Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- BEGIN logs from pod: rook-api-2485995279-lrlf5
- 2017-07-11 13:24:20.905540 I | cephmon: parsing mon endpoints: rook-ceph-mon1=10.233.99.4:6790,rook-ceph-mon2=10.233.124.3:6790,rook-ceph-mon0=10.233.76.3:6790
- 2017-07-11 13:24:20.905897 I | cephmon: writing config file /var/lib/rook/rook/rook.config
- 2017-07-11 13:24:20.906057 I | cephmon: generated admin config in /var/lib/rook/rook
- 2017-07-11 13:25:43.270965 I | api: 4ef947f1-5f5d-4a6a-baf9-9854a2b75d01 GET /client GetClientAccessInfo (start)
- 2017-07-11 13:25:43.271261 I | exec: Running command: ceph mon_status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/008625542
- 2017-07-11 13:25:43.917609 I | exec: Running command: ceph auth get-key client.admin --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/203031853
- 2017-07-11 13:25:44.805958 I | api: 4ef947f1-5f5d-4a6a-baf9-9854a2b75d01 GET /client GetClientAccessInfo 200 OK 1.534990948s
- 2017-07-11 13:26:37.943591 I | api: e88570dd-56ff-435f-bfa5-b8743a341da5 GET /status GetStatusDetails (start)
- 2017-07-11 13:26:37.943917 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/481367208
- 2017-07-11 13:26:38.353768 I | api: e88570dd-56ff-435f-bfa5-b8743a341da5 GET /status GetStatusDetails 200 OK 410.184055ms
- 2017-07-11 13:26:46.067271 I | api: 8988e573-6ddf-4ff0-8156-4452493d8f52 GET /status GetStatusDetails (start)
- 2017-07-11 13:26:46.067577 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/515929063
- 2017-07-11 13:26:46.510512 I | api: 8988e573-6ddf-4ff0-8156-4452493d8f52 GET /status GetStatusDetails 200 OK 443.243695ms
- 2017-07-11 13:27:19.982532 I | api: 851a1235-c7da-4e71-9823-9682f2982812 GET /status GetStatusDetails (start)
- 2017-07-11 13:27:19.982785 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/421626394
- 2017-07-11 13:27:20.393982 I | api: 851a1235-c7da-4e71-9823-9682f2982812 GET /status GetStatusDetails 200 OK 411.452931ms
- 2017-07-11 13:28:42.545208 I | api: 330f53b3-16b9-4961-966e-aeed6d19a211 GET /status GetStatusDetails (start)
- 2017-07-11 13:28:42.545490 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/649810609
- 2017-07-11 13:28:43.276234 I | api: 330f53b3-16b9-4961-966e-aeed6d19a211 GET /status GetStatusDetails 200 OK 731.028677ms
- 2017-07-11 13:28:50.553433 I | api: 34b8dab0-da55-4499-b6da-ec07a6d48deb GET /status GetStatusDetails (start)
- 2017-07-11 13:28:50.553759 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/842429020
- 2017-07-11 13:28:51.004742 I | api: 34b8dab0-da55-4499-b6da-ec07a6d48deb GET /status GetStatusDetails 200 OK 451.320655ms
- 2017-07-11 13:28:54.677392 I | api: 90a0693d-e748-46f8-a712-2d5501daafba GET /status GetStatusDetails (start)
- 2017-07-11 13:28:54.677693 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/780785163
- 2017-07-11 13:28:55.097606 I | api: 90a0693d-e748-46f8-a712-2d5501daafba GET /status GetStatusDetails 200 OK 420.215544ms
- 2017-07-11 13:30:14.115737 I | api: 2dcacf7b-8cdf-4900-8aae-830835cb2e4b GET /status GetStatusDetails (start)
- 2017-07-11 13:30:14.116029 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/182447598
- 2017-07-11 13:30:14.543997 I | api: 2dcacf7b-8cdf-4900-8aae-830835cb2e4b GET /status GetStatusDetails 200 OK 428.264164ms
- 2017-07-11 13:30:55.421280 I | api: 2169cf28-758a-4108-a606-9b46b4c96fda GET /status GetStatusDetails (start)
- 2017-07-11 13:30:55.421555 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/888900213
- 2017-07-11 13:30:55.855533 I | api: 2169cf28-758a-4108-a606-9b46b4c96fda GET /status GetStatusDetails 200 OK 434.257264ms
- 2017-07-11 13:30:59.047574 I | api: fec6615a-2000-4b26-8bf8-5dc46141a8c4 GET /status GetStatusDetails (start)
- 2017-07-11 13:30:59.047697 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/256346448
- 2017-07-11 13:30:59.504941 I | api: fec6615a-2000-4b26-8bf8-5dc46141a8c4 GET /status GetStatusDetails 200 OK 457.370724ms
- 2017-07-11 14:00:07.603018 I | api: 23acd67b-21a0-438d-be5b-781a622a37f6 GET /status GetStatusDetails (start)
- 2017-07-11 14:00:07.603188 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/343339631
- 2017-07-11 14:00:08.024974 I | api: 23acd67b-21a0-438d-be5b-781a622a37f6 GET /status GetStatusDetails 200 OK 421.958786ms
- 2017-07-11 14:00:41.445101 I | api: 8bedd31b-da6f-4d2b-a0f2-4e2ee6013726 GET /status GetStatusDetails (start)
- 2017-07-11 14:00:41.445235 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/683388674
- 2017-07-11 14:00:41.860170 I | api: 8bedd31b-da6f-4d2b-a0f2-4e2ee6013726 GET /status GetStatusDetails 200 OK 415.073401ms
- 2017-07-11 14:00:44.247977 I | api: f8179abd-d239-4dec-bb09-9ff8005a86fe GET /status GetStatusDetails (start)
- 2017-07-11 14:00:44.248083 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/127149689
- 2017-07-11 14:00:44.689035 I | api: f8179abd-d239-4dec-bb09-9ff8005a86fe GET /status GetStatusDetails 200 OK 441.063021ms
- 2017-07-11 14:00:45.976980 I | api: ea7d6221-195d-45a9-9120-bb5433e2e9b4 GET /status GetStatusDetails (start)
- 2017-07-11 14:00:45.977278 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/746541956
- 2017-07-11 14:00:46.396653 I | api: ea7d6221-195d-45a9-9120-bb5433e2e9b4 GET /status GetStatusDetails 200 OK 419.676542ms
- 2017-07-11 14:01:12.323316 I | api: 646b6e23-077a-4ac7-ad69-4b5f3d144d01 GET /status GetStatusDetails (start)
- 2017-07-11 14:01:12.323579 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/479767827
- 2017-07-11 14:01:12.724375 I | api: 646b6e23-077a-4ac7-ad69-4b5f3d144d01 GET /status GetStatusDetails 200 OK 401.062328ms
- 2017-07-11 14:01:16.223276 I | api: 1a6ac8e7-9750-4715-9bde-bf21d5781167 GET /status GetStatusDetails (start)
- 2017-07-11 14:01:16.223585 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/020494166
- 2017-07-11 14:01:16.736109 I | api: 1a6ac8e7-9750-4715-9bde-bf21d5781167 GET /status GetStatusDetails 200 OK 512.836029ms
- 2017-07-11 14:13:28.452253 I | api: c63bef73-b259-47fa-af96-3a7f87be9ad1 GET /status GetStatusDetails (start)
- 2017-07-11 14:13:28.452535 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/348867773
- 2017-07-11 14:13:28.876541 I | api: c63bef73-b259-47fa-af96-3a7f87be9ad1 GET /status GetStatusDetails 200 OK 424.309192ms
- 2017-07-11 14:14:23.355227 I | api: 28e0a772-8bd5-49ff-bcb3-fb8fd54da22d GET /status GetStatusDetails (start)
- 2017-07-11 14:14:23.355506 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/385468664
- 2017-07-11 14:14:23.776364 I | api: 28e0a772-8bd5-49ff-bcb3-fb8fd54da22d GET /status GetStatusDetails 200 OK 421.138493ms
- 2017-07-11 14:14:24.878985 I | api: c7e292ba-bfab-4f6a-997b-9ecd280bb2ce GET /status GetStatusDetails (start)
- 2017-07-11 14:14:24.879227 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/581001207
- 2017-07-11 14:14:25.483132 I | api: c7e292ba-bfab-4f6a-997b-9ecd280bb2ce GET /status GetStatusDetails 200 OK 604.148385ms
- 2017-07-11 14:14:26.589413 I | api: 362d7217-4ce3-4740-b56d-753f4e9993a4 GET /status GetStatusDetails (start)
- 2017-07-11 14:14:26.589723 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/060414698
- 2017-07-11 14:14:27.051874 I | api: 362d7217-4ce3-4740-b56d-753f4e9993a4 GET /status GetStatusDetails 200 OK 462.462192ms
- 2017-07-11 14:14:29.051368 I | api: 35ee4621-3250-48cf-b640-a5e94e8eef36 GET /status GetStatusDetails (start)
- 2017-07-11 14:14:29.051680 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/467859265
- 2017-07-11 14:14:29.486418 I | api: 35ee4621-3250-48cf-b640-a5e94e8eef36 GET /status GetStatusDetails 200 OK 435.052377ms
- 2017-07-11 14:14:37.291000 I | api: fbaabbcf-8e3f-4a69-ac4f-82efc63ac698 GET /status GetStatusDetails (start)
- 2017-07-11 14:14:37.291332 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/195402156
- 2017-07-11 14:14:37.701601 I | api: fbaabbcf-8e3f-4a69-ac4f-82efc63ac698 GET /status GetStatusDetails 200 OK 410.603599ms
- 2017-07-11 14:15:52.319047 I | api: 6027d3e0-6cba-49ee-8bdb-75555ad2b674 GET /metrics GetMetrics (start)
- 2017-07-11 14:15:52.319289 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/878262555
- 2017-07-11 14:15:53.084746 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/758825406
- 2017-07-11 14:15:53.993975 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/624116741
- 2017-07-11 14:15:54.446592 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/832595360
- 2017-07-11 14:15:54.955367 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/528238719
- 2017-07-11 14:15:56.157235 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/236844498
- 2017-07-11 14:15:56.982410 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/388338441
- 2017-07-11 14:15:57.246448 I | api: 7c125395-34eb-4363-835a-d4e134c14377 GET /metrics GetMetrics (start)
- 2017-07-11 14:15:57.570120 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/723927764
- 2017-07-11 14:15:58.190599 I | api: 6027d3e0-6cba-49ee-8bdb-75555ad2b674 GET /metrics GetMetrics 200 OK 5.871552502s
- 2017-07-11 14:15:58.190705 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/850710563
- 2017-07-11 14:15:58.981966 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/771127078
- 2017-07-11 14:15:59.436040 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/747067981
- 2017-07-11 14:15:59.916777 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/888202568
- 2017-07-11 14:16:00.317667 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/649972743
- 2017-07-11 14:16:00.800233 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/222018490
- 2017-07-11 14:16:01.684196 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/383488977
- 2017-07-11 14:16:02.155971 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/208379644
- 2017-07-11 14:16:02.685689 I | api: 7c125395-34eb-4363-835a-d4e134c14377 GET /metrics GetMetrics 200 OK 5.439246259s
- 2017-07-11 14:16:03.841550 I | api: 0a2c6a10-3906-4809-9124-ae6a58b31b9e GET /metrics GetMetrics (start)
- 2017-07-11 14:16:03.842571 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/380477483
- 2017-07-11 14:16:04.350688 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/267697038
- 2017-07-11 14:16:04.806176 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/748990357
- 2017-07-11 14:16:05.316605 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/354512368
- 2017-07-11 14:16:05.703576 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/940551311
- 2017-07-11 14:16:06.132601 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/770879650
- 2017-07-11 14:16:06.718663 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/213836697
- 2017-07-11 14:16:07.155781 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/091290660
- 2017-07-11 14:16:07.583992 I | api: 0a2c6a10-3906-4809-9124-ae6a58b31b9e GET /metrics GetMetrics 200 OK 3.742459045s
- 2017-07-11 14:16:08.777281 I | api: 34d6d5e2-3d55-4893-868e-56f2d2f9a7ae GET /metrics GetMetrics (start)
- 2017-07-11 14:16:08.778302 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/656808243
- 2017-07-11 14:16:09.193192 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/714288886
- 2017-07-11 14:16:09.617242 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/903659997
- 2017-07-11 14:16:10.026420 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/612409240
- 2017-07-11 14:16:10.404287 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/966082583
- 2017-07-11 14:16:10.812500 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/718546058
- 2017-07-11 14:16:11.415180 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/168310369
- 2017-07-11 14:16:11.837449 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/783147084
- 2017-07-11 14:16:12.273442 I | api: 34d6d5e2-3d55-4893-868e-56f2d2f9a7ae GET /metrics GetMetrics 200 OK 3.496166048s
- 2017-07-11 14:16:13.709488 I | api: ab4822d9-7fe0-4882-81cd-b60d3932eb48 GET /metrics GetMetrics (start)
- 2017-07-11 14:16:13.710671 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/389890363
- 2017-07-11 14:16:14.148598 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/035583838
- 2017-07-11 14:16:14.680182 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/976873253
- 2017-07-11 14:16:15.328104 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/965762624
- 2017-07-11 14:16:15.815468 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/175202975
- 2017-07-11 14:16:16.293646 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/675002226
- 2017-07-11 14:16:16.916651 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/153005097
- 2017-07-11 14:16:17.366900 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/686770548
- 2017-07-11 14:16:17.815884 I | api: ab4822d9-7fe0-4882-81cd-b60d3932eb48 GET /metrics GetMetrics 200 OK 4.106377347s
- 2017-07-11 14:16:18.639741 I | api: 3857892a-e579-4ba4-aece-eda7eb41eb71 GET /metrics GetMetrics (start)
- 2017-07-11 14:16:18.640113 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/559777859
- 2017-07-11 14:16:19.169667 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/373094598
- 2017-07-11 14:16:19.631590 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/006976877
- 2017-07-11 14:16:20.035472 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/443024872
- 2017-07-11 14:16:20.636354 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/953117223
- 2017-07-11 14:16:21.276235 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/389320538
- 2017-07-11 14:16:21.750067 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/900897521
- 2017-07-11 14:16:22.274765 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/103484828
- 2017-07-11 14:16:22.754024 I | api: 3857892a-e579-4ba4-aece-eda7eb41eb71 GET /metrics GetMetrics 200 OK 4.114273862s
- 2017-07-11 14:16:23.576021 I | api: fbeaf027-de5c-4366-86ef-4ce4b414573c GET /metrics GetMetrics (start)
- 2017-07-11 14:16:23.576978 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/973358155
- 2017-07-11 14:16:24.121302 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/203188014
- 2017-07-11 14:16:24.598904 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/091251893
- 2017-07-11 14:16:25.261233 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/595712144
- 2017-07-11 14:16:25.740117 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/879302831
- 2017-07-11 14:16:26.673449 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/783412802
- 2017-07-11 14:16:27.134169 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/302512825
- 2017-07-11 14:16:27.596256 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/416688836
- 2017-07-11 14:16:28.328873 I | api: fbeaf027-de5c-4366-86ef-4ce4b414573c GET /metrics GetMetrics 200 OK 4.75285115s
- 2017-07-11 14:16:28.510092 I | api: e1bcc65e-3720-4a45-b704-1fb5229ba179 GET /metrics GetMetrics (start)
- 2017-07-11 14:16:28.510991 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/024983379
- 2017-07-11 14:16:28.976157 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/599474326
- 2017-07-11 14:16:29.475118 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/523445501
- 2017-07-11 14:16:29.922146 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/394422328
- 2017-07-11 14:16:30.321559 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/433519159
- 2017-07-11 14:16:30.804601 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/115704362
- 2017-07-11 14:16:31.281390 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/562576257
- 2017-07-11 14:16:32.161481 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/797476076
- 2017-07-11 14:16:32.670923 I | api: e1bcc65e-3720-4a45-b704-1fb5229ba179 GET /metrics GetMetrics 200 OK 4.160835826s
- 2017-07-11 14:16:33.442961 I | api: e06c5ae4-ead8-47ca-b949-4e44eb9802a3 GET /metrics GetMetrics (start)
- 2017-07-11 14:16:33.444021 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/315471707
- 2017-07-11 14:16:33.916941 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/099955454
- 2017-07-11 14:16:34.456315 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/296895045
- 2017-07-11 14:16:34.915716 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/711670496
- 2017-07-11 14:16:35.793719 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/085350079
- 2017-07-11 14:16:36.284443 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/634469138
- 2017-07-11 14:16:36.796640 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/247420233
- 2017-07-11 14:16:37.266843 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/187660308
- 2017-07-11 14:16:37.767734 I | api: e06c5ae4-ead8-47ca-b949-4e44eb9802a3 GET /metrics GetMetrics 200 OK 4.324804682s
- 2017-07-11 14:16:38.375773 I | api: 63653934-1ab7-4ef8-82e0-cfc896e65951 GET /metrics GetMetrics (start)
- 2017-07-11 14:16:38.376128 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/654642275
- 2017-07-11 14:16:38.824873 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/883965030
- 2017-07-11 14:16:39.297117 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/958800013
- 2017-07-11 14:16:39.791863 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/017359496
- 2017-07-11 14:16:40.175447 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/832051271
- 2017-07-11 14:16:40.620891 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/490629370
- 2017-07-11 14:16:41.120573 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/978506769
- 2017-07-11 14:16:41.584863 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/279684156
- 2017-07-11 14:16:42.052466 I | api: 63653934-1ab7-4ef8-82e0-cfc896e65951 GET /metrics GetMetrics 200 OK 3.676699818s
- 2017-07-11 14:16:43.308995 I | api: b2ff88c0-9957-4a26-8113-2ad5e3275c4d GET /metrics GetMetrics (start)
- 2017-07-11 14:16:43.309874 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/397056619
- 2017-07-11 14:16:43.797249 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/323671246
- 2017-07-11 14:16:44.263280 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/405576661
- 2017-07-11 14:16:44.713460 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/956035376
- 2017-07-11 14:16:45.089871 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/119931087
- 2017-07-11 14:16:45.711689 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/895576034
- 2017-07-11 14:16:46.169804 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/246901721
- 2017-07-11 14:16:46.633866 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/773933924
- 2017-07-11 14:16:47.099866 I | api: b2ff88c0-9957-4a26-8113-2ad5e3275c4d GET /metrics GetMetrics 200 OK 3.790872438s
- 2017-07-11 14:16:48.239213 I | api: 3c721f3d-beec-4109-88e3-0d73aefcf798 GET /metrics GetMetrics (start)
- 2017-07-11 14:16:48.240102 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/096522611
- 2017-07-11 14:16:48.985590 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/845371446
- 2017-07-11 14:16:49.458764 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/633739293
- 2017-07-11 14:16:49.904643 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/086450904
- 2017-07-11 14:16:50.326607 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/329134167
- 2017-07-11 14:16:50.854084 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/128388554
- 2017-07-11 14:16:51.700111 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/118504609
- 2017-07-11 14:16:52.184364 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/978231692
- 2017-07-11 14:16:52.646741 I | api: 3c721f3d-beec-4109-88e3-0d73aefcf798 GET /metrics GetMetrics 200 OK 4.407526077s
- 2017-07-11 14:16:53.171306 I | api: 2aa70104-3295-4c85-be68-0276e23d6603 GET /metrics GetMetrics (start)
- 2017-07-11 14:16:53.172219 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/673674107
- 2017-07-11 14:16:53.634712 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/165349534
- 2017-07-11 14:16:54.121204 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/187223909
- 2017-07-11 14:16:54.581213 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/193502592
- 2017-07-11 14:16:55.032793 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/936925919
- 2017-07-11 14:16:55.588287 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/852846258
- 2017-07-11 14:16:56.045421 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/290426473
- 2017-07-11 14:16:56.523024 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/634406580
- 2017-07-11 14:16:57.034515 I | api: 2aa70104-3295-4c85-be68-0276e23d6603 GET /metrics GetMetrics 200 OK 3.863207544s
- 2017-07-11 14:16:58.102143 I | api: e8ea65c5-54ed-4618-89a8-80b78cc3beb9 GET /metrics GetMetrics (start)
- 2017-07-11 14:16:58.103094 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/197280387
- 2017-07-11 14:16:58.574818 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/130492422
- 2017-07-11 14:16:59.070866 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/740107693
- 2017-07-11 14:16:59.523364 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/302083368
- 2017-07-11 14:16:59.972282 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/834314343
- 2017-07-11 14:17:00.340757 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/744231578
- 2017-07-11 14:17:00.817020 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/628057905
- 2017-07-11 14:17:01.315681 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/792075996
- 2017-07-11 14:17:01.852160 I | api: e8ea65c5-54ed-4618-89a8-80b78cc3beb9 GET /metrics GetMetrics 200 OK 3.750023264s
- 2017-07-11 14:17:03.031779 I | api: 3a6b731a-f554-40f1-9315-ca27f4234ce2 GET /metrics GetMetrics (start)
- 2017-07-11 14:17:03.032754 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/113860235
- 2017-07-11 14:17:03.594142 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/868698222
- 2017-07-11 14:17:04.073714 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/670738165
- 2017-07-11 14:17:04.604147 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/263308752
- 2017-07-11 14:17:05.054599 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/616140015
- 2017-07-11 14:17:05.631137 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/785663362
- 2017-07-11 14:17:06.107397 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/578448633
- 2017-07-11 14:17:06.600223 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/959833092
- 2017-07-11 14:17:07.373651 I | api: 3a6b731a-f554-40f1-9315-ca27f4234ce2 GET /metrics GetMetrics 200 OK 4.341875986s
- 2017-07-11 14:17:07.967015 I | api: 1669bd0f-2c97-40e0-9f45-1cbce179bf38 GET /metrics GetMetrics (start)
- 2017-07-11 14:17:07.967886 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/155796883
- 2017-07-11 14:17:08.533581 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/198749142
- 2017-07-11 14:17:09.037705 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/821585213
- 2017-07-11 14:17:09.493223 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/862789496
- 2017-07-11 14:17:09.966719 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/549666935
- 2017-07-11 14:17:10.345310 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/169189226
- 2017-07-11 14:17:10.805007 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/539213761
- 2017-07-11 14:17:11.326530 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/138219052
- 2017-07-11 14:17:11.842131 I | api: 1669bd0f-2c97-40e0-9f45-1cbce179bf38 GET /metrics GetMetrics 200 OK 3.875115701s
- 2017-07-11 14:17:12.896384 I | api: 0c75b4b6-0e6b-4e20-8b45-549587edff9f GET /metrics GetMetrics (start)
- 2017-07-11 14:17:12.897245 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/402790299
- 2017-07-11 14:17:13.356191 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/760041534
- 2017-07-11 14:17:13.823001 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/969979525
- 2017-07-11 14:17:14.304387 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/501277728
- 2017-07-11 14:17:14.924738 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/106576127
- 2017-07-11 14:17:15.404633 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/981506130
- 2017-07-11 14:17:15.869476 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/578588041
- 2017-07-11 14:17:16.313558 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/245199700
- 2017-07-11 14:17:16.778770 I | api: 0c75b4b6-0e6b-4e20-8b45-549587edff9f GET /metrics GetMetrics 200 OK 3.882392356s
- 2017-07-11 14:17:17.831762 I | api: 959d7024-d1ec-4af4-9278-adc9e3fc2ad2 GET /metrics GetMetrics (start)
- 2017-07-11 14:17:17.832999 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/726843043
- 2017-07-11 14:17:18.340977 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/926944166
- 2017-07-11 14:17:18.785564 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/534900941
- 2017-07-11 14:17:19.281885 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/692326856
- 2017-07-11 14:17:19.821093 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/648296583
- 2017-07-11 14:17:20.327729 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/019603514
- 2017-07-11 14:17:20.796104 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/686497361
- 2017-07-11 14:17:21.319318 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/473753980
- 2017-07-11 14:17:21.809172 I | api: 959d7024-d1ec-4af4-9278-adc9e3fc2ad2 GET /metrics GetMetrics 200 OK 3.977415183s
- 2017-07-11 14:17:22.760892 I | api: 9e3e5f61-bc22-4674-b35c-8b4075b886bd GET /metrics GetMetrics (start)
- 2017-07-11 14:17:22.761705 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/095616171
- 2017-07-11 14:17:23.307679 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/212817422
- 2017-07-11 14:17:23.784649 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/289620501
- 2017-07-11 14:17:24.256701 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/312194160
- 2017-07-11 14:17:24.759099 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/609967887
- 2017-07-11 14:17:25.190252 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/225609506
- 2017-07-11 14:17:25.775699 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/211353113
- 2017-07-11 14:17:26.218832 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/991639716
- 2017-07-11 14:17:26.685223 I | api: 9e3e5f61-bc22-4674-b35c-8b4075b886bd GET /metrics GetMetrics 200 OK 3.924333872s
- 2017-07-11 14:17:27.696991 I | api: 97817285-01de-44c0-8ba8-e42df03c4e42 GET /metrics GetMetrics (start)
- 2017-07-11 14:17:27.697810 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/849253299
- 2017-07-11 14:17:28.157983 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/983824246
- 2017-07-11 14:17:28.619060 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/425490525
- 2017-07-11 14:17:29.124895 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/191920664
- 2017-07-11 14:17:29.647054 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/132707479
- 2017-07-11 14:17:30.086567 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/301886730
- 2017-07-11 14:17:30.471804 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/942961889
- 2017-07-11 14:17:30.987448 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/573271244
- 2017-07-11 14:17:31.469667 I | api: 97817285-01de-44c0-8ba8-e42df03c4e42 GET /metrics GetMetrics 200 OK 3.772676121s
- 2017-07-11 14:17:32.627471 I | api: d759f417-e3e9-4a29-b4f2-38299bbb27fe GET /metrics GetMetrics (start)
- 2017-07-11 14:17:32.628298 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/770803643
- 2017-07-11 14:17:33.078732 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/252336606
- 2017-07-11 14:17:33.541418 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/866228645
- 2017-07-11 14:17:34.000594 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/281784512
- 2017-07-11 14:17:34.455102 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/554247967
- 2017-07-11 14:17:34.921411 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/470494706
- 2017-07-11 14:17:35.411365 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/791223465
- 2017-07-11 14:17:35.861398 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/393905140
- 2017-07-11 14:17:36.329707 I | api: d759f417-e3e9-4a29-b4f2-38299bbb27fe GET /metrics GetMetrics 200 OK 3.702234913s
- 2017-07-11 14:17:37.561610 I | api: 1a625859-6871-454d-8412-07c70f7029bb GET /metrics GetMetrics (start)
- 2017-07-11 14:17:37.562550 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/554622659
- 2017-07-11 14:17:38.023497 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/549937478
- 2017-07-11 14:17:38.478456 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/983676909
- 2017-07-11 14:17:38.936155 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/992506472
- 2017-07-11 14:17:39.454112 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/103238823
- 2017-07-11 14:17:39.913388 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/722313178
- 2017-07-11 14:17:40.303686 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/815976817
- 2017-07-11 14:17:40.797186 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/345872412
- 2017-07-11 14:17:41.286237 I | api: 1a625859-6871-454d-8412-07c70f7029bb GET /metrics GetMetrics 200 OK 3.724632239s
- 2017-07-11 14:17:42.493956 I | api: e6a0cc2e-bf4d-4c10-85c6-4d09ed9fb473 GET /metrics GetMetrics (start)
- 2017-07-11 14:17:42.494935 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/528764107
- 2017-07-11 14:17:42.939662 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/045443502
- 2017-07-11 14:17:43.394937 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/564054837
- 2017-07-11 14:17:43.845132 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/454123280
- 2017-07-11 14:17:44.294480 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/041852719
- 2017-07-11 14:17:44.835012 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/375957186
- 2017-07-11 14:17:45.348143 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/737536313
- 2017-07-11 14:17:45.794810 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/337249604
- 2017-07-11 14:17:46.234015 I | api: e6a0cc2e-bf4d-4c10-85c6-4d09ed9fb473 GET /metrics GetMetrics 200 OK 3.740049483s
- 2017-07-11 14:17:47.425138 I | api: 7c0b9979-6888-4974-9e5d-901713910d80 GET /metrics GetMetrics (start)
- 2017-07-11 14:17:47.425376 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/595480531
- 2017-07-11 14:17:47.881625 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/692196118
- 2017-07-11 14:17:48.315532 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/240458621
- 2017-07-11 14:17:48.754856 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/771743928
- 2017-07-11 14:17:49.256198 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/846631095
- 2017-07-11 14:17:49.731435 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/946483882
- 2017-07-11 14:17:50.198295 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/388310529
- 2017-07-11 14:17:50.646260 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/882380140
- 2017-07-11 14:17:51.148319 I | api: 7c0b9979-6888-4974-9e5d-901713910d80 GET /metrics GetMetrics 200 OK 3.723183359s
- 2017-07-11 14:17:52.359105 I | api: b5db399d-c37c-4dfc-8e25-693dd98f79f1 GET /metrics GetMetrics (start)
- 2017-07-11 14:17:52.360066 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/440159195
- 2017-07-11 14:17:52.830198 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/210307966
- 2017-07-11 14:17:53.283879 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/111083205
- 2017-07-11 14:17:54.031998 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/443614048
- 2017-07-11 14:17:54.512304 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/938288447
- 2017-07-11 14:17:54.963617 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/863498642
- 2017-07-11 14:17:55.492593 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/990405577
- 2017-07-11 14:17:55.923987 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/379867284
- 2017-07-11 14:17:56.376224 I | api: b5db399d-c37c-4dfc-8e25-693dd98f79f1 GET /metrics GetMetrics 200 OK 4.017117109s
- 2017-07-11 14:17:57.292613 I | api: f068c17a-5f63-4df7-b2e2-1af86ba00b0e GET /metrics GetMetrics (start)
- 2017-07-11 14:17:57.293860 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/648955107
- 2017-07-11 14:17:57.790601 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/558570214
- 2017-07-11 14:17:58.234304 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/888461581
- 2017-07-11 14:17:58.696800 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/121357576
- 2017-07-11 14:17:59.194685 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/579297991
- 2017-07-11 14:17:59.666451 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/024216442
- 2017-07-11 14:18:00.103580 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/618951313
- 2017-07-11 14:18:00.603358 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/207580860
- 2017-07-11 14:18:01.041735 I | api: f068c17a-5f63-4df7-b2e2-1af86ba00b0e GET /metrics GetMetrics 200 OK 3.749126663s
- 2017-07-11 14:18:02.224685 I | api: a16359b5-9ea5-48a2-9a92-8c2ba12bdb51 GET /metrics GetMetrics (start)
- 2017-07-11 14:18:02.225647 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/224401643
- 2017-07-11 14:18:02.675993 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/485955406
- 2017-07-11 14:18:03.168777 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/694819413
- 2017-07-11 14:18:03.614827 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/007362992
- 2017-07-11 14:18:04.072706 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/730501455
- 2017-07-11 14:18:04.554544 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/016053346
- 2017-07-11 14:18:05.017036 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/131673689
- 2017-07-11 14:18:05.538925 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/979972068
- 2017-07-11 14:18:05.967582 I | api: a16359b5-9ea5-48a2-9a92-8c2ba12bdb51 GET /metrics GetMetrics 200 OK 3.742890302s
- 2017-07-11 14:18:07.158533 I | api: 508fc27d-7b30-44b5-a7ce-1e9ac5908264 GET /metrics GetMetrics (start)
- 2017-07-11 14:18:07.159304 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/765078003
- 2017-07-11 14:18:07.656760 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/982846646
- 2017-07-11 14:18:08.109855 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/517989021
- 2017-07-11 14:18:08.556909 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/594346840
- 2017-07-11 14:18:09.031849 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/420794583
- 2017-07-11 14:18:09.488164 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/059075146
- 2017-07-11 14:18:09.940319 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/464059169
- 2017-07-11 14:18:10.311010 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/327434764
- 2017-07-11 14:18:10.773312 I | api: 508fc27d-7b30-44b5-a7ce-1e9ac5908264 GET /metrics GetMetrics 200 OK 3.614773164s
- 2017-07-11 14:18:12.090643 I | api: a46c0f74-56b2-4984-8b9e-8c7eb24c4c23 GET /metrics GetMetrics (start)
- 2017-07-11 14:18:12.091496 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/813058043
- 2017-07-11 14:18:12.544912 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/042058526
- 2017-07-11 14:18:13.116295 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/723504101
- 2017-07-11 14:18:13.637017 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/862192640
- 2017-07-11 14:18:14.140608 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/205378911
- 2017-07-11 14:18:14.635447 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/797845298
- 2017-07-11 14:18:15.085540 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/505863401
- 2017-07-11 14:18:15.636808 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/543007540
- 2017-07-11 14:18:16.080020 I | api: a46c0f74-56b2-4984-8b9e-8c7eb24c4c23 GET /metrics GetMetrics 200 OK 3.98937892s
- 2017-07-11 14:18:17.022984 I | api: dc099be7-95ce-4db1-adfc-d0ddb86026e0 GET /metrics GetMetrics (start)
- 2017-07-11 14:18:17.023933 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/750317827
- 2017-07-11 14:18:17.680896 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/679322758
- 2017-07-11 14:18:18.115601 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/802744365
- 2017-07-11 14:18:18.602693 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/816967080
- 2017-07-11 14:18:19.139813 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/482383591
- 2017-07-11 14:18:19.669012 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/928228122
- 2017-07-11 14:18:20.137586 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/113015729
- 2017-07-11 14:18:20.550270 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/161187676
- 2017-07-11 14:18:21.039339 I | api: dc099be7-95ce-4db1-adfc-d0ddb86026e0 GET /metrics GetMetrics 200 OK 4.016347208s
- 2017-07-11 14:18:21.955357 I | api: e45c04fc-238d-4915-88cc-5b209a7aac52 GET /metrics GetMetrics (start)
- 2017-07-11 14:18:21.956261 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/913251595
- 2017-07-11 14:18:22.483248 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/673630958
- 2017-07-11 14:18:23.002159 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/191704949
- 2017-07-11 14:18:23.559177 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/846949968
- 2017-07-11 14:18:24.089273 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/603086191
- 2017-07-11 14:18:24.529848 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/608820226
- 2017-07-11 14:18:25.055444 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/636096889
- 2017-07-11 14:18:25.616276 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/763824260
- 2017-07-11 14:18:26.176567 I | api: e45c04fc-238d-4915-88cc-5b209a7aac52 GET /metrics GetMetrics 200 OK 4.221210221s
- 2017-07-11 14:18:26.887959 I | api: 4b02a7ed-888d-4ab1-b2a5-7b74e135371d GET /metrics GetMetrics (start)
- 2017-07-11 14:18:26.888926 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/615884819
- 2017-07-11 14:18:27.469303 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/207303766
- 2017-07-11 14:18:27.915936 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/556011965
- 2017-07-11 14:18:28.357797 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/766135800
- 2017-07-11 14:18:28.849411 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/315340023
- 2017-07-11 14:18:29.315537 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/951977450
- 2017-07-11 14:18:29.830018 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/584212545
- 2017-07-11 14:18:30.266959 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/178515628
- 2017-07-11 14:18:30.741434 I | api: 4b02a7ed-888d-4ab1-b2a5-7b74e135371d GET /metrics GetMetrics 200 OK 3.853481013s
- 2017-07-11 14:18:31.819305 I | api: c23b8553-8459-416b-9a6d-9803a4529a58 GET /metrics GetMetrics (start)
- 2017-07-11 14:18:31.820259 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/096228379
- 2017-07-11 14:18:32.281496 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/880622782
- 2017-07-11 14:18:32.774934 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/146562821
- 2017-07-11 14:18:33.224937 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/264683680
- 2017-07-11 14:18:33.667772 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/000600447
- 2017-07-11 14:18:34.177393 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/414568146
- 2017-07-11 14:18:34.621647 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/755112969
- 2017-07-11 14:18:35.114917 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/263824340
- 2017-07-11 14:18:35.765251 I | api: c23b8553-8459-416b-9a6d-9803a4529a58 GET /metrics GetMetrics 200 OK 3.945937798s
- 2017-07-11 14:18:36.752892 I | api: 390edb34-4586-4ae7-b348-3dfb76d81805 GET /metrics GetMetrics (start)
- 2017-07-11 14:18:36.754174 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/666297123
- 2017-07-11 14:18:37.227171 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/511090726
- 2017-07-11 14:18:37.756520 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/326445389
- 2017-07-11 14:18:38.202029 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/406577224
- 2017-07-11 14:18:38.679491 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/179386631
- 2017-07-11 14:18:39.154461 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/498518202
- 2017-07-11 14:18:39.631136 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/961101009
- 2017-07-11 14:18:40.092477 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/971898364
- 2017-07-11 14:18:40.491691 I | api: 390edb34-4586-4ae7-b348-3dfb76d81805 GET /metrics GetMetrics 200 OK 3.738794212s
- 2017-07-11 14:18:41.684976 I | api: 328286c5-ad93-4f18-896c-6c2a0f2b75b0 GET /metrics GetMetrics (start)
- 2017-07-11 14:18:41.685860 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/835596587
- 2017-07-11 14:18:42.144562 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/472679566
- 2017-07-11 14:18:42.591707 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/873514645
- 2017-07-11 14:18:43.060067 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/109723376
- 2017-07-11 14:18:43.523362 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/170080655
- 2017-07-11 14:18:43.959998 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/120886178
- 2017-07-11 14:18:44.544454 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/696022681
- 2017-07-11 14:18:45.004214 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/048236836
- 2017-07-11 14:18:45.556334 I | api: 328286c5-ad93-4f18-896c-6c2a0f2b75b0 GET /metrics GetMetrics 200 OK 3.871358222s
- 2017-07-11 14:18:46.617324 I | api: c1b674e9-35c0-4841-be36-26e4f9752323 GET /metrics GetMetrics (start)
- 2017-07-11 14:18:46.618102 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/062783539
- 2017-07-11 14:18:47.059012 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/474412534
- 2017-07-11 14:18:47.535956 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/519019229
- 2017-07-11 14:18:48.085893 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/917901464
- 2017-07-11 14:18:48.543081 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/131260183
- 2017-07-11 14:18:49.068003 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/883664778
- 2017-07-11 14:18:49.659055 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/398046049
- 2017-07-11 14:18:50.144863 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/073633100
- 2017-07-11 14:18:50.558468 I | api: c1b674e9-35c0-4841-be36-26e4f9752323 GET /metrics GetMetrics 200 OK 3.941136775s
- 2017-07-11 14:18:51.551249 I | api: 833244db-6e2f-4b35-bc5a-e0f7217e0b21 GET /metrics GetMetrics (start)
- 2017-07-11 14:18:51.552187 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/710990907
- 2017-07-11 14:18:52.038473 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/468868702
- 2017-07-11 14:18:52.490421 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/722277925
- 2017-07-11 14:18:52.965308 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/345085760
- 2017-07-11 14:18:53.402566 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/257368479
- 2017-07-11 14:18:53.878724 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/063439474
- 2017-07-11 14:18:54.504672 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/538424617
- 2017-07-11 14:18:54.962628 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/848295028
- 2017-07-11 14:18:55.507354 I | api: 833244db-6e2f-4b35-bc5a-e0f7217e0b21 GET /metrics GetMetrics 200 OK 3.956102425s
- 2017-07-11 14:18:56.483353 I | api: 806e22f1-adc8-4838-bb66-4124ae60167c GET /metrics GetMetrics (start)
- 2017-07-11 14:18:56.484312 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/976620867
- 2017-07-11 14:18:56.955252 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/935250374
- 2017-07-11 14:18:57.409036 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/926046317
- 2017-07-11 14:18:57.875001 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/151879912
- 2017-07-11 14:18:58.454020 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/062950695
- 2017-07-11 14:18:58.975846 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/745413722
- 2017-07-11 14:18:59.449410 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/241277937
- 2017-07-11 14:18:59.981644 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/413109916
- 2017-07-11 14:19:00.405429 I | api: 806e22f1-adc8-4838-bb66-4124ae60167c GET /metrics GetMetrics 200 OK 3.922059743s
- 2017-07-11 14:19:01.416459 I | api: 5182e28c-53ea-4278-bb33-f8ed181ca1a9 GET /metrics GetMetrics (start)
- 2017-07-11 14:19:01.416812 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/151344459
- 2017-07-11 14:19:01.891008 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/472242222
- 2017-07-11 14:19:02.523047 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/047933365
- 2017-07-11 14:19:02.999473 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/899357584
- 2017-07-11 14:19:03.458602 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/935325615
- 2017-07-11 14:19:03.924840 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/612520258
- 2017-07-11 14:19:04.389390 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/614258617
- 2017-07-11 14:19:04.902171 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/348315588
- 2017-07-11 14:19:05.310055 I | api: 5182e28c-53ea-4278-bb33-f8ed181ca1a9 GET /metrics GetMetrics 200 OK 3.893597331s
- 2017-07-11 14:19:06.348705 I | api: c51ddc8f-43c9-4386-ac76-fad3b4419321 GET /metrics GetMetrics (start)
- 2017-07-11 14:19:06.349635 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/382732883
- 2017-07-11 14:19:06.813460 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/470465942
- 2017-07-11 14:19:07.269234 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/322966013
- 2017-07-11 14:19:07.733770 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/974622520
- 2017-07-11 14:19:08.200490 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/610398519
- 2017-07-11 14:19:08.823833 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/058768170
- 2017-07-11 14:19:09.277480 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/969974913
- 2017-07-11 14:19:09.739810 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/953956332
- 2017-07-11 14:19:10.243690 I | api: c51ddc8f-43c9-4386-ac76-fad3b4419321 GET /metrics GetMetrics 200 OK 3.894990207s
- 2017-07-11 14:19:11.281190 I | api: 197aa9a1-bf3b-4f65-a005-b2a6b9d6e58c GET /metrics GetMetrics (start)
- 2017-07-11 14:19:11.282183 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/408356955
- 2017-07-11 14:19:11.751318 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/684661246
- 2017-07-11 14:19:12.279209 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/396647749
- 2017-07-11 14:19:12.721783 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/354167264
- 2017-07-11 14:19:13.243785 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/197432767
- 2017-07-11 14:19:13.785897 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/367741458
- 2017-07-11 14:19:14.251910 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/628757577
- 2017-07-11 14:19:14.800161 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/642973972
- 2017-07-11 14:19:15.257125 I | api: 197aa9a1-bf3b-4f65-a005-b2a6b9d6e58c GET /metrics GetMetrics 200 OK 3.97592327s
- 2017-07-11 14:19:16.213490 I | api: 39b6ca00-dc3c-44bf-84f0-14c5e1af1bee GET /metrics GetMetrics (start)
- 2017-07-11 14:19:16.214172 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/918060387
- 2017-07-11 14:19:16.733012 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/295527782
- 2017-07-11 14:19:17.186462 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/114459533
- 2017-07-11 14:19:17.618859 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/313787784
- 2017-07-11 14:19:18.109167 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/781668167
- 2017-07-11 14:19:18.611554 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/920366074
- 2017-07-11 14:19:19.190231 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/676953361
- 2017-07-11 14:19:19.672672 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/036214588
- 2017-07-11 14:19:20.177862 I | api: 39b6ca00-dc3c-44bf-84f0-14c5e1af1bee GET /metrics GetMetrics 200 OK 3.964375454s
- 2017-07-11 14:19:21.146238 I | api: 32bb5d56-78c2-4ae5-83e5-04cb60911f08 GET /metrics GetMetrics (start)
- 2017-07-11 14:19:21.147085 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/234995563
- 2017-07-11 14:19:21.645720 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/281358798
- 2017-07-11 14:19:22.132491 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/446756565
- 2017-07-11 14:19:22.600862 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/466231344
- 2017-07-11 14:19:23.120429 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/396028879
- 2017-07-11 14:19:23.544900 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/647697634
- 2017-07-11 14:19:24.016774 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/781399257
- 2017-07-11 14:19:24.467191 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/989547108
- 2017-07-11 14:19:24.934461 I | api: 32bb5d56-78c2-4ae5-83e5-04cb60911f08 GET /metrics GetMetrics 200 OK 3.788212592s
- 2017-07-11 14:19:26.078631 I | api: 3d2d8611-b57c-4b5a-aa85-be72a51b956d GET /metrics GetMetrics (start)
- 2017-07-11 14:19:26.079303 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/034898547
- 2017-07-11 14:19:26.577541 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/459204918
- 2017-07-11 14:19:27.046423 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/930238237
- 2017-07-11 14:19:27.511657 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/385661912
- 2017-07-11 14:19:28.018019 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/750547287
- 2017-07-11 14:19:28.463751 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/038141130
- 2017-07-11 14:19:28.907508 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/714783137
- 2017-07-11 14:19:29.442642 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/128584332
- 2017-07-11 14:19:29.895965 I | api: 3d2d8611-b57c-4b5a-aa85-be72a51b956d GET /metrics GetMetrics 200 OK 3.817337596s
- 2017-07-11 14:19:31.010624 I | api: 61eb656e-9af6-40e8-a849-da5dc5a09543 GET /metrics GetMetrics (start)
- 2017-07-11 14:19:31.011526 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/743864955
- 2017-07-11 14:19:31.475225 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/425764254
- 2017-07-11 14:19:31.945100 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/719650405
- 2017-07-11 14:19:32.385372 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/509531776
- 2017-07-11 14:19:32.951875 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/035910111
- 2017-07-11 14:19:33.446806 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/274593202
- 2017-07-11 14:19:33.910838 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/886858089
- 2017-07-11 14:19:34.356607 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/034992564
- 2017-07-11 14:19:34.824213 I | api: 61eb656e-9af6-40e8-a849-da5dc5a09543 GET /metrics GetMetrics 200 OK 3.813593382s
- 2017-07-11 14:19:35.942704 I | api: b466cca8-3dda-4c08-8d5f-746480941662 GET /metrics GetMetrics (start)
- 2017-07-11 14:19:35.952420 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/499528579
- 2017-07-11 14:19:36.459155 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/218129670
- 2017-07-11 14:19:36.925481 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/861093549
- 2017-07-11 14:19:37.347925 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/562499624
- 2017-07-11 14:19:37.836057 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/419949415
- 2017-07-11 14:19:38.259774 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/336081818
- 2017-07-11 14:19:38.763954 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/406673969
- 2017-07-11 14:19:39.227785 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/465567196
- 2017-07-11 14:19:39.701158 I | api: b466cca8-3dda-4c08-8d5f-746480941662 GET /metrics GetMetrics 200 OK 3.758458827s
- 2017-07-11 14:19:40.874370 I | api: b7e358ce-6516-43f8-94d6-3a78d3c55677 GET /metrics GetMetrics (start)
- 2017-07-11 14:19:40.875380 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/380675467
- 2017-07-11 14:19:41.313972 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/939033454
- 2017-07-11 14:19:41.974186 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/995694069
- 2017-07-11 14:19:42.429373 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/732591312
- 2017-07-11 14:19:42.896591 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/337732591
- 2017-07-11 14:19:43.381154 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/589066882
- 2017-07-11 14:19:43.832429 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/675826169
- 2017-07-11 14:19:44.282857 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/158125828
- 2017-07-11 14:19:44.771348 I | api: b7e358ce-6516-43f8-94d6-3a78d3c55677 GET /metrics GetMetrics 200 OK 3.896965315s
- 2017-07-11 14:19:45.806563 I | api: d15cf34c-3131-49d9-81c5-92c3626e61e3 GET /metrics GetMetrics (start)
- 2017-07-11 14:19:45.807340 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/430456979
- 2017-07-11 14:19:46.270508 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/166720214
- 2017-07-11 14:19:46.718348 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/464750653
- 2017-07-11 14:19:47.813148 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/894570616
- 2017-07-11 14:19:48.274412 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/280284023
- 2017-07-11 14:19:48.831451 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/623761514
- 2017-07-11 14:19:49.327090 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/462394561
- 2017-07-11 14:19:49.865788 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/799709484
- 2017-07-11 14:19:50.345503 I | api: d15cf34c-3131-49d9-81c5-92c3626e61e3 GET /metrics GetMetrics 200 OK 4.538954395s
- 2017-07-11 14:19:50.738401 I | api: 304d6de4-734e-498c-9424-898f9b060c80 GET /metrics GetMetrics (start)
- 2017-07-11 14:19:50.739365 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/897711259
- 2017-07-11 14:19:51.180675 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/609840446
- 2017-07-11 14:19:51.828596 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/845243781
- 2017-07-11 14:19:52.270318 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/585552672
- 2017-07-11 14:19:52.747802 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/096382463
- 2017-07-11 14:19:53.345258 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/119721810
- 2017-07-11 14:19:53.876105 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/441128585
- 2017-07-11 14:19:54.345135 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/336961108
- 2017-07-11 14:19:54.810915 I | api: 304d6de4-734e-498c-9424-898f9b060c80 GET /metrics GetMetrics 200 OK 4.072515549s
- 2017-07-11 14:19:55.670785 I | api: f3ae668b-5ee5-4fe6-94ff-204c2cf38528 GET /metrics GetMetrics (start)
- 2017-07-11 14:19:55.671622 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/797047203
- 2017-07-11 14:19:56.148428 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/496645286
- 2017-07-11 14:19:56.600942 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/591853005
- 2017-07-11 14:19:57.040250 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/682533064
- 2017-07-11 14:19:57.485928 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/498022791
- 2017-07-11 14:19:57.969545 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/136326458
- 2017-07-11 14:19:58.445882 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/804257105
- 2017-07-11 14:19:58.911573 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/333714044
- 2017-07-11 14:19:59.407766 I | api: f3ae668b-5ee5-4fe6-94ff-204c2cf38528 GET /metrics GetMetrics 200 OK 3.736979971s
- 2017-07-11 14:20:00.603135 I | api: dd76dc8b-185a-4565-b7fb-a47037300e9a GET /metrics GetMetrics (start)
- 2017-07-11 14:20:00.604038 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/507167659
- 2017-07-11 14:20:01.053040 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/094103822
- 2017-07-11 14:20:01.542260 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/929468181
- 2017-07-11 14:20:01.998760 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/177453936
- 2017-07-11 14:20:02.433550 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/949411343
- 2017-07-11 14:20:03.262423 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/892917282
- 2017-07-11 14:20:03.837941 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/338544409
- 2017-07-11 14:20:04.615054 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/965725092
- 2017-07-11 14:20:05.155624 I | api: dd76dc8b-185a-4565-b7fb-a47037300e9a GET /metrics GetMetrics 200 OK 4.552490595s
- 2017-07-11 14:20:05.534496 I | api: 215bb859-517d-45c3-8b5d-4374b950b71a GET /metrics GetMetrics (start)
- 2017-07-11 14:20:05.535306 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/457758899
- 2017-07-11 14:20:05.994854 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/011648630
- 2017-07-11 14:20:06.457018 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/506914141
- 2017-07-11 14:20:06.919173 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/179349272
- 2017-07-11 14:20:07.369373 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/069036951
- 2017-07-11 14:20:07.832744 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/268796938
- 2017-07-11 14:20:08.288326 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/278003681
- 2017-07-11 14:20:08.764776 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/062617548
- 2017-07-11 14:20:09.226437 I | api: 215bb859-517d-45c3-8b5d-4374b950b71a GET /metrics GetMetrics 200 OK 3.691944228s
- 2017-07-11 14:20:10.466472 I | api: de05b75d-2d9a-41ff-8648-9446efe1ecfa GET /metrics GetMetrics (start)
- 2017-07-11 14:20:10.467362 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/264684731
- 2017-07-11 14:20:10.920593 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/289549534
- 2017-07-11 14:20:11.372136 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/236398245
- 2017-07-11 14:20:11.815155 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/618405824
- 2017-07-11 14:20:12.331048 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/465602591
- 2017-07-11 14:20:12.846751 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/332495090
- 2017-07-11 14:20:13.336889 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/212791209
- 2017-07-11 14:20:13.848576 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/607099636
- 2017-07-11 14:20:14.312694 I | api: de05b75d-2d9a-41ff-8648-9446efe1ecfa GET /metrics GetMetrics 200 OK 3.846220917s
- 2017-07-11 14:20:15.398289 I | api: 30d68101-b15a-4c39-9255-574ccc9aa701 GET /metrics GetMetrics (start)
- 2017-07-11 14:20:15.398985 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/953746883
- 2017-07-11 14:20:15.898637 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/502111814
- 2017-07-11 14:20:16.342805 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/189138669
- 2017-07-11 14:20:16.813128 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/867691880
- 2017-07-11 14:20:17.293689 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/792065447
- 2017-07-11 14:20:17.804470 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/526120666
- 2017-07-11 14:20:18.744858 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/478790769
- 2017-07-11 14:20:19.221826 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/641131292
- 2017-07-11 14:20:19.773646 I | api: 30d68101-b15a-4c39-9255-574ccc9aa701 GET /metrics GetMetrics 200 OK 4.37533369s
- 2017-07-11 14:20:20.329989 I | api: 45be62a2-45b8-4a1c-bc75-0b6487d70794 GET /metrics GetMetrics (start)
- 2017-07-11 14:20:20.330749 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/337782731
- 2017-07-11 14:20:21.142815 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/235437230
- 2017-07-11 14:20:21.583303 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/381748277
- 2017-07-11 14:20:22.055989 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/246670864
- 2017-07-11 14:20:22.544555 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/593275951
- 2017-07-11 14:20:25.338646 I | api: 89e8779e-06e0-48a9-9040-21adbf75265f GET /metrics GetMetrics (start)
- 2017-07-11 14:20:30.194255 I | api: 9f23f36f-f4d1-40b2-a1c3-67df24cea7d4 GET /metrics GetMetrics (start)
- 2017-07-11 14:20:35.194745 I | api: 8e156c72-e553-416a-b85e-4e5e3236b778 GET /metrics GetMetrics (start)
- 2017-07-11 14:20:40.126233 I | api: 1babf5b9-4c90-44ea-b65b-fe02e6c4c4f9 GET /metrics GetMetrics (start)
- 2017-07-11 14:20:45.058524 I | api: de17087c-902c-4f1c-8bb8-680723a05e07 GET /metrics GetMetrics (start)
- 2017-07-11 14:20:49.984483 I | api: ccfbc770-66c9-44b9-a920-1ce0f2ae9ede GET /metrics GetMetrics (start)
- 2017-07-11 14:20:54.919723 I | api: d0be7855-f5a3-4982-9556-ef39aceb120c GET /metrics GetMetrics (start)
- 2017-07-11 14:20:59.851340 I | api: 8d667ac0-fff2-43b3-8080-e002e6c109b8 GET /metrics GetMetrics (start)
- 2017-07-11 14:21:04.783023 I | api: 24c2de95-dba4-41e1-b94c-5d79eaf8fb4e GET /metrics GetMetrics (start)
- 2017-07-11 14:21:09.711049 I | api: 6c459dc2-53d7-4d73-a980-c70852883892 GET /metrics GetMetrics (start)
- 2017-07-11 14:21:14.643514 I | api: 84005767-9221-4e0b-ab26-5979ffb8eebf GET /metrics GetMetrics (start)
- 2017-07-11 14:21:19.572031 I | api: 2ba5b52d-4ec8-4296-8a3b-9fc523d09b4c GET /metrics GetMetrics (start)
- 2017-07-11 14:21:24.505232 I | api: 8a4a044b-e7c7-4f89-95f7-ba39c93f9b30 GET /metrics GetMetrics (start)
- 2017-07-11 14:21:25.133984 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/224276930
- 2017-07-11 14:21:25.668313 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/308411449
- 2017-07-11 14:21:26.127767 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/154529860
- 2017-07-11 14:21:26.667110 I | api: 45be62a2-45b8-4a1c-bc75-0b6487d70794 GET /metrics GetMetrics 200 OK 1m6.337125104s
- 2017-07-11 14:21:26.667353 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/367231187
- 2017-07-11 14:21:27.123529 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/464911382
- 2017-07-11 14:21:27.636201 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/683570301
- 2017-07-11 14:21:28.174471 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/802121144
- 2017-07-11 14:21:28.652780 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/832117687
- 2017-07-11 14:21:29.140279 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/372572074
- 2017-07-11 14:21:29.440274 I | api: f774e669-9197-4d5f-b9f6-bc4fa8d87848 GET /metrics GetMetrics (start)
- 2017-07-11 14:21:29.666175 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/757042945
- 2017-07-11 14:21:30.134101 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/495622252
- 2017-07-11 14:21:30.617720 I | api: 89e8779e-06e0-48a9-9040-21adbf75265f GET /metrics GetMetrics 200 OK 1m5.279094648s
- 2017-07-11 14:21:30.617993 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/159199451
- 2017-07-11 14:21:31.047245 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/422351998
- 2017-07-11 14:21:31.485696 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/255031237
- 2017-07-11 14:21:31.949501 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/906069600
- 2017-07-11 14:21:32.431878 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/043821119
- 2017-07-11 14:21:32.892447 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/140954258
- 2017-07-11 14:21:33.336278 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/095757001
- 2017-07-11 14:21:33.812477 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/239172500
- 2017-07-11 14:21:34.285343 I | api: 9f23f36f-f4d1-40b2-a1c3-67df24cea7d4 GET /metrics GetMetrics 200 OK 1m4.091089879s
- 2017-07-11 14:21:34.286013 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/179867107
- 2017-07-11 14:21:34.376434 I | api: 088b62ff-f293-4eff-8fe6-3540c908ff66 GET /metrics GetMetrics (start)
- 2017-07-11 14:21:34.756174 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/772948966
- 2017-07-11 14:21:35.350122 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/286814733
- 2017-07-11 14:21:35.786025 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/131131400
- 2017-07-11 14:21:36.282548 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/104007111
- 2017-07-11 14:21:37.157687 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/656642170
- 2017-07-11 14:21:37.640546 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/159535505
- 2017-07-11 14:21:38.129069 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/986421180
- 2017-07-11 14:21:38.605197 I | api: 8e156c72-e553-416a-b85e-4e5e3236b778 GET /metrics GetMetrics 200 OK 1m3.410467293s
- 2017-07-11 14:21:38.605490 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/515456491
- 2017-07-11 14:21:39.046485 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/166767182
- 2017-07-11 14:21:39.309415 I | api: 3a1bd0f1-55fe-4b57-b2dd-faafc1fcef2c GET /metrics GetMetrics (start)
- 2017-07-11 14:21:39.529277 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/500248917
- 2017-07-11 14:21:40.012069 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/942863536
- 2017-07-11 14:21:40.382247 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/445035087
- 2017-07-11 14:21:40.927432 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/226716514
- 2017-07-11 14:21:41.384157 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/686908249
- 2017-07-11 14:21:41.834467 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/212334820
- 2017-07-11 14:21:42.296096 I | api: 1babf5b9-4c90-44ea-b65b-fe02e6c4c4f9 GET /metrics GetMetrics 200 OK 1m2.169867454s
- 2017-07-11 14:21:42.296385 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/476409587
- 2017-07-11 14:21:42.822109 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/984943030
- 2017-07-11 14:21:43.276986 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/488122269
- 2017-07-11 14:21:43.732782 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/259459160
- 2017-07-11 14:21:44.185437 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/130721239
- 2017-07-11 14:21:44.243748 I | api: c484495c-22d5-4ceb-aca5-673ef316556e GET /metrics GetMetrics (start)
- 2017-07-11 14:21:44.672719 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/280568650
- 2017-07-11 14:21:45.128078 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/025182753
- 2017-07-11 14:21:45.696025 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/749999884
- 2017-07-11 14:21:46.174193 I | api: de17087c-902c-4f1c-8bb8-680723a05e07 GET /metrics GetMetrics 200 OK 1m1.115669746s
- 2017-07-11 14:21:46.183642 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/405229307
- 2017-07-11 14:21:46.736038 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/510770718
- 2017-07-11 14:21:47.187599 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/867039973
- 2017-07-11 14:21:47.640252 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/303292160
- 2017-07-11 14:21:48.097105 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/019623007
- 2017-07-11 14:21:48.535636 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/981879346
- 2017-07-11 14:21:49.149747 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/661658601
- 2017-07-11 14:21:49.171945 I | api: f7def87d-5c2b-47d5-b5eb-34f121ca1c8f GET /metrics GetMetrics (start)
- 2017-07-11 14:21:49.685246 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/257455668
- 2017-07-11 14:21:50.159326 I | api: ccfbc770-66c9-44b9-a920-1ce0f2ae9ede GET /metrics GetMetrics 200 OK 1m0.174849891s
- 2017-07-11 14:21:50.159568 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/457788931
- 2017-07-11 14:21:50.548617 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/130057094
- 2017-07-11 14:21:50.990753 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/975241517
- 2017-07-11 14:21:51.452006 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/780194984
- 2017-07-11 14:21:51.959382 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/196759015
- 2017-07-11 14:21:52.423723 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/625225754
- 2017-07-11 14:21:53.099898 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/811022513
- 2017-07-11 14:21:53.589367 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/746181212
- 2017-07-11 14:21:54.108416 I | api: d0be7855-f5a3-4982-9556-ef39aceb120c GET /metrics GetMetrics 200 OK 59.188696467s
- 2017-07-11 14:21:54.108651 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/012815371
- 2017-07-11 14:21:54.119035 I | api: 924428fa-0898-4d01-ab12-4cab9019ad96 GET /metrics GetMetrics (start)
- 2017-07-11 14:21:54.565640 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/711726062
- 2017-07-11 14:21:55.009983 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/921566325
- 2017-07-11 14:21:55.558732 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/530455888
- 2017-07-11 14:21:56.003539 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/558666351
- 2017-07-11 14:21:56.458169 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/162610946
- 2017-07-11 14:21:57.263838 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/368335481
- 2017-07-11 14:21:57.727896 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/552413572
- 2017-07-11 14:21:58.199979 I | api: 8d667ac0-fff2-43b3-8080-e002e6c109b8 GET /metrics GetMetrics 200 OK 58.348645203s
- 2017-07-11 14:21:58.200256 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/169938707
- 2017-07-11 14:21:58.657256 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/902593366
- 2017-07-11 14:21:59.041327 I | api: 084a4213-f52b-4e38-bd1b-80df6e1ae2f6 GET /metrics GetMetrics (start)
- 2017-07-11 14:21:59.113290 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/460403901
- 2017-07-11 14:21:59.971333 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/342124280
- 2017-07-11 14:22:00.361280 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/256827895
- 2017-07-11 14:22:00.819626 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/399523562
- 2017-07-11 14:22:01.412601 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/623233345
- 2017-07-11 14:22:01.900084 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/485218220
- 2017-07-11 14:22:02.460862 I | api: 24c2de95-dba4-41e1-b94c-5d79eaf8fb4e GET /metrics GetMetrics 200 OK 57.677844096s
- 2017-07-11 14:22:02.461402 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/156438811
- 2017-07-11 14:22:02.909671 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/257096638
- 2017-07-11 14:22:03.618143 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/052366853
- 2017-07-11 14:22:03.976578 I | api: b1ec2a26-0bb2-4a71-a01c-4da5744b8a73 GET /metrics GetMetrics (start)
- 2017-07-11 14:22:04.100142 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/631656864
- 2017-07-11 14:22:04.557578 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/869927551
- 2017-07-11 14:22:05.074838 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/680658386
- 2017-07-11 14:22:05.601755 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/864882953
- 2017-07-11 14:22:06.081229 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/021769428
- 2017-07-11 14:22:06.558340 I | api: 6c459dc2-53d7-4d73-a980-c70852883892 GET /metrics GetMetrics 200 OK 56.847289938s
- 2017-07-11 14:22:06.567943 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/131969571
- 2017-07-11 14:22:07.039609 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/561719078
- 2017-07-11 14:22:07.495067 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/096242765
- 2017-07-11 14:22:07.980733 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/351642952
- 2017-07-11 14:22:08.423126 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/564017671
- 2017-07-11 14:22:08.907195 I | api: 9ab6275d-7450-4d04-83ba-4a57665f073e GET /metrics GetMetrics (start)
- 2017-07-11 14:22:08.929311 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/180395962
- 2017-07-11 14:22:09.392249 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/222988241
- 2017-07-11 14:22:09.891318 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/485069564
- 2017-07-11 14:22:10.281806 I | api: 84005767-9221-4e0b-ab26-5979ffb8eebf GET /metrics GetMetrics 200 OK 55.638295485s
- 2017-07-11 14:22:10.282056 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/196947499
- 2017-07-11 14:22:10.778735 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/828943246
- 2017-07-11 14:22:11.365095 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/706407317
- 2017-07-11 14:22:11.815662 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/125608944
- 2017-07-11 14:22:12.274438 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/276481679
- 2017-07-11 14:22:12.983975 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/387975842
- 2017-07-11 14:22:13.468195 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/924715417
- 2017-07-11 14:22:13.842195 I | api: f4840003-3e36-4dc1-a546-14f4abc99d19 GET /metrics GetMetrics (start)
- 2017-07-11 14:22:13.928116 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/038682148
- 2017-07-11 14:22:14.441276 I | api: 2ba5b52d-4ec8-4296-8a3b-9fc523d09b4c GET /metrics GetMetrics 200 OK 54.869247502s
- 2017-07-11 14:22:14.447263 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/309637427
- 2017-07-11 14:22:14.894459 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/716094710
- 2017-07-11 14:22:15.418928 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/891712477
- 2017-07-11 14:22:15.894755 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/660229016
- 2017-07-11 14:22:16.427047 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/758366743
- 2017-07-11 14:22:16.907170 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/672265354
- 2017-07-11 14:22:17.400388 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/147406433
- 2017-07-11 14:22:17.853755 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/023642188
- 2017-07-11 14:22:18.314026 I | api: 8a4a044b-e7c7-4f89-95f7-ba39c93f9b30 GET /metrics GetMetrics 200 OK 53.808796685s
- 2017-07-11 14:22:18.314296 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/076052283
- 2017-07-11 14:22:18.770449 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/908683102
- 2017-07-11 14:22:18.780660 I | api: c0eb35a3-209f-4646-9ceb-c7c3f28623ed GET /metrics GetMetrics (start)
- 2017-07-11 14:22:19.277026 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/689901349
- 2017-07-11 14:22:19.760393 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/974549568
- 2017-07-11 14:22:20.224809 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/065021087
- 2017-07-11 14:22:20.597698 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/566385522
- 2017-07-11 14:22:21.265950 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/747604009
- 2017-07-11 14:22:21.728375 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/227478388
- 2017-07-11 14:22:22.222630 I | api: f774e669-9197-4d5f-b9f6-bc4fa8d87848 GET /metrics GetMetrics 200 OK 52.782362402s
- 2017-07-11 14:22:22.222918 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/203909699
- 2017-07-11 14:22:22.745209 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/928633030
- 2017-07-11 14:22:23.175200 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/948138349
- 2017-07-11 14:22:23.663715 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/381456360
- 2017-07-11 14:22:23.710461 I | api: fb6f9538-a495-49a3-9626-12cb589ba7bc GET /metrics GetMetrics (start)
- 2017-07-11 14:22:24.151641 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/840330279
- 2017-07-11 14:22:24.611465 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/016834394
- 2017-07-11 14:22:25.130614 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/125472497
- 2017-07-11 14:22:25.636362 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/955805084
- 2017-07-11 14:22:26.147595 I | api: 088b62ff-f293-4eff-8fe6-3540c908ff66 GET /metrics GetMetrics 200 OK 51.771168531s
- 2017-07-11 14:22:26.147866 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/879729739
- 2017-07-11 14:22:26.597691 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/086881582
- 2017-07-11 14:22:27.116272 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/109393077
- 2017-07-11 14:22:27.757194 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/926417040
- 2017-07-11 14:22:28.251151 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/754290863
- 2017-07-11 14:22:28.642573 I | api: 2def09af-239d-4c37-b6cf-895257d370bc GET /metrics GetMetrics (start)
- 2017-07-11 14:22:28.716047 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/942402114
- 2017-07-11 14:22:29.177653 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/195726521
- 2017-07-11 14:22:29.700843 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/460535492
- 2017-07-11 14:22:30.203851 I | api: 3a1bd0f1-55fe-4b57-b2dd-faafc1fcef2c GET /metrics GetMetrics 200 OK 50.894440311s
- 2017-07-11 14:22:30.204097 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/709335379
- 2017-07-11 14:22:30.585646 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/796094614
- 2017-07-11 14:22:31.055337 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/939906813
- 2017-07-11 14:22:31.562894 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/938204728
- 2017-07-11 14:22:32.021993 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/619084855
- 2017-07-11 14:22:32.484795 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/987779626
- 2017-07-11 14:22:32.944887 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/904020865
- 2017-07-11 14:22:33.414440 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/285762796
- 2017-07-11 14:22:33.574241 I | api: 29e6ded7-695c-495e-999f-b3dc0db12d45 GET /metrics GetMetrics (start)
- 2017-07-11 14:22:33.896802 I | api: c484495c-22d5-4ceb-aca5-673ef316556e GET /metrics GetMetrics 200 OK 49.653053593s
- 2017-07-11 14:22:33.902722 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/041886555
- 2017-07-11 14:22:34.360182 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/027749630
- 2017-07-11 14:22:34.934943 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/262512709
- 2017-07-11 14:22:35.447601 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/267093216
- 2017-07-11 14:22:35.882428 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/068556991
- 2017-07-11 14:22:36.339674 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/061795602
- 2017-07-11 14:22:36.806635 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/209586505
- 2017-07-11 14:22:37.287172 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/020589588
- 2017-07-11 14:22:37.790806 I | api: f7def87d-5c2b-47d5-b5eb-34f121ca1c8f GET /metrics GetMetrics 200 OK 48.618864124s
- 2017-07-11 14:22:37.791057 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/267382371
- 2017-07-11 14:22:38.233979 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/963912294
- 2017-07-11 14:22:38.510577 I | api: 96cc3165-295b-4b82-b73f-0c61bff0b58a GET /metrics GetMetrics (start)
- 2017-07-11 14:22:38.771135 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/285744269
- 2017-07-11 14:22:39.240321 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/519935112
- 2017-07-11 14:22:39.708895 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/506127431
- 2017-07-11 14:22:40.181655 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/480412410
- 2017-07-11 14:22:40.580972 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/368687633
- 2017-07-11 14:22:41.057920 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/099167292
- 2017-07-11 14:22:41.528479 I | api: 924428fa-0898-4d01-ab12-4cab9019ad96 GET /metrics GetMetrics 200 OK 47.409442131s
- 2017-07-11 14:22:41.537566 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/267500651
- 2017-07-11 14:22:41.993796 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/189000910
- 2017-07-11 14:22:42.501924 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/284091861
- 2017-07-11 14:22:42.946323 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/867613488
- 2017-07-11 14:22:43.414266 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/616107215
- 2017-07-11 14:22:43.444420 I | api: 8782e7d8-360c-47cc-811f-418499dca40e GET /metrics GetMetrics (start)
- 2017-07-11 14:22:44.208861 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/189317602
- 2017-07-11 14:22:44.663195 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/518899673
- 2017-07-11 14:22:45.119759 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/942912868
- 2017-07-11 14:22:45.647615 I | api: 084a4213-f52b-4e38-bd1b-80df6e1ae2f6 GET /metrics GetMetrics 200 OK 46.606284667s
- 2017-07-11 14:22:45.654097 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/955003763
- 2017-07-11 14:22:46.133470 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/500753974
- 2017-07-11 14:22:46.600848 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/809276445
- 2017-07-11 14:22:47.076297 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/604736216
- 2017-07-11 14:22:47.541198 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/963579991
- 2017-07-11 14:22:47.975431 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/001339850
- 2017-07-11 14:22:48.374420 I | api: dda5692e-d708-4aaf-b21e-67ba070440fd GET /metrics GetMetrics (start)
- 2017-07-11 14:22:48.427340 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/139698849
- 2017-07-11 14:22:48.868710 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/085164428
- 2017-07-11 14:22:49.337577 I | api: b1ec2a26-0bb2-4a71-a01c-4da5744b8a73 GET /metrics GetMetrics 200 OK 45.361004213s
- 2017-07-11 14:22:49.337919 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/851383675
- 2017-07-11 14:22:49.810902 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/196414622
- 2017-07-11 14:22:50.297461 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/857049957
- 2017-07-11 14:22:50.906073 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/116278656
- 2017-07-11 14:22:51.361358 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/337555679
- 2017-07-11 14:22:51.900829 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/798362290
- 2017-07-11 14:22:52.336102 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/058513001
- 2017-07-11 14:22:52.856656 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/062523572
- 2017-07-11 14:22:53.303454 I | api: c19497fe-9d7d-4a3e-b6d7-bae95f8d9455 GET /metrics GetMetrics (start)
- 2017-07-11 14:22:53.542461 I | api: 9ab6275d-7450-4d04-83ba-4a57665f073e GET /metrics GetMetrics 200 OK 44.635273578s
- 2017-07-11 14:22:53.542662 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/458105987
- 2017-07-11 14:22:53.982208 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/388183558
- 2017-07-11 14:22:54.569790 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/615339949
- 2017-07-11 14:22:55.025514 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/121632552
- 2017-07-11 14:22:55.527993 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/182690407
- 2017-07-11 14:22:56.037940 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/863158426
- 2017-07-11 14:22:56.498135 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/628051249
- 2017-07-11 14:22:56.959674 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/928898268
- 2017-07-11 14:22:57.468783 I | api: f4840003-3e36-4dc1-a546-14f4abc99d19 GET /metrics GetMetrics 200 OK 43.626598969s
- 2017-07-11 14:22:57.469664 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/896289419
- 2017-07-11 14:22:57.956637 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/448594542
- 2017-07-11 14:22:58.237483 I | api: e226717f-89d5-479e-8686-9124f3219fdd GET /metrics GetMetrics (start)
- 2017-07-11 14:22:58.420938 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/808182517
- 2017-07-11 14:22:58.896497 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/260832208
- 2017-07-11 14:22:59.332656 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/889376495
- 2017-07-11 14:23:00.000822 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/470692738
- 2017-07-11 14:23:00.399518 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/499421945
- 2017-07-11 14:23:00.851955 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/651330564
- 2017-07-11 14:23:01.317599 I | api: c0eb35a3-209f-4646-9ceb-c7c3f28623ed GET /metrics GetMetrics 200 OK 42.536945549s
- 2017-07-11 14:23:01.317917 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/109788051
- 2017-07-11 14:23:01.795379 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/240518102
- 2017-07-11 14:23:02.424508 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/160607037
- 2017-07-11 14:23:02.975044 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/792761720
- 2017-07-11 14:23:03.163980 I | api: 23c4fcff-8f84-4a4b-b66e-1a8cae28b176 GET /metrics GetMetrics (start)
- 2017-07-11 14:23:03.482479 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/057300599
- 2017-07-11 14:23:04.158596 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/789213034
- 2017-07-11 14:23:04.614625 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/221235137
- 2017-07-11 14:23:05.093701 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/308394028
- 2017-07-11 14:23:05.638290 I | api: fb6f9538-a495-49a3-9626-12cb589ba7bc GET /metrics GetMetrics 200 OK 41.927831783s
- 2017-07-11 14:23:05.638540 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/221610907
- 2017-07-11 14:23:06.073356 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/016695358
- 2017-07-11 14:23:06.577723 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/164341893
- 2017-07-11 14:23:07.064909 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/275801120
- 2017-07-11 14:23:07.635615 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/912339199
- 2017-07-11 14:23:08.097020 I | api: dce088c4-8c14-4129-80cf-ba706934eee8 GET /metrics GetMetrics (start)
- 2017-07-11 14:23:08.138995 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/386101842
- 2017-07-11 14:23:08.609973 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/959656841
- 2017-07-11 14:23:09.266069 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/465343316
- 2017-07-11 14:23:09.745810 I | api: 2def09af-239d-4c37-b6cf-895257d370bc GET /metrics GetMetrics 200 OK 41.103243111s
- 2017-07-11 14:23:09.746116 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/094005923
- 2017-07-11 14:23:10.344954 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/974357926
- 2017-07-11 14:23:10.723385 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/899700941
- 2017-07-11 14:23:11.168912 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/065486280
- 2017-07-11 14:23:11.656062 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/337183879
- 2017-07-11 14:23:12.123351 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/403257914
- 2017-07-11 14:23:12.586955 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/519284305
- 2017-07-11 14:23:13.026748 I | api: 86b356ea-0972-40fe-badb-0db2df266800 GET /metrics GetMetrics (start)
- 2017-07-11 14:23:13.070666 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/761898876
- 2017-07-11 14:23:13.583735 I | api: 29e6ded7-695c-495e-999f-b3dc0db12d45 GET /metrics GetMetrics 200 OK 40.009500757s
- 2017-07-11 14:23:13.584000 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/811685035
- 2017-07-11 14:23:14.033689 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/724018190
- 2017-07-11 14:23:14.489324 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/043192853
- 2017-07-11 14:23:14.988953 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/679509616
- 2017-07-11 14:23:15.671027 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/594911503
- 2017-07-11 14:23:17.954220 I | api: 063e4788-fdf1-476f-92ce-47017975c6d1 GET /metrics GetMetrics (start)
- 2017-07-11 14:23:22.886172 I | api: 7948f56d-57d6-406a-9eb2-42910befdec9 GET /metrics GetMetrics (start)
- 2017-07-11 14:23:27.816055 I | api: f1515646-5d9e-4813-9e8f-1a239562246e GET /metrics GetMetrics (start)
- 2017-07-11 14:23:32.746218 I | api: ea0c9b3e-125f-4b4c-a7b3-51ca0ccdae3b GET /metrics GetMetrics (start)
- 2017-07-11 14:23:37.675833 I | api: 95082d19-8004-418c-82ce-5b9c1dc063eb GET /metrics GetMetrics (start)
- 2017-07-11 14:23:42.606021 I | api: ba866c35-fea7-48a7-88ae-06d519434be2 GET /metrics GetMetrics (start)
- 2017-07-11 14:23:46.599500 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/927171362
- 2017-07-11 14:23:47.039510 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/125234713
- 2017-07-11 14:23:47.509626 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/086849188
- 2017-07-11 14:23:47.537439 I | api: c5f337b5-440d-477e-9bb4-8e4793afbbdc GET /metrics GetMetrics (start)
- 2017-07-11 14:23:47.980121 I | api: 96cc3165-295b-4b82-b73f-0c61bff0b58a GET /metrics GetMetrics 200 OK 1m9.469550237s
- 2017-07-11 14:23:47.980362 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/188844467
- 2017-07-11 14:23:48.442859 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/413345654
- 2017-07-11 14:23:48.893206 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/701114973
- 2017-07-11 14:23:49.385998 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/864636440
- 2017-07-11 14:23:49.836826 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/011578519
- 2017-07-11 14:23:50.301139 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/604019466
- 2017-07-11 14:23:50.680510 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/750695137
- 2017-07-11 14:23:51.127738 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/030059212
- 2017-07-11 14:23:51.599301 I | api: 8782e7d8-360c-47cc-811f-418499dca40e GET /metrics GetMetrics 200 OK 1m8.154895048s
- 2017-07-11 14:23:51.609057 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/789260731
- 2017-07-11 14:23:52.088994 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/635671518
- 2017-07-11 14:23:52.464740 I | api: cad05299-84be-4f67-a46c-5da1d548bf36 GET /metrics GetMetrics (start)
- 2017-07-11 14:23:52.717130 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/184229797
- 2017-07-11 14:23:53.198018 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/581289152
- 2017-07-11 14:23:53.719905 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/941694751
- 2017-07-11 14:23:54.187522 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/758867442
- 2017-07-11 14:23:54.648780 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/666078377
- 2017-07-11 14:23:55.142131 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/266590708
- 2017-07-11 14:23:55.679173 I | api: dda5692e-d708-4aaf-b21e-67ba070440fd GET /metrics GetMetrics 200 OK 1m7.304758214s
- 2017-07-11 14:23:55.679529 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/150051011
- 2017-07-11 14:23:56.167719 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/482859846
- 2017-07-11 14:23:56.645215 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/558098925
- 2017-07-11 14:23:57.092943 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/934687336
- 2017-07-11 14:23:57.397415 I | api: fc8bfc89-24b6-46b3-a5f2-2c5d40ee5933 GET /metrics GetMetrics (start)
- 2017-07-11 14:23:57.570467 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/872590503
- 2017-07-11 14:23:58.053026 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/990086106
- 2017-07-11 14:23:58.510044 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/188345713
- 2017-07-11 14:23:58.966516 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/988032540
- 2017-07-11 14:23:59.434757 I | api: c19497fe-9d7d-4a3e-b6d7-bae95f8d9455 GET /metrics GetMetrics 200 OK 1m6.131308079s
- 2017-07-11 14:23:59.435032 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/978901707
- 2017-07-11 14:23:59.883516 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/073395630
- 2017-07-11 14:24:00.368351 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/364695861
- 2017-07-11 14:24:00.859491 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/843786512
- 2017-07-11 14:24:01.517916 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/746892079
- 2017-07-11 14:24:02.026877 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/318201538
- 2017-07-11 14:24:02.339134 I | api: 3cdd7485-8363-45fe-b45c-464df8233662 GET /metrics GetMetrics (start)
- 2017-07-11 14:24:02.504252 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/062000953
- 2017-07-11 14:24:02.966461 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/676008260
- 2017-07-11 14:24:03.534264 I | api: e226717f-89d5-479e-8686-9124f3219fdd GET /metrics GetMetrics 200 OK 1m5.296781215s
- 2017-07-11 14:24:03.537857 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/684503507
- 2017-07-11 14:24:04.006824 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/994643222
- 2017-07-11 14:24:04.457266 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/709610877
- 2017-07-11 14:24:04.901060 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/181936312
- 2017-07-11 14:24:05.405137 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/078596279
- 2017-07-11 14:24:06.051823 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/529438378
- 2017-07-11 14:24:06.564897 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/565414913
- 2017-07-11 14:24:07.036581 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/512828268
- 2017-07-11 14:24:07.267705 I | api: b41bfdd6-b53a-4815-b8bf-be968a6311cb GET /metrics GetMetrics (start)
- 2017-07-11 14:24:07.516678 I | api: 23c4fcff-8f84-4a4b-b66e-1a8cae28b176 GET /metrics GetMetrics 200 OK 1m4.352701075s
- 2017-07-11 14:24:07.516941 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/995552731
- 2017-07-11 14:24:08.006036 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/695158142
- 2017-07-11 14:24:08.449085 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/815502021
- 2017-07-11 14:24:08.899706 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/310042976
- 2017-07-11 14:24:09.428550 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/452678463
- 2017-07-11 14:24:09.996686 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/124022162
- 2017-07-11 14:24:10.384402 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/608559561
- 2017-07-11 14:24:10.824545 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/544384660
- 2017-07-11 14:24:11.288489 I | api: dce088c4-8c14-4129-80cf-ba706934eee8 GET /metrics GetMetrics 200 OK 1m3.19147499s
- 2017-07-11 14:24:11.288775 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/488449763
- 2017-07-11 14:24:11.752822 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/546528998
- 2017-07-11 14:24:12.220567 I | api: faa55350-5a7a-414e-a24b-99dbdcb3bea6 GET /metrics GetMetrics (start)
- 2017-07-11 14:24:12.283180 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/761269005
- 2017-07-11 14:24:12.808117 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/721712904
- 2017-07-11 14:24:13.265314 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/537776327
- 2017-07-11 14:24:13.993290 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/164207994
- 2017-07-11 14:24:14.532263 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/901366929
- 2017-07-11 14:24:15.038720 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/595288764
- 2017-07-11 14:24:15.596660 I | api: 86b356ea-0972-40fe-badb-0db2df266800 GET /metrics GetMetrics 200 OK 1m2.569907271s
- 2017-07-11 14:24:15.596962 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/987811563
- 2017-07-11 14:24:16.106492 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/689847630
- 2017-07-11 14:24:16.601892 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/752244309
- 2017-07-11 14:24:17.067585 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/850704304
- 2017-07-11 14:24:17.135983 I | api: 13f9e6d6-abcc-4c29-97b5-bdb772e06552 GET /metrics GetMetrics (start)
- 2017-07-11 14:24:17.852370 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/237766991
- 2017-07-11 14:24:18.350789 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/971708514
- 2017-07-11 14:24:18.905634 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/358137945
- 2017-07-11 14:24:19.420485 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/001022436
- 2017-07-11 14:24:19.896196 I | api: 063e4788-fdf1-476f-92ce-47017975c6d1 GET /metrics GetMetrics 200 OK 1m1.941981694s
- 2017-07-11 14:24:19.896485 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/451171827
- 2017-07-11 14:24:20.381899 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/717134518
- 2017-07-11 14:24:20.758341 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/806303389
- 2017-07-11 14:24:21.225114 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/515523416
- 2017-07-11 14:24:21.838405 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/061452503
- 2017-07-11 14:24:22.067083 I | api: 386a7073-052a-4e6c-b72e-a9fa31959d76 GET /metrics GetMetrics (start)
- 2017-07-11 14:24:22.325788 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/300338762
- 2017-07-11 14:24:22.838367 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/917870369
- 2017-07-11 14:24:23.325621 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/207430156
- 2017-07-11 14:24:23.814427 I | api: 7948f56d-57d6-406a-9eb2-42910befdec9 GET /metrics GetMetrics 200 OK 1m0.928254034s
- 2017-07-11 14:24:23.824004 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/021462523
- 2017-07-11 14:24:24.329694 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/382032670
- 2017-07-11 14:24:24.793303 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/970992101
- 2017-07-11 14:24:25.458432 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/706198016
- 2017-07-11 14:24:25.932871 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/170746207
- 2017-07-11 14:24:26.421567 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/307733298
- 2017-07-11 14:24:26.942070 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/305669353
- 2017-07-11 14:24:27.001789 I | api: 5f911cea-8fcd-4785-92c9-b408aa74b3df GET /metrics GetMetrics (start)
- 2017-07-11 14:24:27.419615 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/417421108
- 2017-07-11 14:24:27.902874 I | api: f1515646-5d9e-4813-9e8f-1a239562246e GET /metrics GetMetrics 200 OK 1m0.086809502s
- 2017-07-11 14:24:27.903128 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/808323331
- 2017-07-11 14:24:28.362116 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/260554886
- 2017-07-11 14:24:28.811180 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/841475117
- 2017-07-11 14:24:29.360735 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/123293608
- 2017-07-11 14:24:29.861531 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/927490791
- 2017-07-11 14:24:30.321895 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/707312922
- 2017-07-11 14:24:30.722115 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/159750065
- 2017-07-11 14:24:31.336589 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/644619612
- 2017-07-11 14:24:31.817192 I | api: ea0c9b3e-125f-4b4c-a7b3-51ca0ccdae3b GET /metrics GetMetrics 200 OK 59.070977871s
- 2017-07-11 14:24:31.817522 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/232813835
- 2017-07-11 14:24:31.933796 I | api: 5c51ea19-c900-4253-ac79-720fb0a2704b GET /metrics GetMetrics (start)
- 2017-07-11 14:24:32.274673 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/196459246
- 2017-07-11 14:24:32.738073 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/494403445
- 2017-07-11 14:24:33.207363 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/944008784
- 2017-07-11 14:24:33.691662 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/773482863
- 2017-07-11 14:24:34.191926 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/539454466
- 2017-07-11 14:24:34.648573 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/739784569
- 2017-07-11 14:24:35.110792 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/159519876
- 2017-07-11 14:24:35.651042 I | api: 95082d19-8004-418c-82ce-5b9c1dc063eb GET /metrics GetMetrics 200 OK 57.975212279s
- 2017-07-11 14:24:35.651309 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/115397651
- 2017-07-11 14:24:36.112348 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/301056598
- 2017-07-11 14:24:36.649498 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/772929981
- 2017-07-11 14:24:36.867267 I | api: 2adf031a-84ca-4921-b2ec-1236dab122f7 GET /metrics GetMetrics (start)
- 2017-07-11 14:24:37.118612 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/750578680
- 2017-07-11 14:24:37.595483 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/083965687
- 2017-07-11 14:24:38.061361 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/302779370
- 2017-07-11 14:24:38.507704 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/705873473
- 2017-07-11 14:24:38.958267 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/752654508
- 2017-07-11 14:24:39.411507 I | api: ba866c35-fea7-48a7-88ae-06d519434be2 GET /metrics GetMetrics 200 OK 56.80548846s
- 2017-07-11 14:24:39.411748 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/737394715
- 2017-07-11 14:24:39.900061 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/493006014
- 2017-07-11 14:24:40.359576 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/462480645
- 2017-07-11 14:24:40.794693 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/685757600
- 2017-07-11 14:24:41.243927 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/109688191
- 2017-07-11 14:24:41.767276 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/524776146
- 2017-07-11 14:24:41.798106 I | api: 09298c02-3ef0-4904-934d-8e5e58520680 GET /metrics GetMetrics (start)
- 2017-07-11 14:24:42.227960 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/543632905
- 2017-07-11 14:24:42.681832 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/929874900
- 2017-07-11 14:24:43.157766 I | api: c5f337b5-440d-477e-9bb4-8e4793afbbdc GET /metrics GetMetrics 200 OK 55.620328506s
- 2017-07-11 14:24:43.167346 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/401065251
- 2017-07-11 14:24:43.666374 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/412673062
- 2017-07-11 14:24:44.136556 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/472379213
- 2017-07-11 14:24:44.644230 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/065577032
- 2017-07-11 14:24:45.136035 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/072301319
- 2017-07-11 14:24:45.684208 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/757312698
- 2017-07-11 14:24:46.138376 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/995135185
- 2017-07-11 14:24:46.637773 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/090070524
- 2017-07-11 14:24:46.734106 I | api: e787b0a2-c955-408d-9904-3c0787911910 GET /metrics GetMetrics (start)
- 2017-07-11 14:24:47.086934 I | api: cad05299-84be-4f67-a46c-5da1d548bf36 GET /metrics GetMetrics 200 OK 54.62220029s
- 2017-07-11 14:24:47.087158 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/437998379
- 2017-07-11 14:24:47.559913 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/826149006
- 2017-07-11 14:24:48.009552 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/073652885
- 2017-07-11 14:24:48.441787 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/744346352
- 2017-07-11 14:24:48.892970 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/233222543
- 2017-07-11 14:24:49.359763 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/061809570
- 2017-07-11 14:24:49.839135 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/315834009
- 2017-07-11 14:24:50.303422 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/404803876
- 2017-07-11 14:24:50.750580 I | api: fc8bfc89-24b6-46b3-a5f2-2c5d40ee5933 GET /metrics GetMetrics 200 OK 53.353169531s
- 2017-07-11 14:24:50.750823 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/665805363
- 2017-07-11 14:24:51.245722 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/634029046
- 2017-07-11 14:24:51.672352 I | api: 5be2d65d-008a-4d9c-844c-646306b8facd GET /metrics GetMetrics (start)
- 2017-07-11 14:24:51.732261 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/142691549
- 2017-07-11 14:24:52.197407 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/181569176
- 2017-07-11 14:24:52.664524 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/230935831
- 2017-07-11 14:24:53.136436 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/574008714
- 2017-07-11 14:24:53.888028 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/242376033
- 2017-07-11 14:24:54.402804 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/565286220
- 2017-07-11 14:24:54.866142 I | api: 3cdd7485-8363-45fe-b45c-464df8233662 GET /metrics GetMetrics 200 OK 52.527012636s
- 2017-07-11 14:24:54.866406 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/048477243
- 2017-07-11 14:24:55.406601 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/254753374
- 2017-07-11 14:24:55.851044 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/000695333
- 2017-07-11 14:24:56.293992 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/606396736
- 2017-07-11 14:24:56.601663 I | api: ddf5930f-84f7-40c6-b35d-4c68f33c7efd GET /metrics GetMetrics (start)
- 2017-07-11 14:24:56.791286 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/276661663
- 2017-07-11 14:24:57.270686 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/788599410
- 2017-07-11 14:24:57.734942 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/196462377
- 2017-07-11 14:24:58.180440 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/576563316
- 2017-07-11 14:24:58.709793 I | api: b41bfdd6-b53a-4815-b8bf-be968a6311cb GET /metrics GetMetrics 200 OK 51.442091029s
- 2017-07-11 14:24:58.710024 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/215112515
- 2017-07-11 14:24:59.169076 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/842903494
- 2017-07-11 14:24:59.729102 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/489172077
- 2017-07-11 14:25:00.365847 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/473931496
- 2017-07-11 14:25:00.904041 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/143626023
- 2017-07-11 14:25:01.386666 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/398276186
- 2017-07-11 14:25:01.536388 I | api: b0e0ea9e-dc7c-402b-983d-ca44d059a246 GET /metrics GetMetrics (start)
- 2017-07-11 14:25:01.884394 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/264367601
- 2017-07-11 14:25:02.316949 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/073747612
- 2017-07-11 14:25:02.791177 I | api: faa55350-5a7a-414e-a24b-99dbdcb3bea6 GET /metrics GetMetrics 200 OK 50.570637769s
- 2017-07-11 14:25:02.791529 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/131982155
- 2017-07-11 14:25:03.250764 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/241799726
- 2017-07-11 14:25:03.740963 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/691550133
- 2017-07-11 14:25:04.210975 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/724100496
- 2017-07-11 14:25:04.669152 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/604634031
- 2017-07-11 14:25:05.139768 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/672784706
- 2017-07-11 14:25:05.708601 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/872901049
- 2017-07-11 14:25:06.186659 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/505591236
- 2017-07-11 14:25:06.476640 I | api: 8a448c03-5625-4f5e-b1b1-8c93e38c2f7d GET /metrics GetMetrics (start)
- 2017-07-11 14:25:06.687675 I | api: 13f9e6d6-abcc-4c29-97b5-bdb772e06552 GET /metrics GetMetrics 200 OK 49.551699337s
- 2017-07-11 14:25:06.687970 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/863160915
- 2017-07-11 14:25:07.142725 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/476086678
- 2017-07-11 14:25:07.601109 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/905285117
- 2017-07-11 14:25:08.065270 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/922313528
- 2017-07-11 14:25:08.551343 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/022980919
- 2017-07-11 14:25:09.122779 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/097432362
- 2017-07-11 14:25:09.594674 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/485665921
- 2017-07-11 14:25:10.081011 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/250170860
- 2017-07-11 14:25:10.496178 I | api: 386a7073-052a-4e6c-b72e-a9fa31959d76 GET /metrics GetMetrics 200 OK 48.429101349s
- 2017-07-11 14:25:10.496407 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/779463259
- 2017-07-11 14:25:10.922485 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/323914238
- 2017-07-11 14:25:11.374914 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/605376325
- 2017-07-11 14:25:11.411769 I | api: a486929a-13ae-48af-827d-e9b6fee28c6c GET /metrics GetMetrics (start)
- 2017-07-11 14:25:12.056487 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/497658336
- 2017-07-11 14:25:12.636980 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/377223615
- 2017-07-11 14:25:13.100479 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/911325202
- 2017-07-11 14:25:13.620895 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/110858825
- 2017-07-11 14:25:14.597818 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/367717140
- 2017-07-11 14:25:15.110800 I | api: 5f911cea-8fcd-4785-92c9-b408aa74b3df GET /metrics GetMetrics 200 OK 48.109016263s
- 2017-07-11 14:25:15.120360 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/266010979
- 2017-07-11 14:25:15.698725 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/083812198
- 2017-07-11 14:25:16.155608 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/593606029
- 2017-07-11 14:25:16.344169 I | api: dda8ec35-2b15-4708-a128-66ea19cacf74 GET /metrics GetMetrics (start)
- 2017-07-11 14:25:16.602184 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/977978760
- 2017-07-11 14:25:17.159124 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/568831815
- 2017-07-11 14:25:17.614455 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/660429306
- 2017-07-11 14:25:18.075342 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/764595985
- 2017-07-11 14:25:18.569873 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/515752252
- 2017-07-11 14:25:19.054709 I | api: 5c51ea19-c900-4253-ac79-720fb0a2704b GET /metrics GetMetrics 200 OK 47.120916094s
- 2017-07-11 14:25:19.062586 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/173072747
- 2017-07-11 14:25:19.492171 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/831225806
- 2017-07-11 14:25:19.974552 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/038534357
- 2017-07-11 14:25:20.620045 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/207391792
- 2017-07-11 14:25:21.081622 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/048601551
- 2017-07-11 14:25:21.274735 I | api: 1c415cb9-28fd-4590-9b68-520d75548616 GET /metrics GetMetrics (start)
- 2017-07-11 14:25:21.638952 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/715129570
- 2017-07-11 14:25:22.091126 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/875322073
- 2017-07-11 14:25:22.564434 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/681241188
- 2017-07-11 14:25:23.057313 I | api: 2adf031a-84ca-4921-b2ec-1236dab122f7 GET /metrics GetMetrics 200 OK 46.1900494s
- 2017-07-11 14:25:23.057734 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/830306419
- 2017-07-11 14:25:23.501829 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/164712246
- 2017-07-11 14:25:23.994205 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/096838429
- 2017-07-11 14:25:24.537244 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/085851096
- 2017-07-11 14:25:25.025985 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/826602327
- 2017-07-11 14:25:25.582247 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/097580234
- 2017-07-11 14:25:26.088226 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/514203553
- 2017-07-11 14:25:26.223786 I | api: a7b8a1a2-e45c-4fda-8c2c-6c00094f924a GET /metrics GetMetrics (start)
- 2017-07-11 14:25:26.566949 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/305247372
- 2017-07-11 14:25:27.096772 I | api: 09298c02-3ef0-4904-934d-8e5e58520680 GET /metrics GetMetrics 200 OK 45.298670815s
- 2017-07-11 14:25:27.097089 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/559633019
- 2017-07-11 14:25:27.541877 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/966961566
- 2017-07-11 14:25:27.999168 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/310308965
- 2017-07-11 14:25:28.476209 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/355920512
- 2017-07-11 14:25:28.963212 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/405265375
- 2017-07-11 14:25:29.425129 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/503749042
- 2017-07-11 14:25:29.908424 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/926343017
- 2017-07-11 14:25:30.450575 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/469242292
- 2017-07-11 14:25:30.914402 I | api: e787b0a2-c955-408d-9904-3c0787911910 GET /metrics GetMetrics 200 OK 44.180312558s
- 2017-07-11 14:25:30.920210 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/341448067
- 2017-07-11 14:25:31.157082 I | api: ab85b9a4-497b-4dd9-8072-e8eb21688e2a GET /metrics GetMetrics (start)
- 2017-07-11 14:25:31.380346 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/130315014
- 2017-07-11 14:25:32.013857 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/418765997
- 2017-07-11 14:25:32.437919 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/731724840
- 2017-07-11 14:25:32.905860 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/096005479
- 2017-07-11 14:25:33.346053 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/520155034
- 2017-07-11 14:25:33.979119 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/708108849
- 2017-07-11 14:25:34.415565 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/524246492
- 2017-07-11 14:25:34.961485 I | api: 5be2d65d-008a-4d9c-844c-646306b8facd GET /metrics GetMetrics 200 OK 43.289134442s
- 2017-07-11 14:25:34.970490 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/224104843
- 2017-07-11 14:25:35.532493 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/002140526
- 2017-07-11 14:25:35.979970 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/819089909
- 2017-07-11 14:25:36.087732 I | api: bf47a1b2-1e2b-4bf8-9cc5-12887468b9f5 GET /metrics GetMetrics (start)
- 2017-07-11 14:25:36.714514 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/600274128
- 2017-07-11 14:25:37.192220 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/539507183
- 2017-07-11 14:25:37.694605 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/215169154
- 2017-07-11 14:25:38.158859 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/170187769
- 2017-07-11 14:25:38.623441 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/486657284
- 2017-07-11 14:25:39.075241 I | api: ddf5930f-84f7-40c6-b35d-4c68f33c7efd GET /metrics GetMetrics 200 OK 42.473584029s
- 2017-07-11 14:25:39.075509 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/757192851
- 2017-07-11 14:25:39.547944 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/909803734
- 2017-07-11 14:25:40.039063 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/325073469
- 2017-07-11 14:25:40.424299 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/899540088
- 2017-07-11 14:25:40.877730 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/149152119
- 2017-07-11 14:25:41.019993 I | api: f723d6c3-2f2a-4668-88cd-143ac86a554d GET /metrics GetMetrics (start)
- 2017-07-11 14:25:41.357474 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/155204714
- 2017-07-11 14:25:41.816097 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/231654593
- 2017-07-11 14:25:42.280440 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/301417260
- 2017-07-11 14:25:42.761346 I | api: b0e0ea9e-dc7c-402b-983d-ca44d059a246 GET /metrics GetMetrics 200 OK 41.224964191s
- 2017-07-11 14:25:42.761665 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/347957403
- 2017-07-11 14:25:43.237298 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/175299902
- 2017-07-11 14:25:43.779458 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/638160261
- 2017-07-11 14:25:44.239326 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/324265760
- 2017-07-11 14:25:44.729982 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/937979903
- 2017-07-11 14:25:45.205706 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/680372562
- 2017-07-11 14:25:45.752717 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/550091913
- 2017-07-11 14:25:45.947185 I | api: 36002d4a-4407-4f2b-a720-e0d5ac0454d2 GET /metrics GetMetrics (start)
- 2017-07-11 14:25:46.230184 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/972523604
- 2017-07-11 14:25:46.698559 I | api: 8a448c03-5625-4f5e-b1b1-8c93e38c2f7d GET /metrics GetMetrics 200 OK 40.221923575s
- 2017-07-11 14:25:46.698836 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/181121955
- 2017-07-11 14:25:47.174553 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/849743014
- 2017-07-11 14:25:47.632900 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/874363853
- 2017-07-11 14:25:48.082003 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/298461896
- 2017-07-11 14:25:48.552925 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/729182599
- 2017-07-11 14:25:49.007137 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/015091514
- 2017-07-11 14:25:49.447776 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/247498065
- 2017-07-11 14:25:49.899743 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/805518460
- 2017-07-11 14:25:50.473304 I | api: a486929a-13ae-48af-827d-e9b6fee28c6c GET /metrics GetMetrics 200 OK 39.061548182s
- 2017-07-11 14:25:50.482996 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/277603755
- 2017-07-11 14:25:50.878025 I | api: a0428058-d70b-4b76-a1b5-bd86b18f45dd GET /metrics GetMetrics (start)
- 2017-07-11 14:25:50.939221 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/887188750
- 2017-07-11 14:25:51.387190 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/046713621
- 2017-07-11 14:25:51.845401 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/750473072
- 2017-07-11 14:25:52.348366 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/224969231
- 2017-07-11 14:25:52.823336 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/818032674
- 2017-07-11 14:25:53.344148 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/282310425
- 2017-07-11 14:25:53.846432 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/402221988
- 2017-07-11 14:25:54.347796 I | api: dda8ec35-2b15-4708-a128-66ea19cacf74 GET /metrics GetMetrics 200 OK 38.003631988s
- 2017-07-11 14:25:54.353981 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/310945459
- 2017-07-11 14:25:54.860924 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/793674358
- 2017-07-11 14:25:55.299181 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/834077533
- 2017-07-11 14:25:55.813730 I | api: 8b55e4b7-b34f-4533-8505-6dc1ccc7f05f GET /metrics GetMetrics (start)
- 2017-07-11 14:25:55.866381 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/705057560
- 2017-07-11 14:25:56.316057 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/228767639
- 2017-07-11 14:25:56.802358 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/502247946
- 2017-07-11 14:25:57.285821 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/776955361
- 2017-07-11 14:25:57.733856 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/112740812
- 2017-07-11 14:25:58.204863 I | api: 1c415cb9-28fd-4590-9b68-520d75548616 GET /metrics GetMetrics 200 OK 36.930125765s
- 2017-07-11 14:25:58.216091 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/907934395
- 2017-07-11 14:25:58.703840 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/780363486
- 2017-07-11 14:25:59.161843 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/830675109
- 2017-07-11 14:25:59.623803 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/512611776
- 2017-07-11 14:26:00.223641 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/955992607
- 2017-07-11 14:26:00.719976 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/944305394
- 2017-07-11 14:26:00.747793 I | api: c43b0f29-fc68-4843-a6dc-b4ad82ae2a3e GET /metrics GetMetrics (start)
- 2017-07-11 14:26:01.171680 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/567004073
- 2017-07-11 14:26:01.627947 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/009522932
- 2017-07-11 14:26:02.126349 I | api: a7b8a1a2-e45c-4fda-8c2c-6c00094f924a GET /metrics GetMetrics 200 OK 35.902568288s
- 2017-07-11 14:26:02.126620 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/117003203
- 2017-07-11 14:26:02.642146 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/686875206
- 2017-07-11 14:26:03.078185 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/506476781
- 2017-07-11 14:26:03.550960 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/535670120
- 2017-07-11 14:26:03.985792 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/318282151
- 2017-07-11 14:26:04.484262 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/308903130
- 2017-07-11 14:26:04.988896 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/065593457
- 2017-07-11 14:26:05.528269 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/433786140
- 2017-07-11 14:26:05.680148 I | api: f29e05ed-30f1-4a8e-9645-05c3f1a0ed3b GET /metrics GetMetrics (start)
- 2017-07-11 14:26:06.306612 I | api: ab85b9a4-497b-4dd9-8072-e8eb21688e2a GET /metrics GetMetrics 200 OK 35.149534759s
- 2017-07-11 14:26:06.306853 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/130621899
- 2017-07-11 14:26:06.764349 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/343946926
- 2017-07-11 14:26:07.258789 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/223783989
- 2017-07-11 14:26:07.772158 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/177582096
- 2017-07-11 14:26:08.309543 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/361071151
- 2017-07-11 14:26:08.762462 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/852424642
- 2017-07-11 14:26:09.216516 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/414223929
- 2017-07-11 14:26:09.675852 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/653927492
- 2017-07-11 14:26:10.149079 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/815732947
- 2017-07-11 14:26:10.149942 I | api: bf47a1b2-1e2b-4bf8-9cc5-12887468b9f5 GET /metrics GetMetrics 200 OK 34.06220659s
- 2017-07-11 14:26:10.614337 I | api: 630cac5f-530d-43b6-9a90-81b6b58ae4b8 GET /metrics GetMetrics (start)
- 2017-07-11 14:26:10.617132 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/066019862
- 2017-07-11 14:26:11.199667 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/439532157
- 2017-07-11 14:26:11.653934 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/253366712
- 2017-07-11 14:26:12.163027 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/559535031
- 2017-07-11 14:26:12.649312 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/906743722
- 2017-07-11 14:26:13.229445 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/524312833
- 2017-07-11 14:26:13.755105 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/981208172
- 2017-07-11 14:26:14.261664 I | api: f723d6c3-2f2a-4668-88cd-143ac86a554d GET /metrics GetMetrics 200 OK 33.241668951s
- 2017-07-11 14:26:14.262113 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/627719899
- 2017-07-11 14:26:14.851399 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/813354622
- 2017-07-11 14:26:15.330051 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/323512773
- 2017-07-11 14:26:15.544041 I | api: f56b3e65-7187-4604-9f8e-07815d3bdd4c GET /metrics GetMetrics (start)
- 2017-07-11 14:26:15.917148 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/702744160
- 2017-07-11 14:26:16.362684 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/728263231
- 2017-07-11 14:26:16.832823 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/007395986
- 2017-07-11 14:26:17.479300 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/649765065
- 2017-07-11 14:26:17.995988 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/342713748
- 2017-07-11 14:26:18.462586 I | api: 36002d4a-4407-4f2b-a720-e0d5ac0454d2 GET /metrics GetMetrics 200 OK 32.51540563s
- 2017-07-11 14:26:18.462857 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/728040419
- 2017-07-11 14:26:18.915830 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/958905830
- 2017-07-11 14:26:19.371404 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/432776205
- 2017-07-11 14:26:19.826161 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/235279368
- 2017-07-11 14:26:20.334119 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/149041095
- 2017-07-11 14:26:20.496004 I | api: 8e785ada-6c4f-4410-b742-f4b6f1394133 GET /metrics GetMetrics (start)
- 2017-07-11 14:26:20.780207 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/036574842
- 2017-07-11 14:26:21.252653 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/260364689
- 2017-07-11 14:26:21.720408 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/081393596
- 2017-07-11 14:26:22.199259 I | api: a0428058-d70b-4b76-a1b5-bd86b18f45dd GET /metrics GetMetrics 200 OK 31.321240435s
- 2017-07-11 14:26:22.199861 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/614935019
- 2017-07-11 14:26:22.681027 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/954923086
- 2017-07-11 14:26:23.141483 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/276790101
- 2017-07-11 14:26:23.714400 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/662997168
- 2017-07-11 14:26:24.207140 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/082165327
- 2017-07-11 14:26:24.729251 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/150755682
- 2017-07-11 14:26:25.231826 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/151216473
- 2017-07-11 14:26:25.433414 I | api: 8683d39c-5264-489c-8529-c0f99bd5749c GET /metrics GetMetrics (start)
- 2017-07-11 14:26:25.762561 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/098277604
- 2017-07-11 14:26:26.273628 I | api: 8b55e4b7-b34f-4533-8505-6dc1ccc7f05f GET /metrics GetMetrics 200 OK 30.45989455s
- 2017-07-11 14:26:26.273894 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/662832883
- 2017-07-11 14:26:26.727512 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/669082038
- 2017-07-11 14:26:27.166198 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/593484189
- 2017-07-11 14:26:27.677182 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/409749592
- 2017-07-11 14:26:28.152028 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/481423831
- 2017-07-11 14:26:28.602979 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/903013706
- 2017-07-11 14:26:29.273870 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/673139233
- 2017-07-11 14:26:29.775062 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/746935564
- 2017-07-11 14:26:30.352893 I | api: c43b0f29-fc68-4843-a6dc-b4ad82ae2a3e GET /metrics GetMetrics 200 OK 29.605104816s
- 2017-07-11 14:26:30.358762 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/520127739
- 2017-07-11 14:26:30.439303 I | api: 36163b05-3a1a-4067-a080-c58c0ce5ce6c GET /metrics GetMetrics (start)
- 2017-07-11 14:26:30.789083 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/850538014
- 2017-07-11 14:26:31.229841 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/156312293
- 2017-07-11 14:26:31.800906 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/118120192
- 2017-07-11 14:26:32.242444 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/222151263
- 2017-07-11 14:26:32.695444 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/970100786
- 2017-07-11 14:26:33.159251 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/853814761
- 2017-07-11 14:26:33.604598 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/775146548
- 2017-07-11 14:26:34.102892 I | api: f29e05ed-30f1-4a8e-9645-05c3f1a0ed3b GET /metrics GetMetrics 200 OK 28.422748965s
- 2017-07-11 14:26:34.103207 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/070356483
- 2017-07-11 14:26:34.597451 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/265509766
- 2017-07-11 14:26:35.054549 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/817364269
- 2017-07-11 14:26:35.479381 I | api: 018b9454-0173-4919-99e0-b56a98af11e2 GET /metrics GetMetrics (start)
- 2017-07-11 14:26:35.588757 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/188440232
- 2017-07-11 14:26:36.051193 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/237981671
- 2017-07-11 14:26:36.517569 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/369183258
- 2017-07-11 14:26:36.973971 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/280150193
- 2017-07-11 14:26:37.557932 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/198680156
- 2017-07-11 14:26:38.031524 I | api: 630cac5f-530d-43b6-9a90-81b6b58ae4b8 GET /metrics GetMetrics 200 OK 27.417190841s
- 2017-07-11 14:26:38.031771 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/956780555
- 2017-07-11 14:26:38.490842 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/617491438
- 2017-07-11 14:26:38.962982 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/326135413
- 2017-07-11 14:26:39.399880 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/839851344
- 2017-07-11 14:26:39.904086 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/221003887
- 2017-07-11 14:26:40.310701 I | api: f795ebe8-5555-4d1d-a8a7-111d4dffc26f GET /metrics GetMetrics (start)
- 2017-07-11 14:26:40.393278 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/934044418
- 2017-07-11 14:26:40.811537 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/166363257
- 2017-07-11 14:26:41.266230 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/632353156
- 2017-07-11 14:26:41.733711 I | api: f56b3e65-7187-4604-9f8e-07815d3bdd4c GET /metrics GetMetrics 200 OK 26.189676168s
- 2017-07-11 14:26:41.733968 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/015664403
- 2017-07-11 14:26:42.311950 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/892354390
- 2017-07-11 14:26:42.804925 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/319574717
- 2017-07-11 14:26:43.262470 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/038708984
- 2017-07-11 14:26:43.772405 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/655123447
- 2017-07-11 14:26:44.214315 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/856438506
- 2017-07-11 14:26:44.688848 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/248052033
- 2017-07-11 14:26:45.122637 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/733067180
- 2017-07-11 14:26:45.241140 I | api: fc09a571-07cb-43bb-8363-e258ae73050e GET /metrics GetMetrics (start)
- 2017-07-11 14:26:45.626733 I | api: 8e785ada-6c4f-4410-b742-f4b6f1394133 GET /metrics GetMetrics 200 OK 25.130733877s
- 2017-07-11 14:26:45.626966 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/697466139
- 2017-07-11 14:26:46.033847 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/372979134
- 2017-07-11 14:26:46.463688 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/087790597
- 2017-07-11 14:26:46.892763 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/359097760
- 2017-07-11 14:26:47.318590 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/283285119
- 2017-07-11 14:26:47.800526 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/141615058
- 2017-07-11 14:26:48.237577 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/502249225
- 2017-07-11 14:26:48.691595 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/445416148
- 2017-07-11 14:26:49.119545 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/857117731
- 2017-07-11 14:26:49.120352 I | api: 8683d39c-5264-489c-8529-c0f99bd5749c GET /metrics GetMetrics 200 OK 23.686935988s
- 2017-07-11 14:26:49.524000 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/258646310
- 2017-07-11 14:26:50.015764 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/870773837
- 2017-07-11 14:26:50.173803 I | api: fa489790-4ed3-4a9e-a1d5-2c7b604c1f59 GET /metrics GetMetrics (start)
- 2017-07-11 14:26:50.453630 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/595589448
- 2017-07-11 14:26:50.842086 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/972673031
- 2017-07-11 14:26:51.267245 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/128994746
- 2017-07-11 14:26:51.694054 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/988428241
- 2017-07-11 14:26:52.142034 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/834111228
- 2017-07-11 14:26:52.775201 I | api: 36163b05-3a1a-4067-a080-c58c0ce5ce6c GET /metrics GetMetrics 200 OK 22.335904213s
- 2017-07-11 14:26:52.775456 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/122151979
- 2017-07-11 14:26:53.206564 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/658990478
- 2017-07-11 14:26:53.642867 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/096203157
- 2017-07-11 14:26:54.122958 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/013145584
- 2017-07-11 14:26:54.556132 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/603705999
- 2017-07-11 14:26:55.008964 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/042113698
- 2017-07-11 14:26:55.116044 I | api: 62fe8b89-c496-4252-a2ff-e762e0752d85 GET /metrics GetMetrics (start)
- 2017-07-11 14:26:55.520818 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/990330265
- 2017-07-11 14:26:55.949173 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/783746596
- 2017-07-11 14:26:56.766459 I | api: 018b9454-0173-4919-99e0-b56a98af11e2 GET /metrics GetMetrics 200 OK 21.287083876s
- 2017-07-11 14:26:56.766723 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/399722803
- 2017-07-11 14:26:57.196205 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/717876470
- 2017-07-11 14:26:57.677393 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/687875549
- 2017-07-11 14:26:58.113263 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/529131928
- 2017-07-11 14:26:58.647593 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/112370199
- 2017-07-11 14:26:59.272172 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/488621194
- 2017-07-11 14:26:59.747528 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/803906657
- 2017-07-11 14:27:00.040217 I | api: 28f54cb5-5c18-4e48-9385-7e766a71c978 GET /metrics GetMetrics (start)
- 2017-07-11 14:27:00.171812 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/745775180
- 2017-07-11 14:27:00.614328 I | api: f795ebe8-5555-4d1d-a8a7-111d4dffc26f GET /metrics GetMetrics 200 OK 20.303636346s
- 2017-07-11 14:27:00.614579 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/306766651
- 2017-07-11 14:27:01.014126 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/701773150
- 2017-07-11 14:27:01.476654 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/365546277
- 2017-07-11 14:27:02.009510 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/877771840
- 2017-07-11 14:27:02.409511 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/160725663
- 2017-07-11 14:27:03.050167 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/219742066
- 2017-07-11 14:27:03.480279 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/005951529
- 2017-07-11 14:27:03.948328 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/827661684
- 2017-07-11 14:27:04.562725 I | api: fc09a571-07cb-43bb-8363-e258ae73050e GET /metrics GetMetrics 200 OK 19.315813219s
- 2017-07-11 14:27:04.563383 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/278664771
- 2017-07-11 14:27:04.968490 I | api: e075e26d-51a0-4cc8-b9f6-aac1b530a2ca GET /metrics GetMetrics (start)
- 2017-07-11 14:27:05.120816 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/282820806
- 2017-07-11 14:27:05.670922 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/375132013
- 2017-07-11 14:27:06.098612 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/771482600
- 2017-07-11 14:27:06.537766 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/651338791
- 2017-07-11 14:27:07.052418 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/084432730
- 2017-07-11 14:27:07.536727 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/483947761
- 2017-07-11 14:27:07.994626 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/404082076
- 2017-07-11 14:27:08.404375 I | api: fa489790-4ed3-4a9e-a1d5-2c7b604c1f59 GET /metrics GetMetrics 200 OK 18.230571669s
- 2017-07-11 14:27:08.413244 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/176537163
- 2017-07-11 14:27:08.835237 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/131690286
- 2017-07-11 14:27:09.266167 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/210323637
- 2017-07-11 14:27:09.700100 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/634585232
- 2017-07-11 14:27:09.896304 I | api: a6476bdc-bae6-4092-b175-b7f4568c77f5 GET /metrics GetMetrics (start)
- 2017-07-11 14:27:10.117517 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/049757871
- 2017-07-11 14:27:10.542921 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/293328962
- 2017-07-11 14:27:11.000934 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/061701305
- 2017-07-11 14:27:11.424862 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/120627396
- 2017-07-11 14:27:11.915350 I | api: 62fe8b89-c496-4252-a2ff-e762e0752d85 GET /metrics GetMetrics 200 OK 16.799311997s
- 2017-07-11 14:27:11.915648 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/112644947
- 2017-07-11 14:27:12.407180 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/295070358
- 2017-07-11 14:27:12.850928 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/224954621
- 2017-07-11 14:27:13.409247 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/974158904
- 2017-07-11 14:27:13.833631 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/795554871
- 2017-07-11 14:27:14.309740 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/172354602
- 2017-07-11 14:27:14.772533 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/130829185
- 2017-07-11 14:27:14.832865 I | api: 7793cf26-f5fe-40a2-8018-ee780211e6b8 GET /metrics GetMetrics (start)
- 2017-07-11 14:27:15.276771 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/484325100
- 2017-07-11 14:27:15.841212 I | api: 28f54cb5-5c18-4e48-9385-7e766a71c978 GET /metrics GetMetrics 200 OK 15.800996875s
- 2017-07-11 14:27:15.849494 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/594555227
- 2017-07-11 14:27:16.251265 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/767848702
- 2017-07-11 14:27:16.723792 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/251223109
- 2017-07-11 14:27:17.181547 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/388039904
- 2017-07-11 14:27:17.602458 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/391868095
- 2017-07-11 14:27:18.073759 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/405991186
- 2017-07-11 14:27:18.523582 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/453526345
- 2017-07-11 14:27:18.974288 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/026533908
- 2017-07-11 14:27:19.444783 I | api: e075e26d-51a0-4cc8-b9f6-aac1b530a2ca GET /metrics GetMetrics 200 OK 14.476296599s
- 2017-07-11 14:27:19.445059 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/592447075
- 2017-07-11 14:27:19.763157 I | api: c955b9f9-f2a3-467f-9177-4595a3837f00 GET /metrics GetMetrics (start)
- 2017-07-11 14:27:19.889470 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/144888422
- 2017-07-11 14:27:20.351901 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/453963917
- 2017-07-11 14:27:20.750615 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/440161416
- 2017-07-11 14:27:21.197579 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/238216775
- 2017-07-11 14:27:22.031006 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/655110394
- 2017-07-11 14:27:22.461063 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/690662929
- 2017-07-11 14:27:23.074046 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/628146748
- 2017-07-11 14:27:23.555155 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/810081899
- 2017-07-11 14:27:23.556995 I | api: a6476bdc-bae6-4092-b175-b7f4568c77f5 GET /metrics GetMetrics 200 OK 13.660696279s
- 2017-07-11 14:27:23.992472 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/107759822
- 2017-07-11 14:27:24.471418 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/420970453
- 2017-07-11 14:27:24.691804 I | api: 17da64fb-f761-4bc5-936d-1cc5b19a1ce0 GET /metrics GetMetrics (start)
- 2017-07-11 14:27:24.931692 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/532776240
- 2017-07-11 14:27:25.683401 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/666980047
- 2017-07-11 14:27:26.122758 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/714794466
- 2017-07-11 14:27:26.668061 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/266585561
- 2017-07-11 14:27:27.132790 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/546709348
- 2017-07-11 14:27:27.571086 I | api: 7793cf26-f5fe-40a2-8018-ee780211e6b8 GET /metrics GetMetrics 200 OK 12.738217614s
- 2017-07-11 14:27:27.571330 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/224209267
- 2017-07-11 14:27:28.057236 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/350806070
- 2017-07-11 14:27:28.476220 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/208843293
- 2017-07-11 14:27:28.898795 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/876216536
- 2017-07-11 14:27:29.339434 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/018115159
- 2017-07-11 14:27:29.622778 I | api: 5ce5e83c-a44d-4293-982f-269a447d8882 GET /metrics GetMetrics (start)
- 2017-07-11 14:27:29.791887 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/226588618
- 2017-07-11 14:27:30.502813 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/254216353
- 2017-07-11 14:27:30.898479 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/720945036
- 2017-07-11 14:27:31.309323 I | api: c955b9f9-f2a3-467f-9177-4595a3837f00 GET /metrics GetMetrics 200 OK 11.546168812s
- 2017-07-11 14:27:31.318151 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/842081147
- 2017-07-11 14:27:31.796820 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/932098718
- 2017-07-11 14:27:32.219840 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/905411941
- 2017-07-11 14:27:32.652751 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/570634624
- 2017-07-11 14:27:33.074100 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/507474655
- 2017-07-11 14:27:33.512013 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/995512498
- 2017-07-11 14:27:33.951909 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/611299945
- 2017-07-11 14:27:34.372898 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/892293300
- 2017-07-11 14:27:34.552862 I | api: b3cb0f77-118a-44bc-8478-13869e2acce7 GET /metrics GetMetrics (start)
- 2017-07-11 14:27:34.812565 I | api: 17da64fb-f761-4bc5-936d-1cc5b19a1ce0 GET /metrics GetMetrics 200 OK 10.120765361s
- 2017-07-11 14:27:34.812818 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/417990275
- 2017-07-11 14:27:35.264653 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/639217670
- 2017-07-11 14:27:35.797623 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/097356205
- 2017-07-11 14:27:36.214784 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/734953768
- 2017-07-11 14:27:36.645586 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/723297383
- 2017-07-11 14:27:37.107715 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/206797978
- 2017-07-11 14:27:37.536776 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/472831281
- 2017-07-11 14:27:38.001339 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/003854556
- 2017-07-11 14:27:38.437906 I | api: 5ce5e83c-a44d-4293-982f-269a447d8882 GET /metrics GetMetrics 200 OK 8.815127959s
- 2017-07-11 14:27:38.440473 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/337589899
- 2017-07-11 14:27:38.897265 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/089332334
- 2017-07-11 14:27:39.326809 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/854400757
- 2017-07-11 14:27:39.485782 I | api: db7f1abb-ff01-4143-bdf0-4074a9af0f86 GET /metrics GetMetrics (start)
- 2017-07-11 14:27:39.777754 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/388061648
- 2017-07-11 14:27:40.201837 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/851527407
- 2017-07-11 14:27:40.593089 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/132287874
- 2017-07-11 14:27:41.079699 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/104042745
- 2017-07-11 14:27:41.521988 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/301250564
- 2017-07-11 14:27:41.999649 I | api: b3cb0f77-118a-44bc-8478-13869e2acce7 GET /metrics GetMetrics 200 OK 7.446790794s
- 2017-07-11 14:27:41.999932 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/051172243
- 2017-07-11 14:27:42.427833 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/074303446
- 2017-07-11 14:27:42.915147 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/079101757
- 2017-07-11 14:27:43.380144 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/557083000
- 2017-07-11 14:27:43.819699 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/119241335
- 2017-07-11 14:27:44.254885 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/916430186
- 2017-07-11 14:27:44.415861 I | api: fe883917-ed29-49c9-b056-2ba7b5e52604 GET /metrics GetMetrics (start)
- 2017-07-11 14:27:44.913321 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/204539329
- 2017-07-11 14:27:45.348658 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/825989164
- 2017-07-11 14:27:45.928423 I | api: db7f1abb-ff01-4143-bdf0-4074a9af0f86 GET /metrics GetMetrics 200 OK 6.442639201s
- 2017-07-11 14:27:45.936884 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/840153499
- 2017-07-11 14:27:46.361613 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/280347710
- 2017-07-11 14:27:46.820447 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/092683397
- 2017-07-11 14:27:47.251988 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/663058464
- 2017-07-11 14:27:47.701582 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/031674623
- 2017-07-11 14:27:48.153617 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/492194898
- 2017-07-11 14:27:48.791138 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/628352905
- 2017-07-11 14:27:49.218585 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/905711956
- 2017-07-11 14:27:49.340848 I | api: 7cfa191e-96d4-40f6-b5e3-9553b2e7e438 GET /metrics GetMetrics (start)
- 2017-07-11 14:27:49.660693 I | api: fe883917-ed29-49c9-b056-2ba7b5e52604 GET /metrics GetMetrics 200 OK 5.244837823s
- 2017-07-11 14:27:49.660911 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/441928867
- 2017-07-11 14:27:50.099152 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/612461478
- 2017-07-11 14:27:50.531392 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/931760845
- 2017-07-11 14:27:51.115667 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/608539080
- 2017-07-11 14:27:51.539548 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/352519815
- 2017-07-11 14:27:52.017890 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/461488186
- 2017-07-11 14:27:52.521592 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/109850193
- 2017-07-11 14:27:53.018669 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/806750076
- 2017-07-11 14:27:53.476168 I | api: 7cfa191e-96d4-40f6-b5e3-9553b2e7e438 GET /metrics GetMetrics 200 OK 4.135321911s
- 2017-07-11 14:27:53.970435 I | api: 2c658345-7942-4b0a-ab0f-2d37e3d385d3 GET /metrics GetMetrics (start)
- 2017-07-11 14:27:53.970773 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/173359275
- 2017-07-11 14:27:54.525473 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/188374542
- 2017-07-11 14:27:55.024385 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/060982293
- 2017-07-11 14:27:55.442783 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/142586992
- 2017-07-11 14:27:56.039246 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/108019983
- 2017-07-11 14:27:56.465907 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/760194850
- 2017-07-11 14:27:56.972602 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/930723353
- 2017-07-11 14:27:57.400786 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/254020772
- 2017-07-11 14:27:57.854582 I | api: 2c658345-7942-4b0a-ab0f-2d37e3d385d3 GET /metrics GetMetrics 200 OK 3.884156473s
- 2017-07-11 14:27:58.898999 I | api: 32302434-e15b-4841-b6d5-2d6ead924d8c GET /metrics GetMetrics (start)
- 2017-07-11 14:27:58.899910 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/797530035
- 2017-07-11 14:27:59.374923 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/937262966
- 2017-07-11 14:27:59.890388 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/321720925
- 2017-07-11 14:28:00.502851 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/042789912
- 2017-07-11 14:28:00.952275 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/284007063
- 2017-07-11 14:28:01.466196 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/453143306
- 2017-07-11 14:28:01.900152 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/772703457
- 2017-07-11 14:28:02.347063 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/652839628
- 2017-07-11 14:28:02.843837 I | api: 32302434-e15b-4841-b6d5-2d6ead924d8c GET /metrics GetMetrics 200 OK 3.944835889s
- 2017-07-11 14:28:03.823401 I | api: 9ab64a36-9074-423c-91f4-87f78bb79043 GET /metrics GetMetrics (start)
- 2017-07-11 14:28:03.824284 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/889141179
- 2017-07-11 14:28:04.245328 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/918319070
- 2017-07-11 14:28:04.683505 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/296685989
- 2017-07-11 14:28:05.133167 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/164616384
- 2017-07-11 14:28:05.613234 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/071898911
- 2017-07-11 14:28:06.144737 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/493567986
- 2017-07-11 14:28:06.641431 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/036520105
- 2017-07-11 14:28:07.074774 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/178073588
- 2017-07-11 14:28:07.521282 I | api: 9ab64a36-9074-423c-91f4-87f78bb79043 GET /metrics GetMetrics 200 OK 3.69788461s
- 2017-07-11 14:28:08.751575 I | api: 87fe9edb-3731-4e83-8751-8b86f369f1a8 GET /metrics GetMetrics (start)
- 2017-07-11 14:28:08.752525 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/418006211
- 2017-07-11 14:28:09.175847 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/603818822
- 2017-07-11 14:28:09.888178 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/155224045
- 2017-07-11 14:28:10.314652 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/717850216
- 2017-07-11 14:28:10.693683 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/102608551
- 2017-07-11 14:28:11.308076 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/677265370
- 2017-07-11 14:28:11.728169 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/526453105
- 2017-07-11 14:28:12.184798 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/615536668
- 2017-07-11 14:28:12.660878 I | api: 87fe9edb-3731-4e83-8751-8b86f369f1a8 GET /metrics GetMetrics 200 OK 3.909309026s
- 2017-07-11 14:28:13.680065 I | api: 6fe0a44c-c883-4d95-a2e3-2675d919e3ae GET /metrics GetMetrics (start)
- 2017-07-11 14:28:13.683924 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/061378763
- 2017-07-11 14:28:14.076979 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/651850158
- 2017-07-11 14:28:14.599483 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/490029877
- 2017-07-11 14:28:15.018773 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/000300304
- 2017-07-11 14:28:15.558972 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/409281327
- 2017-07-11 14:28:16.010148 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/726672578
- 2017-07-11 14:28:16.444825 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/486032185
- 2017-07-11 14:28:16.894902 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/020399428
- 2017-07-11 14:28:17.388373 I | api: 6fe0a44c-c883-4d95-a2e3-2675d919e3ae GET /metrics GetMetrics 200 OK 3.708312092s
- 2017-07-11 14:28:18.607832 I | api: ee717db1-36cf-4362-a2db-8ff258283d08 GET /metrics GetMetrics (start)
- 2017-07-11 14:28:18.608652 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/029354963
- 2017-07-11 14:28:19.024321 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/283800342
- 2017-07-11 14:28:19.442107 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/584220541
- 2017-07-11 14:28:19.890158 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/768655032
- 2017-07-11 14:28:20.315945 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/543369399
- 2017-07-11 14:28:20.704072 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/404214442
- 2017-07-11 14:28:21.152793 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/459721217
- 2017-07-11 14:28:21.582939 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/537906540
- 2017-07-11 14:28:22.063139 I | api: ee717db1-36cf-4362-a2db-8ff258283d08 GET /metrics GetMetrics 200 OK 3.455306219s
- 2017-07-11 14:28:23.541254 I | api: a152f4bd-13c9-4cad-9f31-b57abb777d11 GET /metrics GetMetrics (start)
- 2017-07-11 14:28:23.547803 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/324136411
- 2017-07-11 14:28:23.981339 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/381700478
- 2017-07-11 14:28:24.400515 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/784917189
- 2017-07-11 14:28:25.003142 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/426350432
- 2017-07-11 14:28:25.442871 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/844043583
- 2017-07-11 14:28:26.007769 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/985769362
- 2017-07-11 14:28:26.443177 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/340325321
- 2017-07-11 14:28:26.891153 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/271304340
- 2017-07-11 14:28:27.414320 I | api: a152f4bd-13c9-4cad-9f31-b57abb777d11 GET /metrics GetMetrics 200 OK 3.873070153s
- 2017-07-11 14:28:28.464299 I | api: f16ccb8d-e427-4e2d-85e6-01748cf0b075 GET /metrics GetMetrics (start)
- 2017-07-11 14:28:28.465165 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/577139939
- 2017-07-11 14:28:28.920315 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/319871206
- 2017-07-11 14:28:29.359908 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/422288141
- 2017-07-11 14:28:29.810298 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/129106184
- 2017-07-11 14:28:30.253715 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/796171463
- 2017-07-11 14:28:30.633316 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/173469050
- 2017-07-11 14:28:31.055165 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/062513297
- 2017-07-11 14:28:31.496287 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/786912956
- 2017-07-11 14:28:31.929679 I | api: f16ccb8d-e427-4e2d-85e6-01748cf0b075 GET /metrics GetMetrics 200 OK 3.465383211s
- 2017-07-11 14:28:33.392956 I | api: e1e29132-de0e-47c8-9adf-04a25dc19367 GET /metrics GetMetrics (start)
- 2017-07-11 14:28:33.393903 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/960229611
- 2017-07-11 14:28:33.835893 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/746621774
- 2017-07-11 14:28:34.284653 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/194838101
- 2017-07-11 14:28:34.747220 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/131984816
- 2017-07-11 14:28:35.188673 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/541632847
- 2017-07-11 14:28:35.717042 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/548486242
- 2017-07-11 14:28:36.234949 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/597161049
- 2017-07-11 14:28:36.802973 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/141244900
- 2017-07-11 14:28:37.277650 I | api: e1e29132-de0e-47c8-9adf-04a25dc19367 GET /metrics GetMetrics 200 OK 3.884738615s
- 2017-07-11 14:28:38.320780 I | api: 5858ca19-7f57-4d3d-a45e-31d61aee03c5 GET /metrics GetMetrics (start)
- 2017-07-11 14:28:38.321548 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/379828211
- 2017-07-11 14:28:38.757367 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/035479222
- 2017-07-11 14:28:39.171185 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/265583773
- 2017-07-11 14:28:39.608957 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/284314968
- 2017-07-11 14:28:40.032567 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/659070679
- 2017-07-11 14:28:40.455039 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/283287114
- 2017-07-11 14:28:40.910340 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/001875745
- 2017-07-11 14:28:41.356807 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/005660684
- 2017-07-11 14:28:41.904801 I | api: 5858ca19-7f57-4d3d-a45e-31d61aee03c5 GET /metrics GetMetrics 200 OK 3.584001901s
- 2017-07-11 14:28:43.243820 I | api: 8aa5c47e-b5c0-43d7-a778-d4bb16a4be93 GET /metrics GetMetrics (start)
- 2017-07-11 14:28:43.244628 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/874693115
- 2017-07-11 14:28:43.655671 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/110980382
- 2017-07-11 14:28:44.087648 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/838919653
- 2017-07-11 14:28:44.540436 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/881235968
- 2017-07-11 14:28:44.965275 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/442273631
- 2017-07-11 14:28:45.429050 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/163675442
- 2017-07-11 14:28:45.953678 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/427046633
- 2017-07-11 14:28:46.374708 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/672809268
- 2017-07-11 14:28:46.791359 I | api: 8aa5c47e-b5c0-43d7-a778-d4bb16a4be93 GET /metrics GetMetrics 200 OK 3.547209227s
- 2017-07-11 14:28:48.173662 I | api: b5b517c0-27f7-4a91-944f-48b04b6dd90d GET /metrics GetMetrics (start)
- 2017-07-11 14:28:48.174885 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/102258435
- 2017-07-11 14:28:48.591653 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/929549958
- 2017-07-11 14:28:49.133786 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/023860781
- 2017-07-11 14:28:49.544339 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/317812136
- 2017-07-11 14:28:49.973472 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/101699815
- 2017-07-11 14:28:50.387482 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/100497690
- 2017-07-11 14:28:50.756219 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/293174705
- 2017-07-11 14:28:51.230166 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/455572828
- 2017-07-11 14:28:51.650691 I | api: b5b517c0-27f7-4a91-944f-48b04b6dd90d GET /metrics GetMetrics 200 OK 3.477027477s
- 2017-07-11 14:28:53.100830 I | api: 400747b9-8149-474b-bceb-115216a37bdd GET /metrics GetMetrics (start)
- 2017-07-11 14:28:53.101636 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/748118283
- 2017-07-11 14:28:53.519479 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/464483566
- 2017-07-11 14:28:53.971766 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/537714037
- 2017-07-11 14:28:54.369990 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/855128144
- 2017-07-11 14:28:54.795222 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/169664879
- 2017-07-11 14:28:55.222880 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/541074434
- 2017-07-11 14:28:55.754552 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/063990649
- 2017-07-11 14:28:56.169408 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/903025284
- 2017-07-11 14:28:56.588268 I | api: 400747b9-8149-474b-bceb-115216a37bdd GET /metrics GetMetrics 200 OK 3.48744358s
- 2017-07-11 14:28:58.028574 I | api: 75c28aed-f0e6-4936-ac0c-ba31f60cc960 GET /metrics GetMetrics (start)
- 2017-07-11 14:28:58.029454 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/139174419
- 2017-07-11 14:28:58.465114 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/871180374
- 2017-07-11 14:28:58.978204 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/516257213
- 2017-07-11 14:28:59.570868 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/548692472
- 2017-07-11 14:28:59.997652 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/648802039
- 2017-07-11 14:29:00.431082 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/845129194
- 2017-07-11 14:29:00.789430 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/665688129
- 2017-07-11 14:29:01.210189 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/063600812
- 2017-07-11 14:29:01.836713 I | api: 75c28aed-f0e6-4936-ac0c-ba31f60cc960 GET /metrics GetMetrics 200 OK 3.808129637s
- 2017-07-11 14:29:02.953562 I | api: 40423b63-a6d7-43cf-9501-fb605f4d39b8 GET /metrics GetMetrics (start)
- 2017-07-11 14:29:02.953924 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/715153947
- 2017-07-11 14:29:03.413411 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/796742334
- 2017-07-11 14:29:03.873065 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/049248517
- 2017-07-11 14:29:04.358865 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/403920032
- 2017-07-11 14:29:04.788264 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/659153791
- 2017-07-11 14:29:05.272024 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/725868754
- 2017-07-11 14:29:05.851586 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/861683721
- 2017-07-11 14:29:06.285202 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/205537748
- 2017-07-11 14:29:06.745718 I | api: 40423b63-a6d7-43cf-9501-fb605f4d39b8 GET /metrics GetMetrics 200 OK 3.792160149s
- 2017-07-11 14:29:07.882031 I | api: 3d39f2ff-3ee0-4930-9fc5-beed25ad4102 GET /metrics GetMetrics (start)
- 2017-07-11 14:29:07.882809 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/358497059
- 2017-07-11 14:29:08.319579 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/294332454
- 2017-07-11 14:29:08.813289 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/117411149
- 2017-07-11 14:29:09.217977 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/283857480
- 2017-07-11 14:29:09.643273 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/828535559
- 2017-07-11 14:29:10.128167 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/080070330
- 2017-07-11 14:29:10.633094 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/323819217
- 2017-07-11 14:29:11.068303 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/059368956
- 2017-07-11 14:29:11.595679 I | api: 3d39f2ff-3ee0-4930-9fc5-beed25ad4102 GET /metrics GetMetrics 200 OK 3.713647983s
- 2017-07-11 14:29:12.805524 I | api: 6e462c1c-2353-49f9-b5e3-84e61611096d GET /metrics GetMetrics (start)
- 2017-07-11 14:29:12.806337 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/517843755
- 2017-07-11 14:29:13.258281 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/522161294
- 2017-07-11 14:29:13.789024 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/484944533
- 2017-07-11 14:29:14.200029 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/864118512
- 2017-07-11 14:29:14.625443 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/361400207
- 2017-07-11 14:29:15.077971 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/818549154
- 2017-07-11 14:29:15.573833 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/069155993
- 2017-07-11 14:29:16.097142 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/222720292
- 2017-07-11 14:29:16.700571 I | api: 6e462c1c-2353-49f9-b5e3-84e61611096d GET /metrics GetMetrics 200 OK 3.895050476s
- 2017-07-11 14:29:17.734748 I | api: a9bc4407-3466-4056-8e23-b53e09e9904a GET /metrics GetMetrics (start)
- 2017-07-11 14:29:17.735596 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/779825203
- 2017-07-11 14:29:18.156709 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/867363318
- 2017-07-11 14:29:18.614388 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/648216285
- 2017-07-11 14:29:19.066656 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/340061848
- 2017-07-11 14:29:19.788256 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/966072599
- 2017-07-11 14:29:20.207512 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/905763722
- 2017-07-11 14:29:20.554941 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/542884705
- 2017-07-11 14:29:21.031912 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/612319052
- 2017-07-11 14:29:21.503994 I | api: a9bc4407-3466-4056-8e23-b53e09e9904a GET /metrics GetMetrics 200 OK 3.769246245s
- 2017-07-11 14:29:22.661972 I | api: baf0308f-cd2c-4679-b9c2-12a5faa5aa92 GET /metrics GetMetrics (start)
- 2017-07-11 14:29:22.662295 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/709290555
- 2017-07-11 14:29:23.163664 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/034370654
- 2017-07-11 14:29:23.614876 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/610438693
- 2017-07-11 14:29:24.051028 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/835884864
- 2017-07-11 14:29:24.470281 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/280615839
- 2017-07-11 14:29:24.908746 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/054507122
- 2017-07-11 14:29:25.356137 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/591990569
- 2017-07-11 14:29:26.279617 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/027983476
- 2017-07-11 14:29:26.711440 I | api: baf0308f-cd2c-4679-b9c2-12a5faa5aa92 GET /metrics GetMetrics 200 OK 4.049496712s
- 2017-07-11 14:29:27.589328 I | api: d64873b1-da4f-49e2-89b0-3242fa4498cd GET /metrics GetMetrics (start)
- 2017-07-11 14:29:27.590216 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/663001923
- 2017-07-11 14:29:28.018575 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/033013190
- 2017-07-11 14:29:28.437664 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/021937261
- 2017-07-11 14:29:28.871738 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/321319656
- 2017-07-11 14:29:29.285151 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/926871335
- 2017-07-11 14:29:29.815065 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/859932250
- 2017-07-11 14:29:30.238068 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/495099377
- 2017-07-11 14:29:30.597892 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/699051164
- 2017-07-11 14:29:31.116320 I | api: d64873b1-da4f-49e2-89b0-3242fa4498cd GET /metrics GetMetrics 200 OK 3.526992254s
- 2017-07-11 14:29:32.512257 I | api: 0a168f4b-b48d-405b-addc-71754e71818d GET /metrics GetMetrics (start)
- 2017-07-11 14:29:32.513116 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/281830219
- 2017-07-11 14:29:32.933515 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/951246894
- 2017-07-11 14:29:33.394474 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/196730805
- 2017-07-11 14:29:33.916888 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/705081232
- 2017-07-11 14:29:34.335827 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/768163247
- 2017-07-11 14:29:34.776736 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/293695810
- 2017-07-11 14:29:35.264396 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/178046393
- 2017-07-11 14:29:35.804538 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/352853956
- 2017-07-11 14:29:36.267515 I | api: 0a168f4b-b48d-405b-addc-71754e71818d GET /metrics GetMetrics 200 OK 3.755263786s
- 2017-07-11 14:29:37.440774 I | api: a07e0716-6b36-4cd0-9d25-0a0454250b72 GET /metrics GetMetrics (start)
- 2017-07-11 14:29:37.441689 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/136288339
- 2017-07-11 14:29:37.909638 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/152771990
- 2017-07-11 14:29:38.350477 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/429932541
- 2017-07-11 14:29:38.837623 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/730885432
- 2017-07-11 14:29:39.599834 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/205242167
- 2017-07-11 14:29:40.136152 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/817305386
- 2017-07-11 14:29:40.599042 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/960462465
- 2017-07-11 14:29:41.005655 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/330402796
- 2017-07-11 14:29:41.488014 I | api: a07e0716-6b36-4cd0-9d25-0a0454250b72 GET /metrics GetMetrics 200 OK 4.047236847s
- 2017-07-11 14:29:42.366487 I | api: 39c6bc1c-241d-4b3e-9d12-08e996d99882 GET /metrics GetMetrics (start)
- 2017-07-11 14:29:42.367667 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/755597915
- 2017-07-11 14:29:42.832281 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/849213950
- 2017-07-11 14:29:43.349664 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/910939461
- 2017-07-11 14:29:43.815943 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/985447904
- 2017-07-11 14:29:44.260453 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/675893183
- 2017-07-11 14:29:44.718934 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/035454482
- 2017-07-11 14:29:45.204134 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/243442761
- 2017-07-11 14:29:45.774068 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/339217172
- 2017-07-11 14:29:46.217148 I | api: 39c6bc1c-241d-4b3e-9d12-08e996d99882 GET /metrics GetMetrics 200 OK 3.85066567s
- 2017-07-11 14:29:47.293274 I | api: 2e2687df-fff9-4bab-8f3a-a01a18a1dafa GET /metrics GetMetrics (start)
- 2017-07-11 14:29:47.294240 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/105060707
- 2017-07-11 14:29:47.762032 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/046867302
- 2017-07-11 14:29:48.217833 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/692802445
- 2017-07-11 14:29:48.651941 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/543627656
- 2017-07-11 14:29:49.148433 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/782717767
- 2017-07-11 14:29:49.679875 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/954116602
- 2017-07-11 14:29:50.234512 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/267840273
- 2017-07-11 14:29:50.613931 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/483560764
- 2017-07-11 14:29:51.099449 I | api: 2e2687df-fff9-4bab-8f3a-a01a18a1dafa GET /metrics GetMetrics 200 OK 3.806195731s
- 2017-07-11 14:29:52.221099 I | api: cb36b19b-7d9f-49d3-aa17-3f216b2f1745 GET /metrics GetMetrics (start)
- 2017-07-11 14:29:52.221982 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/857028971
- 2017-07-11 14:29:52.752802 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/213296590
- 2017-07-11 14:29:53.408064 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/552351957
- 2017-07-11 14:29:54.081787 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/480911408
- 2017-07-11 14:29:54.587616 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/034645455
- 2017-07-11 14:29:55.070984 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/088038626
- 2017-07-11 14:29:55.615146 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/518674649
- 2017-07-11 14:29:56.239760 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/586527332
- 2017-07-11 14:29:57.042944 I | api: cb36b19b-7d9f-49d3-aa17-3f216b2f1745 GET /metrics GetMetrics 200 OK 4.821842596s
- 2017-07-11 14:29:57.145595 I | api: f583c40e-b16c-49df-afa1-e161f16e0f95 GET /metrics GetMetrics (start)
- 2017-07-11 14:29:57.146506 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/405147763
- 2017-07-11 14:29:57.597325 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/843663670
- 2017-07-11 14:29:58.090311 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/266242845
- 2017-07-11 14:29:58.531207 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/023042520
- 2017-07-11 14:29:59.030347 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/806553943
- 2017-07-11 14:29:59.504657 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/583058634
- 2017-07-11 14:29:59.967842 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/775656353
- 2017-07-11 14:30:00.424952 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/084500108
- 2017-07-11 14:30:00.829132 I | api: f583c40e-b16c-49df-afa1-e161f16e0f95 GET /metrics GetMetrics 200 OK 3.683558467s
- 2017-07-11 14:30:02.073134 I | api: 3a3fd70a-1061-456e-bb3c-a1e564d4fbb8 GET /metrics GetMetrics (start)
- 2017-07-11 14:30:02.074092 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/967163515
- 2017-07-11 14:30:02.506781 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/991552414
- 2017-07-11 14:30:02.966513 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/353245285
- 2017-07-11 14:30:03.519034 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/512663680
- 2017-07-11 14:30:03.977721 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/617651679
- 2017-07-11 14:30:04.470456 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/763313586
- 2017-07-11 14:30:04.970415 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/529302889
- 2017-07-11 14:30:05.526470 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/673853876
- 2017-07-11 14:30:06.074590 I | api: 3a3fd70a-1061-456e-bb3c-a1e564d4fbb8 GET /metrics GetMetrics 200 OK 4.001458817s
- 2017-07-11 14:30:07.001491 I | api: fab27188-8236-4a67-9382-9e69ff5f80bd GET /metrics GetMetrics (start)
- 2017-07-11 14:30:07.002293 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/956168067
- 2017-07-11 14:30:07.473222 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/109585158
- 2017-07-11 14:30:07.996993 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/361996973
- 2017-07-11 14:30:08.452656 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/178529320
- 2017-07-11 14:30:08.954274 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/038034279
- 2017-07-11 14:30:09.438138 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/412748186
- 2017-07-11 14:30:09.981371 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/338137649
- 2017-07-11 14:30:10.414317 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/299834332
- 2017-07-11 14:30:10.853647 I | api: fab27188-8236-4a67-9382-9e69ff5f80bd GET /metrics GetMetrics 200 OK 3.852155596s
- 2017-07-11 14:30:11.928017 I | api: e78614c5-f016-4f04-a26c-1cb20cd59a91 GET /metrics GetMetrics (start)
- 2017-07-11 14:30:11.928197 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/800147339
- 2017-07-11 14:30:12.384661 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/199830894
- 2017-07-11 14:30:12.892359 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/625001461
- 2017-07-11 14:30:13.405384 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/966372048
- 2017-07-11 14:30:13.913043 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/503938031
- 2017-07-11 14:30:14.386213 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/301644418
- 2017-07-11 14:30:15.006940 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/126971385
- 2017-07-11 14:30:15.440178 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/142320388
- 2017-07-11 14:30:16.009136 I | api: e78614c5-f016-4f04-a26c-1cb20cd59a91 GET /metrics GetMetrics 200 OK 4.081123293s
- 2017-07-11 14:30:16.854127 I | api: 4f5d7d48-b4f9-46d7-a624-80cc668ebf63 GET /metrics GetMetrics (start)
- 2017-07-11 14:30:16.855047 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/555128979
- 2017-07-11 14:30:17.318369 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/518645462
- 2017-07-11 14:30:17.760349 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/543643709
- 2017-07-11 14:30:18.198464 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/107567736
- 2017-07-11 14:30:18.656990 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/351101815
- 2017-07-11 14:30:19.158498 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/562550378
- 2017-07-11 14:30:19.796677 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/670906561
- 2017-07-11 14:30:20.264308 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/224287020
- 2017-07-11 14:30:20.811371 I | api: 4f5d7d48-b4f9-46d7-a624-80cc668ebf63 GET /metrics GetMetrics 200 OK 3.957244684s
- 2017-07-11 14:30:21.775767 I | api: 04a52aa3-ce6e-4aaa-a39a-1fea8dc0bda0 GET /metrics GetMetrics (start)
- 2017-07-11 14:30:21.776892 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/966634651
- 2017-07-11 14:30:22.310727 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/526532414
- 2017-07-11 14:30:22.814807 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/648863109
- 2017-07-11 14:30:23.261478 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/044421920
- 2017-07-11 14:30:23.727655 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/461858815
- 2017-07-11 14:30:24.234870 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/721295186
- 2017-07-11 14:30:24.735903 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/020424329
- 2017-07-11 14:30:25.218975 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/902052948
- 2017-07-11 14:30:25.724700 I | api: 04a52aa3-ce6e-4aaa-a39a-1fea8dc0bda0 GET /metrics GetMetrics 200 OK 3.948937236s
- 2017-07-11 14:30:26.698681 I | api: 028f5d06-84d0-47ae-9a74-e49fcdc8acbe GET /metrics GetMetrics (start)
- 2017-07-11 14:30:26.699561 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/029764003
- 2017-07-11 14:30:27.181162 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/867272358
- 2017-07-11 14:30:27.632403 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/192843725
- 2017-07-11 14:30:28.099070 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/452993224
- 2017-07-11 14:30:28.551890 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/065565575
- 2017-07-11 14:30:29.035223 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/642174266
- 2017-07-11 14:30:29.506042 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/227292497
- 2017-07-11 14:30:29.967629 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/812803708
- 2017-07-11 14:30:30.452934 I | api: 028f5d06-84d0-47ae-9a74-e49fcdc8acbe GET /metrics GetMetrics 200 OK 3.754253559s
- 2017-07-11 14:30:31.628672 I | api: d265ae00-fe50-42a4-a9b4-00215a1c6d32 GET /metrics GetMetrics (start)
- 2017-07-11 14:30:31.629633 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/062354347
- 2017-07-11 14:30:32.278645 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/412203790
- 2017-07-11 14:30:32.739530 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/501917973
- 2017-07-11 14:30:33.190085 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/198028656
- 2017-07-11 14:30:33.698725 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/102433807
- 2017-07-11 14:30:34.198444 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/243318818
- 2017-07-11 14:30:34.639918 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/191425305
- 2017-07-11 14:30:35.091116 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/689455524
- 2017-07-11 14:30:35.543341 I | api: d265ae00-fe50-42a4-a9b4-00215a1c6d32 GET /metrics GetMetrics 200 OK 3.914673771s
- 2017-07-11 14:30:36.554811 I | api: 38cd5a40-11ec-443e-946a-cccefe030452 GET /metrics GetMetrics (start)
- 2017-07-11 14:30:36.555732 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/917033651
- 2017-07-11 14:30:37.020315 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/038805110
- 2017-07-11 14:30:37.479503 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/284996957
- 2017-07-11 14:30:37.960455 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/514978072
- 2017-07-11 14:30:38.398883 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/855797655
- 2017-07-11 14:30:38.938770 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/356431882
- 2017-07-11 14:30:39.451785 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/563923937
- 2017-07-11 14:30:40.000047 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/402598348
- 2017-07-11 14:30:40.473664 I | api: 38cd5a40-11ec-443e-946a-cccefe030452 GET /metrics GetMetrics 200 OK 3.918860273s
- 2017-07-11 14:30:41.481362 I | api: 604faff6-1141-432d-a7f4-2045b6b7dd6a GET /metrics GetMetrics (start)
- 2017-07-11 14:30:41.484879 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/706349243
- 2017-07-11 14:30:41.972485 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/949264606
- 2017-07-11 14:30:42.491221 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/998181541
- 2017-07-11 14:30:42.931189 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/469414848
- 2017-07-11 14:30:43.381249 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/262881823
- 2017-07-11 14:30:43.980745 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/486250738
- 2017-07-11 14:30:44.439522 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/195578281
- 2017-07-11 14:30:44.954157 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/524485364
- 2017-07-11 14:30:45.389510 I | api: 604faff6-1141-432d-a7f4-2045b6b7dd6a GET /metrics GetMetrics 200 OK 3.908339985s
- 2017-07-11 14:30:46.407526 I | api: cd6f2222-574a-44e4-a004-c28276e55df7 GET /metrics GetMetrics (start)
- 2017-07-11 14:30:46.408425 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/026528195
- 2017-07-11 14:30:46.879372 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/133417030
- 2017-07-11 14:30:47.301836 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/625292525
- 2017-07-11 14:30:47.769570 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/118372200
- 2017-07-11 14:30:48.268424 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/083939751
- 2017-07-11 14:30:48.714586 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/289866458
- 2017-07-11 14:30:49.198719 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/691876465
- 2017-07-11 14:30:49.845314 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/285526812
- 2017-07-11 14:30:50.329086 I | api: cd6f2222-574a-44e4-a004-c28276e55df7 GET /metrics GetMetrics 200 OK 3.921559614s
- 2017-07-11 14:30:51.334040 I | api: 5e457dc0-66d9-4718-b80b-f1f701adcee7 GET /metrics GetMetrics (start)
- 2017-07-11 14:30:51.335346 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/629542347
- 2017-07-11 14:30:51.811733 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/781733550
- 2017-07-11 14:30:52.282589 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/169287221
- 2017-07-11 14:30:52.991307 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/654118416
- 2017-07-11 14:30:53.444697 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/159958063
- 2017-07-11 14:30:53.940026 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/430606274
- 2017-07-11 14:30:54.414996 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/103410233
- 2017-07-11 14:30:54.878446 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/527666756
- 2017-07-11 14:30:55.390150 I | api: 5e457dc0-66d9-4718-b80b-f1f701adcee7 GET /metrics GetMetrics 200 OK 4.056114361s
- 2017-07-11 14:30:56.259929 I | api: 970bbce6-f194-49b4-a0bb-6f4a49124593 GET /metrics GetMetrics (start)
- 2017-07-11 14:30:56.260817 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/298837715
- 2017-07-11 14:30:56.724687 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/432612886
- 2017-07-11 14:30:57.208692 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/969660541
- 2017-07-11 14:30:57.959834 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/659913144
- 2017-07-11 14:30:58.419354 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/593502135
- 2017-07-11 14:30:58.905149 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/216544170
- 2017-07-11 14:30:59.347114 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/787559169
- 2017-07-11 14:30:59.806982 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/230133356
- 2017-07-11 14:31:00.350877 I | api: 970bbce6-f194-49b4-a0bb-6f4a49124593 GET /metrics GetMetrics 200 OK 4.09094788s
- 2017-07-11 14:31:01.187353 I | api: 8123c08d-a50c-495e-b7a0-7a666e12cdb7 GET /metrics GetMetrics (start)
- 2017-07-11 14:31:01.188382 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/943172315
- 2017-07-11 14:31:01.952728 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/479791230
- 2017-07-11 14:31:02.498694 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/320667077
- 2017-07-11 14:31:03.053387 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/528071776
- 2017-07-11 14:31:03.580565 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/068454975
- 2017-07-11 14:31:04.078416 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/548803218
- 2017-07-11 14:31:04.587507 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/096159433
- 2017-07-11 14:31:05.077528 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/082399124
- 2017-07-11 14:31:05.660332 I | api: 8123c08d-a50c-495e-b7a0-7a666e12cdb7 GET /metrics GetMetrics 200 OK 4.472983227s
- 2017-07-11 14:31:06.113467 I | api: 6b2aecb9-6297-4368-a405-63a69b286258 GET /metrics GetMetrics (start)
- 2017-07-11 14:31:06.114398 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/304183779
- 2017-07-11 14:31:06.573190 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/709020646
- 2017-07-11 14:31:07.136157 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/440691213
- 2017-07-11 14:31:07.583009 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/630272520
- 2017-07-11 14:31:08.060962 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/157668295
- 2017-07-11 14:31:08.558652 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/064551546
- 2017-07-11 14:31:09.224446 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/313666449
- 2017-07-11 14:31:09.684357 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/054024124
- 2017-07-11 14:31:10.253324 I | api: 6b2aecb9-6297-4368-a405-63a69b286258 GET /metrics GetMetrics 200 OK 4.139856772s
- 2017-07-11 14:31:11.039383 I | api: b20c2d39-3896-4916-9ac2-9d618642b00f GET /metrics GetMetrics (start)
- 2017-07-11 14:31:11.040278 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/997163499
- 2017-07-11 14:31:11.471964 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/964670030
- 2017-07-11 14:31:12.078663 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/922307413
- 2017-07-11 14:31:12.535923 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/599844528
- 2017-07-11 14:31:12.997722 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/884605007
- 2017-07-11 14:31:13.471704 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/064626530
- 2017-07-11 14:31:14.162569 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/111890777
- 2017-07-11 14:31:14.622952 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/882167012
- 2017-07-11 14:31:15.098007 I | api: b20c2d39-3896-4916-9ac2-9d618642b00f GET /metrics GetMetrics 200 OK 4.058627932s
- 2017-07-11 14:31:15.964998 I | api: 4b778ab3-7cb3-445b-868d-78582c172b32 GET /metrics GetMetrics (start)
- 2017-07-11 14:31:15.965985 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/870593267
- 2017-07-11 14:31:16.426965 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/305986998
- 2017-07-11 14:31:16.907588 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/238521245
- 2017-07-11 14:31:17.329479 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/481396824
- 2017-07-11 14:31:17.763121 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/567861207
- 2017-07-11 14:31:18.189072 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/340885322
- 2017-07-11 14:31:18.592649 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/730064417
- 2017-07-11 14:31:19.053783 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/030815500
- 2017-07-11 14:31:19.467597 I | api: 4b778ab3-7cb3-445b-868d-78582c172b32 GET /metrics GetMetrics 200 OK 3.502600056s
- 2017-07-11 14:31:20.893254 I | api: 72826db6-6c81-4231-b952-aac65c0fd42e GET /metrics GetMetrics (start)
- 2017-07-11 14:31:20.894173 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/058626811
- 2017-07-11 14:31:21.322633 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/063086110
- 2017-07-11 14:31:21.766634 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/139765989
- 2017-07-11 14:31:22.202447 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/337722624
- 2017-07-11 14:31:22.684349 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/804581471
- 2017-07-11 14:31:23.121441 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/083150898
- 2017-07-11 14:31:23.599313 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/441284073
- 2017-07-11 14:31:24.062481 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/452586548
- 2017-07-11 14:31:24.463830 I | api: 72826db6-6c81-4231-b952-aac65c0fd42e GET /metrics GetMetrics 200 OK 3.570577051s
- 2017-07-11 14:31:25.815728 I | api: 7dda7e00-3f9d-4826-bdf4-61c86b41f172 GET /metrics GetMetrics (start)
- 2017-07-11 14:31:25.816629 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/287562755
- 2017-07-11 14:31:26.273142 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/152401798
- 2017-07-11 14:31:26.675587 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/876883757
- 2017-07-11 14:31:27.106945 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/853586600
- 2017-07-11 14:31:27.531106 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/787080679
- 2017-07-11 14:31:27.952476 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/506015258
- 2017-07-11 14:31:28.379698 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/909710001
- 2017-07-11 14:31:28.794829 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/757474908
- 2017-07-11 14:31:29.244335 I | api: 7dda7e00-3f9d-4826-bdf4-61c86b41f172 GET /metrics GetMetrics 200 OK 3.428557386s
- 2017-07-11 14:31:30.741654 I | api: 5d5bb3e8-161b-4f58-9216-489c49692c56 GET /metrics GetMetrics (start)
- 2017-07-11 14:31:30.742566 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/875262475
- 2017-07-11 14:31:31.213088 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/637161966
- 2017-07-11 14:31:31.643529 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/250091125
- 2017-07-11 14:31:32.127291 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/037049168
- 2017-07-11 14:31:32.534652 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/887901295
- 2017-07-11 14:31:32.953742 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/145172738
- 2017-07-11 14:31:33.382328 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/258651257
- 2017-07-11 14:31:33.873767 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/723778948
- 2017-07-11 14:31:34.370503 I | api: 5d5bb3e8-161b-4f58-9216-489c49692c56 GET /metrics GetMetrics 200 OK 3.628853505s
- 2017-07-11 14:31:35.667002 I | api: 953827e1-9f1e-45bc-9069-eeba899641e3 GET /metrics GetMetrics (start)
- 2017-07-11 14:31:35.668025 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/459395859
- 2017-07-11 14:31:36.157448 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/137260886
- 2017-07-11 14:31:36.604463 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/778896573
- 2017-07-11 14:31:37.142850 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/327739128
- 2017-07-11 14:31:37.573935 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/628404215
- 2017-07-11 14:31:38.038540 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/873610474
- 2017-07-11 14:31:38.519115 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/079733569
- 2017-07-11 14:31:38.970157 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/791465388
- 2017-07-11 14:31:39.425277 I | api: 953827e1-9f1e-45bc-9069-eeba899641e3 GET /metrics GetMetrics 200 OK 3.758273782s
- 2017-07-11 14:31:40.667193 I | api: 631706b3-bfa4-41ec-96a8-d94b81bd3908 GET /metrics GetMetrics (start)
- 2017-07-11 14:31:40.668001 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/648828187
- 2017-07-11 14:31:41.036082 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/958989246
- 2017-07-11 14:31:41.456642 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/172838917
- 2017-07-11 14:31:42.104361 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/457368992
- 2017-07-11 14:31:42.536199 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/210762367
- 2017-07-11 14:31:42.970389 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/767198162
- 2017-07-11 14:31:43.413598 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/742888201
- 2017-07-11 14:31:43.826821 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/552416980
- 2017-07-11 14:31:44.253118 I | api: 631706b3-bfa4-41ec-96a8-d94b81bd3908 GET /metrics GetMetrics 200 OK 3.585928343s
- 2017-07-11 14:31:45.664131 I | api: 4e95295b-48a0-419e-af5c-c4c68a71a8b9 GET /metrics GetMetrics (start)
- 2017-07-11 14:31:45.665078 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/878671395
- 2017-07-11 14:31:46.046862 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/009392422
- 2017-07-11 14:31:46.470827 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/628210253
- 2017-07-11 14:31:46.885861 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/767525704
- 2017-07-11 14:31:47.302769 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/318389767
- 2017-07-11 14:31:47.712469 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/510265786
- 2017-07-11 14:31:48.137685 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/122259921
- 2017-07-11 14:31:48.596165 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/402988284
- 2017-07-11 14:31:49.040087 I | api: 4e95295b-48a0-419e-af5c-c4c68a71a8b9 GET /metrics GetMetrics 200 OK 3.375954785s
- 2017-07-11 14:31:50.518199 I | api: c90ba657-7643-434f-8559-bcfec80bfcc5 GET /metrics GetMetrics (start)
- 2017-07-11 14:31:50.519105 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/598541867
- 2017-07-11 14:31:50.854098 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/905322382
- 2017-07-11 14:31:51.285775 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/360828821
- 2017-07-11 14:31:51.706089 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/754540528
- 2017-07-11 14:31:52.158410 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/069707919
- 2017-07-11 14:31:52.609917 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/585809570
- 2017-07-11 14:31:53.128052 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/673263001
- 2017-07-11 14:31:53.591513 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/063902244
- 2017-07-11 14:31:54.421210 I | api: c90ba657-7643-434f-8559-bcfec80bfcc5 GET /metrics GetMetrics 200 OK 3.903016392s
- 2017-07-11 14:31:55.443747 I | api: 2c8e80a6-9df8-486c-aaab-9daada2fde1c GET /metrics GetMetrics (start)
- 2017-07-11 14:31:55.444685 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/779580723
- 2017-07-11 14:31:55.922306 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/277183222
- 2017-07-11 14:31:56.365599 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/144665565
- 2017-07-11 14:31:56.754630 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/661568920
- 2017-07-11 14:31:57.717571 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/765511191
- 2017-07-11 14:31:58.133444 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/020129930
- 2017-07-11 14:31:58.553646 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/285294689
- 2017-07-11 14:31:59.166111 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/802062412
- 2017-07-11 14:31:59.610561 I | api: 2c8e80a6-9df8-486c-aaab-9daada2fde1c GET /metrics GetMetrics 200 OK 4.166814002s
- 2017-07-11 14:32:00.365796 I | api: 71ecc96d-b86c-47f6-89e2-d40743c232a9 GET /metrics GetMetrics (start)
- 2017-07-11 14:32:00.367038 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/229517115
- 2017-07-11 14:32:00.741212 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/857304926
- 2017-07-11 14:32:01.165448 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/151291685
- 2017-07-11 14:32:01.626217 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/527945792
- 2017-07-11 14:32:02.047797 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/904767647
- 2017-07-11 14:32:02.473296 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/782555506
- 2017-07-11 14:32:03.002643 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/075531305
- 2017-07-11 14:32:03.424194 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/224738676
- 2017-07-11 14:32:03.913842 I | api: 71ecc96d-b86c-47f6-89e2-d40743c232a9 GET /metrics GetMetrics 200 OK 3.54805105s
- 2017-07-11 14:32:05.290240 I | api: e384ae01-8131-4744-890d-540116568e4f GET /metrics GetMetrics (start)
- 2017-07-11 14:32:05.291130 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/931526723
- 2017-07-11 14:32:05.798922 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/288174278
- 2017-07-11 14:32:06.318867 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/140474221
- 2017-07-11 14:32:06.708364 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/760587240
- 2017-07-11 14:32:07.161162 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/238659111
- 2017-07-11 14:32:07.609652 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/034566490
- 2017-07-11 14:32:08.151456 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/418774257
- 2017-07-11 14:32:08.715261 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/300832156
- 2017-07-11 14:32:09.236815 I | api: e384ae01-8131-4744-890d-540116568e4f GET /metrics GetMetrics 200 OK 3.946575173s
- 2017-07-11 14:32:10.217178 I | api: 842b2aee-6cf7-46c0-8c64-64daf933d802 GET /metrics GetMetrics (start)
- 2017-07-11 14:32:10.218076 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/011264075
- 2017-07-11 14:32:10.617531 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/190130478
- 2017-07-11 14:32:11.067590 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/656625333
- 2017-07-11 14:32:11.465891 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/572733072
- 2017-07-11 14:32:11.899062 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/618220207
- 2017-07-11 14:32:12.500686 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/573611586
- 2017-07-11 14:32:12.951808 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/342888121
- 2017-07-11 14:32:13.396718 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/544448196
- 2017-07-11 14:32:13.801407 I | api: 842b2aee-6cf7-46c0-8c64-64daf933d802 GET /metrics GetMetrics 200 OK 3.584231216s
- 2017-07-11 14:32:15.140903 I | api: 2902c682-8c5d-4c4d-9ff0-32c314eed513 GET /metrics GetMetrics (start)
- 2017-07-11 14:32:15.141714 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/792461139
- 2017-07-11 14:32:15.671227 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/243885206
- 2017-07-11 14:32:16.025895 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/526072573
- 2017-07-11 14:32:16.635709 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/944735800
- 2017-07-11 14:32:17.057820 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/815445559
- 2017-07-11 14:32:17.464335 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/816912938
- 2017-07-11 14:32:17.893082 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/095517569
- 2017-07-11 14:32:18.304655 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/130581228
- 2017-07-11 14:32:18.966275 I | api: 2902c682-8c5d-4c4d-9ff0-32c314eed513 GET /metrics GetMetrics 200 OK 3.825371485s
- 2017-07-11 14:32:20.066192 I | api: 9ec5d02a-e229-466a-9a1e-5718e214fd36 GET /metrics GetMetrics (start)
- 2017-07-11 14:32:20.067088 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/531026779
- 2017-07-11 14:32:20.529343 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/467736318
- 2017-07-11 14:32:21.063480 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/705477189
- 2017-07-11 14:32:21.476849 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/927026912
- 2017-07-11 14:32:21.890577 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/202767039
- 2017-07-11 14:32:22.427909 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/404474130
- 2017-07-11 14:32:22.882669 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/716657993
- 2017-07-11 14:32:23.316357 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/352976916
- 2017-07-11 14:32:23.745236 I | api: 9ec5d02a-e229-466a-9a1e-5718e214fd36 GET /metrics GetMetrics 200 OK 3.679125169s
- 2017-07-11 14:32:24.990819 I | api: 305c83c6-fe76-42fd-90e8-40bb338bc530 GET /metrics GetMetrics (start)
- 2017-07-11 14:32:24.991686 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/482352739
- 2017-07-11 14:32:25.412158 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/279409766
- 2017-07-11 14:32:25.865132 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/726040717
- 2017-07-11 14:32:26.333538 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/335587464
- 2017-07-11 14:32:26.737861 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/175802951
- 2017-07-11 14:32:27.168579 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/457174266
- 2017-07-11 14:32:27.589484 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/207014417
- 2017-07-11 14:32:28.009999 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/129204284
- 2017-07-11 14:32:28.443209 I | api: 305c83c6-fe76-42fd-90e8-40bb338bc530 GET /metrics GetMetrics 200 OK 3.452391574s
- 2017-07-11 14:32:29.912258 I | api: 3df8772f-d87c-4eb8-8a1d-03e688d9d0ad GET /metrics GetMetrics (start)
- 2017-07-11 14:32:29.913276 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/877316715
- 2017-07-11 14:32:30.332520 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/342529742
- 2017-07-11 14:32:30.736013 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/848597973
- 2017-07-11 14:32:31.219023 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/099007280
- 2017-07-11 14:32:31.615356 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/125065935
- 2017-07-11 14:32:32.083720 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/619490274
- 2017-07-11 14:32:32.524999 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/047508441
- 2017-07-11 14:32:32.948606 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/437839716
- 2017-07-11 14:32:33.371687 I | api: 3df8772f-d87c-4eb8-8a1d-03e688d9d0ad GET /metrics GetMetrics 200 OK 3.459431545s
- 2017-07-11 14:32:34.838958 I | api: 079b4d75-ca4b-445e-88ef-c7c93bc3fe8d GET /metrics GetMetrics (start)
- 2017-07-11 14:32:34.839980 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/346590067
- 2017-07-11 14:32:35.269452 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/248044086
- 2017-07-11 14:32:35.717285 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/389988893
- 2017-07-11 14:32:36.184897 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/458440920
- 2017-07-11 14:32:36.606097 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/755321431
- 2017-07-11 14:32:37.083229 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/361683914
- 2017-07-11 14:32:37.558889 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/609540769
- 2017-07-11 14:32:38.002419 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/033057164
- 2017-07-11 14:32:38.432435 I | api: 079b4d75-ca4b-445e-88ef-c7c93bc3fe8d GET /metrics GetMetrics 200 OK 3.593475956s
- 2017-07-11 14:32:39.763496 I | api: e580c06d-4138-4347-b931-eea508fef544 GET /metrics GetMetrics (start)
- 2017-07-11 14:32:39.763866 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/203315579
- 2017-07-11 14:32:40.243459 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/929950878
- 2017-07-11 14:32:40.702517 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/479793509
- 2017-07-11 14:32:41.095542 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/819152256
- 2017-07-11 14:32:41.516516 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/299199199
- 2017-07-11 14:32:41.952474 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/001845938
- 2017-07-11 14:32:42.632158 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/096270953
- 2017-07-11 14:32:43.056530 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/566166708
- 2017-07-11 14:32:43.474001 I | api: e580c06d-4138-4347-b931-eea508fef544 GET /metrics GetMetrics 200 OK 3.710510318s
- 2017-07-11 14:32:44.686976 I | api: defbdef1-5b7b-40a7-9e1b-99eba3315d86 GET /metrics GetMetrics (start)
- 2017-07-11 14:32:44.687949 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/224416899
- 2017-07-11 14:32:45.120424 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/736111110
- 2017-07-11 14:32:45.645467 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/333640109
- 2017-07-11 14:32:45.992735 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/994563368
- 2017-07-11 14:32:46.550339 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/308651623
- 2017-07-11 14:32:46.981037 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/332699290
- 2017-07-11 14:32:47.371917 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/014914353
- 2017-07-11 14:32:47.818214 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/164428508
- 2017-07-11 14:32:48.237692 I | api: defbdef1-5b7b-40a7-9e1b-99eba3315d86 GET /metrics GetMetrics 200 OK 3.550714991s
- 2017-07-11 14:32:49.615102 I | api: cddbaa43-e7c8-4df8-9441-16fc3d615bf8 GET /metrics GetMetrics (start)
- 2017-07-11 14:32:49.615909 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/880212619
- 2017-07-11 14:32:50.112526 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/233362542
- 2017-07-11 14:32:50.516711 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/956876533
- 2017-07-11 14:32:50.850837 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/087448016
- 2017-07-11 14:32:51.290247 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/355109103
- 2017-07-11 14:32:51.707781 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/917932418
- 2017-07-11 14:32:52.134304 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/949860089
- 2017-07-11 14:32:52.637154 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/057076740
- 2017-07-11 14:32:53.084417 I | api: cddbaa43-e7c8-4df8-9441-16fc3d615bf8 GET /metrics GetMetrics 200 OK 3.469319466s
- 2017-07-11 14:32:54.539899 I | api: 12261c7b-72d3-453b-a7d9-4ae5b5a046d2 GET /metrics GetMetrics (start)
- 2017-07-11 14:32:54.540830 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/832465811
- 2017-07-11 14:32:54.966367 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/847588822
- 2017-07-11 14:32:55.538816 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/839651133
- 2017-07-11 14:32:55.860236 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/303236984
- 2017-07-11 14:32:56.432373 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/998070903
- 2017-07-11 14:32:56.851169 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/993291626
- 2017-07-11 14:32:57.280658 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/046675393
- 2017-07-11 14:32:57.849314 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/543520812
- 2017-07-11 14:32:58.300585 I | api: 12261c7b-72d3-453b-a7d9-4ae5b5a046d2 GET /metrics GetMetrics 200 OK 3.760688407s
- 2017-07-11 14:32:59.462296 I | api: 6bea459e-4a88-428e-902f-5b09fbf71e6d GET /metrics GetMetrics (start)
- 2017-07-11 14:32:59.463245 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/405901723
- 2017-07-11 14:32:59.871084 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/698482238
- 2017-07-11 14:33:00.354721 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/017585797
- 2017-07-11 14:33:00.761312 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/810533408
- 2017-07-11 14:33:01.130155 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/202000639
- 2017-07-11 14:33:01.556447 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/152301650
- 2017-07-11 14:33:02.036410 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/142225289
- 2017-07-11 14:33:02.464409 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/008756564
- 2017-07-11 14:33:03.027114 I | api: 6bea459e-4a88-428e-902f-5b09fbf71e6d GET /metrics GetMetrics 200 OK 3.564812434s
- 2017-07-11 14:33:04.388493 I | api: 2640b84a-af8a-4df6-b85f-6167f338fc29 GET /metrics GetMetrics (start)
- 2017-07-11 14:33:04.388828 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/623128227
- 2017-07-11 14:33:04.794129 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/398803878
- 2017-07-11 14:33:05.325940 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/778564301
- 2017-07-11 14:33:05.822382 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/468968904
- 2017-07-11 14:33:06.309531 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/546820743
- 2017-07-11 14:33:06.761397 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/046810682
- 2017-07-11 14:33:07.262618 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/310711377
- 2017-07-11 14:33:07.687967 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/165856636
- 2017-07-11 14:33:08.133253 I | api: 2640b84a-af8a-4df6-b85f-6167f338fc29 GET /metrics GetMetrics 200 OK 3.744759437s
- 2017-07-11 14:33:09.314656 I | api: 996e8a6a-1f0a-4a7a-97d8-0b4e609780f2 GET /metrics GetMetrics (start)
- 2017-07-11 14:33:09.315400 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/623089835
- 2017-07-11 14:33:09.743429 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/753370126
- 2017-07-11 14:33:10.198788 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/195505173
- 2017-07-11 14:33:10.610118 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/553942640
- 2017-07-11 14:33:10.933847 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/886711567
- 2017-07-11 14:33:11.344723 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/167130914
- 2017-07-11 14:33:11.937178 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/185368089
- 2017-07-11 14:33:12.379024 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/050703524
- 2017-07-11 14:33:12.804373 I | api: 996e8a6a-1f0a-4a7a-97d8-0b4e609780f2 GET /metrics GetMetrics 200 OK 3.489721526s
- 2017-07-11 14:33:14.237827 I | api: 3020a649-d78a-413f-ae8c-aa22640a64df GET /metrics GetMetrics (start)
- 2017-07-11 14:33:14.238600 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/937891763
- 2017-07-11 14:33:14.659301 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/998027126
- 2017-07-11 14:33:15.089094 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/139824733
- 2017-07-11 14:33:15.683548 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/168832024
- 2017-07-11 14:33:16.034421 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/507542167
- 2017-07-11 14:33:16.482338 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/701774602
- 2017-07-11 14:33:16.897767 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/156470497
- 2017-07-11 14:33:17.625719 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/999161548
- 2017-07-11 14:33:18.096254 I | api: 3020a649-d78a-413f-ae8c-aa22640a64df GET /metrics GetMetrics 200 OK 3.858429729s
- 2017-07-11 14:33:19.159152 I | api: c59ccb94-4f0d-4f9a-a36b-93d814d34c5a GET /metrics GetMetrics (start)
- 2017-07-11 14:33:19.159960 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/627994043
- 2017-07-11 14:33:19.608295 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/657828318
- 2017-07-11 14:33:20.058003 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/056113573
- 2017-07-11 14:33:20.470472 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/179249856
- 2017-07-11 14:33:20.810061 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/092344095
- 2017-07-11 14:33:21.390073 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/527112690
- 2017-07-11 14:33:21.840635 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/165130409
- 2017-07-11 14:33:22.259417 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/980870132
- 2017-07-11 14:33:22.844284 I | api: c59ccb94-4f0d-4f9a-a36b-93d814d34c5a GET /metrics GetMetrics 200 OK 3.685137307s
- 2017-07-11 14:33:24.083251 I | api: 41f4dcb4-3665-40e8-8b36-4e4280351727 GET /metrics GetMetrics (start)
- 2017-07-11 14:33:24.084113 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/505971907
- 2017-07-11 14:33:24.498667 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/765330758
- 2017-07-11 14:33:24.930197 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/332601325
- 2017-07-11 14:33:25.414830 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/489478760
- 2017-07-11 14:33:25.937143 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/940776615
- 2017-07-11 14:33:26.366852 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/341400026
- 2017-07-11 14:33:26.789653 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/977782641
- 2017-07-11 14:33:27.224201 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/375868444
- 2017-07-11 14:33:27.651314 I | api: 41f4dcb4-3665-40e8-8b36-4e4280351727 GET /metrics GetMetrics 200 OK 3.568060577s
- 2017-07-11 14:33:29.009894 I | api: 171d79f9-5efe-4104-9801-4e3df63ebcab GET /metrics GetMetrics (start)
- 2017-07-11 14:33:29.010715 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/513613515
- 2017-07-11 14:33:29.443609 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/928290734
- 2017-07-11 14:33:29.866796 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/792573237
- 2017-07-11 14:33:30.292443 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/481213712
- 2017-07-11 14:33:30.698042 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/881536815
- 2017-07-11 14:33:31.024594 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/158919362
- 2017-07-11 14:33:31.454735 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/272211769
- 2017-07-11 14:33:31.883360 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/812874052
- 2017-07-11 14:33:32.292620 I | api: 171d79f9-5efe-4104-9801-4e3df63ebcab GET /metrics GetMetrics 200 OK 3.282730398s
- 2017-07-11 14:33:33.934618 I | api: 9e9a2e1e-24bc-4b53-99cc-1598584f0627 GET /metrics GetMetrics (start)
- 2017-07-11 14:33:33.935535 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/187583955
- 2017-07-11 14:33:34.423783 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/412183830
- 2017-07-11 14:33:34.836186 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/011771261
- 2017-07-11 14:33:35.321472 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/974351032
- 2017-07-11 14:33:35.832133 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/683401399
- 2017-07-11 14:33:36.362071 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/128361130
- 2017-07-11 14:33:36.843702 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/628778497
- 2017-07-11 14:33:37.293016 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/105098604
- 2017-07-11 14:33:37.740219 I | api: 9e9a2e1e-24bc-4b53-99cc-1598584f0627 GET /metrics GetMetrics 200 OK 3.805599622s
- 2017-07-11 14:33:38.856098 I | api: 71589914-c150-4149-8e4a-459d9bad1216 GET /metrics GetMetrics (start)
- 2017-07-11 14:33:38.857047 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/163328475
- 2017-07-11 14:33:39.455318 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/712385918
- 2017-07-11 14:33:39.897739 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/756746949
- 2017-07-11 14:33:40.415422 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/350085472
- 2017-07-11 14:33:40.742453 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/259867455
- 2017-07-11 14:33:41.159667 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/891191186
- 2017-07-11 14:33:41.682308 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/333186505
- 2017-07-11 14:33:42.117936 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/413142676
- 2017-07-11 14:33:42.539952 I | api: 71589914-c150-4149-8e4a-459d9bad1216 GET /metrics GetMetrics 200 OK 3.683861034s
- 2017-07-11 14:33:43.784274 I | api: b9192a03-92be-4baf-9f82-842185c00369 GET /metrics GetMetrics (start)
- 2017-07-11 14:33:43.785247 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/472574691
- 2017-07-11 14:33:44.225328 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/026080486
- 2017-07-11 14:33:44.688654 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/313969933
- 2017-07-11 14:33:45.094578 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/196053768
- 2017-07-11 14:33:45.707105 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/501967047
- 2017-07-11 14:33:46.069520 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/904515962
- 2017-07-11 14:33:46.515340 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/544841361
- 2017-07-11 14:33:46.977822 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/929937084
- 2017-07-11 14:33:47.403852 I | api: b9192a03-92be-4baf-9f82-842185c00369 GET /metrics GetMetrics 200 OK 3.619576402s
- 2017-07-11 14:33:48.709484 I | api: e251dbb0-78ff-4f4d-99cb-f19ddae31ac5 GET /metrics GetMetrics (start)
- 2017-07-11 14:33:48.709834 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/994172139
- 2017-07-11 14:33:49.155254 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/098728782
- 2017-07-11 14:33:49.603308 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/875117141
- 2017-07-11 14:33:50.028505 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/703720880
- 2017-07-11 14:33:50.444847 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/084549967
- 2017-07-11 14:33:50.821206 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/893870178
- 2017-07-11 14:33:51.237238 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/406292057
- 2017-07-11 14:33:51.672287 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/253155812
- 2017-07-11 14:33:52.107443 I | api: e251dbb0-78ff-4f4d-99cb-f19ddae31ac5 GET /metrics GetMetrics 200 OK 3.397963815s
- 2017-07-11 14:33:53.633009 I | api: 4cde4546-3f72-4352-ae49-1844fbf2d96f GET /metrics GetMetrics (start)
- 2017-07-11 14:33:53.634028 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/403563507
- 2017-07-11 14:33:54.076497 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/085364406
- 2017-07-11 14:33:54.650864 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/633248413
- 2017-07-11 14:33:55.083696 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/048205144
- 2017-07-11 14:33:55.602495 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/476230871
- 2017-07-11 14:33:55.972387 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/860436554
- 2017-07-11 14:33:56.404628 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/568591649
- 2017-07-11 14:33:56.827667 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/164577292
- 2017-07-11 14:33:57.331789 I | api: 4cde4546-3f72-4352-ae49-1844fbf2d96f GET /metrics GetMetrics 200 OK 3.698779107s
- 2017-07-11 14:33:58.558528 I | api: c57dcc1d-b312-4099-967d-37939fd9a632 GET /metrics GetMetrics (start)
- 2017-07-11 14:33:58.559356 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/635331579
- 2017-07-11 14:33:58.974488 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/491483422
- 2017-07-11 14:33:59.401168 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/474770405
- 2017-07-11 14:33:59.862342 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/829757440
- 2017-07-11 14:34:00.301339 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/577510239
- 2017-07-11 14:34:00.717530 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/513155378
- 2017-07-11 14:34:01.229027 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/017478889
- 2017-07-11 14:34:01.647888 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/161688372
- 2017-07-11 14:34:02.128085 I | api: c57dcc1d-b312-4099-967d-37939fd9a632 GET /metrics GetMetrics 200 OK 3.569559981s
- 2017-07-11 14:34:03.480194 I | api: f86697c0-9031-4d3b-b2b2-5410259c6293 GET /metrics GetMetrics (start)
- 2017-07-11 14:34:03.481074 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/484639491
- 2017-07-11 14:34:03.910728 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/128758918
- 2017-07-11 14:34:04.327611 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/497385005
- 2017-07-11 14:34:04.785725 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/842973608
- 2017-07-11 14:34:05.231528 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/562559719
- 2017-07-11 14:34:05.782611 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/665331482
- 2017-07-11 14:34:06.334364 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/955740593
- 2017-07-11 14:34:06.781787 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/446563676
- 2017-07-11 14:34:07.466350 I | api: f86697c0-9031-4d3b-b2b2-5410259c6293 GET /metrics GetMetrics 200 OK 3.986154721s
- 2017-07-11 14:34:08.406626 I | api: 84c72308-4ec5-4bd3-80d1-1e677ca26aae GET /metrics GetMetrics (start)
- 2017-07-11 14:34:08.407569 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/311681291
- 2017-07-11 14:34:08.841710 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/330220270
- 2017-07-11 14:34:09.325649 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/879185781
- 2017-07-11 14:34:09.790838 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/432824400
- 2017-07-11 14:34:10.211045 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/644148591
- 2017-07-11 14:34:10.616344 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/056131074
- 2017-07-11 14:34:11.016048 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/166264185
- 2017-07-11 14:34:11.425745 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/141824132
- 2017-07-11 14:34:11.843997 I | api: 84c72308-4ec5-4bd3-80d1-1e677ca26aae GET /metrics GetMetrics 200 OK 3.437374218s
- 2017-07-11 14:34:13.327532 I | api: ecf51dd1-f0ff-4dec-abd5-55f021fa6296 GET /metrics GetMetrics (start)
- 2017-07-11 14:34:13.328277 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/244764179
- 2017-07-11 14:34:13.723857 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/180256854
- 2017-07-11 14:34:14.140262 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/933477309
- 2017-07-11 14:34:14.618135 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/718026232
- 2017-07-11 14:34:15.199859 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/862365431
- 2017-07-11 14:34:15.777302 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/431543274
- 2017-07-11 14:34:16.222075 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/316172865
- 2017-07-11 14:34:16.696588 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/963870892
- 2017-07-11 14:34:17.196034 I | api: ecf51dd1-f0ff-4dec-abd5-55f021fa6296 GET /metrics GetMetrics 200 OK 3.868504405s
- 2017-07-11 14:34:18.253688 I | api: 19d003d3-79a4-46ad-9ace-8b3a09d1517b GET /metrics GetMetrics (start)
- 2017-07-11 14:34:18.254657 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/176989723
- 2017-07-11 14:34:18.675509 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/349380798
- 2017-07-11 14:34:19.107069 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/169448197
- 2017-07-11 14:34:19.501412 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/271687328
- 2017-07-11 14:34:19.952972 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/206546303
- 2017-07-11 14:34:20.340251 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/165329618
- 2017-07-11 14:34:20.761833 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/561781769
- 2017-07-11 14:34:21.148033 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/533263828
- 2017-07-11 14:34:21.587988 I | api: 19d003d3-79a4-46ad-9ace-8b3a09d1517b GET /metrics GetMetrics 200 OK 3.334303844s
- 2017-07-11 14:34:23.175716 I | api: 37762c60-e234-4a3b-8819-e479ac4260f1 GET /metrics GetMetrics (start)
- 2017-07-11 14:34:23.176061 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/981043491
- 2017-07-11 14:34:23.855435 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/303552550
- 2017-07-11 14:34:24.265447 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/819090253
- 2017-07-11 14:34:24.790367 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/798836808
- 2017-07-11 14:34:25.219140 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/005638407
- 2017-07-11 14:34:25.778148 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/614274746
- 2017-07-11 14:34:26.153002 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/799669457
- 2017-07-11 14:34:26.573513 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/322244604
- 2017-07-11 14:34:27.080028 I | api: 37762c60-e234-4a3b-8819-e479ac4260f1 GET /metrics GetMetrics 200 OK 3.904311199s
- 2017-07-11 14:34:28.101570 I | api: 7c8da0d1-9705-41f8-a00d-9640b6e1bf0d GET /metrics GetMetrics (start)
- 2017-07-11 14:34:28.102540 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/927649067
- 2017-07-11 14:34:28.523674 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/708200078
- 2017-07-11 14:34:28.995594 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/844807829
- 2017-07-11 14:34:29.409560 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/616523504
- 2017-07-11 14:34:29.859982 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/997064591
- 2017-07-11 14:34:30.274449 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/833555874
- 2017-07-11 14:34:30.685233 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/513537689
- 2017-07-11 14:34:31.037458 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/059535140
- 2017-07-11 14:34:31.513612 I | api: 7c8da0d1-9705-41f8-a00d-9640b6e1bf0d GET /metrics GetMetrics 200 OK 3.412053444s
- 2017-07-11 14:34:33.027202 I | api: 5f470899-77de-4a2f-82df-0e2d9aba763d GET /metrics GetMetrics (start)
- 2017-07-11 14:34:33.028109 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/962392115
- 2017-07-11 14:34:33.441222 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/731964406
- 2017-07-11 14:34:33.844453 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/888109789
- 2017-07-11 14:34:34.244002 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/835830424
- 2017-07-11 14:34:34.634318 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/484154135
- 2017-07-11 14:34:35.092282 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/321380746
- 2017-07-11 14:34:35.718103 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/742023009
- 2017-07-11 14:34:36.080964 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/067247948
- 2017-07-11 14:34:36.519425 I | api: 5f470899-77de-4a2f-82df-0e2d9aba763d GET /metrics GetMetrics 200 OK 3.492224567s
- 2017-07-11 14:34:37.952765 I | api: b1ac7a1b-4687-4c1b-8577-4957536e2c98 GET /metrics GetMetrics (start)
- 2017-07-11 14:34:37.953757 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/840914491
- 2017-07-11 14:34:38.344935 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/955204190
- 2017-07-11 14:34:38.751932 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/404024357
- 2017-07-11 14:34:39.165638 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/591099200
- 2017-07-11 14:34:39.676745 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/711681951
- 2017-07-11 14:34:40.113898 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/303613554
- 2017-07-11 14:34:40.503708 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/577525545
- 2017-07-11 14:34:40.859860 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/055071860
- 2017-07-11 14:34:41.267123 I | api: b1ac7a1b-4687-4c1b-8577-4957536e2c98 GET /metrics GetMetrics 200 OK 3.314363395s
- 2017-07-11 14:34:42.876364 I | api: 8a5f79a5-0c59-4b3d-a527-b41533aa0ede GET /metrics GetMetrics (start)
- 2017-07-11 14:34:42.877265 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/762740035
- 2017-07-11 14:34:43.285280 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/242997702
- 2017-07-11 14:34:43.696660 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/261760109
- 2017-07-11 14:34:44.103150 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/841528040
- 2017-07-11 14:34:44.551236 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/855137575
- 2017-07-11 14:34:44.968127 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/687930970
- 2017-07-11 14:34:45.382887 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/375924209
- 2017-07-11 14:34:45.918291 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/846569628
- 2017-07-11 14:34:46.351527 I | api: 8a5f79a5-0c59-4b3d-a527-b41533aa0ede GET /metrics GetMetrics 200 OK 3.475162449s
- 2017-07-11 14:34:47.801191 I | api: 3b1a7206-8b5c-4242-bc62-6c0c97335b87 GET /metrics GetMetrics (start)
- 2017-07-11 14:34:47.802200 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/338306891
- 2017-07-11 14:34:48.210232 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/748067374
- 2017-07-11 14:34:48.626148 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/415991733
- 2017-07-11 14:34:49.041441 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/989783440
- 2017-07-11 14:34:49.454105 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/278429615
- 2017-07-11 14:34:49.933827 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/327769922
- 2017-07-11 14:34:50.361915 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/972145593
- 2017-07-11 14:34:50.782954 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/037587396
- 2017-07-11 14:34:51.133287 I | api: 3b1a7206-8b5c-4242-bc62-6c0c97335b87 GET /metrics GetMetrics 200 OK 3.332101469s
- 2017-07-11 14:34:52.723330 I | api: a501e94b-c052-4be5-86fc-3d61085ba526 GET /metrics GetMetrics (start)
- 2017-07-11 14:34:52.724320 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/759664211
- 2017-07-11 14:34:53.239949 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/058070934
- 2017-07-11 14:34:53.664257 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/044391933
- 2017-07-11 14:34:54.083313 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/252854584
- 2017-07-11 14:34:54.508731 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/304665911
- 2017-07-11 14:34:54.934025 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/070903594
- 2017-07-11 14:34:55.328652 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/246880897
- 2017-07-11 14:34:55.791837 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/637103084
- 2017-07-11 14:34:56.220374 I | api: a501e94b-c052-4be5-86fc-3d61085ba526 GET /metrics GetMetrics 200 OK 3.497044833s
- 2017-07-11 14:34:57.647752 I | api: 7b8ef73c-b555-4de4-9dc3-addcb9366a06 GET /metrics GetMetrics (start)
- 2017-07-11 14:34:57.648536 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/189277275
- 2017-07-11 14:34:58.078595 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/113076734
- 2017-07-11 14:34:58.525037 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/460820805
- 2017-07-11 14:34:58.949178 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/965019616
- 2017-07-11 14:34:59.362555 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/535892415
- 2017-07-11 14:34:59.816480 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/297678354
- 2017-07-11 14:35:00.745551 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/879025737
- 2017-07-11 14:35:01.185984 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/409990420
- 2017-07-11 14:35:01.605672 I | api: 7b8ef73c-b555-4de4-9dc3-addcb9366a06 GET /metrics GetMetrics 200 OK 3.957923477s
- 2017-07-11 14:35:02.567536 I | api: 713d5854-f391-4fcc-abc3-83190f60402e GET /metrics GetMetrics (start)
- 2017-07-11 14:35:02.568599 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/287725923
- 2017-07-11 14:35:03.034463 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/332176742
- 2017-07-11 14:35:03.447239 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/264565133
- 2017-07-11 14:35:03.905514 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/453185416
- 2017-07-11 14:35:04.341818 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/685907783
- 2017-07-11 14:35:04.748926 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/358977018
- 2017-07-11 14:35:05.248669 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/334169873
- 2017-07-11 14:35:05.821640 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/497189180
- 2017-07-11 14:35:06.193422 I | api: 713d5854-f391-4fcc-abc3-83190f60402e GET /metrics GetMetrics 200 OK 3.625886681s
- 2017-07-11 14:35:07.493624 I | api: 7431e5a9-f9d5-4690-b4a7-45b6ce17dbca GET /metrics GetMetrics (start)
- 2017-07-11 14:35:07.493994 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/139380587
- 2017-07-11 14:35:07.936646 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/985120206
- 2017-07-11 14:35:08.603445 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/135693013
- 2017-07-11 14:35:09.036947 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/434273840
- 2017-07-11 14:35:09.452806 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/501644239
- 2017-07-11 14:35:09.909487 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/913908450
- 2017-07-11 14:35:10.395793 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/269006041
- 2017-07-11 14:35:10.798200 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/147856484
- 2017-07-11 14:35:11.203173 I | api: 7431e5a9-f9d5-4690-b4a7-45b6ce17dbca GET /metrics GetMetrics 200 OK 3.709552039s
- 2017-07-11 14:35:12.417868 I | api: 3e4fa515-2bfd-4521-8ebb-db6aba9516dc GET /metrics GetMetrics (start)
- 2017-07-11 14:35:12.418710 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/611938931
- 2017-07-11 14:35:12.829113 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/348575542
- 2017-07-11 14:35:13.257709 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/290967837
- 2017-07-11 14:35:13.680382 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/639687128
- 2017-07-11 14:35:14.230200 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/132853079
- 2017-07-11 14:35:14.658922 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/052125386
- 2017-07-11 14:35:15.372154 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/761723297
- 2017-07-11 14:35:15.900066 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/613826188
- 2017-07-11 14:35:16.402745 I | api: 3e4fa515-2bfd-4521-8ebb-db6aba9516dc GET /metrics GetMetrics 200 OK 3.984877385s
- 2017-07-11 14:35:17.341499 I | api: 26a2928c-0b8b-40ef-aaa5-871b8afe4b2b GET /metrics GetMetrics (start)
- 2017-07-11 14:35:17.342726 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/113940091
- 2017-07-11 14:35:17.743236 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/647020446
- 2017-07-11 14:35:18.158605 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/700975717
- 2017-07-11 14:35:18.556919 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/537310336
- 2017-07-11 14:35:18.978893 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/525585375
- 2017-07-11 14:35:19.382881 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/200770482
- 2017-07-11 14:35:19.907999 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/138188649
- 2017-07-11 14:35:20.444332 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/501343668
- 2017-07-11 14:35:20.871410 I | api: 26a2928c-0b8b-40ef-aaa5-871b8afe4b2b GET /metrics GetMetrics 200 OK 3.529929107s
- 2017-07-11 14:35:22.263525 I | api: fc3ef31e-c6c3-4ba0-88db-d5ee7c53a44c GET /metrics GetMetrics (start)
- 2017-07-11 14:35:22.264541 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/196204931
- 2017-07-11 14:35:22.846732 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/008456454
- 2017-07-11 14:35:23.288720 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/133237421
- 2017-07-11 14:35:23.692646 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/640331304
- 2017-07-11 14:35:24.143081 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/803584871
- 2017-07-11 14:35:24.568001 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/161344922
- 2017-07-11 14:35:25.015928 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/034178609
- 2017-07-11 14:35:25.423354 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/234781660
- 2017-07-11 14:35:25.904105 I | api: fc3ef31e-c6c3-4ba0-88db-d5ee7c53a44c GET /metrics GetMetrics 200 OK 3.640578987s
- 2017-07-11 14:35:27.188115 I | api: 0032a1fa-8deb-4470-b0d5-bc317c7429ca GET /metrics GetMetrics (start)
- 2017-07-11 14:35:27.188869 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/256286603
- 2017-07-11 14:35:27.591326 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/679588206
- 2017-07-11 14:35:28.063259 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/265945077
- 2017-07-11 14:35:28.472991 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/388434128
- 2017-07-11 14:35:28.873151 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/083541487
- 2017-07-11 14:35:29.353647 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/585910914
- 2017-07-11 14:35:29.775843 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/693660665
- 2017-07-11 14:35:30.256717 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/682664196
- 2017-07-11 14:35:30.680504 I | api: 0032a1fa-8deb-4470-b0d5-bc317c7429ca GET /metrics GetMetrics 200 OK 3.492395508s
- 2017-07-11 14:35:32.112938 I | api: ca06c2a7-b902-45aa-8986-19e958f861da GET /metrics GetMetrics (start)
- 2017-07-11 14:35:32.113767 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/561683603
- 2017-07-11 14:35:32.520270 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/550794454
- 2017-07-11 14:35:32.964187 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/678010429
- 2017-07-11 14:35:33.406830 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/076202616
- 2017-07-11 14:35:33.839133 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/738649463
- 2017-07-11 14:35:34.281825 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/698314858
- 2017-07-11 14:35:34.787988 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/042732225
- 2017-07-11 14:35:35.217443 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/125867820
- 2017-07-11 14:35:35.862372 I | api: ca06c2a7-b902-45aa-8986-19e958f861da GET /metrics GetMetrics 200 OK 3.749433769s
- 2017-07-11 14:35:37.036547 I | api: 29c76de5-e468-4931-9074-59e1ad376f3e GET /metrics GetMetrics (start)
- 2017-07-11 14:35:37.037447 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/016324763
- 2017-07-11 14:35:37.450888 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/400956222
- 2017-07-11 14:35:37.919871 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/319803269
- 2017-07-11 14:35:38.373430 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/303570208
- 2017-07-11 14:35:38.780706 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/815502847
- 2017-07-11 14:35:39.202398 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/684940626
- 2017-07-11 14:35:39.633157 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/114707593
- 2017-07-11 14:35:40.112175 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/273032788
- 2017-07-11 14:35:40.572537 I | api: 29c76de5-e468-4931-9074-59e1ad376f3e GET /metrics GetMetrics 200 OK 3.535947788s
- 2017-07-11 14:35:41.960431 I | api: 96ae4a10-1c67-4944-9660-8cb54d7acff2 GET /metrics GetMetrics (start)
- 2017-07-11 14:35:41.961297 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/785424291
- 2017-07-11 14:35:42.388432 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/401749670
- 2017-07-11 14:35:42.803226 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/104841677
- 2017-07-11 14:35:43.295450 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/703676104
- 2017-07-11 14:35:43.731689 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/654655367
- 2017-07-11 14:35:44.152703 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/575123770
- 2017-07-11 14:35:44.581250 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/186091345
- 2017-07-11 14:35:45.026551 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/503053436
- 2017-07-11 14:35:45.607035 I | api: 96ae4a10-1c67-4944-9660-8cb54d7acff2 GET /metrics GetMetrics 200 OK 3.646603747s
- 2017-07-11 14:35:46.883967 I | api: c659e343-c976-40c2-b8ab-87d0e2c780df GET /metrics GetMetrics (start)
- 2017-07-11 14:35:46.884328 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/418968491
- 2017-07-11 14:35:47.320758 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/111599886
- 2017-07-11 14:35:47.737062 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/852630293
- 2017-07-11 14:35:48.150324 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/962571632
- 2017-07-11 14:35:48.548877 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/729288719
- 2017-07-11 14:35:48.986427 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/021292066
- 2017-07-11 14:35:49.388083 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/328470809
- 2017-07-11 14:35:49.924975 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/384974756
- 2017-07-11 14:35:50.352430 I | api: c659e343-c976-40c2-b8ab-87d0e2c780df GET /metrics GetMetrics 200 OK 3.468458253s
- 2017-07-11 14:35:51.807171 I | api: 57788239-c931-4665-8962-ddb1d9b5eb27 GET /metrics GetMetrics (start)
- 2017-07-11 14:35:51.808159 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/423507123
- 2017-07-11 14:35:52.224644 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/304589942
- 2017-07-11 14:35:52.647216 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/007156061
- 2017-07-11 14:35:53.079496 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/051561752
- 2017-07-11 14:35:53.546134 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/507676055
- 2017-07-11 14:35:53.963852 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/388897802
- 2017-07-11 14:35:54.385368 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/081360353
- 2017-07-11 14:35:54.806982 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/489739212
- 2017-07-11 14:35:55.219393 I | api: 57788239-c931-4665-8962-ddb1d9b5eb27 GET /metrics GetMetrics 200 OK 3.412223663s
- 2017-07-11 14:35:56.731219 I | api: 06f55643-f4fe-46a9-8fd7-579ce753caa6 GET /metrics GetMetrics (start)
- 2017-07-11 14:35:56.732142 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/217478331
- 2017-07-11 14:35:57.163620 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/943736542
- 2017-07-11 14:35:57.571824 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/886401189
- 2017-07-11 14:35:57.973958 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/931265984
- 2017-07-11 14:35:58.570565 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/238786591
- 2017-07-11 14:35:58.992400 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/400782066
- 2017-07-11 14:35:59.642234 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/656062889
- 2017-07-11 14:36:00.045450 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/004503284
- 2017-07-11 14:36:00.539447 I | api: 06f55643-f4fe-46a9-8fd7-579ce753caa6 GET /metrics GetMetrics 200 OK 3.80823134s
- 2017-07-11 14:36:01.659076 I | api: d045e23b-37df-41d9-92a7-5b1c296f7fc7 GET /metrics GetMetrics (start)
- 2017-07-11 14:36:01.659921 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/124772803
- 2017-07-11 14:36:02.088699 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/399286342
- 2017-07-11 14:36:02.511710 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/693069549
- 2017-07-11 14:36:02.955333 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/763281768
- 2017-07-11 14:36:03.528314 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/941554599
- 2017-07-11 14:36:03.950075 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/026559706
- 2017-07-11 14:36:04.488967 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/210156145
- 2017-07-11 14:36:04.905150 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/638804252
- 2017-07-11 14:36:05.322778 I | api: d045e23b-37df-41d9-92a7-5b1c296f7fc7 GET /metrics GetMetrics 200 OK 3.663703204s
- 2017-07-11 14:36:06.577859 I | api: c8153646-1e34-4456-8e4a-1e16aba8848c GET /metrics GetMetrics (start)
- 2017-07-11 14:36:06.579188 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/982027723
- 2017-07-11 14:36:07.033652 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/991248046
- 2017-07-11 14:36:07.536388 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/070774325
- 2017-07-11 14:36:07.967478 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/823763472
- 2017-07-11 14:36:08.362379 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/842453039
- 2017-07-11 14:36:08.790495 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/106305474
- 2017-07-11 14:36:09.200988 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/818421305
- 2017-07-11 14:36:09.643331 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/923231300
- 2017-07-11 14:36:10.167264 I | api: c8153646-1e34-4456-8e4a-1e16aba8848c GET /metrics GetMetrics 200 OK 3.58940971s
- 2017-07-11 14:36:11.500680 I | api: c4484666-08a1-4c6c-85a9-43488f050731 GET /metrics GetMetrics (start)
- 2017-07-11 14:36:11.501627 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/669061843
- 2017-07-11 14:36:11.930809 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/712174102
- 2017-07-11 14:36:12.356875 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/831504509
- 2017-07-11 14:36:12.792187 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/464211384
- 2017-07-11 14:36:13.195305 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/081502647
- 2017-07-11 14:36:13.666321 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/744424362
- 2017-07-11 14:36:14.064936 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/399298305
- 2017-07-11 14:36:14.577775 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/504979564
- 2017-07-11 14:36:15.032976 I | api: c4484666-08a1-4c6c-85a9-43488f050731 GET /metrics GetMetrics 200 OK 3.532296666s
- 2017-07-11 14:36:16.424447 I | api: fadc9b60-640f-4d16-a8ce-8001c02f569e GET /metrics GetMetrics (start)
- 2017-07-11 14:36:16.425262 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/253040347
- 2017-07-11 14:36:16.858516 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/274178174
- 2017-07-11 14:36:17.484566 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/804043205
- 2017-07-11 14:36:17.898273 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/234568800
- 2017-07-11 14:36:18.295369 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/801814591
- 2017-07-11 14:36:18.715135 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/207626898
- 2017-07-11 14:36:19.141054 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/172358345
- 2017-07-11 14:36:19.582985 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/605712276
- 2017-07-11 14:36:20.218552 I | api: fadc9b60-640f-4d16-a8ce-8001c02f569e GET /metrics GetMetrics 200 OK 3.794105858s
- 2017-07-11 14:36:21.347568 I | api: 02d9c62d-8f83-4499-a20c-f0819a2c7218 GET /metrics GetMetrics (start)
- 2017-07-11 14:36:21.348491 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/350748131
- 2017-07-11 14:36:21.792725 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/465744358
- 2017-07-11 14:36:22.188934 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/753010701
- 2017-07-11 14:36:22.600207 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/758561800
- 2017-07-11 14:36:23.039922 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/392470471
- 2017-07-11 14:36:23.486214 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/183023226
- 2017-07-11 14:36:23.918487 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/171957137
- 2017-07-11 14:36:24.332300 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/756829116
- 2017-07-11 14:36:24.764152 I | api: 02d9c62d-8f83-4499-a20c-f0819a2c7218 GET /metrics GetMetrics 200 OK 3.416583849s
- 2017-07-11 14:36:26.270303 I | api: cdfaf928-51cc-4376-8aff-cb33d8380e4e GET /metrics GetMetrics (start)
- 2017-07-11 14:36:26.271417 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/219690987
- 2017-07-11 14:36:26.709851 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/048524366
- 2017-07-11 14:36:27.142272 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/174219093
- 2017-07-11 14:36:27.595082 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/195856560
- 2017-07-11 14:36:28.009409 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/704870479
- 2017-07-11 14:36:28.433977 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/525878114
- 2017-07-11 14:36:28.837318 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/011382105
- 2017-07-11 14:36:29.259448 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/711486692
- 2017-07-11 14:36:29.849685 I | api: cdfaf928-51cc-4376-8aff-cb33d8380e4e GET /metrics GetMetrics 200 OK 3.579387245s
- 2017-07-11 14:36:31.193075 I | api: c92bcacd-561c-49c8-8131-a9d2cf2fc132 GET /metrics GetMetrics (start)
- 2017-07-11 14:36:31.194041 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/247174387
- 2017-07-11 14:36:31.639950 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/158239670
- 2017-07-11 14:36:32.061423 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/570717085
- 2017-07-11 14:36:32.457855 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/326917208
- 2017-07-11 14:36:32.884429 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/947582423
- 2017-07-11 14:36:33.308213 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/446699850
- 2017-07-11 14:36:33.811966 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/638409249
- 2017-07-11 14:36:34.210900 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/454156044
- 2017-07-11 14:36:34.632231 I | api: c92bcacd-561c-49c8-8131-a9d2cf2fc132 GET /metrics GetMetrics 200 OK 3.439156497s
- 2017-07-11 14:36:36.116638 I | api: c8feb944-9c95-404c-af88-d44cf8b52a14 GET /metrics GetMetrics (start)
- 2017-07-11 14:36:36.117551 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/578275579
- 2017-07-11 14:36:36.525581 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/295898654
- 2017-07-11 14:36:36.978510 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/259852005
- 2017-07-11 14:36:37.405516 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/404550400
- 2017-07-11 14:36:37.885228 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/029495391
- 2017-07-11 14:36:38.287041 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/058447922
- 2017-07-11 14:36:38.708624 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/276582889
- 2017-07-11 14:36:39.139143 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/142292020
- 2017-07-11 14:36:39.816002 I | api: c8feb944-9c95-404c-af88-d44cf8b52a14 GET /metrics GetMetrics 200 OK 3.69937289s
- 2017-07-11 14:36:41.039499 I | api: 7a0c2728-7aec-4699-85e5-423ef8a58a35 GET /metrics GetMetrics (start)
- 2017-07-11 14:36:41.040443 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/666956803
- 2017-07-11 14:36:41.454742 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/053314950
- 2017-07-11 14:36:41.878988 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/006316333
- 2017-07-11 14:36:42.303920 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/628150440
- 2017-07-11 14:36:42.730376 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/991539687
- 2017-07-11 14:36:43.150692 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/183205402
- 2017-07-11 14:36:43.594290 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/552218289
- 2017-07-11 14:36:44.008502 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/865016412
- 2017-07-11 14:36:44.450620 I | api: 7a0c2728-7aec-4699-85e5-423ef8a58a35 GET /metrics GetMetrics 200 OK 3.411119891s
- 2017-07-11 14:36:45.962970 I | api: d2ab6c2a-feb0-4c45-9208-3e60dce1f899 GET /metrics GetMetrics (start)
- 2017-07-11 14:36:45.963813 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/915744779
- 2017-07-11 14:36:46.382896 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/328286702
- 2017-07-11 14:36:46.830424 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/545949813
- 2017-07-11 14:36:47.379777 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/974565712
- 2017-07-11 14:36:47.830470 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/706842223
- 2017-07-11 14:36:48.296858 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/353544962
- 2017-07-11 14:36:48.810388 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/907781241
- 2017-07-11 14:36:49.232628 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/089272708
- 2017-07-11 14:36:49.810789 I | api: d2ab6c2a-feb0-4c45-9208-3e60dce1f899 GET /metrics GetMetrics 200 OK 3.847821388s
- 2017-07-11 14:36:51.392147 I | api: f4033faa-ccce-4db5-b0bb-57332c410244 GET /metrics GetMetrics (start)
- 2017-07-11 14:36:51.392571 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/058682131
- 2017-07-11 14:36:51.824149 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/489829206
- 2017-07-11 14:36:52.332340 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/690885821
- 2017-07-11 14:36:52.777579 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/061731064
- 2017-07-11 14:36:53.177265 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/324153847
- 2017-07-11 14:36:53.611035 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/008588522
- 2017-07-11 14:36:54.039987 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/085892417
- 2017-07-11 14:36:54.445866 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/217961900
- 2017-07-11 14:36:54.920334 I | api: f4033faa-ccce-4db5-b0bb-57332c410244 GET /metrics GetMetrics 200 OK 3.528188386s
- 2017-07-11 14:36:56.315251 I | api: 6a3d0812-5d5c-469e-a809-2ca7c6514a1f GET /metrics GetMetrics (start)
- 2017-07-11 14:36:56.316150 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/863041307
- 2017-07-11 14:36:56.749098 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/162610622
- 2017-07-11 14:36:57.177723 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/454995461
- 2017-07-11 14:36:57.678990 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/484019616
- 2017-07-11 14:36:58.122355 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/914941055
- 2017-07-11 14:36:58.590070 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/704891346
- 2017-07-11 14:36:59.027854 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/734283529
- 2017-07-11 14:36:59.596755 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/785222868
- 2017-07-11 14:37:00.023986 I | api: 6a3d0812-5d5c-469e-a809-2ca7c6514a1f GET /metrics GetMetrics 200 OK 3.708741443s
- 2017-07-11 14:37:01.238147 I | api: 6bf9a2e3-8d67-4581-8e1f-3efc757e6d71 GET /metrics GetMetrics (start)
- 2017-07-11 14:37:01.239104 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/344114211
- 2017-07-11 14:37:01.674804 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/666473766
- 2017-07-11 14:37:02.130798 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/811002957
- 2017-07-11 14:37:02.866517 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/719968072
- 2017-07-11 14:37:03.366236 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/158716935
- 2017-07-11 14:37:03.850426 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/586790842
- 2017-07-11 14:37:04.275857 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/771966929
- 2017-07-11 14:37:04.825753 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/749249788
- 2017-07-11 14:37:05.622200 I | api: 6bf9a2e3-8d67-4581-8e1f-3efc757e6d71 GET /metrics GetMetrics 200 OK 4.384040974s
- 2017-07-11 14:37:06.161376 I | api: 71e20e44-7f81-49d1-b6f9-c323fdc0daab GET /metrics GetMetrics (start)
- 2017-07-11 14:37:06.162418 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/478633515
- 2017-07-11 14:37:06.995475 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/420455310
- 2017-07-11 14:37:07.406284 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/057833365
- 2017-07-11 14:37:07.894739 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/202310128
- 2017-07-11 14:37:08.344475 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/116938383
- 2017-07-11 14:37:08.830756 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/166547106
- 2017-07-11 14:37:09.267669 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/710931865
- 2017-07-11 14:37:09.705834 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/141730852
- 2017-07-11 14:37:10.152229 I | api: 71e20e44-7f81-49d1-b6f9-c323fdc0daab GET /metrics GetMetrics 200 OK 3.990858162s
- 2017-07-11 14:37:11.084095 I | api: be14fdd0-1ce3-451c-a7ed-87da47d5de45 GET /metrics GetMetrics (start)
- 2017-07-11 14:37:11.085050 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/596694835
- 2017-07-11 14:37:11.498796 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/836465910
- 2017-07-11 14:37:12.344821 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/704533469
- 2017-07-11 14:37:12.853464 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/205023640
- 2017-07-11 14:37:13.277869 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/980371479
- 2017-07-11 14:37:13.744566 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/709242506
- 2017-07-11 14:37:14.184626 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/739054177
- 2017-07-11 14:37:14.697893 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/045020236
- 2017-07-11 14:37:15.128120 I | api: be14fdd0-1ce3-451c-a7ed-87da47d5de45 GET /metrics GetMetrics 200 OK 4.044026128s
- 2017-07-11 14:37:16.006385 I | api: 80319785-fdfa-480f-8088-9127c577fe7b GET /metrics GetMetrics (start)
- 2017-07-11 14:37:16.007246 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/401852731
- 2017-07-11 14:37:16.443435 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/227794782
- 2017-07-11 14:37:16.894075 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/194621221
- 2017-07-11 14:37:17.435507 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/072555072
- 2017-07-11 14:37:17.913408 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/559728799
- 2017-07-11 14:37:18.369343 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/107342194
- 2017-07-11 14:37:18.803395 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/513892393
- 2017-07-11 14:37:19.222211 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/271225716
- 2017-07-11 14:37:19.667594 I | api: 80319785-fdfa-480f-8088-9127c577fe7b GET /metrics GetMetrics 200 OK 3.661215083s
- 2017-07-11 14:37:20.929231 I | api: 9dcb6d12-5b40-4723-82a9-dc14b6127d91 GET /metrics GetMetrics (start)
- 2017-07-11 14:37:20.930470 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/015011907
- 2017-07-11 14:37:21.349768 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/797209798
- 2017-07-11 14:37:21.780796 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/096681325
- 2017-07-11 14:37:22.210818 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/201286632
- 2017-07-11 14:37:22.641103 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/749774887
- 2017-07-11 14:37:23.071570 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/719752026
- 2017-07-11 14:37:23.486567 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/782468337
- 2017-07-11 14:37:23.933720 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/088506268
- 2017-07-11 14:37:24.394748 I | api: 9dcb6d12-5b40-4723-82a9-dc14b6127d91 GET /metrics GetMetrics 200 OK 3.465526456s
- 2017-07-11 14:37:25.929543 I | api: 83fc1761-1c25-4e19-90a2-334fc2625946 GET /metrics GetMetrics (start)
- 2017-07-11 14:37:25.930336 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/236426827
- 2017-07-11 14:37:26.315560 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/114718510
- 2017-07-11 14:37:26.760302 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/890749109
- 2017-07-11 14:37:27.198736 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/298409616
- 2017-07-11 14:37:27.850849 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/607161519
- 2017-07-11 14:37:28.324336 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/045831746
- 2017-07-11 14:37:28.864827 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/891803321
- 2017-07-11 14:37:29.295187 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/879481540
- 2017-07-11 14:37:29.733010 I | api: 83fc1761-1c25-4e19-90a2-334fc2625946 GET /metrics GetMetrics 200 OK 3.803471151s
- 2017-07-11 14:37:30.847431 I | api: bf2441cd-ffc6-4852-bbfc-f609cbdf3ee1 GET /metrics GetMetrics (start)
- 2017-07-11 14:37:30.848683 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/896267603
- 2017-07-11 14:37:31.201716 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/495055510
- 2017-07-11 14:37:31.625017 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/695777021
- 2017-07-11 14:37:32.061866 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/702451768
- 2017-07-11 14:37:32.530799 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/531273271
- 2017-07-11 14:37:33.034441 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/068938282
- 2017-07-11 14:37:33.445348 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/240536961
- 2017-07-11 14:37:34.018983 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/487112940
- 2017-07-11 14:37:34.461696 I | api: bf2441cd-ffc6-4852-bbfc-f609cbdf3ee1 GET /metrics GetMetrics 200 OK 3.614284066s
- 2017-07-11 14:37:35.767929 I | api: 698ff48d-58b9-4d7f-8bc4-faf1856c2e3b GET /metrics GetMetrics (start)
- 2017-07-11 14:37:35.771655 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/998784859
- 2017-07-11 14:37:36.118883 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/684961534
- 2017-07-11 14:37:36.543264 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/182824005
- 2017-07-11 14:37:36.975361 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/736570592
- 2017-07-11 14:37:37.445699 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/648737471
- 2017-07-11 14:37:37.967661 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/909760786
- 2017-07-11 14:37:38.387608 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/851497801
- 2017-07-11 14:37:38.820816 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/557467668
- 2017-07-11 14:37:39.241612 I | api: 698ff48d-58b9-4d7f-8bc4-faf1856c2e3b GET /metrics GetMetrics 200 OK 3.473891436s
- 2017-07-11 14:37:40.689192 I | api: 8df453e2-c6b0-42a8-9624-8112f669c535 GET /metrics GetMetrics (start)
- 2017-07-11 14:37:40.690528 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/789615715
- 2017-07-11 14:37:41.099926 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/104894566
- 2017-07-11 14:37:41.517176 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/839392909
- 2017-07-11 14:37:41.971908 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/648664200
- 2017-07-11 14:37:42.401571 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/876435015
- 2017-07-11 14:37:42.826281 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/149185786
- 2017-07-11 14:37:43.343347 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/360193041
- 2017-07-11 14:37:43.837006 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/339758140
- 2017-07-11 14:37:44.289256 I | api: 8df453e2-c6b0-42a8-9624-8112f669c535 GET /metrics GetMetrics 200 OK 3.600065599s
- 2017-07-11 14:37:45.612922 I | api: 8c93188a-5adb-4707-879e-235ae788f6cb GET /metrics GetMetrics (start)
- 2017-07-11 14:37:45.614192 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/616688747
- 2017-07-11 14:37:45.965508 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/335761614
- 2017-07-11 14:37:46.386915 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/829556181
- 2017-07-11 14:37:46.808030 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/123855664
- 2017-07-11 14:37:47.294650 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/432815823
- 2017-07-11 14:37:47.773644 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/460954082
- 2017-07-11 14:37:48.217984 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/304119257
- 2017-07-11 14:37:48.671207 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/058754916
- 2017-07-11 14:37:49.104445 I | api: 8c93188a-5adb-4707-879e-235ae788f6cb GET /metrics GetMetrics 200 OK 3.49152595s
- 2017-07-11 14:37:50.531925 I | api: 2ef7ace7-abe8-42d8-9aa9-57ecd1ed7389 GET /metrics GetMetrics (start)
- 2017-07-11 14:37:50.532823 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/174662515
- 2017-07-11 14:37:50.990538 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/339951670
- 2017-07-11 14:37:51.339876 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/795164189
- 2017-07-11 14:37:51.779621 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/203925720
- 2017-07-11 14:37:52.306653 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/617649751
- 2017-07-11 14:37:52.752488 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/849076682
- 2017-07-11 14:37:53.162958 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/058188449
- 2017-07-11 14:37:53.616987 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/168984460
- 2017-07-11 14:37:54.075770 I | api: 2ef7ace7-abe8-42d8-9aa9-57ecd1ed7389 GET /metrics GetMetrics 200 OK 3.543845348s
- 2017-07-11 14:37:55.468862 I | api: 60a64de9-215d-498f-8f3e-4f67b0ea0722 GET /metrics GetMetrics (start)
- 2017-07-11 14:37:55.469707 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/672505211
- 2017-07-11 14:37:55.941435 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/337454750
- 2017-07-11 14:37:56.287348 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/137743717
- 2017-07-11 14:37:56.740117 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/009315200
- 2017-07-11 14:37:57.152837 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/565245663
- 2017-07-11 14:37:57.679462 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/259813554
- 2017-07-11 14:37:58.111085 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/365942377
- 2017-07-11 14:37:58.538502 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/231627444
- 2017-07-11 14:37:59.036327 I | api: 60a64de9-215d-498f-8f3e-4f67b0ea0722 GET /metrics GetMetrics 200 OK 3.567469403s
- 2017-07-11 14:38:00.396899 I | api: 07b74cbc-67f0-443e-9e9d-ba494dc832e0 GET /metrics GetMetrics (start)
- 2017-07-11 14:38:00.397867 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/729902211
- 2017-07-11 14:38:00.965682 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/826347526
- 2017-07-11 14:38:01.303155 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/176708013
- 2017-07-11 14:38:01.776430 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/047945000
- 2017-07-11 14:38:02.274752 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/086236775
- 2017-07-11 14:38:02.842086 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/388346010
- 2017-07-11 14:38:03.246173 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/106816817
- 2017-07-11 14:38:03.810812 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/263136476
- 2017-07-11 14:38:04.230658 I | api: 07b74cbc-67f0-443e-9e9d-ba494dc832e0 GET /metrics GetMetrics 200 OK 3.833761394s
- 2017-07-11 14:38:05.330421 I | api: 3f346fd7-51a1-47ff-bcdc-db573f417a50 GET /metrics GetMetrics (start)
- 2017-07-11 14:38:05.331212 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/786739339
- 2017-07-11 14:38:05.826467 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/733201518
- 2017-07-11 14:38:06.186602 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/968126197
- 2017-07-11 14:38:06.612287 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/211507664
- 2017-07-11 14:38:07.044255 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/547605231
- 2017-07-11 14:38:07.489811 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/090208130
- 2017-07-11 14:38:07.986173 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/184357625
- 2017-07-11 14:38:08.523388 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/066292740
- 2017-07-11 14:38:08.969245 I | api: 3f346fd7-51a1-47ff-bcdc-db573f417a50 GET /metrics GetMetrics 200 OK 3.638827814s
- 2017-07-11 14:38:10.266456 I | api: 299bf668-7ccc-4b90-9b73-6f381c1be5db GET /metrics GetMetrics (start)
- 2017-07-11 14:38:10.267414 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/011217811
- 2017-07-11 14:38:10.863129 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/117923286
- 2017-07-11 14:38:11.213552 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/179673405
- 2017-07-11 14:38:11.643593 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/473674616
- 2017-07-11 14:38:12.081791 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/136240247
- 2017-07-11 14:38:12.550683 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/872313706
- 2017-07-11 14:38:12.981691 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/485061569
- 2017-07-11 14:38:13.471833 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/313505324
- 2017-07-11 14:38:14.021519 I | api: 299bf668-7ccc-4b90-9b73-6f381c1be5db GET /metrics GetMetrics 200 OK 3.755061412s
- 2017-07-11 14:38:15.197950 I | api: eb6df601-4061-48d6-9e52-bb3f806bed01 GET /metrics GetMetrics (start)
- 2017-07-11 14:38:15.198846 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/771371931
- 2017-07-11 14:38:15.695855 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/123615294
- 2017-07-11 14:38:16.155577 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/971434629
- 2017-07-11 14:38:16.563182 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/570742304
- 2017-07-11 14:38:16.993285 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/980866303
- 2017-07-11 14:38:17.461868 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/513905746
- 2017-07-11 14:38:17.955558 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/353790345
- 2017-07-11 14:38:18.369101 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/332026196
- 2017-07-11 14:38:18.867968 I | api: eb6df601-4061-48d6-9e52-bb3f806bed01 GET /metrics GetMetrics 200 OK 3.670023014s
- 2017-07-11 14:38:20.130174 I | api: d635fa71-00d1-463a-96d9-212471bc12fe GET /metrics GetMetrics (start)
- 2017-07-11 14:38:20.131104 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/785087651
- 2017-07-11 14:38:20.543303 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/070803366
- 2017-07-11 14:38:21.087171 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/292627661
- 2017-07-11 14:38:21.559470 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/794259400
- 2017-07-11 14:38:21.982081 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/067570311
- 2017-07-11 14:38:22.402616 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/011741754
- 2017-07-11 14:38:22.836376 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/269351505
- 2017-07-11 14:38:23.294837 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/281669500
- 2017-07-11 14:38:23.850978 I | api: d635fa71-00d1-463a-96d9-212471bc12fe GET /metrics GetMetrics 200 OK 3.720805214s
- 2017-07-11 14:38:25.083641 I | api: af596f68-7775-43df-b1c7-d708f70cdcf7 GET /metrics GetMetrics (start)
- 2017-07-11 14:38:25.091653 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/013393067
- 2017-07-11 14:38:25.597016 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/976553998
- 2017-07-11 14:38:25.971290 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/299277845
- 2017-07-11 14:38:26.481180 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/061060208
- 2017-07-11 14:38:26.902219 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/193568015
- 2017-07-11 14:38:27.321203 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/000495906
- 2017-07-11 14:38:27.743450 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/036652569
- 2017-07-11 14:38:28.183996 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/329413796
- 2017-07-11 14:38:28.627700 I | api: af596f68-7775-43df-b1c7-d708f70cdcf7 GET /metrics GetMetrics 200 OK 3.544062739s
- 2017-07-11 14:38:29.996708 I | api: f9c47004-63ad-4123-a56b-aaab2d4631fc GET /metrics GetMetrics (start)
- 2017-07-11 14:38:29.997077 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/347347891
- 2017-07-11 14:38:30.462335 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/153187190
- 2017-07-11 14:38:30.903372 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/302910045
- 2017-07-11 14:38:31.373595 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/800311832
- 2017-07-11 14:38:31.795992 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/124634775
- 2017-07-11 14:38:32.273952 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/202429706
- 2017-07-11 14:38:32.806119 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/754512609
- 2017-07-11 14:38:33.234173 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/216508620
- 2017-07-11 14:38:33.695687 I | api: f9c47004-63ad-4123-a56b-aaab2d4631fc GET /metrics GetMetrics 200 OK 3.698980407s
- 2017-07-11 14:38:34.929869 I | api: 36369bca-909f-4bb1-8ba0-6814d500e0c0 GET /metrics GetMetrics (start)
- 2017-07-11 14:38:34.930819 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/448270267
- 2017-07-11 14:38:35.462264 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/001682910
- 2017-07-11 14:38:35.910616 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/315028901
- 2017-07-11 14:38:36.256678 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/772673216
- 2017-07-11 14:38:36.700873 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/855546655
- 2017-07-11 14:38:37.136332 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/006985202
- 2017-07-11 14:38:37.550968 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/789327529
- 2017-07-11 14:38:38.030867 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/822463988
- 2017-07-11 14:38:38.471576 I | api: 36369bca-909f-4bb1-8ba0-6814d500e0c0 GET /metrics GetMetrics 200 OK 3.541721616s
- 2017-07-11 14:38:39.864776 I | api: 6d1dadd8-dd4c-4b78-bc92-1f8b47f6608f GET /metrics GetMetrics (start)
- 2017-07-11 14:38:39.865732 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/856399043
- 2017-07-11 14:38:40.269344 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/819912006
- 2017-07-11 14:38:40.693926 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/532681709
- 2017-07-11 14:38:41.133580 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/397056616
- 2017-07-11 14:38:41.542112 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/944643751
- 2017-07-11 14:38:41.958693 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/129973722
- 2017-07-11 14:38:42.398086 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/099883377
- 2017-07-11 14:38:42.848107 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/416511516
- 2017-07-11 14:38:43.318122 I | api: 6d1dadd8-dd4c-4b78-bc92-1f8b47f6608f GET /metrics GetMetrics 200 OK 3.453346168s
- 2017-07-11 14:38:44.796082 I | api: ddba98e5-356b-4df2-93e1-0369c5b2133f GET /metrics GetMetrics (start)
- 2017-07-11 14:38:44.797018 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/598187723
- 2017-07-11 14:38:45.328263 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/460266414
- 2017-07-11 14:38:45.863395 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/124842293
- 2017-07-11 14:38:46.200902 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/728977680
- 2017-07-11 14:38:46.662447 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/311142191
- 2017-07-11 14:38:47.102918 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/467458242
- 2017-07-11 14:38:47.531183 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/862990649
- 2017-07-11 14:38:47.962497 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/905948484
- 2017-07-11 14:38:48.598560 I | api: ddba98e5-356b-4df2-93e1-0369c5b2133f GET /metrics GetMetrics 200 OK 3.802481731s
- 2017-07-11 14:38:49.730634 I | api: ecaef7e7-f52f-478d-8bea-200d1b432ea1 GET /metrics GetMetrics (start)
- 2017-07-11 14:38:49.731614 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/306674131
- 2017-07-11 14:38:50.142874 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/527277334
- 2017-07-11 14:38:50.565395 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/549812093
- 2017-07-11 14:38:50.999690 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/061606072
- 2017-07-11 14:38:51.346477 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/056241335
- 2017-07-11 14:38:51.771737 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/554394794
- 2017-07-11 14:38:52.185837 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/220070401
- 2017-07-11 14:38:52.600432 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/066920812
- 2017-07-11 14:38:53.126497 I | api: ecaef7e7-f52f-478d-8bea-200d1b432ea1 GET /metrics GetMetrics 200 OK 3.395863269s
- 2017-07-11 14:38:54.659142 I | api: c0e8e02c-7912-4d56-b58a-273fe7682688 GET /metrics GetMetrics (start)
- 2017-07-11 14:38:54.660086 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/775710683
- 2017-07-11 14:38:55.226510 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/949796222
- 2017-07-11 14:38:55.627615 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/288540357
- 2017-07-11 14:38:56.046227 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/228731744
- 2017-07-11 14:38:56.459963 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/257699135
- 2017-07-11 14:38:56.959270 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/692803986
- 2017-07-11 14:38:57.400403 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/439659465
- 2017-07-11 14:38:57.825391 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/412350612
- 2017-07-11 14:38:58.395952 I | api: c0e8e02c-7912-4d56-b58a-273fe7682688 GET /metrics GetMetrics 200 OK 3.736814115s
- 2017-07-11 14:38:59.593603 I | api: 8f6e8366-6cd8-4770-b5ab-8bef77be2944 GET /metrics GetMetrics (start)
- 2017-07-11 14:38:59.594640 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/617204963
- 2017-07-11 14:39:00.022682 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/222705894
- 2017-07-11 14:39:00.496608 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/288830733
- 2017-07-11 14:39:00.931474 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/070039304
- 2017-07-11 14:39:01.333883 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/802646727
- 2017-07-11 14:39:01.845858 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/504832378
- 2017-07-11 14:39:02.557904 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/905900177
- 2017-07-11 14:39:03.073449 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/876877500
- 2017-07-11 14:39:03.495106 I | api: 8f6e8366-6cd8-4770-b5ab-8bef77be2944 GET /metrics GetMetrics 200 OK 3.901515554s
- 2017-07-11 14:39:04.526878 I | api: f523dbd5-e676-4170-a644-628072d9f10f GET /metrics GetMetrics (start)
- 2017-07-11 14:39:04.527711 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/237122795
- 2017-07-11 14:39:05.219311 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/598685006
- 2017-07-11 14:39:05.614410 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/940565077
- 2017-07-11 14:39:06.070947 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/418428848
- 2017-07-11 14:39:06.981322 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/719034703
- 2017-07-11 14:39:07.403736 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/155343970
- 2017-07-11 14:39:07.867408 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/933014617
- 2017-07-11 14:39:08.325841 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/189271524
- 2017-07-11 14:39:08.775774 I | api: f523dbd5-e676-4170-a644-628072d9f10f GET /metrics GetMetrics 200 OK 4.248878747s
- 2017-07-11 14:39:09.459442 I | api: 26a2431b-4a10-4827-9f37-8edc04f98049 GET /metrics GetMetrics (start)
- 2017-07-11 14:39:09.460453 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/669861363
- 2017-07-11 14:39:09.889413 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/719306422
- 2017-07-11 14:39:10.413681 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/171879069
- 2017-07-11 14:39:10.883535 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/659710296
- 2017-07-11 14:39:11.254765 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/250351319
- 2017-07-11 14:39:11.722637 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/884303434
- 2017-07-11 14:39:12.153888 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/765501729
- 2017-07-11 14:39:12.656547 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/241729036
- 2017-07-11 14:39:13.133562 I | api: 26a2431b-4a10-4827-9f37-8edc04f98049 GET /metrics GetMetrics 200 OK 3.674119726s
- 2017-07-11 14:39:14.388425 I | api: 74ce696f-81d2-4d73-9e4f-8c441c224d30 GET /metrics GetMetrics (start)
- 2017-07-11 14:39:14.389189 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/450861563
- 2017-07-11 14:39:14.827163 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/671025438
- 2017-07-11 14:39:15.403564 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/320995301
- 2017-07-11 14:39:15.823811 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/109311488
- 2017-07-11 14:39:16.270197 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/723939679
- 2017-07-11 14:39:16.754718 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/503656754
- 2017-07-11 14:39:17.228942 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/929482473
- 2017-07-11 14:39:17.876725 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/031542068
- 2017-07-11 14:39:18.304156 I | api: 74ce696f-81d2-4d73-9e4f-8c441c224d30 GET /metrics GetMetrics 200 OK 3.915733245s
- 2017-07-11 14:39:19.323987 I | api: a3c932fe-76bd-47bf-a086-3a9f9baafe37 GET /metrics GetMetrics (start)
- 2017-07-11 14:39:19.325082 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/102950147
- 2017-07-11 14:39:19.798616 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/415730822
- 2017-07-11 14:39:20.252925 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/114564141
- 2017-07-11 14:39:20.671119 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/551294376
- 2017-07-11 14:39:21.188877 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/047488743
- 2017-07-11 14:39:21.624995 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/844265242
- 2017-07-11 14:39:22.055181 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/410029489
- 2017-07-11 14:39:22.801307 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/060043100
- 2017-07-11 14:39:23.220891 I | api: a3c932fe-76bd-47bf-a086-3a9f9baafe37 GET /metrics GetMetrics 200 OK 3.896929643s
- 2017-07-11 14:39:24.256561 I | api: 2aa7a21e-bbe5-429f-8726-86af84ccccb7 GET /metrics GetMetrics (start)
- 2017-07-11 14:39:24.257488 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/365953803
- 2017-07-11 14:39:24.729426 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/236120302
- 2017-07-11 14:39:25.461534 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/371335029
- 2017-07-11 14:39:25.884329 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/119548496
- 2017-07-11 14:39:26.284030 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/344417647
- 2017-07-11 14:39:26.734261 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/232108034
- 2017-07-11 14:39:27.156014 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/194088825
- 2017-07-11 14:39:27.581203 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/318367364
- 2017-07-11 14:39:27.993978 I | api: 2aa7a21e-bbe5-429f-8726-86af84ccccb7 GET /metrics GetMetrics 200 OK 3.737421153s
- 2017-07-11 14:39:29.184158 I | api: 159c8e1b-2f97-4d54-ad29-c392378b9535 GET /metrics GetMetrics (start)
- 2017-07-11 14:39:29.185085 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/579650579
- 2017-07-11 14:39:29.618115 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/965704278
- 2017-07-11 14:39:30.028331 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/172073917
- 2017-07-11 14:39:30.462294 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/406063608
- 2017-07-11 14:39:30.939679 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/577172215
- 2017-07-11 14:39:31.363013 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/504472554
- 2017-07-11 14:39:31.816166 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/804811329
- 2017-07-11 14:39:32.219614 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/895915692
- 2017-07-11 14:39:32.671220 I | api: 159c8e1b-2f97-4d54-ad29-c392378b9535 GET /metrics GetMetrics 200 OK 3.487061531s
- 2017-07-11 14:39:34.143616 I | api: a7cd9e35-ab11-47a0-99bf-e3892e0bf1a8 GET /metrics GetMetrics (start)
- 2017-07-11 14:39:34.144467 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/680451099
- 2017-07-11 14:39:34.549469 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/593372350
- 2017-07-11 14:39:35.017713 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/560497925
- 2017-07-11 14:39:35.578777 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/436543136
- 2017-07-11 14:39:35.996451 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/899349375
- 2017-07-11 14:39:36.408273 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/990642386
- 2017-07-11 14:39:36.821895 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/086377993
- 2017-07-11 14:39:37.243957 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/060536788
- 2017-07-11 14:39:37.994083 I | api: a7cd9e35-ab11-47a0-99bf-e3892e0bf1a8 GET /metrics GetMetrics 200 OK 3.850472017s
- 2017-07-11 14:39:39.074846 I | api: 6e65f6e5-d54d-4143-b797-df88814da9a5 GET /metrics GetMetrics (start)
- 2017-07-11 14:39:39.075193 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/531286307
- 2017-07-11 14:39:39.523591 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/292849702
- 2017-07-11 14:39:39.949870 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/019867469
- 2017-07-11 14:39:40.375559 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/873096776
- 2017-07-11 14:39:40.788125 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/046060807
- 2017-07-11 14:39:41.135186 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/917475002
- 2017-07-11 14:39:41.545361 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/865136849
- 2017-07-11 14:39:42.049900 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/731213820
- 2017-07-11 14:39:42.495846 I | api: 6e65f6e5-d54d-4143-b797-df88814da9a5 GET /metrics GetMetrics 200 OK 3.421000144s
- 2017-07-11 14:39:44.010059 I | api: 28c9229e-9f4e-40c6-96bd-fd6a3651c17c GET /metrics GetMetrics (start)
- 2017-07-11 14:39:44.010883 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/519930667
- 2017-07-11 14:39:44.443069 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/236781710
- 2017-07-11 14:39:44.897547 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/415824533
- 2017-07-11 14:39:45.485551 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/854077680
- 2017-07-11 14:39:45.925921 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/697764751
- 2017-07-11 14:39:46.322524 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/369411490
- 2017-07-11 14:39:46.747654 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/386397337
- 2017-07-11 14:39:47.161919 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/357699364
- 2017-07-11 14:39:47.754503 I | api: 28c9229e-9f4e-40c6-96bd-fd6a3651c17c GET /metrics GetMetrics 200 OK 3.744446955s
- 2017-07-11 14:39:48.942908 I | api: df2dfb9c-1053-40d4-9d4e-d167eec8e9c1 GET /metrics GetMetrics (start)
- 2017-07-11 14:39:48.943885 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/950924339
- 2017-07-11 14:39:49.367433 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/375315958
- 2017-07-11 14:39:49.782025 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/009855709
- 2017-07-11 14:39:50.226899 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/521391256
- 2017-07-11 14:39:50.631413 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/932664087
- 2017-07-11 14:39:51.056484 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/378408842
- 2017-07-11 14:39:51.419954 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/987274593
- 2017-07-11 14:39:51.879063 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/782589260
- 2017-07-11 14:39:52.337507 I | api: df2dfb9c-1053-40d4-9d4e-d167eec8e9c1 GET /metrics GetMetrics 200 OK 3.394597812s
- 2017-07-11 14:39:53.888483 I | api: 9b014cb8-51cd-465f-bd86-ac04e752b987 GET /metrics GetMetrics (start)
- 2017-07-11 14:39:53.889378 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/590832699
- 2017-07-11 14:39:54.437465 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/164737630
- 2017-07-11 14:39:54.891822 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/233968677
- 2017-07-11 14:39:55.599607 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/314490688
- 2017-07-11 14:39:56.049829 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/717343647
- 2017-07-11 14:39:56.477775 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/388435058
- 2017-07-11 14:39:56.910014 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/005583657
- 2017-07-11 14:39:57.422067 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/215377524
- 2017-07-11 14:39:57.855217 I | api: 9b014cb8-51cd-465f-bd86-ac04e752b987 GET /metrics GetMetrics 200 OK 3.966738042s
- 2017-07-11 14:39:58.807827 I | api: 95cf966c-0293-461e-95a2-f126d2c3635e GET /metrics GetMetrics (start)
- 2017-07-11 14:39:58.808701 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/366843203
- 2017-07-11 14:39:59.231927 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/735438790
- 2017-07-11 14:39:59.697805 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/766189677
- 2017-07-11 14:40:00.171362 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/887073000
- 2017-07-11 14:40:00.590518 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/485973799
- 2017-07-11 14:40:01.112963 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/619690586
- 2017-07-11 14:40:01.595212 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/464391153
- 2017-07-11 14:40:02.061894 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/663786652
- 2017-07-11 14:40:02.554123 I | api: 95cf966c-0293-461e-95a2-f126d2c3635e GET /metrics GetMetrics 200 OK 3.746291777s
- 2017-07-11 14:40:03.754557 I | api: 786e4c8e-9865-4ee1-a514-93d3dfda6609 GET /metrics GetMetrics (start)
- 2017-07-11 14:40:03.755287 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/563993931
- 2017-07-11 14:40:04.258293 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/779744814
- 2017-07-11 14:40:04.688146 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/201849269
- 2017-07-11 14:40:05.149413 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/135756176
- 2017-07-11 14:40:05.712588 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/282916783
- 2017-07-11 14:40:06.094918 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/217457986
- 2017-07-11 14:40:06.522237 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/812747705
- 2017-07-11 14:40:06.951216 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/707275204
- 2017-07-11 14:40:07.387204 I | api: 786e4c8e-9865-4ee1-a514-93d3dfda6609 GET /metrics GetMetrics 200 OK 3.632649661s
- 2017-07-11 14:40:08.671146 I | api: 1f160c19-53e9-44ee-97d8-f58245ca2382 GET /metrics GetMetrics (start)
- 2017-07-11 14:40:08.672083 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/175739475
- 2017-07-11 14:40:09.176097 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/339467158
- 2017-07-11 14:40:09.588097 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/601179645
- 2017-07-11 14:40:10.032093 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/635704632
- 2017-07-11 14:40:10.484770 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/468735799
- 2017-07-11 14:40:10.923897 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/005710634
- 2017-07-11 14:40:11.487033 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/492404865
- 2017-07-11 14:40:12.019601 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/022788076
- 2017-07-11 14:40:12.452017 I | api: 1f160c19-53e9-44ee-97d8-f58245ca2382 GET /metrics GetMetrics 200 OK 3.780884801s
- 2017-07-11 14:40:13.599646 I | api: 4d259449-9584-4df3-b09f-4c29edf02f50 GET /metrics GetMetrics (start)
- 2017-07-11 14:40:13.600543 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/227984987
- 2017-07-11 14:40:14.042924 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/968018942
- 2017-07-11 14:40:14.455617 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/402504005
- 2017-07-11 14:40:14.940269 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/288889824
- 2017-07-11 14:40:15.472229 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/809737663
- 2017-07-11 14:40:15.945252 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/140447762
- 2017-07-11 14:40:16.402481 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/460058697
- 2017-07-11 14:40:16.815223 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/432553236
- 2017-07-11 14:40:17.257922 I | api: 4d259449-9584-4df3-b09f-4c29edf02f50 GET /metrics GetMetrics 200 OK 3.65827554s
- 2017-07-11 14:40:18.534061 I | api: 360b4c62-38dc-41df-b703-dc3e32e5b464 GET /metrics GetMetrics (start)
- 2017-07-11 14:40:18.535001 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/256457571
- 2017-07-11 14:40:19.026470 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/792256870
- 2017-07-11 14:40:19.439614 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/161410445
- 2017-07-11 14:40:19.941465 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/264201096
- 2017-07-11 14:40:20.365631 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/720852807
- 2017-07-11 14:40:20.780920 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/317461498
- 2017-07-11 14:40:21.300772 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/111068433
- 2017-07-11 14:40:21.718021 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/999088444
- 2017-07-11 14:40:22.196924 I | api: 360b4c62-38dc-41df-b703-dc3e32e5b464 GET /metrics GetMetrics 200 OK 3.662868887s
- 2017-07-11 14:40:23.461870 I | api: 1a17d1bb-77d4-4e94-9a9c-370915bf074a GET /metrics GetMetrics (start)
- 2017-07-11 14:40:23.462788 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/872643947
- 2017-07-11 14:40:24.044557 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/589147598
- 2017-07-11 14:40:24.477915 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/051139285
- 2017-07-11 14:40:24.898259 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/509930032
- 2017-07-11 14:40:25.444082 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/597081551
- 2017-07-11 14:40:25.881603 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/750288098
- 2017-07-11 14:40:26.236462 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/273799897
- 2017-07-11 14:40:26.641265 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/217744996
- 2017-07-11 14:40:27.091976 I | api: 1a17d1bb-77d4-4e94-9a9c-370915bf074a GET /metrics GetMetrics 200 OK 3.630105641s
- 2017-07-11 14:40:28.396196 I | api: 45fef352-f68a-47cf-8197-ab972076dbc0 GET /metrics GetMetrics (start)
- 2017-07-11 14:40:28.397143 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/598163571
- 2017-07-11 14:40:29.235962 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/121898806
- 2017-07-11 14:40:29.711422 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/613464349
- 2017-07-11 14:40:30.125030 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/493333976
- 2017-07-11 14:40:30.623386 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/068081495
- 2017-07-11 14:40:31.041888 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/652264138
- 2017-07-11 14:40:31.545097 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/914855329
- 2017-07-11 14:40:32.058345 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/745741964
- 2017-07-11 14:40:32.505187 I | api: 45fef352-f68a-47cf-8197-ab972076dbc0 GET /metrics GetMetrics 200 OK 4.109008346s
- 2017-07-11 14:40:33.328642 I | api: c997d697-7091-4c3c-a876-88d36ff2b3a6 GET /metrics GetMetrics (start)
- 2017-07-11 14:40:33.329599 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/852479099
- 2017-07-11 14:40:33.753093 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/490914718
- 2017-07-11 14:40:34.167523 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/206016613
- 2017-07-11 14:40:34.565537 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/872311424
- 2017-07-11 14:40:35.013849 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/981582815
- 2017-07-11 14:40:35.611317 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/373668786
- 2017-07-11 14:40:36.044961 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/900483945
- 2017-07-11 14:40:36.509962 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/099195316
- 2017-07-11 14:40:36.921707 I | api: c997d697-7091-4c3c-a876-88d36ff2b3a6 GET /metrics GetMetrics 200 OK 3.593064613s
- 2017-07-11 14:40:38.257285 I | api: 5782af54-2c8e-4473-9fcc-f3f194edd7c7 GET /metrics GetMetrics (start)
- 2017-07-11 14:40:38.258271 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/209042307
- 2017-07-11 14:40:38.674251 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/384477958
- 2017-07-11 14:40:39.718090 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/585003693
- 2017-07-11 14:40:40.130837 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/969647144
- 2017-07-11 14:40:40.527732 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/835108199
- 2017-07-11 14:40:40.996476 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/913428890
- 2017-07-11 14:40:41.333973 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/058813489
- 2017-07-11 14:40:41.779478 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/181604828
- 2017-07-11 14:40:42.238853 I | api: 5782af54-2c8e-4473-9fcc-f3f194edd7c7 GET /metrics GetMetrics 200 OK 3.981567819s
- 2017-07-11 14:40:43.186441 I | api: 445b064b-1161-41bc-953a-f0f315d7a25f GET /metrics GetMetrics (start)
- 2017-07-11 14:40:43.187599 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/445038987
- 2017-07-11 14:40:43.623629 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/588896110
- 2017-07-11 14:40:44.038611 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/889404405
- 2017-07-11 14:40:44.468036 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/308911312
- 2017-07-11 14:40:44.926032 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/425801199
- 2017-07-11 14:40:45.669488 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/625517698
- 2017-07-11 14:40:46.148034 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/427804665
- 2017-07-11 14:40:46.533721 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/550139652
- 2017-07-11 14:40:47.125358 I | api: 445b064b-1161-41bc-953a-f0f315d7a25f GET /metrics GetMetrics 200 OK 3.93891735s
- 2017-07-11 14:40:48.120710 I | api: 43a51117-2a85-4a6c-a6d6-3ee6069839c0 GET /metrics GetMetrics (start)
- 2017-07-11 14:40:48.121736 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/039438483
- 2017-07-11 14:40:48.547644 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/448701654
- 2017-07-11 14:40:48.968706 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/170624573
- 2017-07-11 14:40:49.412032 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/247895672
- 2017-07-11 14:40:49.889424 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/459278711
- 2017-07-11 14:40:50.307186 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/415014506
- 2017-07-11 14:40:50.765163 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/494615233
- 2017-07-11 14:40:51.148186 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/448610604
- 2017-07-11 14:40:51.611806 I | api: 43a51117-2a85-4a6c-a6d6-3ee6069839c0 GET /metrics GetMetrics 200 OK 3.491110319s
- 2017-07-11 14:40:53.052705 I | api: 8a9b5d07-3071-4a43-9e57-049556e5e415 GET /metrics GetMetrics (start)
- 2017-07-11 14:40:53.053750 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/939478683
- 2017-07-11 14:40:53.471893 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/061153086
- 2017-07-11 14:40:53.911599 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/503497093
- 2017-07-11 14:40:54.315144 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/249194272
- 2017-07-11 14:40:54.738141 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/556461055
- 2017-07-11 14:40:55.150823 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/128857938
- 2017-07-11 14:40:55.863062 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/275392649
- 2017-07-11 14:40:56.211950 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/232946772
- 2017-07-11 14:40:56.741732 I | api: 8a9b5d07-3071-4a43-9e57-049556e5e415 GET /metrics GetMetrics 200 OK 3.689015218s
- 2017-07-11 14:40:57.983921 I | api: 7300356f-e5bb-4b03-abf6-211c3222d8cb GET /metrics GetMetrics (start)
- 2017-07-11 14:40:57.984855 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/595586467
- 2017-07-11 14:40:58.398867 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/305691302
- 2017-07-11 14:40:58.879268 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/757841357
- 2017-07-11 14:40:59.352617 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/492961480
- 2017-07-11 14:40:59.758855 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/348968327
- 2017-07-11 14:41:00.270784 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/256390970
- 2017-07-11 14:41:00.728417 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/976410961
- 2017-07-11 14:41:01.147388 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/433816700
- 2017-07-11 14:41:01.545513 I | api: 7300356f-e5bb-4b03-abf6-211c3222d8cb GET /metrics GetMetrics 200 OK 3.561595104s
- 2017-07-11 14:41:02.915244 I | api: a7edcc98-77d4-4d41-b759-8ed318df321d GET /metrics GetMetrics (start)
- 2017-07-11 14:41:02.916214 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/084864427
- 2017-07-11 14:41:03.358438 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/542926094
- 2017-07-11 14:41:03.823745 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/246334229
- 2017-07-11 14:41:04.244431 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/601651056
- 2017-07-11 14:41:04.644286 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/253017615
- 2017-07-11 14:41:05.116623 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/299436066
- 2017-07-11 14:41:05.723534 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/135897881
- 2017-07-11 14:41:06.150293 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/931230628
- 2017-07-11 14:41:06.596914 I | api: a7edcc98-77d4-4d41-b759-8ed318df321d GET /metrics GetMetrics 200 OK 3.68167225s
- 2017-07-11 14:41:07.845828 I | api: 8c9f993b-e66d-4b8d-8807-0a717097e2f4 GET /metrics GetMetrics (start)
- 2017-07-11 14:41:07.849978 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/977849523
- 2017-07-11 14:41:08.269158 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/033479798
- 2017-07-11 14:41:08.688500 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/148038493
- 2017-07-11 14:41:09.116067 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/462292248
- 2017-07-11 14:41:09.586906 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/626853783
- 2017-07-11 14:41:10.011465 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/042096650
- 2017-07-11 14:41:10.426811 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/591846369
- 2017-07-11 14:41:10.861105 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/521647052
- 2017-07-11 14:41:11.329663 I | api: 8c9f993b-e66d-4b8d-8807-0a717097e2f4 GET /metrics GetMetrics 200 OK 3.483838791s
- 2017-07-11 14:41:12.777731 I | api: 48f83285-6bdc-435b-ac2b-e689c978187b GET /metrics GetMetrics (start)
- 2017-07-11 14:41:12.778959 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/883772603
- 2017-07-11 14:41:13.211696 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/321328350
- 2017-07-11 14:41:13.626543 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/052883109
- 2017-07-11 14:41:14.046115 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/750681536
- 2017-07-11 14:41:14.451520 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/326157855
- 2017-07-11 14:41:14.864500 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/540415730
- 2017-07-11 14:41:15.580611 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/390908841
- 2017-07-11 14:41:16.009767 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/892027636
- 2017-07-11 14:41:16.425800 I | api: 48f83285-6bdc-435b-ac2b-e689c978187b GET /metrics GetMetrics 200 OK 3.648056704s
- 2017-07-11 14:41:17.710404 I | api: c25876e4-90c0-47f7-81d0-02e77cee211a GET /metrics GetMetrics (start)
- 2017-07-11 14:41:17.711335 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/264253379
- 2017-07-11 14:41:18.119010 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/221901382
- 2017-07-11 14:41:18.526040 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/562324205
- 2017-07-11 14:41:18.980304 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/322915176
- 2017-07-11 14:41:19.513384 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/333577639
- 2017-07-11 14:41:19.974123 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/256401114
- 2017-07-11 14:41:20.383555 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/472948849
- 2017-07-11 14:41:20.849895 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/051167516
- 2017-07-11 14:41:21.250353 I | api: c25876e4-90c0-47f7-81d0-02e77cee211a GET /metrics GetMetrics 200 OK 3.539955486s
- 2017-07-11 14:41:22.641823 I | api: bb3af688-9284-466a-92e3-4b7fd3373deb GET /metrics GetMetrics (start)
- 2017-07-11 14:41:22.642768 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/630528971
- 2017-07-11 14:41:23.092708 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/530039470
- 2017-07-11 14:41:23.496450 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/370696245
- 2017-07-11 14:41:23.895083 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/834000912
- 2017-07-11 14:41:24.310691 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/556039727
- 2017-07-11 14:41:24.746679 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/732038594
- 2017-07-11 14:41:25.154680 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/821838905
- 2017-07-11 14:41:25.755812 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/398170180
- 2017-07-11 14:41:26.308455 I | api: bb3af688-9284-466a-92e3-4b7fd3373deb GET /metrics GetMetrics 200 OK 3.666633566s
- 2017-07-11 14:41:27.573872 I | api: ef9c0ef9-73bf-4429-8b4a-4b732e38a0a4 GET /metrics GetMetrics (start)
- 2017-07-11 14:41:27.574807 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/073888979
- 2017-07-11 14:41:27.984631 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/052187158
- 2017-07-11 14:41:28.405209 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/877580413
- 2017-07-11 14:41:28.833346 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/813745080
- 2017-07-11 14:41:29.246164 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/171020215
- 2017-07-11 14:41:29.745600 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/047933354
- 2017-07-11 14:41:30.179331 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/507013889
- 2017-07-11 14:41:30.600946 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/543165036
- 2017-07-11 14:41:31.039634 I | api: ef9c0ef9-73bf-4429-8b4a-4b732e38a0a4 GET /metrics GetMetrics 200 OK 3.465728129s
- 2017-07-11 14:41:32.504718 I | api: e25b98d9-3a9a-4c36-aa0b-d574b3fc942e GET /metrics GetMetrics (start)
- 2017-07-11 14:41:32.505666 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/704807643
- 2017-07-11 14:41:32.958937 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/638966398
- 2017-07-11 14:41:33.363657 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/921124805
- 2017-07-11 14:41:33.775987 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/674751584
- 2017-07-11 14:41:34.197118 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/190923839
- 2017-07-11 14:41:34.704713 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/836383378
- 2017-07-11 14:41:35.195863 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/140943561
- 2017-07-11 14:41:35.791761 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/470202260
- 2017-07-11 14:41:36.235192 I | api: e25b98d9-3a9a-4c36-aa0b-d574b3fc942e GET /metrics GetMetrics 200 OK 3.730486601s
- 2017-07-11 14:41:39.286422 I | api: 0b2fe97b-00ff-43ca-b65d-c1458813d3fe GET /metrics GetMetrics (start)
- 2017-07-11 14:41:39.287337 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/130315235
- 2017-07-11 14:41:39.703133 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/786626022
- 2017-07-11 14:41:40.177758 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/927283725
- 2017-07-11 14:41:40.602029 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/472663560
- 2017-07-11 14:41:41.035287 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/000931271
- 2017-07-11 14:41:41.368459 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/654571642
- 2017-07-11 14:41:41.790236 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/277687697
- 2017-07-11 14:41:42.229522 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/337292220
- 2017-07-11 14:41:42.646198 I | api: 0b2fe97b-00ff-43ca-b65d-c1458813d3fe GET /metrics GetMetrics 200 OK 3.359781473s
- 2017-07-11 14:41:44.216768 I | api: 9d38cd23-5d6c-4336-acfa-87412738f4a8 GET /metrics GetMetrics (start)
- 2017-07-11 14:41:44.217684 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/019935723
- 2017-07-11 14:41:44.665140 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/353969742
- 2017-07-11 14:41:45.090255 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/295106901
- 2017-07-11 14:41:45.679525 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/713615024
- 2017-07-11 14:41:46.313905 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/395478095
- 2017-07-11 14:41:46.753864 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/681994082
- 2017-07-11 14:41:47.209652 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/997174105
- 2017-07-11 14:41:47.768000 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/438752996
- 2017-07-11 14:41:48.187907 I | api: 9d38cd23-5d6c-4336-acfa-87412738f4a8 GET /metrics GetMetrics 200 OK 3.971135695s
- 2017-07-11 14:41:49.145959 I | api: d81fef05-349a-403b-9636-7b098a4959d4 GET /metrics GetMetrics (start)
- 2017-07-11 14:41:49.146766 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/940059891
- 2017-07-11 14:41:49.551165 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/668290998
- 2017-07-11 14:41:49.998368 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/147620765
- 2017-07-11 14:41:50.827649 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/093794392
- 2017-07-11 14:41:51.190124 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/063038423
- 2017-07-11 14:41:51.580901 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/367940938
- 2017-07-11 14:41:52.073843 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/955722785
- 2017-07-11 14:41:52.498206 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/869473548
- 2017-07-11 14:41:52.956848 I | api: d81fef05-349a-403b-9636-7b098a4959d4 GET /metrics GetMetrics 200 OK 3.810888175s
- 2017-07-11 14:41:54.094041 I | api: a755d719-48ae-47e4-b7e0-b49eae7e3def GET /metrics GetMetrics (start)
- 2017-07-11 14:41:54.103825 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/521524987
- 2017-07-11 14:41:54.601352 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/401491998
- 2017-07-11 14:41:55.031711 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/074119397
- 2017-07-11 14:41:55.454407 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/876152576
- 2017-07-11 14:41:56.080911 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/634311263
- 2017-07-11 14:41:56.427773 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/453540914
- 2017-07-11 14:41:56.864615 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/507194857
- 2017-07-11 14:41:57.289414 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/581681204
- 2017-07-11 14:41:57.699156 I | api: a755d719-48ae-47e4-b7e0-b49eae7e3def GET /metrics GetMetrics 200 OK 3.605118813s
- 2017-07-11 14:41:59.009959 I | api: 2d86b8bc-6078-4048-841c-5878f126829d GET /metrics GetMetrics (start)
- 2017-07-11 14:41:59.014339 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/061054979
- 2017-07-11 14:41:59.560077 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/410700166
- 2017-07-11 14:42:00.030190 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/353145645
- 2017-07-11 14:42:00.472261 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/954582696
- 2017-07-11 14:42:00.922787 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/998842343
- 2017-07-11 14:42:01.251119 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/253270042
- 2017-07-11 14:42:01.715776 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/355158705
- 2017-07-11 14:42:02.131822 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/668788316
- 2017-07-11 14:42:02.595113 I | api: 2d86b8bc-6078-4048-841c-5878f126829d GET /metrics GetMetrics 200 OK 3.585157818s
- 2017-07-11 14:42:03.941369 I | api: 71ab3918-23e2-4bd3-b191-46359ea8539c GET /metrics GetMetrics (start)
- 2017-07-11 14:42:03.942382 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/225711115
- 2017-07-11 14:42:04.399304 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/543381998
- 2017-07-11 14:42:04.792750 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/066227829
- 2017-07-11 14:42:05.225499 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/799884624
- 2017-07-11 14:42:05.786231 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/825310319
- 2017-07-11 14:42:06.175079 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/296579330
- 2017-07-11 14:42:07.032704 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/556204153
- 2017-07-11 14:42:07.492184 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/171285380
- 2017-07-11 14:42:08.059256 I | api: 71ab3918-23e2-4bd3-b191-46359ea8539c GET /metrics GetMetrics 200 OK 4.117885002s
- 2017-07-11 14:42:08.872763 I | api: 7030b27a-60da-401c-9363-b30f89bc86e6 GET /metrics GetMetrics (start)
- 2017-07-11 14:42:08.873604 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/666039571
- 2017-07-11 14:42:09.481295 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/097542998
- 2017-07-11 14:42:09.877375 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/497993405
- 2017-07-11 14:42:10.424173 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/388168440
- 2017-07-11 14:42:11.088980 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/594888695
- 2017-07-11 14:42:11.448792 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/408856298
- 2017-07-11 14:42:12.012103 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/298914113
- 2017-07-11 14:42:12.494587 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/749974956
- 2017-07-11 14:42:12.920064 I | api: 7030b27a-60da-401c-9363-b30f89bc86e6 GET /metrics GetMetrics 200 OK 4.04730582s
- 2017-07-11 14:42:13.801615 I | api: f6b9156f-63fa-4ffe-87b9-174c8046eb69 GET /metrics GetMetrics (start)
- 2017-07-11 14:42:13.802587 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/192621851
- 2017-07-11 14:42:14.234010 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/131326910
- 2017-07-11 14:42:14.688830 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/491809285
- 2017-07-11 14:42:15.095122 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/176467872
- 2017-07-11 14:42:15.634736 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/133239423
- 2017-07-11 14:42:16.106528 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/512243666
- 2017-07-11 14:42:16.444528 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/033984265
- 2017-07-11 14:42:16.936427 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/701382868
- 2017-07-11 14:42:17.363487 I | api: f6b9156f-63fa-4ffe-87b9-174c8046eb69 GET /metrics GetMetrics 200 OK 3.561873257s
- 2017-07-11 14:42:18.732416 I | api: dd66aa0d-2dfa-416b-8667-5e9852b1b467 GET /metrics GetMetrics (start)
- 2017-07-11 14:42:18.733293 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/105962531
- 2017-07-11 14:42:19.160081 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/377373990
- 2017-07-11 14:42:19.586674 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/271668301
- 2017-07-11 14:42:20.010205 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/600400200
- 2017-07-11 14:42:20.476084 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/936105479
- 2017-07-11 14:42:20.942700 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/801020858
- 2017-07-11 14:42:21.282800 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/495098321
- 2017-07-11 14:42:21.696537 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/315346684
- 2017-07-11 14:42:22.146478 I | api: dd66aa0d-2dfa-416b-8667-5e9852b1b467 GET /metrics GetMetrics 200 OK 3.414066772s
- 2017-07-11 14:42:23.660697 I | api: a3ad588e-fa02-4c86-98b2-87b406d3ea07 GET /metrics GetMetrics (start)
- 2017-07-11 14:42:23.661603 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/614943275
- 2017-07-11 14:42:24.108224 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/646840206
- 2017-07-11 14:42:24.591182 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/039733141
- 2017-07-11 14:42:25.004169 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/914003440
- 2017-07-11 14:42:25.408213 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/302946447
- 2017-07-11 14:42:25.953640 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/636842658
- 2017-07-11 14:42:26.369471 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/660885913
- 2017-07-11 14:42:26.805632 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/754650660
- 2017-07-11 14:42:27.364497 I | api: a3ad588e-fa02-4c86-98b2-87b406d3ea07 GET /metrics GetMetrics 200 OK 3.703800851s
- 2017-07-11 14:42:28.594081 I | api: 7e3ef00b-df34-40cc-9c02-97add71855c3 GET /metrics GetMetrics (start)
- 2017-07-11 14:42:28.595011 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/998548787
- 2017-07-11 14:42:29.125283 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/248240886
- 2017-07-11 14:42:29.548943 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/925028317
- 2017-07-11 14:42:29.992707 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/717045144
- 2017-07-11 14:42:30.478962 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/904434711
- 2017-07-11 14:42:30.906341 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/113507978
- 2017-07-11 14:42:31.260865 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/017701473
- 2017-07-11 14:42:31.666403 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/917099596
- 2017-07-11 14:42:32.128638 I | api: 7e3ef00b-df34-40cc-9c02-97add71855c3 GET /metrics GetMetrics 200 OK 3.534565176s
- 2017-07-11 14:42:33.523615 I | api: d759cd32-c2b0-4ebb-873f-5a4032f6d03f GET /metrics GetMetrics (start)
- 2017-07-11 14:42:33.524524 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/971257147
- 2017-07-11 14:42:33.962251 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/665759070
- 2017-07-11 14:42:34.380896 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/348051237
- 2017-07-11 14:42:35.096149 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/659083328
- 2017-07-11 14:42:35.603682 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/863027359
- 2017-07-11 14:42:36.083541 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/046618482
- 2017-07-11 14:42:36.439101 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/468518441
- 2017-07-11 14:42:36.908762 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/524671860
- 2017-07-11 14:42:37.424016 I | api: d759cd32-c2b0-4ebb-873f-5a4032f6d03f GET /metrics GetMetrics 200 OK 3.900401584s
- 2017-07-11 14:42:38.453351 I | api: 05dd4c2c-f1d3-4173-ac22-51df164a7106 GET /metrics GetMetrics (start)
- 2017-07-11 14:42:38.454209 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/381636675
- 2017-07-11 14:42:38.847093 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/957411014
- 2017-07-11 14:42:39.260251 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/686204269
- 2017-07-11 14:42:39.707735 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/946097128
- 2017-07-11 14:42:40.154259 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/037202471
- 2017-07-11 14:42:40.582452 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/287472986
- 2017-07-11 14:42:41.102610 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/427546353
- 2017-07-11 14:42:41.443722 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/619620764
- 2017-07-11 14:42:41.836529 I | api: 05dd4c2c-f1d3-4173-ac22-51df164a7106 GET /metrics GetMetrics 200 OK 3.383182893s
- 2017-07-11 14:42:43.383965 I | api: 7d03ec89-4cb3-4b36-855e-b8b7c47fd865 GET /metrics GetMetrics (start)
- 2017-07-11 14:42:43.384834 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/294476363
- 2017-07-11 14:42:43.795771 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/347905326
- 2017-07-11 14:42:44.209693 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/765211317
- 2017-07-11 14:42:44.627054 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/549033104
- 2017-07-11 14:42:45.095415 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/869098159
- 2017-07-11 14:42:45.831108 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/447407682
- 2017-07-11 14:42:46.366696 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/560963257
- 2017-07-11 14:42:46.787580 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/273211076
- 2017-07-11 14:42:47.346329 I | api: 7d03ec89-4cb3-4b36-855e-b8b7c47fd865 GET /metrics GetMetrics 200 OK 3.962354423s
- 2017-07-11 14:42:48.315543 I | api: 9c23cad0-6c0c-4c04-9318-1c554f2b4278 GET /metrics GetMetrics (start)
- 2017-07-11 14:42:48.316480 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/571547987
- 2017-07-11 14:42:48.838844 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/196064918
- 2017-07-11 14:42:49.265120 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/881551613
- 2017-07-11 14:42:49.668252 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/394790456
- 2017-07-11 14:42:50.471148 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/385488951
- 2017-07-11 14:42:50.875586 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/780946986
- 2017-07-11 14:42:51.409597 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/418403713
- 2017-07-11 14:42:51.807125 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/996371180
- 2017-07-11 14:42:52.230111 I | api: 9c23cad0-6c0c-4c04-9318-1c554f2b4278 GET /metrics GetMetrics 200 OK 3.914571083s
- 2017-07-11 14:42:53.245562 I | api: 468e25d5-cda9-4c55-a2f4-677719db30d5 GET /metrics GetMetrics (start)
- 2017-07-11 14:42:53.246520 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/145313115
- 2017-07-11 14:42:53.741152 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/156942590
- 2017-07-11 14:42:54.235446 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/830747205
- 2017-07-11 14:42:54.648831 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/259121888
- 2017-07-11 14:42:55.055414 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/582295743
- 2017-07-11 14:42:55.652303 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/774367506
- 2017-07-11 14:42:56.087716 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/415594825
- 2017-07-11 14:42:56.443097 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/082457108
- 2017-07-11 14:42:56.886220 I | api: 468e25d5-cda9-4c55-a2f4-677719db30d5 GET /metrics GetMetrics 200 OK 3.640665876s
- 2017-07-11 14:42:58.173519 I | api: 86a1f399-f09d-4721-b89b-6fd5acc1761b GET /metrics GetMetrics (start)
- 2017-07-11 14:42:58.174421 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/956686947
- 2017-07-11 14:42:58.767934 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/883924582
- 2017-07-11 14:42:59.205653 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/351569549
- 2017-07-11 14:42:59.692485 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/641973384
- 2017-07-11 14:43:00.134609 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/487596615
- 2017-07-11 14:43:00.574863 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/468563194
- 2017-07-11 14:43:01.014490 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/002715153
- 2017-07-11 14:43:01.395026 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/522390076
- 2017-07-11 14:43:01.886544 I | api: 86a1f399-f09d-4721-b89b-6fd5acc1761b GET /metrics GetMetrics 200 OK 3.713026869s
- 2017-07-11 14:43:03.105690 I | api: 375ec64b-6cb2-4d3a-b3ac-72b136fd4c55 GET /metrics GetMetrics (start)
- 2017-07-11 14:43:03.106543 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/880714347
- 2017-07-11 14:43:03.579101 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/939971790
- 2017-07-11 14:43:04.025993 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/511328725
- 2017-07-11 14:43:04.432195 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/344739632
- 2017-07-11 14:43:04.846236 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/852811471
- 2017-07-11 14:43:05.273710 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/681636834
- 2017-07-11 14:43:05.845387 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/888934361
- 2017-07-11 14:43:06.281580 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/261971300
- 2017-07-11 14:43:06.635663 I | api: 375ec64b-6cb2-4d3a-b3ac-72b136fd4c55 GET /metrics GetMetrics 200 OK 3.529963668s
- 2017-07-11 14:43:08.036097 I | api: 14423538-5af0-4602-b950-e4df275a29c4 GET /metrics GetMetrics (start)
- 2017-07-11 14:43:08.038179 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/560942963
- 2017-07-11 14:43:08.460711 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/184077878
- 2017-07-11 14:43:08.901317 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/276885533
- 2017-07-11 14:43:09.473424 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/850089176
- 2017-07-11 14:43:09.941554 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/752583767
- 2017-07-11 14:43:10.367706 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/246315978
- 2017-07-11 14:43:10.883206 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/747643041
- 2017-07-11 14:43:11.298145 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/686275980
- 2017-07-11 14:43:11.704130 I | api: 14423538-5af0-4602-b950-e4df275a29c4 GET /metrics GetMetrics 200 OK 3.668048999s
- 2017-07-11 14:43:12.963131 I | api: 67e6bfeb-c061-45ad-aff4-c2ab87f7a9eb GET /metrics GetMetrics (start)
- 2017-07-11 14:43:12.964057 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/512231803
- 2017-07-11 14:43:13.408325 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/302093982
- 2017-07-11 14:43:13.835059 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/321713509
- 2017-07-11 14:43:14.256838 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/583574400
- 2017-07-11 14:43:14.683259 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/453097695
- 2017-07-11 14:43:15.101186 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/326964402
- 2017-07-11 14:43:15.628487 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/567797865
- 2017-07-11 14:43:16.056876 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/446224564
- 2017-07-11 14:43:16.428640 I | api: 67e6bfeb-c061-45ad-aff4-c2ab87f7a9eb GET /metrics GetMetrics 200 OK 3.465509945s
- 2017-07-11 14:43:17.895227 I | api: 621666c6-afaf-4402-8a4b-fbb2df3fd117 GET /metrics GetMetrics (start)
- 2017-07-11 14:43:17.896232 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/786962563
- 2017-07-11 14:43:18.313220 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/467475974
- 2017-07-11 14:43:18.722938 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/479076269
- 2017-07-11 14:43:19.158690 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/747615016
- 2017-07-11 14:43:19.611772 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/908569191
- 2017-07-11 14:43:20.093518 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/226254490
- 2017-07-11 14:43:20.523323 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/601055025
- 2017-07-11 14:43:20.954204 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/447462108
- 2017-07-11 14:43:21.566028 I | api: 621666c6-afaf-4402-8a4b-fbb2df3fd117 GET /metrics GetMetrics 200 OK 3.670804912s
- 2017-07-11 14:43:22.826729 I | api: 4a78c2eb-8e4e-4c68-804b-06826374b0fc GET /metrics GetMetrics (start)
- 2017-07-11 14:43:22.827582 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/499621003
- 2017-07-11 14:43:23.267448 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/441365614
- 2017-07-11 14:43:23.745137 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/740666101
- 2017-07-11 14:43:24.160745 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/612756944
- 2017-07-11 14:43:24.573934 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/281532143
- 2017-07-11 14:43:25.014094 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/386533250
- 2017-07-11 14:43:25.539400 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/249986297
- 2017-07-11 14:43:25.972120 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/181414916
- 2017-07-11 14:43:26.309301 I | api: 4a78c2eb-8e4e-4c68-804b-06826374b0fc GET /metrics GetMetrics 200 OK 3.482560409s
- 2017-07-11 14:43:27.754966 I | api: e1a4cfe9-17e0-403e-a08e-7ec802bd6747 GET /metrics GetMetrics (start)
- 2017-07-11 14:43:27.755784 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/324846483
- 2017-07-11 14:43:28.404451 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/032790486
- 2017-07-11 14:43:28.805729 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/361750333
- 2017-07-11 14:43:29.233512 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/330977656
- 2017-07-11 14:43:29.674557 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/681233015
- 2017-07-11 14:43:30.106692 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/111045482
- 2017-07-11 14:43:30.547372 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/782279617
- 2017-07-11 14:43:31.012454 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/578393644
- 2017-07-11 14:43:31.362384 I | api: e1a4cfe9-17e0-403e-a08e-7ec802bd6747 GET /metrics GetMetrics 200 OK 3.607421834s
- 2017-07-11 14:43:32.685180 I | api: 04c3026d-1fde-4bd0-9eb3-c93bb37958aa GET /metrics GetMetrics (start)
- 2017-07-11 14:43:32.686405 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/084047771
- 2017-07-11 14:43:33.128959 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/703230526
- 2017-07-11 14:43:33.571005 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/921844357
- 2017-07-11 14:43:34.000914 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/091168800
- 2017-07-11 14:43:34.388076 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/515755263
- 2017-07-11 14:43:34.803001 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/724490834
- 2017-07-11 14:43:35.251630 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/000466313
- 2017-07-11 14:43:35.767404 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/023004500
- 2017-07-11 14:43:36.270517 I | api: 04c3026d-1fde-4bd0-9eb3-c93bb37958aa GET /metrics GetMetrics 200 OK 3.585338537s
- 2017-07-11 14:43:37.616846 I | api: f7ad1bc6-b297-42e1-b3be-ffae86baaf93 GET /metrics GetMetrics (start)
- 2017-07-11 14:43:37.617263 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/485356195
- 2017-07-11 14:43:38.045796 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/891041702
- 2017-07-11 14:43:38.455552 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/621434573
- 2017-07-11 14:43:38.917062 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/436926920
- 2017-07-11 14:43:39.365866 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/767284871
- 2017-07-11 14:43:39.779108 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/503765050
- 2017-07-11 14:43:40.240661 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/133254225
- 2017-07-11 14:43:40.667893 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/006705020
- 2017-07-11 14:43:41.110875 I | api: f7ad1bc6-b297-42e1-b3be-ffae86baaf93 GET /metrics GetMetrics 200 OK 3.494032314s
- 2017-07-11 14:43:42.547779 I | api: 974e8ccc-d8b4-42ca-8a2f-d17cfc60bb9e GET /metrics GetMetrics (start)
- 2017-07-11 14:43:42.548723 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/901818027
- 2017-07-11 14:43:42.992385 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/005409806
- 2017-07-11 14:43:43.428302 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/519783957
- 2017-07-11 14:43:43.867661 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/221488752
- 2017-07-11 14:43:44.518833 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/176072975
- 2017-07-11 14:43:45.024161 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/112806178
- 2017-07-11 14:43:45.691111 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/337093145
- 2017-07-11 14:43:46.124618 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/532602532
- 2017-07-11 14:43:46.492413 I | api: 974e8ccc-d8b4-42ca-8a2f-d17cfc60bb9e GET /metrics GetMetrics 200 OK 3.944631862s
- 2017-07-11 14:43:47.477909 I | api: 05ff80c2-531f-4710-ad25-4c5c18df16b2 GET /metrics GetMetrics (start)
- 2017-07-11 14:43:47.478808 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/288480179
- 2017-07-11 14:43:48.093118 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/845194102
- 2017-07-11 14:43:48.508455 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/958460509
- 2017-07-11 14:43:48.931115 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/379680280
- 2017-07-11 14:43:49.427789 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/282768535
- 2017-07-11 14:43:49.849219 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/102592266
- 2017-07-11 14:43:50.462340 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/714313441
- 2017-07-11 14:43:50.893721 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/452364492
- 2017-07-11 14:43:51.249233 I | api: 05ff80c2-531f-4710-ad25-4c5c18df16b2 GET /metrics GetMetrics 200 OK 3.771328611s
- 2017-07-11 14:43:52.403769 I | api: 32f213ed-44d0-436f-91e7-eff7dcb1bb86 GET /metrics GetMetrics (start)
- 2017-07-11 14:43:52.404160 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/202486203
- 2017-07-11 14:43:53.121264 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/097366494
- 2017-07-11 14:43:53.544334 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/220915621
- 2017-07-11 14:43:53.973915 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/207468224
- 2017-07-11 14:43:54.391471 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/214022943
- 2017-07-11 14:43:54.879755 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/490734578
- 2017-07-11 14:43:55.563850 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/171693225
- 2017-07-11 14:43:56.006235 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/555371508
- 2017-07-11 14:43:56.570847 I | api: 32f213ed-44d0-436f-91e7-eff7dcb1bb86 GET /metrics GetMetrics 200 OK 4.167079922s
- 2017-07-11 14:43:57.336583 I | api: 724febda-be71-4342-b85a-a5c3f3f9367b GET /metrics GetMetrics (start)
- 2017-07-11 14:43:57.337510 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/026836675
- 2017-07-11 14:43:57.857928 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/210013510
- 2017-07-11 14:43:58.293020 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/902948845
- 2017-07-11 14:43:58.697244 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/293100136
- 2017-07-11 14:43:59.183818 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/261693607
- 2017-07-11 14:43:59.601525 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/190470106
- 2017-07-11 14:44:00.046178 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/040238961
- 2017-07-11 14:44:00.559252 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/589982236
- 2017-07-11 14:44:01.046356 I | api: 724febda-be71-4342-b85a-a5c3f3f9367b GET /metrics GetMetrics 200 OK 3.709776469s
- 2017-07-11 14:44:02.266736 I | api: 0a151d10-aaa7-42b8-9e11-5c55f694df80 GET /metrics GetMetrics (start)
- 2017-07-11 14:44:02.267688 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/052519627
- 2017-07-11 14:44:02.738762 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/690228142
- 2017-07-11 14:44:03.181112 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/929287989
- 2017-07-11 14:44:03.573717 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/891075856
- 2017-07-11 14:44:04.011635 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/550613807
- 2017-07-11 14:44:04.423899 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/094740162
- 2017-07-11 14:44:04.844183 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/110885177
- 2017-07-11 14:44:05.270606 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/447106372
- 2017-07-11 14:44:05.834585 I | api: 0a151d10-aaa7-42b8-9e11-5c55f694df80 GET /metrics GetMetrics 200 OK 3.567847002s
- 2017-07-11 14:44:07.196984 I | api: 5da4020e-2b00-49d1-b77c-c7a00b340e87 GET /metrics GetMetrics (start)
- 2017-07-11 14:44:07.197912 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/534109139
- 2017-07-11 14:44:07.630015 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/481597206
- 2017-07-11 14:44:08.170085 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/935761277
- 2017-07-11 14:44:08.957142 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/767838392
- 2017-07-11 14:44:09.369439 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/104340151
- 2017-07-11 14:44:09.809144 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/419733674
- 2017-07-11 14:44:10.273170 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/381080577
- 2017-07-11 14:44:11.268441 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/570856812
- 2017-07-11 14:44:11.592682 I | api: 5da4020e-2b00-49d1-b77c-c7a00b340e87 GET /metrics GetMetrics 200 OK 4.395703322s
- 2017-07-11 14:44:12.125198 I | api: 6d0ed4f5-e534-47bd-bd11-191fa24db440 GET /metrics GetMetrics (start)
- 2017-07-11 14:44:12.126169 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/603733979
- 2017-07-11 14:44:12.555157 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/831349630
- 2017-07-11 14:44:13.015957 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/822748357
- 2017-07-11 14:44:13.435302 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/914805600
- 2017-07-11 14:44:13.867039 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/574956863
- 2017-07-11 14:44:14.291681 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/538091410
- 2017-07-11 14:44:15.010050 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/102195145
- 2017-07-11 14:44:15.416109 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/121444500
- 2017-07-11 14:44:16.012771 I | api: 6d0ed4f5-e534-47bd-bd11-191fa24db440 GET /metrics GetMetrics 200 OK 3.887571617s
- 2017-07-11 14:44:17.056479 I | api: be150ec6-f0a9-4dd6-8cc1-576e9e32926f GET /metrics GetMetrics (start)
- 2017-07-11 14:44:17.057514 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/863547107
- 2017-07-11 14:44:17.671947 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/057231078
- 2017-07-11 14:44:18.084458 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/199386893
- 2017-07-11 14:44:18.644830 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/308611848
- 2017-07-11 14:44:19.264872 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/550726855
- 2017-07-11 14:44:19.687409 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/826934650
- 2017-07-11 14:44:20.139553 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/293173393
- 2017-07-11 14:44:20.554748 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/480250556
- 2017-07-11 14:44:20.999358 I | api: be150ec6-f0a9-4dd6-8cc1-576e9e32926f GET /metrics GetMetrics 200 OK 3.942882349s
- 2017-07-11 14:44:21.986105 I | api: 01d1e033-a99d-410a-bc9a-b1d6603bb5ed GET /metrics GetMetrics (start)
- 2017-07-11 14:44:21.987004 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/541597931
- 2017-07-11 14:44:22.436756 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/099006798
- 2017-07-11 14:44:22.850781 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/243698261
- 2017-07-11 14:44:23.273642 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/423592368
- 2017-07-11 14:44:23.691613 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/297603407
- 2017-07-11 14:44:24.144110 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/890456674
- 2017-07-11 14:44:24.591769 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/324812377
- 2017-07-11 14:44:25.032437 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/097075684
- 2017-07-11 14:44:25.610695 I | api: 01d1e033-a99d-410a-bc9a-b1d6603bb5ed GET /metrics GetMetrics 200 OK 3.624594953s
- 2017-07-11 14:44:26.916303 I | api: 8be039f0-5b1f-4a9f-b247-56ccbd73bda9 GET /metrics GetMetrics (start)
- 2017-07-11 14:44:26.926644 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/031238131
- 2017-07-11 14:44:27.431302 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/789821622
- 2017-07-11 14:44:27.847235 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/618893981
- 2017-07-11 14:44:28.327475 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/266314072
- 2017-07-11 14:44:28.736042 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/244013783
- 2017-07-11 14:44:29.168367 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/797338698
- 2017-07-11 14:44:29.593760 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/740089633
- 2017-07-11 14:44:30.025777 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/679566860
- 2017-07-11 14:44:30.450892 I | api: 8be039f0-5b1f-4a9f-b247-56ccbd73bda9 GET /metrics GetMetrics 200 OK 3.534594268s
- 2017-07-11 14:44:31.846218 I | api: 27a9358a-59d9-40a2-a0e3-6f65cb59178f GET /metrics GetMetrics (start)
- 2017-07-11 14:44:31.847058 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/763734011
- 2017-07-11 14:44:32.269982 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/092057374
- 2017-07-11 14:44:32.692599 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/640176101
- 2017-07-11 14:44:33.110265 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/162349056
- 2017-07-11 14:44:33.522435 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/029045599
- 2017-07-11 14:44:33.979497 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/987695922
- 2017-07-11 14:44:34.406084 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/015573737
- 2017-07-11 14:44:34.827430 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/134886708
- 2017-07-11 14:44:35.268300 I | api: 27a9358a-59d9-40a2-a0e3-6f65cb59178f GET /metrics GetMetrics 200 OK 3.422081424s
- 2017-07-11 14:44:36.775819 I | api: e545f439-4ff5-4e93-95db-9359add331ac GET /metrics GetMetrics (start)
- 2017-07-11 14:44:36.776539 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/809706755
- 2017-07-11 14:44:37.266629 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/232916614
- 2017-07-11 14:44:37.759319 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/727914541
- 2017-07-11 14:44:38.207735 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/590258088
- 2017-07-11 14:44:38.681976 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/819068647
- 2017-07-11 14:44:39.109224 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/194848026
- 2017-07-11 14:44:39.513441 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/098492337
- 2017-07-11 14:44:39.930694 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/148527452
- 2017-07-11 14:44:40.369866 I | api: e545f439-4ff5-4e93-95db-9359add331ac GET /metrics GetMetrics 200 OK 3.594048182s
- 2017-07-11 14:44:41.705405 I | api: 4cf4c51b-690c-4918-a027-2d49b978b303 GET /metrics GetMetrics (start)
- 2017-07-11 14:44:41.705748 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/763452171
- 2017-07-11 14:44:42.134786 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/739732718
- 2017-07-11 14:44:42.569181 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/751580021
- 2017-07-11 14:44:42.993971 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/767816784
- 2017-07-11 14:44:43.430659 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/122988399
- 2017-07-11 14:44:44.122955 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/331587074
- 2017-07-11 14:44:44.565391 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/999980921
- 2017-07-11 14:44:44.987091 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/990204036
- 2017-07-11 14:44:45.414958 I | api: 4cf4c51b-690c-4918-a027-2d49b978b303 GET /metrics GetMetrics 200 OK 3.709554405s
- 2017-07-11 14:44:46.635031 I | api: 14e47dac-66bb-4089-b3ec-0b8400d90540 GET /metrics GetMetrics (start)
- 2017-07-11 14:44:46.635383 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/291317267
- 2017-07-11 14:44:47.087281 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/080038998
- 2017-07-11 14:44:47.523721 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/084563389
- 2017-07-11 14:44:47.962149 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/760288248
- 2017-07-11 14:44:48.381520 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/940706039
- 2017-07-11 14:44:48.802145 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/621466090
- 2017-07-11 14:44:49.226285 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/984119873
- 2017-07-11 14:44:49.660022 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/417284268
- 2017-07-11 14:44:50.108293 I | api: 14e47dac-66bb-4089-b3ec-0b8400d90540 GET /metrics GetMetrics 200 OK 3.473263273s
- 2017-07-11 14:44:51.564672 I | api: 24e6900a-3666-4ca0-adfd-539b81cf50dc GET /metrics GetMetrics (start)
- 2017-07-11 14:44:51.565009 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/667989019
- 2017-07-11 14:44:52.022593 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/676200638
- 2017-07-11 14:44:52.509885 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/074914053
- 2017-07-11 14:44:52.943340 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/751003808
- 2017-07-11 14:44:53.375110 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/885046655
- 2017-07-11 14:44:53.914341 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/759356114
- 2017-07-11 14:44:54.331047 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/698054153
- 2017-07-11 14:44:55.124277 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/049938388
- 2017-07-11 14:44:55.691401 I | api: 24e6900a-3666-4ca0-adfd-539b81cf50dc GET /metrics GetMetrics 200 OK 4.12673943s
- 2017-07-11 14:44:56.494378 I | api: d059074e-e835-4301-a680-c607dc2bdca3 GET /metrics GetMetrics (start)
- 2017-07-11 14:44:56.495288 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/746643747
- 2017-07-11 14:44:57.061650 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/114740262
- 2017-07-11 14:44:57.514148 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/277291853
- 2017-07-11 14:44:57.943441 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/949088328
- 2017-07-11 14:44:58.444607 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/097286407
- 2017-07-11 14:44:58.848452 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/432122042
- 2017-07-11 14:44:59.465383 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/782803153
- 2017-07-11 14:44:59.912919 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/138792956
- 2017-07-11 14:45:00.378858 I | api: d059074e-e835-4301-a680-c607dc2bdca3 GET /metrics GetMetrics 200 OK 3.884483546s
- 2017-07-11 14:45:01.423674 I | api: b0ee8662-5260-46c0-8b14-a71911c538c7 GET /metrics GetMetrics (start)
- 2017-07-11 14:45:01.424029 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/737139499
- 2017-07-11 14:45:02.233092 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/255389838
- 2017-07-11 14:45:02.650780 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/640445589
- 2017-07-11 14:45:03.063135 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/429297392
- 2017-07-11 14:45:03.479867 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/905951631
- 2017-07-11 14:45:03.960552 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/163534242
- 2017-07-11 14:45:04.388823 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/245283993
- 2017-07-11 14:45:04.792402 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/969729316
- 2017-07-11 14:45:05.323935 I | api: b0ee8662-5260-46c0-8b14-a71911c538c7 GET /metrics GetMetrics 200 OK 3.900261122s
- 2017-07-11 14:45:06.353722 I | api: 0f6af833-8801-49f9-8e0b-5354a0d7c024 GET /metrics GetMetrics (start)
- 2017-07-11 14:45:06.354542 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/008003635
- 2017-07-11 14:45:06.755243 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/944901622
- 2017-07-11 14:45:07.252881 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/865970397
- 2017-07-11 14:45:07.777216 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/544227992
- 2017-07-11 14:45:08.297067 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/164118807
- 2017-07-11 14:45:08.710466 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/519298954
- 2017-07-11 14:45:09.191723 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/836188513
- 2017-07-11 14:45:09.611009 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/200793932
- 2017-07-11 14:45:10.049444 I | api: 0f6af833-8801-49f9-8e0b-5354a0d7c024 GET /metrics GetMetrics 200 OK 3.695724235s
- 2017-07-11 14:45:11.353556 I | api: 2e56f9c0-6aad-4c90-9e41-16b4843a9ad7 GET /metrics GetMetrics (start)
- 2017-07-11 14:45:11.354511 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/516594235
- 2017-07-11 14:45:11.696129 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/515487326
- 2017-07-11 14:45:12.174596 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/952788005
- 2017-07-11 14:45:12.948848 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/153542976
- 2017-07-11 14:45:13.371833 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/855149983
- 2017-07-11 14:45:13.791436 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/161487986
- 2017-07-11 14:45:14.234938 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/023648553
- 2017-07-11 14:45:14.644597 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/246318708
- 2017-07-11 14:45:15.101335 I | api: 2e56f9c0-6aad-4c90-9e41-16b4843a9ad7 GET /metrics GetMetrics 200 OK 3.74775612s
- 2017-07-11 14:45:16.280284 I | api: c6778dc4-33e0-4304-841c-dbfc0f48ce01 GET /metrics GetMetrics (start)
- 2017-07-11 14:45:16.281218 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/327827779
- 2017-07-11 14:45:16.620747 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/952787398
- 2017-07-11 14:45:17.065082 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/682709613
- 2017-07-11 14:45:17.540997 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/015503592
- 2017-07-11 14:45:18.094723 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/966863655
- 2017-07-11 14:45:18.522483 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/917792858
- 2017-07-11 14:45:19.311646 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/202951153
- 2017-07-11 14:45:19.730887 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/298185884
- 2017-07-11 14:45:20.178630 I | api: c6778dc4-33e0-4304-841c-dbfc0f48ce01 GET /metrics GetMetrics 200 OK 3.898349539s
- 2017-07-11 14:45:21.207200 I | api: 62c407bc-8bf6-4acb-a3fb-8fb240a9a4bc GET /metrics GetMetrics (start)
- 2017-07-11 14:45:21.208611 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/401342283
- 2017-07-11 14:45:21.573255 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/603828270
- 2017-07-11 14:45:22.001118 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/701787061
- 2017-07-11 14:45:22.402819 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/585450384
- 2017-07-11 14:45:23.028470 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/634141103
- 2017-07-11 14:45:23.465897 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/520309058
- 2017-07-11 14:45:23.870640 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/552369081
- 2017-07-11 14:45:24.330084 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/919466436
- 2017-07-11 14:45:24.742874 I | api: 62c407bc-8bf6-4acb-a3fb-8fb240a9a4bc GET /metrics GetMetrics 200 OK 3.535669668s
- 2017-07-11 14:45:26.138928 I | api: 348141dd-682c-47cf-baff-81080b754139 GET /metrics GetMetrics (start)
- 2017-07-11 14:45:26.139841 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/942063187
- 2017-07-11 14:45:26.563318 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/144444310
- 2017-07-11 14:45:27.075324 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/952812029
- 2017-07-11 14:45:27.566934 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/026919224
- 2017-07-11 14:45:28.001086 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/549968183
- 2017-07-11 14:45:28.414404 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/179275562
- 2017-07-11 14:45:29.016768 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/844518017
- 2017-07-11 14:45:29.436123 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/045006828
- 2017-07-11 14:45:29.840315 I | api: 348141dd-682c-47cf-baff-81080b754139 GET /metrics GetMetrics 200 OK 3.701392548s
- 2017-07-11 14:45:31.068658 I | api: 5b84ed9d-0868-4c89-ac42-205d140e322b GET /metrics GetMetrics (start)
- 2017-07-11 14:45:31.069464 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/724237403
- 2017-07-11 14:45:31.445688 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/856491518
- 2017-07-11 14:45:31.851094 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/588505413
- 2017-07-11 14:45:32.373424 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/399509472
- 2017-07-11 14:45:32.782138 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/644912575
- 2017-07-11 14:45:33.209582 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/416279058
- 2017-07-11 14:45:33.684669 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/839057993
- 2017-07-11 14:45:34.136222 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/849356564
- 2017-07-11 14:45:34.542822 I | api: 5b84ed9d-0868-4c89-ac42-205d140e322b GET /metrics GetMetrics 200 OK 3.47416193s
- 2017-07-11 14:45:35.997519 I | api: 4c51ca0b-5b7b-478e-8df7-fa0f77f57767 GET /metrics GetMetrics (start)
- 2017-07-11 14:45:35.998382 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/863772003
- 2017-07-11 14:45:36.387412 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/574591334
- 2017-07-11 14:45:36.803961 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/530822029
- 2017-07-11 14:45:37.365471 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/124158344
- 2017-07-11 14:45:37.834604 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/445101895
- 2017-07-11 14:45:38.263316 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/387119098
- 2017-07-11 14:45:38.677336 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/156085009
- 2017-07-11 14:45:39.104035 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/546807612
- 2017-07-11 14:45:39.785284 I | api: 4c51ca0b-5b7b-478e-8df7-fa0f77f57767 GET /metrics GetMetrics 200 OK 3.787766703s
- 2017-07-11 14:45:40.926049 I | api: 9c7da8fe-b774-4f3a-89d5-a63f69cf8504 GET /metrics GetMetrics (start)
- 2017-07-11 14:45:40.926952 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/204302699
- 2017-07-11 14:45:41.386048 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/877895118
- 2017-07-11 14:45:41.724516 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/036109013
- 2017-07-11 14:45:42.158301 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/970461744
- 2017-07-11 14:45:42.717199 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/173473743
- 2017-07-11 14:45:43.161979 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/744661218
- 2017-07-11 14:45:43.676840 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/975507161
- 2017-07-11 14:45:44.198420 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/943676516
- 2017-07-11 14:45:44.621341 I | api: 9c7da8fe-b774-4f3a-89d5-a63f69cf8504 GET /metrics GetMetrics 200 OK 3.695290983s
- 2017-07-11 14:45:45.855971 I | api: 099d77f0-460d-49e3-87f5-d31ec4f6fb6e GET /metrics GetMetrics (start)
- 2017-07-11 14:45:45.856864 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/921370739
- 2017-07-11 14:45:46.286316 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/016149814
- 2017-07-11 14:45:46.623963 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/791281437
- 2017-07-11 14:45:47.040623 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/026434008
- 2017-07-11 14:45:47.512845 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/349657431
- 2017-07-11 14:45:48.151457 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/530958538
- 2017-07-11 14:45:48.645633 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/382536097
- 2017-07-11 14:45:49.086375 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/332763788
- 2017-07-11 14:45:49.622456 I | api: 099d77f0-460d-49e3-87f5-d31ec4f6fb6e GET /metrics GetMetrics 200 OK 3.766488857s
- 2017-07-11 14:45:50.786298 I | api: 99786a1b-44af-4bdd-a19d-c12542a8b5b5 GET /metrics GetMetrics (start)
- 2017-07-11 14:45:50.786623 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/330264187
- 2017-07-11 14:45:51.229847 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/965686174
- 2017-07-11 14:45:51.656340 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/310818917
- 2017-07-11 14:45:52.084904 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/075216000
- 2017-07-11 14:45:52.482974 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/838160351
- 2017-07-11 14:45:53.035345 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/724459442
- 2017-07-11 14:45:53.817369 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/078770537
- 2017-07-11 14:45:54.266955 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/614892468
- 2017-07-11 14:45:54.687920 I | api: 99786a1b-44af-4bdd-a19d-c12542a8b5b5 GET /metrics GetMetrics 200 OK 3.901622106s
- 2017-07-11 14:45:55.713138 I | api: 68210bf2-949e-466c-98a4-2c37132611c9 GET /metrics GetMetrics (start)
- 2017-07-11 14:45:55.713921 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/142163843
- 2017-07-11 14:45:56.249071 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/975067910
- 2017-07-11 14:45:56.606137 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/569812141
- 2017-07-11 14:45:57.043176 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/724025896
- 2017-07-11 14:45:57.773054 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/985120615
- 2017-07-11 14:45:58.204132 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/521516442
- 2017-07-11 14:45:58.780132 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/854493233
- 2017-07-11 14:45:59.203123 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/697852892
- 2017-07-11 14:45:59.685864 I | api: 68210bf2-949e-466c-98a4-2c37132611c9 GET /metrics GetMetrics 200 OK 3.972729095s
- 2017-07-11 14:46:00.642129 I | api: c332f2c3-9426-4d77-a46c-d52d587309a1 GET /metrics GetMetrics (start)
- 2017-07-11 14:46:00.642969 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/513888139
- 2017-07-11 14:46:01.145894 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/485303662
- 2017-07-11 14:46:01.503535 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/642863093
- 2017-07-11 14:46:01.928347 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/875287248
- 2017-07-11 14:46:02.496108 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/383233519
- 2017-07-11 14:46:02.981161 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/567948418
- 2017-07-11 14:46:03.450545 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/771854329
- 2017-07-11 14:46:03.871396 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/302295812
- 2017-07-11 14:46:04.321634 I | api: c332f2c3-9426-4d77-a46c-d52d587309a1 GET /metrics GetMetrics 200 OK 3.679503498s
- 2017-07-11 14:46:05.572291 I | api: 7eeeacca-33d9-4149-8565-4ed0a550919b GET /metrics GetMetrics (start)
- 2017-07-11 14:46:05.573049 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/430844563
- 2017-07-11 14:46:05.997550 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/064883414
- 2017-07-11 14:46:06.342574 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/874002493
- 2017-07-11 14:46:06.752130 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/770130552
- 2017-07-11 14:46:07.278827 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/070538615
- 2017-07-11 14:46:07.753340 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/155100266
- 2017-07-11 14:46:08.214884 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/469006529
- 2017-07-11 14:46:08.660095 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/045031724
- 2017-07-11 14:46:09.110907 I | api: 7eeeacca-33d9-4149-8565-4ed0a550919b GET /metrics GetMetrics 200 OK 3.538620093s
- 2017-07-11 14:46:10.502379 I | api: 59828a33-2e85-402d-86b9-8becda489135 GET /metrics GetMetrics (start)
- 2017-07-11 14:46:10.503299 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/883580059
- 2017-07-11 14:46:10.945017 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/949573950
- 2017-07-11 14:46:11.375445 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/347428229
- 2017-07-11 14:46:11.795640 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/733810464
- 2017-07-11 14:46:12.270382 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/127184383
- 2017-07-11 14:46:12.732251 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/200530770
- 2017-07-11 14:46:13.255048 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/649963145
- 2017-07-11 14:46:13.700880 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/339343956
- 2017-07-11 14:46:14.162154 I | api: 59828a33-2e85-402d-86b9-8becda489135 GET /metrics GetMetrics 200 OK 3.659763045s
- 2017-07-11 14:46:15.422007 I | api: 9ea0100a-9fe9-4146-86be-4e806ca54a47 GET /metrics GetMetrics (start)
- 2017-07-11 14:46:15.423161 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/017799587
- 2017-07-11 14:46:15.871066 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/021548198
- 2017-07-11 14:46:16.373306 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/004359117
- 2017-07-11 14:46:16.834444 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/673365704
- 2017-07-11 14:46:17.307887 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/590955399
- 2017-07-11 14:46:17.782142 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/243524922
- 2017-07-11 14:46:18.295699 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/450767697
- 2017-07-11 14:46:18.746318 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/342511740
- 2017-07-11 14:46:19.215464 I | api: 9ea0100a-9fe9-4146-86be-4e806ca54a47 GET /metrics GetMetrics 200 OK 3.793449947s
- 2017-07-11 14:46:20.352425 I | api: b4181dd2-8c8c-4669-8a89-017fbcae44a5 GET /metrics GetMetrics (start)
- 2017-07-11 14:46:20.353326 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/322623915
- 2017-07-11 14:46:20.876537 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/853666062
- 2017-07-11 14:46:21.354332 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/535546133
- 2017-07-11 14:46:21.736264 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/262750576
- 2017-07-11 14:46:22.207230 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/231169551
- 2017-07-11 14:46:22.671142 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/225234466
- 2017-07-11 14:46:23.154502 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/466222873
- 2017-07-11 14:46:23.894607 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/180739492
- 2017-07-11 14:46:24.370196 I | api: b4181dd2-8c8c-4669-8a89-017fbcae44a5 GET /metrics GetMetrics 200 OK 4.01777037s
- 2017-07-11 14:46:25.277870 I | api: 71c603d5-430e-4ac1-b62c-12ea2bcd3323 GET /metrics GetMetrics (start)
- 2017-07-11 14:46:25.278623 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/137609907
- 2017-07-11 14:46:25.813625 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/077991030
- 2017-07-11 14:46:26.274248 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/560160605
- 2017-07-11 14:46:26.633310 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/599685912
- 2017-07-11 14:46:27.121105 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/065847191
- 2017-07-11 14:46:27.873972 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/873577482
- 2017-07-11 14:46:28.414197 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/537832929
- 2017-07-11 14:46:28.982936 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/350838220
- 2017-07-11 14:46:29.443785 I | api: 71c603d5-430e-4ac1-b62c-12ea2bcd3323 GET /metrics GetMetrics 200 OK 4.165919037s
- 2017-07-11 14:46:30.231430 I | api: 706958f5-47cd-4148-9604-0e655f93d86a GET /metrics GetMetrics (start)
- 2017-07-11 14:46:30.232416 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/262781115
- 2017-07-11 14:46:30.705052 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/524490974
- 2017-07-11 14:46:31.142479 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/235045541
- 2017-07-11 14:46:31.526932 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/780177856
- 2017-07-11 14:46:31.977260 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/082544671
- 2017-07-11 14:46:32.431520 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/052635378
- 2017-07-11 14:46:32.885992 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/252632489
- 2017-07-11 14:46:33.356093 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/449640180
- 2017-07-11 14:46:33.800591 I | api: 706958f5-47cd-4148-9604-0e655f93d86a GET /metrics GetMetrics 200 OK 3.56915852s
- 2017-07-11 14:46:35.134230 I | api: 6235dc87-3f8f-4b5d-a8ed-6fbe5c4417af GET /metrics GetMetrics (start)
- 2017-07-11 14:46:35.153845 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/002518979
- 2017-07-11 14:46:35.626885 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/863843910
- 2017-07-11 14:46:36.121453 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/380540141
- 2017-07-11 14:46:36.515561 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/944756072
- 2017-07-11 14:46:37.001649 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/112525223
- 2017-07-11 14:46:37.496863 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/831907034
- 2017-07-11 14:46:37.971585 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/922705521
- 2017-07-11 14:46:38.520881 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/670100252
- 2017-07-11 14:46:38.977766 I | api: 6235dc87-3f8f-4b5d-a8ed-6fbe5c4417af GET /metrics GetMetrics 200 OK 3.843541942s
- 2017-07-11 14:46:40.063656 I | api: 5a05a489-cee1-421e-b4eb-d5c910a108c1 GET /metrics GetMetrics (start)
- 2017-07-11 14:46:40.064496 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/132595147
- 2017-07-11 14:46:40.587982 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/840558766
- 2017-07-11 14:46:41.069298 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/921569333
- 2017-07-11 14:46:41.434952 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/242379792
- 2017-07-11 14:46:42.077419 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/153234479
- 2017-07-11 14:46:42.561170 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/455289282
- 2017-07-11 14:46:43.285869 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/556113977
- 2017-07-11 14:46:43.723599 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/394934340
- 2017-07-11 14:46:44.173208 I | api: 5a05a489-cee1-421e-b4eb-d5c910a108c1 GET /metrics GetMetrics 200 OK 4.109548977s
- 2017-07-11 14:46:44.992677 I | api: b512ccb6-85b9-4c4d-be92-8a24a72e44cf GET /metrics GetMetrics (start)
- 2017-07-11 14:46:44.993592 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/660802771
- 2017-07-11 14:46:45.650495 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/010201110
- 2017-07-11 14:46:46.113806 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/550339197
- 2017-07-11 14:46:46.509181 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/266063288
- 2017-07-11 14:46:46.965636 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/419603895
- 2017-07-11 14:46:47.401224 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/569522090
- 2017-07-11 14:46:47.904328 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/258189569
- 2017-07-11 14:46:48.413621 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/197206124
- 2017-07-11 14:46:48.872144 I | api: b512ccb6-85b9-4c4d-be92-8a24a72e44cf GET /metrics GetMetrics 200 OK 3.879444631s
- 2017-07-11 14:46:49.918150 I | api: 135dde70-2b04-4cfb-957d-9d320efbdc9a GET /metrics GetMetrics (start)
- 2017-07-11 14:46:49.919006 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/445957851
- 2017-07-11 14:46:50.400047 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/426672254
- 2017-07-11 14:46:51.035978 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/114362821
- 2017-07-11 14:46:51.477330 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/291071072
- 2017-07-11 14:46:51.996155 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/678233663
- 2017-07-11 14:46:52.555739 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/287589010
- 2017-07-11 14:46:53.032586 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/444366025
- 2017-07-11 14:46:53.478844 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/413287316
- 2017-07-11 14:46:54.032755 I | api: 135dde70-2b04-4cfb-957d-9d320efbdc9a GET /metrics GetMetrics 200 OK 4.114603226s
- 2017-07-11 14:46:54.847065 I | api: 368580e5-b900-4ce2-a357-3466968ea201 GET /metrics GetMetrics (start)
- 2017-07-11 14:46:54.847807 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/085336035
- 2017-07-11 14:46:55.533273 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/819149286
- 2017-07-11 14:46:56.317846 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/110993933
- 2017-07-11 14:46:56.728070 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/920061448
- 2017-07-11 14:46:57.260014 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/425501639
- 2017-07-11 14:46:57.827435 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/216615034
- 2017-07-11 14:46:58.400676 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/483374481
- 2017-07-11 14:46:58.943019 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/647929788
- 2017-07-11 14:46:59.392715 I | api: 368580e5-b900-4ce2-a357-3466968ea201 GET /metrics GetMetrics 200 OK 4.545651947s
- 2017-07-11 14:46:59.771278 I | api: eaa0a523-b5ef-4961-934b-385ad0b25251 GET /metrics GetMetrics (start)
- 2017-07-11 14:46:59.772207 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/660479467
- 2017-07-11 14:47:00.282693 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/028489806
- 2017-07-11 14:47:00.742697 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/022389077
- 2017-07-11 14:47:01.273861 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/595570864
- 2017-07-11 14:47:01.681829 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/103911503
- 2017-07-11 14:47:02.144056 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/680458082
- 2017-07-11 14:47:02.599856 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/626815833
- 2017-07-11 14:47:03.080163 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/211449572
- 2017-07-11 14:47:03.580810 I | api: eaa0a523-b5ef-4961-934b-385ad0b25251 GET /metrics GetMetrics 200 OK 3.80952985s
- 2017-07-11 14:47:04.698796 I | api: c9664010-728a-479f-8d16-e04539176dd3 GET /metrics GetMetrics (start)
- 2017-07-11 14:47:04.699564 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/801766131
- 2017-07-11 14:47:05.522371 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/983624630
- 2017-07-11 14:47:05.960332 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/706650525
- 2017-07-11 14:47:06.503093 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/929512024
- 2017-07-11 14:47:06.888045 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/766745559
- 2017-07-11 14:47:07.366144 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/662157642
- 2017-07-11 14:47:08.022537 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/829488673
- 2017-07-11 14:47:08.520914 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/719218956
- 2017-07-11 14:47:09.049408 I | api: c9664010-728a-479f-8d16-e04539176dd3 GET /metrics GetMetrics 200 OK 4.350616807s
- 2017-07-11 14:47:09.629783 I | api: 2d50763b-8700-4a3a-8894-48849a1f8016 GET /metrics GetMetrics (start)
- 2017-07-11 14:47:09.630344 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/445924091
- 2017-07-11 14:47:10.159631 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/232382494
- 2017-07-11 14:47:10.620969 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/730051813
- 2017-07-11 14:47:11.056141 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/900012800
- 2017-07-11 14:47:11.501134 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/471545439
- 2017-07-11 14:47:11.975152 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/415913522
- 2017-07-11 14:47:12.435862 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/280603625
- 2017-07-11 14:47:12.905799 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/033335860
- 2017-07-11 14:47:13.376278 I | api: 2d50763b-8700-4a3a-8894-48849a1f8016 GET /metrics GetMetrics 200 OK 3.74647945s
- 2017-07-11 14:47:14.557466 I | api: 59ee96c0-ece3-495a-ace1-571be7dc1a9d GET /metrics GetMetrics (start)
- 2017-07-11 14:47:14.558318 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/912308227
- 2017-07-11 14:47:15.132037 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/372041094
- 2017-07-11 14:47:15.729432 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/064855341
- 2017-07-11 14:47:16.203619 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/390432424
- 2017-07-11 14:47:16.558331 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/366537703
- 2017-07-11 14:47:17.001177 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/863692826
- 2017-07-11 14:47:17.681288 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/466014897
- 2017-07-11 14:47:18.178653 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/726339676
- 2017-07-11 14:47:18.619754 I | api: 59ee96c0-ece3-495a-ace1-571be7dc1a9d GET /metrics GetMetrics 200 OK 4.06229398s
- 2017-07-11 14:47:19.480387 I | api: 757280ec-75c5-47fa-87a1-aabe3801e9af GET /metrics GetMetrics (start)
- 2017-07-11 14:47:19.481384 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/952645131
- 2017-07-11 14:47:19.961245 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/724898798
- 2017-07-11 14:47:20.518947 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/253376117
- 2017-07-11 14:47:20.969042 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/660489552
- 2017-07-11 14:47:21.430541 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/800854639
- 2017-07-11 14:47:21.856075 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/531824898
- 2017-07-11 14:47:22.316948 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/351403641
- 2017-07-11 14:47:22.775300 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/822333316
- 2017-07-11 14:47:23.233130 I | api: 757280ec-75c5-47fa-87a1-aabe3801e9af GET /metrics GetMetrics 200 OK 3.752742959s
- 2017-07-11 14:47:24.409168 I | api: 1dc24b2b-dcca-48fa-a7fe-6250fc20553b GET /metrics GetMetrics (start)
- 2017-07-11 14:47:24.410118 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/018886419
- 2017-07-11 14:47:25.023734 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/812918614
- 2017-07-11 14:47:25.626101 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/052735677
- 2017-07-11 14:47:26.137187 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/159567608
- 2017-07-11 14:47:26.546860 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/883059703
- 2017-07-11 14:47:27.006053 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/926930154
- 2017-07-11 14:47:27.593104 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/981380417
- 2017-07-11 14:47:28.093756 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/945053612
- 2017-07-11 14:47:28.543234 I | api: 1dc24b2b-dcca-48fa-a7fe-6250fc20553b GET /metrics GetMetrics 200 OK 4.134072064s
- 2017-07-11 14:47:29.334682 I | api: dee2ab49-fc51-4757-8ed9-61a7bdb9df7a GET /metrics GetMetrics (start)
- 2017-07-11 14:47:29.335643 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/080020763
- 2017-07-11 14:47:29.910805 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/422687166
- 2017-07-11 14:47:30.370275 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/430764037
- 2017-07-11 14:47:30.826481 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/797295520
- 2017-07-11 14:47:31.278785 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/423206527
- 2017-07-11 14:47:31.695204 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/631706066
- 2017-07-11 14:47:32.177815 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/789474057
- 2017-07-11 14:47:32.635962 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/448380628
- 2017-07-11 14:47:33.110647 I | api: dee2ab49-fc51-4757-8ed9-61a7bdb9df7a GET /metrics GetMetrics 200 OK 3.77595485s
- 2017-07-11 14:47:34.263380 I | api: ce04d166-f36e-4a06-85ba-ed9a3823b7eb GET /metrics GetMetrics (start)
- 2017-07-11 14:47:34.264333 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/016732707
- 2017-07-11 14:47:34.742634 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/994609446
- 2017-07-11 14:47:35.403776 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/157689933
- 2017-07-11 14:47:35.889103 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/261338440
- 2017-07-11 14:47:36.364116 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/503071751
- 2017-07-11 14:47:36.730725 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/300439482
- 2017-07-11 14:47:37.408795 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/439137745
- 2017-07-11 14:47:37.913919 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/248762620
- 2017-07-11 14:47:38.394704 I | api: ce04d166-f36e-4a06-85ba-ed9a3823b7eb GET /metrics GetMetrics 200 OK 4.131326049s
- 2017-07-11 14:47:39.190698 I | api: f9b56060-ad51-4e91-bfdf-709694004e85 GET /metrics GetMetrics (start)
- 2017-07-11 14:47:39.191561 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/154954795
- 2017-07-11 14:47:39.664184 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/847058830
- 2017-07-11 14:47:40.126875 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/043946389
- 2017-07-11 14:47:40.565732 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/037104112
- 2017-07-11 14:47:41.205557 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/775215759
- 2017-07-11 14:47:41.602344 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/144179874
- 2017-07-11 14:47:42.126924 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/965576089
- 2017-07-11 14:47:42.570098 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/755178020
- 2017-07-11 14:47:43.024587 I | api: f9b56060-ad51-4e91-bfdf-709694004e85 GET /metrics GetMetrics 200 OK 3.833885637s
- 2017-07-11 14:47:44.117595 I | api: 580f99d3-b231-420f-a896-e0ed753e3e37 GET /metrics GetMetrics (start)
- 2017-07-11 14:47:44.118422 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/542691635
- 2017-07-11 14:47:44.587142 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/365024502
- 2017-07-11 14:47:45.050158 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/953633757
- 2017-07-11 14:47:45.650378 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/345117080
- 2017-07-11 14:47:46.104261 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/685184535
- 2017-07-11 14:47:46.565284 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/085442698
- 2017-07-11 14:47:47.400797 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/268720225
- 2017-07-11 14:47:47.869791 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/975849548
- 2017-07-11 14:47:48.308203 I | api: 580f99d3-b231-420f-a896-e0ed753e3e37 GET /metrics GetMetrics 200 OK 4.190612184s
- 2017-07-11 14:47:49.045457 I | api: 7dcc1f4b-4469-42fe-9e0c-e6dd4c0fe14b GET /metrics GetMetrics (start)
- 2017-07-11 14:47:49.046450 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/085214011
- 2017-07-11 14:47:49.551156 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/613648734
- 2017-07-11 14:47:50.041483 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/464098085
- 2017-07-11 14:47:50.489387 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/845079616
- 2017-07-11 14:47:50.935560 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/372212383
- 2017-07-11 14:47:51.406750 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/042835314
- 2017-07-11 14:47:51.861949 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/086893097
- 2017-07-11 14:47:52.328051 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/722495348
- 2017-07-11 14:47:52.784507 I | api: 7dcc1f4b-4469-42fe-9e0c-e6dd4c0fe14b GET /metrics GetMetrics 200 OK 3.739047805s
- 2017-07-11 14:47:53.967573 I | api: 3c8e1312-cfdd-42c6-89ea-f509d0f88d9b GET /metrics GetMetrics (start)
- 2017-07-11 14:47:53.967956 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/473851971
- 2017-07-11 14:47:54.493532 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/621294278
- 2017-07-11 14:47:55.040183 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/466592109
- 2017-07-11 14:47:55.618099 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/437469672
- 2017-07-11 14:47:56.082188 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/248425511
- 2017-07-11 14:47:56.577153 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/000311130
- 2017-07-11 14:47:57.056771 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/501491953
- 2017-07-11 14:47:57.712493 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/041659292
- 2017-07-11 14:47:58.259616 I | api: 3c8e1312-cfdd-42c6-89ea-f509d0f88d9b GET /metrics GetMetrics 200 OK 4.292045593s
- 2017-07-11 14:47:58.898121 I | api: b7c76b68-b02f-47dc-84c4-1f511a0e07e2 GET /metrics GetMetrics (start)
- 2017-07-11 14:47:58.898945 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/447994443
- 2017-07-11 14:47:59.393650 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/447239982
- 2017-07-11 14:47:59.832790 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/132528309
- 2017-07-11 14:48:00.284573 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/882152592
- 2017-07-11 14:48:00.737263 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/846481071
- 2017-07-11 14:48:01.203844 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/335888450
- 2017-07-11 14:48:01.583979 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/202884281
- 2017-07-11 14:48:02.051303 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/283185860
- 2017-07-11 14:48:02.521036 I | api: b7c76b68-b02f-47dc-84c4-1f511a0e07e2 GET /metrics GetMetrics 200 OK 3.62291638s
- 2017-07-11 14:48:03.824619 I | api: 1f189e30-9373-435b-affb-0b3c99e0fb6f GET /metrics GetMetrics (start)
- 2017-07-11 14:48:03.825612 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/965785939
- 2017-07-11 14:48:04.269307 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/494397078
- 2017-07-11 14:48:04.709315 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/935912701
- 2017-07-11 14:48:05.360188 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/874268216
- 2017-07-11 14:48:05.815806 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/230608951
- 2017-07-11 14:48:06.281727 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/100422698
- 2017-07-11 14:48:06.712500 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/481634177
- 2017-07-11 14:48:07.170007 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/510872300
- 2017-07-11 14:48:07.655627 I | api: 1f189e30-9373-435b-affb-0b3c99e0fb6f GET /metrics GetMetrics 200 OK 3.831010567s
- 2017-07-11 14:48:08.748706 I | api: 6b0e14b7-2cd2-4f69-a426-4a50edee3dc4 GET /metrics GetMetrics (start)
- 2017-07-11 14:48:08.749682 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/823127899
- 2017-07-11 14:48:09.229940 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/146261246
- 2017-07-11 14:48:09.723348 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/796730437
- 2017-07-11 14:48:10.197942 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/052229856
- 2017-07-11 14:48:10.643967 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/855958207
- 2017-07-11 14:48:11.107850 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/850810642
- 2017-07-11 14:48:11.634333 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/146367305
- 2017-07-11 14:48:12.119016 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/075428884
- 2017-07-11 14:48:12.766101 I | api: 6b0e14b7-2cd2-4f69-a426-4a50edee3dc4 GET /metrics GetMetrics 200 OK 4.017392034s
- 2017-07-11 14:48:13.675693 I | api: e9ed967f-b0a8-45c0-8e97-5500bf0e8dcb GET /metrics GetMetrics (start)
- 2017-07-11 14:48:13.676051 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/541115491
- 2017-07-11 14:48:14.129314 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/058950758
- 2017-07-11 14:48:14.574919 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/115086989
- 2017-07-11 14:48:15.060896 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/052933256
- 2017-07-11 14:48:15.660733 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/156771399
- 2017-07-11 14:48:16.103011 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/972855546
- 2017-07-11 14:48:16.549910 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/282064401
- 2017-07-11 14:48:16.942764 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/119551036
- 2017-07-11 14:48:17.401235 I | api: e9ed967f-b0a8-45c0-8e97-5500bf0e8dcb GET /metrics GetMetrics 200 OK 3.725543875s
- 2017-07-11 14:48:18.603669 I | api: 0e819bf1-5d81-4a4c-b90a-26eb7ea4d3ef GET /metrics GetMetrics (start)
- 2017-07-11 14:48:18.604588 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/111844459
- 2017-07-11 14:48:19.083139 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/302643918
- 2017-07-11 14:48:19.544975 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/041399253
- 2017-07-11 14:48:19.992436 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/024240944
- 2017-07-11 14:48:20.436200 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/122471119
- 2017-07-11 14:48:20.996990 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/134054882
- 2017-07-11 14:48:21.467662 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/654470105
- 2017-07-11 14:48:21.879650 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/605037924
- 2017-07-11 14:48:22.341510 I | api: 0e819bf1-5d81-4a4c-b90a-26eb7ea4d3ef GET /metrics GetMetrics 200 OK 3.737829518s
- 2017-07-11 14:48:23.531275 I | api: 1a004d1c-a5bb-4a1e-8ef6-438a7a3cd77a GET /metrics GetMetrics (start)
- 2017-07-11 14:48:23.532163 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/652915059
- 2017-07-11 14:48:24.044551 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/222873654
- 2017-07-11 14:48:24.493519 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/982636573
- 2017-07-11 14:48:24.966567 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/659513048
- 2017-07-11 14:48:25.665113 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/717672535
- 2017-07-11 14:48:26.149327 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/700885450
- 2017-07-11 14:48:26.531239 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/235453601
- 2017-07-11 14:48:26.993692 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/027382668
- 2017-07-11 14:48:27.531112 I | api: 1a004d1c-a5bb-4a1e-8ef6-438a7a3cd77a GET /metrics GetMetrics 200 OK 3.999840219s
- 2017-07-11 14:48:28.455206 I | api: 567c8087-545e-463e-b409-6af3aa0d3c2a GET /metrics GetMetrics (start)
- 2017-07-11 14:48:28.455389 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/164946299
- 2017-07-11 14:48:28.943938 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/676384926
- 2017-07-11 14:48:29.409566 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/589251941
- 2017-07-11 14:48:29.852699 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/099478912
- 2017-07-11 14:48:30.553550 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/110238943
- 2017-07-11 14:48:31.024122 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/350782130
- 2017-07-11 14:48:31.536764 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/554353769
- 2017-07-11 14:48:31.890270 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/652409012
- 2017-07-11 14:48:32.378907 I | api: 567c8087-545e-463e-b409-6af3aa0d3c2a GET /metrics GetMetrics 200 OK 3.923690036s
- 2017-07-11 14:48:33.380593 I | api: ee69ce8c-e1b0-42a9-9f4c-8987553d6250 GET /metrics GetMetrics (start)
- 2017-07-11 14:48:33.381506 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/543081603
- 2017-07-11 14:48:33.835480 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/101947398
- 2017-07-11 14:48:34.302857 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/683195821
- 2017-07-11 14:48:34.885876 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/241057064
- 2017-07-11 14:48:35.549160 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/923132519
- 2017-07-11 14:48:35.994100 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/288875674
- 2017-07-11 14:48:36.444312 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/235047217
- 2017-07-11 14:48:36.817684 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/274954460
- 2017-07-11 14:48:37.300850 I | api: ee69ce8c-e1b0-42a9-9f4c-8987553d6250 GET /metrics GetMetrics 200 OK 3.920249188s
- 2017-07-11 14:48:38.306411 I | api: 452a4241-e8cf-4985-a80b-f48121ecf892 GET /metrics GetMetrics (start)
- 2017-07-11 14:48:38.307238 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/166341259
- 2017-07-11 14:48:38.783803 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/210371182
- 2017-07-11 14:48:39.245452 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/421979893
- 2017-07-11 14:48:39.688702 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/438679504
- 2017-07-11 14:48:40.346563 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/704373487
- 2017-07-11 14:48:40.864554 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/364456834
- 2017-07-11 14:48:41.358250 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/409327865
- 2017-07-11 14:48:41.732160 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/254959620
- 2017-07-11 14:48:42.191693 I | api: 452a4241-e8cf-4985-a80b-f48121ecf892 GET /metrics GetMetrics 200 OK 3.885283295s
- 2017-07-11 14:48:43.231133 I | api: 2fe1c425-6590-4416-9241-4d52ea11b12f GET /metrics GetMetrics (start)
- 2017-07-11 14:48:43.232075 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/330900883
- 2017-07-11 14:48:43.665177 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/444706774
- 2017-07-11 14:48:44.118976 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/828332861
- 2017-07-11 14:48:44.615330 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/317597048
- 2017-07-11 14:48:45.241514 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/190598263
- 2017-07-11 14:48:45.735993 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/446905194
- 2017-07-11 14:48:46.205691 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/675747777
- 2017-07-11 14:48:46.899749 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/895734828
- 2017-07-11 14:48:47.356597 I | api: 2fe1c425-6590-4416-9241-4d52ea11b12f GET /metrics GetMetrics 200 OK 4.125468478s
- 2017-07-11 14:48:48.160005 I | api: accf4fbd-e13e-4cdc-96ac-21bda346a7e1 GET /metrics GetMetrics (start)
- 2017-07-11 14:48:48.160838 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/901478299
- 2017-07-11 14:48:48.640889 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/289844286
- 2017-07-11 14:48:49.098318 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/606233221
- 2017-07-11 14:48:49.716121 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/519296544
- 2017-07-11 14:48:50.164423 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/659183871
- 2017-07-11 14:48:50.632336 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/341605970
- 2017-07-11 14:48:51.816566 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/344834953
- 2017-07-11 14:48:52.336970 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/229175124
- 2017-07-11 14:48:52.855041 I | api: accf4fbd-e13e-4cdc-96ac-21bda346a7e1 GET /metrics GetMetrics 200 OK 4.695034367s
- 2017-07-11 14:48:53.086675 I | api: b301a3f5-cb81-461e-8e89-e8ee2a88bacc GET /metrics GetMetrics (start)
- 2017-07-11 14:48:53.087723 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/166384803
- 2017-07-11 14:48:53.726554 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/301969830
- 2017-07-11 14:48:54.198561 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/617501389
- 2017-07-11 14:48:54.792632 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/544455112
- 2017-07-11 14:48:55.386828 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/793448071
- 2017-07-11 14:48:55.891135 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/670364218
- 2017-07-11 14:48:56.396225 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/049903185
- 2017-07-11 14:48:56.783777 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/193479548
- 2017-07-11 14:48:57.449029 I | api: b301a3f5-cb81-461e-8e89-e8ee2a88bacc GET /metrics GetMetrics 200 OK 4.362359146s
- 2017-07-11 14:48:58.013261 I | api: 5571b5f3-e2f5-49dc-a3ca-72252213b2f3 GET /metrics GetMetrics (start)
- 2017-07-11 14:48:58.014310 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/025782955
- 2017-07-11 14:48:58.622856 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/282388494
- 2017-07-11 14:48:59.097801 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/709539861
- 2017-07-11 14:48:59.564095 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/772646512
- 2017-07-11 14:49:00.112286 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/981710095
- 2017-07-11 14:49:00.599394 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/946512674
- 2017-07-11 14:49:01.267839 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/234173465
- 2017-07-11 14:49:01.655122 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/512786084
- 2017-07-11 14:49:02.097659 I | api: 5571b5f3-e2f5-49dc-a3ca-72252213b2f3 GET /metrics GetMetrics 200 OK 4.084387355s
- 2017-07-11 14:49:02.940503 I | api: a0a2838e-9e8a-4067-b3de-1a71fc14d188 GET /metrics GetMetrics (start)
- 2017-07-11 14:49:02.941267 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/498706867
- 2017-07-11 14:49:03.404652 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/631596918
- 2017-07-11 14:49:03.861454 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/664025181
- 2017-07-11 14:49:04.327935 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/464486424
- 2017-07-11 14:49:04.853330 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/539492503
- 2017-07-11 14:49:05.430503 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/254778634
- 2017-07-11 14:49:05.943206 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/183356641
- 2017-07-11 14:49:06.430595 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/559245516
- 2017-07-11 14:49:06.838766 I | api: a0a2838e-9e8a-4067-b3de-1a71fc14d188 GET /metrics GetMetrics 200 OK 3.898256865s
- 2017-07-11 14:49:07.862314 I | api: 6d4c4ebe-4f86-48b2-8137-55dfa57dceed GET /metrics GetMetrics (start)
- 2017-07-11 14:49:07.863208 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/038125499
- 2017-07-11 14:49:08.335693 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/092362718
- 2017-07-11 14:49:08.978051 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/921257381
- 2017-07-11 14:49:09.432697 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/221053120
- 2017-07-11 14:49:09.883345 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/905191199
- 2017-07-11 14:49:10.349863 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/420811762
- 2017-07-11 14:49:10.850408 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/049645737
- 2017-07-11 14:49:11.289665 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/622043636
- 2017-07-11 14:49:11.690694 I | api: 6d4c4ebe-4f86-48b2-8137-55dfa57dceed GET /metrics GetMetrics 200 OK 3.828379062s
- 2017-07-11 14:49:12.786468 I | api: 5a25397d-94e5-4da5-a112-f905b9780fe9 GET /metrics GetMetrics (start)
- 2017-07-11 14:49:12.787258 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/164768451
- 2017-07-11 14:49:13.241048 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/788151622
- 2017-07-11 14:49:13.712553 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/705984493
- 2017-07-11 14:49:14.235636 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/030125672
- 2017-07-11 14:49:15.042107 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/039409831
- 2017-07-11 14:49:15.647325 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/375405530
- 2017-07-11 14:49:16.447510 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/241300337
- 2017-07-11 14:49:16.803073 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/043764252
- 2017-07-11 14:49:17.277161 I | api: 5a25397d-94e5-4da5-a112-f905b9780fe9 GET /metrics GetMetrics 200 OK 4.490696901s
- 2017-07-11 14:49:17.712664 I | api: 7850123f-3901-46f4-aab8-ee55f57547a8 GET /metrics GetMetrics (start)
- 2017-07-11 14:49:17.713602 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/139190987
- 2017-07-11 14:49:18.191677 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/175724974
- 2017-07-11 14:49:18.630285 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/763459381
- 2017-07-11 14:49:19.163629 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/230090000
- 2017-07-11 14:49:19.622809 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/747435311
- 2017-07-11 14:49:20.124898 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/598314178
- 2017-07-11 14:49:20.606369 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/868411705
- 2017-07-11 14:49:21.077077 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/288864068
- 2017-07-11 14:49:21.585395 I | api: 7850123f-3901-46f4-aab8-ee55f57547a8 GET /metrics GetMetrics 200 OK 3.872728189s
- 2017-07-11 14:49:22.642355 I | api: d5edc758-a591-4cf7-87a8-5774c067876d GET /metrics GetMetrics (start)
- 2017-07-11 14:49:22.654975 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/722405331
- 2017-07-11 14:49:23.290616 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/127659798
- 2017-07-11 14:49:23.738711 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/432200573
- 2017-07-11 14:49:24.214183 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/650597048
- 2017-07-11 14:49:24.679508 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/385246903
- 2017-07-11 14:49:25.265413 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/986959530
- 2017-07-11 14:49:25.712214 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/964325377
- 2017-07-11 14:49:26.197994 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/764390252
- 2017-07-11 14:49:26.600225 I | api: d5edc758-a591-4cf7-87a8-5774c067876d GET /metrics GetMetrics 200 OK 3.957874728s
- 2017-07-11 14:49:27.568171 I | api: 02c4a98b-8ec3-418c-94e1-86593bda78f1 GET /metrics GetMetrics (start)
- 2017-07-11 14:49:27.569141 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/499914715
- 2017-07-11 14:49:28.030733 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/914595198
- 2017-07-11 14:49:28.506087 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/916920005
- 2017-07-11 14:49:29.076784 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/850757984
- 2017-07-11 14:49:29.542563 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/769189695
- 2017-07-11 14:49:30.004673 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/279569810
- 2017-07-11 14:49:30.483097 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/878342601
- 2017-07-11 14:49:30.956484 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/392940692
- 2017-07-11 14:49:31.491818 I | api: 02c4a98b-8ec3-418c-94e1-86593bda78f1 GET /metrics GetMetrics 200 OK 3.923657461s
- 2017-07-11 14:49:32.494813 I | api: bc752ef8-3413-4f4e-b67e-af11c3bd733c GET /metrics GetMetrics (start)
- 2017-07-11 14:49:32.495746 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/359084771
- 2017-07-11 14:49:32.966321 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/972106982
- 2017-07-11 14:49:33.434008 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/193122061
- 2017-07-11 14:49:33.944282 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/059255048
- 2017-07-11 14:49:34.426653 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/893691079
- 2017-07-11 14:49:34.876075 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/018306426
- 2017-07-11 14:49:35.542911 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/559177361
- 2017-07-11 14:49:36.038044 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/887539900
- 2017-07-11 14:49:36.563434 I | api: bc752ef8-3413-4f4e-b67e-af11c3bd733c GET /metrics GetMetrics 200 OK 4.0686362s
- 2017-07-11 14:49:37.421442 I | api: b12fa198-01a0-48d6-bfa5-3f78ccee7f7a GET /metrics GetMetrics (start)
- 2017-07-11 14:49:37.422612 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/055081195
- 2017-07-11 14:49:37.920656 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/042145102
- 2017-07-11 14:49:38.386719 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/637033045
- 2017-07-11 14:49:38.855389 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/571727792
- 2017-07-11 14:49:39.520355 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/672772431
- 2017-07-11 14:49:39.992013 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/541659234
- 2017-07-11 14:49:40.470614 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/729168985
- 2017-07-11 14:49:40.932752 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/124051940
- 2017-07-11 14:49:41.397568 I | api: b12fa198-01a0-48d6-bfa5-3f78ccee7f7a GET /metrics GetMetrics 200 OK 3.976127479s
- 2017-07-11 14:49:42.347634 I | api: e53a29e6-001a-4d39-8141-b79942636bca GET /metrics GetMetrics (start)
- 2017-07-11 14:49:42.348510 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/635177459
- 2017-07-11 14:49:42.792114 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/444393654
- 2017-07-11 14:49:43.561436 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/531842205
- 2017-07-11 14:49:44.043578 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/720532824
- 2017-07-11 14:49:44.509343 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/899669207
- 2017-07-11 14:49:44.970528 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/157091402
- 2017-07-11 14:49:45.637341 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/049904417
- 2017-07-11 14:49:46.242253 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/035639820
- 2017-07-11 14:49:46.636039 I | api: e53a29e6-001a-4d39-8141-b79942636bca GET /metrics GetMetrics 200 OK 4.288411273s
- 2017-07-11 14:49:47.272999 I | api: d659afc1-24ef-4f1e-87a6-c25a8d8da3e2 GET /metrics GetMetrics (start)
- 2017-07-11 14:49:47.273790 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/131497979
- 2017-07-11 14:49:47.744580 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/312128286
- 2017-07-11 14:49:48.192566 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/169731045
- 2017-07-11 14:49:49.214380 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/841386496
- 2017-07-11 14:49:49.671920 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/640311647
- 2017-07-11 14:49:50.191225 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/817789234
- 2017-07-11 14:49:50.623090 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/718203625
- 2017-07-11 14:49:51.075274 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/324238644
- 2017-07-11 14:49:51.623306 I | api: d659afc1-24ef-4f1e-87a6-c25a8d8da3e2 GET /metrics GetMetrics 200 OK 4.350275679s
- 2017-07-11 14:49:52.199290 I | api: 6fe7b3e0-1398-454a-b6b7-6c7dd84ed4e5 GET /metrics GetMetrics (start)
- 2017-07-11 14:49:52.200149 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/047360259
- 2017-07-11 14:49:52.868136 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/432832646
- 2017-07-11 14:49:53.374246 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/484919853
- 2017-07-11 14:49:53.862639 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/107348392
- 2017-07-11 14:49:54.333994 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/319750375
- 2017-07-11 14:49:54.787036 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/159530778
- 2017-07-11 14:49:55.589749 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/873645489
- 2017-07-11 14:49:56.086815 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/859500380
- 2017-07-11 14:49:56.596606 I | api: 6fe7b3e0-1398-454a-b6b7-6c7dd84ed4e5 GET /metrics GetMetrics 200 OK 4.397318645s
- 2017-07-11 14:49:57.125341 I | api: cbbb4280-524f-43b5-84dd-6b96f3f9f165 GET /metrics GetMetrics (start)
- 2017-07-11 14:49:57.126281 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/356692747
- 2017-07-11 14:49:57.630201 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/988541166
- 2017-07-11 14:49:58.116309 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/282502517
- 2017-07-11 14:49:58.561469 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/230145616
- 2017-07-11 14:49:59.042451 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/127344495
- 2017-07-11 14:49:59.490399 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/797019138
- 2017-07-11 14:49:59.962594 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/026391417
- 2017-07-11 14:50:00.466975 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/009850500
- 2017-07-11 14:50:00.902158 I | api: cbbb4280-524f-43b5-84dd-6b96f3f9f165 GET /metrics GetMetrics 200 OK 3.776816084s
- 2017-07-11 14:50:02.051512 I | api: 1690a67f-1bfa-4b25-ae23-a78172dc5d07 GET /metrics GetMetrics (start)
- 2017-07-11 14:50:02.052389 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/527247891
- 2017-07-11 14:50:02.514996 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/080810070
- 2017-07-11 14:50:02.993365 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/818429373
- 2017-07-11 14:50:03.465755 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/633216504
- 2017-07-11 14:50:04.012182 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/100450551
- 2017-07-11 14:50:04.458054 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/224974826
- 2017-07-11 14:50:04.940566 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/706614849
- 2017-07-11 14:50:05.576394 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/675460268
- 2017-07-11 14:50:06.044716 I | api: 1690a67f-1bfa-4b25-ae23-a78172dc5d07 GET /metrics GetMetrics 200 OK 3.993208553s
- 2017-07-11 14:50:06.977197 I | api: 92ae4722-3462-466c-9f0b-3fa969763a64 GET /metrics GetMetrics (start)
- 2017-07-11 14:50:06.977955 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/992119835
- 2017-07-11 14:50:07.570310 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/155414718
- 2017-07-11 14:50:08.070081 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/270245637
- 2017-07-11 14:50:08.512170 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/067585696
- 2017-07-11 14:50:09.143607 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/016154495
- 2017-07-11 14:50:09.616792 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/618954450
- 2017-07-11 14:50:10.086229 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/134228489
- 2017-07-11 14:50:10.555234 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/238886868
- 2017-07-11 14:50:10.997830 I | api: 92ae4722-3462-466c-9f0b-3fa969763a64 GET /metrics GetMetrics 200 OK 4.02063731s
- 2017-07-11 14:50:11.903082 I | api: c933dd62-4b7a-4905-bf5e-e14fffe0976e GET /metrics GetMetrics (start)
- 2017-07-11 14:50:11.907166 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/184664867
- 2017-07-11 14:50:12.371101 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/211675174
- 2017-07-11 14:50:13.012031 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/738847053
- 2017-07-11 14:50:13.506443 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/879327816
- 2017-07-11 14:50:13.950272 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/716864263
- 2017-07-11 14:50:14.423928 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/010732218
- 2017-07-11 14:50:14.890488 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/290086609
- 2017-07-11 14:50:15.526432 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/692465660
- 2017-07-11 14:50:15.968863 I | api: c933dd62-4b7a-4905-bf5e-e14fffe0976e GET /metrics GetMetrics 200 OK 4.065785939s
- 2017-07-11 14:50:16.828523 I | api: 29d1415c-0622-45e4-9f71-2bb466074f1e GET /metrics GetMetrics (start)
- 2017-07-11 14:50:16.829286 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/136824619
- 2017-07-11 14:50:17.282403 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/616540814
- 2017-07-11 14:50:17.851065 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/371187349
- 2017-07-11 14:50:18.279681 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/784633584
- 2017-07-11 14:50:18.723766 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/179174287
- 2017-07-11 14:50:19.231482 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/068440482
- 2017-07-11 14:50:19.707123 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/942714009
- 2017-07-11 14:50:20.172718 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/453174052
- 2017-07-11 14:50:20.628594 I | api: 29d1415c-0622-45e4-9f71-2bb466074f1e GET /metrics GetMetrics 200 OK 3.800056728s
- 2017-07-11 14:50:21.754210 I | api: e6f02f3e-da9c-407d-849d-1275afd7f0e6 GET /metrics GetMetrics (start)
- 2017-07-11 14:50:21.755043 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/576080947
- 2017-07-11 14:50:22.315710 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/998270454
- 2017-07-11 14:50:22.775520 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/603937501
- 2017-07-11 14:50:23.256038 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/461889688
- 2017-07-11 14:50:23.745344 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/031034647
- 2017-07-11 14:50:24.286372 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/301600138
- 2017-07-11 14:50:24.919816 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/436248417
- 2017-07-11 14:50:25.558155 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/584443724
- 2017-07-11 14:50:26.015963 I | api: e6f02f3e-da9c-407d-849d-1275afd7f0e6 GET /metrics GetMetrics 200 OK 4.261755797s
- 2017-07-11 14:50:26.680240 I | api: ffe9304e-eea7-4862-b762-4461658e7d6b GET /metrics GetMetrics (start)
- 2017-07-11 14:50:26.680979 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/060650043
- 2017-07-11 14:50:27.208087 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/154936926
- 2017-07-11 14:50:27.692944 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/002933285
- 2017-07-11 14:50:28.142868 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/370837824
- 2017-07-11 14:50:28.598543 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/272584607
- 2017-07-11 14:50:29.075922 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/475288690
- 2017-07-11 14:50:29.541230 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/074171177
- 2017-07-11 14:50:30.018793 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/705444468
- 2017-07-11 14:50:30.490530 I | api: ffe9304e-eea7-4862-b762-4461658e7d6b GET /metrics GetMetrics 200 OK 3.810287289s
- 2017-07-11 14:50:31.680268 I | api: 19ad03e6-c756-4640-88f7-078aa74e8975 GET /metrics GetMetrics (start)
- 2017-07-11 14:50:31.681107 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/088144707
- 2017-07-11 14:50:32.052387 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/747559878
- 2017-07-11 14:50:32.513167 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/158803565
- 2017-07-11 14:50:32.972375 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/964238056
- 2017-07-11 14:50:33.602185 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/150323495
- 2017-07-11 14:50:34.087742 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/024688730
- 2017-07-11 14:50:34.655093 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/149153265
- 2017-07-11 14:50:35.120187 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/602283676
- 2017-07-11 14:50:35.737625 I | api: 19ad03e6-c756-4640-88f7-078aa74e8975 GET /metrics GetMetrics 200 OK 4.057327612s
- 2017-07-11 14:50:36.604991 I | api: 5aa8fb7c-3408-4f49-8c3e-876e5021a66c GET /metrics GetMetrics (start)
- 2017-07-11 14:50:36.605923 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/702868299
- 2017-07-11 14:50:37.036327 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/367801390
- 2017-07-11 14:50:37.515343 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/768321461
- 2017-07-11 14:50:37.984850 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/191382416
- 2017-07-11 14:50:38.568645 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/479586223
- 2017-07-11 14:50:39.033501 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/383806786
- 2017-07-11 14:50:39.627390 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/928427961
- 2017-07-11 14:50:40.097357 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/116612036
- 2017-07-11 14:50:40.549481 I | api: 5aa8fb7c-3408-4f49-8c3e-876e5021a66c GET /metrics GetMetrics 200 OK 3.944488967s
- 2017-07-11 14:50:41.528165 I | api: 36724eda-b8e4-4e00-8048-ec8320265de6 GET /metrics GetMetrics (start)
- 2017-07-11 14:50:41.529085 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/206118995
- 2017-07-11 14:50:41.891055 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/030551446
- 2017-07-11 14:50:42.355701 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/246772733
- 2017-07-11 14:50:42.804182 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/984047416
- 2017-07-11 14:50:43.351207 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/695846711
- 2017-07-11 14:50:43.852854 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/739082026
- 2017-07-11 14:50:44.294430 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/155736705
- 2017-07-11 14:50:44.790553 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/441177580
- 2017-07-11 14:50:45.357259 I | api: 36724eda-b8e4-4e00-8048-ec8320265de6 GET /metrics GetMetrics 200 OK 3.82910888s
- 2017-07-11 14:50:46.456831 I | api: e6498e43-6db5-4e9a-8ca3-ee397c8d50f5 GET /metrics GetMetrics (start)
- 2017-07-11 14:50:46.457731 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/120485467
- 2017-07-11 14:50:46.945979 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/631010814
- 2017-07-11 14:50:47.407743 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/871341381
- 2017-07-11 14:50:47.894489 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/559460320
- 2017-07-11 14:50:48.363933 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/893933503
- 2017-07-11 14:50:48.817594 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/272655890
- 2017-07-11 14:50:49.332195 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/163507273
- 2017-07-11 14:50:49.958713 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/512916756
- 2017-07-11 14:50:50.424647 I | api: e6498e43-6db5-4e9a-8ca3-ee397c8d50f5 GET /metrics GetMetrics 200 OK 3.967814899s
- 2017-07-11 14:50:51.384521 I | api: bcce7b66-76d0-4c12-8876-f14ef2ea5024 GET /metrics GetMetrics (start)
- 2017-07-11 14:50:51.391236 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/962185571
- 2017-07-11 14:50:51.821319 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/531696486
- 2017-07-11 14:50:52.350427 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/520283533
- 2017-07-11 14:50:52.826331 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/475508104
- 2017-07-11 14:50:53.399096 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/596073287
- 2017-07-11 14:50:53.887670 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/715433466
- 2017-07-11 14:50:54.357038 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/911670545
- 2017-07-11 14:50:54.831274 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/582797628
- 2017-07-11 14:50:55.430113 I | api: bcce7b66-76d0-4c12-8876-f14ef2ea5024 GET /metrics GetMetrics 200 OK 4.045596735s
- 2017-07-11 14:50:56.303156 I | api: d5cdb9bf-2caf-42bc-ace7-04cc17687d4b GET /metrics GetMetrics (start)
- 2017-07-11 14:50:56.304064 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/281840491
- 2017-07-11 14:50:56.742454 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/703879118
- 2017-07-11 14:50:57.196214 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/648151253
- 2017-07-11 14:50:57.801323 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/553287216
- 2017-07-11 14:50:58.249475 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/378304463
- 2017-07-11 14:50:58.731259 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/044511458
- 2017-07-11 14:50:59.182072 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/636709593
- 2017-07-11 14:50:59.642041 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/883200100
- 2017-07-11 14:51:00.113897 I | api: d5cdb9bf-2caf-42bc-ace7-04cc17687d4b GET /metrics GetMetrics 200 OK 3.810731436s
- 2017-07-11 14:51:01.231096 I | api: 6bdca683-d0e1-42a4-8725-fc6f3e4dc0ec GET /metrics GetMetrics (start)
- 2017-07-11 14:51:01.232045 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/024011379
- 2017-07-11 14:51:01.668608 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/883844918
- 2017-07-11 14:51:02.019261 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/266870045
- 2017-07-11 14:51:02.479676 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/796536280
- 2017-07-11 14:51:02.996237 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/830097239
- 2017-07-11 14:51:03.462737 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/245757642
- 2017-07-11 14:51:03.944786 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/722314657
- 2017-07-11 14:51:04.448540 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/817342604
- 2017-07-11 14:51:04.910531 I | api: 6bdca683-d0e1-42a4-8725-fc6f3e4dc0ec GET /metrics GetMetrics 200 OK 3.679439339s
- 2017-07-11 14:51:06.161647 I | api: cc3f62a3-3946-434e-b320-a611527de547 GET /metrics GetMetrics (start)
- 2017-07-11 14:51:06.162380 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/694779003
- 2017-07-11 14:51:06.645740 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/628883870
- 2017-07-11 14:51:07.065642 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/572931685
- 2017-07-11 14:51:07.534481 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/293507712
- 2017-07-11 14:51:08.003389 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/242801631
- 2017-07-11 14:51:08.469241 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/105658802
- 2017-07-11 14:51:08.922415 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/410466665
- 2017-07-11 14:51:09.427712 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/900951476
- 2017-07-11 14:51:09.881197 I | api: cc3f62a3-3946-434e-b320-a611527de547 GET /metrics GetMetrics 200 OK 3.719550339s
- 2017-07-11 14:51:11.078955 I | api: 399270ef-faf0-49f3-a6c1-c2a6dbfc64bd GET /metrics GetMetrics (start)
- 2017-07-11 14:51:11.079901 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/553118595
- 2017-07-11 14:51:11.527891 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/337775366
- 2017-07-11 14:51:11.877168 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/235146413
- 2017-07-11 14:51:12.345668 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/345918504
- 2017-07-11 14:51:12.809953 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/401105767
- 2017-07-11 14:51:13.274036 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/133091226
- 2017-07-11 14:51:13.950385 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/273734193
- 2017-07-11 14:51:14.429713 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/520944092
- 2017-07-11 14:51:15.189297 I | api: 399270ef-faf0-49f3-a6c1-c2a6dbfc64bd GET /metrics GetMetrics 200 OK 4.110344516s
- 2017-07-11 14:51:16.001403 I | api: d1f2558a-8325-4f41-9c31-1bb01427039a GET /metrics GetMetrics (start)
- 2017-07-11 14:51:16.002244 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/020383115
- 2017-07-11 14:51:16.464969 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/811261806
- 2017-07-11 14:51:16.826760 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/083870197
- 2017-07-11 14:51:17.594629 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/645110992
- 2017-07-11 14:51:18.045570 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/808354799
- 2017-07-11 14:51:18.550799 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/265719426
- 2017-07-11 14:51:19.010297 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/283358713
- 2017-07-11 14:51:19.493759 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/086616324
- 2017-07-11 14:51:20.073512 I | api: d1f2558a-8325-4f41-9c31-1bb01427039a GET /metrics GetMetrics 200 OK 4.072106748s
- 2017-07-11 14:51:20.927150 I | api: 46b3e2b2-b6a7-4f19-8b45-8b9be8d5c531 GET /metrics GetMetrics (start)
- 2017-07-11 14:51:20.928131 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/588418195
- 2017-07-11 14:51:21.622182 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/251856086
- 2017-07-11 14:51:21.987410 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/640660541
- 2017-07-11 14:51:22.470976 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/905489016
- 2017-07-11 14:51:22.928487 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/014880119
- 2017-07-11 14:51:23.405776 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/476121194
- 2017-07-11 14:51:24.159146 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/523455169
- 2017-07-11 14:51:24.606973 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/767647532
- 2017-07-11 14:51:25.274452 I | api: 46b3e2b2-b6a7-4f19-8b45-8b9be8d5c531 GET /metrics GetMetrics 200 OK 4.347317645s
- 2017-07-11 14:51:25.853069 I | api: 417f0362-2f62-4b25-98fa-f0c02158e2ba GET /metrics GetMetrics (start)
- 2017-07-11 14:51:25.853927 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/406177947
- 2017-07-11 14:51:26.325855 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/918735166
- 2017-07-11 14:51:26.682164 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/409145733
- 2017-07-11 14:51:27.146690 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/199869728
- 2017-07-11 14:51:27.862838 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/380189183
- 2017-07-11 14:51:28.359433 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/047442770
- 2017-07-11 14:51:28.848322 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/795968137
- 2017-07-11 14:51:29.295226 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/034675284
- 2017-07-11 14:51:29.759590 I | api: 417f0362-2f62-4b25-98fa-f0c02158e2ba GET /metrics GetMetrics 200 OK 3.906510304s
- 2017-07-11 14:51:30.774776 I | api: 180e2d18-b785-4b58-b8e6-088e8aea878e GET /metrics GetMetrics (start)
- 2017-07-11 14:51:30.775678 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/494514595
- 2017-07-11 14:51:31.226169 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/811902118
- 2017-07-11 14:51:31.671440 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/286845901
- 2017-07-11 14:51:32.075322 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/097405128
- 2017-07-11 14:51:32.660414 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/938165639
- 2017-07-11 14:51:33.093719 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/978976570
- 2017-07-11 14:51:33.559181 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/756645201
- 2017-07-11 14:51:34.015193 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/491720316
- 2017-07-11 14:51:34.510476 I | api: 180e2d18-b785-4b58-b8e6-088e8aea878e GET /metrics GetMetrics 200 OK 3.735704172s
- 2017-07-11 14:51:35.704503 I | api: beabb03e-a018-4c74-8be5-9e18e5797aad GET /metrics GetMetrics (start)
- 2017-07-11 14:51:35.711552 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/279730603
- 2017-07-11 14:51:36.228647 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/191303438
- 2017-07-11 14:51:36.687058 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/867749653
- 2017-07-11 14:51:37.153023 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/093353840
- 2017-07-11 14:51:37.834435 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/106195471
- 2017-07-11 14:51:38.337947 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/356236322
- 2017-07-11 14:51:38.823858 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/466929433
- 2017-07-11 14:51:39.285387 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/280984996
- 2017-07-11 14:51:39.826263 I | api: beabb03e-a018-4c74-8be5-9e18e5797aad GET /metrics GetMetrics 200 OK 4.121757321s
- 2017-07-11 14:51:40.625993 I | api: 392221bd-f747-4bc1-92b2-92667d2a482a GET /metrics GetMetrics (start)
- 2017-07-11 14:51:40.626975 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/345239219
- 2017-07-11 14:51:41.134781 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/290639990
- 2017-07-11 14:51:41.593033 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/391006045
- 2017-07-11 14:51:41.979459 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/021291800
- 2017-07-11 14:51:42.498500 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/972139927
- 2017-07-11 14:51:42.967725 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/030823946
- 2017-07-11 14:51:43.646839 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/771836385
- 2017-07-11 14:51:44.111931 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/124796364
- 2017-07-11 14:51:44.578996 I | api: 392221bd-f747-4bc1-92b2-92667d2a482a GET /metrics GetMetrics 200 OK 3.9530085s
- 2017-07-11 14:51:45.550986 I | api: 8221e14b-1008-433a-b09d-5a20043de5ae GET /metrics GetMetrics (start)
- 2017-07-11 14:51:45.551906 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/796954811
- 2017-07-11 14:51:46.064104 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/700708062
- 2017-07-11 14:51:46.521728 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/695470245
- 2017-07-11 14:51:46.920667 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/167238592
- 2017-07-11 14:51:47.415162 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/655430687
- 2017-07-11 14:51:47.864224 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/789957362
- 2017-07-11 14:51:48.657757 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/388717481
- 2017-07-11 14:51:49.106720 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/119791860
- 2017-07-11 14:51:49.559205 I | api: 8221e14b-1008-433a-b09d-5a20043de5ae GET /metrics GetMetrics 200 OK 4.008220333s
- 2017-07-11 14:51:50.472730 I | api: fc0247fe-042e-47b4-b5b3-3e6680ac572e GET /metrics GetMetrics (start)
- 2017-07-11 14:51:50.473621 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/076987843
- 2017-07-11 14:51:51.119765 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/472597574
- 2017-07-11 14:51:51.628971 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/000233709
- 2017-07-11 14:51:52.029567 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/481320808
- 2017-07-11 14:51:52.499256 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/425880999
- 2017-07-11 14:51:52.966134 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/310626522
- 2017-07-11 14:51:53.446648 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/116975217
- 2017-07-11 14:51:53.922854 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/348118812
- 2017-07-11 14:51:54.460636 I | api: fc0247fe-042e-47b4-b5b3-3e6680ac572e GET /metrics GetMetrics 200 OK 3.98791136s
- 2017-07-11 14:51:55.398331 I | api: 888bb03a-bf81-468a-8c61-fcbdefa1e1d0 GET /metrics GetMetrics (start)
- 2017-07-11 14:51:55.399286 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/635709899
- 2017-07-11 14:51:55.883005 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/480354990
- 2017-07-11 14:51:56.346981 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/575909941
- 2017-07-11 14:51:56.724207 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/491351056
- 2017-07-11 14:51:57.203348 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/486553647
- 2017-07-11 14:51:57.657425 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/423541186
- 2017-07-11 14:51:58.147625 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/168730169
- 2017-07-11 14:51:58.605352 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/766040132
- 2017-07-11 14:51:59.055993 I | api: 888bb03a-bf81-468a-8c61-fcbdefa1e1d0 GET /metrics GetMetrics 200 OK 3.657660773s
- 2017-07-11 14:52:00.319899 I | api: 80cd0cd0-7a9f-430e-99d3-8e0cdd97fe22 GET /metrics GetMetrics (start)
- 2017-07-11 14:52:00.320709 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/987352275
- 2017-07-11 14:52:00.783425 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/028666902
- 2017-07-11 14:52:01.218580 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/702297213
- 2017-07-11 14:52:01.685278 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/968649656
- 2017-07-11 14:52:02.133428 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/269704631
- 2017-07-11 14:52:02.584800 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/866739626
- 2017-07-11 14:52:03.042401 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/210374401
- 2017-07-11 14:52:03.567951 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/319619180
- 2017-07-11 14:52:04.136343 I | api: 80cd0cd0-7a9f-430e-99d3-8e0cdd97fe22 GET /metrics GetMetrics 200 OK 3.816447669s
- 2017-07-11 14:52:05.242534 I | api: 9b094ea1-037a-4925-bdfa-9fb4840d59a6 GET /metrics GetMetrics (start)
- 2017-07-11 14:52:05.243613 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/034040027
- 2017-07-11 14:52:05.720656 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/489812094
- 2017-07-11 14:52:06.185538 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/646339013
- 2017-07-11 14:52:06.635017 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/936043616
- 2017-07-11 14:52:07.012427 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/116260415
- 2017-07-11 14:52:07.509283 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/413760146
- 2017-07-11 14:52:08.050719 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/230109385
- 2017-07-11 14:52:08.510914 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/697549204
- 2017-07-11 14:52:08.965947 I | api: 9b094ea1-037a-4925-bdfa-9fb4840d59a6 GET /metrics GetMetrics 200 OK 3.723417155s
- 2017-07-11 14:52:10.169580 I | api: 6643b990-2d04-4486-af58-96f611dac20b GET /metrics GetMetrics (start)
- 2017-07-11 14:52:10.174360 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/363294179
- 2017-07-11 14:52:10.656229 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/710797798
- 2017-07-11 14:52:11.128291 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/156657677
- 2017-07-11 14:52:11.598935 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/658304520
- 2017-07-11 14:52:11.983574 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/223730631
- 2017-07-11 14:52:12.546052 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/721669754
- 2017-07-11 14:52:13.009994 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/641533841
- 2017-07-11 14:52:13.494628 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/836225468
- 2017-07-11 14:52:13.946357 I | api: 6643b990-2d04-4486-af58-96f611dac20b GET /metrics GetMetrics 200 OK 3.776782121s
- 2017-07-11 14:52:15.110456 I | api: af37c9ed-3d29-439f-ab93-12653a172507 GET /metrics GetMetrics (start)
- 2017-07-11 14:52:15.121595 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/288805867
- 2017-07-11 14:52:15.610163 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/334666318
- 2017-07-11 14:52:16.051002 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/208581973
- 2017-07-11 14:52:16.493331 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/694240432
- 2017-07-11 14:52:16.858203 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/977654351
- 2017-07-11 14:52:17.519804 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/373786466
- 2017-07-11 14:52:17.979903 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/047790937
- 2017-07-11 14:52:18.531684 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/882092772
- 2017-07-11 14:52:18.972031 I | api: af37c9ed-3d29-439f-ab93-12653a172507 GET /metrics GetMetrics 200 OK 3.861576206s
- 2017-07-11 14:52:20.013287 I | api: 8deae783-35ab-433b-8ffa-dab3f2e92994 GET /metrics GetMetrics (start)
- 2017-07-11 14:52:20.014264 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/684809459
- 2017-07-11 14:52:20.574718 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/366822326
- 2017-07-11 14:52:21.041232 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/510388125
- 2017-07-11 14:52:21.543192 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/686586456
- 2017-07-11 14:52:21.922485 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/911220183
- 2017-07-11 14:52:22.373550 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/476833610
- 2017-07-11 14:52:22.863038 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/112223265
- 2017-07-11 14:52:23.330371 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/265974028
- 2017-07-11 14:52:23.790297 I | api: 8deae783-35ab-433b-8ffa-dab3f2e92994 GET /metrics GetMetrics 200 OK 3.777015253s
- 2017-07-11 14:52:24.939963 I | api: a62d6430-8b62-4272-8a7c-d9e1d7ebf6fa GET /metrics GetMetrics (start)
- 2017-07-11 14:52:24.940874 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/498956539
- 2017-07-11 14:52:25.573529 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/231021086
- 2017-07-11 14:52:26.022914 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/080165605
- 2017-07-11 14:52:26.502526 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/623614720
- 2017-07-11 14:52:26.853791 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/098746975
- 2017-07-11 14:52:27.364294 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/093049394
- 2017-07-11 14:52:27.822156 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/154358249
- 2017-07-11 14:52:28.301135 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/644739636
- 2017-07-11 14:52:28.757199 I | api: a62d6430-8b62-4272-8a7c-d9e1d7ebf6fa GET /metrics GetMetrics 200 OK 3.81722386s
- 2017-07-11 14:52:29.865133 I | api: 64b4f783-f5e0-4dca-9fca-9eb1eb92152f GET /metrics GetMetrics (start)
- 2017-07-11 14:52:29.865450 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/778265603
- 2017-07-11 14:52:30.340441 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/494886790
- 2017-07-11 14:52:30.782915 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/404027181
- 2017-07-11 14:52:31.263262 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/083183272
- 2017-07-11 14:52:31.719690 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/537076711
- 2017-07-11 14:52:32.074500 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/866990106
- 2017-07-11 14:52:32.838349 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/737303217
- 2017-07-11 14:52:33.318526 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/185154140
- 2017-07-11 14:52:33.773480 I | api: 64b4f783-f5e0-4dca-9fca-9eb1eb92152f GET /metrics GetMetrics 200 OK 3.908318321s
- 2017-07-11 14:52:34.783542 I | api: 195fb380-3c2b-4395-b5d4-7348b0098ead GET /metrics GetMetrics (start)
- 2017-07-11 14:52:34.784305 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/949063179
- 2017-07-11 14:52:35.449856 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/725353454
- 2017-07-11 14:52:35.895597 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/664943733
- 2017-07-11 14:52:36.355276 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/408896848
- 2017-07-11 14:52:36.874934 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/075926127
- 2017-07-11 14:52:37.387875 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/911798018
- 2017-07-11 14:52:37.884672 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/850928761
- 2017-07-11 14:52:38.424264 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/189900164
- 2017-07-11 14:52:38.892234 I | api: 195fb380-3c2b-4395-b5d4-7348b0098ead GET /metrics GetMetrics 200 OK 4.108692385s
- 2017-07-11 14:52:39.711258 I | api: 2a9276d5-47fe-4c4d-8c50-44062a77d828 GET /metrics GetMetrics (start)
- 2017-07-11 14:52:39.712150 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/379804435
- 2017-07-11 14:52:40.196574 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/783439702
- 2017-07-11 14:52:40.669750 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/207628989
- 2017-07-11 14:52:41.159945 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/523412216
- 2017-07-11 14:52:41.690674 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/451248631
- 2017-07-11 14:52:42.082672 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/710293738
- 2017-07-11 14:52:42.686178 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/280774977
- 2017-07-11 14:52:43.165819 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/950681516
- 2017-07-11 14:52:43.628801 I | api: 2a9276d5-47fe-4c4d-8c50-44062a77d828 GET /metrics GetMetrics 200 OK 3.91756068s
- 2017-07-11 14:52:44.633405 I | api: bcff9f28-9462-49d4-8fd2-d4e688263ffb GET /metrics GetMetrics (start)
- 2017-07-11 14:52:44.634367 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/082787099
- 2017-07-11 14:52:45.215863 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/479142334
- 2017-07-11 14:52:45.677604 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/714310661
- 2017-07-11 14:52:46.149154 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/493986208
- 2017-07-11 14:52:46.615939 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/932326015
- 2017-07-11 14:52:47.009885 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/915794898
- 2017-07-11 14:52:47.598553 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/853269257
- 2017-07-11 14:52:48.050844 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/468667092
- 2017-07-11 14:52:48.523998 I | api: bcff9f28-9462-49d4-8fd2-d4e688263ffb GET /metrics GetMetrics 200 OK 3.890592322s
- 2017-07-11 14:52:49.555571 I | api: 2eee1b1f-658f-4494-a53a-c500b19e69db GET /metrics GetMetrics (start)
- 2017-07-11 14:52:49.556527 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/518875683
- 2017-07-11 14:52:50.081408 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/665663782
- 2017-07-11 14:52:51.094162 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/026616909
- 2017-07-11 14:52:51.572354 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/145233736
- 2017-07-11 14:52:51.951785 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/712132103
- 2017-07-11 14:52:52.470961 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/642595770
- 2017-07-11 14:52:52.967937 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/751568849
- 2017-07-11 14:52:53.531986 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/812079356
- 2017-07-11 14:52:53.987972 I | api: 2eee1b1f-658f-4494-a53a-c500b19e69db GET /metrics GetMetrics 200 OK 4.432405179s
- 2017-07-11 14:52:54.480139 I | api: c2e52ebb-db5d-431f-8e79-105494300216 GET /metrics GetMetrics (start)
- 2017-07-11 14:52:54.480900 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/246151723
- 2017-07-11 14:52:54.973487 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/758529422
- 2017-07-11 14:52:55.666047 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/038087573
- 2017-07-11 14:52:56.107817 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/719095792
- 2017-07-11 14:52:56.568590 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/386262671
- 2017-07-11 14:52:56.951690 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/541075106
- 2017-07-11 14:52:57.435713 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/887584153
- 2017-07-11 14:52:57.876242 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/700861988
- 2017-07-11 14:52:58.361862 I | api: c2e52ebb-db5d-431f-8e79-105494300216 GET /metrics GetMetrics 200 OK 3.881712574s
- 2017-07-11 14:52:59.399361 I | api: 7910a9a4-57e3-473d-a337-21beeb7698b0 GET /metrics GetMetrics (start)
- 2017-07-11 14:52:59.400202 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/671574323
- 2017-07-11 14:52:59.850843 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/334300406
- 2017-07-11 14:53:00.308040 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/937833437
- 2017-07-11 14:53:00.782691 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/236723096
- 2017-07-11 14:53:01.293439 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/175137303
- 2017-07-11 14:53:01.740711 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/362464906
- 2017-07-11 14:53:02.148506 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/049659489
- 2017-07-11 14:53:02.654176 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/368753740
- 2017-07-11 14:53:03.154923 I | api: 7910a9a4-57e3-473d-a337-21beeb7698b0 GET /metrics GetMetrics 200 OK 3.755582307s
- 2017-07-11 14:53:04.326901 I | api: fe03932b-12a3-4fb1-890a-f05e5b5877c8 GET /metrics GetMetrics (start)
- 2017-07-11 14:53:04.327660 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/301272379
- 2017-07-11 14:53:04.773238 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/334045534
- 2017-07-11 14:53:05.431125 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/690245413
- 2017-07-11 14:53:05.868928 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/072994880
- 2017-07-11 14:53:06.338570 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/234767519
- 2017-07-11 14:53:06.809434 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/653541746
- 2017-07-11 14:53:07.189871 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/516500009
- 2017-07-11 14:53:07.695347 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/127277940
- 2017-07-11 14:53:08.158611 I | api: fe03932b-12a3-4fb1-890a-f05e5b5877c8 GET /metrics GetMetrics 200 OK 3.831722006s
- 2017-07-11 14:53:09.250217 I | api: 2b4645dc-372e-4786-884b-e2eb84dcaacf GET /metrics GetMetrics (start)
- 2017-07-11 14:53:09.251156 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/144174147
- 2017-07-11 14:53:09.695804 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/231310534
- 2017-07-11 14:53:10.125789 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/880295789
- 2017-07-11 14:53:10.630114 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/232953320
- 2017-07-11 14:53:11.083217 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/235960359
- 2017-07-11 14:53:11.546468 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/890651994
- 2017-07-11 14:53:11.909430 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/856821489
- 2017-07-11 14:53:12.379679 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/912170908
- 2017-07-11 14:53:12.850179 I | api: 2b4645dc-372e-4786-884b-e2eb84dcaacf GET /metrics GetMetrics 200 OK 3.599964935s
- 2017-07-11 14:53:14.174181 I | api: ad4b989c-ca97-45df-92cd-3b91ddf0941d GET /metrics GetMetrics (start)
- 2017-07-11 14:53:14.175089 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/434399307
- 2017-07-11 14:53:14.680308 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/560206126
- 2017-07-11 14:53:15.340251 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/435151029
- 2017-07-11 14:53:15.759149 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/150284432
- 2017-07-11 14:53:16.196507 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/801892015
- 2017-07-11 14:53:16.665488 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/858757698
- 2017-07-11 14:53:17.024836 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/260017337
- 2017-07-11 14:53:17.541116 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/056889540
- 2017-07-11 14:53:18.036752 I | api: ad4b989c-ca97-45df-92cd-3b91ddf0941d GET /metrics GetMetrics 200 OK 3.862560478s
- 2017-07-11 14:53:19.097408 I | api: 4c7aad6e-2847-4275-8297-2a1c8bcc1143 GET /metrics GetMetrics (start)
- 2017-07-11 14:53:19.098537 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/931497811
- 2017-07-11 14:53:19.601509 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/242568342
- 2017-07-11 14:53:20.129029 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/006343933
- 2017-07-11 14:53:20.643282 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/993401400
- 2017-07-11 14:53:21.100633 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/919149623
- 2017-07-11 14:53:21.573854 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/879881770
- 2017-07-11 14:53:21.946452 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/577712001
- 2017-07-11 14:53:22.444939 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/883132652
- 2017-07-11 14:53:22.929429 I | api: 4c7aad6e-2847-4275-8297-2a1c8bcc1143 GET /metrics GetMetrics 200 OK 3.83202559s
- 2017-07-11 14:53:24.021127 I | api: 53fb57ac-7227-4d19-bf6e-566b54eca8be GET /metrics GetMetrics (start)
- 2017-07-11 14:53:24.022031 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/884745563
- 2017-07-11 14:53:24.515291 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/095368446
- 2017-07-11 14:53:25.080865 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/933290053
- 2017-07-11 14:53:25.572370 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/263378144
- 2017-07-11 14:53:26.008455 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/322241215
- 2017-07-11 14:53:26.499179 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/581541138
- 2017-07-11 14:53:26.859466 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/306397001
- 2017-07-11 14:53:27.320110 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/798964756
- 2017-07-11 14:53:27.802534 I | api: 53fb57ac-7227-4d19-bf6e-566b54eca8be GET /metrics GetMetrics 200 OK 3.781407389s
- 2017-07-11 14:53:28.944363 I | api: 68547bc5-5fab-4ed1-b563-a08b70a2474f GET /metrics GetMetrics (start)
- 2017-07-11 14:53:28.945383 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/690384995
- 2017-07-11 14:53:29.415538 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/187522150
- 2017-07-11 14:53:29.882734 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/867363469
- 2017-07-11 14:53:30.382618 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/439092872
- 2017-07-11 14:53:30.863304 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/736475719
- 2017-07-11 14:53:31.334041 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/809546490
- 2017-07-11 14:53:31.771664 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/050757137
- 2017-07-11 14:53:32.174154 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/278724668
- 2017-07-11 14:53:32.628239 I | api: 68547bc5-5fab-4ed1-b563-a08b70a2474f GET /metrics GetMetrics 200 OK 3.683880689s
- 2017-07-11 14:53:33.866423 I | api: c42bd34a-ee80-49fa-95cf-7f5cad19e855 GET /metrics GetMetrics (start)
- 2017-07-11 14:53:33.867295 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/572660843
- 2017-07-11 14:53:34.367829 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/276294350
- 2017-07-11 14:53:34.839388 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/272284117
- 2017-07-11 14:53:35.455313 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/604810544
- 2017-07-11 14:53:36.037411 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/799343823
- 2017-07-11 14:53:36.546910 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/670724578
- 2017-07-11 14:53:36.942965 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/748210137
- 2017-07-11 14:53:37.455710 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/825373028
- 2017-07-11 14:53:37.944563 I | api: c42bd34a-ee80-49fa-95cf-7f5cad19e855 GET /metrics GetMetrics 200 OK 4.078138567s
- 2017-07-11 14:53:38.790032 I | api: 8a7cac3b-fa12-4919-9dd9-1e9d44935ccd GET /metrics GetMetrics (start)
- 2017-07-11 14:53:38.790417 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/598062451
- 2017-07-11 14:53:39.246506 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/308855350
- 2017-07-11 14:53:39.686003 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/764933661
- 2017-07-11 14:53:40.306999 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/779680984
- 2017-07-11 14:53:41.080254 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/955366999
- 2017-07-11 14:53:41.540633 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/360268746
- 2017-07-11 14:53:41.951614 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/964071073
- 2017-07-11 14:53:42.441238 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/749853580
- 2017-07-11 14:53:43.245489 I | api: 8a7cac3b-fa12-4919-9dd9-1e9d44935ccd GET /metrics GetMetrics 200 OK 4.455471846s
- 2017-07-11 14:53:43.714350 I | api: 4db29cc8-d15e-4bbe-9d66-0ce0e0050423 GET /metrics GetMetrics (start)
- 2017-07-11 14:53:43.715317 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/483165051
- 2017-07-11 14:53:44.228265 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/312843934
- 2017-07-11 14:53:44.704254 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/382809957
- 2017-07-11 14:53:45.627652 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/704512384
- 2017-07-11 14:53:46.104712 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/094218463
- 2017-07-11 14:53:46.567320 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/478750386
- 2017-07-11 14:53:46.995062 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/473093737
- 2017-07-11 14:53:47.443673 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/702697140
- 2017-07-11 14:53:48.091993 I | api: 4db29cc8-d15e-4bbe-9d66-0ce0e0050423 GET /metrics GetMetrics 200 OK 4.377641476s
- 2017-07-11 14:53:48.633096 I | api: bb0b8a59-b966-493a-b814-777a1550ceb3 GET /metrics GetMetrics (start)
- 2017-07-11 14:53:48.634134 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/145742979
- 2017-07-11 14:53:49.143602 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/582278150
- 2017-07-11 14:53:49.668895 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/346615725
- 2017-07-11 14:53:50.150621 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/675754792
- 2017-07-11 14:53:50.663333 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/982443111
- 2017-07-11 14:53:51.175627 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/133758618
- 2017-07-11 14:53:51.706633 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/271375153
- 2017-07-11 14:53:52.089841 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/188064476
- 2017-07-11 14:53:52.612329 I | api: bb0b8a59-b966-493a-b814-777a1550ceb3 GET /metrics GetMetrics 200 OK 3.97922565s
- 2017-07-11 14:53:53.556084 I | api: c1a751b2-26c8-4053-adc5-75e40d9d486d GET /metrics GetMetrics (start)
- 2017-07-11 14:53:53.557053 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/344449163
- 2017-07-11 14:53:54.154146 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/482669166
- 2017-07-11 14:53:54.637794 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/159551221
- 2017-07-11 14:53:55.206003 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/541791696
- 2017-07-11 14:53:55.693475 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/963612911
- 2017-07-11 14:53:56.171109 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/171462530
- 2017-07-11 14:53:56.740708 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/104833273
- 2017-07-11 14:53:57.129958 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/434410500
- 2017-07-11 14:53:57.591229 I | api: c1a751b2-26c8-4053-adc5-75e40d9d486d GET /metrics GetMetrics 200 OK 4.035132826s
- 2017-07-11 14:53:58.476385 I | api: 38af470c-9467-4351-9432-08dc528d3d14 GET /metrics GetMetrics (start)
- 2017-07-11 14:53:58.477201 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/176864659
- 2017-07-11 14:53:58.925657 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/796123094
- 2017-07-11 14:53:59.398025 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/431937341
- 2017-07-11 14:53:59.842670 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/581016440
- 2017-07-11 14:54:00.505589 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/811819639
- 2017-07-11 14:54:01.001446 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/437441898
- 2017-07-11 14:54:01.507148 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/428047809
- 2017-07-11 14:54:01.883177 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/707979820
- 2017-07-11 14:54:02.346349 I | api: 38af470c-9467-4351-9432-08dc528d3d14 GET /metrics GetMetrics 200 OK 3.869969132s
- 2017-07-11 14:54:03.397520 I | api: d11b6972-e68c-4d09-9aee-f229b0b50a9f GET /metrics GetMetrics (start)
- 2017-07-11 14:54:03.398451 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/666114459
- 2017-07-11 14:54:03.882321 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/030940222
- 2017-07-11 14:54:04.498511 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/877117573
- 2017-07-11 14:54:05.126827 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/412674592
- 2017-07-11 14:54:05.586036 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/558635775
- 2017-07-11 14:54:06.063322 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/807702098
- 2017-07-11 14:54:06.523083 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/829347209
- 2017-07-11 14:54:06.906999 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/803054420
- 2017-07-11 14:54:07.379964 I | api: d11b6972-e68c-4d09-9aee-f229b0b50a9f GET /metrics GetMetrics 200 OK 3.98244273s
- 2017-07-11 14:54:08.319949 I | api: a7986c31-9785-486a-bb34-713eed647e99 GET /metrics GetMetrics (start)
- 2017-07-11 14:54:08.320868 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/975657123
- 2017-07-11 14:54:08.778017 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/451071398
- 2017-07-11 14:54:09.243906 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/428311757
- 2017-07-11 14:54:09.716853 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/969360328
- 2017-07-11 14:54:10.245975 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/998576263
- 2017-07-11 14:54:10.711267 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/364055610
- 2017-07-11 14:54:11.228430 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/281880145
- 2017-07-11 14:54:11.667524 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/284444028
- 2017-07-11 14:54:12.034726 I | api: a7986c31-9785-486a-bb34-713eed647e99 GET /metrics GetMetrics 200 OK 3.71478027s
- 2017-07-11 14:54:13.243322 I | api: a523af5e-baef-42ae-b928-0463f633c83e GET /metrics GetMetrics (start)
- 2017-07-11 14:54:13.244241 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/942836907
- 2017-07-11 14:54:13.711782 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/070071822
- 2017-07-11 14:54:14.178239 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/721061909
- 2017-07-11 14:54:14.622949 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/272082544
- 2017-07-11 14:54:15.569834 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/462995727
- 2017-07-11 14:54:16.045558 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/354131746
- 2017-07-11 14:54:16.498774 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/580409881
- 2017-07-11 14:54:16.870162 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/122480804
- 2017-07-11 14:54:17.336772 I | api: a523af5e-baef-42ae-b928-0463f633c83e GET /metrics GetMetrics 200 OK 4.093460312s
- 2017-07-11 14:54:18.166595 I | api: 9beecd01-6017-499b-9547-649ba462cd2e GET /metrics GetMetrics (start)
- 2017-07-11 14:54:18.167660 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/535577011
- 2017-07-11 14:54:18.677142 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/954846582
- 2017-07-11 14:54:19.151506 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/862055005
- 2017-07-11 14:54:19.708376 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/202213912
- 2017-07-11 14:54:20.167217 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/042290327
- 2017-07-11 14:54:20.606480 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/101439754
- 2017-07-11 14:54:21.138077 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/719191265
- 2017-07-11 14:54:21.608182 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/389668044
- 2017-07-11 14:54:21.989083 I | api: 9beecd01-6017-499b-9547-649ba462cd2e GET /metrics GetMetrics 200 OK 3.822482752s
- 2017-07-11 14:54:23.090271 I | api: 5195943f-68fb-4e4c-8403-d94e81c1d653 GET /metrics GetMetrics (start)
- 2017-07-11 14:54:23.091281 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/807704507
- 2017-07-11 14:54:23.557866 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/544220638
- 2017-07-11 14:54:24.140801 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/973603237
- 2017-07-11 14:54:24.574918 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/665944256
- 2017-07-11 14:54:25.166193 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/191633183
- 2017-07-11 14:54:25.630997 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/649733106
- 2017-07-11 14:54:26.099603 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/685766825
- 2017-07-11 14:54:26.558387 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/580029428
- 2017-07-11 14:54:26.931235 I | api: 5195943f-68fb-4e4c-8403-d94e81c1d653 GET /metrics GetMetrics 200 OK 3.840963475s
- 2017-07-11 14:54:28.012153 I | api: 86b4c5f6-22f4-40ca-9e62-380b84a423f4 GET /metrics GetMetrics (start)
- 2017-07-11 14:54:28.012822 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/417678019
- 2017-07-11 14:54:28.472930 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/406842694
- 2017-07-11 14:54:28.919312 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/679206893
- 2017-07-11 14:54:29.475591 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/050584168
- 2017-07-11 14:54:29.935110 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/130308775
- 2017-07-11 14:54:30.558545 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/832263642
- 2017-07-11 14:54:31.125044 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/965649265
- 2017-07-11 14:54:31.591768 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/630373916
- 2017-07-11 14:54:31.945084 I | api: 86b4c5f6-22f4-40ca-9e62-380b84a423f4 GET /metrics GetMetrics 200 OK 3.932934588s
- 2017-07-11 14:54:32.931362 I | api: 2a2f5a09-4c5c-4b34-aaba-589c5b39e11f GET /metrics GetMetrics (start)
- 2017-07-11 14:54:32.932276 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/595620043
- 2017-07-11 14:54:33.413235 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/359207854
- 2017-07-11 14:54:33.888468 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/479872821
- 2017-07-11 14:54:34.356447 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/483438352
- 2017-07-11 14:54:35.114209 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/049090351
- 2017-07-11 14:54:35.611271 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/125663938
- 2017-07-11 14:54:36.093121 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/578021177
- 2017-07-11 14:54:36.885354 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/578705220
- 2017-07-11 14:54:37.276832 I | api: 2a2f5a09-4c5c-4b34-aaba-589c5b39e11f GET /metrics GetMetrics 200 OK 4.34547109s
- 2017-07-11 14:54:37.855263 I | api: 2436843d-9027-47ad-b70a-402dbccc4e15 GET /metrics GetMetrics (start)
- 2017-07-11 14:54:37.855452 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/019046355
- 2017-07-11 14:54:38.330313 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/202883350
- 2017-07-11 14:54:38.773515 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/776548221
- 2017-07-11 14:54:39.279356 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/857365688
- 2017-07-11 14:54:39.790742 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/046445239
- 2017-07-11 14:54:40.333347 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/698523306
- 2017-07-11 14:54:40.770367 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/117288449
- 2017-07-11 14:54:41.300844 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/205070188
- 2017-07-11 14:54:41.771403 I | api: 2436843d-9027-47ad-b70a-402dbccc4e15 GET /metrics GetMetrics 200 OK 3.916142911s
- 2017-07-11 14:54:42.778002 I | api: f52e9131-e033-4846-aeda-e494ba2da41b GET /metrics GetMetrics (start)
- 2017-07-11 14:54:42.778826 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/316769243
- 2017-07-11 14:54:43.273066 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/347016574
- 2017-07-11 14:54:43.709755 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/718538949
- 2017-07-11 14:54:44.203127 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/594137952
- 2017-07-11 14:54:44.690050 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/987881279
- 2017-07-11 14:54:45.368658 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/769755538
- 2017-07-11 14:54:45.833888 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/620618185
- 2017-07-11 14:54:46.363695 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/374322836
- 2017-07-11 14:54:46.814410 I | api: f52e9131-e033-4846-aeda-e494ba2da41b GET /metrics GetMetrics 200 OK 4.036405004s
- 2017-07-11 14:54:47.701044 I | api: 71951e5f-3f5b-48e5-9449-9711892344a5 GET /metrics GetMetrics (start)
- 2017-07-11 14:54:47.702038 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/661367011
- 2017-07-11 14:54:48.364187 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/229915366
- 2017-07-11 14:54:48.870822 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/122552589
- 2017-07-11 14:54:49.692965 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/764419848
- 2017-07-11 14:54:50.144777 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/684055751
- 2017-07-11 14:54:50.754868 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/226431354
- 2017-07-11 14:54:51.292202 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/146363025
- 2017-07-11 14:54:51.774408 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/246229180
- 2017-07-11 14:54:52.128756 I | api: 71951e5f-3f5b-48e5-9449-9711892344a5 GET /metrics GetMetrics 200 OK 4.427716776s
- 2017-07-11 14:54:52.613617 I | api: 99a1c4e8-6f0c-4578-86c6-6ba53945101b GET /metrics GetMetrics (start)
- 2017-07-11 14:54:52.614662 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/630088939
- 2017-07-11 14:54:53.124253 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/690681678
- 2017-07-11 14:54:53.603367 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/563020373
- 2017-07-11 14:54:54.050708 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/010318768
- 2017-07-11 14:54:54.504505 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/286992719
- 2017-07-11 14:54:55.214795 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/666500706
- 2017-07-11 14:54:55.661774 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/703633497
- 2017-07-11 14:54:56.144296 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/122716644
- 2017-07-11 14:54:56.604473 I | api: 99a1c4e8-6f0c-4578-86c6-6ba53945101b GET /metrics GetMetrics 200 OK 3.990864122s
- 2017-07-11 14:54:57.552467 I | api: b0d5edfd-802e-4222-b598-a4a05e3079cb GET /metrics GetMetrics (start)
- 2017-07-11 14:54:57.553385 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/334195699
- 2017-07-11 14:54:58.023110 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/535538870
- 2017-07-11 14:54:58.903723 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/058207389
- 2017-07-11 14:54:59.427709 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/169850200
- 2017-07-11 14:54:59.979297 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/069833943
- 2017-07-11 14:55:00.438592 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/111045194
- 2017-07-11 14:55:00.987081 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/137397025
- 2017-07-11 14:55:01.472043 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/752398860
- 2017-07-11 14:55:01.913483 I | api: b0d5edfd-802e-4222-b598-a4a05e3079cb GET /metrics GetMetrics 200 OK 4.361028935s
- 2017-07-11 14:55:02.485743 I | api: 79269ca0-3587-4db8-8e34-57b6cda5fef8 GET /metrics GetMetrics (start)
- 2017-07-11 14:55:02.486573 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/406669819
- 2017-07-11 14:55:02.926324 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/478721822
- 2017-07-11 14:55:03.420721 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/172241893
- 2017-07-11 14:55:03.882238 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/293907456
- 2017-07-11 14:55:04.336739 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/115286879
- 2017-07-11 14:55:05.222185 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/436387634
- 2017-07-11 14:55:05.679620 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/594921193
- 2017-07-11 14:55:06.131839 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/042048820
- 2017-07-11 14:55:06.595873 I | api: 79269ca0-3587-4db8-8e34-57b6cda5fef8 GET /metrics GetMetrics 200 OK 4.110129198s
- 2017-07-11 14:55:07.419492 I | api: 1a3ad4f4-d904-4c2c-b326-60a7a0281d28 GET /metrics GetMetrics (start)
- 2017-07-11 14:55:07.420406 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/373459715
- 2017-07-11 14:55:07.853971 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/162962566
- 2017-07-11 14:55:08.399722 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/238096429
- 2017-07-11 14:55:08.874223 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/365147048
- 2017-07-11 14:55:09.366689 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/697017575
- 2017-07-11 14:55:09.858438 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/590829850
- 2017-07-11 14:55:10.309486 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/882972593
- 2017-07-11 14:55:10.756986 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/750510940
- 2017-07-11 14:55:11.262354 I | api: 1a3ad4f4-d904-4c2c-b326-60a7a0281d28 GET /metrics GetMetrics 200 OK 3.842854773s
- 2017-07-11 14:55:12.352936 I | api: c452d2b2-1fea-47dd-98b7-6dfcafff6650 GET /metrics GetMetrics (start)
- 2017-07-11 14:55:12.353785 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/293159179
- 2017-07-11 14:55:12.808849 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/130029294
- 2017-07-11 14:55:13.283076 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/111586165
- 2017-07-11 14:55:13.847333 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/654018640
- 2017-07-11 14:55:14.305987 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/210002287
- 2017-07-11 14:55:14.779579 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/775887874
- 2017-07-11 14:55:15.683677 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/830869369
- 2017-07-11 14:55:16.135101 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/114724996
- 2017-07-11 14:55:16.596921 I | api: c452d2b2-1fea-47dd-98b7-6dfcafff6650 GET /metrics GetMetrics 200 OK 4.243985542s
- 2017-07-11 14:55:17.286264 I | api: 815ae377-b87f-4c1d-991f-95264b4a6804 GET /metrics GetMetrics (start)
- 2017-07-11 14:55:17.287143 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/844991507
- 2017-07-11 14:55:17.805911 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/115501142
- 2017-07-11 14:55:18.328575 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/226188221
- 2017-07-11 14:55:18.851859 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/172332024
- 2017-07-11 14:55:19.304370 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/908922103
- 2017-07-11 14:55:19.752996 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/872547818
- 2017-07-11 14:55:20.229459 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/119779905
- 2017-07-11 14:55:20.691427 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/817927340
- 2017-07-11 14:55:21.285448 I | api: 815ae377-b87f-4c1d-991f-95264b4a6804 GET /metrics GetMetrics 200 OK 3.999187216s
- 2017-07-11 14:55:22.220052 I | api: 2ec35f4f-fb0c-43b4-bd56-01a865033c8b GET /metrics GetMetrics (start)
- 2017-07-11 14:55:22.220931 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/505359899
- 2017-07-11 14:55:22.671718 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/178498238
- 2017-07-11 14:55:23.129036 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/588943621
- 2017-07-11 14:55:23.578588 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/828739744
- 2017-07-11 14:55:24.089092 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/440156543
- 2017-07-11 14:55:24.584601 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/716921042
- 2017-07-11 14:55:25.399386 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/657482761
- 2017-07-11 14:55:25.830720 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/184931284
- 2017-07-11 14:55:26.297630 I | api: 2ec35f4f-fb0c-43b4-bd56-01a865033c8b GET /metrics GetMetrics 200 OK 4.077576665s
- 2017-07-11 14:55:27.152842 I | api: 01829546-ce5f-4423-9232-8344576ac65f GET /metrics GetMetrics (start)
- 2017-07-11 14:55:27.153609 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/992833315
- 2017-07-11 14:55:27.603521 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/846236198
- 2017-07-11 14:55:28.063568 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/552016717
- 2017-07-11 14:55:28.595697 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/811298888
- 2017-07-11 14:55:29.339441 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/052278023
- 2017-07-11 14:55:29.786941 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/800789178
- 2017-07-11 14:55:30.315638 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/944536273
- 2017-07-11 14:55:30.813254 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/244748284
- 2017-07-11 14:55:31.263562 I | api: 01829546-ce5f-4423-9232-8344576ac65f GET /metrics GetMetrics 200 OK 4.110725197s
- 2017-07-11 14:55:32.086272 I | api: 1cc60563-6b28-4a7b-aa21-d479af1ffcd2 GET /metrics GetMetrics (start)
- 2017-07-11 14:55:32.087201 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/161436971
- 2017-07-11 14:55:32.570680 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/467718286
- 2017-07-11 14:55:33.287048 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/755533461
- 2017-07-11 14:55:33.733526 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/477635312
- 2017-07-11 14:55:34.793316 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/664916367
- 2017-07-11 14:55:35.393322 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/641679266
- 2017-07-11 14:55:35.864835 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/921138329
- 2017-07-11 14:55:36.342034 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/250484516
- 2017-07-11 14:55:36.801439 I | api: 1cc60563-6b28-4a7b-aa21-d479af1ffcd2 GET /metrics GetMetrics 200 OK 4.715143832s
- 2017-07-11 14:55:37.019765 I | api: a1f45667-702d-494f-9c31-cb2f69bdc71b GET /metrics GetMetrics (start)
- 2017-07-11 14:55:37.020807 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/507672627
- 2017-07-11 14:55:37.771903 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/272840694
- 2017-07-11 14:55:38.221863 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/076273373
- 2017-07-11 14:55:38.749400 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/716827288
- 2017-07-11 14:55:39.194305 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/680895255
- 2017-07-11 14:55:39.659209 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/167763338
- 2017-07-11 14:55:40.577119 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/229905249
- 2017-07-11 14:55:41.039587 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/670956876
- 2017-07-11 14:55:41.519093 I | api: a1f45667-702d-494f-9c31-cb2f69bdc71b GET /metrics GetMetrics 200 OK 4.499342039s
- 2017-07-11 14:55:42.020116 I | api: 764d9a4a-003e-434a-b650-1a5bd7a7eb9b GET /metrics GetMetrics (start)
- 2017-07-11 14:55:42.021087 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/075516475
- 2017-07-11 14:55:42.448062 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/935602782
- 2017-07-11 14:55:42.887549 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/941953573
- 2017-07-11 14:55:43.341838 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/703793472
- 2017-07-11 14:55:43.832776 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/117131167
- 2017-07-11 14:55:44.302445 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/772288114
- 2017-07-11 14:55:44.767230 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/419733289
- 2017-07-11 14:55:45.418717 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/740238452
- 2017-07-11 14:55:45.894027 I | api: 764d9a4a-003e-434a-b650-1a5bd7a7eb9b GET /metrics GetMetrics 200 OK 3.873912392s
- 2017-07-11 14:55:46.949753 I | api: 000cffc1-bc51-47a3-b51a-fdb75579fea1 GET /metrics GetMetrics (start)
- 2017-07-11 14:55:46.950057 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/910375747
- 2017-07-11 14:55:47.385281 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/267239878
- 2017-07-11 14:55:47.895615 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/752020589
- 2017-07-11 14:55:48.381360 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/290825448
- 2017-07-11 14:55:48.844483 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/478804263
- 2017-07-11 14:55:49.351285 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/792894554
- 2017-07-11 14:55:49.877720 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/745448433
- 2017-07-11 14:55:50.406643 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/723563676
- 2017-07-11 14:55:50.974759 I | api: 000cffc1-bc51-47a3-b51a-fdb75579fea1 GET /metrics GetMetrics 200 OK 4.025009432s
- 2017-07-11 14:55:51.884929 I | api: bc916ae5-3e50-4a74-aebe-3504e5d1dee1 GET /metrics GetMetrics (start)
- 2017-07-11 14:55:51.885782 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/616055627
- 2017-07-11 14:55:52.328909 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/219147822
- 2017-07-11 14:55:52.767951 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/548936117
- 2017-07-11 14:55:53.207457 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/806068624
- 2017-07-11 14:55:53.913406 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/376801199
- 2017-07-11 14:55:54.392649 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/955434818
- 2017-07-11 14:55:54.960487 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/203506105
- 2017-07-11 14:55:55.525531 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/446195652
- 2017-07-11 14:55:55.996847 I | api: bc916ae5-3e50-4a74-aebe-3504e5d1dee1 GET /metrics GetMetrics 200 OK 4.111920091s
- 2017-07-11 14:55:56.817764 I | api: 5cbc8164-b792-4117-a46f-eb00a67b40cf GET /metrics GetMetrics (start)
- 2017-07-11 14:55:56.818636 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/115390547
- 2017-07-11 14:55:57.204088 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/735206806
- 2017-07-11 14:55:57.752161 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/630545405
- 2017-07-11 14:55:58.212048 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/949540152
- 2017-07-11 14:55:58.798985 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/463920439
- 2017-07-11 14:55:59.254221 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/127580970
- 2017-07-11 14:55:59.739703 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/573544577
- 2017-07-11 14:56:00.248215 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/473882092
- 2017-07-11 14:56:00.755338 I | api: 5cbc8164-b792-4117-a46f-eb00a67b40cf GET /metrics GetMetrics 200 OK 3.937575683s
- 2017-07-11 14:56:01.750314 I | api: 61b93069-39dd-404b-b677-8f1b0b5cebbe GET /metrics GetMetrics (start)
- 2017-07-11 14:56:01.751154 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/679310939
- 2017-07-11 14:56:02.133953 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/144093182
- 2017-07-11 14:56:02.596699 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/398495557
- 2017-07-11 14:56:03.146395 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/506160608
- 2017-07-11 14:56:03.586282 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/704284095
- 2017-07-11 14:56:04.062470 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/267127314
- 2017-07-11 14:56:04.527886 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/990955593
- 2017-07-11 14:56:04.987902 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/275750164
- 2017-07-11 14:56:05.586543 I | api: 61b93069-39dd-404b-b677-8f1b0b5cebbe GET /metrics GetMetrics 200 OK 3.836228383s
- 2017-07-11 14:56:06.680748 I | api: a41d1349-3f5f-423c-bc7a-c3b2fbff5564 GET /metrics GetMetrics (start)
- 2017-07-11 14:56:06.681724 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/699181923
- 2017-07-11 14:56:07.082449 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/811055974
- 2017-07-11 14:56:07.539226 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/982311309
- 2017-07-11 14:56:08.009506 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/580832136
- 2017-07-11 14:56:08.503439 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/436348743
- 2017-07-11 14:56:08.991666 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/449888250
- 2017-07-11 14:56:09.469350 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/230341393
- 2017-07-11 14:56:09.980485 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/959574844
- 2017-07-11 14:56:10.449467 I | api: a41d1349-3f5f-423c-bc7a-c3b2fbff5564 GET /metrics GetMetrics 200 OK 3.76872392s
- 2017-07-11 14:56:11.611298 I | api: 8b1dbfdd-af41-405a-bd1d-418953c9ef22 GET /metrics GetMetrics (start)
- 2017-07-11 14:56:11.612192 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/957773675
- 2017-07-11 14:56:12.038831 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/214583246
- 2017-07-11 14:56:12.486061 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/329716949
- 2017-07-11 14:56:13.000509 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/520988208
- 2017-07-11 14:56:13.447239 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/064090063
- 2017-07-11 14:56:13.969387 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/502355170
- 2017-07-11 14:56:14.443190 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/699858137
- 2017-07-11 14:56:14.887091 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/478766692
- 2017-07-11 14:56:15.455064 I | api: 8b1dbfdd-af41-405a-bd1d-418953c9ef22 GET /metrics GetMetrics 200 OK 3.843764948s
- 2017-07-11 14:56:16.546280 I | api: d99aa8bf-7f7b-4946-a4ab-9c7be77d3c03 GET /metrics GetMetrics (start)
- 2017-07-11 14:56:16.547190 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/053569139
- 2017-07-11 14:56:17.004833 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/577500470
- 2017-07-11 14:56:17.471118 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/597779229
- 2017-07-11 14:56:17.904877 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/951124440
- 2017-07-11 14:56:18.395295 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/066949975
- 2017-07-11 14:56:18.878992 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/239112394
- 2017-07-11 14:56:19.525402 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/081674657
- 2017-07-11 14:56:20.034368 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/757027468
- 2017-07-11 14:56:20.653761 I | api: d99aa8bf-7f7b-4946-a4ab-9c7be77d3c03 GET /metrics GetMetrics 200 OK 4.107485478s
- 2017-07-11 14:56:21.477341 I | api: ac1f93b0-3e7e-4176-ab22-8049336ac7cb GET /metrics GetMetrics (start)
- 2017-07-11 14:56:21.478241 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/503572603
- 2017-07-11 14:56:22.051116 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/922958750
- 2017-07-11 14:56:22.545371 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/434805861
- 2017-07-11 14:56:22.987304 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/674670208
- 2017-07-11 14:56:23.651920 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/342990303
- 2017-07-11 14:56:24.153700 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/664750514
- 2017-07-11 14:56:24.648889 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/453121385
- 2017-07-11 14:56:25.078673 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/104855988
- 2017-07-11 14:56:25.636027 I | api: ac1f93b0-3e7e-4176-ab22-8049336ac7cb GET /metrics GetMetrics 200 OK 4.158679898s
- 2017-07-11 14:56:26.411575 I | api: ab6a650a-93ad-4681-ba25-57c1451dc167 GET /metrics GetMetrics (start)
- 2017-07-11 14:56:26.412453 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/589390211
- 2017-07-11 14:56:26.832046 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/620083974
- 2017-07-11 14:56:27.503045 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/433522861
- 2017-07-11 14:56:27.984934 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/982808616
- 2017-07-11 14:56:28.436985 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/640612711
- 2017-07-11 14:56:28.936046 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/895636890
- 2017-07-11 14:56:29.439167 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/464020017
- 2017-07-11 14:56:29.902795 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/208427484
- 2017-07-11 14:56:30.369887 I | api: ab6a650a-93ad-4681-ba25-57c1451dc167 GET /metrics GetMetrics 200 OK 3.958315906s
- 2017-07-11 14:56:31.344498 I | api: 73f02f68-8150-47d5-96f7-f4e2fbd026a7 GET /metrics GetMetrics (start)
- 2017-07-11 14:56:31.345453 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/406974859
- 2017-07-11 14:56:31.866398 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/419286894
- 2017-07-11 14:56:32.229364 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/359909365
- 2017-07-11 14:56:32.655748 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/765866192
- 2017-07-11 14:56:33.212259 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/143615983
- 2017-07-11 14:56:33.703848 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/866314370
- 2017-07-11 14:56:34.198675 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/404768761
- 2017-07-11 14:56:34.655147 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/345552132
- 2017-07-11 14:56:35.348008 I | api: 73f02f68-8150-47d5-96f7-f4e2fbd026a7 GET /metrics GetMetrics 200 OK 4.003517227s
- 2017-07-11 14:56:36.276772 I | api: 9f462ac4-35e9-4ba7-8d7e-537218148e6a GET /metrics GetMetrics (start)
- 2017-07-11 14:56:36.277095 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/364675731
- 2017-07-11 14:56:36.724849 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/862136022
- 2017-07-11 14:56:37.098085 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/618082365
- 2017-07-11 14:56:37.682754 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/391389304
- 2017-07-11 14:56:38.151538 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/144819575
- 2017-07-11 14:56:38.642979 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/525560938
- 2017-07-11 14:56:39.402482 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/805444801
- 2017-07-11 14:56:39.868420 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/763941676
- 2017-07-11 14:56:40.443302 I | api: 9f462ac4-35e9-4ba7-8d7e-537218148e6a GET /metrics GetMetrics 200 OK 4.166534561s
- 2017-07-11 14:56:41.207995 I | api: 7b24ecd1-9441-4533-8850-ad0b27791fbd GET /metrics GetMetrics (start)
- 2017-07-11 14:56:41.208300 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/949723291
- 2017-07-11 14:56:41.773563 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/821153086
- 2017-07-11 14:56:42.194024 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/131100549
- 2017-07-11 14:56:42.681925 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/204921120
- 2017-07-11 14:56:43.157236 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/462959103
- 2017-07-11 14:56:43.657283 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/522110290
- 2017-07-11 14:56:44.120149 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/860891273
- 2017-07-11 14:56:44.650548 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/171457108
- 2017-07-11 14:56:45.083561 I | api: 7b24ecd1-9441-4533-8850-ad0b27791fbd GET /metrics GetMetrics 200 OK 3.875547466s
- 2017-07-11 14:56:46.137974 I | api: d77dcaa0-d39c-4637-950b-b49e77feab30 GET /metrics GetMetrics (start)
- 2017-07-11 14:56:46.138723 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/583280547
- 2017-07-11 14:56:51.072550 I | api: c0e3a6f4-341a-45d3-8f46-e6322a2a1346 GET /metrics GetMetrics (start)
- 2017-07-11 14:56:56.005192 I | api: 01477f66-c854-4c08-85d9-193de4f4bdd4 GET /metrics GetMetrics (start)
- 2017-07-11 14:56:56.635433 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/119204006
- 2017-07-11 14:57:00.938251 I | api: d099f885-a9f9-4621-8276-0be8c79ac633 GET /metrics GetMetrics (start)
- 2017-07-11 14:57:05.870041 I | api: 2a11f67c-365a-4898-a677-c03699143d57 GET /metrics GetMetrics (start)
- 2017-07-11 14:57:07.178771 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/162850765
- 2017-07-11 14:57:07.928242 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/912563400
- 2017-07-11 14:57:10.802754 I | api: d053c48f-da80-44d9-b3a4-e1cd0686de03 GET /metrics GetMetrics (start)
- 2017-07-11 14:57:15.735101 I | api: b1574e3c-b781-4b3e-a2f9-76fb8b84c1bd GET /metrics GetMetrics (start)
- 2017-07-11 14:57:20.667313 I | api: b15db633-42cb-44ed-a3b5-be748f593a53 GET /metrics GetMetrics (start)
- 2017-07-11 14:57:25.599857 I | api: 73cde09c-c23d-4d03-b55c-b3ee352f43ec GET /metrics GetMetrics (start)
- 2017-07-11 14:57:27.659413 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/538082695
- 2017-07-11 14:57:30.531868 I | api: 905e62a0-d784-4af9-9516-e3741d6e9679 GET /metrics GetMetrics (start)
- 2017-07-11 14:57:35.463877 I | api: 64972cc7-dc27-40a2-a8cd-3ac28a8196f4 GET /metrics GetMetrics (start)
- 2017-07-11 14:57:40.395809 I | api: ceee0888-202e-48bc-a4c1-83ae02df55ae GET /metrics GetMetrics (start)
- 2017-07-11 14:57:45.329659 I | api: 12e51265-263a-4346-bb65-41a9b8863302 GET /metrics GetMetrics (start)
- 2017-07-11 14:57:53.152533 I | api: 920e4f81-0d16-49a9-b982-6c38e6f1d233 GET /metrics GetMetrics (start)
- 2017-07-11 14:57:58.084286 I | api: 8bf732ea-1caa-4bfa-890e-5ed93675398b GET /metrics GetMetrics (start)
- 2017-07-11 14:57:58.582653 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/315262266
- 2017-07-11 14:57:59.063960 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/746559825
- 2017-07-11 14:57:59.583011 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/323893372
- 2017-07-11 14:58:00.021301 I | api: d77dcaa0-d39c-4637-950b-b49e77feab30 GET /metrics GetMetrics 200 OK 1m13.883327218s
- 2017-07-11 14:58:00.030559 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/398635435
- 2017-07-11 14:58:00.510831 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/408354574
- 2017-07-11 14:58:01.094572 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/390428437
- 2017-07-11 14:58:01.546363 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/651009904
- 2017-07-11 14:58:02.017711 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/025579023
- 2017-07-11 14:58:02.487378 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/134892578
- 2017-07-11 14:58:02.947586 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/990533913
- 2017-07-11 14:58:03.014575 I | api: 83e39f49-562d-4ecd-9f41-2c6bdde13e56 GET /metrics GetMetrics (start)
- 2017-07-11 14:58:03.426093 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/084483492
- 2017-07-11 14:58:03.871663 I | api: c0e3a6f4-341a-45d3-8f46-e6322a2a1346 GET /metrics GetMetrics 200 OK 1m12.799118114s
- 2017-07-11 14:58:03.877540 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/748221107
- 2017-07-11 14:58:04.355215 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/818910326
- 2017-07-11 14:58:04.802885 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/493091165
- 2017-07-11 14:58:05.362817 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/464528152
- 2017-07-11 14:58:05.892647 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/903281047
- 2017-07-11 14:58:06.377852 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/661319690
- 2017-07-11 14:58:06.844888 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/441340385
- 2017-07-11 14:58:07.226997 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/696037836
- 2017-07-11 14:58:07.705058 I | api: 01477f66-c854-4c08-85d9-193de4f4bdd4 GET /metrics GetMetrics 200 OK 1m11.699869421s
- 2017-07-11 14:58:07.705290 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/043842747
- 2017-07-11 14:58:07.951661 I | api: 188d405a-e5a5-4e7e-8b64-851ee9961d3a GET /metrics GetMetrics (start)
- 2017-07-11 14:58:08.163184 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/112561374
- 2017-07-11 14:58:08.608329 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/876608165
- 2017-07-11 14:58:09.101296 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/059347392
- 2017-07-11 14:58:09.553208 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/192299551
- 2017-07-11 14:58:10.013854 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/899865330
- 2017-07-11 14:58:10.494480 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/356712873
- 2017-07-11 14:58:10.945177 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/754999028
- 2017-07-11 14:58:11.473337 I | api: d099f885-a9f9-4621-8276-0be8c79ac633 GET /metrics GetMetrics 200 OK 1m10.535093834s
- 2017-07-11 14:58:11.473594 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/045209027
- 2017-07-11 14:58:11.917863 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/490613318
- 2017-07-11 14:58:12.398084 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/863855853
- 2017-07-11 14:58:12.833704 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/080093032
- 2017-07-11 14:58:12.892708 I | api: adfb2edf-2667-4319-b101-3e391a3ace87 GET /metrics GetMetrics (start)
- 2017-07-11 14:58:13.284966 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/831194023
- 2017-07-11 14:58:13.747939 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/135010522
- 2017-07-11 14:58:14.217943 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/203241585
- 2017-07-11 14:58:14.697736 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/232706844
- 2017-07-11 14:58:15.305366 I | api: 2a11f67c-365a-4898-a677-c03699143d57 GET /metrics GetMetrics 200 OK 1m9.435323737s
- 2017-07-11 14:58:15.315772 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/287356875
- 2017-07-11 14:58:15.833686 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/596911790
- 2017-07-11 14:58:16.309492 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/186234421
- 2017-07-11 14:58:16.775356 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/138463760
- 2017-07-11 14:58:17.251531 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/703480879
- 2017-07-11 14:58:17.719762 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/489310658
- 2017-07-11 14:58:17.824944 I | api: c023f2ed-479a-4687-9320-bdfeb63a8c79 GET /metrics GetMetrics (start)
- 2017-07-11 14:58:18.165831 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/217236537
- 2017-07-11 14:58:18.659646 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/364003908
- 2017-07-11 14:58:19.167233 I | api: d053c48f-da80-44d9-b3a4-e1cd0686de03 GET /metrics GetMetrics 200 OK 1m8.364484852s
- 2017-07-11 14:58:19.167487 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/495988435
- 2017-07-11 14:58:19.651072 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/255068182
- 2017-07-11 14:58:20.457239 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/480938109
- 2017-07-11 14:58:20.911240 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/068987832
- 2017-07-11 14:58:21.376211 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/278871479
- 2017-07-11 14:58:21.824753 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/382036906
- 2017-07-11 14:58:22.388331 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/806019329
- 2017-07-11 14:58:22.756284 I | api: 87ce0334-da94-463a-ad27-ed32c3607980 GET /metrics GetMetrics (start)
- 2017-07-11 14:58:23.007686 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/762920556
- 2017-07-11 14:58:23.462742 I | api: b1574e3c-b781-4b3e-a2f9-76fb8b84c1bd GET /metrics GetMetrics 200 OK 1m7.72764685s
- 2017-07-11 14:58:23.462963 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/616537819
- 2017-07-11 14:58:24.063656 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/680902270
- 2017-07-11 14:58:24.532722 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/254471621
- 2017-07-11 14:58:24.971814 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/167218272
- 2017-07-11 14:58:25.604684 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/357520447
- 2017-07-11 14:58:26.068474 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/657347730
- 2017-07-11 14:58:26.586304 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/055722697
- 2017-07-11 14:58:27.031447 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/765438868
- 2017-07-11 14:58:27.393035 I | api: b15db633-42cb-44ed-a3b5-be748f593a53 GET /metrics GetMetrics 200 OK 1m6.72572672s
- 2017-07-11 14:58:27.393288 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/521738723
- 2017-07-11 14:58:27.683117 I | api: 55092639-ab88-4a68-8bc8-a4d037c61147 GET /metrics GetMetrics (start)
- 2017-07-11 14:58:27.850077 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/314087910
- 2017-07-11 14:58:28.294786 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/211758605
- 2017-07-11 14:58:28.765973 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/424811016
- 2017-07-11 14:58:29.261267 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/248134599
- 2017-07-11 14:58:29.716327 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/727284858
- 2017-07-11 14:58:30.211250 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/899649425
- 2017-07-11 14:58:30.692485 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/754695612
- 2017-07-11 14:58:31.140297 I | api: 73cde09c-c23d-4d03-b55c-b3ee352f43ec GET /metrics GetMetrics 200 OK 1m5.540419168s
- 2017-07-11 14:58:31.146065 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/347365867
- 2017-07-11 14:58:31.763386 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/009917518
- 2017-07-11 14:58:32.172146 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/411234645
- 2017-07-11 14:58:32.620131 I | api: a0ec1530-d499-4864-870e-8b4a1333dacc GET /metrics GetMetrics (start)
- 2017-07-11 14:58:32.892532 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/157107376
- 2017-07-11 14:58:33.336757 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/869222991
- 2017-07-11 14:58:33.864446 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/614495586
- 2017-07-11 14:58:34.334648 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/112615769
- 2017-07-11 14:58:34.801301 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/598166244
- 2017-07-11 14:58:35.469760 I | api: 905e62a0-d784-4af9-9516-e3741d6e9679 GET /metrics GetMetrics 200 OK 1m4.937898s
- 2017-07-11 14:58:35.470049 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/736673523
- 2017-07-11 14:58:35.937210 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/555302326
- 2017-07-11 14:58:36.430559 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/001284509
- 2017-07-11 14:58:36.861531 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/217534040
- 2017-07-11 14:58:37.245334 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/348978647
- 2017-07-11 14:58:37.552315 I | api: 2c1b1a1a-7aa1-488b-be00-d5731359769c GET /metrics GetMetrics (start)
- 2017-07-11 14:58:37.702556 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/254419786
- 2017-07-11 14:58:38.523119 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/246377505
- 2017-07-11 14:58:38.992501 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/247157004
- 2017-07-11 14:58:39.480890 I | api: 64972cc7-dc27-40a2-a8cd-3ac28a8196f4 GET /metrics GetMetrics 200 OK 1m4.017016931s
- 2017-07-11 14:58:39.481266 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/123073275
- 2017-07-11 14:58:39.974381 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/249924126
- 2017-07-11 14:58:40.425101 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/566911717
- 2017-07-11 14:58:41.037905 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/899474688
- 2017-07-11 14:58:41.521806 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/958366815
- 2017-07-11 14:58:41.986210 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/042497586
- 2017-07-11 14:58:42.402286 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/570909673
- 2017-07-11 14:58:42.487263 I | api: 29f5bb37-de96-4596-ad90-f27be495c89b GET /metrics GetMetrics (start)
- 2017-07-11 14:58:42.843996 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/858343476
- 2017-07-11 14:58:43.400718 I | api: ceee0888-202e-48bc-a4c1-83ae02df55ae GET /metrics GetMetrics 200 OK 1m3.004907442s
- 2017-07-11 14:58:43.409991 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/806410755
- 2017-07-11 14:58:43.894754 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/926720902
- 2017-07-11 14:58:44.384976 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/108079405
- 2017-07-11 14:58:44.902721 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/885351592
- 2017-07-11 14:58:45.490120 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/068008423
- 2017-07-11 14:58:46.013044 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/115678234
- 2017-07-11 14:58:46.477028 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/021540017
- 2017-07-11 14:58:47.001199 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/192715356
- 2017-07-11 14:58:47.383122 I | api: 12e51265-263a-4346-bb65-41a9b8863302 GET /metrics GetMetrics 200 OK 1m2.053466574s
- 2017-07-11 14:58:47.383377 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/067481611
- 2017-07-11 14:58:47.421473 I | api: 3040d811-7a84-4b05-ae22-6239ef43606c GET /metrics GetMetrics (start)
- 2017-07-11 14:58:47.881801 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/397262318
- 2017-07-11 14:58:48.348169 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/743381621
- 2017-07-11 14:58:48.846035 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/897622864
- 2017-07-11 14:58:49.317714 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/503041135
- 2017-07-11 14:58:49.808960 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/878949634
- 2017-07-11 14:58:50.359606 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/497230457
- 2017-07-11 14:58:50.828003 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/126502276
- 2017-07-11 14:58:51.298841 I | api: 920e4f81-0d16-49a9-b982-6c38e6f1d233 GET /metrics GetMetrics 200 OK 58.146310324s
- 2017-07-11 14:58:51.299100 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/896277267
- 2017-07-11 14:58:51.811805 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/861622614
- 2017-07-11 14:58:52.257538 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/110156989
- 2017-07-11 14:58:52.351082 I | api: 6bbbb392-ae3b-44c3-9eeb-94b68aa0f885 GET /metrics GetMetrics (start)
- 2017-07-11 14:58:52.694975 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/627185912
- 2017-07-11 14:58:53.187681 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/036873719
- 2017-07-11 14:58:53.687259 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/906430698
- 2017-07-11 14:58:54.258981 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/344581441
- 2017-07-11 14:58:54.738467 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/619375020
- 2017-07-11 14:58:55.317964 I | api: 8bf732ea-1caa-4bfa-890e-5ed93675398b GET /metrics GetMetrics 200 OK 57.233682556s
- 2017-07-11 14:58:55.318236 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/643371803
- 2017-07-11 14:58:55.816898 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/153208766
- 2017-07-11 14:58:56.329690 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/605030917
- 2017-07-11 14:58:56.820550 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/708990880
- 2017-07-11 14:58:57.215068 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/808081535
- 2017-07-11 14:58:57.311872 I | api: 32a35a42-39d9-4e29-8782-d418322aa67e GET /metrics GetMetrics (start)
- 2017-07-11 14:58:57.713884 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/217026514
- 2017-07-11 14:58:58.220040 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/667820809
- 2017-07-11 14:58:58.658625 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/024824020
- 2017-07-11 14:58:59.132147 I | api: 83e39f49-562d-4ecd-9f41-2c6bdde13e56 GET /metrics GetMetrics 200 OK 56.117581018s
- 2017-07-11 14:58:59.132530 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/169940515
- 2017-07-11 14:58:59.644834 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/243053350
- 2017-07-11 14:59:00.071348 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/025932877
- 2017-07-11 14:59:00.540757 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/514667848
- 2017-07-11 14:59:00.994567 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/710770183
- 2017-07-11 14:59:01.461596 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/974973370
- 2017-07-11 14:59:01.982145 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/284907985
- 2017-07-11 14:59:02.222966 I | api: a16b2e20-c82f-4c8e-884b-df25664d2e6b GET /metrics GetMetrics (start)
- 2017-07-11 14:59:02.362988 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/742715132
- 2017-07-11 14:59:03.175541 I | api: 188d405a-e5a5-4e7e-8b64-851ee9961d3a GET /metrics GetMetrics 200 OK 55.223885487s
- 2017-07-11 14:59:03.175828 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/446083115
- 2017-07-11 14:59:03.649899 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/938801038
- 2017-07-11 14:59:04.111533 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/054542229
- 2017-07-11 14:59:04.552649 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/107462128
- 2017-07-11 14:59:05.012711 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/283570831
- 2017-07-11 14:59:05.764676 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/975012002
- 2017-07-11 14:59:06.251129 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/164328345
- 2017-07-11 14:59:06.780429 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/034153508
- 2017-07-11 14:59:07.282516 I | api: adfb2edf-2667-4319-b101-3e391a3ace87 GET /metrics GetMetrics 200 OK 54.389811537s
- 2017-07-11 14:59:07.283432 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/942745907
- 2017-07-11 14:59:07.823706 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/008584950
- 2017-07-11 14:59:08.279615 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/730143709
- 2017-07-11 14:59:08.737100 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/244379544
- 2017-07-11 14:59:08.802530 I | api: a35a48b1-32ba-4b6e-a177-85101beff3c2 GET /metrics GetMetrics (start)
- 2017-07-11 14:59:09.202960 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/521776663
- 2017-07-11 14:59:09.711079 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/207156362
- 2017-07-11 14:59:10.250140 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/802970209
- 2017-07-11 14:59:10.699844 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/243295820
- 2017-07-11 14:59:11.148218 I | api: c023f2ed-479a-4687-9320-bdfeb63a8c79 GET /metrics GetMetrics 200 OK 53.323278116s
- 2017-07-11 14:59:11.148466 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/356850491
- 2017-07-11 14:59:11.639706 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/564367710
- 2017-07-11 14:59:12.093459 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/173976869
- 2017-07-11 14:59:12.981261 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/900378176
- 2017-07-11 14:59:13.446163 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/598176415
- 2017-07-11 14:59:13.739040 I | api: 0d56b648-3eaa-4d55-93d2-818426c5f3f8 GET /metrics GetMetrics (start)
- 2017-07-11 14:59:13.898237 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/026221426
- 2017-07-11 14:59:14.408825 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/609855529
- 2017-07-11 14:59:14.904190 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/181470580
- 2017-07-11 14:59:15.554223 I | api: 87ce0334-da94-463a-ad27-ed32c3607980 GET /metrics GetMetrics 200 OK 52.797945512s
- 2017-07-11 14:59:15.556813 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/950152259
- 2017-07-11 14:59:16.024726 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/050041542
- 2017-07-11 14:59:16.452899 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/484864365
- 2017-07-11 14:59:16.927414 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/774999016
- 2017-07-11 14:59:17.312738 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/147290663
- 2017-07-11 14:59:17.769857 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/221077338
- 2017-07-11 14:59:18.205792 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/641018609
- 2017-07-11 14:59:18.669903 I | api: 24690ef7-bbaf-42fd-8d3f-a4593e2c427c GET /metrics GetMetrics (start)
- 2017-07-11 14:59:18.680305 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/378639260
- 2017-07-11 14:59:19.170717 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/811240011
- 2017-07-11 14:59:19.172641 I | api: 55092639-ab88-4a68-8bc8-a4d037c61147 GET /metrics GetMetrics 200 OK 51.489519746s
- 2017-07-11 14:59:19.640537 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/539320110
- 2017-07-11 14:59:20.141004 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/230628533
- 2017-07-11 14:59:20.996198 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/795879568
- 2017-07-11 14:59:21.500182 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/472749231
- 2017-07-11 14:59:21.962323 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/868531778
- 2017-07-11 14:59:22.369565 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/584878777
- 2017-07-11 14:59:22.846677 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/036773060
- 2017-07-11 14:59:23.333040 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/026232659
- 2017-07-11 14:59:23.333561 I | api: a0ec1530-d499-4864-870e-8b4a1333dacc GET /metrics GetMetrics 200 OK 50.713416186s
- 2017-07-11 14:59:23.601746 I | api: ce04e248-57cc-401c-8c9d-9a01bee5b465 GET /metrics GetMetrics (start)
- 2017-07-11 14:59:23.782277 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/293095062
- 2017-07-11 14:59:24.223290 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/945361661
- 2017-07-11 14:59:24.688886 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/899673656
- 2017-07-11 14:59:25.242189 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/598594615
- 2017-07-11 14:59:25.797718 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/971840554
- 2017-07-11 14:59:26.241374 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/559153537
- 2017-07-11 14:59:26.692781 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/555603180
- 2017-07-11 14:59:27.222354 I | api: 2c1b1a1a-7aa1-488b-be00-d5731359769c GET /metrics GetMetrics 200 OK 49.670044335s
- 2017-07-11 14:59:27.222814 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/772617051
- 2017-07-11 14:59:27.610027 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/561813246
- 2017-07-11 14:59:28.087276 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/387909701
- 2017-07-11 14:59:28.531233 I | api: c06e3e15-ed41-4ee6-a5e6-1bd48e7a530d GET /metrics GetMetrics (start)
- 2017-07-11 14:59:28.553217 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/040050400
- 2017-07-11 14:59:29.041100 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/718563007
- 2017-07-11 14:59:29.681731 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/524108050
- 2017-07-11 14:59:30.153574 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/043167561
- 2017-07-11 14:59:30.827425 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/990482964
- 2017-07-11 14:59:31.312849 I | api: 29f5bb37-de96-4596-ad90-f27be495c89b GET /metrics GetMetrics 200 OK 48.82560846s
- 2017-07-11 14:59:31.313133 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/551979107
- 2017-07-11 14:59:31.837815 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/007056998
- 2017-07-11 14:59:32.220444 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/870980749
- 2017-07-11 14:59:32.636426 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/947935880
- 2017-07-11 14:59:33.093219 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/374193223
- 2017-07-11 14:59:33.462681 I | api: 0e2a66bd-33f2-48ff-82ac-e2e9f7ccc722 GET /metrics GetMetrics (start)
- 2017-07-11 14:59:33.552540 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/126119674
- 2017-07-11 14:59:34.010251 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/161309713
- 2017-07-11 14:59:34.460563 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/262492732
- 2017-07-11 14:59:34.913335 I | api: 3040d811-7a84-4b05-ae22-6239ef43606c GET /metrics GetMetrics 200 OK 47.491866827s
- 2017-07-11 14:59:34.913693 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/000581739
- 2017-07-11 14:59:35.589069 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/713439438
- 2017-07-11 14:59:36.045665 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/646434261
- 2017-07-11 14:59:36.481372 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/938964784
- 2017-07-11 14:59:36.966154 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/735945935
- 2017-07-11 14:59:37.368192 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/734096866
- 2017-07-11 14:59:37.851744 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/317638105
- 2017-07-11 14:59:38.311413 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/185558372
- 2017-07-11 14:59:38.409511 I | api: 932b2dda-3677-4674-b868-0a7f3d832f12 GET /metrics GetMetrics (start)
- 2017-07-11 14:59:38.788078 I | api: 6bbbb392-ae3b-44c3-9eeb-94b68aa0f885 GET /metrics GetMetrics 200 OK 46.436998674s
- 2017-07-11 14:59:38.788330 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/953934195
- 2017-07-11 14:59:39.321791 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/589506614
- 2017-07-11 14:59:39.779554 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/476293149
- 2017-07-11 14:59:40.270170 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/358076632
- 2017-07-11 14:59:40.762667 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/023216215
- 2017-07-11 14:59:41.234939 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/076982218
- 2017-07-11 14:59:41.672574 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/786011809
- 2017-07-11 14:59:42.133518 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/296139660
- 2017-07-11 14:59:42.566249 I | api: 32a35a42-39d9-4e29-8782-d418322aa67e GET /metrics GetMetrics 200 OK 45.254382196s
- 2017-07-11 14:59:42.566473 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/319404411
- 2017-07-11 14:59:43.049211 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/653921950
- 2017-07-11 14:59:43.326550 I | api: bcb63530-6bb7-4f12-a47b-9d845c9663ca GET /metrics GetMetrics (start)
- 2017-07-11 14:59:43.544491 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/554903909
- 2017-07-11 14:59:44.053905 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/546158464
- 2017-07-11 14:59:44.541836 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/552519903
- 2017-07-11 14:59:45.014458 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/858352818
- 2017-07-11 14:59:45.655733 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/471501417
- 2017-07-11 14:59:46.177492 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/154638004
- 2017-07-11 14:59:46.659600 I | api: a16b2e20-c82f-4c8e-884b-df25664d2e6b GET /metrics GetMetrics 200 OK 44.436615387s
- 2017-07-11 14:59:46.659819 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/447463043
- 2017-07-11 14:59:47.159397 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/055951878
- 2017-07-11 14:59:47.502752 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/616819629
- 2017-07-11 14:59:47.978934 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/609257256
- 2017-07-11 14:59:48.256996 I | api: 9f07860c-12de-48db-9047-b3f1c0d89152 GET /metrics GetMetrics (start)
- 2017-07-11 14:59:48.408018 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/939017319
- 2017-07-11 14:59:48.887087 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/908386970
- 2017-07-11 14:59:49.380065 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/857522481
- 2017-07-11 14:59:49.805160 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/039308508
- 2017-07-11 14:59:50.299066 I | api: a35a48b1-32ba-4b6e-a177-85101beff3c2 GET /metrics GetMetrics 200 OK 41.496544031s
- 2017-07-11 14:59:50.299306 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/476395659
- 2017-07-11 14:59:50.732280 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/110775918
- 2017-07-11 14:59:51.214195 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/805896437
- 2017-07-11 14:59:51.655272 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/364544464
- 2017-07-11 14:59:52.116678 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/616799471
- 2017-07-11 14:59:52.519321 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/955033986
- 2017-07-11 14:59:52.976717 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/189018873
- 2017-07-11 14:59:53.194950 I | api: a6a51fdf-0fab-4d4f-b3bf-e3c662831051 GET /metrics GetMetrics (start)
- 2017-07-11 14:59:53.947827 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/867251204
- 2017-07-11 14:59:54.401989 I | api: 0d56b648-3eaa-4d55-93d2-818426c5f3f8 GET /metrics GetMetrics 200 OK 40.662954692s
- 2017-07-11 14:59:54.402262 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/715254163
- 2017-07-11 14:59:54.891173 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/644588502
- 2017-07-11 14:59:55.554183 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/320047421
- 2017-07-11 14:59:56.018246 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/678784888
- 2017-07-11 14:59:56.474321 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/692380791
- 2017-07-11 14:59:56.975699 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/230139242
- 2017-07-11 14:59:57.723396 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/481630657
- 2017-07-11 14:59:58.125890 I | api: af957210-e49e-416a-8eaf-cc9e24249083 GET /metrics GetMetrics (start)
- 2017-07-11 14:59:58.177822 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/572677676
- 2017-07-11 14:59:58.696158 I | api: 24690ef7-bbaf-42fd-8d3f-a4593e2c427c GET /metrics GetMetrics 200 OK 40.026261291s
- 2017-07-11 14:59:58.700023 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/230472603
- 2017-07-11 14:59:59.189954 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/779034686
- 2017-07-11 14:59:59.713675 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/292046469
- 2017-07-11 15:00:00.198601 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/213753888
- 2017-07-11 15:00:00.662757 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/361594623
- 2017-07-11 15:00:01.155612 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/680328274
- 2017-07-11 15:00:01.591962 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/306519433
- 2017-07-11 15:00:02.039474 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/892126036
- 2017-07-11 15:00:02.528402 I | api: ce04e248-57cc-401c-8c9d-9a01bee5b465 GET /metrics GetMetrics 200 OK 38.926648911s
- 2017-07-11 15:00:02.528674 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/175754915
- 2017-07-11 15:00:03.040439 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/895895462
- 2017-07-11 15:00:03.059204 I | api: 0198dba9-fe6a-4255-ae21-0387057938af GET /metrics GetMetrics (start)
- 2017-07-11 15:00:03.511040 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/201349325
- 2017-07-11 15:00:03.967926 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/564158920
- 2017-07-11 15:00:04.430843 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/530153095
- 2017-07-11 15:00:04.929368 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/732322874
- 2017-07-11 15:00:05.573100 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/566603345
- 2017-07-11 15:00:06.033260 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/542180220
- 2017-07-11 15:00:06.537667 I | api: c06e3e15-ed41-4ee6-a5e6-1bd48e7a530d GET /metrics GetMetrics 200 OK 38.006441675s
- 2017-07-11 15:00:06.537942 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/505496235
- 2017-07-11 15:00:07.023455 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/105878030
- 2017-07-11 15:00:07.428450 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/996801045
- 2017-07-11 15:00:07.921130 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/867280496
- 2017-07-11 15:00:07.996957 I | api: 7b1318a5-0bf6-4ff7-8384-c54f2a3cbc7d GET /metrics GetMetrics (start)
- 2017-07-11 15:00:08.383121 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/767413519
- 2017-07-11 15:00:08.823618 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/893212450
- 2017-07-11 15:00:09.520181 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/818253337
- 2017-07-11 15:00:10.012010 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/509170340
- 2017-07-11 15:00:10.536198 I | api: 0e2a66bd-33f2-48ff-82ac-e2e9f7ccc722 GET /metrics GetMetrics 200 OK 37.073515828s
- 2017-07-11 15:00:10.545307 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/251606963
- 2017-07-11 15:00:11.166308 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/372492150
- 2017-07-11 15:00:11.596415 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/405066333
- 2017-07-11 15:00:12.058399 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/445379096
- 2017-07-11 15:00:12.414472 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/233612951
- 2017-07-11 15:00:12.830616 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/905157386
- 2017-07-11 15:00:12.925790 I | api: 9ab155fa-4a0d-45eb-b901-c811f16e56ed GET /metrics GetMetrics (start)
- 2017-07-11 15:00:13.333296 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/764268257
- 2017-07-11 15:00:13.836869 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/091115724
- 2017-07-11 15:00:14.347745 I | api: 932b2dda-3677-4674-b868-0a7f3d832f12 GET /metrics GetMetrics 200 OK 35.938228204s
- 2017-07-11 15:00:14.348027 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/363739579
- 2017-07-11 15:00:14.836072 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/895391198
- 2017-07-11 15:00:15.445188 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/525436837
- 2017-07-11 15:00:15.900557 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/394657984
- 2017-07-11 15:00:16.352668 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/220832543
- 2017-07-11 15:00:16.808147 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/030014962
- 2017-07-11 15:00:17.651619 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/817474729
- 2017-07-11 15:00:17.858549 I | api: d94046e1-2316-4398-9908-f5bc4c47d799 GET /metrics GetMetrics (start)
- 2017-07-11 15:00:18.088830 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/576812532
- 2017-07-11 15:00:18.551513 I | api: bcb63530-6bb7-4f12-a47b-9d845c9663ca GET /metrics GetMetrics 200 OK 35.224972043s
- 2017-07-11 15:00:18.551761 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/638081731
- 2017-07-11 15:00:19.040417 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/918603078
- 2017-07-11 15:00:19.521697 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/380165101
- 2017-07-11 15:00:20.199999 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/617057384
- 2017-07-11 15:00:20.688442 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/386906791
- 2017-07-11 15:00:21.148096 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/413560794
- 2017-07-11 15:00:21.601439 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/655736689
- 2017-07-11 15:00:22.075349 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/497294876
- 2017-07-11 15:00:22.458259 I | api: 9f07860c-12de-48db-9047-b3f1c0d89152 GET /metrics GetMetrics 200 OK 34.201269829s
- 2017-07-11 15:00:22.458537 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/979355851
- 2017-07-11 15:00:22.794705 I | api: 6895320c-497d-4ae8-8146-50d0d5354df7 GET /metrics GetMetrics (start)
- 2017-07-11 15:00:22.973504 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/093193134
- 2017-07-11 15:00:23.437600 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/815946549
- 2017-07-11 15:00:23.871112 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/503637264
- 2017-07-11 15:00:24.331547 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/013127983
- 2017-07-11 15:00:24.836572 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/119240386
- 2017-07-11 15:00:25.569237 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/797262649
- 2017-07-11 15:00:26.030685 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/169146180
- 2017-07-11 15:00:26.480381 I | api: a6a51fdf-0fab-4d4f-b3bf-e3c662831051 GET /metrics GetMetrics 200 OK 33.285438653s
- 2017-07-11 15:00:26.480603 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/276548563
- 2017-07-11 15:00:26.939027 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/674882326
- 2017-07-11 15:00:27.360907 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/231385981
- 2017-07-11 15:00:27.729234 I | api: c8be6501-498f-48ee-89b9-4d76ca8fc51a GET /metrics GetMetrics (start)
- 2017-07-11 15:00:27.793620 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/240660664
- 2017-07-11 15:00:28.295243 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/235418807
- 2017-07-11 15:00:28.761214 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/406941354
- 2017-07-11 15:00:29.331932 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/692486145
- 2017-07-11 15:00:29.917832 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/335347564
- 2017-07-11 15:00:30.434933 I | api: af957210-e49e-416a-8eaf-cc9e24249083 GET /metrics GetMetrics 200 OK 32.309052949s
- 2017-07-11 15:00:30.435216 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/201781211
- 2017-07-11 15:00:30.909434 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/981130110
- 2017-07-11 15:00:31.376779 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/080121541
- 2017-07-11 15:00:31.934927 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/292429152
- 2017-07-11 15:00:32.344223 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/083547967
- 2017-07-11 15:00:32.663623 I | api: 29a369df-f93d-432f-a9d9-add33e33b27a GET /metrics GetMetrics (start)
- 2017-07-11 15:00:32.844814 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/156132242
- 2017-07-11 15:00:33.373356 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/066440137
- 2017-07-11 15:00:33.820229 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/213074580
- 2017-07-11 15:00:34.518503 I | api: 0198dba9-fe6a-4255-ae21-0387057938af GET /metrics GetMetrics 200 OK 31.459302933s
- 2017-07-11 15:00:34.518724 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/212844771
- 2017-07-11 15:00:34.996098 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/568074470
- 2017-07-11 15:00:35.600503 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/135162125
- 2017-07-11 15:00:36.179991 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/981655304
- 2017-07-11 15:00:36.620746 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/774337223
- 2017-07-11 15:00:37.260855 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/008858490
- 2017-07-11 15:00:37.597057 I | api: 34fef3e2-f606-4061-ba09-07e8bbbe149b GET /metrics GetMetrics (start)
- 2017-07-11 15:00:37.661490 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/317312145
- 2017-07-11 15:00:38.193366 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/408834748
- 2017-07-11 15:00:38.639900 I | api: 7b1318a5-0bf6-4ff7-8384-c54f2a3cbc7d GET /metrics GetMetrics 200 OK 30.642947707s
- 2017-07-11 15:00:38.640174 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/414104811
- 2017-07-11 15:00:39.117023 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/782034766
- 2017-07-11 15:00:39.621474 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/579209301
- 2017-07-11 15:00:40.076996 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/886848944
- 2017-07-11 15:00:40.548889 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/992780623
- 2017-07-11 15:00:41.033924 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/707432034
- 2017-07-11 15:00:41.481623 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/395689561
- 2017-07-11 15:00:42.058252 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/945586148
- 2017-07-11 15:00:42.510779 I | api: 9ab155fa-4a0d-45eb-b901-c811f16e56ed GET /metrics GetMetrics 200 OK 29.58499495s
- 2017-07-11 15:00:42.511032 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/275776499
- 2017-07-11 15:00:42.528735 I | api: a99ab165-e9c5-497b-b1b8-cae68c3fdc97 GET /metrics GetMetrics (start)
- 2017-07-11 15:00:43.013120 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/210740918
- 2017-07-11 15:00:43.487148 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/050505885
- 2017-07-11 15:00:44.002240 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/466782552
- 2017-07-11 15:00:44.500152 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/607024343
- 2017-07-11 15:00:44.970294 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/806683722
- 2017-07-11 15:00:45.556588 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/855083809
- 2017-07-11 15:00:46.339492 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/387393036
- 2017-07-11 15:00:46.786978 I | api: d94046e1-2316-4398-9908-f5bc4c47d799 GET /metrics GetMetrics 200 OK 28.928433363s
- 2017-07-11 15:00:46.787300 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/326667771
- 2017-07-11 15:00:47.460312 I | api: 352975c5-3a5e-4dd6-bf28-157df59fd047 GET /metrics GetMetrics (start)
- 2017-07-11 15:00:47.488530 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/739321630
- 2017-07-11 15:00:47.910674 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/385126885
- 2017-07-11 15:00:48.406748 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/077460992
- 2017-07-11 15:00:48.880864 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/601454943
- 2017-07-11 15:00:49.386984 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/401040178
- 2017-07-11 15:00:49.839873 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/793210089
- 2017-07-11 15:00:50.349730 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/140833588
- 2017-07-11 15:00:50.819337 I | api: 6895320c-497d-4ae8-8146-50d0d5354df7 GET /metrics GetMetrics 200 OK 28.024639323s
- 2017-07-11 15:00:50.829148 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/935488771
- 2017-07-11 15:00:51.300573 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/980855430
- 2017-07-11 15:00:51.734279 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/429895213
- 2017-07-11 15:00:52.274917 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/101072296
- 2017-07-11 15:00:52.392902 I | api: 452d05fd-6777-4321-ae79-80b34e24efd3 GET /metrics GetMetrics (start)
- 2017-07-11 15:00:52.678547 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/213452007
- 2017-07-11 15:00:53.130831 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/341261594
- 2017-07-11 15:00:53.918506 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/273957297
- 2017-07-11 15:00:54.435446 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/264010076
- 2017-07-11 15:00:54.933338 I | api: c8be6501-498f-48ee-89b9-4d76ca8fc51a GET /metrics GetMetrics 200 OK 27.204109332s
- 2017-07-11 15:00:54.933676 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/130400523
- 2017-07-11 15:00:55.510096 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/016713454
- 2017-07-11 15:00:55.998317 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/681281909
- 2017-07-11 15:00:56.575221 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/186919504
- 2017-07-11 15:00:57.012399 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/223478127
- 2017-07-11 15:00:57.332637 I | api: 54087aa8-b9a9-45cf-8558-a5401027373b GET /metrics GetMetrics (start)
- 2017-07-11 15:00:57.440560 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/120709634
- 2017-07-11 15:00:57.898751 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/560898425
- 2017-07-11 15:00:58.370096 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/272441988
- 2017-07-11 15:00:58.841058 I | api: 29a369df-f93d-432f-a9d9-add33e33b27a GET /metrics GetMetrics 200 OK 26.177442125s
- 2017-07-11 15:00:58.841343 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/392031763
- 2017-07-11 15:00:59.715724 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/626563158
- 2017-07-11 15:01:00.321982 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/160356285
- 2017-07-11 15:01:00.803828 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/230151160
- 2017-07-11 15:01:01.243989 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/513604343
- 2017-07-11 15:01:01.689998 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/006636010
- 2017-07-11 15:01:02.147259 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/371098689
- 2017-07-11 15:01:02.254395 I | api: b488d843-eff4-4cf6-be60-3b55dd00c494 GET /metrics GetMetrics (start)
- 2017-07-11 15:01:02.513538 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/697201836
- 2017-07-11 15:01:02.944024 I | api: 34fef3e2-f606-4061-ba09-07e8bbbe149b GET /metrics GetMetrics 200 OK 25.346975439s
- 2017-07-11 15:01:02.945268 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/355192859
- 2017-07-11 15:01:03.395472 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/597967550
- 2017-07-11 15:01:03.872718 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/883524357
- 2017-07-11 15:01:04.358659 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/886982304
- 2017-07-11 15:01:04.829445 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/009569151
- 2017-07-11 15:01:05.407997 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/905772242
- 2017-07-11 15:01:05.874123 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/005235209
- 2017-07-11 15:01:06.350806 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/035555284
- 2017-07-11 15:01:06.813221 I | api: a99ab165-e9c5-497b-b1b8-cae68c3fdc97 GET /metrics GetMetrics 200 OK 24.284486456s
- 2017-07-11 15:01:06.813531 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/318632739
- 2017-07-11 15:01:07.262975 I | api: bf6dffee-4c7f-4884-accf-3e49b8481b48 GET /metrics GetMetrics (start)
- 2017-07-11 15:01:07.299409 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/755841574
- 2017-07-11 15:01:07.705505 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/864284493
- 2017-07-11 15:01:08.202701 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/302550600
- 2017-07-11 15:01:08.656036 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/956044039
- 2017-07-11 15:01:09.153341 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/654809274
- 2017-07-11 15:01:09.677215 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/893635793
- 2017-07-11 15:01:10.156719 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/648157180
- 2017-07-11 15:01:10.688385 I | api: 352975c5-3a5e-4dd6-bf28-157df59fd047 GET /metrics GetMetrics 200 OK 23.228076857s
- 2017-07-11 15:01:10.688687 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/368525611
- 2017-07-11 15:01:11.161184 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/366471310
- 2017-07-11 15:01:11.657611 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/351032981
- 2017-07-11 15:01:12.158620 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/950753520
- 2017-07-11 15:01:12.197355 I | api: 57a852c9-05fc-417f-b886-3a2e93b65635 GET /metrics GetMetrics (start)
- 2017-07-11 15:01:12.623500 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/510661519
- 2017-07-11 15:01:13.087542 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/325701538
- 2017-07-11 15:01:13.596299 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/033073305
- 2017-07-11 15:01:14.102218 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/509144356
- 2017-07-11 15:01:14.561913 I | api: 452d05fd-6777-4321-ae79-80b34e24efd3 GET /metrics GetMetrics 200 OK 22.169014577s
- 2017-07-11 15:01:14.562209 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/950262323
- 2017-07-11 15:01:15.016743 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/031194102
- 2017-07-11 15:01:15.596207 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/725428957
- 2017-07-11 15:01:16.324010 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/161557144
- 2017-07-11 15:01:16.767128 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/261184279
- 2017-07-11 15:01:17.128652 I | api: e789159f-13da-4f2f-8a4e-9f7c61289c7e GET /metrics GetMetrics (start)
- 2017-07-11 15:01:17.230781 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/970304906
- 2017-07-11 15:01:17.630044 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/479740769
- 2017-07-11 15:01:18.103034 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/017882444
- 2017-07-11 15:01:18.799730 I | api: 54087aa8-b9a9-45cf-8558-a5401027373b GET /metrics GetMetrics 200 OK 21.467098193s
- 2017-07-11 15:01:18.804947 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/413709883
- 2017-07-11 15:01:19.287136 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/004968542
- 2017-07-11 15:01:19.791754 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/212299813
- 2017-07-11 15:01:20.276510 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/709958976
- 2017-07-11 15:01:20.733830 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/241306015
- 2017-07-11 15:01:21.212847 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/905002610
- 2017-07-11 15:01:21.727452 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/207818537
- 2017-07-11 15:01:22.070642 I | api: 5c2e6c52-6853-405e-8951-429bc6191d76 GET /metrics GetMetrics (start)
- 2017-07-11 15:01:22.193244 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/498184308
- 2017-07-11 15:01:22.670439 I | api: b488d843-eff4-4cf6-be60-3b55dd00c494 GET /metrics GetMetrics 200 OK 20.416049055s
- 2017-07-11 15:01:22.670711 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/236971843
- 2017-07-11 15:01:23.138336 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/069376454
- 2017-07-11 15:01:23.603671 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/904811629
- 2017-07-11 15:01:24.149528 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/142749416
- 2017-07-11 15:01:24.598971 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/509855015
- 2017-07-11 15:01:25.082794 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/369893978
- 2017-07-11 15:01:25.669842 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/549385713
- 2017-07-11 15:01:26.148527 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/219574940
- 2017-07-11 15:01:26.601994 I | api: bf6dffee-4c7f-4884-accf-3e49b8481b48 GET /metrics GetMetrics 200 OK 19.339024594s
- 2017-07-11 15:01:26.602255 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/993420619
- 2017-07-11 15:01:26.997689 I | api: 3015aaf4-5d48-4a08-8794-b1ff51d79edc GET /metrics GetMetrics (start)
- 2017-07-11 15:01:27.060987 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/010383918
- 2017-07-11 15:01:27.553047 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/191114677
- 2017-07-11 15:01:28.003930 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/871959952
- 2017-07-11 15:01:28.465967 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/063204271
- 2017-07-11 15:01:29.323790 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/087709506
- 2017-07-11 15:01:29.805473 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/525087161
- 2017-07-11 15:01:30.316586 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/170799044
- 2017-07-11 15:01:30.824859 I | api: 57a852c9-05fc-417f-b886-3a2e93b65635 GET /metrics GetMetrics 200 OK 18.627513033s
- 2017-07-11 15:01:30.829990 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/522394195
- 2017-07-11 15:01:31.561954 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/815959446
- 2017-07-11 15:01:31.937794 I | api: 4fbfe4f0-4c96-4343-961e-be6300e91834 GET /metrics GetMetrics (start)
- 2017-07-11 15:01:32.022984 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/661679101
- 2017-07-11 15:01:32.408145 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/480946488
- 2017-07-11 15:01:32.844460 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/296640311
- 2017-07-11 15:01:33.296603 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/902321450
- 2017-07-11 15:01:33.807561 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/655490689
- 2017-07-11 15:01:34.289612 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/880538604
- 2017-07-11 15:01:34.764067 I | api: e789159f-13da-4f2f-8a4e-9f7c61289c7e GET /metrics GetMetrics 200 OK 17.635431852s
- 2017-07-11 15:01:34.764354 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/138132059
- 2017-07-11 15:01:35.444587 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/543222270
- 2017-07-11 15:01:35.898786 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/317451589
- 2017-07-11 15:01:36.381979 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/797159392
- 2017-07-11 15:01:36.835800 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/633513407
- 2017-07-11 15:01:36.875743 I | api: 3c56ace0-5dea-4579-a089-34698b659c0d GET /metrics GetMetrics (start)
- 2017-07-11 15:01:37.314410 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/842144274
- 2017-07-11 15:01:37.900741 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/468886601
- 2017-07-11 15:01:38.356765 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/990373140
- 2017-07-11 15:01:38.905759 I | api: 5c2e6c52-6853-405e-8951-429bc6191d76 GET /metrics GetMetrics 200 OK 16.835133024s
- 2017-07-11 15:01:38.911753 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/222244707
- 2017-07-11 15:01:39.397040 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/265186150
- 2017-07-11 15:01:39.836192 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/064389005
- 2017-07-11 15:01:40.284694 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/882581384
- 2017-07-11 15:01:40.776726 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/408379207
- 2017-07-11 15:01:41.311628 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/737967098
- 2017-07-11 15:01:41.769759 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/964613905
- 2017-07-11 15:01:41.815388 I | api: 5f6e3eb1-ee51-4e46-b040-7f3ec4107c50 GET /metrics GetMetrics (start)
- 2017-07-11 15:01:42.267014 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/529655612
- 2017-07-11 15:01:42.611222 I | api: 3015aaf4-5d48-4a08-8794-b1ff51d79edc GET /metrics GetMetrics 200 OK 15.613539964s
- 2017-07-11 15:01:42.616879 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/379585899
- 2017-07-11 15:01:43.069613 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/262523854
- 2017-07-11 15:01:43.614334 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/638355157
- 2017-07-11 15:01:44.100325 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/610982960
- 2017-07-11 15:01:44.526128 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/083346895
- 2017-07-11 15:01:44.948992 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/265676002
- 2017-07-11 15:01:45.585626 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/017469145
- 2017-07-11 15:01:46.015163 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/287925348
- 2017-07-11 15:01:46.498504 I | api: 4fbfe4f0-4c96-4343-961e-be6300e91834 GET /metrics GetMetrics 200 OK 14.560716799s
- 2017-07-11 15:01:46.498809 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/567593075
- 2017-07-11 15:01:46.746269 I | api: 5825c02d-4691-4fc4-9a4e-c8362b8da069 GET /metrics GetMetrics (start)
- 2017-07-11 15:01:46.928154 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/539567414
- 2017-07-11 15:01:47.325467 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/226459933
- 2017-07-11 15:01:47.936554 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/637682136
- 2017-07-11 15:01:48.366432 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/502666583
- 2017-07-11 15:01:48.794328 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/363539146
- 2017-07-11 15:01:49.233828 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/608099745
- 2017-07-11 15:01:49.668521 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/299302028
- 2017-07-11 15:01:50.315281 I | api: 3c56ace0-5dea-4579-a089-34698b659c0d GET /metrics GetMetrics 200 OK 13.439544087s
- 2017-07-11 15:01:50.315570 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/199095931
- 2017-07-11 15:01:50.728589 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/700427166
- 2017-07-11 15:01:51.179840 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/453990501
- 2017-07-11 15:01:51.604975 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/366187136
- 2017-07-11 15:01:51.681195 I | api: f8c9e85d-f8db-4d9a-8f24-1dfa62b786fb GET /metrics GetMetrics (start)
- 2017-07-11 15:01:52.018985 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/991242719
- 2017-07-11 15:01:52.385545 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/254250930
- 2017-07-11 15:01:52.820511 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/354218345
- 2017-07-11 15:01:53.274732 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/784155060
- 2017-07-11 15:01:54.116933 I | api: 5f6e3eb1-ee51-4e46-b040-7f3ec4107c50 GET /metrics GetMetrics 200 OK 12.301548604s
- 2017-07-11 15:01:54.117170 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/693429635
- 2017-07-11 15:01:54.557279 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/674510086
- 2017-07-11 15:01:55.032882 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/312425133
- 2017-07-11 15:01:55.669295 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/897277992
- 2017-07-11 15:01:56.096038 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/146092391
- 2017-07-11 15:01:56.539106 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/366702490
- 2017-07-11 15:01:56.616115 I | api: a85133f8-6435-4377-aaab-8c73d30fd6e2 GET /metrics GetMetrics (start)
- 2017-07-11 15:01:56.957722 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/277867057
- 2017-07-11 15:01:57.344836 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/612819420
- 2017-07-11 15:01:57.908988 I | api: 5825c02d-4691-4fc4-9a4e-c8362b8da069 GET /metrics GetMetrics 200 OK 11.162734186s
- 2017-07-11 15:01:57.909244 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/821147019
- 2017-07-11 15:01:58.364670 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/161895278
- 2017-07-11 15:01:58.775480 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/618464245
- 2017-07-11 15:01:59.229910 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/385036496
- 2017-07-11 15:01:59.685434 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/946566127
- 2017-07-11 15:02:00.123359 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/222249602
- 2017-07-11 15:02:00.572689 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/988600825
- 2017-07-11 15:02:00.993194 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/341684996
- 2017-07-11 15:02:01.495922 I | api: f8c9e85d-f8db-4d9a-8f24-1dfa62b786fb GET /metrics GetMetrics 200 OK 9.8147476s
- 2017-07-11 15:02:01.496168 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/202068115
- 2017-07-11 15:02:01.553384 I | api: 6c7c0453-66e6-40a4-a160-edfea9e07f01 GET /metrics GetMetrics (start)
- 2017-07-11 15:02:01.922963 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/338174166
- 2017-07-11 15:02:02.364736 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/953751613
- 2017-07-11 15:02:02.745358 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/785380472
- 2017-07-11 15:02:03.195050 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/312873335
- 2017-07-11 15:02:03.619806 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/450903146
- 2017-07-11 15:02:04.370700 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/167491777
- 2017-07-11 15:02:04.808879 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/181397804
- 2017-07-11 15:02:05.260809 I | api: a85133f8-6435-4377-aaab-8c73d30fd6e2 GET /metrics GetMetrics 200 OK 8.644724493s
- 2017-07-11 15:02:05.261046 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/071765147
- 2017-07-11 15:02:05.853010 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/804311358
- 2017-07-11 15:02:06.276623 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/070841733
- 2017-07-11 15:02:06.484556 I | api: a66810ab-711e-4977-a93d-70c49da5f4fe GET /metrics GetMetrics (start)
- 2017-07-11 15:02:06.702877 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/191415584
- 2017-07-11 15:02:07.126503 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/228010495
- 2017-07-11 15:02:07.490435 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/477049682
- 2017-07-11 15:02:07.931039 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/287183497
- 2017-07-11 15:02:08.376090 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/602205780
- 2017-07-11 15:02:08.800352 I | api: 6c7c0453-66e6-40a4-a160-edfea9e07f01 GET /metrics GetMetrics 200 OK 7.246947323s
- 2017-07-11 15:02:08.801262 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/726548387
- 2017-07-11 15:02:09.310854 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/090937510
- 2017-07-11 15:02:09.738194 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/074824653
- 2017-07-11 15:02:10.277960 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/266324168
- 2017-07-11 15:02:10.777923 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/243222919
- 2017-07-11 15:02:11.224339 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/104898362
- 2017-07-11 15:02:11.416559 I | api: 081db142-85bd-4b75-a2e8-3fde0a51ba50 GET /metrics GetMetrics (start)
- 2017-07-11 15:02:12.057876 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/567995217
- 2017-07-11 15:02:12.420595 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/691547260
- 2017-07-11 15:02:12.874375 I | api: a66810ab-711e-4977-a93d-70c49da5f4fe GET /metrics GetMetrics 200 OK 6.389824267s
- 2017-07-11 15:02:12.874641 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/236887467
- 2017-07-11 15:02:13.295579 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/357335822
- 2017-07-11 15:02:13.707506 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/956098837
- 2017-07-11 15:02:14.311899 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/378169712
- 2017-07-11 15:02:14.748962 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/546869263
- 2017-07-11 15:02:15.195654 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/118752290
- 2017-07-11 15:02:15.796602 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/184519961
- 2017-07-11 15:02:16.216885 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/443751332
- 2017-07-11 15:02:16.344714 I | api: f1933b64-47c4-4c43-9165-eb6d3f7bcadd GET /metrics GetMetrics (start)
- 2017-07-11 15:02:16.651542 I | api: 081db142-85bd-4b75-a2e8-3fde0a51ba50 GET /metrics GetMetrics 200 OK 5.234988182s
- 2017-07-11 15:02:16.651805 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/609137331
- 2017-07-11 15:02:17.079665 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/810285686
- 2017-07-11 15:02:17.434392 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/013899613
- 2017-07-11 15:02:17.836753 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/486944024
- 2017-07-11 15:02:18.261561 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/006754199
- 2017-07-11 15:02:18.676638 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/617581066
- 2017-07-11 15:02:19.216018 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/398861281
- 2017-07-11 15:02:19.666025 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/212046284
- 2017-07-11 15:02:20.078086 I | api: f1933b64-47c4-4c43-9165-eb6d3f7bcadd GET /metrics GetMetrics 200 OK 3.73337729s
- 2017-07-11 15:02:21.127529 I | api: 4ee497d9-c324-4ec1-a080-21b419d1423b GET /metrics GetMetrics (start)
- 2017-07-11 15:02:21.128244 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/445895867
- 2017-07-11 15:02:21.599309 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/497469150
- 2017-07-11 15:02:22.014109 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/630975653
- 2017-07-11 15:02:22.420212 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/014053312
- 2017-07-11 15:02:22.760858 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/250700319
- 2017-07-11 15:02:23.208212 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/234875634
- 2017-07-11 15:02:23.661299 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/599069609
- 2017-07-11 15:02:24.103911 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/502745332
- 2017-07-11 15:02:24.698063 I | api: 4ee497d9-c324-4ec1-a080-21b419d1423b GET /metrics GetMetrics 200 OK 3.570528708s
- 2017-07-11 15:02:26.056381 I | api: 22acc36a-2d0f-4f8b-a786-44a95a1f612e GET /metrics GetMetrics (start)
- 2017-07-11 15:02:26.057403 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/759698883
- 2017-07-11 15:02:26.479579 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/475440198
- 2017-07-11 15:02:26.913883 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/233988333
- 2017-07-11 15:02:27.326606 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/593589096
- 2017-07-11 15:02:27.679686 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/770915239
- 2017-07-11 15:02:28.258463 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/157575386
- 2017-07-11 15:02:28.712544 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/034020977
- 2017-07-11 15:02:29.116999 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/471347996
- 2017-07-11 15:02:29.593902 I | api: 22acc36a-2d0f-4f8b-a786-44a95a1f612e GET /metrics GetMetrics 200 OK 3.537516174s
- 2017-07-11 15:02:30.982902 I | api: 74619da7-2b07-4150-9060-b7268bedc5c7 GET /metrics GetMetrics (start)
- 2017-07-11 15:02:30.983973 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/645085131
- 2017-07-11 15:02:31.440652 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/337712814
- 2017-07-11 15:02:31.852124 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain --out-file /tmp/194993717
- 2017-07-11 15:02:32.242860 I | exec: Running command: ceph status --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/626168848
- 2017-07-11 15:02:32.673700 I | exec: Running command: ceph osd perf --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/951499823
- 2017-07-11 15:02:33.116114 I | exec: Running command: ceph osd dump --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/505114050
- 2017-07-11 15:02:33.724688 I | exec: Running command: ceph osd df --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/144084025
- 2017-07-11 15:02:34.175212 I | exec: Running command: ceph df detail --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/336309316
- 2017-07-11 15:02:34.636396 I | api: 74619da7-2b07-4150-9060-b7268bedc5c7 GET /metrics GetMetrics 200 OK 3.653498722s
- 2017-07-11 15:07:18.226777 I | api: 2cac65fe-f057-4341-bc2d-d79a44838839 GET /pool GetPools (start)
- 2017-07-11 15:07:18.227053 I | exec: Running command: ceph osd lspools --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/039227603
- 2017-07-11 15:07:18.269405 I | api: c1503ac2-e520-4d40-94ae-a366a179f011 GET /pool GetPools (start)
- 2017-07-11 15:07:18.269845 I | exec: Running command: ceph osd lspools --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/246954006
- 2017-07-11 15:07:18.270410 I | api: 5b01b688-635e-4288-8eb8-3316062d600e GET /pool GetPools (start)
- 2017-07-11 15:07:18.270579 I | exec: Running command: ceph osd lspools --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/443810941
- 2017-07-11 15:07:19.504297 I | exec: Running command: ceph osd pool get rbd all --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/419594168
- 2017-07-11 15:07:19.523545 I | exec: Running command: ceph osd pool get rbd all --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/184522679
- 2017-07-11 15:07:19.604742 I | exec: Running command: ceph osd pool get rbd all --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/672962986
- 2017-07-11 15:07:20.832627 I | api: c1503ac2-e520-4d40-94ae-a366a179f011 GET /pool GetPools 200 OK 2.56322479s
- 2017-07-11 15:07:20.850354 I | api: 2cac65fe-f057-4341-bc2d-d79a44838839 GET /pool GetPools 200 OK 2.623582417s
- 2017-07-11 15:07:20.869260 I | api: 73250390-7ace-4871-bb50-b09cd98cda18 POST /pool CreatePool (start)
- 2017-07-11 15:07:20.870183 I | exec: Running command: ceph osd pool create replicapool 0 replicated --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/897640705
- 2017-07-11 15:07:20.899247 I | api: 2182c2d9-a6d8-4cf0-ae1e-aefff9c44175 POST /pool CreatePool (start)
- 2017-07-11 15:07:20.899482 I | exec: Running command: ceph osd pool create replicapool 0 replicated --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/969561196
- 2017-07-11 15:07:21.000293 I | api: 5b01b688-635e-4288-8eb8-3316062d600e GET /pool GetPools 200 OK 2.729870514s
- 2017-07-11 15:07:21.048281 I | api: 582b8fbd-aeeb-4d3a-9970-b5e72bbdf256 POST /pool CreatePool (start)
- 2017-07-11 15:07:21.048586 I | exec: Running command: ceph osd pool create replicapool 0 replicated --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/340934875
- 2017-07-11 15:07:24.462740 I | exec: pool 'replicapool' created
- 2017-07-11 15:07:24.469133 I | exec: Running command: ceph osd pool set replicapool size 1 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/442393726
- 2017-07-11 15:07:24.519097 I | exec: pool 'replicapool' created
- 2017-07-11 15:07:24.519482 I | exec: Running command: ceph osd pool set replicapool size 1 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/201342405
- 2017-07-11 15:07:24.554730 I | exec: pool 'replicapool' created
- 2017-07-11 15:07:24.555006 I | exec: Running command: ceph osd pool set replicapool size 1 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/722013280
- 2017-07-11 15:07:24.619556 I | api: eb44a916-1a1a-438b-b31b-7b5eb96ba677 POST /image CreateImage (start)
- 2017-07-11 15:07:24.626177 I | exec: Running command: rbd create replicapool/k8s-dynamic-pvc-a4b4d9a7-664a-11e7-9df0-000d3ab305ff-a587ee34-664a-11e7-8a53-02420ae96302 --size 20480 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring
- 2017-07-11 15:07:25.322208 I | api: 45ed686c-4ccc-4ed3-b9c5-049771559157 POST /image CreateImage (start)
- 2017-07-11 15:07:25.322452 I | exec: Running command: rbd create replicapool/k8s-dynamic-pvc-ca9cc254-6636-11e7-a94e-000d3ab30af5-a5ef7ba0-664a-11e7-8a53-02420ae96302 --size 20480 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring
- 2017-07-11 15:07:27.157847 I | api: a5a4a52c-8ee5-4cfe-9abe-a43f22399dd1 POST /image CreateImage (start)
- 2017-07-11 15:07:27.158113 I | exec: Running command: rbd create replicapool/k8s-dynamic-pvc-a60a0cfa-664a-11e7-8805-000d3ab307af-a6f953c9-664a-11e7-8a53-02420ae96302 --size 20480 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring
- 2017-07-11 15:07:27.383967 I | exec: set pool 1 size to 1
- 2017-07-11 15:07:27.384199 I | cephclient: creating pool replicapool succeeded, buf:
- 2017-07-11 15:07:27.384246 I | api: 73250390-7ace-4871-bb50-b09cd98cda18 POST /pool CreatePool 200 OK 6.514993292s
- 2017-07-11 15:07:27.385414 I | exec: set pool 1 size to 1
- 2017-07-11 15:07:27.385507 I | cephclient: creating pool replicapool succeeded, buf:
- 2017-07-11 15:07:27.391360 I | api: 582b8fbd-aeeb-4d3a-9970-b5e72bbdf256 POST /pool CreatePool 200 OK 6.34308652s
- 2017-07-11 15:07:27.393704 I | exec: set pool 1 size to 1
- 2017-07-11 15:07:27.393761 I | cephclient: creating pool replicapool succeeded, buf:
- 2017-07-11 15:07:27.393772 I | api: 2182c2d9-a6d8-4cf0-ae1e-aefff9c44175 POST /pool CreatePool 200 OK 6.494534754s
- 2017-07-11 15:07:28.093453 I | api: 4e4c09f7-f760-427b-9470-4e1467b5317a POST /image CreateImage (start)
- 2017-07-11 15:07:28.093513 I | exec: Running command: rbd create replicapool/k8s-dynamic-pvc-cbe89bc4-6636-11e7-9df0-000d3ab305ff-a79c49dc-664a-11e7-8a53-02420ae96302 --size 20480 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring
- 2017-07-11 15:07:52.008792 I | api: df136381-a1c1-4b14-83f4-50fe1d48c983 POST /image CreateImage (start)
- 2017-07-11 15:07:52.009016 I | exec: Running command: rbd create replicapool/k8s-dynamic-pvc-a60a0cfa-664a-11e7-8805-000d3ab307af-b5d723f2-664a-11e7-8a53-02420ae96302 --size 20480 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring
- 2017-07-11 15:07:52.179312 I | api: 4a4d94c4-2a3d-459b-be95-d6f126352ae6 POST /image CreateImage (start)
- 2017-07-11 15:07:52.179539 I | exec: Running command: rbd create replicapool/k8s-dynamic-pvc-a4b4d9a7-664a-11e7-9df0-000d3ab305ff-b5e43dd1-664a-11e7-8a53-02420ae96302 --size 20480 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring
- 2017-07-11 15:08:07.695529 I | api: cddbfb92-9c85-4a14-8448-bc72320480bf POST /image CreateImage (start)
- 2017-07-11 15:08:07.695605 I | exec: Running command: rbd create replicapool/k8s-dynamic-pvc-a60a0cfa-664a-11e7-8805-000d3ab307af-bf389eca-664a-11e7-8a53-02420ae96302 --size 20480 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring
- 2017-07-11 15:08:07.898692 I | api: ccc61bb0-fd49-4624-b715-650eab7a9b65 POST /image CreateImage (start)
- 2017-07-11 15:08:07.898931 I | exec: Running command: rbd create replicapool/k8s-dynamic-pvc-a4b4d9a7-664a-11e7-9df0-000d3ab305ff-bf570d60-664a-11e7-8a53-02420ae96302 --size 20480 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring
- 2017-07-11 15:09:08.702119 I | api: 7aa2a1c1-deb9-4cd2-b8c4-0f492d95635a POST /image CreateImage (start)
- 2017-07-11 15:09:08.702360 I | exec: Running command: rbd create replicapool/k8s-dynamic-pvc-a60a0cfa-664a-11e7-8805-000d3ab307af-e3a2d140-664a-11e7-8a53-02420ae96302 --size 20480 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring
- 2017-07-11 15:09:08.815618 I | api: 515b86b1-1d70-4019-b207-ff77a71f1dd5 POST /image CreateImage (start)
- 2017-07-11 15:09:08.815873 I | exec: Running command: rbd create replicapool/k8s-dynamic-pvc-a4b4d9a7-664a-11e7-9df0-000d3ab305ff-e3b34c8e-664a-11e7-8a53-02420ae96302 --size 20480 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring
- 2017-07-11 15:09:24.803625 I | api: df96abe1-2674-49c5-bf79-6d650f1f0b5e POST /image CreateImage (start)
- 2017-07-11 15:09:24.820051 I | exec: Running command: rbd create replicapool/k8s-dynamic-pvc-a4b4d9a7-664a-11e7-9df0-000d3ab305ff-ed339706-664a-11e7-8a53-02420ae96302 --size 20480 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring
- 2017-07-11 15:09:24.830821 I | api: bd057cfb-93f2-4ef1-b949-6a86e3563fa3 POST /image CreateImage (start)
- 2017-07-11 15:09:24.830891 I | exec: Running command: rbd create replicapool/k8s-dynamic-pvc-a60a0cfa-664a-11e7-8805-000d3ab307af-ed338e19-664a-11e7-8a53-02420ae96302 --size 20480 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring
- 2017-07-11 15:11:15.525634 I | api: 3c88934a-75e0-48eb-aa03-88833ecab44f GET /pool GetPools (start)
- 2017-07-11 15:11:15.525867 I | exec: Running command: ceph osd lspools --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/844464703
- 2017-07-11 15:11:15.957228 I | exec: Running command: ceph osd pool get rbd all --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/870868114
- 2017-07-11 15:11:16.380429 I | exec: Running command: ceph osd pool get replicapool all --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/068689609
- 2017-07-11 15:11:17.004782 I | api: 3c88934a-75e0-48eb-aa03-88833ecab44f GET /pool GetPools 200 OK 1.479153413s
- END logs from pod: rook-api-2485995279-lrlf5
- BEGIN logs from pod: rook-ceph-mgr0-2234418690-jkr5c
- 2017-07-11 13:24:21.763701 I | cephmon: parsing mon endpoints: rook-ceph-mon1=10.233.99.4:6790,rook-ceph-mon2=10.233.124.3:6790,rook-ceph-mon0=10.233.76.3:6790
- 2017-07-11 13:24:21.766437 I | cephmgr: Starting MGR rook-ceph-mgr0 with keyring AQB60WRZUnOKNRAAjqok/mkjFdJrCIy6D1qntA==
- 2017-07-11 13:24:21.766471 I | cephmgr: Conf files: dir=/var/lib/rook/mgrrook-ceph-mgr0 keyring=/var/lib/rook/mgrrook-ceph-mgr0/keyring
- 2017-07-11 13:24:21.766943 I | cephmon: writing config file /var/lib/rook/mgrrook-ceph-mgr0/rook.config
- 2017-07-11 13:24:21.767172 I | cephmgr: starting ceph-mgr
- 2017-07-11 13:24:21.767230 I | cephmgr: Config file /var/lib/rook/mgrrook-ceph-mgr0/rook.config:
- [global]
- enable experimental unrecoverable data corrupting features =
- run dir = /var/lib/rook/mgrrook-ceph-mgr0
- mon initial members = rook-ceph-mon0 rook-ceph-mon1 rook-ceph-mon2
- log file = /dev/stdout
- mon cluster log file = /dev/stdout
- mon keyvaluedb = rocksdb
- debug default = 0
- debug rados = 0
- debug mon = 0
- debug osd = 0
- debug bluestore = 0
- debug filestore = 0
- debug journal = 0
- debug leveldb = 0
- filestore_omap_backend = rocksdb
- osd pg bits = 11
- osd pgp bits = 11
- osd pool default size = 1
- osd pool default min size = 1
- osd pool default pg num = 100
- osd pool default pgp num = 100
- osd objectstore = filestore
- rbd_default_features = 3
- fatal signal handlers = false
- [mgr.rook-ceph-mgr0]
- keyring = /var/lib/rook/mgrrook-ceph-mgr0/keyring
- mgr data = /var/lib/rook/mgrrook-ceph-mgr0
- [mon.rook-ceph-mon1]
- name = rook-ceph-mon1
- mon addr = 10.233.99.4:6790
- [mon.rook-ceph-mon2]
- name = rook-ceph-mon2
- mon addr = 10.233.124.3:6790
- [mon.rook-ceph-mon0]
- name = rook-ceph-mon0
- mon addr = 10.233.76.3:6790
- 2017-07-11 13:24:21.797018 I | cephmgr: Config file /var/lib/rook/mgrrook-ceph-mgr0/keyring:
- [mgr.rook-ceph-mgr0]
- key = AQB60WRZUnOKNRAAjqok/mkjFdJrCIy6D1qntA==
- caps mon = "allow *"
- 2017-07-11 13:24:21.797055 I | proc: Running process ceph-mgr with args: [--foreground --cluster=rook --conf=/var/lib/rook/mgrrook-ceph-mgr0/rook.config --keyring=/var/lib/rook/mgrrook-ceph-mgr0/keyring -i rook-ceph-mgr0]
- 2017-07-11 13:24:21.797088 I | exec: Running command: ceph-mgr --foreground --cluster=rook --conf=/var/lib/rook/mgrrook-ceph-mgr0/rook.config --keyring=/var/lib/rook/mgrrook-ceph-mgr0/keyring -i rook-ceph-mgr0
- 2017-07-11 13:24:22.361400 I | ceph-mgr: 2017-07-11 13:24:22.359977 7f4cd1bd6380 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 10
- 2017-07-11 13:24:22.361480 I | ceph-mgr: 2017-07-11 13:24:22.359989 7f4cd1bd6380 0 pidfile_write: ignore empty --pid-file
- 2017-07-11 13:24:22.488635 I | ceph-mgr: 2017-07-11 13:24:22.488576 7f4cd1bd6380 0 mgr tick tick
- 2017-07-11 13:24:22.488692 I | ceph-mgr: 2017-07-11 13:24:22.488577 7f4cd1bd6380 1 mgr send_beacon standby
- 2017-07-11 13:24:22.798649 I | ceph-mgr: 2017-07-11 13:24:22.798625 7f4cc622c700 1 mgr handle_mgr_map Activating!
- 2017-07-11 13:24:22.820380 I | ceph-mgr: 2017-07-11 13:24:22.802600 7f4cc622c700 1 mgr handle_mgr_map I am now active
- 2017-07-11 13:24:22.828889 I | ceph-mgr: 2017-07-11 13:24:22.828867 7f4cc2224700 1 mgr load_all_metadata Skipping incomplete metadata entry
- 2017-07-11 13:24:22.828955 I | ceph-mgr: 2017-07-11 13:24:22.828940 7f4cc2224700 1 mgr load_all_metadata Skipping incomplete metadata entry
- 2017-07-11 13:24:22.828985 I | ceph-mgr: 2017-07-11 13:24:22.828974 7f4cc2224700 1 mgr load_all_metadata Skipping incomplete metadata entry
- 2017-07-11 13:24:22.829027 I | ceph-mgr: 2017-07-11 13:24:22.829016 7f4cc2224700 1 mgr load_all_metadata Skipping incomplete metadata entry
- 2017-07-11 13:24:22.829054 I | ceph-mgr: 2017-07-11 13:24:22.829043 7f4cc2224700 1 mgr load_all_metadata Skipping incomplete metadata entry
- 2017-07-11 13:24:22.982945 I | ceph-mgr: 2017-07-11 13:24:22.982915 7f4cc2224700 1 mgr init Loading python module 'restful'
- 2017-07-11 13:24:23.203084 I | ceph-mgr: 2017-07-11 13:24:23.203017 7f4cc2224700 -1 mgr load Module not found: 'restful'
- 2017-07-11 13:24:23.203625 I | ceph-mgr: 2017-07-11 13:24:23.203165 7f4cc2224700 -1 mgr load Traceback (most recent call last):
- 2017-07-11 13:24:23.203660 I | ceph-mgr: File "/usr/local/lib/ceph/mgr/restful/__init__.py", line 1, in <module>
- 2017-07-11 13:24:23.203675 I | ceph-mgr: from module import * # NOQA
- 2017-07-11 13:24:23.203686 I | ceph-mgr: File "/usr/local/lib/ceph/mgr/restful/module.py", line 17, in <module>
- 2017-07-11 13:24:23.203696 I | ceph-mgr: from pecan import jsonify, make_app
- 2017-07-11 13:24:23.203707 I | ceph-mgr: ImportError: No module named pecan
- 2017-07-11 13:24:23.203716 I | ceph-mgr:
- 2017-07-11 13:24:23.203767 I | ceph-mgr: 2017-07-11 13:24:23.203743 7f4cc2224700 -1 mgr init Error loading module 'restful': (2) No such file or directory
- 2017-07-11 13:24:23.203799 I | ceph-mgr: 2017-07-11 13:24:23.203788 7f4cc2224700 1 mgr start Creating threads for 0 modules
- 2017-07-11 13:24:24.132666 I | ceph-mgr: 2017-07-11 13:24:24.132622 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.0: (2) No such file or directory
- 2017-07-11 13:24:24.132716 I | ceph-mgr: 2017-07-11 13:24:24.132628 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.1: (2) No such file or directory
- 2017-07-11 13:24:24.132731 I | ceph-mgr: 2017-07-11 13:24:24.132631 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.2: (2) No such file or directory
- 2017-07-11 13:24:24.132743 I | ceph-mgr: 2017-07-11 13:24:24.132633 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.3: (2) No such file or directory
- 2017-07-11 13:24:24.132753 I | ceph-mgr: 2017-07-11 13:24:24.132635 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.4: (2) No such file or directory
- 2017-07-11 13:24:24.132783 I | ceph-mgr: 2017-07-11 13:24:24.132636 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.5: (2) No such file or directory
- 2017-07-11 13:24:24.491993 I | ceph-mgr: 2017-07-11 13:24:24.491736 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:24.492068 I | ceph-mgr: 2017-07-11 13:24:24.491752 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:24.492084 I | ceph-mgr: 2017-07-11 13:24:24.491807 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:25.397635 I | ceph-mgr: 2017-07-11 13:24:25.397600 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.0: (2) No such file or directory
- 2017-07-11 13:24:25.398988 I | ceph-mgr: 2017-07-11 13:24:25.398964 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.1: (2) No such file or directory
- 2017-07-11 13:24:25.405918 I | ceph-mgr: 2017-07-11 13:24:25.405870 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.2: (2) No such file or directory
- 2017-07-11 13:24:25.416280 I | ceph-mgr: 2017-07-11 13:24:25.416259 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.3: (2) No such file or directory
- 2017-07-11 13:24:25.416913 I | ceph-mgr: 2017-07-11 13:24:25.416895 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.4: (2) No such file or directory
- 2017-07-11 13:24:25.417430 I | ceph-mgr: 2017-07-11 13:24:25.417402 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.5: (2) No such file or directory
- 2017-07-11 13:24:26.498113 I | ceph-mgr: 2017-07-11 13:24:26.497840 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:26.498192 I | ceph-mgr: 2017-07-11 13:24:26.497851 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:26.498230 I | ceph-mgr: 2017-07-11 13:24:26.497884 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:26.498258 I | ceph-mgr: 2017-07-11 13:24:26.497899 7f4cc3226700 0 Cannot get stat of OSD 0
- 2017-07-11 13:24:26.498270 I | ceph-mgr: 2017-07-11 13:24:26.497900 7f4cc3226700 0 Cannot get stat of OSD 1
- 2017-07-11 13:24:26.743106 I | ceph-mgr: 2017-07-11 13:24:26.743047 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.0: (2) No such file or directory
- 2017-07-11 13:24:26.743782 I | ceph-mgr: 2017-07-11 13:24:26.743729 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.1: (2) No such file or directory
- 2017-07-11 13:24:26.744335 I | ceph-mgr: 2017-07-11 13:24:26.744319 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.2: (2) No such file or directory
- 2017-07-11 13:24:26.744781 I | ceph-mgr: 2017-07-11 13:24:26.744762 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.3: (2) No such file or directory
- 2017-07-11 13:24:26.745356 I | ceph-mgr: 2017-07-11 13:24:26.745340 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.4: (2) No such file or directory
- 2017-07-11 13:24:26.762233 I | ceph-mgr: 2017-07-11 13:24:26.762216 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.5: (2) No such file or directory
- 2017-07-11 13:24:28.503551 I | ceph-mgr: 2017-07-11 13:24:28.503251 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:28.503611 I | ceph-mgr: 2017-07-11 13:24:28.503264 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:28.503628 I | ceph-mgr: 2017-07-11 13:24:28.503297 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:28.503639 I | ceph-mgr: 2017-07-11 13:24:28.503315 7f4cc3226700 0 Cannot get stat of OSD 3
- 2017-07-11 13:24:29.042600 I | ceph-mgr: 2017-07-11 13:24:29.042574 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.2: (2) No such file or directory
- 2017-07-11 13:24:29.043317 I | ceph-mgr: 2017-07-11 13:24:29.043299 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.3: (2) No such file or directory
- 2017-07-11 13:24:29.043929 I | ceph-mgr: 2017-07-11 13:24:29.043879 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.4: (2) No such file or directory
- 2017-07-11 13:24:29.044552 I | ceph-mgr: 2017-07-11 13:24:29.044533 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.5: (2) No such file or directory
- 2017-07-11 13:24:30.453001 I | ceph-mgr: 2017-07-11 13:24:30.452959 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.2: (2) No such file or directory
- 2017-07-11 13:24:30.454319 I | ceph-mgr: 2017-07-11 13:24:30.454246 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.4: (2) No such file or directory
- 2017-07-11 13:24:30.473937 I | ceph-mgr: 2017-07-11 13:24:30.473919 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.5: (2) No such file or directory
- 2017-07-11 13:24:30.510626 I | ceph-mgr: 2017-07-11 13:24:30.510337 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:30.510665 I | ceph-mgr: 2017-07-11 13:24:30.510343 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:30.510695 I | ceph-mgr: 2017-07-11 13:24:30.510364 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:30.510707 I | ceph-mgr: 2017-07-11 13:24:30.510379 7f4cc3226700 0 Cannot get stat of OSD 4
- 2017-07-11 13:24:30.946448 I | ceph-mgr: 2017-07-11 13:24:30.946406 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.2: (2) No such file or directory
- 2017-07-11 13:24:30.946624 I | ceph-mgr: 2017-07-11 13:24:30.946608 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.4: (2) No such file or directory
- 2017-07-11 13:24:30.954540 I | ceph-mgr: 2017-07-11 13:24:30.954522 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.5: (2) No such file or directory
- 2017-07-11 13:24:32.513704 I | ceph-mgr: 2017-07-11 13:24:32.513198 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:32.520030 I | ceph-mgr: 2017-07-11 13:24:32.513291 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:32.520193 I | ceph-mgr: 2017-07-11 13:24:32.513311 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:32.702227 I | ceph-mgr: 2017-07-11 13:24:32.702201 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.4: (2) No such file or directory
- 2017-07-11 13:24:32.711322 I | ceph-mgr: 2017-07-11 13:24:32.711290 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.5: (2) No such file or directory
- 2017-07-11 13:24:33.825217 I | ceph-mgr: 2017-07-11 13:24:33.825191 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.5: (2) No such file or directory
- 2017-07-11 13:24:34.522435 I | ceph-mgr: 2017-07-11 13:24:34.521963 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:34.522506 I | ceph-mgr: 2017-07-11 13:24:34.521975 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:34.522525 I | ceph-mgr: 2017-07-11 13:24:34.522006 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:34.522551 I | ceph-mgr: 2017-07-11 13:24:34.522157 7f4cc3226700 0 Cannot get stat of OSD 5
- 2017-07-11 13:24:36.529678 I | ceph-mgr: 2017-07-11 13:24:36.528026 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:36.529746 I | ceph-mgr: 2017-07-11 13:24:36.528033 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:36.529763 I | ceph-mgr: 2017-07-11 13:24:36.528061 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:36.529774 I | ceph-mgr: 2017-07-11 13:24:36.528194 7f4cc3226700 0 Cannot get stat of OSD 5
- 2017-07-11 13:24:36.699490 I | ceph-mgr: 2017-07-11 13:24:36.699469 7f4cc4a29700 1 mgr finish mon failed to return metadata for osd.5: (2) No such file or directory
- 2017-07-11 13:24:38.529983 I | ceph-mgr: 2017-07-11 13:24:38.529642 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:38.530060 I | ceph-mgr: 2017-07-11 13:24:38.529656 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:38.530077 I | ceph-mgr: 2017-07-11 13:24:38.529689 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:40.531797 I | ceph-mgr: 2017-07-11 13:24:40.531191 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:40.532276 I | ceph-mgr: 2017-07-11 13:24:40.531197 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:40.532307 I | ceph-mgr: 2017-07-11 13:24:40.531222 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:42.532503 I | ceph-mgr: 2017-07-11 13:24:42.531888 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:42.535215 I | ceph-mgr: 2017-07-11 13:24:42.531896 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:42.535245 I | ceph-mgr: 2017-07-11 13:24:42.531920 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:44.538322 I | ceph-mgr: 2017-07-11 13:24:44.537882 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:44.538389 I | ceph-mgr: 2017-07-11 13:24:44.537890 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:44.538405 I | ceph-mgr: 2017-07-11 13:24:44.537918 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:46.539474 I | ceph-mgr: 2017-07-11 13:24:46.539019 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:46.539654 I | ceph-mgr: 2017-07-11 13:24:46.539028 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:46.539686 I | ceph-mgr: 2017-07-11 13:24:46.539055 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:48.540208 I | ceph-mgr: 2017-07-11 13:24:48.539515 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:48.540266 I | ceph-mgr: 2017-07-11 13:24:48.539525 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:48.540281 I | ceph-mgr: 2017-07-11 13:24:48.539554 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:50.549115 I | ceph-mgr: 2017-07-11 13:24:50.548518 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:50.549174 I | ceph-mgr: 2017-07-11 13:24:50.548524 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:50.549189 I | ceph-mgr: 2017-07-11 13:24:50.548545 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:52.550614 I | ceph-mgr: 2017-07-11 13:24:52.549862 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:52.552319 I | ceph-mgr: 2017-07-11 13:24:52.549868 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:52.552348 I | ceph-mgr: 2017-07-11 13:24:52.549892 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:54.558135 I | ceph-mgr: 2017-07-11 13:24:54.557576 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:54.558211 I | ceph-mgr: 2017-07-11 13:24:54.557587 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:54.558233 I | ceph-mgr: 2017-07-11 13:24:54.557617 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:56.560606 I | ceph-mgr: 2017-07-11 13:24:56.560565 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:56.560682 I | ceph-mgr: 2017-07-11 13:24:56.560665 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:56.560761 I | ceph-mgr: 2017-07-11 13:24:56.560751 7f4cc3226700 0 mgr tick
- 2017-07-11 13:24:58.564485 I | ceph-mgr: 2017-07-11 13:24:58.564426 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:24:58.564574 I | ceph-mgr: 2017-07-11 13:24:58.564559 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:24:58.564672 I | ceph-mgr: 2017-07-11 13:24:58.564661 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:00.566931 I | ceph-mgr: 2017-07-11 13:25:00.566903 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:00.566995 I | ceph-mgr: 2017-07-11 13:25:00.566981 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:00.567068 I | ceph-mgr: 2017-07-11 13:25:00.567058 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:02.575188 I | ceph-mgr: 2017-07-11 13:25:02.574165 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:02.575242 I | ceph-mgr: 2017-07-11 13:25:02.574177 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:02.575262 I | ceph-mgr: 2017-07-11 13:25:02.574218 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:04.576309 I | ceph-mgr: 2017-07-11 13:25:04.575667 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:04.576461 I | ceph-mgr: 2017-07-11 13:25:04.575677 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:04.576603 I | ceph-mgr: 2017-07-11 13:25:04.575706 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:06.581585 I | ceph-mgr: 2017-07-11 13:25:06.579232 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:06.581638 I | ceph-mgr: 2017-07-11 13:25:06.579247 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:06.581653 I | ceph-mgr: 2017-07-11 13:25:06.579295 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:08.591685 I | ceph-mgr: 2017-07-11 13:25:08.588783 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:08.591759 I | ceph-mgr: 2017-07-11 13:25:08.588797 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:08.591776 I | ceph-mgr: 2017-07-11 13:25:08.588828 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:10.594474 I | ceph-mgr: 2017-07-11 13:25:10.593690 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:10.596824 I | ceph-mgr: 2017-07-11 13:25:10.593697 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:10.596858 I | ceph-mgr: 2017-07-11 13:25:10.593724 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:12.618496 I | ceph-mgr: 2017-07-11 13:25:12.600913 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:12.618556 I | ceph-mgr: 2017-07-11 13:25:12.600926 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:12.618573 I | ceph-mgr: 2017-07-11 13:25:12.600977 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:14.622678 I | ceph-mgr: 2017-07-11 13:25:14.622636 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:14.622757 I | ceph-mgr: 2017-07-11 13:25:14.622742 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:14.623010 I | ceph-mgr: 2017-07-11 13:25:14.622995 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:16.627345 I | ceph-mgr: 2017-07-11 13:25:16.627318 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:16.627410 I | ceph-mgr: 2017-07-11 13:25:16.627397 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:16.627620 I | ceph-mgr: 2017-07-11 13:25:16.627510 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:18.652815 I | ceph-mgr: 2017-07-11 13:25:18.652747 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:18.652931 I | ceph-mgr: 2017-07-11 13:25:18.652917 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:18.653145 I | ceph-mgr: 2017-07-11 13:25:18.653095 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:20.658925 I | ceph-mgr: 2017-07-11 13:25:20.658803 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:20.659012 I | ceph-mgr: 2017-07-11 13:25:20.658997 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:20.659272 I | ceph-mgr: 2017-07-11 13:25:20.659257 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:22.660927 I | ceph-mgr: 2017-07-11 13:25:22.660897 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:22.661088 I | ceph-mgr: 2017-07-11 13:25:22.661073 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:22.663259 I | ceph-mgr: 2017-07-11 13:25:22.663242 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:24.665325 I | ceph-mgr: 2017-07-11 13:25:24.664951 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:24.665425 I | ceph-mgr: 2017-07-11 13:25:24.665409 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:24.665673 I | ceph-mgr: 2017-07-11 13:25:24.665657 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:26.683811 I | ceph-mgr: 2017-07-11 13:25:26.683225 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:26.683890 I | ceph-mgr: 2017-07-11 13:25:26.683227 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:26.683914 I | ceph-mgr: 2017-07-11 13:25:26.683246 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:28.689509 I | ceph-mgr: 2017-07-11 13:25:28.685903 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:28.689721 I | ceph-mgr: 2017-07-11 13:25:28.685915 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:28.689819 I | ceph-mgr: 2017-07-11 13:25:28.685943 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:30.702433 I | ceph-mgr: 2017-07-11 13:25:30.702260 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:30.702585 I | ceph-mgr: 2017-07-11 13:25:30.702265 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:30.702636 I | ceph-mgr: 2017-07-11 13:25:30.702289 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:32.715512 I | ceph-mgr: 2017-07-11 13:25:32.705400 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:32.715573 I | ceph-mgr: 2017-07-11 13:25:32.705411 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:32.715607 I | ceph-mgr: 2017-07-11 13:25:32.705435 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:34.712650 I | ceph-mgr: 2017-07-11 13:25:34.711868 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:34.712809 I | ceph-mgr: 2017-07-11 13:25:34.711878 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:34.712855 I | ceph-mgr: 2017-07-11 13:25:34.711905 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:36.719238 I | ceph-mgr: 2017-07-11 13:25:36.718278 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:36.721772 I | ceph-mgr: 2017-07-11 13:25:36.718284 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:36.721801 I | ceph-mgr: 2017-07-11 13:25:36.718306 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:38.726144 I | ceph-mgr: 2017-07-11 13:25:38.725188 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:38.726225 I | ceph-mgr: 2017-07-11 13:25:38.725201 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:38.726243 I | ceph-mgr: 2017-07-11 13:25:38.725234 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:40.730879 I | ceph-mgr: 2017-07-11 13:25:40.727175 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:40.730961 I | ceph-mgr: 2017-07-11 13:25:40.727190 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:40.730978 I | ceph-mgr: 2017-07-11 13:25:40.727238 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:42.753146 I | ceph-mgr: 2017-07-11 13:25:42.752198 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:42.753230 I | ceph-mgr: 2017-07-11 13:25:42.752210 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:42.753252 I | ceph-mgr: 2017-07-11 13:25:42.752237 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:44.769953 I | ceph-mgr: 2017-07-11 13:25:44.753755 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:44.770008 I | ceph-mgr: 2017-07-11 13:25:44.753763 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:44.770024 I | ceph-mgr: 2017-07-11 13:25:44.753788 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:46.771053 I | ceph-mgr: 2017-07-11 13:25:46.771020 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:46.771126 I | ceph-mgr: 2017-07-11 13:25:46.771113 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:46.771342 I | ceph-mgr: 2017-07-11 13:25:46.771226 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:48.773886 I | ceph-mgr: 2017-07-11 13:25:48.773846 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:48.773965 I | ceph-mgr: 2017-07-11 13:25:48.773951 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:48.774223 I | ceph-mgr: 2017-07-11 13:25:48.774195 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:50.775698 I | ceph-mgr: 2017-07-11 13:25:50.775596 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:50.775780 I | ceph-mgr: 2017-07-11 13:25:50.775764 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:50.776031 I | ceph-mgr: 2017-07-11 13:25:50.775949 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:52.781173 I | ceph-mgr: 2017-07-11 13:25:52.780746 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:52.783591 I | ceph-mgr: 2017-07-11 13:25:52.780759 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:52.783623 I | ceph-mgr: 2017-07-11 13:25:52.780823 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:54.786831 I | ceph-mgr: 2017-07-11 13:25:54.786483 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:54.787054 I | ceph-mgr: 2017-07-11 13:25:54.786488 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:54.787146 I | ceph-mgr: 2017-07-11 13:25:54.786508 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:56.832685 I | ceph-mgr: 2017-07-11 13:25:56.790784 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:56.832753 I | ceph-mgr: 2017-07-11 13:25:56.790789 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:56.832770 I | ceph-mgr: 2017-07-11 13:25:56.790811 7f4cc3226700 0 mgr tick
- 2017-07-11 13:25:58.798319 I | ceph-mgr: 2017-07-11 13:25:58.797950 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:25:58.798388 I | ceph-mgr: 2017-07-11 13:25:58.797958 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:25:58.798406 I | ceph-mgr: 2017-07-11 13:25:58.797980 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:00.805716 I | ceph-mgr: 2017-07-11 13:26:00.798513 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:00.805778 I | ceph-mgr: 2017-07-11 13:26:00.798522 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:00.805794 I | ceph-mgr: 2017-07-11 13:26:00.798548 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:02.804010 I | ceph-mgr: 2017-07-11 13:26:02.803690 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:02.806550 I | ceph-mgr: 2017-07-11 13:26:02.803699 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:02.806610 I | ceph-mgr: 2017-07-11 13:26:02.803723 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:04.810421 I | ceph-mgr: 2017-07-11 13:26:04.809452 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:04.810855 I | ceph-mgr: 2017-07-11 13:26:04.809462 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:04.810893 I | ceph-mgr: 2017-07-11 13:26:04.809493 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:06.818255 I | ceph-mgr: 2017-07-11 13:26:06.814451 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:06.818320 I | ceph-mgr: 2017-07-11 13:26:06.814457 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:06.818337 I | ceph-mgr: 2017-07-11 13:26:06.814480 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:08.817258 I | ceph-mgr: 2017-07-11 13:26:08.816919 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:08.817320 I | ceph-mgr: 2017-07-11 13:26:08.816928 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:08.817336 I | ceph-mgr: 2017-07-11 13:26:08.816955 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:10.820652 I | ceph-mgr: 2017-07-11 13:26:10.820377 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:10.820814 I | ceph-mgr: 2017-07-11 13:26:10.820389 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:10.820856 I | ceph-mgr: 2017-07-11 13:26:10.820418 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:12.823722 I | ceph-mgr: 2017-07-11 13:26:12.823481 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:12.823785 I | ceph-mgr: 2017-07-11 13:26:12.823491 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:12.823801 I | ceph-mgr: 2017-07-11 13:26:12.823518 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:14.825194 I | ceph-mgr: 2017-07-11 13:26:14.824838 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:14.825258 I | ceph-mgr: 2017-07-11 13:26:14.824846 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:14.825274 I | ceph-mgr: 2017-07-11 13:26:14.824875 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:16.827344 I | ceph-mgr: 2017-07-11 13:26:16.826721 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:16.827409 I | ceph-mgr: 2017-07-11 13:26:16.826732 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:16.827426 I | ceph-mgr: 2017-07-11 13:26:16.826773 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:18.832167 I | ceph-mgr: 2017-07-11 13:26:18.831848 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:18.832670 I | ceph-mgr: 2017-07-11 13:26:18.831855 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:18.832717 I | ceph-mgr: 2017-07-11 13:26:18.831877 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:20.834130 I | ceph-mgr: 2017-07-11 13:26:20.833312 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:20.834200 I | ceph-mgr: 2017-07-11 13:26:20.833319 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:20.834217 I | ceph-mgr: 2017-07-11 13:26:20.833342 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:22.844454 I | ceph-mgr: 2017-07-11 13:26:22.842776 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:22.844510 I | ceph-mgr: 2017-07-11 13:26:22.842782 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:22.844527 I | ceph-mgr: 2017-07-11 13:26:22.842810 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:24.845979 I | ceph-mgr: 2017-07-11 13:26:24.845934 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:24.846063 I | ceph-mgr: 2017-07-11 13:26:24.846048 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:24.846821 I | ceph-mgr: 2017-07-11 13:26:24.846149 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:26.873340 I | ceph-mgr: 2017-07-11 13:26:26.855569 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:26.876523 I | ceph-mgr: 2017-07-11 13:26:26.855690 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:26.876532 I | ceph-mgr: 2017-07-11 13:26:26.855748 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:28.884584 I | ceph-mgr: 2017-07-11 13:26:28.884517 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:28.884834 I | ceph-mgr: 2017-07-11 13:26:28.884693 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:28.885102 I | ceph-mgr: 2017-07-11 13:26:28.885086 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:30.890836 I | ceph-mgr: 2017-07-11 13:26:30.890415 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:30.890893 I | ceph-mgr: 2017-07-11 13:26:30.890424 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:30.890910 I | ceph-mgr: 2017-07-11 13:26:30.890448 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:32.892921 I | ceph-mgr: 2017-07-11 13:26:32.892149 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:32.894970 I | ceph-mgr: 2017-07-11 13:26:32.892160 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:32.894999 I | ceph-mgr: 2017-07-11 13:26:32.892187 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:34.898840 I | ceph-mgr: 2017-07-11 13:26:34.898506 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:34.898896 I | ceph-mgr: 2017-07-11 13:26:34.898514 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:34.898912 I | ceph-mgr: 2017-07-11 13:26:34.898536 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:36.928614 I | ceph-mgr: 2017-07-11 13:26:36.901500 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:36.928670 I | ceph-mgr: 2017-07-11 13:26:36.901507 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:36.928688 I | ceph-mgr: 2017-07-11 13:26:36.901529 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:38.936695 I | ceph-mgr: 2017-07-11 13:26:38.936244 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:38.937713 I | ceph-mgr: 2017-07-11 13:26:38.936259 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:38.937744 I | ceph-mgr: 2017-07-11 13:26:38.936305 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:40.966117 I | ceph-mgr: 2017-07-11 13:26:40.939729 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:40.966729 I | ceph-mgr: 2017-07-11 13:26:40.939734 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:40.966767 I | ceph-mgr: 2017-07-11 13:26:40.939758 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:42.974136 I | ceph-mgr: 2017-07-11 13:26:42.971826 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:42.974194 I | ceph-mgr: 2017-07-11 13:26:42.971847 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:42.974275 I | ceph-mgr: 2017-07-11 13:26:42.974216 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:44.977360 I | ceph-mgr: 2017-07-11 13:26:44.977069 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:44.977509 I | ceph-mgr: 2017-07-11 13:26:44.977074 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:44.977559 I | ceph-mgr: 2017-07-11 13:26:44.977095 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:46.985756 I | ceph-mgr: 2017-07-11 13:26:46.984248 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:46.985944 I | ceph-mgr: 2017-07-11 13:26:46.984256 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:46.986082 I | ceph-mgr: 2017-07-11 13:26:46.984294 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:48.992664 I | ceph-mgr: 2017-07-11 13:26:48.992293 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:48.992718 I | ceph-mgr: 2017-07-11 13:26:48.992305 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:48.992737 I | ceph-mgr: 2017-07-11 13:26:48.992345 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:50.994365 I | ceph-mgr: 2017-07-11 13:26:50.993625 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:51.003832 I | ceph-mgr: 2017-07-11 13:26:50.993644 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:51.003880 I | ceph-mgr: 2017-07-11 13:26:50.993665 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:53.000809 I | ceph-mgr: 2017-07-11 13:26:53.000082 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:53.001235 I | ceph-mgr: 2017-07-11 13:26:53.000091 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:53.001265 I | ceph-mgr: 2017-07-11 13:26:53.000117 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:55.001227 I | ceph-mgr: 2017-07-11 13:26:55.000856 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:55.001284 I | ceph-mgr: 2017-07-11 13:26:55.000876 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:55.001300 I | ceph-mgr: 2017-07-11 13:26:55.000904 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:57.007538 I | ceph-mgr: 2017-07-11 13:26:57.006608 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:57.007719 I | ceph-mgr: 2017-07-11 13:26:57.006619 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:57.007752 I | ceph-mgr: 2017-07-11 13:26:57.006670 7f4cc3226700 0 mgr tick
- 2017-07-11 13:26:59.010289 I | ceph-mgr: 2017-07-11 13:26:59.010248 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:26:59.016305 I | ceph-mgr: 2017-07-11 13:26:59.016263 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:26:59.016454 I | ceph-mgr: 2017-07-11 13:26:59.016434 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:01.022605 I | ceph-mgr: 2017-07-11 13:27:01.022306 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:01.022661 I | ceph-mgr: 2017-07-11 13:27:01.022312 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:01.022677 I | ceph-mgr: 2017-07-11 13:27:01.022330 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:03.032868 I | ceph-mgr: 2017-07-11 13:27:03.032077 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:03.032924 I | ceph-mgr: 2017-07-11 13:27:03.032089 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:03.032943 I | ceph-mgr: 2017-07-11 13:27:03.032117 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:05.033926 I | ceph-mgr: 2017-07-11 13:27:05.033556 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:05.033999 I | ceph-mgr: 2017-07-11 13:27:05.033566 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:05.034015 I | ceph-mgr: 2017-07-11 13:27:05.033598 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:07.037263 I | ceph-mgr: 2017-07-11 13:27:07.035424 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:07.043934 I | ceph-mgr: 2017-07-11 13:27:07.035431 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:07.043970 I | ceph-mgr: 2017-07-11 13:27:07.035457 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:09.039462 I | ceph-mgr: 2017-07-11 13:27:09.039412 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:09.039553 I | ceph-mgr: 2017-07-11 13:27:09.039528 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:09.039802 I | ceph-mgr: 2017-07-11 13:27:09.039785 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:11.046855 I | ceph-mgr: 2017-07-11 13:27:11.046594 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:11.046922 I | ceph-mgr: 2017-07-11 13:27:11.046599 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:11.046939 I | ceph-mgr: 2017-07-11 13:27:11.046617 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:13.058783 I | ceph-mgr: 2017-07-11 13:27:13.049727 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:13.058849 I | ceph-mgr: 2017-07-11 13:27:13.049738 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:13.058865 I | ceph-mgr: 2017-07-11 13:27:13.049766 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:15.058053 I | ceph-mgr: 2017-07-11 13:27:15.058019 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:15.058137 I | ceph-mgr: 2017-07-11 13:27:15.058122 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:15.058364 I | ceph-mgr: 2017-07-11 13:27:15.058348 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:17.063879 I | ceph-mgr: 2017-07-11 13:27:17.062020 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:17.070618 I | ceph-mgr: 2017-07-11 13:27:17.062029 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:17.070718 I | ceph-mgr: 2017-07-11 13:27:17.062053 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:19.064316 I | ceph-mgr: 2017-07-11 13:27:19.064276 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:19.064388 I | ceph-mgr: 2017-07-11 13:27:19.064374 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:19.064561 I | ceph-mgr: 2017-07-11 13:27:19.064492 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:21.066006 I | ceph-mgr: 2017-07-11 13:27:21.065624 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:21.066230 I | ceph-mgr: 2017-07-11 13:27:21.065630 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:21.066258 I | ceph-mgr: 2017-07-11 13:27:21.065649 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:23.085586 I | ceph-mgr: 2017-07-11 13:27:23.067790 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:23.085716 I | ceph-mgr: 2017-07-11 13:27:23.067798 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:23.085733 I | ceph-mgr: 2017-07-11 13:27:23.067829 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:25.090137 I | ceph-mgr: 2017-07-11 13:27:25.090089 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:25.090228 I | ceph-mgr: 2017-07-11 13:27:25.090212 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:25.090730 I | ceph-mgr: 2017-07-11 13:27:25.090702 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:27.108092 I | ceph-mgr: 2017-07-11 13:27:27.091732 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:27.108149 I | ceph-mgr: 2017-07-11 13:27:27.091739 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:27.108165 I | ceph-mgr: 2017-07-11 13:27:27.091763 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:29.111918 I | ceph-mgr: 2017-07-11 13:27:29.111874 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:29.112097 I | ceph-mgr: 2017-07-11 13:27:29.112080 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:29.121919 I | ceph-mgr: 2017-07-11 13:27:29.121900 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:31.126221 I | ceph-mgr: 2017-07-11 13:27:31.125317 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:31.127877 I | ceph-mgr: 2017-07-11 13:27:31.125330 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:31.127913 I | ceph-mgr: 2017-07-11 13:27:31.125372 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:33.128869 I | ceph-mgr: 2017-07-11 13:27:33.128530 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:33.128922 I | ceph-mgr: 2017-07-11 13:27:33.128539 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:33.128938 I | ceph-mgr: 2017-07-11 13:27:33.128567 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:35.135048 I | ceph-mgr: 2017-07-11 13:27:35.134731 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:35.135100 I | ceph-mgr: 2017-07-11 13:27:35.134737 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:35.135116 I | ceph-mgr: 2017-07-11 13:27:35.134757 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:37.149648 I | ceph-mgr: 2017-07-11 13:27:37.139468 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:37.149731 I | ceph-mgr: 2017-07-11 13:27:37.139481 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:37.149746 I | ceph-mgr: 2017-07-11 13:27:37.139525 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:39.152744 I | ceph-mgr: 2017-07-11 13:27:39.152713 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:39.152815 I | ceph-mgr: 2017-07-11 13:27:39.152801 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:39.152885 I | ceph-mgr: 2017-07-11 13:27:39.152875 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:41.176157 I | ceph-mgr: 2017-07-11 13:27:41.176097 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:41.176584 I | ceph-mgr: 2017-07-11 13:27:41.176565 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:41.176917 I | ceph-mgr: 2017-07-11 13:27:41.176900 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:43.184160 I | ceph-mgr: 2017-07-11 13:27:43.183646 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:43.184366 I | ceph-mgr: 2017-07-11 13:27:43.183662 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:43.184406 I | ceph-mgr: 2017-07-11 13:27:43.183710 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:45.186887 I | ceph-mgr: 2017-07-11 13:27:45.186453 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:45.186944 I | ceph-mgr: 2017-07-11 13:27:45.186464 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:45.187010 I | ceph-mgr: 2017-07-11 13:27:45.186967 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:47.190783 I | ceph-mgr: 2017-07-11 13:27:47.188811 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:47.206765 I | ceph-mgr: 2017-07-11 13:27:47.188818 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:47.206775 I | ceph-mgr: 2017-07-11 13:27:47.188841 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:49.195670 I | ceph-mgr: 2017-07-11 13:27:49.194978 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:49.195825 I | ceph-mgr: 2017-07-11 13:27:49.194983 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:49.195846 I | ceph-mgr: 2017-07-11 13:27:49.195004 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:51.200199 I | ceph-mgr: 2017-07-11 13:27:51.199866 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:51.200265 I | ceph-mgr: 2017-07-11 13:27:51.199872 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:51.200281 I | ceph-mgr: 2017-07-11 13:27:51.199892 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:53.210100 I | ceph-mgr: 2017-07-11 13:27:53.209705 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:53.210162 I | ceph-mgr: 2017-07-11 13:27:53.209723 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:53.210180 I | ceph-mgr: 2017-07-11 13:27:53.209772 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:55.213652 I | ceph-mgr: 2017-07-11 13:27:55.212815 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:55.215414 I | ceph-mgr: 2017-07-11 13:27:55.212826 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:55.215450 I | ceph-mgr: 2017-07-11 13:27:55.212858 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:57.219472 I | ceph-mgr: 2017-07-11 13:27:57.219126 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:57.219634 I | ceph-mgr: 2017-07-11 13:27:57.219131 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:57.219676 I | ceph-mgr: 2017-07-11 13:27:57.219152 7f4cc3226700 0 mgr tick
- 2017-07-11 13:27:59.226541 I | ceph-mgr: 2017-07-11 13:27:59.226509 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:27:59.226639 I | ceph-mgr: 2017-07-11 13:27:59.226513 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:27:59.227047 I | ceph-mgr: 2017-07-11 13:27:59.226972 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:01.230071 I | ceph-mgr: 2017-07-11 13:28:01.229398 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:01.230133 I | ceph-mgr: 2017-07-11 13:28:01.229406 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:01.230325 I | ceph-mgr: 2017-07-11 13:28:01.229429 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:03.239363 I | ceph-mgr: 2017-07-11 13:28:03.239066 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:03.239433 I | ceph-mgr: 2017-07-11 13:28:03.239072 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:03.239449 I | ceph-mgr: 2017-07-11 13:28:03.239092 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:05.245412 I | ceph-mgr: 2017-07-11 13:28:05.245239 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:05.245473 I | ceph-mgr: 2017-07-11 13:28:05.245256 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:05.245488 I | ceph-mgr: 2017-07-11 13:28:05.245303 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:07.249195 I | ceph-mgr: 2017-07-11 13:28:07.248776 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:07.251706 I | ceph-mgr: 2017-07-11 13:28:07.248788 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:07.251737 I | ceph-mgr: 2017-07-11 13:28:07.248844 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:09.252315 I | ceph-mgr: 2017-07-11 13:28:09.251580 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:09.253458 I | ceph-mgr: 2017-07-11 13:28:09.251587 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:09.253485 I | ceph-mgr: 2017-07-11 13:28:09.251611 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:11.258052 I | ceph-mgr: 2017-07-11 13:28:11.257725 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:11.267756 I | ceph-mgr: 2017-07-11 13:28:11.257730 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:11.267766 I | ceph-mgr: 2017-07-11 13:28:11.257759 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:13.262019 I | ceph-mgr: 2017-07-11 13:28:13.261600 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:13.263874 I | ceph-mgr: 2017-07-11 13:28:13.261619 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:13.263908 I | ceph-mgr: 2017-07-11 13:28:13.261667 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:15.267979 I | ceph-mgr: 2017-07-11 13:28:15.267548 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:15.268045 I | ceph-mgr: 2017-07-11 13:28:15.267557 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:15.268062 I | ceph-mgr: 2017-07-11 13:28:15.267583 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:17.272294 I | ceph-mgr: 2017-07-11 13:28:17.272074 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:17.272347 I | ceph-mgr: 2017-07-11 13:28:17.272080 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:17.272363 I | ceph-mgr: 2017-07-11 13:28:17.272098 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:19.275363 I | ceph-mgr: 2017-07-11 13:28:19.274197 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:19.275415 I | ceph-mgr: 2017-07-11 13:28:19.274202 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:19.275431 I | ceph-mgr: 2017-07-11 13:28:19.274223 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:21.277355 I | ceph-mgr: 2017-07-11 13:28:21.276762 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:21.277552 I | ceph-mgr: 2017-07-11 13:28:21.276768 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:21.277581 I | ceph-mgr: 2017-07-11 13:28:21.276787 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:23.304408 I | ceph-mgr: 2017-07-11 13:28:23.286195 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:23.304473 I | ceph-mgr: 2017-07-11 13:28:23.286204 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:23.304492 I | ceph-mgr: 2017-07-11 13:28:23.286229 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:25.306403 I | ceph-mgr: 2017-07-11 13:28:25.305562 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:25.315603 I | ceph-mgr: 2017-07-11 13:28:25.305574 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:25.315644 I | ceph-mgr: 2017-07-11 13:28:25.305608 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:27.312932 I | ceph-mgr: 2017-07-11 13:28:27.310921 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:27.319958 I | ceph-mgr: 2017-07-11 13:28:27.310934 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:27.319995 I | ceph-mgr: 2017-07-11 13:28:27.310970 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:29.314317 I | ceph-mgr: 2017-07-11 13:28:29.313373 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:29.314373 I | ceph-mgr: 2017-07-11 13:28:29.313378 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:29.314570 I | ceph-mgr: 2017-07-11 13:28:29.313401 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:31.322870 I | ceph-mgr: 2017-07-11 13:28:31.322151 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:31.323081 I | ceph-mgr: 2017-07-11 13:28:31.322157 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:31.323108 I | ceph-mgr: 2017-07-11 13:28:31.322178 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:33.327284 I | ceph-mgr: 2017-07-11 13:28:33.325386 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:33.333173 I | ceph-mgr: 2017-07-11 13:28:33.325413 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:33.333192 I | ceph-mgr: 2017-07-11 13:28:33.325440 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:35.330660 I | ceph-mgr: 2017-07-11 13:28:35.330622 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:35.330889 I | ceph-mgr: 2017-07-11 13:28:35.330873 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:35.331124 I | ceph-mgr: 2017-07-11 13:28:35.331108 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:37.344642 I | ceph-mgr: 2017-07-11 13:28:37.342725 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:37.344803 I | ceph-mgr: 2017-07-11 13:28:37.342740 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:37.345224 I | ceph-mgr: 2017-07-11 13:28:37.342785 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:39.346285 I | ceph-mgr: 2017-07-11 13:28:39.345208 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:39.353247 I | ceph-mgr: 2017-07-11 13:28:39.345214 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:39.353293 I | ceph-mgr: 2017-07-11 13:28:39.345279 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:41.353166 I | ceph-mgr: 2017-07-11 13:28:41.352434 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:41.353518 I | ceph-mgr: 2017-07-11 13:28:41.352440 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:41.353564 I | ceph-mgr: 2017-07-11 13:28:41.352516 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:43.364162 I | ceph-mgr: 2017-07-11 13:28:43.354997 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:43.364235 I | ceph-mgr: 2017-07-11 13:28:43.355008 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:43.364268 I | ceph-mgr: 2017-07-11 13:28:43.355040 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:45.368999 I | ceph-mgr: 2017-07-11 13:28:45.368959 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:45.369169 I | ceph-mgr: 2017-07-11 13:28:45.369153 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:45.379034 I | ceph-mgr: 2017-07-11 13:28:45.379013 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:47.380978 I | ceph-mgr: 2017-07-11 13:28:47.380155 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:47.381054 I | ceph-mgr: 2017-07-11 13:28:47.380160 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:47.381071 I | ceph-mgr: 2017-07-11 13:28:47.380183 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:49.400775 I | ceph-mgr: 2017-07-11 13:28:49.400746 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:49.400845 I | ceph-mgr: 2017-07-11 13:28:49.400832 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:49.401005 I | ceph-mgr: 2017-07-11 13:28:49.400942 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:51.402369 I | ceph-mgr: 2017-07-11 13:28:51.402308 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:51.402630 I | ceph-mgr: 2017-07-11 13:28:51.402478 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:51.402897 I | ceph-mgr: 2017-07-11 13:28:51.402881 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:53.418553 I | ceph-mgr: 2017-07-11 13:28:53.408728 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:53.418639 I | ceph-mgr: 2017-07-11 13:28:53.408741 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:53.418656 I | ceph-mgr: 2017-07-11 13:28:53.408783 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:55.419006 I | ceph-mgr: 2017-07-11 13:28:55.418942 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:55.419118 I | ceph-mgr: 2017-07-11 13:28:55.419102 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:55.429133 I | ceph-mgr: 2017-07-11 13:28:55.429111 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:57.458407 I | ceph-mgr: 2017-07-11 13:28:57.440820 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:57.458495 I | ceph-mgr: 2017-07-11 13:28:57.440833 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:57.458514 I | ceph-mgr: 2017-07-11 13:28:57.440879 7f4cc3226700 0 mgr tick
- 2017-07-11 13:28:59.466705 I | ceph-mgr: 2017-07-11 13:28:59.466635 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:28:59.466940 I | ceph-mgr: 2017-07-11 13:28:59.466902 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:28:59.467160 I | ceph-mgr: 2017-07-11 13:28:59.467144 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:01.472240 I | ceph-mgr: 2017-07-11 13:29:01.472178 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:01.472444 I | ceph-mgr: 2017-07-11 13:29:01.472354 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:01.472672 I | ceph-mgr: 2017-07-11 13:29:01.472655 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:03.485291 I | ceph-mgr: 2017-07-11 13:29:03.475666 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:03.485371 I | ceph-mgr: 2017-07-11 13:29:03.475680 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:03.485398 I | ceph-mgr: 2017-07-11 13:29:03.475710 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:05.482837 I | ceph-mgr: 2017-07-11 13:29:05.482791 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:05.482924 I | ceph-mgr: 2017-07-11 13:29:05.482908 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:05.483181 I | ceph-mgr: 2017-07-11 13:29:05.483164 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:07.503106 I | ceph-mgr: 2017-07-11 13:29:07.486294 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:07.503195 I | ceph-mgr: 2017-07-11 13:29:07.486301 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:07.503212 I | ceph-mgr: 2017-07-11 13:29:07.486324 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:09.510616 I | ceph-mgr: 2017-07-11 13:29:09.510569 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:09.510695 I | ceph-mgr: 2017-07-11 13:29:09.510680 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:09.510949 I | ceph-mgr: 2017-07-11 13:29:09.510933 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:11.519758 I | ceph-mgr: 2017-07-11 13:29:11.518945 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:11.519971 I | ceph-mgr: 2017-07-11 13:29:11.518957 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:11.519998 I | ceph-mgr: 2017-07-11 13:29:11.518989 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:13.530432 I | ceph-mgr: 2017-07-11 13:29:13.519855 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:13.530516 I | ceph-mgr: 2017-07-11 13:29:13.519865 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:13.530534 I | ceph-mgr: 2017-07-11 13:29:13.519895 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:15.528321 I | ceph-mgr: 2017-07-11 13:29:15.526719 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:15.528550 I | ceph-mgr: 2017-07-11 13:29:15.526730 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:15.528650 I | ceph-mgr: 2017-07-11 13:29:15.526771 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:17.529228 I | ceph-mgr: 2017-07-11 13:29:17.528022 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:17.529280 I | ceph-mgr: 2017-07-11 13:29:17.528028 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:17.529317 I | ceph-mgr: 2017-07-11 13:29:17.528054 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:19.538203 I | ceph-mgr: 2017-07-11 13:29:19.538168 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:19.538279 I | ceph-mgr: 2017-07-11 13:29:19.538264 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:19.538526 I | ceph-mgr: 2017-07-11 13:29:19.538511 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:21.545735 I | ceph-mgr: 2017-07-11 13:29:21.545678 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:21.545815 I | ceph-mgr: 2017-07-11 13:29:21.545800 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:21.546048 I | ceph-mgr: 2017-07-11 13:29:21.546032 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:23.551753 I | ceph-mgr: 2017-07-11 13:29:23.551686 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:23.551847 I | ceph-mgr: 2017-07-11 13:29:23.551830 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:23.552112 I | ceph-mgr: 2017-07-11 13:29:23.552093 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:25.560971 I | ceph-mgr: 2017-07-11 13:29:25.559921 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:25.561192 I | ceph-mgr: 2017-07-11 13:29:25.559927 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:25.561292 I | ceph-mgr: 2017-07-11 13:29:25.559953 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:27.562516 I | ceph-mgr: 2017-07-11 13:29:27.561282 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:27.562731 I | ceph-mgr: 2017-07-11 13:29:27.561302 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:27.562758 I | ceph-mgr: 2017-07-11 13:29:27.561336 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:29.564339 I | ceph-mgr: 2017-07-11 13:29:29.563628 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:29.564398 I | ceph-mgr: 2017-07-11 13:29:29.563635 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:29.564413 I | ceph-mgr: 2017-07-11 13:29:29.563659 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:31.568478 I | ceph-mgr: 2017-07-11 13:29:31.567665 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:31.577599 I | ceph-mgr: 2017-07-11 13:29:31.567673 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:31.577634 I | ceph-mgr: 2017-07-11 13:29:31.567702 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:33.576096 I | ceph-mgr: 2017-07-11 13:29:33.574879 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:33.576163 I | ceph-mgr: 2017-07-11 13:29:33.574893 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:33.576185 I | ceph-mgr: 2017-07-11 13:29:33.574925 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:35.578442 I | ceph-mgr: 2017-07-11 13:29:35.577416 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:35.578600 I | ceph-mgr: 2017-07-11 13:29:35.577422 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:35.578622 I | ceph-mgr: 2017-07-11 13:29:35.577445 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:37.580274 I | ceph-mgr: 2017-07-11 13:29:37.579468 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:37.581422 I | ceph-mgr: 2017-07-11 13:29:37.579480 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:37.581448 I | ceph-mgr: 2017-07-11 13:29:37.579516 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:39.588232 I | ceph-mgr: 2017-07-11 13:29:39.587298 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:39.588477 I | ceph-mgr: 2017-07-11 13:29:39.587309 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:39.588508 I | ceph-mgr: 2017-07-11 13:29:39.587340 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:41.591349 I | ceph-mgr: 2017-07-11 13:29:41.590937 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:41.591523 I | ceph-mgr: 2017-07-11 13:29:41.590947 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:41.591582 I | ceph-mgr: 2017-07-11 13:29:41.590978 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:43.595922 I | ceph-mgr: 2017-07-11 13:29:43.595556 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:43.596007 I | ceph-mgr: 2017-07-11 13:29:43.595568 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:43.596024 I | ceph-mgr: 2017-07-11 13:29:43.595598 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:45.598092 I | ceph-mgr: 2017-07-11 13:29:45.597746 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:45.598147 I | ceph-mgr: 2017-07-11 13:29:45.597751 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:45.598163 I | ceph-mgr: 2017-07-11 13:29:45.597776 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:47.603085 I | ceph-mgr: 2017-07-11 13:29:47.602736 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:47.603133 I | ceph-mgr: 2017-07-11 13:29:47.602742 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:47.603164 I | ceph-mgr: 2017-07-11 13:29:47.602766 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:49.609925 I | ceph-mgr: 2017-07-11 13:29:49.609581 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:49.611491 I | ceph-mgr: 2017-07-11 13:29:49.609588 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:49.611519 I | ceph-mgr: 2017-07-11 13:29:49.609611 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:51.612154 I | ceph-mgr: 2017-07-11 13:29:51.611772 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:51.612210 I | ceph-mgr: 2017-07-11 13:29:51.611786 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:51.612225 I | ceph-mgr: 2017-07-11 13:29:51.611831 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:53.615906 I | ceph-mgr: 2017-07-11 13:29:53.615497 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:53.615978 I | ceph-mgr: 2017-07-11 13:29:53.615512 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:53.615995 I | ceph-mgr: 2017-07-11 13:29:53.615556 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:55.622399 I | ceph-mgr: 2017-07-11 13:29:55.622059 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:55.622467 I | ceph-mgr: 2017-07-11 13:29:55.622065 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:55.622484 I | ceph-mgr: 2017-07-11 13:29:55.622091 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:57.629474 I | ceph-mgr: 2017-07-11 13:29:57.628998 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:57.629551 I | ceph-mgr: 2017-07-11 13:29:57.629010 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:57.629568 I | ceph-mgr: 2017-07-11 13:29:57.629052 7f4cc3226700 0 mgr tick
- 2017-07-11 13:29:59.631999 I | ceph-mgr: 2017-07-11 13:29:59.631663 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:29:59.636305 I | ceph-mgr: 2017-07-11 13:29:59.631669 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:29:59.642291 I | ceph-mgr: 2017-07-11 13:29:59.631704 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:01.648653 I | ceph-mgr: 2017-07-11 13:30:01.632263 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:01.648725 I | ceph-mgr: 2017-07-11 13:30:01.632267 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:01.648741 I | ceph-mgr: 2017-07-11 13:30:01.632288 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:03.634323 I | ceph-mgr: 2017-07-11 13:30:03.633971 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:03.634381 I | ceph-mgr: 2017-07-11 13:30:03.633983 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:03.634398 I | ceph-mgr: 2017-07-11 13:30:03.634013 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:05.641484 I | ceph-mgr: 2017-07-11 13:30:05.638898 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:05.641532 I | ceph-mgr: 2017-07-11 13:30:05.638905 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:05.641547 I | ceph-mgr: 2017-07-11 13:30:05.638927 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:07.647927 I | ceph-mgr: 2017-07-11 13:30:07.647597 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:07.647983 I | ceph-mgr: 2017-07-11 13:30:07.647609 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:07.647999 I | ceph-mgr: 2017-07-11 13:30:07.647640 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:09.659608 I | ceph-mgr: 2017-07-11 13:30:09.650763 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:09.659684 I | ceph-mgr: 2017-07-11 13:30:09.650777 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:09.659736 I | ceph-mgr: 2017-07-11 13:30:09.650822 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:11.666772 I | ceph-mgr: 2017-07-11 13:30:11.666718 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:11.666874 I | ceph-mgr: 2017-07-11 13:30:11.666858 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:11.667319 I | ceph-mgr: 2017-07-11 13:30:11.667301 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:13.668537 I | ceph-mgr: 2017-07-11 13:30:13.668488 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:13.668633 I | ceph-mgr: 2017-07-11 13:30:13.668618 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:13.668930 I | ceph-mgr: 2017-07-11 13:30:13.668913 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:15.695992 I | ceph-mgr: 2017-07-11 13:30:15.695955 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:15.696069 I | ceph-mgr: 2017-07-11 13:30:15.696053 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:15.696311 I | ceph-mgr: 2017-07-11 13:30:15.696283 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:17.698919 I | ceph-mgr: 2017-07-11 13:30:17.698841 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:17.699003 I | ceph-mgr: 2017-07-11 13:30:17.698987 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:17.699264 I | ceph-mgr: 2017-07-11 13:30:17.699242 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:19.706948 I | ceph-mgr: 2017-07-11 13:30:19.706911 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:19.707043 I | ceph-mgr: 2017-07-11 13:30:19.707028 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:19.707279 I | ceph-mgr: 2017-07-11 13:30:19.707264 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:21.713961 I | ceph-mgr: 2017-07-11 13:30:21.713861 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:21.714166 I | ceph-mgr: 2017-07-11 13:30:21.714149 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:21.714515 I | ceph-mgr: 2017-07-11 13:30:21.714499 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:23.716080 I | ceph-mgr: 2017-07-11 13:30:23.716038 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:23.716176 I | ceph-mgr: 2017-07-11 13:30:23.716161 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:23.716427 I | ceph-mgr: 2017-07-11 13:30:23.716411 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:25.729583 I | ceph-mgr: 2017-07-11 13:30:25.729526 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:25.729662 I | ceph-mgr: 2017-07-11 13:30:25.729647 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:25.729906 I | ceph-mgr: 2017-07-11 13:30:25.729890 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:27.730727 I | ceph-mgr: 2017-07-11 13:30:27.730613 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:27.730827 I | ceph-mgr: 2017-07-11 13:30:27.730812 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:27.731068 I | ceph-mgr: 2017-07-11 13:30:27.731053 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:29.738436 I | ceph-mgr: 2017-07-11 13:30:29.738105 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:29.738520 I | ceph-mgr: 2017-07-11 13:30:29.738113 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:29.738584 I | ceph-mgr: 2017-07-11 13:30:29.738139 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:31.739060 I | ceph-mgr: 2017-07-11 13:30:31.738701 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:31.747086 I | ceph-mgr: 2017-07-11 13:30:31.738723 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:31.747121 I | ceph-mgr: 2017-07-11 13:30:31.738755 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:33.748385 I | ceph-mgr: 2017-07-11 13:30:33.748019 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:33.748450 I | ceph-mgr: 2017-07-11 13:30:33.748033 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:33.748467 I | ceph-mgr: 2017-07-11 13:30:33.748063 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:35.756684 I | ceph-mgr: 2017-07-11 13:30:35.756339 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:35.756748 I | ceph-mgr: 2017-07-11 13:30:35.756344 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:35.756764 I | ceph-mgr: 2017-07-11 13:30:35.756368 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:37.762824 I | ceph-mgr: 2017-07-11 13:30:37.762773 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:37.762928 I | ceph-mgr: 2017-07-11 13:30:37.762909 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:37.763841 I | ceph-mgr: 2017-07-11 13:30:37.763112 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:39.769484 I | ceph-mgr: 2017-07-11 13:30:39.767460 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:39.769595 I | ceph-mgr: 2017-07-11 13:30:39.767495 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:39.769614 I | ceph-mgr: 2017-07-11 13:30:39.767609 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:41.775103 I | ceph-mgr: 2017-07-11 13:30:41.774651 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:41.775255 I | ceph-mgr: 2017-07-11 13:30:41.774666 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:41.775303 I | ceph-mgr: 2017-07-11 13:30:41.774698 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:43.791418 I | ceph-mgr: 2017-07-11 13:30:43.775455 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:43.791525 I | ceph-mgr: 2017-07-11 13:30:43.775468 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:43.791555 I | ceph-mgr: 2017-07-11 13:30:43.775502 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:45.798626 I | ceph-mgr: 2017-07-11 13:30:45.798586 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:45.798724 I | ceph-mgr: 2017-07-11 13:30:45.798710 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:45.799093 I | ceph-mgr: 2017-07-11 13:30:45.799076 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:47.806389 I | ceph-mgr: 2017-07-11 13:30:47.806321 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:47.806651 I | ceph-mgr: 2017-07-11 13:30:47.806499 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:47.806935 I | ceph-mgr: 2017-07-11 13:30:47.806918 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:49.808613 I | ceph-mgr: 2017-07-11 13:30:49.808577 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:49.808690 I | ceph-mgr: 2017-07-11 13:30:49.808676 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:49.808927 I | ceph-mgr: 2017-07-11 13:30:49.808912 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:51.812625 I | ceph-mgr: 2017-07-11 13:30:51.812593 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:51.812805 I | ceph-mgr: 2017-07-11 13:30:51.812729 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:51.813045 I | ceph-mgr: 2017-07-11 13:30:51.813028 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:53.834394 I | ceph-mgr: 2017-07-11 13:30:53.834349 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:53.834504 I | ceph-mgr: 2017-07-11 13:30:53.834488 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:53.835038 I | ceph-mgr: 2017-07-11 13:30:53.835016 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:55.835720 I | ceph-mgr: 2017-07-11 13:30:55.835601 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:55.835794 I | ceph-mgr: 2017-07-11 13:30:55.835778 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:55.836036 I | ceph-mgr: 2017-07-11 13:30:55.836019 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:57.842246 I | ceph-mgr: 2017-07-11 13:30:57.842200 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:57.842340 I | ceph-mgr: 2017-07-11 13:30:57.842324 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:57.842597 I | ceph-mgr: 2017-07-11 13:30:57.842582 7f4cc3226700 0 mgr tick
- 2017-07-11 13:30:59.844360 I | ceph-mgr: 2017-07-11 13:30:59.843907 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:30:59.844439 I | ceph-mgr: 2017-07-11 13:30:59.843917 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:30:59.844457 I | ceph-mgr: 2017-07-11 13:30:59.843945 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:01.849763 I | ceph-mgr: 2017-07-11 13:31:01.849459 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:01.849980 I | ceph-mgr: 2017-07-11 13:31:01.849464 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:01.850010 I | ceph-mgr: 2017-07-11 13:31:01.849486 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:03.856282 I | ceph-mgr: 2017-07-11 13:31:03.855906 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:03.856341 I | ceph-mgr: 2017-07-11 13:31:03.855919 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:03.856356 I | ceph-mgr: 2017-07-11 13:31:03.855966 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:05.858164 I | ceph-mgr: 2017-07-11 13:31:05.857837 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:05.858222 I | ceph-mgr: 2017-07-11 13:31:05.857842 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:05.858238 I | ceph-mgr: 2017-07-11 13:31:05.857863 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:07.861883 I | ceph-mgr: 2017-07-11 13:31:07.859102 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:07.861941 I | ceph-mgr: 2017-07-11 13:31:07.859120 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:07.861958 I | ceph-mgr: 2017-07-11 13:31:07.859173 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:09.863491 I | ceph-mgr: 2017-07-11 13:31:09.863445 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:09.863652 I | ceph-mgr: 2017-07-11 13:31:09.863549 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:09.863674 I | ceph-mgr: 2017-07-11 13:31:09.863583 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:11.881643 I | ceph-mgr: 2017-07-11 13:31:11.881606 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:11.881723 I | ceph-mgr: 2017-07-11 13:31:11.881709 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:11.881963 I | ceph-mgr: 2017-07-11 13:31:11.881947 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:13.887482 I | ceph-mgr: 2017-07-11 13:31:13.887429 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:13.887583 I | ceph-mgr: 2017-07-11 13:31:13.887569 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:13.887846 I | ceph-mgr: 2017-07-11 13:31:13.887829 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:15.897816 I | ceph-mgr: 2017-07-11 13:31:15.897774 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:15.897892 I | ceph-mgr: 2017-07-11 13:31:15.897877 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:15.898148 I | ceph-mgr: 2017-07-11 13:31:15.898131 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:17.905766 I | ceph-mgr: 2017-07-11 13:31:17.905344 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:17.905967 I | ceph-mgr: 2017-07-11 13:31:17.905351 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:17.905995 I | ceph-mgr: 2017-07-11 13:31:17.905378 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:19.911753 I | ceph-mgr: 2017-07-11 13:31:19.911416 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:19.911810 I | ceph-mgr: 2017-07-11 13:31:19.911424 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:19.911826 I | ceph-mgr: 2017-07-11 13:31:19.911450 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:21.916308 I | ceph-mgr: 2017-07-11 13:31:21.915904 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:21.919239 I | ceph-mgr: 2017-07-11 13:31:21.915909 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:21.919272 I | ceph-mgr: 2017-07-11 13:31:21.915933 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:23.917681 I | ceph-mgr: 2017-07-11 13:31:23.917243 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:23.920550 I | ceph-mgr: 2017-07-11 13:31:23.917263 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:23.920581 I | ceph-mgr: 2017-07-11 13:31:23.917314 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:25.922659 I | ceph-mgr: 2017-07-11 13:31:25.922146 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:25.922723 I | ceph-mgr: 2017-07-11 13:31:25.922165 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:25.922738 I | ceph-mgr: 2017-07-11 13:31:25.922228 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:27.925812 I | ceph-mgr: 2017-07-11 13:31:27.925346 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:27.926036 I | ceph-mgr: 2017-07-11 13:31:27.925360 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:27.926199 I | ceph-mgr: 2017-07-11 13:31:27.925390 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:29.926996 I | ceph-mgr: 2017-07-11 13:31:29.926668 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:29.928414 I | ceph-mgr: 2017-07-11 13:31:29.926677 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:29.928446 I | ceph-mgr: 2017-07-11 13:31:29.926705 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:31.935071 I | ceph-mgr: 2017-07-11 13:31:31.934674 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:31.935282 I | ceph-mgr: 2017-07-11 13:31:31.934680 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:31.935310 I | ceph-mgr: 2017-07-11 13:31:31.934704 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:33.939053 I | ceph-mgr: 2017-07-11 13:31:33.938688 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:33.941149 I | ceph-mgr: 2017-07-11 13:31:33.938702 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:33.941187 I | ceph-mgr: 2017-07-11 13:31:33.938743 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:35.943400 I | ceph-mgr: 2017-07-11 13:31:35.943063 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:35.946290 I | ceph-mgr: 2017-07-11 13:31:35.943066 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:35.946473 I | ceph-mgr: 2017-07-11 13:31:35.943089 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:37.948197 I | ceph-mgr: 2017-07-11 13:31:37.947762 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:37.948214 I | ceph-mgr: 2017-07-11 13:31:37.947774 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:37.948217 I | ceph-mgr: 2017-07-11 13:31:37.947805 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:39.958001 I | ceph-mgr: 2017-07-11 13:31:39.948418 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:39.958067 I | ceph-mgr: 2017-07-11 13:31:39.948428 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:39.958083 I | ceph-mgr: 2017-07-11 13:31:39.948456 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:41.954811 I | ceph-mgr: 2017-07-11 13:31:41.954349 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:41.955018 I | ceph-mgr: 2017-07-11 13:31:41.954355 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:41.955125 I | ceph-mgr: 2017-07-11 13:31:41.954380 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:43.956784 I | ceph-mgr: 2017-07-11 13:31:43.956423 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:43.956802 I | ceph-mgr: 2017-07-11 13:31:43.956436 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:43.956805 I | ceph-mgr: 2017-07-11 13:31:43.956472 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:45.963309 I | ceph-mgr: 2017-07-11 13:31:45.962987 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:45.963383 I | ceph-mgr: 2017-07-11 13:31:45.962992 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:45.963399 I | ceph-mgr: 2017-07-11 13:31:45.963017 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:47.967053 I | ceph-mgr: 2017-07-11 13:31:47.966680 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:47.967124 I | ceph-mgr: 2017-07-11 13:31:47.966693 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:47.967141 I | ceph-mgr: 2017-07-11 13:31:47.966742 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:49.973546 I | ceph-mgr: 2017-07-11 13:31:49.973167 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:49.973604 I | ceph-mgr: 2017-07-11 13:31:49.973204 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:49.973620 I | ceph-mgr: 2017-07-11 13:31:49.973234 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:51.980537 I | ceph-mgr: 2017-07-11 13:31:51.980146 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:51.980593 I | ceph-mgr: 2017-07-11 13:31:51.980158 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:51.980609 I | ceph-mgr: 2017-07-11 13:31:51.980194 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:53.981585 I | ceph-mgr: 2017-07-11 13:31:53.981155 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:53.981644 I | ceph-mgr: 2017-07-11 13:31:53.981168 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:53.981659 I | ceph-mgr: 2017-07-11 13:31:53.981200 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:55.988871 I | ceph-mgr: 2017-07-11 13:31:55.988526 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:55.988926 I | ceph-mgr: 2017-07-11 13:31:55.988532 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:55.988942 I | ceph-mgr: 2017-07-11 13:31:55.988554 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:57.990966 I | ceph-mgr: 2017-07-11 13:31:57.990615 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:57.992619 I | ceph-mgr: 2017-07-11 13:31:57.990637 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:57.992645 I | ceph-mgr: 2017-07-11 13:31:57.990667 7f4cc3226700 0 mgr tick
- 2017-07-11 13:31:59.992410 I | ceph-mgr: 2017-07-11 13:31:59.991696 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:31:59.992475 I | ceph-mgr: 2017-07-11 13:31:59.991709 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:31:59.992491 I | ceph-mgr: 2017-07-11 13:31:59.991740 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:01.993671 I | ceph-mgr: 2017-07-11 13:32:01.993319 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:01.993726 I | ceph-mgr: 2017-07-11 13:32:01.993325 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:01.993741 I | ceph-mgr: 2017-07-11 13:32:01.993350 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:04.000411 I | ceph-mgr: 2017-07-11 13:32:03.999964 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:04.003677 I | ceph-mgr: 2017-07-11 13:32:03.999977 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:04.003712 I | ceph-mgr: 2017-07-11 13:32:04.000008 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:06.007506 I | ceph-mgr: 2017-07-11 13:32:06.005085 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:06.007999 I | ceph-mgr: 2017-07-11 13:32:06.005090 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:06.008035 I | ceph-mgr: 2017-07-11 13:32:06.005115 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:08.011739 I | ceph-mgr: 2017-07-11 13:32:08.011364 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:08.011963 I | ceph-mgr: 2017-07-11 13:32:08.011377 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:08.011992 I | ceph-mgr: 2017-07-11 13:32:08.011410 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:10.018681 I | ceph-mgr: 2017-07-11 13:32:10.018301 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:10.018734 I | ceph-mgr: 2017-07-11 13:32:10.018314 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:10.018750 I | ceph-mgr: 2017-07-11 13:32:10.018349 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:12.024032 I | ceph-mgr: 2017-07-11 13:32:12.023532 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:12.024105 I | ceph-mgr: 2017-07-11 13:32:12.023541 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:12.024122 I | ceph-mgr: 2017-07-11 13:32:12.023580 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:14.030635 I | ceph-mgr: 2017-07-11 13:32:14.030587 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:14.030723 I | ceph-mgr: 2017-07-11 13:32:14.030708 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:14.030964 I | ceph-mgr: 2017-07-11 13:32:14.030795 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:16.040138 I | ceph-mgr: 2017-07-11 13:32:16.040074 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:16.040352 I | ceph-mgr: 2017-07-11 13:32:16.040237 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:16.040589 I | ceph-mgr: 2017-07-11 13:32:16.040574 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:18.042635 I | ceph-mgr: 2017-07-11 13:32:18.042570 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:18.042714 I | ceph-mgr: 2017-07-11 13:32:18.042696 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:18.042960 I | ceph-mgr: 2017-07-11 13:32:18.042927 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:20.050865 I | ceph-mgr: 2017-07-11 13:32:20.050820 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:20.050947 I | ceph-mgr: 2017-07-11 13:32:20.050933 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:20.051190 I | ceph-mgr: 2017-07-11 13:32:20.051175 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:22.059577 I | ceph-mgr: 2017-07-11 13:32:22.059508 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:22.059842 I | ceph-mgr: 2017-07-11 13:32:22.059692 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:22.060075 I | ceph-mgr: 2017-07-11 13:32:22.060059 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:24.060697 I | ceph-mgr: 2017-07-11 13:32:24.060649 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:24.060800 I | ceph-mgr: 2017-07-11 13:32:24.060781 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:24.067233 I | ceph-mgr: 2017-07-11 13:32:24.067180 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:26.067933 I | ceph-mgr: 2017-07-11 13:32:26.067895 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:26.068029 I | ceph-mgr: 2017-07-11 13:32:26.068013 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:26.068275 I | ceph-mgr: 2017-07-11 13:32:26.068259 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:28.086967 I | ceph-mgr: 2017-07-11 13:32:28.086919 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:28.087035 I | ceph-mgr: 2017-07-11 13:32:28.087021 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:28.087277 I | ceph-mgr: 2017-07-11 13:32:28.087261 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:30.099213 I | ceph-mgr: 2017-07-11 13:32:30.099171 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:30.099293 I | ceph-mgr: 2017-07-11 13:32:30.099279 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:30.099557 I | ceph-mgr: 2017-07-11 13:32:30.099540 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:32.107212 I | ceph-mgr: 2017-07-11 13:32:32.107170 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:32.107313 I | ceph-mgr: 2017-07-11 13:32:32.107297 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:32.107609 I | ceph-mgr: 2017-07-11 13:32:32.107594 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:34.108391 I | ceph-mgr: 2017-07-11 13:32:34.108276 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:34.108472 I | ceph-mgr: 2017-07-11 13:32:34.108457 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:34.108706 I | ceph-mgr: 2017-07-11 13:32:34.108689 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:36.115207 I | ceph-mgr: 2017-07-11 13:32:36.115176 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:36.115286 I | ceph-mgr: 2017-07-11 13:32:36.115272 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:36.115508 I | ceph-mgr: 2017-07-11 13:32:36.115392 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:38.116792 I | ceph-mgr: 2017-07-11 13:32:38.116747 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:38.116874 I | ceph-mgr: 2017-07-11 13:32:38.116859 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:38.132813 I | ceph-mgr: 2017-07-11 13:32:38.132794 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:40.139480 I | ceph-mgr: 2017-07-11 13:32:40.139409 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:40.139580 I | ceph-mgr: 2017-07-11 13:32:40.139564 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:40.139882 I | ceph-mgr: 2017-07-11 13:32:40.139859 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:42.142903 I | ceph-mgr: 2017-07-11 13:32:42.142855 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:42.142995 I | ceph-mgr: 2017-07-11 13:32:42.142980 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:42.143512 I | ceph-mgr: 2017-07-11 13:32:42.143494 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:44.144644 I | ceph-mgr: 2017-07-11 13:32:44.144612 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:44.144736 I | ceph-mgr: 2017-07-11 13:32:44.144722 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:44.144968 I | ceph-mgr: 2017-07-11 13:32:44.144952 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:46.147494 I | ceph-mgr: 2017-07-11 13:32:46.147461 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:46.147568 I | ceph-mgr: 2017-07-11 13:32:46.147554 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:46.147739 I | ceph-mgr: 2017-07-11 13:32:46.147672 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:48.151517 I | ceph-mgr: 2017-07-11 13:32:48.151473 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:48.151592 I | ceph-mgr: 2017-07-11 13:32:48.151578 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:48.151834 I | ceph-mgr: 2017-07-11 13:32:48.151818 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:50.164301 I | ceph-mgr: 2017-07-11 13:32:50.164250 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:50.164386 I | ceph-mgr: 2017-07-11 13:32:50.164371 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:50.164853 I | ceph-mgr: 2017-07-11 13:32:50.164837 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:52.165730 I | ceph-mgr: 2017-07-11 13:32:52.165685 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:52.165827 I | ceph-mgr: 2017-07-11 13:32:52.165812 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:52.166088 I | ceph-mgr: 2017-07-11 13:32:52.166069 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:54.172016 I | ceph-mgr: 2017-07-11 13:32:54.171979 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:54.172094 I | ceph-mgr: 2017-07-11 13:32:54.172080 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:54.172326 I | ceph-mgr: 2017-07-11 13:32:54.172311 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:56.180855 I | ceph-mgr: 2017-07-11 13:32:56.180808 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:56.180941 I | ceph-mgr: 2017-07-11 13:32:56.180927 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:56.181170 I | ceph-mgr: 2017-07-11 13:32:56.181154 7f4cc3226700 0 mgr tick
- 2017-07-11 13:32:58.187362 I | ceph-mgr: 2017-07-11 13:32:58.187325 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:32:58.187429 I | ceph-mgr: 2017-07-11 13:32:58.187415 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:32:58.187664 I | ceph-mgr: 2017-07-11 13:32:58.187649 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:00.198152 I | ceph-mgr: 2017-07-11 13:33:00.198105 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:00.198230 I | ceph-mgr: 2017-07-11 13:33:00.198214 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:00.198519 I | ceph-mgr: 2017-07-11 13:33:00.198501 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:02.202591 I | ceph-mgr: 2017-07-11 13:33:02.202503 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:02.202681 I | ceph-mgr: 2017-07-11 13:33:02.202666 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:02.202922 I | ceph-mgr: 2017-07-11 13:33:02.202906 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:04.206870 I | ceph-mgr: 2017-07-11 13:33:04.206802 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:04.207134 I | ceph-mgr: 2017-07-11 13:33:04.207118 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:04.207378 I | ceph-mgr: 2017-07-11 13:33:04.207363 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:06.229103 I | ceph-mgr: 2017-07-11 13:33:06.228078 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:06.229176 I | ceph-mgr: 2017-07-11 13:33:06.228086 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:06.229193 I | ceph-mgr: 2017-07-11 13:33:06.228110 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:08.233793 I | ceph-mgr: 2017-07-11 13:33:08.233351 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:08.234010 I | ceph-mgr: 2017-07-11 13:33:08.233369 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:08.234051 I | ceph-mgr: 2017-07-11 13:33:08.233417 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:10.238023 I | ceph-mgr: 2017-07-11 13:33:10.237657 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:10.238749 I | ceph-mgr: 2017-07-11 13:33:10.237673 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:10.238787 I | ceph-mgr: 2017-07-11 13:33:10.237719 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:12.239177 I | ceph-mgr: 2017-07-11 13:33:12.238760 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:12.239252 I | ceph-mgr: 2017-07-11 13:33:12.238775 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:12.239270 I | ceph-mgr: 2017-07-11 13:33:12.238809 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:14.244676 I | ceph-mgr: 2017-07-11 13:33:14.244644 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:14.244746 I | ceph-mgr: 2017-07-11 13:33:14.244731 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:14.244968 I | ceph-mgr: 2017-07-11 13:33:14.244809 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:16.247933 I | ceph-mgr: 2017-07-11 13:33:16.247901 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:16.248009 I | ceph-mgr: 2017-07-11 13:33:16.247995 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:16.248246 I | ceph-mgr: 2017-07-11 13:33:16.248230 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:18.250209 I | ceph-mgr: 2017-07-11 13:33:18.250165 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:18.250281 I | ceph-mgr: 2017-07-11 13:33:18.250267 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:18.250532 I | ceph-mgr: 2017-07-11 13:33:18.250516 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:20.255280 I | ceph-mgr: 2017-07-11 13:33:20.255231 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:20.255359 I | ceph-mgr: 2017-07-11 13:33:20.255345 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:20.255604 I | ceph-mgr: 2017-07-11 13:33:20.255588 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:22.259572 I | ceph-mgr: 2017-07-11 13:33:22.259526 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:22.259675 I | ceph-mgr: 2017-07-11 13:33:22.259643 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:22.259918 I | ceph-mgr: 2017-07-11 13:33:22.259901 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:24.264191 I | ceph-mgr: 2017-07-11 13:33:24.263873 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:24.264248 I | ceph-mgr: 2017-07-11 13:33:24.263878 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:24.264263 I | ceph-mgr: 2017-07-11 13:33:24.263900 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:26.265398 I | ceph-mgr: 2017-07-11 13:33:26.265031 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:26.265454 I | ceph-mgr: 2017-07-11 13:33:26.265040 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:26.265469 I | ceph-mgr: 2017-07-11 13:33:26.265078 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:28.271877 I | ceph-mgr: 2017-07-11 13:33:28.271426 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:28.272057 I | ceph-mgr: 2017-07-11 13:33:28.271439 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:28.272097 I | ceph-mgr: 2017-07-11 13:33:28.271488 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:30.273607 I | ceph-mgr: 2017-07-11 13:33:30.273185 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:30.273678 I | ceph-mgr: 2017-07-11 13:33:30.273194 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:30.273694 I | ceph-mgr: 2017-07-11 13:33:30.273220 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:32.279993 I | ceph-mgr: 2017-07-11 13:33:32.279536 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:32.280198 I | ceph-mgr: 2017-07-11 13:33:32.279549 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:32.280230 I | ceph-mgr: 2017-07-11 13:33:32.279586 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:34.283162 I | ceph-mgr: 2017-07-11 13:33:34.282834 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:34.283223 I | ceph-mgr: 2017-07-11 13:33:34.282842 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:34.283243 I | ceph-mgr: 2017-07-11 13:33:34.282865 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:36.291187 I | ceph-mgr: 2017-07-11 13:33:36.290852 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:36.291242 I | ceph-mgr: 2017-07-11 13:33:36.290859 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:36.291258 I | ceph-mgr: 2017-07-11 13:33:36.290882 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:38.291963 I | ceph-mgr: 2017-07-11 13:33:38.291918 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:38.292194 I | ceph-mgr: 2017-07-11 13:33:38.292177 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:38.292442 I | ceph-mgr: 2017-07-11 13:33:38.292411 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:40.295955 I | ceph-mgr: 2017-07-11 13:33:40.295903 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:40.296049 I | ceph-mgr: 2017-07-11 13:33:40.296034 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:40.296379 I | ceph-mgr: 2017-07-11 13:33:40.296363 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:42.304793 I | ceph-mgr: 2017-07-11 13:33:42.304743 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:42.304884 I | ceph-mgr: 2017-07-11 13:33:42.304869 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:42.305371 I | ceph-mgr: 2017-07-11 13:33:42.305352 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:44.312524 I | ceph-mgr: 2017-07-11 13:33:44.312488 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:44.318376 I | ceph-mgr: 2017-07-11 13:33:44.318356 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:44.318496 I | ceph-mgr: 2017-07-11 13:33:44.318477 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:46.324552 I | ceph-mgr: 2017-07-11 13:33:46.324513 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:46.324631 I | ceph-mgr: 2017-07-11 13:33:46.324616 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:46.324865 I | ceph-mgr: 2017-07-11 13:33:46.324849 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:48.328548 I | ceph-mgr: 2017-07-11 13:33:48.328501 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:48.328626 I | ceph-mgr: 2017-07-11 13:33:48.328611 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:48.328869 I | ceph-mgr: 2017-07-11 13:33:48.328853 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:50.329986 I | ceph-mgr: 2017-07-11 13:33:50.329916 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:50.330167 I | ceph-mgr: 2017-07-11 13:33:50.330103 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:50.340091 I | ceph-mgr: 2017-07-11 13:33:50.340052 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:52.341944 I | ceph-mgr: 2017-07-11 13:33:52.341899 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:52.342027 I | ceph-mgr: 2017-07-11 13:33:52.342009 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:52.342281 I | ceph-mgr: 2017-07-11 13:33:52.342265 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:54.344126 I | ceph-mgr: 2017-07-11 13:33:54.344092 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:54.344204 I | ceph-mgr: 2017-07-11 13:33:54.344189 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:54.344432 I | ceph-mgr: 2017-07-11 13:33:54.344416 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:56.354571 I | ceph-mgr: 2017-07-11 13:33:56.354115 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:56.355222 I | ceph-mgr: 2017-07-11 13:33:56.354121 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:56.355258 I | ceph-mgr: 2017-07-11 13:33:56.354143 7f4cc3226700 0 mgr tick
- 2017-07-11 13:33:58.362055 I | ceph-mgr: 2017-07-11 13:33:58.361662 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:33:58.362120 I | ceph-mgr: 2017-07-11 13:33:58.361681 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:33:58.362136 I | ceph-mgr: 2017-07-11 13:33:58.361732 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:00.362570 I | ceph-mgr: 2017-07-11 13:34:00.362234 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:00.370831 I | ceph-mgr: 2017-07-11 13:34:00.362239 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:00.371127 I | ceph-mgr: 2017-07-11 13:34:00.362261 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:02.372418 I | ceph-mgr: 2017-07-11 13:34:02.371965 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:02.372635 I | ceph-mgr: 2017-07-11 13:34:02.371977 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:02.372735 I | ceph-mgr: 2017-07-11 13:34:02.372011 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:04.376795 I | ceph-mgr: 2017-07-11 13:34:04.376378 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:04.376998 I | ceph-mgr: 2017-07-11 13:34:04.376384 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:04.377098 I | ceph-mgr: 2017-07-11 13:34:04.376407 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:06.385494 I | ceph-mgr: 2017-07-11 13:34:06.385013 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:06.385728 I | ceph-mgr: 2017-07-11 13:34:06.385026 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:06.385757 I | ceph-mgr: 2017-07-11 13:34:06.385057 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:08.392069 I | ceph-mgr: 2017-07-11 13:34:08.391603 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:08.392219 I | ceph-mgr: 2017-07-11 13:34:08.391624 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:08.392272 I | ceph-mgr: 2017-07-11 13:34:08.391689 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:10.392792 I | ceph-mgr: 2017-07-11 13:34:10.392409 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:10.392871 I | ceph-mgr: 2017-07-11 13:34:10.392423 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:10.392889 I | ceph-mgr: 2017-07-11 13:34:10.392464 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:12.400312 I | ceph-mgr: 2017-07-11 13:34:12.400152 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:12.400482 I | ceph-mgr: 2017-07-11 13:34:12.400165 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:12.400518 I | ceph-mgr: 2017-07-11 13:34:12.400199 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:14.403654 I | ceph-mgr: 2017-07-11 13:34:14.403179 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:14.403865 I | ceph-mgr: 2017-07-11 13:34:14.403190 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:14.403895 I | ceph-mgr: 2017-07-11 13:34:14.403220 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:16.409982 I | ceph-mgr: 2017-07-11 13:34:16.409539 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:16.410163 I | ceph-mgr: 2017-07-11 13:34:16.409553 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:16.410292 I | ceph-mgr: 2017-07-11 13:34:16.409586 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:18.417896 I | ceph-mgr: 2017-07-11 13:34:18.417466 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:18.418109 I | ceph-mgr: 2017-07-11 13:34:18.417480 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:18.418136 I | ceph-mgr: 2017-07-11 13:34:18.417510 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:20.418231 I | ceph-mgr: 2017-07-11 13:34:20.417864 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:20.418290 I | ceph-mgr: 2017-07-11 13:34:20.417878 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:20.418306 I | ceph-mgr: 2017-07-11 13:34:20.417914 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:22.421464 I | ceph-mgr: 2017-07-11 13:34:22.420721 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:22.421689 I | ceph-mgr: 2017-07-11 13:34:22.420727 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:22.421793 I | ceph-mgr: 2017-07-11 13:34:22.420752 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:24.423469 I | ceph-mgr: 2017-07-11 13:34:24.423004 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:24.424038 I | ceph-mgr: 2017-07-11 13:34:24.423021 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:24.424085 I | ceph-mgr: 2017-07-11 13:34:24.423055 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:26.426203 I | ceph-mgr: 2017-07-11 13:34:26.425707 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:26.426453 I | ceph-mgr: 2017-07-11 13:34:26.425721 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:26.426599 I | ceph-mgr: 2017-07-11 13:34:26.425757 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:28.443187 I | ceph-mgr: 2017-07-11 13:34:28.427015 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:28.443422 I | ceph-mgr: 2017-07-11 13:34:28.427028 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:28.443523 I | ceph-mgr: 2017-07-11 13:34:28.427061 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:30.445392 I | ceph-mgr: 2017-07-11 13:34:30.445335 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:30.445471 I | ceph-mgr: 2017-07-11 13:34:30.445455 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:30.445727 I | ceph-mgr: 2017-07-11 13:34:30.445711 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:32.446526 I | ceph-mgr: 2017-07-11 13:34:32.446484 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:32.446694 I | ceph-mgr: 2017-07-11 13:34:32.446677 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:32.447012 I | ceph-mgr: 2017-07-11 13:34:32.446996 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:34.457713 I | ceph-mgr: 2017-07-11 13:34:34.456938 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:34.458167 I | ceph-mgr: 2017-07-11 13:34:34.456943 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:34.458209 I | ceph-mgr: 2017-07-11 13:34:34.456967 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:36.464807 I | ceph-mgr: 2017-07-11 13:34:36.464410 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:36.465225 I | ceph-mgr: 2017-07-11 13:34:36.464413 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:36.465362 I | ceph-mgr: 2017-07-11 13:34:36.464433 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:38.473566 I | ceph-mgr: 2017-07-11 13:34:38.472564 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:38.473774 I | ceph-mgr: 2017-07-11 13:34:38.472585 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:38.473803 I | ceph-mgr: 2017-07-11 13:34:38.472637 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:40.476102 I | ceph-mgr: 2017-07-11 13:34:40.475296 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:40.476183 I | ceph-mgr: 2017-07-11 13:34:40.475310 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:40.476200 I | ceph-mgr: 2017-07-11 13:34:40.475342 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:42.479875 I | ceph-mgr: 2017-07-11 13:34:42.478239 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:42.480572 I | ceph-mgr: 2017-07-11 13:34:42.478264 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:42.480609 I | ceph-mgr: 2017-07-11 13:34:42.478312 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:44.481841 I | ceph-mgr: 2017-07-11 13:34:44.481793 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:44.481915 I | ceph-mgr: 2017-07-11 13:34:44.481901 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:44.482160 I | ceph-mgr: 2017-07-11 13:34:44.482130 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:46.500127 I | ceph-mgr: 2017-07-11 13:34:46.500080 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:46.500203 I | ceph-mgr: 2017-07-11 13:34:46.500189 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:46.500423 I | ceph-mgr: 2017-07-11 13:34:46.500408 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:48.509843 I | ceph-mgr: 2017-07-11 13:34:48.509797 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:48.509920 I | ceph-mgr: 2017-07-11 13:34:48.509904 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:48.510182 I | ceph-mgr: 2017-07-11 13:34:48.510163 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:50.534790 I | ceph-mgr: 2017-07-11 13:34:50.534741 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:50.534867 I | ceph-mgr: 2017-07-11 13:34:50.534853 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:50.535993 I | ceph-mgr: 2017-07-11 13:34:50.535976 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:52.546150 I | ceph-mgr: 2017-07-11 13:34:52.546090 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:52.546243 I | ceph-mgr: 2017-07-11 13:34:52.546229 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:52.546695 I | ceph-mgr: 2017-07-11 13:34:52.546679 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:54.570485 I | ceph-mgr: 2017-07-11 13:34:54.570443 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:54.570576 I | ceph-mgr: 2017-07-11 13:34:54.570560 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:54.570809 I | ceph-mgr: 2017-07-11 13:34:54.570782 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:56.574335 I | ceph-mgr: 2017-07-11 13:34:56.574297 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:56.574417 I | ceph-mgr: 2017-07-11 13:34:56.574403 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:56.574659 I | ceph-mgr: 2017-07-11 13:34:56.574643 7f4cc3226700 0 mgr tick
- 2017-07-11 13:34:58.578352 I | ceph-mgr: 2017-07-11 13:34:58.578301 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:34:58.578438 I | ceph-mgr: 2017-07-11 13:34:58.578422 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:34:58.578702 I | ceph-mgr: 2017-07-11 13:34:58.578686 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:00.597042 I | ceph-mgr: 2017-07-11 13:35:00.596979 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:00.597129 I | ceph-mgr: 2017-07-11 13:35:00.597111 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:00.616816 I | ceph-mgr: 2017-07-11 13:35:00.616794 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:02.624432 I | ceph-mgr: 2017-07-11 13:35:02.624389 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:02.624503 I | ceph-mgr: 2017-07-11 13:35:02.624488 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:02.624590 I | ceph-mgr: 2017-07-11 13:35:02.624580 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:04.650195 I | ceph-mgr: 2017-07-11 13:35:04.650151 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:04.650266 I | ceph-mgr: 2017-07-11 13:35:04.650252 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:04.650700 I | ceph-mgr: 2017-07-11 13:35:04.650682 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:06.657131 I | ceph-mgr: 2017-07-11 13:35:06.657089 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:06.657213 I | ceph-mgr: 2017-07-11 13:35:06.657198 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:06.657441 I | ceph-mgr: 2017-07-11 13:35:06.657425 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:08.665125 I | ceph-mgr: 2017-07-11 13:35:08.665043 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:08.665337 I | ceph-mgr: 2017-07-11 13:35:08.665235 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:08.665568 I | ceph-mgr: 2017-07-11 13:35:08.665541 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:10.669379 I | ceph-mgr: 2017-07-11 13:35:10.669329 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:10.669494 I | ceph-mgr: 2017-07-11 13:35:10.669479 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:10.669903 I | ceph-mgr: 2017-07-11 13:35:10.669886 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:12.680688 I | ceph-mgr: 2017-07-11 13:35:12.679104 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:12.680772 I | ceph-mgr: 2017-07-11 13:35:12.679112 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:12.680789 I | ceph-mgr: 2017-07-11 13:35:12.679138 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:14.685437 I | ceph-mgr: 2017-07-11 13:35:14.685393 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:14.685520 I | ceph-mgr: 2017-07-11 13:35:14.685505 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:14.685775 I | ceph-mgr: 2017-07-11 13:35:14.685759 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:16.695259 I | ceph-mgr: 2017-07-11 13:35:16.695223 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:16.695440 I | ceph-mgr: 2017-07-11 13:35:16.695424 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:16.697372 I | ceph-mgr: 2017-07-11 13:35:16.697356 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:18.704046 I | ceph-mgr: 2017-07-11 13:35:18.703999 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:18.704135 I | ceph-mgr: 2017-07-11 13:35:18.704119 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:18.704416 I | ceph-mgr: 2017-07-11 13:35:18.704384 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:20.717629 I | ceph-mgr: 2017-07-11 13:35:20.717555 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:20.717737 I | ceph-mgr: 2017-07-11 13:35:20.717723 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:20.717983 I | ceph-mgr: 2017-07-11 13:35:20.717967 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:22.737073 I | ceph-mgr: 2017-07-11 13:35:22.720862 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:22.737137 I | ceph-mgr: 2017-07-11 13:35:22.720867 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:22.737154 I | ceph-mgr: 2017-07-11 13:35:22.720891 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:24.739586 I | ceph-mgr: 2017-07-11 13:35:24.739540 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:24.739687 I | ceph-mgr: 2017-07-11 13:35:24.739671 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:24.739940 I | ceph-mgr: 2017-07-11 13:35:24.739923 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:26.757194 I | ceph-mgr: 2017-07-11 13:35:26.757131 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:26.757448 I | ceph-mgr: 2017-07-11 13:35:26.757416 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:26.758937 I | ceph-mgr: 2017-07-11 13:35:26.758918 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:28.761164 I | ceph-mgr: 2017-07-11 13:35:28.761117 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:28.761262 I | ceph-mgr: 2017-07-11 13:35:28.761247 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:28.761533 I | ceph-mgr: 2017-07-11 13:35:28.761517 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:30.780438 I | ceph-mgr: 2017-07-11 13:35:30.780397 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:30.780508 I | ceph-mgr: 2017-07-11 13:35:30.780494 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:30.780769 I | ceph-mgr: 2017-07-11 13:35:30.780752 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:32.797794 I | ceph-mgr: 2017-07-11 13:35:32.796399 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:32.797861 I | ceph-mgr: 2017-07-11 13:35:32.796405 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:32.797879 I | ceph-mgr: 2017-07-11 13:35:32.796431 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:34.798379 I | ceph-mgr: 2017-07-11 13:35:34.798333 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:34.798559 I | ceph-mgr: 2017-07-11 13:35:34.798543 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:34.800408 I | ceph-mgr: 2017-07-11 13:35:34.800376 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:36.804131 I | ceph-mgr: 2017-07-11 13:35:36.804101 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:36.804200 I | ceph-mgr: 2017-07-11 13:35:36.804185 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:36.804432 I | ceph-mgr: 2017-07-11 13:35:36.804415 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:38.815045 I | ceph-mgr: 2017-07-11 13:35:38.813195 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:38.815569 I | ceph-mgr: 2017-07-11 13:35:38.813206 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:38.815614 I | ceph-mgr: 2017-07-11 13:35:38.813235 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:40.823269 I | ceph-mgr: 2017-07-11 13:35:40.821793 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:40.823342 I | ceph-mgr: 2017-07-11 13:35:40.821812 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:40.823358 I | ceph-mgr: 2017-07-11 13:35:40.821874 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:42.825418 I | ceph-mgr: 2017-07-11 13:35:42.825334 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:42.825616 I | ceph-mgr: 2017-07-11 13:35:42.825528 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:42.825848 I | ceph-mgr: 2017-07-11 13:35:42.825833 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:44.829761 I | ceph-mgr: 2017-07-11 13:35:44.829716 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:44.829858 I | ceph-mgr: 2017-07-11 13:35:44.829826 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:44.830204 I | ceph-mgr: 2017-07-11 13:35:44.830183 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:46.849774 I | ceph-mgr: 2017-07-11 13:35:46.849741 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:46.849853 I | ceph-mgr: 2017-07-11 13:35:46.849839 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:46.850039 I | ceph-mgr: 2017-07-11 13:35:46.850024 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:48.868886 I | ceph-mgr: 2017-07-11 13:35:48.868852 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:48.868967 I | ceph-mgr: 2017-07-11 13:35:48.868952 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:48.869208 I | ceph-mgr: 2017-07-11 13:35:48.869192 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:50.890047 I | ceph-mgr: 2017-07-11 13:35:50.890009 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:50.890130 I | ceph-mgr: 2017-07-11 13:35:50.890116 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:50.890361 I | ceph-mgr: 2017-07-11 13:35:50.890345 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:52.896105 I | ceph-mgr: 2017-07-11 13:35:52.896070 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:52.896195 I | ceph-mgr: 2017-07-11 13:35:52.896180 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:52.896413 I | ceph-mgr: 2017-07-11 13:35:52.896295 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:54.902427 I | ceph-mgr: 2017-07-11 13:35:54.900963 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:54.902639 I | ceph-mgr: 2017-07-11 13:35:54.900977 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:54.902755 I | ceph-mgr: 2017-07-11 13:35:54.901009 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:56.923754 I | ceph-mgr: 2017-07-11 13:35:56.906861 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:56.924160 I | ceph-mgr: 2017-07-11 13:35:56.906866 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:56.924191 I | ceph-mgr: 2017-07-11 13:35:56.906890 7f4cc3226700 0 mgr tick
- 2017-07-11 13:35:58.927414 I | ceph-mgr: 2017-07-11 13:35:58.927303 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:35:58.927513 I | ceph-mgr: 2017-07-11 13:35:58.927498 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:35:58.927857 I | ceph-mgr: 2017-07-11 13:35:58.927829 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:00.930023 I | ceph-mgr: 2017-07-11 13:36:00.929980 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:00.930107 I | ceph-mgr: 2017-07-11 13:36:00.930093 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:00.937543 I | ceph-mgr: 2017-07-11 13:36:00.937523 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:02.942021 I | ceph-mgr: 2017-07-11 13:36:02.940760 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:02.942074 I | ceph-mgr: 2017-07-11 13:36:02.940765 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:02.942089 I | ceph-mgr: 2017-07-11 13:36:02.940795 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:04.950148 I | ceph-mgr: 2017-07-11 13:36:04.949997 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:04.950247 I | ceph-mgr: 2017-07-11 13:36:04.950231 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:04.950765 I | ceph-mgr: 2017-07-11 13:36:04.950747 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:06.958614 I | ceph-mgr: 2017-07-11 13:36:06.958580 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:06.958691 I | ceph-mgr: 2017-07-11 13:36:06.958675 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:06.958933 I | ceph-mgr: 2017-07-11 13:36:06.958906 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:08.960787 I | ceph-mgr: 2017-07-11 13:36:08.960733 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:08.960872 I | ceph-mgr: 2017-07-11 13:36:08.960857 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:08.961136 I | ceph-mgr: 2017-07-11 13:36:08.961121 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:10.963704 I | ceph-mgr: 2017-07-11 13:36:10.963669 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:10.963790 I | ceph-mgr: 2017-07-11 13:36:10.963763 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:10.964027 I | ceph-mgr: 2017-07-11 13:36:10.964010 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:12.971723 I | ceph-mgr: 2017-07-11 13:36:12.971679 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:12.971807 I | ceph-mgr: 2017-07-11 13:36:12.971793 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:12.972050 I | ceph-mgr: 2017-07-11 13:36:12.972034 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:14.984661 I | ceph-mgr: 2017-07-11 13:36:14.984590 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:14.987900 I | ceph-mgr: 2017-07-11 13:36:14.987875 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:14.988379 I | ceph-mgr: 2017-07-11 13:36:14.988362 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:16.993085 I | ceph-mgr: 2017-07-11 13:36:16.993052 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:16.993254 I | ceph-mgr: 2017-07-11 13:36:16.993236 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:16.993500 I | ceph-mgr: 2017-07-11 13:36:16.993484 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:19.027737 I | ceph-mgr: 2017-07-11 13:36:19.027695 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:19.027811 I | ceph-mgr: 2017-07-11 13:36:19.027796 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:19.028058 I | ceph-mgr: 2017-07-11 13:36:19.028042 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:21.045725 I | ceph-mgr: 2017-07-11 13:36:21.045685 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:21.045800 I | ceph-mgr: 2017-07-11 13:36:21.045786 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:21.046042 I | ceph-mgr: 2017-07-11 13:36:21.046026 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:23.057771 I | ceph-mgr: 2017-07-11 13:36:23.057730 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:23.057851 I | ceph-mgr: 2017-07-11 13:36:23.057837 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:23.058088 I | ceph-mgr: 2017-07-11 13:36:23.058073 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:25.072919 I | ceph-mgr: 2017-07-11 13:36:25.071572 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:25.073092 I | ceph-mgr: 2017-07-11 13:36:25.071587 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:25.073225 I | ceph-mgr: 2017-07-11 13:36:25.071620 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:27.093786 I | ceph-mgr: 2017-07-11 13:36:27.083821 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:27.109335 I | ceph-mgr: 2017-07-11 13:36:27.083829 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:27.109385 I | ceph-mgr: 2017-07-11 13:36:27.083855 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:29.117808 I | ceph-mgr: 2017-07-11 13:36:29.117746 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:29.117890 I | ceph-mgr: 2017-07-11 13:36:29.117876 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:29.118159 I | ceph-mgr: 2017-07-11 13:36:29.118143 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:31.120679 I | ceph-mgr: 2017-07-11 13:36:31.120624 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:31.121212 I | ceph-mgr: 2017-07-11 13:36:31.120768 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:31.121603 I | ceph-mgr: 2017-07-11 13:36:31.121586 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:33.141844 I | ceph-mgr: 2017-07-11 13:36:33.141804 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:33.141930 I | ceph-mgr: 2017-07-11 13:36:33.141915 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:33.142298 I | ceph-mgr: 2017-07-11 13:36:33.142279 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:35.148316 I | ceph-mgr: 2017-07-11 13:36:35.148261 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:35.148409 I | ceph-mgr: 2017-07-11 13:36:35.148393 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:35.148890 I | ceph-mgr: 2017-07-11 13:36:35.148872 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:37.168303 I | ceph-mgr: 2017-07-11 13:36:37.168247 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:37.168384 I | ceph-mgr: 2017-07-11 13:36:37.168370 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:37.168635 I | ceph-mgr: 2017-07-11 13:36:37.168619 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:39.177657 I | ceph-mgr: 2017-07-11 13:36:39.176249 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:39.177872 I | ceph-mgr: 2017-07-11 13:36:39.176262 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:39.177968 I | ceph-mgr: 2017-07-11 13:36:39.176295 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:41.178518 I | ceph-mgr: 2017-07-11 13:36:41.178481 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:41.178595 I | ceph-mgr: 2017-07-11 13:36:41.178581 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:41.180633 I | ceph-mgr: 2017-07-11 13:36:41.178810 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:43.182611 I | ceph-mgr: 2017-07-11 13:36:43.182533 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:43.182906 I | ceph-mgr: 2017-07-11 13:36:43.182740 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:43.183070 I | ceph-mgr: 2017-07-11 13:36:43.183055 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:45.191837 I | ceph-mgr: 2017-07-11 13:36:45.191786 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:45.191926 I | ceph-mgr: 2017-07-11 13:36:45.191894 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:45.192167 I | ceph-mgr: 2017-07-11 13:36:45.192151 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:47.215810 I | ceph-mgr: 2017-07-11 13:36:47.215772 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:47.215892 I | ceph-mgr: 2017-07-11 13:36:47.215877 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:47.216118 I | ceph-mgr: 2017-07-11 13:36:47.216102 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:49.221304 I | ceph-mgr: 2017-07-11 13:36:49.221271 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:49.221390 I | ceph-mgr: 2017-07-11 13:36:49.221376 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:49.221621 I | ceph-mgr: 2017-07-11 13:36:49.221606 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:51.223388 I | ceph-mgr: 2017-07-11 13:36:51.223348 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:51.223461 I | ceph-mgr: 2017-07-11 13:36:51.223446 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:51.223709 I | ceph-mgr: 2017-07-11 13:36:51.223693 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:53.233254 I | ceph-mgr: 2017-07-11 13:36:53.233213 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:53.233330 I | ceph-mgr: 2017-07-11 13:36:53.233315 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:53.234867 I | ceph-mgr: 2017-07-11 13:36:53.234850 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:55.237390 I | ceph-mgr: 2017-07-11 13:36:55.237338 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:55.237490 I | ceph-mgr: 2017-07-11 13:36:55.237473 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:55.238088 I | ceph-mgr: 2017-07-11 13:36:55.238071 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:57.261388 I | ceph-mgr: 2017-07-11 13:36:57.261338 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:57.261483 I | ceph-mgr: 2017-07-11 13:36:57.261468 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:57.261834 I | ceph-mgr: 2017-07-11 13:36:57.261818 7f4cc3226700 0 mgr tick
- 2017-07-11 13:36:59.265223 I | ceph-mgr: 2017-07-11 13:36:59.265187 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:36:59.267560 I | ceph-mgr: 2017-07-11 13:36:59.267542 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:36:59.267714 I | ceph-mgr: 2017-07-11 13:36:59.267699 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:01.277056 I | ceph-mgr: 2017-07-11 13:37:01.277012 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:01.277148 I | ceph-mgr: 2017-07-11 13:37:01.277133 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:01.277803 I | ceph-mgr: 2017-07-11 13:37:01.277776 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:03.283286 I | ceph-mgr: 2017-07-11 13:37:03.283215 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:03.285045 I | ceph-mgr: 2017-07-11 13:37:03.285018 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:03.285284 I | ceph-mgr: 2017-07-11 13:37:03.285268 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:05.293839 I | ceph-mgr: 2017-07-11 13:37:05.291511 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:05.294008 I | ceph-mgr: 2017-07-11 13:37:05.291517 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:05.294153 I | ceph-mgr: 2017-07-11 13:37:05.291537 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:07.297807 I | ceph-mgr: 2017-07-11 13:37:07.297760 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:07.297903 I | ceph-mgr: 2017-07-11 13:37:07.297889 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:07.298155 I | ceph-mgr: 2017-07-11 13:37:07.298128 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:09.311661 I | ceph-mgr: 2017-07-11 13:37:09.311585 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:09.311781 I | ceph-mgr: 2017-07-11 13:37:09.311766 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:09.312009 I | ceph-mgr: 2017-07-11 13:37:09.311993 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:11.315631 I | ceph-mgr: 2017-07-11 13:37:11.315600 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:11.315706 I | ceph-mgr: 2017-07-11 13:37:11.315692 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:11.315932 I | ceph-mgr: 2017-07-11 13:37:11.315917 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:13.336154 I | ceph-mgr: 2017-07-11 13:37:13.336095 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:13.336380 I | ceph-mgr: 2017-07-11 13:37:13.336364 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:13.338462 I | ceph-mgr: 2017-07-11 13:37:13.338123 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:15.357039 I | ceph-mgr: 2017-07-11 13:37:15.357002 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:15.357217 I | ceph-mgr: 2017-07-11 13:37:15.357199 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:15.358547 I | ceph-mgr: 2017-07-11 13:37:15.358525 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:17.361016 I | ceph-mgr: 2017-07-11 13:37:17.360974 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:17.361091 I | ceph-mgr: 2017-07-11 13:37:17.361074 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:17.361350 I | ceph-mgr: 2017-07-11 13:37:17.361333 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:19.383570 I | ceph-mgr: 2017-07-11 13:37:19.381262 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:19.385177 I | ceph-mgr: 2017-07-11 13:37:19.385157 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:19.392481 I | ceph-mgr: 2017-07-11 13:37:19.392462 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:21.397194 I | ceph-mgr: 2017-07-11 13:37:21.397154 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:21.397381 I | ceph-mgr: 2017-07-11 13:37:21.397350 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:21.397794 I | ceph-mgr: 2017-07-11 13:37:21.397777 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:23.403227 I | ceph-mgr: 2017-07-11 13:37:23.403185 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:23.403306 I | ceph-mgr: 2017-07-11 13:37:23.403291 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:23.403551 I | ceph-mgr: 2017-07-11 13:37:23.403535 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:25.412144 I | ceph-mgr: 2017-07-11 13:37:25.412090 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:25.412239 I | ceph-mgr: 2017-07-11 13:37:25.412224 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:25.412510 I | ceph-mgr: 2017-07-11 13:37:25.412492 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:27.438265 I | ceph-mgr: 2017-07-11 13:37:27.435658 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:27.438362 I | ceph-mgr: 2017-07-11 13:37:27.438346 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:27.438623 I | ceph-mgr: 2017-07-11 13:37:27.438606 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:29.458854 I | ceph-mgr: 2017-07-11 13:37:29.458798 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:29.459050 I | ceph-mgr: 2017-07-11 13:37:29.458985 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:29.459442 I | ceph-mgr: 2017-07-11 13:37:29.459424 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:31.466376 I | ceph-mgr: 2017-07-11 13:37:31.466183 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:31.466620 I | ceph-mgr: 2017-07-11 13:37:31.466603 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:31.467056 I | ceph-mgr: 2017-07-11 13:37:31.467036 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:33.472542 I | ceph-mgr: 2017-07-11 13:37:33.472499 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:33.472624 I | ceph-mgr: 2017-07-11 13:37:33.472609 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:33.472877 I | ceph-mgr: 2017-07-11 13:37:33.472861 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:35.479734 I | ceph-mgr: 2017-07-11 13:37:35.479696 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:35.479947 I | ceph-mgr: 2017-07-11 13:37:35.479917 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:35.482170 I | ceph-mgr: 2017-07-11 13:37:35.482153 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:37.505030 I | ceph-mgr: 2017-07-11 13:37:37.503515 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:37.505099 I | ceph-mgr: 2017-07-11 13:37:37.503537 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:37.505115 I | ceph-mgr: 2017-07-11 13:37:37.503580 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:39.511038 I | ceph-mgr: 2017-07-11 13:37:39.510962 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:39.511131 I | ceph-mgr: 2017-07-11 13:37:39.511116 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:39.511212 I | ceph-mgr: 2017-07-11 13:37:39.511202 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:41.519251 I | ceph-mgr: 2017-07-11 13:37:41.519198 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:41.519356 I | ceph-mgr: 2017-07-11 13:37:41.519339 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:41.519442 I | ceph-mgr: 2017-07-11 13:37:41.519430 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:43.540458 I | ceph-mgr: 2017-07-11 13:37:43.530458 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:43.540712 I | ceph-mgr: 2017-07-11 13:37:43.540577 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:43.541184 I | ceph-mgr: 2017-07-11 13:37:43.541165 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:45.543931 I | ceph-mgr: 2017-07-11 13:37:45.543898 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:45.544013 I | ceph-mgr: 2017-07-11 13:37:45.543999 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:45.544239 I | ceph-mgr: 2017-07-11 13:37:45.544118 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:47.567945 I | ceph-mgr: 2017-07-11 13:37:47.567899 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:47.568028 I | ceph-mgr: 2017-07-11 13:37:47.568013 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:47.568286 I | ceph-mgr: 2017-07-11 13:37:47.568269 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:49.592695 I | ceph-mgr: 2017-07-11 13:37:49.592567 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:49.592777 I | ceph-mgr: 2017-07-11 13:37:49.592761 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:49.593043 I | ceph-mgr: 2017-07-11 13:37:49.593027 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:51.612658 I | ceph-mgr: 2017-07-11 13:37:51.612598 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:51.612740 I | ceph-mgr: 2017-07-11 13:37:51.612724 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:51.613011 I | ceph-mgr: 2017-07-11 13:37:51.612995 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:53.637177 I | ceph-mgr: 2017-07-11 13:37:53.620658 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:53.637255 I | ceph-mgr: 2017-07-11 13:37:53.620671 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:53.637270 I | ceph-mgr: 2017-07-11 13:37:53.620703 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:55.645358 I | ceph-mgr: 2017-07-11 13:37:55.645302 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:55.645459 I | ceph-mgr: 2017-07-11 13:37:55.645445 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:55.645934 I | ceph-mgr: 2017-07-11 13:37:55.645695 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:57.670177 I | ceph-mgr: 2017-07-11 13:37:57.668616 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:57.670751 I | ceph-mgr: 2017-07-11 13:37:57.668631 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:57.670809 I | ceph-mgr: 2017-07-11 13:37:57.668664 7f4cc3226700 0 mgr tick
- 2017-07-11 13:37:59.674870 I | ceph-mgr: 2017-07-11 13:37:59.672873 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:37:59.674955 I | ceph-mgr: 2017-07-11 13:37:59.672883 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:37:59.675008 I | ceph-mgr: 2017-07-11 13:37:59.672980 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:01.678228 I | ceph-mgr: 2017-07-11 13:38:01.678153 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:01.678292 I | ceph-mgr: 2017-07-11 13:38:01.678161 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:01.678537 I | ceph-mgr: 2017-07-11 13:38:01.678479 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:03.701116 I | ceph-mgr: 2017-07-11 13:38:03.701065 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:03.701190 I | ceph-mgr: 2017-07-11 13:38:03.701175 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:03.701435 I | ceph-mgr: 2017-07-11 13:38:03.701420 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:05.705469 I | ceph-mgr: 2017-07-11 13:38:05.705438 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:05.705548 I | ceph-mgr: 2017-07-11 13:38:05.705533 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:05.705774 I | ceph-mgr: 2017-07-11 13:38:05.705650 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:07.719802 I | ceph-mgr: 2017-07-11 13:38:07.719754 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:07.719882 I | ceph-mgr: 2017-07-11 13:38:07.719868 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:07.720120 I | ceph-mgr: 2017-07-11 13:38:07.720105 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:09.728394 I | ceph-mgr: 2017-07-11 13:38:09.728348 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:09.728499 I | ceph-mgr: 2017-07-11 13:38:09.728484 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:09.728894 I | ceph-mgr: 2017-07-11 13:38:09.728878 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:11.734508 I | ceph-mgr: 2017-07-11 13:38:11.734467 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:11.734602 I | ceph-mgr: 2017-07-11 13:38:11.734587 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:11.734828 I | ceph-mgr: 2017-07-11 13:38:11.734811 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:13.738339 I | ceph-mgr: 2017-07-11 13:38:13.738290 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:13.738427 I | ceph-mgr: 2017-07-11 13:38:13.738412 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:13.738708 I | ceph-mgr: 2017-07-11 13:38:13.738691 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:15.755115 I | ceph-mgr: 2017-07-11 13:38:15.755052 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:15.755197 I | ceph-mgr: 2017-07-11 13:38:15.755182 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:15.755441 I | ceph-mgr: 2017-07-11 13:38:15.755426 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:17.757625 I | ceph-mgr: 2017-07-11 13:38:17.757580 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:17.757705 I | ceph-mgr: 2017-07-11 13:38:17.757688 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:17.757966 I | ceph-mgr: 2017-07-11 13:38:17.757950 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:19.766472 I | ceph-mgr: 2017-07-11 13:38:19.766435 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:19.766542 I | ceph-mgr: 2017-07-11 13:38:19.766528 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:19.766807 I | ceph-mgr: 2017-07-11 13:38:19.766791 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:21.786764 I | ceph-mgr: 2017-07-11 13:38:21.786732 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:21.786841 I | ceph-mgr: 2017-07-11 13:38:21.786827 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:21.787066 I | ceph-mgr: 2017-07-11 13:38:21.787050 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:23.795951 I | ceph-mgr: 2017-07-11 13:38:23.795903 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:23.796041 I | ceph-mgr: 2017-07-11 13:38:23.796026 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:23.802261 I | ceph-mgr: 2017-07-11 13:38:23.802241 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:25.815332 I | ceph-mgr: 2017-07-11 13:38:25.815192 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:25.816924 I | ceph-mgr: 2017-07-11 13:38:25.816907 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:25.818057 I | ceph-mgr: 2017-07-11 13:38:25.817365 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:27.825501 I | ceph-mgr: 2017-07-11 13:38:27.825444 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:27.825605 I | ceph-mgr: 2017-07-11 13:38:27.825590 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:27.825871 I | ceph-mgr: 2017-07-11 13:38:27.825854 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:29.842039 I | ceph-mgr: 2017-07-11 13:38:29.841997 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:29.842115 I | ceph-mgr: 2017-07-11 13:38:29.842101 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:29.842367 I | ceph-mgr: 2017-07-11 13:38:29.842351 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:31.867144 I | ceph-mgr: 2017-07-11 13:38:31.867083 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:31.867330 I | ceph-mgr: 2017-07-11 13:38:31.867261 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:31.867561 I | ceph-mgr: 2017-07-11 13:38:31.867546 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:33.873493 I | ceph-mgr: 2017-07-11 13:38:33.873051 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:33.873568 I | ceph-mgr: 2017-07-11 13:38:33.873552 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:33.873801 I | ceph-mgr: 2017-07-11 13:38:33.873786 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:35.888936 I | ceph-mgr: 2017-07-11 13:38:35.885831 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:35.889000 I | ceph-mgr: 2017-07-11 13:38:35.888985 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:35.889258 I | ceph-mgr: 2017-07-11 13:38:35.889148 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:37.906953 I | ceph-mgr: 2017-07-11 13:38:37.906909 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:37.912890 I | ceph-mgr: 2017-07-11 13:38:37.912865 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:37.913028 I | ceph-mgr: 2017-07-11 13:38:37.913013 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:39.922492 I | ceph-mgr: 2017-07-11 13:38:39.922424 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:39.922573 I | ceph-mgr: 2017-07-11 13:38:39.922558 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:39.922878 I | ceph-mgr: 2017-07-11 13:38:39.922859 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:41.924872 I | ceph-mgr: 2017-07-11 13:38:41.924810 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:41.924959 I | ceph-mgr: 2017-07-11 13:38:41.924944 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:41.925215 I | ceph-mgr: 2017-07-11 13:38:41.925199 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:43.951725 I | ceph-mgr: 2017-07-11 13:38:43.943023 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:43.951933 I | ceph-mgr: 2017-07-11 13:38:43.951825 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:43.954711 I | ceph-mgr: 2017-07-11 13:38:43.954693 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:45.986697 I | ceph-mgr: 2017-07-11 13:38:45.986671 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:45.986775 I | ceph-mgr: 2017-07-11 13:38:45.986755 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:45.987116 I | ceph-mgr: 2017-07-11 13:38:45.986883 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:47.992088 I | ceph-mgr: 2017-07-11 13:38:47.992043 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:47.992263 I | ceph-mgr: 2017-07-11 13:38:47.992247 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:47.995296 I | ceph-mgr: 2017-07-11 13:38:47.995279 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:50.014731 I | ceph-mgr: 2017-07-11 13:38:50.014674 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:50.014804 I | ceph-mgr: 2017-07-11 13:38:50.014789 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:50.015046 I | ceph-mgr: 2017-07-11 13:38:50.015031 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:52.037741 I | ceph-mgr: 2017-07-11 13:38:52.036264 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:52.045672 I | ceph-mgr: 2017-07-11 13:38:52.036277 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:52.045725 I | ceph-mgr: 2017-07-11 13:38:52.036307 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:54.042454 I | ceph-mgr: 2017-07-11 13:38:54.042422 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:54.042533 I | ceph-mgr: 2017-07-11 13:38:54.042518 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:54.042765 I | ceph-mgr: 2017-07-11 13:38:54.042604 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:56.045436 I | ceph-mgr: 2017-07-11 13:38:56.045372 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:56.047064 I | ceph-mgr: 2017-07-11 13:38:56.047047 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:56.047462 I | ceph-mgr: 2017-07-11 13:38:56.047445 7f4cc3226700 0 mgr tick
- 2017-07-11 13:38:58.053236 I | ceph-mgr: 2017-07-11 13:38:58.053191 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:38:58.053308 I | ceph-mgr: 2017-07-11 13:38:58.053293 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:38:58.053530 I | ceph-mgr: 2017-07-11 13:38:58.053513 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:00.056431 I | ceph-mgr: 2017-07-11 13:39:00.056385 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:00.056527 I | ceph-mgr: 2017-07-11 13:39:00.056512 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:00.056998 I | ceph-mgr: 2017-07-11 13:39:00.056980 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:02.074606 I | ceph-mgr: 2017-07-11 13:39:02.074568 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:02.074686 I | ceph-mgr: 2017-07-11 13:39:02.074671 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:02.075412 I | ceph-mgr: 2017-07-11 13:39:02.075391 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:04.096172 I | ceph-mgr: 2017-07-11 13:39:04.096128 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:04.096349 I | ceph-mgr: 2017-07-11 13:39:04.096333 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:04.097172 I | ceph-mgr: 2017-07-11 13:39:04.097155 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:06.110792 I | ceph-mgr: 2017-07-11 13:39:06.110493 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:06.110888 I | ceph-mgr: 2017-07-11 13:39:06.110871 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:06.111333 I | ceph-mgr: 2017-07-11 13:39:06.111315 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:08.113263 I | ceph-mgr: 2017-07-11 13:39:08.113183 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:08.113515 I | ceph-mgr: 2017-07-11 13:39:08.113385 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:08.113959 I | ceph-mgr: 2017-07-11 13:39:08.113930 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:10.117929 I | ceph-mgr: 2017-07-11 13:39:10.117878 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:10.118033 I | ceph-mgr: 2017-07-11 13:39:10.118016 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:10.118354 I | ceph-mgr: 2017-07-11 13:39:10.118336 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:12.123536 I | ceph-mgr: 2017-07-11 13:39:12.123483 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:12.123619 I | ceph-mgr: 2017-07-11 13:39:12.123604 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:12.123867 I | ceph-mgr: 2017-07-11 13:39:12.123852 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:14.159769 I | ceph-mgr: 2017-07-11 13:39:14.143854 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:14.159846 I | ceph-mgr: 2017-07-11 13:39:14.159831 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:14.160083 I | ceph-mgr: 2017-07-11 13:39:14.160067 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:16.168246 I | ceph-mgr: 2017-07-11 13:39:16.168210 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:16.168327 I | ceph-mgr: 2017-07-11 13:39:16.168313 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:16.168512 I | ceph-mgr: 2017-07-11 13:39:16.168496 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:18.177411 I | ceph-mgr: 2017-07-11 13:39:18.177363 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:18.177491 I | ceph-mgr: 2017-07-11 13:39:18.177476 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:18.177945 I | ceph-mgr: 2017-07-11 13:39:18.177927 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:20.184184 I | ceph-mgr: 2017-07-11 13:39:20.184135 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:20.184263 I | ceph-mgr: 2017-07-11 13:39:20.184249 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:20.184515 I | ceph-mgr: 2017-07-11 13:39:20.184499 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:22.198186 I | ceph-mgr: 2017-07-11 13:39:22.198150 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:22.198261 I | ceph-mgr: 2017-07-11 13:39:22.198246 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:22.198448 I | ceph-mgr: 2017-07-11 13:39:22.198432 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:24.206240 I | ceph-mgr: 2017-07-11 13:39:24.206194 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:24.206324 I | ceph-mgr: 2017-07-11 13:39:24.206310 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:24.206560 I | ceph-mgr: 2017-07-11 13:39:24.206545 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:26.210712 I | ceph-mgr: 2017-07-11 13:39:26.210586 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:26.210797 I | ceph-mgr: 2017-07-11 13:39:26.210780 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:26.211096 I | ceph-mgr: 2017-07-11 13:39:26.211081 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:28.214652 I | ceph-mgr: 2017-07-11 13:39:28.214583 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:28.214747 I | ceph-mgr: 2017-07-11 13:39:28.214728 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:28.220810 I | ceph-mgr: 2017-07-11 13:39:28.220790 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:30.229164 I | ceph-mgr: 2017-07-11 13:39:30.229110 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:30.229251 I | ceph-mgr: 2017-07-11 13:39:30.229236 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:30.229684 I | ceph-mgr: 2017-07-11 13:39:30.229666 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:32.253566 I | ceph-mgr: 2017-07-11 13:39:32.253496 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:32.253829 I | ceph-mgr: 2017-07-11 13:39:32.253682 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:32.254205 I | ceph-mgr: 2017-07-11 13:39:32.254189 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:34.256083 I | ceph-mgr: 2017-07-11 13:39:34.256039 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:34.256161 I | ceph-mgr: 2017-07-11 13:39:34.256147 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:34.256406 I | ceph-mgr: 2017-07-11 13:39:34.256388 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:36.260448 I | ceph-mgr: 2017-07-11 13:39:36.260328 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:36.260674 I | ceph-mgr: 2017-07-11 13:39:36.260563 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:36.261048 I | ceph-mgr: 2017-07-11 13:39:36.261032 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:38.267972 I | ceph-mgr: 2017-07-11 13:39:38.267912 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:38.268058 I | ceph-mgr: 2017-07-11 13:39:38.268043 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:38.268306 I | ceph-mgr: 2017-07-11 13:39:38.268290 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:40.270124 I | ceph-mgr: 2017-07-11 13:39:40.270073 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:40.270227 I | ceph-mgr: 2017-07-11 13:39:40.270212 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:40.270506 I | ceph-mgr: 2017-07-11 13:39:40.270490 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:42.272480 I | ceph-mgr: 2017-07-11 13:39:42.272433 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:42.272718 I | ceph-mgr: 2017-07-11 13:39:42.272700 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:42.272982 I | ceph-mgr: 2017-07-11 13:39:42.272966 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:44.278722 I | ceph-mgr: 2017-07-11 13:39:44.278692 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:44.278770 I | ceph-mgr: 2017-07-11 13:39:44.278746 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:44.278877 I | ceph-mgr: 2017-07-11 13:39:44.278861 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:46.294497 I | ceph-mgr: 2017-07-11 13:39:46.294209 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:46.294570 I | ceph-mgr: 2017-07-11 13:39:46.294554 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:46.294800 I | ceph-mgr: 2017-07-11 13:39:46.294784 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:48.300084 I | ceph-mgr: 2017-07-11 13:39:48.300049 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:48.300165 I | ceph-mgr: 2017-07-11 13:39:48.300151 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:48.300406 I | ceph-mgr: 2017-07-11 13:39:48.300390 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:50.318644 I | ceph-mgr: 2017-07-11 13:39:50.318596 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:50.318736 I | ceph-mgr: 2017-07-11 13:39:50.318705 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:50.318986 I | ceph-mgr: 2017-07-11 13:39:50.318970 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:52.334547 I | ceph-mgr: 2017-07-11 13:39:52.334505 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:52.334731 I | ceph-mgr: 2017-07-11 13:39:52.334715 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:52.337467 I | ceph-mgr: 2017-07-11 13:39:52.337451 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:54.361570 I | ceph-mgr: 2017-07-11 13:39:54.361536 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:54.361642 I | ceph-mgr: 2017-07-11 13:39:54.361628 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:54.361867 I | ceph-mgr: 2017-07-11 13:39:54.361750 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:56.355921 I | ceph-mgr: 2017-07-11 13:39:56.355887 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:56.355997 I | ceph-mgr: 2017-07-11 13:39:56.355982 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:56.356233 I | ceph-mgr: 2017-07-11 13:39:56.356217 7f4cc3226700 0 mgr tick
- 2017-07-11 13:39:58.364972 I | ceph-mgr: 2017-07-11 13:39:58.364925 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:39:58.367899 I | ceph-mgr: 2017-07-11 13:39:58.367861 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:39:58.368415 I | ceph-mgr: 2017-07-11 13:39:58.368397 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:00.393600 I | ceph-mgr: 2017-07-11 13:40:00.393276 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:00.393772 I | ceph-mgr: 2017-07-11 13:40:00.393288 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:00.393808 I | ceph-mgr: 2017-07-11 13:40:00.393319 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:02.400589 I | ceph-mgr: 2017-07-11 13:40:02.397503 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:02.400799 I | ceph-mgr: 2017-07-11 13:40:02.397516 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:02.400826 I | ceph-mgr: 2017-07-11 13:40:02.397546 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:04.405018 I | ceph-mgr: 2017-07-11 13:40:04.402601 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:04.405194 I | ceph-mgr: 2017-07-11 13:40:04.405176 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:04.405638 I | ceph-mgr: 2017-07-11 13:40:04.405453 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:06.420984 I | ceph-mgr: 2017-07-11 13:40:06.420934 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:06.421028 I | ceph-mgr: 2017-07-11 13:40:06.421013 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:06.421203 I | ceph-mgr: 2017-07-11 13:40:06.421187 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:08.439105 I | ceph-mgr: 2017-07-11 13:40:08.439059 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:08.439182 I | ceph-mgr: 2017-07-11 13:40:08.439168 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:08.439642 I | ceph-mgr: 2017-07-11 13:40:08.439624 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:10.445027 I | ceph-mgr: 2017-07-11 13:40:10.444965 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:10.445116 I | ceph-mgr: 2017-07-11 13:40:10.445101 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:10.445374 I | ceph-mgr: 2017-07-11 13:40:10.445358 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:12.457974 I | ceph-mgr: 2017-07-11 13:40:12.449161 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:12.458145 I | ceph-mgr: 2017-07-11 13:40:12.449176 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:12.458290 I | ceph-mgr: 2017-07-11 13:40:12.449212 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:14.458562 I | ceph-mgr: 2017-07-11 13:40:14.458524 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:14.458636 I | ceph-mgr: 2017-07-11 13:40:14.458621 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:14.458875 I | ceph-mgr: 2017-07-11 13:40:14.458860 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:16.462211 I | ceph-mgr: 2017-07-11 13:40:16.462163 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:16.462304 I | ceph-mgr: 2017-07-11 13:40:16.462289 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:16.471957 I | ceph-mgr: 2017-07-11 13:40:16.471936 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:18.474202 I | ceph-mgr: 2017-07-11 13:40:18.474159 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:18.474272 I | ceph-mgr: 2017-07-11 13:40:18.474256 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:18.474511 I | ceph-mgr: 2017-07-11 13:40:18.474496 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:20.486126 I | ceph-mgr: 2017-07-11 13:40:20.486096 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:20.486213 I | ceph-mgr: 2017-07-11 13:40:20.486198 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:20.486482 I | ceph-mgr: 2017-07-11 13:40:20.486465 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:22.495942 I | ceph-mgr: 2017-07-11 13:40:22.495868 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:22.496218 I | ceph-mgr: 2017-07-11 13:40:22.496069 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:22.496463 I | ceph-mgr: 2017-07-11 13:40:22.496446 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:24.498722 I | ceph-mgr: 2017-07-11 13:40:24.498671 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:24.498819 I | ceph-mgr: 2017-07-11 13:40:24.498803 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:24.499335 I | ceph-mgr: 2017-07-11 13:40:24.499317 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:26.507699 I | ceph-mgr: 2017-07-11 13:40:26.507642 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:26.507792 I | ceph-mgr: 2017-07-11 13:40:26.507776 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:26.508268 I | ceph-mgr: 2017-07-11 13:40:26.508249 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:28.527684 I | ceph-mgr: 2017-07-11 13:40:28.527638 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:28.527754 I | ceph-mgr: 2017-07-11 13:40:28.527740 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:28.528019 I | ceph-mgr: 2017-07-11 13:40:28.528002 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:30.551505 I | ceph-mgr: 2017-07-11 13:40:30.550035 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:30.551565 I | ceph-mgr: 2017-07-11 13:40:30.550040 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:30.551580 I | ceph-mgr: 2017-07-11 13:40:30.550062 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:32.561087 I | ceph-mgr: 2017-07-11 13:40:32.559502 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:32.569087 I | ceph-mgr: 2017-07-11 13:40:32.559513 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:32.569124 I | ceph-mgr: 2017-07-11 13:40:32.559544 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:34.569352 I | ceph-mgr: 2017-07-11 13:40:34.569314 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:34.569426 I | ceph-mgr: 2017-07-11 13:40:34.569412 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:34.569611 I | ceph-mgr: 2017-07-11 13:40:34.569595 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:36.593596 I | ceph-mgr: 2017-07-11 13:40:36.589561 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:36.599445 I | ceph-mgr: 2017-07-11 13:40:36.589571 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:36.599454 I | ceph-mgr: 2017-07-11 13:40:36.589598 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:38.598507 I | ceph-mgr: 2017-07-11 13:40:38.598457 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:38.598588 I | ceph-mgr: 2017-07-11 13:40:38.598573 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:38.598667 I | ceph-mgr: 2017-07-11 13:40:38.598656 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:40.606128 I | ceph-mgr: 2017-07-11 13:40:40.606089 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:40.606212 I | ceph-mgr: 2017-07-11 13:40:40.606197 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:40.606288 I | ceph-mgr: 2017-07-11 13:40:40.606277 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:42.634133 I | ceph-mgr: 2017-07-11 13:40:42.634083 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:42.634303 I | ceph-mgr: 2017-07-11 13:40:42.634239 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:42.634561 I | ceph-mgr: 2017-07-11 13:40:42.634381 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:44.647866 I | ceph-mgr: 2017-07-11 13:40:44.647821 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:44.647939 I | ceph-mgr: 2017-07-11 13:40:44.647923 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:44.648170 I | ceph-mgr: 2017-07-11 13:40:44.648154 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:46.673536 I | ceph-mgr: 2017-07-11 13:40:46.671834 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:46.673611 I | ceph-mgr: 2017-07-11 13:40:46.673595 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:46.673856 I | ceph-mgr: 2017-07-11 13:40:46.673841 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:48.686954 I | ceph-mgr: 2017-07-11 13:40:48.686907 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:48.695724 I | ceph-mgr: 2017-07-11 13:40:48.695652 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:48.698816 I | ceph-mgr: 2017-07-11 13:40:48.698799 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:50.710284 I | ceph-mgr: 2017-07-11 13:40:50.709885 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:50.710375 I | ceph-mgr: 2017-07-11 13:40:50.710359 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:50.710652 I | ceph-mgr: 2017-07-11 13:40:50.710535 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:52.731064 I | ceph-mgr: 2017-07-11 13:40:52.731013 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:52.731147 I | ceph-mgr: 2017-07-11 13:40:52.731131 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:52.731410 I | ceph-mgr: 2017-07-11 13:40:52.731394 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:54.742040 I | ceph-mgr: 2017-07-11 13:40:54.741857 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:54.742144 I | ceph-mgr: 2017-07-11 13:40:54.742127 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:54.742427 I | ceph-mgr: 2017-07-11 13:40:54.742409 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:56.750911 I | ceph-mgr: 2017-07-11 13:40:56.750799 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:56.751002 I | ceph-mgr: 2017-07-11 13:40:56.750985 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:56.751285 I | ceph-mgr: 2017-07-11 13:40:56.751269 7f4cc3226700 0 mgr tick
- 2017-07-11 13:40:58.759204 I | ceph-mgr: 2017-07-11 13:40:58.759125 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:40:58.759489 I | ceph-mgr: 2017-07-11 13:40:58.759347 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:40:58.759828 I | ceph-mgr: 2017-07-11 13:40:58.759811 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:00.765504 I | ceph-mgr: 2017-07-11 13:41:00.764131 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:00.765564 I | ceph-mgr: 2017-07-11 13:41:00.764142 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:00.765580 I | ceph-mgr: 2017-07-11 13:41:00.764170 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:02.772205 I | ceph-mgr: 2017-07-11 13:41:02.768475 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:02.772369 I | ceph-mgr: 2017-07-11 13:41:02.768488 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:02.772507 I | ceph-mgr: 2017-07-11 13:41:02.768520 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:04.793831 I | ceph-mgr: 2017-07-11 13:41:04.793789 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:04.793910 I | ceph-mgr: 2017-07-11 13:41:04.793895 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:04.794097 I | ceph-mgr: 2017-07-11 13:41:04.794081 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:06.813651 I | ceph-mgr: 2017-07-11 13:41:06.813582 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:06.813925 I | ceph-mgr: 2017-07-11 13:41:06.813766 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:06.814104 I | ceph-mgr: 2017-07-11 13:41:06.814089 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:08.817215 I | ceph-mgr: 2017-07-11 13:41:08.817165 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:08.817444 I | ceph-mgr: 2017-07-11 13:41:08.817428 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:08.820170 I | ceph-mgr: 2017-07-11 13:41:08.820152 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:10.839404 I | ceph-mgr: 2017-07-11 13:41:10.839356 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:10.839487 I | ceph-mgr: 2017-07-11 13:41:10.839473 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:10.839744 I | ceph-mgr: 2017-07-11 13:41:10.839727 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:12.843396 I | ceph-mgr: 2017-07-11 13:41:12.843356 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:12.843491 I | ceph-mgr: 2017-07-11 13:41:12.843476 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:12.843721 I | ceph-mgr: 2017-07-11 13:41:12.843706 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:14.851315 I | ceph-mgr: 2017-07-11 13:41:14.851271 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:14.851536 I | ceph-mgr: 2017-07-11 13:41:14.851521 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:14.858816 I | ceph-mgr: 2017-07-11 13:41:14.858781 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:16.863076 I | ceph-mgr: 2017-07-11 13:41:16.863042 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:16.863163 I | ceph-mgr: 2017-07-11 13:41:16.863146 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:16.872935 I | ceph-mgr: 2017-07-11 13:41:16.872916 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:18.877552 I | ceph-mgr: 2017-07-11 13:41:18.877508 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:18.877627 I | ceph-mgr: 2017-07-11 13:41:18.877612 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:18.877870 I | ceph-mgr: 2017-07-11 13:41:18.877855 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:20.880774 I | ceph-mgr: 2017-07-11 13:41:20.880732 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:20.880847 I | ceph-mgr: 2017-07-11 13:41:20.880833 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:20.881106 I | ceph-mgr: 2017-07-11 13:41:20.881090 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:22.906072 I | ceph-mgr: 2017-07-11 13:41:22.905040 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:22.906114 I | ceph-mgr: 2017-07-11 13:41:22.906098 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:22.906212 I | ceph-mgr: 2017-07-11 13:41:22.906197 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:24.920685 I | ceph-mgr: 2017-07-11 13:41:24.920648 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:24.920773 I | ceph-mgr: 2017-07-11 13:41:24.920748 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:24.921060 I | ceph-mgr: 2017-07-11 13:41:24.921031 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:26.933529 I | ceph-mgr: 2017-07-11 13:41:26.930990 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:26.933640 I | ceph-mgr: 2017-07-11 13:41:26.933582 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:26.933876 I | ceph-mgr: 2017-07-11 13:41:26.933860 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:28.953567 I | ceph-mgr: 2017-07-11 13:41:28.953520 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:28.953654 I | ceph-mgr: 2017-07-11 13:41:28.953639 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:28.953926 I | ceph-mgr: 2017-07-11 13:41:28.953909 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:30.991974 I | ceph-mgr: 2017-07-11 13:41:30.990546 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:30.992053 I | ceph-mgr: 2017-07-11 13:41:30.992036 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:30.992306 I | ceph-mgr: 2017-07-11 13:41:30.992290 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:33.003997 I | ceph-mgr: 2017-07-11 13:41:33.003135 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:33.004049 I | ceph-mgr: 2017-07-11 13:41:33.004034 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:33.004171 I | ceph-mgr: 2017-07-11 13:41:33.004156 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:35.011019 I | ceph-mgr: 2017-07-11 13:41:35.010940 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:35.011118 I | ceph-mgr: 2017-07-11 13:41:35.011102 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:35.011463 I | ceph-mgr: 2017-07-11 13:41:35.011447 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:37.023138 I | ceph-mgr: 2017-07-11 13:41:37.023105 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:37.023299 I | ceph-mgr: 2017-07-11 13:41:37.023284 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:37.023530 I | ceph-mgr: 2017-07-11 13:41:37.023515 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:39.041094 I | ceph-mgr: 2017-07-11 13:41:39.041048 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:39.041184 I | ceph-mgr: 2017-07-11 13:41:39.041170 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:39.041439 I | ceph-mgr: 2017-07-11 13:41:39.041423 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:41.050628 I | ceph-mgr: 2017-07-11 13:41:41.050591 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:41.050702 I | ceph-mgr: 2017-07-11 13:41:41.050688 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:41.050934 I | ceph-mgr: 2017-07-11 13:41:41.050918 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:43.076454 I | ceph-mgr: 2017-07-11 13:41:43.076400 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:43.076504 I | ceph-mgr: 2017-07-11 13:41:43.076491 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:43.076625 I | ceph-mgr: 2017-07-11 13:41:43.076611 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:45.089441 I | ceph-mgr: 2017-07-11 13:41:45.086588 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:45.089539 I | ceph-mgr: 2017-07-11 13:41:45.089522 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:45.089811 I | ceph-mgr: 2017-07-11 13:41:45.089794 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:47.105654 I | ceph-mgr: 2017-07-11 13:41:47.105591 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:47.105691 I | ceph-mgr: 2017-07-11 13:41:47.105677 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:47.105820 I | ceph-mgr: 2017-07-11 13:41:47.105805 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:49.116638 I | ceph-mgr: 2017-07-11 13:41:49.116592 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:49.116724 I | ceph-mgr: 2017-07-11 13:41:49.116709 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:49.117204 I | ceph-mgr: 2017-07-11 13:41:49.117188 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:51.120054 I | ceph-mgr: 2017-07-11 13:41:51.120021 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:51.120131 I | ceph-mgr: 2017-07-11 13:41:51.120116 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:51.120365 I | ceph-mgr: 2017-07-11 13:41:51.120349 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:53.152436 I | ceph-mgr: 2017-07-11 13:41:53.132442 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:53.152463 I | ceph-mgr: 2017-07-11 13:41:53.132452 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:53.152470 I | ceph-mgr: 2017-07-11 13:41:53.132481 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:55.184406 I | ceph-mgr: 2017-07-11 13:41:55.174393 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:55.184484 I | ceph-mgr: 2017-07-11 13:41:55.174407 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:55.184501 I | ceph-mgr: 2017-07-11 13:41:55.174443 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:57.192806 I | ceph-mgr: 2017-07-11 13:41:57.191229 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:57.192891 I | ceph-mgr: 2017-07-11 13:41:57.192874 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:57.192964 I | ceph-mgr: 2017-07-11 13:41:57.192954 7f4cc3226700 0 mgr tick
- 2017-07-11 13:41:59.227341 I | ceph-mgr: 2017-07-11 13:41:59.225956 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:41:59.227497 I | ceph-mgr: 2017-07-11 13:41:59.225967 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:41:59.227534 I | ceph-mgr: 2017-07-11 13:41:59.225997 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:01.228647 I | ceph-mgr: 2017-07-11 13:42:01.228612 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:01.228723 I | ceph-mgr: 2017-07-11 13:42:01.228708 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:01.228813 I | ceph-mgr: 2017-07-11 13:42:01.228803 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:03.244900 I | ceph-mgr: 2017-07-11 13:42:03.236142 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:03.245109 I | ceph-mgr: 2017-07-11 13:42:03.244989 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:03.245785 I | ceph-mgr: 2017-07-11 13:42:03.245768 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:05.261419 I | ceph-mgr: 2017-07-11 13:42:05.261368 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:05.261495 I | ceph-mgr: 2017-07-11 13:42:05.261479 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:05.261742 I | ceph-mgr: 2017-07-11 13:42:05.261726 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:07.269880 I | ceph-mgr: 2017-07-11 13:42:07.269831 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:07.269965 I | ceph-mgr: 2017-07-11 13:42:07.269950 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:07.270225 I | ceph-mgr: 2017-07-11 13:42:07.270209 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:09.280970 I | ceph-mgr: 2017-07-11 13:42:09.280887 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:09.291473 I | ceph-mgr: 2017-07-11 13:42:09.291419 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:09.301627 I | ceph-mgr: 2017-07-11 13:42:09.293879 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:11.333771 I | ceph-mgr: 2017-07-11 13:42:11.333740 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:11.333844 I | ceph-mgr: 2017-07-11 13:42:11.333830 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:11.334092 I | ceph-mgr: 2017-07-11 13:42:11.334076 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:13.345779 I | ceph-mgr: 2017-07-11 13:42:13.345738 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:13.345853 I | ceph-mgr: 2017-07-11 13:42:13.345838 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:13.346106 I | ceph-mgr: 2017-07-11 13:42:13.346090 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:15.368480 I | ceph-mgr: 2017-07-11 13:42:15.367007 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:15.368540 I | ceph-mgr: 2017-07-11 13:42:15.367021 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:15.368555 I | ceph-mgr: 2017-07-11 13:42:15.367054 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:17.369675 I | ceph-mgr: 2017-07-11 13:42:17.369638 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:17.369747 I | ceph-mgr: 2017-07-11 13:42:17.369733 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:17.369824 I | ceph-mgr: 2017-07-11 13:42:17.369814 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:19.379040 I | ceph-mgr: 2017-07-11 13:42:19.379005 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:19.379133 I | ceph-mgr: 2017-07-11 13:42:19.379114 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:19.379210 I | ceph-mgr: 2017-07-11 13:42:19.379200 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:21.381041 I | ceph-mgr: 2017-07-11 13:42:21.380997 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:21.381108 I | ceph-mgr: 2017-07-11 13:42:21.381094 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:21.381281 I | ceph-mgr: 2017-07-11 13:42:21.381215 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:23.401046 I | ceph-mgr: 2017-07-11 13:42:23.401003 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:23.401124 I | ceph-mgr: 2017-07-11 13:42:23.401109 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:23.401372 I | ceph-mgr: 2017-07-11 13:42:23.401357 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:25.410247 I | ceph-mgr: 2017-07-11 13:42:25.410102 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:25.410372 I | ceph-mgr: 2017-07-11 13:42:25.410308 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:25.429192 I | ceph-mgr: 2017-07-11 13:42:25.427225 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:27.444943 I | ceph-mgr: 2017-07-11 13:42:27.435249 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:27.445042 I | ceph-mgr: 2017-07-11 13:42:27.435263 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:27.445102 I | ceph-mgr: 2017-07-11 13:42:27.435295 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:29.446741 I | ceph-mgr: 2017-07-11 13:42:29.439958 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:29.446852 I | ceph-mgr: 2017-07-11 13:42:29.446835 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:29.447662 I | ceph-mgr: 2017-07-11 13:42:29.447646 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:31.453577 I | ceph-mgr: 2017-07-11 13:42:31.453541 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:31.453651 I | ceph-mgr: 2017-07-11 13:42:31.453636 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:31.454176 I | ceph-mgr: 2017-07-11 13:42:31.453889 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:33.456468 I | ceph-mgr: 2017-07-11 13:42:33.456356 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:33.463562 I | ceph-mgr: 2017-07-11 13:42:33.463440 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:33.463732 I | ceph-mgr: 2017-07-11 13:42:33.463716 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:35.482788 I | ceph-mgr: 2017-07-11 13:42:35.480813 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:35.482930 I | ceph-mgr: 2017-07-11 13:42:35.482895 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:35.483205 I | ceph-mgr: 2017-07-11 13:42:35.483189 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:37.494360 I | ceph-mgr: 2017-07-11 13:42:37.492684 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:37.494570 I | ceph-mgr: 2017-07-11 13:42:37.492691 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:37.494669 I | ceph-mgr: 2017-07-11 13:42:37.492715 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:39.521081 I | ceph-mgr: 2017-07-11 13:42:39.520934 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:39.521339 I | ceph-mgr: 2017-07-11 13:42:39.521200 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:39.521596 I | ceph-mgr: 2017-07-11 13:42:39.521581 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:41.523925 I | ceph-mgr: 2017-07-11 13:42:41.523873 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:41.524016 I | ceph-mgr: 2017-07-11 13:42:41.524000 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:41.524321 I | ceph-mgr: 2017-07-11 13:42:41.524303 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:43.563271 I | ceph-mgr: 2017-07-11 13:42:43.563214 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:43.563495 I | ceph-mgr: 2017-07-11 13:42:43.563479 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:43.565960 I | ceph-mgr: 2017-07-11 13:42:43.565930 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:45.586656 I | ceph-mgr: 2017-07-11 13:42:45.586613 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:45.586734 I | ceph-mgr: 2017-07-11 13:42:45.586719 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:45.587042 I | ceph-mgr: 2017-07-11 13:42:45.587024 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:47.605093 I | ceph-mgr: 2017-07-11 13:42:47.605024 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:47.605181 I | ceph-mgr: 2017-07-11 13:42:47.605166 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:47.605447 I | ceph-mgr: 2017-07-11 13:42:47.605430 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:49.625082 I | ceph-mgr: 2017-07-11 13:42:49.623772 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:49.632370 I | ceph-mgr: 2017-07-11 13:42:49.623778 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:49.632466 I | ceph-mgr: 2017-07-11 13:42:49.623802 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:51.627295 I | ceph-mgr: 2017-07-11 13:42:51.627261 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:51.627397 I | ceph-mgr: 2017-07-11 13:42:51.627371 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:51.627525 I | ceph-mgr: 2017-07-11 13:42:51.627511 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:53.637408 I | ceph-mgr: 2017-07-11 13:42:53.634838 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:53.637493 I | ceph-mgr: 2017-07-11 13:42:53.637476 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:53.637663 I | ceph-mgr: 2017-07-11 13:42:53.637578 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:55.679824 I | ceph-mgr: 2017-07-11 13:42:55.662352 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:55.679885 I | ceph-mgr: 2017-07-11 13:42:55.662366 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:55.679902 I | ceph-mgr: 2017-07-11 13:42:55.662398 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:57.673366 I | ceph-mgr: 2017-07-11 13:42:57.671828 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:57.673430 I | ceph-mgr: 2017-07-11 13:42:57.671841 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:57.673446 I | ceph-mgr: 2017-07-11 13:42:57.671873 7f4cc3226700 0 mgr tick
- 2017-07-11 13:42:59.677003 I | ceph-mgr: 2017-07-11 13:42:59.675481 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:42:59.677214 I | ceph-mgr: 2017-07-11 13:42:59.675487 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:42:59.677314 I | ceph-mgr: 2017-07-11 13:42:59.675515 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:01.680997 I | ceph-mgr: 2017-07-11 13:43:01.680899 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:01.681095 I | ceph-mgr: 2017-07-11 13:43:01.681080 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:01.681418 I | ceph-mgr: 2017-07-11 13:43:01.681402 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:03.687278 I | ceph-mgr: 2017-07-11 13:43:03.687225 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:03.687372 I | ceph-mgr: 2017-07-11 13:43:03.687356 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:03.690440 I | ceph-mgr: 2017-07-11 13:43:03.689209 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:05.702656 I | ceph-mgr: 2017-07-11 13:43:05.702624 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:05.702745 I | ceph-mgr: 2017-07-11 13:43:05.702729 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:05.702965 I | ceph-mgr: 2017-07-11 13:43:05.702949 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:07.717844 I | ceph-mgr: 2017-07-11 13:43:07.717797 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:07.717924 I | ceph-mgr: 2017-07-11 13:43:07.717910 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:07.718184 I | ceph-mgr: 2017-07-11 13:43:07.718168 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:09.726589 I | ceph-mgr: 2017-07-11 13:43:09.726539 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:09.726699 I | ceph-mgr: 2017-07-11 13:43:09.726684 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:09.726946 I | ceph-mgr: 2017-07-11 13:43:09.726931 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:11.730481 I | ceph-mgr: 2017-07-11 13:43:11.730405 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:11.730582 I | ceph-mgr: 2017-07-11 13:43:11.730567 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:11.730839 I | ceph-mgr: 2017-07-11 13:43:11.730821 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:13.733996 I | ceph-mgr: 2017-07-11 13:43:13.733946 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:13.759549 I | ceph-mgr: 2017-07-11 13:43:13.734096 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:13.759599 I | ceph-mgr: 2017-07-11 13:43:13.749808 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:15.766349 I | ceph-mgr: 2017-07-11 13:43:15.753608 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:15.766435 I | ceph-mgr: 2017-07-11 13:43:15.756581 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:15.766453 I | ceph-mgr: 2017-07-11 13:43:15.756671 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:17.784733 I | ceph-mgr: 2017-07-11 13:43:17.784694 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:17.784803 I | ceph-mgr: 2017-07-11 13:43:17.784789 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:17.785041 I | ceph-mgr: 2017-07-11 13:43:17.785026 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:19.792332 I | ceph-mgr: 2017-07-11 13:43:19.792286 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:19.792418 I | ceph-mgr: 2017-07-11 13:43:19.792397 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:19.792660 I | ceph-mgr: 2017-07-11 13:43:19.792645 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:21.813814 I | ceph-mgr: 2017-07-11 13:43:21.813774 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:21.813899 I | ceph-mgr: 2017-07-11 13:43:21.813883 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:21.819955 I | ceph-mgr: 2017-07-11 13:43:21.819935 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:23.827200 I | ceph-mgr: 2017-07-11 13:43:23.827149 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:23.827294 I | ceph-mgr: 2017-07-11 13:43:23.827279 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:23.827570 I | ceph-mgr: 2017-07-11 13:43:23.827544 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:25.853579 I | ceph-mgr: 2017-07-11 13:43:25.853528 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:25.853660 I | ceph-mgr: 2017-07-11 13:43:25.853646 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:25.854011 I | ceph-mgr: 2017-07-11 13:43:25.853995 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:27.855794 I | ceph-mgr: 2017-07-11 13:43:27.855744 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:27.855994 I | ceph-mgr: 2017-07-11 13:43:27.855964 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:27.864910 I | ceph-mgr: 2017-07-11 13:43:27.864889 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:29.882542 I | ceph-mgr: 2017-07-11 13:43:29.882501 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:29.882764 I | ceph-mgr: 2017-07-11 13:43:29.882747 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:29.884282 I | ceph-mgr: 2017-07-11 13:43:29.884266 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:31.895555 I | ceph-mgr: 2017-07-11 13:43:31.891536 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:31.911762 I | ceph-mgr: 2017-07-11 13:43:31.895611 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:31.912121 I | ceph-mgr: 2017-07-11 13:43:31.912104 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:33.914246 I | ceph-mgr: 2017-07-11 13:43:33.914197 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:33.914328 I | ceph-mgr: 2017-07-11 13:43:33.914313 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:33.914587 I | ceph-mgr: 2017-07-11 13:43:33.914571 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:35.927839 I | ceph-mgr: 2017-07-11 13:43:35.927794 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:35.927914 I | ceph-mgr: 2017-07-11 13:43:35.927899 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:35.928157 I | ceph-mgr: 2017-07-11 13:43:35.928140 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:37.945369 I | ceph-mgr: 2017-07-11 13:43:37.944234 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:37.945398 I | ceph-mgr: 2017-07-11 13:43:37.944250 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:37.945401 I | ceph-mgr: 2017-07-11 13:43:37.944298 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:39.947175 I | ceph-mgr: 2017-07-11 13:43:39.947130 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:39.947255 I | ceph-mgr: 2017-07-11 13:43:39.947240 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:39.947509 I | ceph-mgr: 2017-07-11 13:43:39.947493 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:41.959162 I | ceph-mgr: 2017-07-11 13:43:41.959127 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:41.959239 I | ceph-mgr: 2017-07-11 13:43:41.959224 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:41.959494 I | ceph-mgr: 2017-07-11 13:43:41.959478 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:43.991373 I | ceph-mgr: 2017-07-11 13:43:43.980438 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:43.991437 I | ceph-mgr: 2017-07-11 13:43:43.980451 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:43.991462 I | ceph-mgr: 2017-07-11 13:43:43.980487 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:46.006810 I | ceph-mgr: 2017-07-11 13:43:45.996281 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:46.006882 I | ceph-mgr: 2017-07-11 13:43:45.996298 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:46.006903 I | ceph-mgr: 2017-07-11 13:43:45.996428 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:48.051501 I | ceph-mgr: 2017-07-11 13:43:48.009739 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:48.053104 I | ceph-mgr: 2017-07-11 13:43:48.009753 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:48.053138 I | ceph-mgr: 2017-07-11 13:43:48.009784 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:50.018471 I | ceph-mgr: 2017-07-11 13:43:50.011643 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:50.018547 I | ceph-mgr: 2017-07-11 13:43:50.018532 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:50.019007 I | ceph-mgr: 2017-07-11 13:43:50.018970 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:52.027742 I | ceph-mgr: 2017-07-11 13:43:52.027677 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:52.028002 I | ceph-mgr: 2017-07-11 13:43:52.027851 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:52.028414 I | ceph-mgr: 2017-07-11 13:43:52.028397 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:54.031418 I | ceph-mgr: 2017-07-11 13:43:54.030252 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:54.031508 I | ceph-mgr: 2017-07-11 13:43:54.031491 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:54.031760 I | ceph-mgr: 2017-07-11 13:43:54.031744 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:56.039634 I | ceph-mgr: 2017-07-11 13:43:56.039570 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:56.039712 I | ceph-mgr: 2017-07-11 13:43:56.039697 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:56.039972 I | ceph-mgr: 2017-07-11 13:43:56.039955 7f4cc3226700 0 mgr tick
- 2017-07-11 13:43:58.042969 I | ceph-mgr: 2017-07-11 13:43:58.042869 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:43:58.044765 I | ceph-mgr: 2017-07-11 13:43:58.044749 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:43:58.045092 I | ceph-mgr: 2017-07-11 13:43:58.045076 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:00.049800 I | ceph-mgr: 2017-07-11 13:44:00.049618 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:00.049989 I | ceph-mgr: 2017-07-11 13:44:00.049901 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:00.050220 I | ceph-mgr: 2017-07-11 13:44:00.050205 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:02.053643 I | ceph-mgr: 2017-07-11 13:44:02.053600 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:02.053723 I | ceph-mgr: 2017-07-11 13:44:02.053708 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:02.053957 I | ceph-mgr: 2017-07-11 13:44:02.053942 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:04.069651 I | ceph-mgr: 2017-07-11 13:44:04.066229 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:04.075893 I | ceph-mgr: 2017-07-11 13:44:04.075874 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:04.077668 I | ceph-mgr: 2017-07-11 13:44:04.077650 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:06.087490 I | ceph-mgr: 2017-07-11 13:44:06.087441 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:06.087660 I | ceph-mgr: 2017-07-11 13:44:06.087644 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:06.105339 I | ceph-mgr: 2017-07-11 13:44:06.088163 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:08.112439 I | ceph-mgr: 2017-07-11 13:44:08.110747 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:08.112657 I | ceph-mgr: 2017-07-11 13:44:08.110761 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:08.112690 I | ceph-mgr: 2017-07-11 13:44:08.110867 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:10.126489 I | ceph-mgr: 2017-07-11 13:44:10.116690 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:10.126700 I | ceph-mgr: 2017-07-11 13:44:10.116703 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:10.126726 I | ceph-mgr: 2017-07-11 13:44:10.116734 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:12.124753 I | ceph-mgr: 2017-07-11 13:44:12.123464 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:12.124903 I | ceph-mgr: 2017-07-11 13:44:12.123469 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:12.124952 I | ceph-mgr: 2017-07-11 13:44:12.123489 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:14.136819 I | ceph-mgr: 2017-07-11 13:44:14.127063 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:14.136906 I | ceph-mgr: 2017-07-11 13:44:14.136888 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:14.146603 I | ceph-mgr: 2017-07-11 13:44:14.146584 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:16.193670 I | ceph-mgr: 2017-07-11 13:44:16.193635 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:16.193744 I | ceph-mgr: 2017-07-11 13:44:16.193730 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:16.193922 I | ceph-mgr: 2017-07-11 13:44:16.193907 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:18.196563 I | ceph-mgr: 2017-07-11 13:44:18.196515 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:18.196786 I | ceph-mgr: 2017-07-11 13:44:18.196770 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:18.199394 I | ceph-mgr: 2017-07-11 13:44:18.199357 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:20.219343 I | ceph-mgr: 2017-07-11 13:44:20.219302 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:20.219458 I | ceph-mgr: 2017-07-11 13:44:20.219442 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:20.219757 I | ceph-mgr: 2017-07-11 13:44:20.219740 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:22.226082 I | ceph-mgr: 2017-07-11 13:44:22.226049 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:22.226153 I | ceph-mgr: 2017-07-11 13:44:22.226139 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:22.226389 I | ceph-mgr: 2017-07-11 13:44:22.226374 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:24.235875 I | ceph-mgr: 2017-07-11 13:44:24.228692 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:24.236062 I | ceph-mgr: 2017-07-11 13:44:24.235998 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:24.246304 I | ceph-mgr: 2017-07-11 13:44:24.246284 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:26.258869 I | ceph-mgr: 2017-07-11 13:44:26.258835 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:26.258943 I | ceph-mgr: 2017-07-11 13:44:26.258929 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:26.279044 I | ceph-mgr: 2017-07-11 13:44:26.277154 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:28.288400 I | ceph-mgr: 2017-07-11 13:44:28.279189 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:28.288470 I | ceph-mgr: 2017-07-11 13:44:28.279201 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:28.288486 I | ceph-mgr: 2017-07-11 13:44:28.279233 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:30.295995 I | ceph-mgr: 2017-07-11 13:44:30.285658 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:30.296044 I | ceph-mgr: 2017-07-11 13:44:30.285688 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:30.296070 I | ceph-mgr: 2017-07-11 13:44:30.285809 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:32.303908 I | ceph-mgr: 2017-07-11 13:44:32.302178 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:32.303960 I | ceph-mgr: 2017-07-11 13:44:32.302222 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:32.303986 I | ceph-mgr: 2017-07-11 13:44:32.302397 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:34.334849 I | ceph-mgr: 2017-07-11 13:44:34.304636 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:34.334893 I | ceph-mgr: 2017-07-11 13:44:34.334876 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:34.335041 I | ceph-mgr: 2017-07-11 13:44:34.335024 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:36.344501 I | ceph-mgr: 2017-07-11 13:44:36.341407 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:36.351319 I | ceph-mgr: 2017-07-11 13:44:36.351299 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:36.361658 I | ceph-mgr: 2017-07-11 13:44:36.351490 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:38.390843 I | ceph-mgr: 2017-07-11 13:44:38.389426 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:38.390996 I | ceph-mgr: 2017-07-11 13:44:38.389438 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:38.391044 I | ceph-mgr: 2017-07-11 13:44:38.389467 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:40.395145 I | ceph-mgr: 2017-07-11 13:44:40.395054 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:40.395244 I | ceph-mgr: 2017-07-11 13:44:40.395229 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:40.395502 I | ceph-mgr: 2017-07-11 13:44:40.395487 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:42.402225 I | ceph-mgr: 2017-07-11 13:44:42.402163 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:42.402421 I | ceph-mgr: 2017-07-11 13:44:42.402327 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:42.402845 I | ceph-mgr: 2017-07-11 13:44:42.402828 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:44.407215 I | ceph-mgr: 2017-07-11 13:44:44.406968 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:44.420034 I | ceph-mgr: 2017-07-11 13:44:44.420012 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:44.420166 I | ceph-mgr: 2017-07-11 13:44:44.420137 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:46.499121 I | ceph-mgr: 2017-07-11 13:44:46.489704 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:46.499502 I | ceph-mgr: 2017-07-11 13:44:46.499484 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:46.499875 I | ceph-mgr: 2017-07-11 13:44:46.499859 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:48.511348 I | ceph-mgr: 2017-07-11 13:44:48.508403 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:48.511429 I | ceph-mgr: 2017-07-11 13:44:48.511413 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:48.511709 I | ceph-mgr: 2017-07-11 13:44:48.511692 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:50.524094 I | ceph-mgr: 2017-07-11 13:44:50.523627 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:50.524147 I | ceph-mgr: 2017-07-11 13:44:50.524132 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:50.524313 I | ceph-mgr: 2017-07-11 13:44:50.524297 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:52.540308 I | ceph-mgr: 2017-07-11 13:44:52.530211 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:52.540638 I | ceph-mgr: 2017-07-11 13:44:52.530222 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:52.540666 I | ceph-mgr: 2017-07-11 13:44:52.530266 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:54.532480 I | ceph-mgr: 2017-07-11 13:44:54.532430 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:54.539025 I | ceph-mgr: 2017-07-11 13:44:54.539005 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:54.540524 I | ceph-mgr: 2017-07-11 13:44:54.540505 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:56.589301 I | ceph-mgr: 2017-07-11 13:44:56.589251 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:56.589389 I | ceph-mgr: 2017-07-11 13:44:56.589374 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:56.589657 I | ceph-mgr: 2017-07-11 13:44:56.589641 7f4cc3226700 0 mgr tick
- 2017-07-11 13:44:58.593294 I | ceph-mgr: 2017-07-11 13:44:58.593247 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:44:58.593375 I | ceph-mgr: 2017-07-11 13:44:58.593361 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:44:58.595837 I | ceph-mgr: 2017-07-11 13:44:58.595820 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:00.620495 I | ceph-mgr: 2017-07-11 13:45:00.620446 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:00.620583 I | ceph-mgr: 2017-07-11 13:45:00.620569 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:00.620847 I | ceph-mgr: 2017-07-11 13:45:00.620831 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:02.628604 I | ceph-mgr: 2017-07-11 13:45:02.628557 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:02.628693 I | ceph-mgr: 2017-07-11 13:45:02.628678 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:02.628963 I | ceph-mgr: 2017-07-11 13:45:02.628946 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:04.720053 I | ceph-mgr: 2017-07-11 13:45:04.631950 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:04.720282 I | ceph-mgr: 2017-07-11 13:45:04.631963 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:04.720311 I | ceph-mgr: 2017-07-11 13:45:04.631991 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:06.738575 I | ceph-mgr: 2017-07-11 13:45:06.738526 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:06.738655 I | ceph-mgr: 2017-07-11 13:45:06.738640 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:06.738895 I | ceph-mgr: 2017-07-11 13:45:06.738880 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:08.755553 I | ceph-mgr: 2017-07-11 13:45:08.747929 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:08.755630 I | ceph-mgr: 2017-07-11 13:45:08.755615 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:08.757165 I | ceph-mgr: 2017-07-11 13:45:08.757145 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:10.759631 I | ceph-mgr: 2017-07-11 13:45:10.759547 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:10.759718 I | ceph-mgr: 2017-07-11 13:45:10.759702 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:10.759969 I | ceph-mgr: 2017-07-11 13:45:10.759953 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:12.771218 I | ceph-mgr: 2017-07-11 13:45:12.771156 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:12.771309 I | ceph-mgr: 2017-07-11 13:45:12.771295 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:12.771859 I | ceph-mgr: 2017-07-11 13:45:12.771832 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:14.777492 I | ceph-mgr: 2017-07-11 13:45:14.777449 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:14.777572 I | ceph-mgr: 2017-07-11 13:45:14.777558 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:14.781100 I | ceph-mgr: 2017-07-11 13:45:14.781081 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:16.829103 I | ceph-mgr: 2017-07-11 13:45:16.829059 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:16.829182 I | ceph-mgr: 2017-07-11 13:45:16.829168 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:16.829432 I | ceph-mgr: 2017-07-11 13:45:16.829416 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:18.844835 I | ceph-mgr: 2017-07-11 13:45:18.844794 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:18.844908 I | ceph-mgr: 2017-07-11 13:45:18.844893 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:18.845149 I | ceph-mgr: 2017-07-11 13:45:18.845134 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:20.853943 I | ceph-mgr: 2017-07-11 13:45:20.853913 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:20.854011 I | ceph-mgr: 2017-07-11 13:45:20.853997 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:20.854416 I | ceph-mgr: 2017-07-11 13:45:20.854399 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:22.878172 I | ceph-mgr: 2017-07-11 13:45:22.878129 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:22.879625 I | ceph-mgr: 2017-07-11 13:45:22.878344 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:22.880018 I | ceph-mgr: 2017-07-11 13:45:22.880002 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:24.886191 I | ceph-mgr: 2017-07-11 13:45:24.882383 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:24.886285 I | ceph-mgr: 2017-07-11 13:45:24.886269 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:24.892929 I | ceph-mgr: 2017-07-11 13:45:24.892913 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:26.970269 I | ceph-mgr: 2017-07-11 13:45:26.969596 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:26.970331 I | ceph-mgr: 2017-07-11 13:45:26.969609 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:26.970346 I | ceph-mgr: 2017-07-11 13:45:26.969639 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:28.973797 I | ceph-mgr: 2017-07-11 13:45:28.973745 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:28.974027 I | ceph-mgr: 2017-07-11 13:45:28.974010 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:28.974210 I | ceph-mgr: 2017-07-11 13:45:28.974198 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:30.987810 I | ceph-mgr: 2017-07-11 13:45:30.987779 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:30.987879 I | ceph-mgr: 2017-07-11 13:45:30.987865 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:30.987964 I | ceph-mgr: 2017-07-11 13:45:30.987953 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:32.999818 I | ceph-mgr: 2017-07-11 13:45:32.999785 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:32.999890 I | ceph-mgr: 2017-07-11 13:45:32.999876 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:33.000108 I | ceph-mgr: 2017-07-11 13:45:32.999991 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:35.015881 I | ceph-mgr: 2017-07-11 13:45:35.008389 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:35.016102 I | ceph-mgr: 2017-07-11 13:45:35.016064 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:35.026085 I | ceph-mgr: 2017-07-11 13:45:35.026044 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:37.084427 I | ceph-mgr: 2017-07-11 13:45:37.084384 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:37.084654 I | ceph-mgr: 2017-07-11 13:45:37.084638 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:37.086713 I | ceph-mgr: 2017-07-11 13:45:37.086693 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:39.090835 I | ceph-mgr: 2017-07-11 13:45:39.090788 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:39.104402 I | ceph-mgr: 2017-07-11 13:45:39.104383 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:39.112403 I | ceph-mgr: 2017-07-11 13:45:39.112383 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:41.194507 I | ceph-mgr: 2017-07-11 13:45:41.194451 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:41.194699 I | ceph-mgr: 2017-07-11 13:45:41.194609 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:41.194932 I | ceph-mgr: 2017-07-11 13:45:41.194916 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:43.199886 I | ceph-mgr: 2017-07-11 13:45:43.199840 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:43.199963 I | ceph-mgr: 2017-07-11 13:45:43.199950 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:43.200259 I | ceph-mgr: 2017-07-11 13:45:43.200241 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:45.215785 I | ceph-mgr: 2017-07-11 13:45:45.213646 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:45.215827 I | ceph-mgr: 2017-07-11 13:45:45.215813 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:45.215996 I | ceph-mgr: 2017-07-11 13:45:45.215981 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:47.219745 I | ceph-mgr: 2017-07-11 13:45:47.219714 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:47.219831 I | ceph-mgr: 2017-07-11 13:45:47.219817 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:47.220313 I | ceph-mgr: 2017-07-11 13:45:47.220070 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:49.239889 I | ceph-mgr: 2017-07-11 13:45:49.237867 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:49.246387 I | ceph-mgr: 2017-07-11 13:45:49.246367 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:49.249998 I | ceph-mgr: 2017-07-11 13:45:49.249977 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:51.264126 I | ceph-mgr: 2017-07-11 13:45:51.264028 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:51.264333 I | ceph-mgr: 2017-07-11 13:45:51.264254 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:51.264651 I | ceph-mgr: 2017-07-11 13:45:51.264462 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:53.268358 I | ceph-mgr: 2017-07-11 13:45:53.268280 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:53.268434 I | ceph-mgr: 2017-07-11 13:45:53.268419 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:53.268658 I | ceph-mgr: 2017-07-11 13:45:53.268642 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:55.276214 I | ceph-mgr: 2017-07-11 13:45:55.274609 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:55.276309 I | ceph-mgr: 2017-07-11 13:45:55.276292 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:55.277578 I | ceph-mgr: 2017-07-11 13:45:55.277559 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:57.308654 I | ceph-mgr: 2017-07-11 13:45:57.288958 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:57.308725 I | ceph-mgr: 2017-07-11 13:45:57.288974 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:57.308742 I | ceph-mgr: 2017-07-11 13:45:57.289025 7f4cc3226700 0 mgr tick
- 2017-07-11 13:45:59.306624 I | ceph-mgr: 2017-07-11 13:45:59.290495 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:45:59.306693 I | ceph-mgr: 2017-07-11 13:45:59.290507 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:45:59.306709 I | ceph-mgr: 2017-07-11 13:45:59.290536 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:01.315801 I | ceph-mgr: 2017-07-11 13:46:01.315769 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:01.315874 I | ceph-mgr: 2017-07-11 13:46:01.315860 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:01.316097 I | ceph-mgr: 2017-07-11 13:46:01.315982 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:03.320154 I | ceph-mgr: 2017-07-11 13:46:03.319964 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:03.320229 I | ceph-mgr: 2017-07-11 13:46:03.320214 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:03.320477 I | ceph-mgr: 2017-07-11 13:46:03.320462 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:05.332986 I | ceph-mgr: 2017-07-11 13:46:05.330941 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:05.340417 I | ceph-mgr: 2017-07-11 13:46:05.340397 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:05.350543 I | ceph-mgr: 2017-07-11 13:46:05.350507 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:07.352992 I | ceph-mgr: 2017-07-11 13:46:07.352958 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:07.353063 I | ceph-mgr: 2017-07-11 13:46:07.353049 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:07.353314 I | ceph-mgr: 2017-07-11 13:46:07.353298 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:09.377007 I | ceph-mgr: 2017-07-11 13:46:09.376757 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:09.377115 I | ceph-mgr: 2017-07-11 13:46:09.377099 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:09.377358 I | ceph-mgr: 2017-07-11 13:46:09.377342 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:11.384841 I | ceph-mgr: 2017-07-11 13:46:11.384795 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:11.384930 I | ceph-mgr: 2017-07-11 13:46:11.384915 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:11.385160 I | ceph-mgr: 2017-07-11 13:46:11.385145 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:13.387600 I | ceph-mgr: 2017-07-11 13:46:13.387538 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:13.387689 I | ceph-mgr: 2017-07-11 13:46:13.387673 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:13.388177 I | ceph-mgr: 2017-07-11 13:46:13.388159 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:15.400596 I | ceph-mgr: 2017-07-11 13:46:15.398359 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:15.408433 I | ceph-mgr: 2017-07-11 13:46:15.408389 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:15.418431 I | ceph-mgr: 2017-07-11 13:46:15.418403 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:17.484830 I | ceph-mgr: 2017-07-11 13:46:17.484793 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:17.484920 I | ceph-mgr: 2017-07-11 13:46:17.484905 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:17.485150 I | ceph-mgr: 2017-07-11 13:46:17.485135 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:19.493950 I | ceph-mgr: 2017-07-11 13:46:19.493915 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:19.494070 I | ceph-mgr: 2017-07-11 13:46:19.494053 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:19.494308 I | ceph-mgr: 2017-07-11 13:46:19.494291 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:21.497460 I | ceph-mgr: 2017-07-11 13:46:21.497415 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:21.497548 I | ceph-mgr: 2017-07-11 13:46:21.497532 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:21.497791 I | ceph-mgr: 2017-07-11 13:46:21.497775 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:23.517496 I | ceph-mgr: 2017-07-11 13:46:23.517452 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:23.517533 I | ceph-mgr: 2017-07-11 13:46:23.517520 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:23.517641 I | ceph-mgr: 2017-07-11 13:46:23.517627 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:25.532145 I | ceph-mgr: 2017-07-11 13:46:25.532072 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:25.539926 I | ceph-mgr: 2017-07-11 13:46:25.539906 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:25.543163 I | ceph-mgr: 2017-07-11 13:46:25.543134 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:27.552577 I | ceph-mgr: 2017-07-11 13:46:27.552495 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:27.552706 I | ceph-mgr: 2017-07-11 13:46:27.552688 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:27.554126 I | ceph-mgr: 2017-07-11 13:46:27.554108 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:29.574532 I | ceph-mgr: 2017-07-11 13:46:29.574498 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:29.574605 I | ceph-mgr: 2017-07-11 13:46:29.574591 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:29.574839 I | ceph-mgr: 2017-07-11 13:46:29.574824 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:31.578591 I | ceph-mgr: 2017-07-11 13:46:31.577229 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:31.578759 I | ceph-mgr: 2017-07-11 13:46:31.577236 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:31.578857 I | ceph-mgr: 2017-07-11 13:46:31.577258 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:33.578785 I | ceph-mgr: 2017-07-11 13:46:33.578747 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:33.578864 I | ceph-mgr: 2017-07-11 13:46:33.578849 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:33.579090 I | ceph-mgr: 2017-07-11 13:46:33.579074 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:35.595524 I | ceph-mgr: 2017-07-11 13:46:35.585570 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:35.595613 I | ceph-mgr: 2017-07-11 13:46:35.595597 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:35.598317 I | ceph-mgr: 2017-07-11 13:46:35.598291 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:37.643869 I | ceph-mgr: 2017-07-11 13:46:37.635728 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:37.643975 I | ceph-mgr: 2017-07-11 13:46:37.643955 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:37.644910 I | ceph-mgr: 2017-07-11 13:46:37.644870 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:39.643408 I | ceph-mgr: 2017-07-11 13:46:39.648657 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:39.643639 I | ceph-mgr: 2017-07-11 13:46:39.643621 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:39.643939 I | ceph-mgr: 2017-07-11 13:46:39.643924 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:41.665792 I | ceph-mgr: 2017-07-11 13:46:41.665748 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:41.665914 I | ceph-mgr: 2017-07-11 13:46:41.665899 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:41.666346 I | ceph-mgr: 2017-07-11 13:46:41.666330 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:43.676981 I | ceph-mgr: 2017-07-11 13:46:43.675566 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:43.682817 I | ceph-mgr: 2017-07-11 13:46:43.675579 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:43.682828 I | ceph-mgr: 2017-07-11 13:46:43.675618 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:45.691062 I | ceph-mgr: 2017-07-11 13:46:45.680927 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:45.693229 I | ceph-mgr: 2017-07-11 13:46:45.691335 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:45.753416 I | ceph-mgr: 2017-07-11 13:46:45.701404 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:47.771590 I | ceph-mgr: 2017-07-11 13:46:47.755564 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:47.772065 I | ceph-mgr: 2017-07-11 13:46:47.755577 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:47.772094 I | ceph-mgr: 2017-07-11 13:46:47.755605 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:49.778775 I | ceph-mgr: 2017-07-11 13:46:49.777237 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:49.779239 I | ceph-mgr: 2017-07-11 13:46:49.777243 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:49.779270 I | ceph-mgr: 2017-07-11 13:46:49.777267 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:51.780460 I | ceph-mgr: 2017-07-11 13:46:51.780414 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:51.780540 I | ceph-mgr: 2017-07-11 13:46:51.780526 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:51.780791 I | ceph-mgr: 2017-07-11 13:46:51.780775 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:53.798430 I | ceph-mgr: 2017-07-11 13:46:53.798267 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:53.798505 I | ceph-mgr: 2017-07-11 13:46:53.798490 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:53.798746 I | ceph-mgr: 2017-07-11 13:46:53.798731 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:55.818133 I | ceph-mgr: 2017-07-11 13:46:55.818085 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:55.825195 I | ceph-mgr: 2017-07-11 13:46:55.825151 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:55.835232 I | ceph-mgr: 2017-07-11 13:46:55.835216 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:57.868205 I | ceph-mgr: 2017-07-11 13:46:57.868156 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:57.868384 I | ceph-mgr: 2017-07-11 13:46:57.868307 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:57.868569 I | ceph-mgr: 2017-07-11 13:46:57.868554 7f4cc3226700 0 mgr tick
- 2017-07-11 13:46:59.870481 I | ceph-mgr: 2017-07-11 13:46:59.870443 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:46:59.870559 I | ceph-mgr: 2017-07-11 13:46:59.870544 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:46:59.873106 I | ceph-mgr: 2017-07-11 13:46:59.873083 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:01.891430 I | ceph-mgr: 2017-07-11 13:47:01.891368 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:01.891516 I | ceph-mgr: 2017-07-11 13:47:01.891501 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:01.892217 I | ceph-mgr: 2017-07-11 13:47:01.892197 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:03.900299 I | ceph-mgr: 2017-07-11 13:47:03.900259 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:03.900382 I | ceph-mgr: 2017-07-11 13:47:03.900368 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:03.900602 I | ceph-mgr: 2017-07-11 13:47:03.900587 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:05.915001 I | ceph-mgr: 2017-07-11 13:47:05.911405 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:05.921412 I | ceph-mgr: 2017-07-11 13:47:05.921368 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:05.954991 I | ceph-mgr: 2017-07-11 13:47:05.954971 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:07.973952 I | ceph-mgr: 2017-07-11 13:47:07.973904 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:07.974032 I | ceph-mgr: 2017-07-11 13:47:07.974017 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:07.974290 I | ceph-mgr: 2017-07-11 13:47:07.974273 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:09.998509 I | ceph-mgr: 2017-07-11 13:47:09.998432 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:09.998727 I | ceph-mgr: 2017-07-11 13:47:09.998694 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:09.999179 I | ceph-mgr: 2017-07-11 13:47:09.999151 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:12.001777 I | ceph-mgr: 2017-07-11 13:47:12.001677 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:12.001877 I | ceph-mgr: 2017-07-11 13:47:12.001852 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:12.002168 I | ceph-mgr: 2017-07-11 13:47:12.002152 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:14.006968 I | ceph-mgr: 2017-07-11 13:47:14.006886 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:14.007077 I | ceph-mgr: 2017-07-11 13:47:14.007060 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:14.007338 I | ceph-mgr: 2017-07-11 13:47:14.007317 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:16.025285 I | ceph-mgr: 2017-07-11 13:47:16.025256 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:16.032707 I | ceph-mgr: 2017-07-11 13:47:16.032666 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:16.042627 I | ceph-mgr: 2017-07-11 13:47:16.042597 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:18.050380 I | ceph-mgr: 2017-07-11 13:47:18.050335 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:18.050457 I | ceph-mgr: 2017-07-11 13:47:18.050443 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:18.050695 I | ceph-mgr: 2017-07-11 13:47:18.050680 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:20.057789 I | ceph-mgr: 2017-07-11 13:47:20.057744 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:20.057876 I | ceph-mgr: 2017-07-11 13:47:20.057860 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:20.058154 I | ceph-mgr: 2017-07-11 13:47:20.058136 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:22.081814 I | ceph-mgr: 2017-07-11 13:47:22.081743 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:22.081903 I | ceph-mgr: 2017-07-11 13:47:22.081889 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:22.084514 I | ceph-mgr: 2017-07-11 13:47:22.084496 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:24.104197 I | ceph-mgr: 2017-07-11 13:47:24.104151 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:24.104294 I | ceph-mgr: 2017-07-11 13:47:24.104279 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:24.104543 I | ceph-mgr: 2017-07-11 13:47:24.104527 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:26.124852 I | ceph-mgr: 2017-07-11 13:47:26.124805 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:26.131224 I | ceph-mgr: 2017-07-11 13:47:26.131205 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:26.141177 I | ceph-mgr: 2017-07-11 13:47:26.132814 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:28.164936 I | ceph-mgr: 2017-07-11 13:47:28.164871 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:28.165028 I | ceph-mgr: 2017-07-11 13:47:28.165012 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:28.165274 I | ceph-mgr: 2017-07-11 13:47:28.165259 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:30.173992 I | ceph-mgr: 2017-07-11 13:47:30.173910 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:30.174166 I | ceph-mgr: 2017-07-11 13:47:30.174147 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:30.174663 I | ceph-mgr: 2017-07-11 13:47:30.174646 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:32.183086 I | ceph-mgr: 2017-07-11 13:47:32.183050 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:32.183169 I | ceph-mgr: 2017-07-11 13:47:32.183153 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:32.183420 I | ceph-mgr: 2017-07-11 13:47:32.183403 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:34.185447 I | ceph-mgr: 2017-07-11 13:47:34.185150 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:34.185527 I | ceph-mgr: 2017-07-11 13:47:34.185511 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:34.185767 I | ceph-mgr: 2017-07-11 13:47:34.185751 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:36.189204 I | ceph-mgr: 2017-07-11 13:47:36.189170 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:36.208724 I | ceph-mgr: 2017-07-11 13:47:36.208703 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:36.208952 I | ceph-mgr: 2017-07-11 13:47:36.208937 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:38.242484 I | ceph-mgr: 2017-07-11 13:47:38.242433 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:38.242567 I | ceph-mgr: 2017-07-11 13:47:38.242552 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:38.242829 I | ceph-mgr: 2017-07-11 13:47:38.242813 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:40.263350 I | ceph-mgr: 2017-07-11 13:47:40.263247 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:40.263427 I | ceph-mgr: 2017-07-11 13:47:40.263411 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:40.263684 I | ceph-mgr: 2017-07-11 13:47:40.263667 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:42.275035 I | ceph-mgr: 2017-07-11 13:47:42.273607 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:42.282572 I | ceph-mgr: 2017-07-11 13:47:42.273614 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:42.282724 I | ceph-mgr: 2017-07-11 13:47:42.273641 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:44.282910 I | ceph-mgr: 2017-07-11 13:47:44.282861 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:44.282993 I | ceph-mgr: 2017-07-11 13:47:44.282978 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:44.283287 I | ceph-mgr: 2017-07-11 13:47:44.283086 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:46.298712 I | ceph-mgr: 2017-07-11 13:47:46.288754 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:46.299003 I | ceph-mgr: 2017-07-11 13:47:46.298837 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:46.308676 I | ceph-mgr: 2017-07-11 13:47:46.308629 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:48.373283 I | ceph-mgr: 2017-07-11 13:47:48.373215 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:48.373368 I | ceph-mgr: 2017-07-11 13:47:48.373352 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:48.373622 I | ceph-mgr: 2017-07-11 13:47:48.373607 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:50.378304 I | ceph-mgr: 2017-07-11 13:47:50.378256 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:50.378398 I | ceph-mgr: 2017-07-11 13:47:50.378382 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:50.378666 I | ceph-mgr: 2017-07-11 13:47:50.378650 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:52.381979 I | ceph-mgr: 2017-07-11 13:47:52.381943 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:52.382068 I | ceph-mgr: 2017-07-11 13:47:52.382043 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:52.382294 I | ceph-mgr: 2017-07-11 13:47:52.382279 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:54.403102 I | ceph-mgr: 2017-07-11 13:47:54.403069 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:54.403267 I | ceph-mgr: 2017-07-11 13:47:54.403252 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:54.403518 I | ceph-mgr: 2017-07-11 13:47:54.403503 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:56.413256 I | ceph-mgr: 2017-07-11 13:47:56.413225 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:56.413328 I | ceph-mgr: 2017-07-11 13:47:56.413314 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:56.433296 I | ceph-mgr: 2017-07-11 13:47:56.433275 7f4cc3226700 0 mgr tick
- 2017-07-11 13:47:58.457266 I | ceph-mgr: 2017-07-11 13:47:58.457215 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:47:58.457360 I | ceph-mgr: 2017-07-11 13:47:58.457345 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:47:58.457597 I | ceph-mgr: 2017-07-11 13:47:58.457581 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:00.468241 I | ceph-mgr: 2017-07-11 13:48:00.468158 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:00.468315 I | ceph-mgr: 2017-07-11 13:48:00.468300 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:00.468545 I | ceph-mgr: 2017-07-11 13:48:00.468530 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:02.479465 I | ceph-mgr: 2017-07-11 13:48:02.479401 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:02.479766 I | ceph-mgr: 2017-07-11 13:48:02.479572 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:02.480035 I | ceph-mgr: 2017-07-11 13:48:02.480007 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:04.488410 I | ceph-mgr: 2017-07-11 13:48:04.488376 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:04.488485 I | ceph-mgr: 2017-07-11 13:48:04.488471 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:04.488714 I | ceph-mgr: 2017-07-11 13:48:04.488698 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:06.494800 I | ceph-mgr: 2017-07-11 13:48:06.492873 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:06.502831 I | ceph-mgr: 2017-07-11 13:48:06.502788 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:06.592106 I | ceph-mgr: 2017-07-11 13:48:06.592066 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:08.600198 I | ceph-mgr: 2017-07-11 13:48:08.600162 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:08.600271 I | ceph-mgr: 2017-07-11 13:48:08.600257 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:08.600592 I | ceph-mgr: 2017-07-11 13:48:08.600372 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:10.607600 I | ceph-mgr: 2017-07-11 13:48:10.607526 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:10.607754 I | ceph-mgr: 2017-07-11 13:48:10.607717 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:10.608304 I | ceph-mgr: 2017-07-11 13:48:10.608285 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:12.615785 I | ceph-mgr: 2017-07-11 13:48:12.615736 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:12.615886 I | ceph-mgr: 2017-07-11 13:48:12.615871 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:12.616366 I | ceph-mgr: 2017-07-11 13:48:12.616349 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:14.627785 I | ceph-mgr: 2017-07-11 13:48:14.627718 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:14.627883 I | ceph-mgr: 2017-07-11 13:48:14.627868 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:14.628133 I | ceph-mgr: 2017-07-11 13:48:14.628111 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:16.644784 I | ceph-mgr: 2017-07-11 13:48:16.644628 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:16.644825 I | ceph-mgr: 2017-07-11 13:48:16.644811 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:16.644941 I | ceph-mgr: 2017-07-11 13:48:16.644927 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:18.649842 I | ceph-mgr: 2017-07-11 13:48:18.649784 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:18.649921 I | ceph-mgr: 2017-07-11 13:48:18.649907 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:18.652149 I | ceph-mgr: 2017-07-11 13:48:18.652133 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:20.671022 I | ceph-mgr: 2017-07-11 13:48:20.654003 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:20.671193 I | ceph-mgr: 2017-07-11 13:48:20.654016 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:20.671339 I | ceph-mgr: 2017-07-11 13:48:20.654046 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:22.679755 I | ceph-mgr: 2017-07-11 13:48:22.679720 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:22.679829 I | ceph-mgr: 2017-07-11 13:48:22.679815 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:22.680077 I | ceph-mgr: 2017-07-11 13:48:22.680060 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:24.682051 I | ceph-mgr: 2017-07-11 13:48:24.682002 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:24.682131 I | ceph-mgr: 2017-07-11 13:48:24.682116 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:24.688419 I | ceph-mgr: 2017-07-11 13:48:24.688400 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:26.704742 I | ceph-mgr: 2017-07-11 13:48:26.704674 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:26.704832 I | ceph-mgr: 2017-07-11 13:48:26.704817 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:26.707844 I | ceph-mgr: 2017-07-11 13:48:26.707828 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:28.761760 I | ceph-mgr: 2017-07-11 13:48:28.745140 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:28.762171 I | ceph-mgr: 2017-07-11 13:48:28.745154 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:28.762205 I | ceph-mgr: 2017-07-11 13:48:28.745193 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:30.766435 I | ceph-mgr: 2017-07-11 13:48:30.766402 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:30.766533 I | ceph-mgr: 2017-07-11 13:48:30.766518 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:30.766810 I | ceph-mgr: 2017-07-11 13:48:30.766794 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:32.771112 I | ceph-mgr: 2017-07-11 13:48:32.771038 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:32.771216 I | ceph-mgr: 2017-07-11 13:48:32.771201 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:32.771520 I | ceph-mgr: 2017-07-11 13:48:32.771505 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:34.775310 I | ceph-mgr: 2017-07-11 13:48:34.775244 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:34.775961 I | ceph-mgr: 2017-07-11 13:48:34.775944 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:34.776366 I | ceph-mgr: 2017-07-11 13:48:34.776349 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:36.787981 I | ceph-mgr: 2017-07-11 13:48:36.784395 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:36.794325 I | ceph-mgr: 2017-07-11 13:48:36.794305 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:36.804459 I | ceph-mgr: 2017-07-11 13:48:36.804440 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:38.864628 I | ceph-mgr: 2017-07-11 13:48:38.864579 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:38.865856 I | ceph-mgr: 2017-07-11 13:48:38.864800 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:38.868061 I | ceph-mgr: 2017-07-11 13:48:38.868043 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:40.966840 I | ceph-mgr: 2017-07-11 13:48:40.964974 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:40.966923 I | ceph-mgr: 2017-07-11 13:48:40.966907 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:40.967214 I | ceph-mgr: 2017-07-11 13:48:40.967197 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:42.991881 I | ceph-mgr: 2017-07-11 13:48:42.985252 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:42.991983 I | ceph-mgr: 2017-07-11 13:48:42.991965 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:43.011770 I | ceph-mgr: 2017-07-11 13:48:43.005199 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:45.061047 I | ceph-mgr: 2017-07-11 13:48:45.059607 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:45.061202 I | ceph-mgr: 2017-07-11 13:48:45.059621 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:45.061222 I | ceph-mgr: 2017-07-11 13:48:45.059653 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:47.062567 I | ceph-mgr: 2017-07-11 13:48:47.060993 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:47.062956 I | ceph-mgr: 2017-07-11 13:48:47.061006 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:47.062995 I | ceph-mgr: 2017-07-11 13:48:47.061037 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:49.073837 I | ceph-mgr: 2017-07-11 13:48:49.072183 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:49.079765 I | ceph-mgr: 2017-07-11 13:48:49.079722 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:49.080005 I | ceph-mgr: 2017-07-11 13:48:49.079988 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:51.084953 I | ceph-mgr: 2017-07-11 13:48:51.084924 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:51.085027 I | ceph-mgr: 2017-07-11 13:48:51.085013 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:51.085191 I | ceph-mgr: 2017-07-11 13:48:51.085125 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:53.098738 I | ceph-mgr: 2017-07-11 13:48:53.098705 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:53.098810 I | ceph-mgr: 2017-07-11 13:48:53.098796 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:53.099017 I | ceph-mgr: 2017-07-11 13:48:53.098907 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:55.102988 I | ceph-mgr: 2017-07-11 13:48:55.102910 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:55.103074 I | ceph-mgr: 2017-07-11 13:48:55.103058 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:55.103332 I | ceph-mgr: 2017-07-11 13:48:55.103317 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:57.111135 I | ceph-mgr: 2017-07-11 13:48:57.111073 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:57.111258 I | ceph-mgr: 2017-07-11 13:48:57.111241 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:57.111530 I | ceph-mgr: 2017-07-11 13:48:57.111514 7f4cc3226700 0 mgr tick
- 2017-07-11 13:48:59.118059 I | ceph-mgr: 2017-07-11 13:48:59.118014 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:48:59.118280 I | ceph-mgr: 2017-07-11 13:48:59.118263 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:48:59.120221 I | ceph-mgr: 2017-07-11 13:48:59.120204 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:01.122160 I | ceph-mgr: 2017-07-11 13:49:01.122122 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:01.122338 I | ceph-mgr: 2017-07-11 13:49:01.122321 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:01.124090 I | ceph-mgr: 2017-07-11 13:49:01.124073 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:03.145140 I | ceph-mgr: 2017-07-11 13:49:03.128025 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:03.145198 I | ceph-mgr: 2017-07-11 13:49:03.128034 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:03.145215 I | ceph-mgr: 2017-07-11 13:49:03.128057 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:05.150016 I | ceph-mgr: 2017-07-11 13:49:05.149970 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:05.150095 I | ceph-mgr: 2017-07-11 13:49:05.150081 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:05.150357 I | ceph-mgr: 2017-07-11 13:49:05.150341 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:07.172522 I | ceph-mgr: 2017-07-11 13:49:07.172457 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:07.172749 I | ceph-mgr: 2017-07-11 13:49:07.172733 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:07.172963 I | ceph-mgr: 2017-07-11 13:49:07.172947 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:09.184540 I | ceph-mgr: 2017-07-11 13:49:09.184477 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:09.184643 I | ceph-mgr: 2017-07-11 13:49:09.184627 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:09.184959 I | ceph-mgr: 2017-07-11 13:49:09.184943 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:11.191879 I | ceph-mgr: 2017-07-11 13:49:11.191849 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:11.191947 I | ceph-mgr: 2017-07-11 13:49:11.191933 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:11.192156 I | ceph-mgr: 2017-07-11 13:49:11.192045 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:13.200360 I | ceph-mgr: 2017-07-11 13:49:13.200318 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:13.200433 I | ceph-mgr: 2017-07-11 13:49:13.200419 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:13.200655 I | ceph-mgr: 2017-07-11 13:49:13.200538 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:15.206361 I | ceph-mgr: 2017-07-11 13:49:15.206308 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:15.206460 I | ceph-mgr: 2017-07-11 13:49:15.206436 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:15.210274 I | ceph-mgr: 2017-07-11 13:49:15.210257 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:17.258000 I | ceph-mgr: 2017-07-11 13:49:17.230326 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:17.258018 I | ceph-mgr: 2017-07-11 13:49:17.230345 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:17.258021 I | ceph-mgr: 2017-07-11 13:49:17.236717 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:19.266316 I | ceph-mgr: 2017-07-11 13:49:19.262319 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:19.274326 I | ceph-mgr: 2017-07-11 13:49:19.266391 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:19.274754 I | ceph-mgr: 2017-07-11 13:49:19.274738 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:21.286005 I | ceph-mgr: 2017-07-11 13:49:21.285317 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:21.286070 I | ceph-mgr: 2017-07-11 13:49:21.285322 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:21.286086 I | ceph-mgr: 2017-07-11 13:49:21.285343 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:23.292712 I | ceph-mgr: 2017-07-11 13:49:23.292676 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:23.292787 I | ceph-mgr: 2017-07-11 13:49:23.292773 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:23.292863 I | ceph-mgr: 2017-07-11 13:49:23.292852 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:25.298865 I | ceph-mgr: 2017-07-11 13:49:25.298782 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:25.298929 I | ceph-mgr: 2017-07-11 13:49:25.298796 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:25.299351 I | ceph-mgr: 2017-07-11 13:49:25.298968 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:27.313556 I | ceph-mgr: 2017-07-11 13:49:27.310450 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:27.320394 I | ceph-mgr: 2017-07-11 13:49:27.320372 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:27.322122 I | ceph-mgr: 2017-07-11 13:49:27.322103 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:29.377346 I | ceph-mgr: 2017-07-11 13:49:29.377260 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:29.377528 I | ceph-mgr: 2017-07-11 13:49:29.377447 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:29.395528 I | ceph-mgr: 2017-07-11 13:49:29.393843 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:31.414521 I | ceph-mgr: 2017-07-11 13:49:31.398103 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:31.414594 I | ceph-mgr: 2017-07-11 13:49:31.398115 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:31.414617 I | ceph-mgr: 2017-07-11 13:49:31.398192 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:33.448566 I | ceph-mgr: 2017-07-11 13:49:33.422808 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:33.450332 I | ceph-mgr: 2017-07-11 13:49:33.448645 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:33.450525 I | ceph-mgr: 2017-07-11 13:49:33.448996 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:35.462778 I | ceph-mgr: 2017-07-11 13:49:35.452646 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:35.463001 I | ceph-mgr: 2017-07-11 13:49:35.452659 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:35.463036 I | ceph-mgr: 2017-07-11 13:49:35.452746 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:37.490873 I | ceph-mgr: 2017-07-11 13:49:37.471490 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:37.490929 I | ceph-mgr: 2017-07-11 13:49:37.471502 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:37.490939 I | ceph-mgr: 2017-07-11 13:49:37.471593 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:39.498431 I | ceph-mgr: 2017-07-11 13:49:39.496714 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:39.506618 I | ceph-mgr: 2017-07-11 13:49:39.506592 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:39.507100 I | ceph-mgr: 2017-07-11 13:49:39.507072 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:41.517876 I | ceph-mgr: 2017-07-11 13:49:41.517825 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:41.517972 I | ceph-mgr: 2017-07-11 13:49:41.517957 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:41.518214 I | ceph-mgr: 2017-07-11 13:49:41.518198 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:43.521353 I | ceph-mgr: 2017-07-11 13:49:43.521302 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:43.521439 I | ceph-mgr: 2017-07-11 13:49:43.521424 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:43.537258 I | ceph-mgr: 2017-07-11 13:49:43.537237 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:45.540676 I | ceph-mgr: 2017-07-11 13:49:45.540616 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:45.540769 I | ceph-mgr: 2017-07-11 13:49:45.540754 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:45.540930 I | ceph-mgr: 2017-07-11 13:49:45.540850 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:47.545498 I | ceph-mgr: 2017-07-11 13:49:47.545431 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:47.555469 I | ceph-mgr: 2017-07-11 13:49:47.555453 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:47.555702 I | ceph-mgr: 2017-07-11 13:49:47.555687 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:49.677851 I | ceph-mgr: 2017-07-11 13:49:49.677740 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:49.678052 I | ceph-mgr: 2017-07-11 13:49:49.677961 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:49.678328 I | ceph-mgr: 2017-07-11 13:49:49.678312 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:51.683145 I | ceph-mgr: 2017-07-11 13:49:51.683109 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:51.683260 I | ceph-mgr: 2017-07-11 13:49:51.683201 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:51.683503 I | ceph-mgr: 2017-07-11 13:49:51.683487 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:53.695361 I | ceph-mgr: 2017-07-11 13:49:53.695312 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:53.695448 I | ceph-mgr: 2017-07-11 13:49:53.695433 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:53.695764 I | ceph-mgr: 2017-07-11 13:49:53.695748 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:55.707305 I | ceph-mgr: 2017-07-11 13:49:55.707260 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:55.707421 I | ceph-mgr: 2017-07-11 13:49:55.707362 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:55.707667 I | ceph-mgr: 2017-07-11 13:49:55.707652 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:57.732650 I | ceph-mgr: 2017-07-11 13:49:57.732599 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:57.732739 I | ceph-mgr: 2017-07-11 13:49:57.732725 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:57.742259 I | ceph-mgr: 2017-07-11 13:49:57.742239 7f4cc3226700 0 mgr tick
- 2017-07-11 13:49:59.826150 I | ceph-mgr: 2017-07-11 13:49:59.826111 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:49:59.826323 I | ceph-mgr: 2017-07-11 13:49:59.826307 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:49:59.828869 I | ceph-mgr: 2017-07-11 13:49:59.828851 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:01.848851 I | ceph-mgr: 2017-07-11 13:50:01.848806 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:01.848961 I | ceph-mgr: 2017-07-11 13:50:01.848947 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:01.849248 I | ceph-mgr: 2017-07-11 13:50:01.849233 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:03.864501 I | ceph-mgr: 2017-07-11 13:50:03.864426 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:03.864831 I | ceph-mgr: 2017-07-11 13:50:03.864608 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:03.865248 I | ceph-mgr: 2017-07-11 13:50:03.865230 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:05.867070 I | ceph-mgr: 2017-07-11 13:50:05.866991 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:05.870997 I | ceph-mgr: 2017-07-11 13:50:05.870980 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:05.886889 I | ceph-mgr: 2017-07-11 13:50:05.886871 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:07.896679 I | ceph-mgr: 2017-07-11 13:50:07.896628 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:07.896758 I | ceph-mgr: 2017-07-11 13:50:07.896744 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:07.906700 I | ceph-mgr: 2017-07-11 13:50:07.906682 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:09.989050 I | ceph-mgr: 2017-07-11 13:50:09.989007 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:09.989138 I | ceph-mgr: 2017-07-11 13:50:09.989124 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:09.989383 I | ceph-mgr: 2017-07-11 13:50:09.989367 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:11.992441 I | ceph-mgr: 2017-07-11 13:50:11.992394 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:11.992620 I | ceph-mgr: 2017-07-11 13:50:11.992517 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:11.993078 I | ceph-mgr: 2017-07-11 13:50:11.993060 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:13.998436 I | ceph-mgr: 2017-07-11 13:50:13.998388 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:13.998525 I | ceph-mgr: 2017-07-11 13:50:13.998511 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:13.998767 I | ceph-mgr: 2017-07-11 13:50:13.998751 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:16.017987 I | ceph-mgr: 2017-07-11 13:50:16.017926 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:16.018067 I | ceph-mgr: 2017-07-11 13:50:16.018052 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:16.018503 I | ceph-mgr: 2017-07-11 13:50:16.018485 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:18.025661 I | ceph-mgr: 2017-07-11 13:50:18.024109 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:18.034018 I | ceph-mgr: 2017-07-11 13:50:18.033999 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:18.037678 I | ceph-mgr: 2017-07-11 13:50:18.037660 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:20.153273 I | ceph-mgr: 2017-07-11 13:50:20.146460 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:20.153354 I | ceph-mgr: 2017-07-11 13:50:20.153337 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:20.153609 I | ceph-mgr: 2017-07-11 13:50:20.153593 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:22.160738 I | ceph-mgr: 2017-07-11 13:50:22.160688 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:22.160824 I | ceph-mgr: 2017-07-11 13:50:22.160806 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:22.161413 I | ceph-mgr: 2017-07-11 13:50:22.161393 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:24.170223 I | ceph-mgr: 2017-07-11 13:50:24.166245 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:24.170281 I | ceph-mgr: 2017-07-11 13:50:24.166264 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:24.170296 I | ceph-mgr: 2017-07-11 13:50:24.166313 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:26.174922 I | ceph-mgr: 2017-07-11 13:50:26.173569 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:26.174986 I | ceph-mgr: 2017-07-11 13:50:26.173575 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:26.175003 I | ceph-mgr: 2017-07-11 13:50:26.173596 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:28.190252 I | ceph-mgr: 2017-07-11 13:50:28.180207 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:28.190462 I | ceph-mgr: 2017-07-11 13:50:28.190370 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:28.309507 I | ceph-mgr: 2017-07-11 13:50:28.292314 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:30.315353 I | ceph-mgr: 2017-07-11 13:50:30.312350 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:30.315460 I | ceph-mgr: 2017-07-11 13:50:30.315439 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:30.315721 I | ceph-mgr: 2017-07-11 13:50:30.315706 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:32.334953 I | ceph-mgr: 2017-07-11 13:50:32.333627 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:32.335040 I | ceph-mgr: 2017-07-11 13:50:32.335023 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:32.335439 I | ceph-mgr: 2017-07-11 13:50:32.335207 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:34.354891 I | ceph-mgr: 2017-07-11 13:50:34.344894 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:34.354938 I | ceph-mgr: 2017-07-11 13:50:34.354919 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:34.355051 I | ceph-mgr: 2017-07-11 13:50:34.355036 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:36.357792 I | ceph-mgr: 2017-07-11 13:50:36.357756 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:36.357875 I | ceph-mgr: 2017-07-11 13:50:36.357861 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:36.358097 I | ceph-mgr: 2017-07-11 13:50:36.357975 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:38.377815 I | ceph-mgr: 2017-07-11 13:50:38.377767 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:38.385402 I | ceph-mgr: 2017-07-11 13:50:38.385383 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:38.395174 I | ceph-mgr: 2017-07-11 13:50:38.395152 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:40.436451 I | ceph-mgr: 2017-07-11 13:50:40.436402 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:40.436545 I | ceph-mgr: 2017-07-11 13:50:40.436524 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:40.436795 I | ceph-mgr: 2017-07-11 13:50:40.436780 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:42.456445 I | ceph-mgr: 2017-07-11 13:50:42.456403 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:42.456516 I | ceph-mgr: 2017-07-11 13:50:42.456501 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:42.456773 I | ceph-mgr: 2017-07-11 13:50:42.456757 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:44.470008 I | ceph-mgr: 2017-07-11 13:50:44.469732 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:44.470092 I | ceph-mgr: 2017-07-11 13:50:44.470077 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:44.470316 I | ceph-mgr: 2017-07-11 13:50:44.470300 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:46.481939 I | ceph-mgr: 2017-07-11 13:50:46.481880 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:46.482023 I | ceph-mgr: 2017-07-11 13:50:46.482008 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:46.482229 I | ceph-mgr: 2017-07-11 13:50:46.482123 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:48.504649 I | ceph-mgr: 2017-07-11 13:50:48.494650 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:48.514509 I | ceph-mgr: 2017-07-11 13:50:48.494664 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:48.514613 I | ceph-mgr: 2017-07-11 13:50:48.494695 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:50.529487 I | ceph-mgr: 2017-07-11 13:50:50.529431 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:50.529596 I | ceph-mgr: 2017-07-11 13:50:50.529563 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:50.529859 I | ceph-mgr: 2017-07-11 13:50:50.529842 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:52.533929 I | ceph-mgr: 2017-07-11 13:50:52.533895 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:52.534026 I | ceph-mgr: 2017-07-11 13:50:52.534012 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:52.534388 I | ceph-mgr: 2017-07-11 13:50:52.534372 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:54.538979 I | ceph-mgr: 2017-07-11 13:50:54.538896 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:54.539065 I | ceph-mgr: 2017-07-11 13:50:54.539049 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:54.539305 I | ceph-mgr: 2017-07-11 13:50:54.539290 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:56.552046 I | ceph-mgr: 2017-07-11 13:50:56.550568 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:56.552256 I | ceph-mgr: 2017-07-11 13:50:56.550582 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:56.552353 I | ceph-mgr: 2017-07-11 13:50:56.550615 7f4cc3226700 0 mgr tick
- 2017-07-11 13:50:58.556854 I | ceph-mgr: 2017-07-11 13:50:58.554275 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:50:58.564188 I | ceph-mgr: 2017-07-11 13:50:58.564167 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:50:58.574175 I | ceph-mgr: 2017-07-11 13:50:58.574146 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:00.644837 I | ceph-mgr: 2017-07-11 13:51:00.644794 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:00.644913 I | ceph-mgr: 2017-07-11 13:51:00.644898 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:00.645179 I | ceph-mgr: 2017-07-11 13:51:00.645162 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:02.669270 I | ceph-mgr: 2017-07-11 13:51:02.669203 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:02.669520 I | ceph-mgr: 2017-07-11 13:51:02.669377 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:02.669970 I | ceph-mgr: 2017-07-11 13:51:02.669954 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:04.671549 I | ceph-mgr: 2017-07-11 13:51:04.671512 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:04.671620 I | ceph-mgr: 2017-07-11 13:51:04.671606 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:04.671793 I | ceph-mgr: 2017-07-11 13:51:04.671726 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:06.694183 I | ceph-mgr: 2017-07-11 13:51:06.694126 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:06.694277 I | ceph-mgr: 2017-07-11 13:51:06.694262 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:06.694520 I | ceph-mgr: 2017-07-11 13:51:06.694505 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:08.710670 I | ceph-mgr: 2017-07-11 13:51:08.707374 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:08.717315 I | ceph-mgr: 2017-07-11 13:51:08.717272 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:08.727364 I | ceph-mgr: 2017-07-11 13:51:08.727303 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:10.761998 I | ceph-mgr: 2017-07-11 13:51:10.761948 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:10.762325 I | ceph-mgr: 2017-07-11 13:51:10.762307 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:10.762615 I | ceph-mgr: 2017-07-11 13:51:10.762596 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:12.792029 I | ceph-mgr: 2017-07-11 13:51:12.782315 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:12.792117 I | ceph-mgr: 2017-07-11 13:51:12.782328 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:12.792135 I | ceph-mgr: 2017-07-11 13:51:12.782359 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:14.786335 I | ceph-mgr: 2017-07-11 13:51:14.786293 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:14.786423 I | ceph-mgr: 2017-07-11 13:51:14.786409 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:14.786497 I | ceph-mgr: 2017-07-11 13:51:14.786485 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:16.790692 I | ceph-mgr: 2017-07-11 13:51:16.789392 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:16.798908 I | ceph-mgr: 2017-07-11 13:51:16.789399 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:16.798943 I | ceph-mgr: 2017-07-11 13:51:16.789421 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:18.802377 I | ceph-mgr: 2017-07-11 13:51:18.792402 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:18.802465 I | ceph-mgr: 2017-07-11 13:51:18.802447 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:18.802550 I | ceph-mgr: 2017-07-11 13:51:18.802540 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:20.880039 I | ceph-mgr: 2017-07-11 13:51:20.879963 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:20.880296 I | ceph-mgr: 2017-07-11 13:51:20.880151 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:20.880373 I | ceph-mgr: 2017-07-11 13:51:20.880363 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:22.886390 I | ceph-mgr: 2017-07-11 13:51:22.886349 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:22.886468 I | ceph-mgr: 2017-07-11 13:51:22.886454 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:22.886706 I | ceph-mgr: 2017-07-11 13:51:22.886531 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:24.890030 I | ceph-mgr: 2017-07-11 13:51:24.889986 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:24.890123 I | ceph-mgr: 2017-07-11 13:51:24.890108 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:24.890814 I | ceph-mgr: 2017-07-11 13:51:24.890777 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:26.909707 I | ceph-mgr: 2017-07-11 13:51:26.909645 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:26.909800 I | ceph-mgr: 2017-07-11 13:51:26.909785 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:26.910282 I | ceph-mgr: 2017-07-11 13:51:26.910265 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:28.913695 I | ceph-mgr: 2017-07-11 13:51:28.913646 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:28.913788 I | ceph-mgr: 2017-07-11 13:51:28.913773 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:28.914084 I | ceph-mgr: 2017-07-11 13:51:28.914066 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:31.036085 I | ceph-mgr: 2017-07-11 13:51:31.035999 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:31.036296 I | ceph-mgr: 2017-07-11 13:51:31.036200 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:31.036748 I | ceph-mgr: 2017-07-11 13:51:31.036731 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:33.039479 I | ceph-mgr: 2017-07-11 13:51:33.039381 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:33.039565 I | ceph-mgr: 2017-07-11 13:51:33.039548 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:33.039816 I | ceph-mgr: 2017-07-11 13:51:33.039800 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:35.052066 I | ceph-mgr: 2017-07-11 13:51:35.050580 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:35.052228 I | ceph-mgr: 2017-07-11 13:51:35.050597 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:35.052267 I | ceph-mgr: 2017-07-11 13:51:35.050655 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:37.054624 I | ceph-mgr: 2017-07-11 13:51:37.054576 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:37.072254 I | ceph-mgr: 2017-07-11 13:51:37.070437 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:37.072541 I | ceph-mgr: 2017-07-11 13:51:37.070732 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:39.143378 I | ceph-mgr: 2017-07-11 13:51:39.073261 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:39.143394 I | ceph-mgr: 2017-07-11 13:51:39.073274 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:39.143399 I | ceph-mgr: 2017-07-11 13:51:39.073305 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:41.170643 I | ceph-mgr: 2017-07-11 13:51:41.144923 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:41.170916 I | ceph-mgr: 2017-07-11 13:51:41.170770 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:41.171155 I | ceph-mgr: 2017-07-11 13:51:41.171131 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:43.181852 I | ceph-mgr: 2017-07-11 13:51:43.180485 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:43.181916 I | ceph-mgr: 2017-07-11 13:51:43.180492 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:43.181932 I | ceph-mgr: 2017-07-11 13:51:43.180518 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:45.189004 I | ceph-mgr: 2017-07-11 13:51:45.188919 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:45.189088 I | ceph-mgr: 2017-07-11 13:51:45.189062 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:45.189341 I | ceph-mgr: 2017-07-11 13:51:45.189325 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:47.220408 I | ceph-mgr: 2017-07-11 13:51:47.210111 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:47.221123 I | ceph-mgr: 2017-07-11 13:51:47.210122 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:47.221154 I | ceph-mgr: 2017-07-11 13:51:47.210161 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:49.222214 I | ceph-mgr: 2017-07-11 13:51:49.212285 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:49.222316 I | ceph-mgr: 2017-07-11 13:51:49.222298 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:49.224964 I | ceph-mgr: 2017-07-11 13:51:49.224947 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:51.265989 I | ceph-mgr: 2017-07-11 13:51:51.265961 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:51.266065 I | ceph-mgr: 2017-07-11 13:51:51.266051 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:51.266286 I | ceph-mgr: 2017-07-11 13:51:51.266270 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:53.287710 I | ceph-mgr: 2017-07-11 13:51:53.287078 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:53.287782 I | ceph-mgr: 2017-07-11 13:51:53.287084 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:53.287798 I | ceph-mgr: 2017-07-11 13:51:53.287110 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:55.289065 I | ceph-mgr: 2017-07-11 13:51:55.289015 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:55.289143 I | ceph-mgr: 2017-07-11 13:51:55.289128 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:55.289219 I | ceph-mgr: 2017-07-11 13:51:55.289209 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:57.291676 I | ceph-mgr: 2017-07-11 13:51:57.291619 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:57.291788 I | ceph-mgr: 2017-07-11 13:51:57.291760 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:57.293431 I | ceph-mgr: 2017-07-11 13:51:57.293419 7f4cc3226700 0 mgr tick
- 2017-07-11 13:51:59.301805 I | ceph-mgr: 2017-07-11 13:51:59.301760 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:51:59.301878 I | ceph-mgr: 2017-07-11 13:51:59.301864 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:51:59.302151 I | ceph-mgr: 2017-07-11 13:51:59.302135 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:01.306285 I | ceph-mgr: 2017-07-11 13:52:01.306253 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:01.306366 I | ceph-mgr: 2017-07-11 13:52:01.306351 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:01.306585 I | ceph-mgr: 2017-07-11 13:52:01.306469 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:03.309358 I | ceph-mgr: 2017-07-11 13:52:03.309317 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:03.309442 I | ceph-mgr: 2017-07-11 13:52:03.309426 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:03.309683 I | ceph-mgr: 2017-07-11 13:52:03.309666 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:05.327441 I | ceph-mgr: 2017-07-11 13:52:05.327396 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:05.327521 I | ceph-mgr: 2017-07-11 13:52:05.327506 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:05.327775 I | ceph-mgr: 2017-07-11 13:52:05.327760 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:07.347604 I | ceph-mgr: 2017-07-11 13:52:07.347575 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:07.347681 I | ceph-mgr: 2017-07-11 13:52:07.347667 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:07.347897 I | ceph-mgr: 2017-07-11 13:52:07.347781 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:09.371825 I | ceph-mgr: 2017-07-11 13:52:09.371785 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:09.371904 I | ceph-mgr: 2017-07-11 13:52:09.371890 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:09.372127 I | ceph-mgr: 2017-07-11 13:52:09.372113 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:11.378748 I | ceph-mgr: 2017-07-11 13:52:11.378316 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:11.378830 I | ceph-mgr: 2017-07-11 13:52:11.378813 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:11.378999 I | ceph-mgr: 2017-07-11 13:52:11.378983 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:13.389163 I | ceph-mgr: 2017-07-11 13:52:13.389122 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:13.389249 I | ceph-mgr: 2017-07-11 13:52:13.389235 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:13.389521 I | ceph-mgr: 2017-07-11 13:52:13.389504 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:15.392279 I | ceph-mgr: 2017-07-11 13:52:15.392233 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:15.392358 I | ceph-mgr: 2017-07-11 13:52:15.392344 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:15.392604 I | ceph-mgr: 2017-07-11 13:52:15.392585 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:17.402670 I | ceph-mgr: 2017-07-11 13:52:17.402633 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:17.402759 I | ceph-mgr: 2017-07-11 13:52:17.402744 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:17.402986 I | ceph-mgr: 2017-07-11 13:52:17.402970 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:19.406442 I | ceph-mgr: 2017-07-11 13:52:19.406413 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:19.408727 I | ceph-mgr: 2017-07-11 13:52:19.408701 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:19.408959 I | ceph-mgr: 2017-07-11 13:52:19.408944 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:21.430733 I | ceph-mgr: 2017-07-11 13:52:21.430675 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:21.432027 I | ceph-mgr: 2017-07-11 13:52:21.432012 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:21.432360 I | ceph-mgr: 2017-07-11 13:52:21.432343 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:23.436039 I | ceph-mgr: 2017-07-11 13:52:23.436005 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:23.436117 I | ceph-mgr: 2017-07-11 13:52:23.436101 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:23.436292 I | ceph-mgr: 2017-07-11 13:52:23.436218 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:25.444384 I | ceph-mgr: 2017-07-11 13:52:25.444321 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:25.444621 I | ceph-mgr: 2017-07-11 13:52:25.444605 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:25.444902 I | ceph-mgr: 2017-07-11 13:52:25.444886 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:27.466604 I | ceph-mgr: 2017-07-11 13:52:27.449898 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:27.466794 I | ceph-mgr: 2017-07-11 13:52:27.449907 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:27.467011 I | ceph-mgr: 2017-07-11 13:52:27.449933 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:29.471776 I | ceph-mgr: 2017-07-11 13:52:29.471700 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:29.471858 I | ceph-mgr: 2017-07-11 13:52:29.471843 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:29.472107 I | ceph-mgr: 2017-07-11 13:52:29.472091 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:31.476632 I | ceph-mgr: 2017-07-11 13:52:31.476597 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:31.476710 I | ceph-mgr: 2017-07-11 13:52:31.476696 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:31.476935 I | ceph-mgr: 2017-07-11 13:52:31.476919 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:33.497204 I | ceph-mgr: 2017-07-11 13:52:33.497154 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:33.497290 I | ceph-mgr: 2017-07-11 13:52:33.497275 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:33.497528 I | ceph-mgr: 2017-07-11 13:52:33.497513 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:35.504236 I | ceph-mgr: 2017-07-11 13:52:35.504191 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:35.504334 I | ceph-mgr: 2017-07-11 13:52:35.504319 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:35.504577 I | ceph-mgr: 2017-07-11 13:52:35.504561 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:37.512562 I | ceph-mgr: 2017-07-11 13:52:37.512195 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:37.512650 I | ceph-mgr: 2017-07-11 13:52:37.512633 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:37.512880 I | ceph-mgr: 2017-07-11 13:52:37.512864 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:39.516237 I | ceph-mgr: 2017-07-11 13:52:39.516191 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:39.516323 I | ceph-mgr: 2017-07-11 13:52:39.516308 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:39.516582 I | ceph-mgr: 2017-07-11 13:52:39.516566 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:41.539279 I | ceph-mgr: 2017-07-11 13:52:41.539233 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:41.539319 I | ceph-mgr: 2017-07-11 13:52:41.539306 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:41.539469 I | ceph-mgr: 2017-07-11 13:52:41.539440 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:43.576752 I | ceph-mgr: 2017-07-11 13:52:43.576706 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:43.576967 I | ceph-mgr: 2017-07-11 13:52:43.576923 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:43.583512 I | ceph-mgr: 2017-07-11 13:52:43.583493 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:45.593511 I | ceph-mgr: 2017-07-11 13:52:45.593444 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:45.593722 I | ceph-mgr: 2017-07-11 13:52:45.593615 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:45.594147 I | ceph-mgr: 2017-07-11 13:52:45.594130 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:47.596361 I | ceph-mgr: 2017-07-11 13:52:47.596316 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:47.596448 I | ceph-mgr: 2017-07-11 13:52:47.596434 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:47.596689 I | ceph-mgr: 2017-07-11 13:52:47.596673 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:49.615232 I | ceph-mgr: 2017-07-11 13:52:49.614493 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:49.615322 I | ceph-mgr: 2017-07-11 13:52:49.615307 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:49.615545 I | ceph-mgr: 2017-07-11 13:52:49.615530 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:51.619546 I | ceph-mgr: 2017-07-11 13:52:51.618930 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:51.619668 I | ceph-mgr: 2017-07-11 13:52:51.619651 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:51.619914 I | ceph-mgr: 2017-07-11 13:52:51.619898 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:53.636258 I | ceph-mgr: 2017-07-11 13:52:53.636188 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:53.636350 I | ceph-mgr: 2017-07-11 13:52:53.636328 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:53.636602 I | ceph-mgr: 2017-07-11 13:52:53.636587 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:55.648694 I | ceph-mgr: 2017-07-11 13:52:55.648647 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:55.648782 I | ceph-mgr: 2017-07-11 13:52:55.648769 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:55.649032 I | ceph-mgr: 2017-07-11 13:52:55.649017 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:57.674332 I | ceph-mgr: 2017-07-11 13:52:57.672774 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:57.674780 I | ceph-mgr: 2017-07-11 13:52:57.672787 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:57.674811 I | ceph-mgr: 2017-07-11 13:52:57.672823 7f4cc3226700 0 mgr tick
- 2017-07-11 13:52:59.680057 I | ceph-mgr: 2017-07-11 13:52:59.679995 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:52:59.680309 I | ceph-mgr: 2017-07-11 13:52:59.680164 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:52:59.680545 I | ceph-mgr: 2017-07-11 13:52:59.680529 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:01.685683 I | ceph-mgr: 2017-07-11 13:53:01.685638 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:01.685765 I | ceph-mgr: 2017-07-11 13:53:01.685750 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:01.686008 I | ceph-mgr: 2017-07-11 13:53:01.685991 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:03.736115 I | ceph-mgr: 2017-07-11 13:53:03.736050 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:03.736313 I | ceph-mgr: 2017-07-11 13:53:03.736226 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:03.736553 I | ceph-mgr: 2017-07-11 13:53:03.736538 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:05.738811 I | ceph-mgr: 2017-07-11 13:53:05.738738 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:05.741965 I | ceph-mgr: 2017-07-11 13:53:05.741949 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:05.742366 I | ceph-mgr: 2017-07-11 13:53:05.742350 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:07.762007 I | ceph-mgr: 2017-07-11 13:53:07.761957 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:07.762100 I | ceph-mgr: 2017-07-11 13:53:07.762084 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:07.762378 I | ceph-mgr: 2017-07-11 13:53:07.762361 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:09.781997 I | ceph-mgr: 2017-07-11 13:53:09.781949 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:09.782084 I | ceph-mgr: 2017-07-11 13:53:09.782070 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:09.788140 I | ceph-mgr: 2017-07-11 13:53:09.788096 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:11.796068 I | ceph-mgr: 2017-07-11 13:53:11.795990 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:11.796170 I | ceph-mgr: 2017-07-11 13:53:11.796154 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:11.796440 I | ceph-mgr: 2017-07-11 13:53:11.796423 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:13.801634 I | ceph-mgr: 2017-07-11 13:53:13.800873 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:13.801705 I | ceph-mgr: 2017-07-11 13:53:13.800891 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:13.801722 I | ceph-mgr: 2017-07-11 13:53:13.800939 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:15.805119 I | ceph-mgr: 2017-07-11 13:53:15.805077 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:15.805296 I | ceph-mgr: 2017-07-11 13:53:15.805280 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:15.806104 I | ceph-mgr: 2017-07-11 13:53:15.806087 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:17.817141 I | ceph-mgr: 2017-07-11 13:53:17.817099 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:17.817219 I | ceph-mgr: 2017-07-11 13:53:17.817205 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:17.817454 I | ceph-mgr: 2017-07-11 13:53:17.817438 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:19.826188 I | ceph-mgr: 2017-07-11 13:53:19.826120 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:19.826453 I | ceph-mgr: 2017-07-11 13:53:19.826301 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:19.826936 I | ceph-mgr: 2017-07-11 13:53:19.826919 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:21.833090 I | ceph-mgr: 2017-07-11 13:53:21.833043 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:21.833586 I | ceph-mgr: 2017-07-11 13:53:21.833357 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:21.835005 I | ceph-mgr: 2017-07-11 13:53:21.833755 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:23.841332 I | ceph-mgr: 2017-07-11 13:53:23.841212 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:23.841375 I | ceph-mgr: 2017-07-11 13:53:23.841361 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:23.841505 I | ceph-mgr: 2017-07-11 13:53:23.841490 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:25.859128 I | ceph-mgr: 2017-07-11 13:53:25.859084 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:25.859389 I | ceph-mgr: 2017-07-11 13:53:25.859363 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:25.859629 I | ceph-mgr: 2017-07-11 13:53:25.859613 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:27.872217 I | ceph-mgr: 2017-07-11 13:53:27.872164 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:27.872306 I | ceph-mgr: 2017-07-11 13:53:27.872290 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:27.872660 I | ceph-mgr: 2017-07-11 13:53:27.872632 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:29.879982 I | ceph-mgr: 2017-07-11 13:53:29.879927 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:29.880083 I | ceph-mgr: 2017-07-11 13:53:29.880067 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:29.880301 I | ceph-mgr: 2017-07-11 13:53:29.880285 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:31.887895 I | ceph-mgr: 2017-07-11 13:53:31.887854 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:31.887980 I | ceph-mgr: 2017-07-11 13:53:31.887965 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:31.888316 I | ceph-mgr: 2017-07-11 13:53:31.888297 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:33.890581 I | ceph-mgr: 2017-07-11 13:53:33.890545 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:33.890647 I | ceph-mgr: 2017-07-11 13:53:33.890633 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:33.890818 I | ceph-mgr: 2017-07-11 13:53:33.890754 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:35.907724 I | ceph-mgr: 2017-07-11 13:53:35.907654 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:35.907811 I | ceph-mgr: 2017-07-11 13:53:35.907796 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:35.908050 I | ceph-mgr: 2017-07-11 13:53:35.908034 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:37.916109 I | ceph-mgr: 2017-07-11 13:53:37.916069 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:37.916201 I | ceph-mgr: 2017-07-11 13:53:37.916186 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:37.916462 I | ceph-mgr: 2017-07-11 13:53:37.916435 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:39.926064 I | ceph-mgr: 2017-07-11 13:53:39.926012 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:39.933558 I | ceph-mgr: 2017-07-11 13:53:39.933515 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:39.943426 I | ceph-mgr: 2017-07-11 13:53:39.943401 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:41.962067 I | ceph-mgr: 2017-07-11 13:53:41.962021 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:41.962143 I | ceph-mgr: 2017-07-11 13:53:41.962127 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:41.962376 I | ceph-mgr: 2017-07-11 13:53:41.962360 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:43.966923 I | ceph-mgr: 2017-07-11 13:53:43.966875 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:43.967001 I | ceph-mgr: 2017-07-11 13:53:43.966986 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:43.967291 I | ceph-mgr: 2017-07-11 13:53:43.967251 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:45.988914 I | ceph-mgr: 2017-07-11 13:53:45.988874 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:45.988987 I | ceph-mgr: 2017-07-11 13:53:45.988973 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:45.989229 I | ceph-mgr: 2017-07-11 13:53:45.989212 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:47.995182 I | ceph-mgr: 2017-07-11 13:53:47.993704 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:47.995393 I | ceph-mgr: 2017-07-11 13:53:47.993721 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:47.995422 I | ceph-mgr: 2017-07-11 13:53:47.993767 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:49.996636 I | ceph-mgr: 2017-07-11 13:53:49.996595 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:49.996808 I | ceph-mgr: 2017-07-11 13:53:49.996792 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:49.998354 I | ceph-mgr: 2017-07-11 13:53:49.998339 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:52.002102 I | ceph-mgr: 2017-07-11 13:53:52.002031 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:52.002328 I | ceph-mgr: 2017-07-11 13:53:52.002211 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:52.002582 I | ceph-mgr: 2017-07-11 13:53:52.002566 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:54.011480 I | ceph-mgr: 2017-07-11 13:53:54.008529 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:54.011544 I | ceph-mgr: 2017-07-11 13:53:54.008542 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:54.011563 I | ceph-mgr: 2017-07-11 13:53:54.008573 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:56.016709 I | ceph-mgr: 2017-07-11 13:53:56.016664 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:56.016780 I | ceph-mgr: 2017-07-11 13:53:56.016766 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:56.017019 I | ceph-mgr: 2017-07-11 13:53:56.017003 7f4cc3226700 0 mgr tick
- 2017-07-11 13:53:58.040490 I | ceph-mgr: 2017-07-11 13:53:58.040448 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:53:58.040566 I | ceph-mgr: 2017-07-11 13:53:58.040552 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:53:58.040876 I | ceph-mgr: 2017-07-11 13:53:58.040855 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:00.048450 I | ceph-mgr: 2017-07-11 13:54:00.045572 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:00.055595 I | ceph-mgr: 2017-07-11 13:54:00.045588 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:00.055631 I | ceph-mgr: 2017-07-11 13:54:00.045633 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:02.051830 I | ceph-mgr: 2017-07-11 13:54:02.051753 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:02.052354 I | ceph-mgr: 2017-07-11 13:54:02.052327 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:02.052597 I | ceph-mgr: 2017-07-11 13:54:02.052582 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:04.059229 I | ceph-mgr: 2017-07-11 13:54:04.059185 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:04.059316 I | ceph-mgr: 2017-07-11 13:54:04.059300 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:04.059554 I | ceph-mgr: 2017-07-11 13:54:04.059538 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:06.071274 I | ceph-mgr: 2017-07-11 13:54:06.071187 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:06.071359 I | ceph-mgr: 2017-07-11 13:54:06.071342 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:06.071630 I | ceph-mgr: 2017-07-11 13:54:06.071614 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:08.098741 I | ceph-mgr: 2017-07-11 13:54:08.097329 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:08.098800 I | ceph-mgr: 2017-07-11 13:54:08.097341 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:08.098817 I | ceph-mgr: 2017-07-11 13:54:08.097370 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:10.098759 I | ceph-mgr: 2017-07-11 13:54:10.098710 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:10.098846 I | ceph-mgr: 2017-07-11 13:54:10.098832 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:10.098921 I | ceph-mgr: 2017-07-11 13:54:10.098911 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:12.115961 I | ceph-mgr: 2017-07-11 13:54:12.115914 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:12.116041 I | ceph-mgr: 2017-07-11 13:54:12.116027 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:12.118559 I | ceph-mgr: 2017-07-11 13:54:12.118543 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:14.138321 I | ceph-mgr: 2017-07-11 13:54:14.136925 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:14.138402 I | ceph-mgr: 2017-07-11 13:54:14.136939 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:14.138420 I | ceph-mgr: 2017-07-11 13:54:14.136970 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:16.143755 I | ceph-mgr: 2017-07-11 13:54:16.141326 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:16.145328 I | ceph-mgr: 2017-07-11 13:54:16.145297 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:16.161442 I | ceph-mgr: 2017-07-11 13:54:16.161410 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:18.170802 I | ceph-mgr: 2017-07-11 13:54:18.169326 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:18.170886 I | ceph-mgr: 2017-07-11 13:54:18.169340 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:18.170904 I | ceph-mgr: 2017-07-11 13:54:18.169371 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:20.170906 I | ceph-mgr: 2017-07-11 13:54:20.170857 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:20.170995 I | ceph-mgr: 2017-07-11 13:54:20.170981 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:20.171211 I | ceph-mgr: 2017-07-11 13:54:20.171200 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:22.182898 I | ceph-mgr: 2017-07-11 13:54:22.182863 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:22.182990 I | ceph-mgr: 2017-07-11 13:54:22.182973 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:22.183061 I | ceph-mgr: 2017-07-11 13:54:22.183051 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:24.198004 I | ceph-mgr: 2017-07-11 13:54:24.197967 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:24.198096 I | ceph-mgr: 2017-07-11 13:54:24.198081 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:24.198328 I | ceph-mgr: 2017-07-11 13:54:24.198160 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:26.208268 I | ceph-mgr: 2017-07-11 13:54:26.208224 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:26.208336 I | ceph-mgr: 2017-07-11 13:54:26.208322 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:26.208574 I | ceph-mgr: 2017-07-11 13:54:26.208560 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:28.230989 I | ceph-mgr: 2017-07-11 13:54:28.229590 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:28.232305 I | ceph-mgr: 2017-07-11 13:54:28.229604 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:28.232351 I | ceph-mgr: 2017-07-11 13:54:28.229633 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:30.237915 I | ceph-mgr: 2017-07-11 13:54:30.236531 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:30.239476 I | ceph-mgr: 2017-07-11 13:54:30.236543 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:30.239509 I | ceph-mgr: 2017-07-11 13:54:30.236572 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:32.243484 I | ceph-mgr: 2017-07-11 13:54:32.242184 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:32.243539 I | ceph-mgr: 2017-07-11 13:54:32.242196 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:32.243740 I | ceph-mgr: 2017-07-11 13:54:32.242236 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:34.244509 I | ceph-mgr: 2017-07-11 13:54:34.244450 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:34.244654 I | ceph-mgr: 2017-07-11 13:54:34.244622 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:34.245165 I | ceph-mgr: 2017-07-11 13:54:34.245147 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:36.249284 I | ceph-mgr: 2017-07-11 13:54:36.249248 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:36.249369 I | ceph-mgr: 2017-07-11 13:54:36.249355 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:36.251208 I | ceph-mgr: 2017-07-11 13:54:36.251192 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:38.257198 I | ceph-mgr: 2017-07-11 13:54:38.257135 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:38.257366 I | ceph-mgr: 2017-07-11 13:54:38.257349 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:38.257705 I | ceph-mgr: 2017-07-11 13:54:38.257684 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:40.266096 I | ceph-mgr: 2017-07-11 13:54:40.266043 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:40.267716 I | ceph-mgr: 2017-07-11 13:54:40.267698 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:40.268107 I | ceph-mgr: 2017-07-11 13:54:40.268090 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:42.274023 I | ceph-mgr: 2017-07-11 13:54:42.273970 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:42.274113 I | ceph-mgr: 2017-07-11 13:54:42.274098 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:42.274287 I | ceph-mgr: 2017-07-11 13:54:42.274271 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:44.283912 I | ceph-mgr: 2017-07-11 13:54:44.283863 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:44.284006 I | ceph-mgr: 2017-07-11 13:54:44.283991 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:44.284257 I | ceph-mgr: 2017-07-11 13:54:44.284240 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:46.292282 I | ceph-mgr: 2017-07-11 13:54:46.292171 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:46.292557 I | ceph-mgr: 2017-07-11 13:54:46.292410 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:46.292794 I | ceph-mgr: 2017-07-11 13:54:46.292778 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:48.295146 I | ceph-mgr: 2017-07-11 13:54:48.295083 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:48.295233 I | ceph-mgr: 2017-07-11 13:54:48.295218 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:48.295472 I | ceph-mgr: 2017-07-11 13:54:48.295456 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:50.304770 I | ceph-mgr: 2017-07-11 13:54:50.304723 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:50.310656 I | ceph-mgr: 2017-07-11 13:54:50.310636 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:50.310824 I | ceph-mgr: 2017-07-11 13:54:50.310809 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:52.313488 I | ceph-mgr: 2017-07-11 13:54:52.313424 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:52.313830 I | ceph-mgr: 2017-07-11 13:54:52.313814 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:52.314933 I | ceph-mgr: 2017-07-11 13:54:52.314677 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:54.321165 I | ceph-mgr: 2017-07-11 13:54:54.321120 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:54.321246 I | ceph-mgr: 2017-07-11 13:54:54.321232 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:54.321496 I | ceph-mgr: 2017-07-11 13:54:54.321480 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:56.338449 I | ceph-mgr: 2017-07-11 13:54:56.338411 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:56.338524 I | ceph-mgr: 2017-07-11 13:54:56.338510 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:56.338975 I | ceph-mgr: 2017-07-11 13:54:56.338956 7f4cc3226700 0 mgr tick
- 2017-07-11 13:54:58.342691 I | ceph-mgr: 2017-07-11 13:54:58.342648 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:54:58.342766 I | ceph-mgr: 2017-07-11 13:54:58.342751 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:54:58.343002 I | ceph-mgr: 2017-07-11 13:54:58.342986 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:00.344806 I | ceph-mgr: 2017-07-11 13:55:00.344757 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:00.344892 I | ceph-mgr: 2017-07-11 13:55:00.344877 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:00.345129 I | ceph-mgr: 2017-07-11 13:55:00.345113 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:02.353418 I | ceph-mgr: 2017-07-11 13:55:02.353383 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:02.353495 I | ceph-mgr: 2017-07-11 13:55:02.353481 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:02.353731 I | ceph-mgr: 2017-07-11 13:55:02.353715 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:04.373906 I | ceph-mgr: 2017-07-11 13:55:04.373867 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:04.373992 I | ceph-mgr: 2017-07-11 13:55:04.373977 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:04.374350 I | ceph-mgr: 2017-07-11 13:55:04.374331 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:06.381869 I | ceph-mgr: 2017-07-11 13:55:06.381829 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:06.382054 I | ceph-mgr: 2017-07-11 13:55:06.382037 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:06.385086 I | ceph-mgr: 2017-07-11 13:55:06.385070 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:08.407659 I | ceph-mgr: 2017-07-11 13:55:08.407585 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:08.407783 I | ceph-mgr: 2017-07-11 13:55:08.407768 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:08.408090 I | ceph-mgr: 2017-07-11 13:55:08.408074 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:10.415985 I | ceph-mgr: 2017-07-11 13:55:10.415908 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:10.416092 I | ceph-mgr: 2017-07-11 13:55:10.416077 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:10.416319 I | ceph-mgr: 2017-07-11 13:55:10.416303 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:12.440361 I | ceph-mgr: 2017-07-11 13:55:12.418265 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:12.440570 I | ceph-mgr: 2017-07-11 13:55:12.418278 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:12.440596 I | ceph-mgr: 2017-07-11 13:55:12.418309 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:14.423368 I | ceph-mgr: 2017-07-11 13:55:14.423326 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:14.423550 I | ceph-mgr: 2017-07-11 13:55:14.423533 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:14.424475 I | ceph-mgr: 2017-07-11 13:55:14.424456 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:16.441655 I | ceph-mgr: 2017-07-11 13:55:16.439021 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:16.441736 I | ceph-mgr: 2017-07-11 13:55:16.441719 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:16.441910 I | ceph-mgr: 2017-07-11 13:55:16.441894 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:18.467507 I | ceph-mgr: 2017-07-11 13:55:18.461540 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:18.467550 I | ceph-mgr: 2017-07-11 13:55:18.467535 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:18.467721 I | ceph-mgr: 2017-07-11 13:55:18.467705 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:20.474545 I | ceph-mgr: 2017-07-11 13:55:20.474498 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:20.474625 I | ceph-mgr: 2017-07-11 13:55:20.474610 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:20.475024 I | ceph-mgr: 2017-07-11 13:55:20.475007 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:22.483645 I | ceph-mgr: 2017-07-11 13:55:22.483599 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:22.483720 I | ceph-mgr: 2017-07-11 13:55:22.483705 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:22.483972 I | ceph-mgr: 2017-07-11 13:55:22.483956 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:24.507334 I | ceph-mgr: 2017-07-11 13:55:24.507220 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:24.507428 I | ceph-mgr: 2017-07-11 13:55:24.507413 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:24.507687 I | ceph-mgr: 2017-07-11 13:55:24.507670 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:26.510303 I | ceph-mgr: 2017-07-11 13:55:26.510234 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:26.510420 I | ceph-mgr: 2017-07-11 13:55:26.510405 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:26.510905 I | ceph-mgr: 2017-07-11 13:55:26.510657 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:28.526275 I | ceph-mgr: 2017-07-11 13:55:28.526225 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:28.526380 I | ceph-mgr: 2017-07-11 13:55:28.526365 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:28.526637 I | ceph-mgr: 2017-07-11 13:55:28.526622 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:30.528978 I | ceph-mgr: 2017-07-11 13:55:30.528933 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:30.529141 I | ceph-mgr: 2017-07-11 13:55:30.529068 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:30.529600 I | ceph-mgr: 2017-07-11 13:55:30.529582 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:32.536961 I | ceph-mgr: 2017-07-11 13:55:32.536910 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:32.537042 I | ceph-mgr: 2017-07-11 13:55:32.537025 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:32.537268 I | ceph-mgr: 2017-07-11 13:55:32.537253 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:34.540080 I | ceph-mgr: 2017-07-11 13:55:34.540047 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:34.545898 I | ceph-mgr: 2017-07-11 13:55:34.545878 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:34.546045 I | ceph-mgr: 2017-07-11 13:55:34.546030 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:36.552543 I | ceph-mgr: 2017-07-11 13:55:36.552504 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:36.552623 I | ceph-mgr: 2017-07-11 13:55:36.552609 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:36.552863 I | ceph-mgr: 2017-07-11 13:55:36.552848 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:38.565570 I | ceph-mgr: 2017-07-11 13:55:38.555710 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:38.565673 I | ceph-mgr: 2017-07-11 13:55:38.565657 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:38.568888 I | ceph-mgr: 2017-07-11 13:55:38.568867 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:40.586008 I | ceph-mgr: 2017-07-11 13:55:40.585963 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:40.586114 I | ceph-mgr: 2017-07-11 13:55:40.586099 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:40.586428 I | ceph-mgr: 2017-07-11 13:55:40.586412 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:42.590896 I | ceph-mgr: 2017-07-11 13:55:42.590822 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:42.591003 I | ceph-mgr: 2017-07-11 13:55:42.590988 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:42.591544 I | ceph-mgr: 2017-07-11 13:55:42.591517 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:44.601334 I | ceph-mgr: 2017-07-11 13:55:44.601302 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:44.601410 I | ceph-mgr: 2017-07-11 13:55:44.601396 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:44.601704 I | ceph-mgr: 2017-07-11 13:55:44.601688 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:46.623003 I | ceph-mgr: 2017-07-11 13:55:46.622970 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:46.623078 I | ceph-mgr: 2017-07-11 13:55:46.623064 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:46.623529 I | ceph-mgr: 2017-07-11 13:55:46.623513 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:48.631024 I | ceph-mgr: 2017-07-11 13:55:48.630975 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:48.631119 I | ceph-mgr: 2017-07-11 13:55:48.631104 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:48.631622 I | ceph-mgr: 2017-07-11 13:55:48.631604 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:50.646493 I | ceph-mgr: 2017-07-11 13:55:50.646449 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:50.646602 I | ceph-mgr: 2017-07-11 13:55:50.646575 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:50.646827 I | ceph-mgr: 2017-07-11 13:55:50.646811 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:52.651313 I | ceph-mgr: 2017-07-11 13:55:52.651281 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:52.651403 I | ceph-mgr: 2017-07-11 13:55:52.651388 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:52.651622 I | ceph-mgr: 2017-07-11 13:55:52.651608 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:54.663338 I | ceph-mgr: 2017-07-11 13:55:54.663291 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:54.671035 I | ceph-mgr: 2017-07-11 13:55:54.670980 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:54.680984 I | ceph-mgr: 2017-07-11 13:55:54.680967 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:56.718633 I | ceph-mgr: 2017-07-11 13:55:56.718582 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:56.718722 I | ceph-mgr: 2017-07-11 13:55:56.718707 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:56.718951 I | ceph-mgr: 2017-07-11 13:55:56.718935 7f4cc3226700 0 mgr tick
- 2017-07-11 13:55:58.723969 I | ceph-mgr: 2017-07-11 13:55:58.723923 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:55:58.724227 I | ceph-mgr: 2017-07-11 13:55:58.724198 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:55:58.724745 I | ceph-mgr: 2017-07-11 13:55:58.724728 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:00.750076 I | ceph-mgr: 2017-07-11 13:56:00.750006 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:00.750332 I | ceph-mgr: 2017-07-11 13:56:00.750182 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:00.750763 I | ceph-mgr: 2017-07-11 13:56:00.750747 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:02.756684 I | ceph-mgr: 2017-07-11 13:56:02.756605 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:02.756893 I | ceph-mgr: 2017-07-11 13:56:02.756814 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:02.757296 I | ceph-mgr: 2017-07-11 13:56:02.757063 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:04.760946 I | ceph-mgr: 2017-07-11 13:56:04.760916 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:04.761015 I | ceph-mgr: 2017-07-11 13:56:04.761001 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:04.761238 I | ceph-mgr: 2017-07-11 13:56:04.761122 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:06.776759 I | ceph-mgr: 2017-07-11 13:56:06.776702 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:06.776835 I | ceph-mgr: 2017-07-11 13:56:06.776820 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:06.777051 I | ceph-mgr: 2017-07-11 13:56:06.777035 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:08.793127 I | ceph-mgr: 2017-07-11 13:56:08.785019 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:08.800945 I | ceph-mgr: 2017-07-11 13:56:08.785033 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:08.800996 I | ceph-mgr: 2017-07-11 13:56:08.785063 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:10.806538 I | ceph-mgr: 2017-07-11 13:56:10.806472 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:10.806633 I | ceph-mgr: 2017-07-11 13:56:10.806617 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:10.806899 I | ceph-mgr: 2017-07-11 13:56:10.806883 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:12.826536 I | ceph-mgr: 2017-07-11 13:56:12.826485 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:12.832690 I | ceph-mgr: 2017-07-11 13:56:12.832669 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:12.834573 I | ceph-mgr: 2017-07-11 13:56:12.834554 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:14.897184 I | ceph-mgr: 2017-07-11 13:56:14.897141 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:14.897271 I | ceph-mgr: 2017-07-11 13:56:14.897255 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:14.897543 I | ceph-mgr: 2017-07-11 13:56:14.897515 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:16.900011 I | ceph-mgr: 2017-07-11 13:56:16.899980 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:16.900086 I | ceph-mgr: 2017-07-11 13:56:16.900072 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:16.900302 I | ceph-mgr: 2017-07-11 13:56:16.900187 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:18.912236 I | ceph-mgr: 2017-07-11 13:56:18.912165 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:18.914622 I | ceph-mgr: 2017-07-11 13:56:18.914599 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:18.915081 I | ceph-mgr: 2017-07-11 13:56:18.914806 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:20.932636 I | ceph-mgr: 2017-07-11 13:56:20.932604 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:20.932708 I | ceph-mgr: 2017-07-11 13:56:20.932693 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:20.938764 I | ceph-mgr: 2017-07-11 13:56:20.938745 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:22.956366 I | ceph-mgr: 2017-07-11 13:56:22.956328 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:22.956448 I | ceph-mgr: 2017-07-11 13:56:22.956432 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:22.966371 I | ceph-mgr: 2017-07-11 13:56:22.966353 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:25.015952 I | ceph-mgr: 2017-07-11 13:56:25.015874 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:25.016171 I | ceph-mgr: 2017-07-11 13:56:25.016072 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:25.016369 I | ceph-mgr: 2017-07-11 13:56:25.016353 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:27.024511 I | ceph-mgr: 2017-07-11 13:56:27.024470 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:27.024587 I | ceph-mgr: 2017-07-11 13:56:27.024572 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:27.024835 I | ceph-mgr: 2017-07-11 13:56:27.024819 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:29.033169 I | ceph-mgr: 2017-07-11 13:56:29.033100 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:29.033259 I | ceph-mgr: 2017-07-11 13:56:29.033243 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:29.033739 I | ceph-mgr: 2017-07-11 13:56:29.033722 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:31.037780 I | ceph-mgr: 2017-07-11 13:56:31.037730 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:31.037856 I | ceph-mgr: 2017-07-11 13:56:31.037839 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:31.038100 I | ceph-mgr: 2017-07-11 13:56:31.038083 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:33.055523 I | ceph-mgr: 2017-07-11 13:56:33.053291 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:33.062794 I | ceph-mgr: 2017-07-11 13:56:33.062774 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:33.072453 I | ceph-mgr: 2017-07-11 13:56:33.063533 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:35.155752 I | ceph-mgr: 2017-07-11 13:56:35.155709 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:35.155824 I | ceph-mgr: 2017-07-11 13:56:35.155810 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:35.156069 I | ceph-mgr: 2017-07-11 13:56:35.156052 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:37.167728 I | ceph-mgr: 2017-07-11 13:56:37.165886 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:37.167817 I | ceph-mgr: 2017-07-11 13:56:37.167802 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:37.168252 I | ceph-mgr: 2017-07-11 13:56:37.168236 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:39.189198 I | ceph-mgr: 2017-07-11 13:56:39.171722 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:39.189417 I | ceph-mgr: 2017-07-11 13:56:39.187414 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:39.189513 I | ceph-mgr: 2017-07-11 13:56:39.187559 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:41.192816 I | ceph-mgr: 2017-07-11 13:56:41.191159 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:41.193040 I | ceph-mgr: 2017-07-11 13:56:41.191171 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:41.193138 I | ceph-mgr: 2017-07-11 13:56:41.191263 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:43.201667 I | ceph-mgr: 2017-07-11 13:56:43.200013 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:43.201740 I | ceph-mgr: 2017-07-11 13:56:43.200024 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:43.201760 I | ceph-mgr: 2017-07-11 13:56:43.200143 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:45.205424 I | ceph-mgr: 2017-07-11 13:56:45.205360 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:45.205503 I | ceph-mgr: 2017-07-11 13:56:45.205491 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:45.205737 I | ceph-mgr: 2017-07-11 13:56:45.205723 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:47.208499 I | ceph-mgr: 2017-07-11 13:56:47.208457 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:47.208587 I | ceph-mgr: 2017-07-11 13:56:47.208571 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:47.208830 I | ceph-mgr: 2017-07-11 13:56:47.208814 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:49.220914 I | ceph-mgr: 2017-07-11 13:56:49.220866 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:49.220999 I | ceph-mgr: 2017-07-11 13:56:49.220984 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:49.221484 I | ceph-mgr: 2017-07-11 13:56:49.221466 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:51.226341 I | ceph-mgr: 2017-07-11 13:56:51.226294 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:51.226428 I | ceph-mgr: 2017-07-11 13:56:51.226413 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:51.226673 I | ceph-mgr: 2017-07-11 13:56:51.226657 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:53.228733 I | ceph-mgr: 2017-07-11 13:56:53.228705 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:53.228806 I | ceph-mgr: 2017-07-11 13:56:53.228792 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:53.229021 I | ceph-mgr: 2017-07-11 13:56:53.228901 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:55.242203 I | ceph-mgr: 2017-07-11 13:56:55.242008 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:55.242297 I | ceph-mgr: 2017-07-11 13:56:55.242280 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:55.242562 I | ceph-mgr: 2017-07-11 13:56:55.242547 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:57.277075 I | ceph-mgr: 2017-07-11 13:56:57.268558 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:57.277269 I | ceph-mgr: 2017-07-11 13:56:57.268572 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:57.277400 I | ceph-mgr: 2017-07-11 13:56:57.268602 7f4cc3226700 0 mgr tick
- 2017-07-11 13:56:59.287486 I | ceph-mgr: 2017-07-11 13:56:59.287408 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:56:59.287759 I | ceph-mgr: 2017-07-11 13:56:59.287742 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:56:59.287841 I | ceph-mgr: 2017-07-11 13:56:59.287830 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:01.292733 I | ceph-mgr: 2017-07-11 13:57:01.292699 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:01.292814 I | ceph-mgr: 2017-07-11 13:57:01.292800 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:01.292887 I | ceph-mgr: 2017-07-11 13:57:01.292877 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:03.296749 I | ceph-mgr: 2017-07-11 13:57:03.296696 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:03.296834 I | ceph-mgr: 2017-07-11 13:57:03.296818 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:03.297073 I | ceph-mgr: 2017-07-11 13:57:03.297044 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:05.305341 I | ceph-mgr: 2017-07-11 13:57:05.305262 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:05.305627 I | ceph-mgr: 2017-07-11 13:57:05.305462 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:05.305900 I | ceph-mgr: 2017-07-11 13:57:05.305883 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:07.309261 I | ceph-mgr: 2017-07-11 13:57:07.309228 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:07.309445 I | ceph-mgr: 2017-07-11 13:57:07.309428 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:07.312289 I | ceph-mgr: 2017-07-11 13:57:07.312272 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:09.331299 I | ceph-mgr: 2017-07-11 13:57:09.331252 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:09.331377 I | ceph-mgr: 2017-07-11 13:57:09.331362 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:09.331641 I | ceph-mgr: 2017-07-11 13:57:09.331625 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:11.341260 I | ceph-mgr: 2017-07-11 13:57:11.341197 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:11.341452 I | ceph-mgr: 2017-07-11 13:57:11.341371 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:11.341698 I | ceph-mgr: 2017-07-11 13:57:11.341671 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:13.350112 I | ceph-mgr: 2017-07-11 13:57:13.350077 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:13.350209 I | ceph-mgr: 2017-07-11 13:57:13.350194 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:13.350422 I | ceph-mgr: 2017-07-11 13:57:13.350407 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:15.357583 I | ceph-mgr: 2017-07-11 13:57:15.357535 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:15.357820 I | ceph-mgr: 2017-07-11 13:57:15.357802 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:15.359782 I | ceph-mgr: 2017-07-11 13:57:15.359765 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:17.393503 I | ceph-mgr: 2017-07-11 13:57:17.377522 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:17.393564 I | ceph-mgr: 2017-07-11 13:57:17.377527 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:17.393580 I | ceph-mgr: 2017-07-11 13:57:17.377548 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:19.397796 I | ceph-mgr: 2017-07-11 13:57:19.397729 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:19.397887 I | ceph-mgr: 2017-07-11 13:57:19.397872 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:19.398147 I | ceph-mgr: 2017-07-11 13:57:19.398121 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:21.406810 I | ceph-mgr: 2017-07-11 13:57:21.406365 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:21.406867 I | ceph-mgr: 2017-07-11 13:57:21.406370 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:21.406900 I | ceph-mgr: 2017-07-11 13:57:21.406392 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:23.426528 I | ceph-mgr: 2017-07-11 13:57:23.426497 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:23.426606 I | ceph-mgr: 2017-07-11 13:57:23.426592 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:23.426981 I | ceph-mgr: 2017-07-11 13:57:23.426703 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:25.452449 I | ceph-mgr: 2017-07-11 13:57:25.452314 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:25.452536 I | ceph-mgr: 2017-07-11 13:57:25.452521 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:25.453008 I | ceph-mgr: 2017-07-11 13:57:25.452990 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:27.458832 I | ceph-mgr: 2017-07-11 13:57:27.458755 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:27.460661 I | ceph-mgr: 2017-07-11 13:57:27.460644 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:27.461099 I | ceph-mgr: 2017-07-11 13:57:27.461082 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:29.463144 I | ceph-mgr: 2017-07-11 13:57:29.463113 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:29.463215 I | ceph-mgr: 2017-07-11 13:57:29.463201 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:29.463392 I | ceph-mgr: 2017-07-11 13:57:29.463377 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:31.499067 I | ceph-mgr: 2017-07-11 13:57:31.482333 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:31.499479 I | ceph-mgr: 2017-07-11 13:57:31.482339 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:31.499517 I | ceph-mgr: 2017-07-11 13:57:31.482359 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:33.506362 I | ceph-mgr: 2017-07-11 13:57:33.506330 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:33.506431 I | ceph-mgr: 2017-07-11 13:57:33.506417 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:33.506657 I | ceph-mgr: 2017-07-11 13:57:33.506540 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:35.528132 I | ceph-mgr: 2017-07-11 13:57:35.528084 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:35.528318 I | ceph-mgr: 2017-07-11 13:57:35.528302 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:35.528575 I | ceph-mgr: 2017-07-11 13:57:35.528560 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:37.542568 I | ceph-mgr: 2017-07-11 13:57:37.542519 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:37.542797 I | ceph-mgr: 2017-07-11 13:57:37.542780 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:37.543030 I | ceph-mgr: 2017-07-11 13:57:37.543001 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:39.563377 I | ceph-mgr: 2017-07-11 13:57:39.562963 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:39.563451 I | ceph-mgr: 2017-07-11 13:57:39.562975 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:39.563746 I | ceph-mgr: 2017-07-11 13:57:39.563492 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:41.576729 I | ceph-mgr: 2017-07-11 13:57:41.576677 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:41.576987 I | ceph-mgr: 2017-07-11 13:57:41.576968 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:41.577460 I | ceph-mgr: 2017-07-11 13:57:41.577433 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:43.596472 I | ceph-mgr: 2017-07-11 13:57:43.596395 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:43.596562 I | ceph-mgr: 2017-07-11 13:57:43.596544 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:43.596816 I | ceph-mgr: 2017-07-11 13:57:43.596799 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:45.599775 I | ceph-mgr: 2017-07-11 13:57:45.599704 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:45.600017 I | ceph-mgr: 2017-07-11 13:57:45.600001 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:45.600272 I | ceph-mgr: 2017-07-11 13:57:45.600258 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:47.609015 I | ceph-mgr: 2017-07-11 13:57:47.608514 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:47.609168 I | ceph-mgr: 2017-07-11 13:57:47.608520 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:47.609223 I | ceph-mgr: 2017-07-11 13:57:47.608540 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:49.612377 I | ceph-mgr: 2017-07-11 13:57:49.612339 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:49.612465 I | ceph-mgr: 2017-07-11 13:57:49.612451 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:49.612685 I | ceph-mgr: 2017-07-11 13:57:49.612669 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:51.622221 I | ceph-mgr: 2017-07-11 13:57:51.621926 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:51.622327 I | ceph-mgr: 2017-07-11 13:57:51.622312 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:51.622546 I | ceph-mgr: 2017-07-11 13:57:51.622531 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:53.626322 I | ceph-mgr: 2017-07-11 13:57:53.626240 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:53.626506 I | ceph-mgr: 2017-07-11 13:57:53.626414 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:53.626757 I | ceph-mgr: 2017-07-11 13:57:53.626739 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:55.630628 I | ceph-mgr: 2017-07-11 13:57:55.630576 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:55.630721 I | ceph-mgr: 2017-07-11 13:57:55.630706 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:55.631011 I | ceph-mgr: 2017-07-11 13:57:55.630994 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:57.650606 I | ceph-mgr: 2017-07-11 13:57:57.650569 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:57.650699 I | ceph-mgr: 2017-07-11 13:57:57.650683 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:57.651112 I | ceph-mgr: 2017-07-11 13:57:57.651095 7f4cc3226700 0 mgr tick
- 2017-07-11 13:57:59.655915 I | ceph-mgr: 2017-07-11 13:57:59.655868 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:57:59.656002 I | ceph-mgr: 2017-07-11 13:57:59.655986 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:57:59.656235 I | ceph-mgr: 2017-07-11 13:57:59.656219 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:01.663424 I | ceph-mgr: 2017-07-11 13:58:01.663392 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:01.663552 I | ceph-mgr: 2017-07-11 13:58:01.663526 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:01.663769 I | ceph-mgr: 2017-07-11 13:58:01.663754 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:03.666469 I | ceph-mgr: 2017-07-11 13:58:03.666232 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:03.666552 I | ceph-mgr: 2017-07-11 13:58:03.666537 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:03.666724 I | ceph-mgr: 2017-07-11 13:58:03.666709 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:05.675341 I | ceph-mgr: 2017-07-11 13:58:05.675283 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:05.675503 I | ceph-mgr: 2017-07-11 13:58:05.675433 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:05.675985 I | ceph-mgr: 2017-07-11 13:58:05.675966 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:07.681320 I | ceph-mgr: 2017-07-11 13:58:07.681285 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:07.681395 I | ceph-mgr: 2017-07-11 13:58:07.681380 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:07.681612 I | ceph-mgr: 2017-07-11 13:58:07.681496 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:09.685301 I | ceph-mgr: 2017-07-11 13:58:09.685244 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:09.685396 I | ceph-mgr: 2017-07-11 13:58:09.685381 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:09.685708 I | ceph-mgr: 2017-07-11 13:58:09.685692 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:11.695754 I | ceph-mgr: 2017-07-11 13:58:11.695705 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:11.695843 I | ceph-mgr: 2017-07-11 13:58:11.695829 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:11.696101 I | ceph-mgr: 2017-07-11 13:58:11.696085 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:13.716559 I | ceph-mgr: 2017-07-11 13:58:13.716486 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:13.716810 I | ceph-mgr: 2017-07-11 13:58:13.716780 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:13.717096 I | ceph-mgr: 2017-07-11 13:58:13.717080 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:15.732963 I | ceph-mgr: 2017-07-11 13:58:15.732795 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:15.733215 I | ceph-mgr: 2017-07-11 13:58:15.733077 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:15.733613 I | ceph-mgr: 2017-07-11 13:58:15.733597 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:17.737407 I | ceph-mgr: 2017-07-11 13:58:17.737369 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:17.737490 I | ceph-mgr: 2017-07-11 13:58:17.737475 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:17.737711 I | ceph-mgr: 2017-07-11 13:58:17.737694 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:19.740717 I | ceph-mgr: 2017-07-11 13:58:19.740619 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:19.740800 I | ceph-mgr: 2017-07-11 13:58:19.740784 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:19.741046 I | ceph-mgr: 2017-07-11 13:58:19.741030 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:21.744493 I | ceph-mgr: 2017-07-11 13:58:21.744458 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:21.744753 I | ceph-mgr: 2017-07-11 13:58:21.744736 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:21.744987 I | ceph-mgr: 2017-07-11 13:58:21.744971 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:23.748788 I | ceph-mgr: 2017-07-11 13:58:23.748740 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:23.748882 I | ceph-mgr: 2017-07-11 13:58:23.748865 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:23.749232 I | ceph-mgr: 2017-07-11 13:58:23.749215 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:25.757435 I | ceph-mgr: 2017-07-11 13:58:25.757360 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:25.757711 I | ceph-mgr: 2017-07-11 13:58:25.757675 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:25.757984 I | ceph-mgr: 2017-07-11 13:58:25.757964 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:27.762722 I | ceph-mgr: 2017-07-11 13:58:27.762651 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:27.762973 I | ceph-mgr: 2017-07-11 13:58:27.762843 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:27.763373 I | ceph-mgr: 2017-07-11 13:58:27.763357 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:29.768699 I | ceph-mgr: 2017-07-11 13:58:29.768636 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:29.768998 I | ceph-mgr: 2017-07-11 13:58:29.768982 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:29.769245 I | ceph-mgr: 2017-07-11 13:58:29.769229 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:31.781370 I | ceph-mgr: 2017-07-11 13:58:31.781328 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:31.781442 I | ceph-mgr: 2017-07-11 13:58:31.781426 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:31.781671 I | ceph-mgr: 2017-07-11 13:58:31.781656 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:33.804132 I | ceph-mgr: 2017-07-11 13:58:33.801636 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:33.804193 I | ceph-mgr: 2017-07-11 13:58:33.801646 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:33.804209 I | ceph-mgr: 2017-07-11 13:58:33.801673 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:35.803576 I | ceph-mgr: 2017-07-11 13:58:35.803491 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:35.803657 I | ceph-mgr: 2017-07-11 13:58:35.803642 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:35.803989 I | ceph-mgr: 2017-07-11 13:58:35.803973 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:37.823763 I | ceph-mgr: 2017-07-11 13:58:37.823729 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:37.823856 I | ceph-mgr: 2017-07-11 13:58:37.823842 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:37.824087 I | ceph-mgr: 2017-07-11 13:58:37.824071 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:39.848775 I | ceph-mgr: 2017-07-11 13:58:39.848699 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:39.849015 I | ceph-mgr: 2017-07-11 13:58:39.848899 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:39.849445 I | ceph-mgr: 2017-07-11 13:58:39.849429 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:41.867665 I | ceph-mgr: 2017-07-11 13:58:41.851943 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:41.867878 I | ceph-mgr: 2017-07-11 13:58:41.851956 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:41.867904 I | ceph-mgr: 2017-07-11 13:58:41.851986 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:43.870400 I | ceph-mgr: 2017-07-11 13:58:43.870361 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:43.870493 I | ceph-mgr: 2017-07-11 13:58:43.870477 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:43.870720 I | ceph-mgr: 2017-07-11 13:58:43.870704 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:45.877326 I | ceph-mgr: 2017-07-11 13:58:45.877251 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:45.877441 I | ceph-mgr: 2017-07-11 13:58:45.877426 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:45.877715 I | ceph-mgr: 2017-07-11 13:58:45.877601 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:47.882771 I | ceph-mgr: 2017-07-11 13:58:47.882730 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:47.882864 I | ceph-mgr: 2017-07-11 13:58:47.882847 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:47.883097 I | ceph-mgr: 2017-07-11 13:58:47.883080 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:49.889413 I | ceph-mgr: 2017-07-11 13:58:49.889362 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:49.889511 I | ceph-mgr: 2017-07-11 13:58:49.889497 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:49.889757 I | ceph-mgr: 2017-07-11 13:58:49.889741 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:51.896422 I | ceph-mgr: 2017-07-11 13:58:51.895857 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:51.896491 I | ceph-mgr: 2017-07-11 13:58:51.896476 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:51.896738 I | ceph-mgr: 2017-07-11 13:58:51.896723 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:53.900118 I | ceph-mgr: 2017-07-11 13:58:53.900069 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:53.900207 I | ceph-mgr: 2017-07-11 13:58:53.900192 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:53.900455 I | ceph-mgr: 2017-07-11 13:58:53.900438 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:55.917441 I | ceph-mgr: 2017-07-11 13:58:55.917374 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:55.917530 I | ceph-mgr: 2017-07-11 13:58:55.917515 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:55.917779 I | ceph-mgr: 2017-07-11 13:58:55.917764 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:57.943827 I | ceph-mgr: 2017-07-11 13:58:57.943761 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:57.943922 I | ceph-mgr: 2017-07-11 13:58:57.943907 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:57.944185 I | ceph-mgr: 2017-07-11 13:58:57.944164 7f4cc3226700 0 mgr tick
- 2017-07-11 13:58:59.952216 I | ceph-mgr: 2017-07-11 13:58:59.952154 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:58:59.952301 I | ceph-mgr: 2017-07-11 13:58:59.952286 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:58:59.952536 I | ceph-mgr: 2017-07-11 13:58:59.952521 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:01.958467 I | ceph-mgr: 2017-07-11 13:59:01.958383 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:01.958551 I | ceph-mgr: 2017-07-11 13:59:01.958536 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:01.958783 I | ceph-mgr: 2017-07-11 13:59:01.958767 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:03.979434 I | ceph-mgr: 2017-07-11 13:59:03.979370 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:03.979519 I | ceph-mgr: 2017-07-11 13:59:03.979504 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:03.979757 I | ceph-mgr: 2017-07-11 13:59:03.979742 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:05.988205 I | ceph-mgr: 2017-07-11 13:59:05.988168 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:05.988291 I | ceph-mgr: 2017-07-11 13:59:05.988276 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:05.988530 I | ceph-mgr: 2017-07-11 13:59:05.988515 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:07.999125 I | ceph-mgr: 2017-07-11 13:59:07.999057 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:07.999213 I | ceph-mgr: 2017-07-11 13:59:07.999197 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:08.015113 I | ceph-mgr: 2017-07-11 13:59:08.015068 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:10.019101 I | ceph-mgr: 2017-07-11 13:59:10.019053 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:10.019174 I | ceph-mgr: 2017-07-11 13:59:10.019160 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:10.019412 I | ceph-mgr: 2017-07-11 13:59:10.019396 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:12.035707 I | ceph-mgr: 2017-07-11 13:59:12.035659 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:12.035785 I | ceph-mgr: 2017-07-11 13:59:12.035771 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:12.036026 I | ceph-mgr: 2017-07-11 13:59:12.036010 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:14.039814 I | ceph-mgr: 2017-07-11 13:59:14.039767 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:14.040050 I | ceph-mgr: 2017-07-11 13:59:14.040033 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:14.042535 I | ceph-mgr: 2017-07-11 13:59:14.042516 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:16.064262 I | ceph-mgr: 2017-07-11 13:59:16.064199 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:16.064345 I | ceph-mgr: 2017-07-11 13:59:16.064330 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:16.064610 I | ceph-mgr: 2017-07-11 13:59:16.064593 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:18.088456 I | ceph-mgr: 2017-07-11 13:59:18.072669 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:18.088826 I | ceph-mgr: 2017-07-11 13:59:18.072675 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:18.089070 I | ceph-mgr: 2017-07-11 13:59:18.089049 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:20.101709 I | ceph-mgr: 2017-07-11 13:59:20.091825 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:20.101797 I | ceph-mgr: 2017-07-11 13:59:20.101779 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:20.105579 I | ceph-mgr: 2017-07-11 13:59:20.105562 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:22.126408 I | ceph-mgr: 2017-07-11 13:59:22.126282 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:22.126518 I | ceph-mgr: 2017-07-11 13:59:22.126502 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:22.151748 I | ceph-mgr: 2017-07-11 13:59:22.142093 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:24.160426 I | ceph-mgr: 2017-07-11 13:59:24.148501 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:24.160635 I | ceph-mgr: 2017-07-11 13:59:24.148514 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:24.160733 I | ceph-mgr: 2017-07-11 13:59:24.148545 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:26.150772 I | ceph-mgr: 2017-07-11 13:59:26.150563 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:26.150845 I | ceph-mgr: 2017-07-11 13:59:26.150830 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:26.151096 I | ceph-mgr: 2017-07-11 13:59:26.151081 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:28.154678 I | ceph-mgr: 2017-07-11 13:59:28.154638 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:28.154905 I | ceph-mgr: 2017-07-11 13:59:28.154888 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:28.155154 I | ceph-mgr: 2017-07-11 13:59:28.155138 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:30.168780 I | ceph-mgr: 2017-07-11 13:59:30.168689 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:30.168858 I | ceph-mgr: 2017-07-11 13:59:30.168843 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:30.169115 I | ceph-mgr: 2017-07-11 13:59:30.169099 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:32.176635 I | ceph-mgr: 2017-07-11 13:59:32.176031 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:32.176716 I | ceph-mgr: 2017-07-11 13:59:32.176699 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:32.177191 I | ceph-mgr: 2017-07-11 13:59:32.177172 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:34.183061 I | ceph-mgr: 2017-07-11 13:59:34.183017 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:34.183148 I | ceph-mgr: 2017-07-11 13:59:34.183132 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:34.183382 I | ceph-mgr: 2017-07-11 13:59:34.183366 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:36.193624 I | ceph-mgr: 2017-07-11 13:59:36.193584 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:36.193697 I | ceph-mgr: 2017-07-11 13:59:36.193683 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:36.193921 I | ceph-mgr: 2017-07-11 13:59:36.193905 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:38.219727 I | ceph-mgr: 2017-07-11 13:59:38.219670 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:38.219805 I | ceph-mgr: 2017-07-11 13:59:38.219790 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:38.220123 I | ceph-mgr: 2017-07-11 13:59:38.220102 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:40.226647 I | ceph-mgr: 2017-07-11 13:59:40.226598 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:40.226745 I | ceph-mgr: 2017-07-11 13:59:40.226729 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:40.227018 I | ceph-mgr: 2017-07-11 13:59:40.226999 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:42.235077 I | ceph-mgr: 2017-07-11 13:59:42.235030 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:42.235170 I | ceph-mgr: 2017-07-11 13:59:42.235155 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:42.235406 I | ceph-mgr: 2017-07-11 13:59:42.235391 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:44.244033 I | ceph-mgr: 2017-07-11 13:59:44.243931 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:44.244102 I | ceph-mgr: 2017-07-11 13:59:44.244087 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:44.244337 I | ceph-mgr: 2017-07-11 13:59:44.244322 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:46.257868 I | ceph-mgr: 2017-07-11 13:59:46.257816 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:46.258092 I | ceph-mgr: 2017-07-11 13:59:46.258077 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:46.260415 I | ceph-mgr: 2017-07-11 13:59:46.260387 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:48.274662 I | ceph-mgr: 2017-07-11 13:59:48.274622 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:48.274700 I | ceph-mgr: 2017-07-11 13:59:48.274687 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:48.274807 I | ceph-mgr: 2017-07-11 13:59:48.274793 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:50.283682 I | ceph-mgr: 2017-07-11 13:59:50.283596 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:50.283881 I | ceph-mgr: 2017-07-11 13:59:50.283786 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:50.284136 I | ceph-mgr: 2017-07-11 13:59:50.284121 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:52.287418 I | ceph-mgr: 2017-07-11 13:59:52.287354 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:52.287514 I | ceph-mgr: 2017-07-11 13:59:52.287499 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:52.287756 I | ceph-mgr: 2017-07-11 13:59:52.287741 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:54.292076 I | ceph-mgr: 2017-07-11 13:59:54.292034 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:54.292146 I | ceph-mgr: 2017-07-11 13:59:54.292132 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:54.292703 I | ceph-mgr: 2017-07-11 13:59:54.292686 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:56.322672 I | ceph-mgr: 2017-07-11 13:59:56.319316 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:56.338507 I | ceph-mgr: 2017-07-11 13:59:56.330642 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:56.348340 I | ceph-mgr: 2017-07-11 13:59:56.348294 7f4cc3226700 0 mgr tick
- 2017-07-11 13:59:58.362869 I | ceph-mgr: 2017-07-11 13:59:58.362791 7f4cc3226700 0 mgr tick tick
- 2017-07-11 13:59:58.365381 I | ceph-mgr: 2017-07-11 13:59:58.365365 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 13:59:58.365765 I | ceph-mgr: 2017-07-11 13:59:58.365561 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:00.383658 I | ceph-mgr: 2017-07-11 14:00:00.383616 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:00.383754 I | ceph-mgr: 2017-07-11 14:00:00.383738 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:00.383999 I | ceph-mgr: 2017-07-11 14:00:00.383983 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:02.402792 I | ceph-mgr: 2017-07-11 14:00:02.402730 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:02.403621 I | ceph-mgr: 2017-07-11 14:00:02.403605 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:02.403988 I | ceph-mgr: 2017-07-11 14:00:02.403971 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:04.415647 I | ceph-mgr: 2017-07-11 14:00:04.415598 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:04.415733 I | ceph-mgr: 2017-07-11 14:00:04.415717 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:04.416006 I | ceph-mgr: 2017-07-11 14:00:04.415989 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:06.423573 I | ceph-mgr: 2017-07-11 14:00:06.423537 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:06.423652 I | ceph-mgr: 2017-07-11 14:00:06.423638 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:06.433446 I | ceph-mgr: 2017-07-11 14:00:06.426969 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:08.515347 I | ceph-mgr: 2017-07-11 14:00:08.502740 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:08.515562 I | ceph-mgr: 2017-07-11 14:00:08.502749 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:08.515663 I | ceph-mgr: 2017-07-11 14:00:08.502775 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:10.517208 I | ceph-mgr: 2017-07-11 14:00:10.517153 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:10.517288 I | ceph-mgr: 2017-07-11 14:00:10.517272 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:10.517622 I | ceph-mgr: 2017-07-11 14:00:10.517574 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:12.521210 I | ceph-mgr: 2017-07-11 14:00:12.521176 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:12.521306 I | ceph-mgr: 2017-07-11 14:00:12.521290 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:12.521534 I | ceph-mgr: 2017-07-11 14:00:12.521516 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:14.556648 I | ceph-mgr: 2017-07-11 14:00:14.539901 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:14.556812 I | ceph-mgr: 2017-07-11 14:00:14.539915 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:14.556832 I | ceph-mgr: 2017-07-11 14:00:14.539949 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:16.559188 I | ceph-mgr: 2017-07-11 14:00:16.559153 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:16.559264 I | ceph-mgr: 2017-07-11 14:00:16.559250 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:16.565414 I | ceph-mgr: 2017-07-11 14:00:16.559367 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:18.568717 I | ceph-mgr: 2017-07-11 14:00:18.568674 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:18.568796 I | ceph-mgr: 2017-07-11 14:00:18.568782 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:18.569233 I | ceph-mgr: 2017-07-11 14:00:18.569216 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:20.572984 I | ceph-mgr: 2017-07-11 14:00:20.572938 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:20.573073 I | ceph-mgr: 2017-07-11 14:00:20.573058 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:20.573377 I | ceph-mgr: 2017-07-11 14:00:20.573361 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:22.591202 I | ceph-mgr: 2017-07-11 14:00:22.590781 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:22.591284 I | ceph-mgr: 2017-07-11 14:00:22.591268 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:22.591503 I | ceph-mgr: 2017-07-11 14:00:22.591384 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:24.597249 I | ceph-mgr: 2017-07-11 14:00:24.597199 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:24.597345 I | ceph-mgr: 2017-07-11 14:00:24.597328 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:24.597747 I | ceph-mgr: 2017-07-11 14:00:24.597730 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:26.612998 I | ceph-mgr: 2017-07-11 14:00:26.612935 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:26.613094 I | ceph-mgr: 2017-07-11 14:00:26.613079 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:26.613342 I | ceph-mgr: 2017-07-11 14:00:26.613325 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:28.615686 I | ceph-mgr: 2017-07-11 14:00:28.615597 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:28.615779 I | ceph-mgr: 2017-07-11 14:00:28.615764 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:28.616139 I | ceph-mgr: 2017-07-11 14:00:28.616124 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:30.630379 I | ceph-mgr: 2017-07-11 14:00:30.629169 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:30.630585 I | ceph-mgr: 2017-07-11 14:00:30.629182 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:30.630612 I | ceph-mgr: 2017-07-11 14:00:30.629212 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:32.631946 I | ceph-mgr: 2017-07-11 14:00:32.631913 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:32.632035 I | ceph-mgr: 2017-07-11 14:00:32.632019 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:32.634373 I | ceph-mgr: 2017-07-11 14:00:32.632133 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:34.641740 I | ceph-mgr: 2017-07-11 14:00:34.640196 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:34.641795 I | ceph-mgr: 2017-07-11 14:00:34.640219 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:34.641829 I | ceph-mgr: 2017-07-11 14:00:34.640295 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:36.648852 I | ceph-mgr: 2017-07-11 14:00:36.647259 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:36.648943 I | ceph-mgr: 2017-07-11 14:00:36.648927 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:36.649179 I | ceph-mgr: 2017-07-11 14:00:36.649163 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:38.650925 I | ceph-mgr: 2017-07-11 14:00:38.650874 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:38.651016 I | ceph-mgr: 2017-07-11 14:00:38.651002 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:38.651270 I | ceph-mgr: 2017-07-11 14:00:38.651244 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:40.675249 I | ceph-mgr: 2017-07-11 14:00:40.675179 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:40.675342 I | ceph-mgr: 2017-07-11 14:00:40.675326 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:40.675914 I | ceph-mgr: 2017-07-11 14:00:40.675895 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:42.687206 I | ceph-mgr: 2017-07-11 14:00:42.686753 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:42.687294 I | ceph-mgr: 2017-07-11 14:00:42.687279 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:42.687768 I | ceph-mgr: 2017-07-11 14:00:42.687751 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:44.718865 I | ceph-mgr: 2017-07-11 14:00:44.699174 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:44.718920 I | ceph-mgr: 2017-07-11 14:00:44.699180 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:44.718935 I | ceph-mgr: 2017-07-11 14:00:44.699200 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:46.703706 I | ceph-mgr: 2017-07-11 14:00:46.702337 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:46.710862 I | ceph-mgr: 2017-07-11 14:00:46.702342 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:46.710955 I | ceph-mgr: 2017-07-11 14:00:46.702392 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:48.705991 I | ceph-mgr: 2017-07-11 14:00:48.705945 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:48.706077 I | ceph-mgr: 2017-07-11 14:00:48.706062 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:48.706165 I | ceph-mgr: 2017-07-11 14:00:48.706145 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:50.713863 I | ceph-mgr: 2017-07-11 14:00:50.713784 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:50.713968 I | ceph-mgr: 2017-07-11 14:00:50.713953 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:50.714060 I | ceph-mgr: 2017-07-11 14:00:50.714050 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:52.716586 I | ceph-mgr: 2017-07-11 14:00:52.716543 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:52.716660 I | ceph-mgr: 2017-07-11 14:00:52.716645 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:52.716914 I | ceph-mgr: 2017-07-11 14:00:52.716729 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:54.722218 I | ceph-mgr: 2017-07-11 14:00:54.722178 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:54.722469 I | ceph-mgr: 2017-07-11 14:00:54.722453 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:54.723958 I | ceph-mgr: 2017-07-11 14:00:54.723941 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:56.726999 I | ceph-mgr: 2017-07-11 14:00:56.726952 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:56.727089 I | ceph-mgr: 2017-07-11 14:00:56.727074 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:56.727336 I | ceph-mgr: 2017-07-11 14:00:56.727319 7f4cc3226700 0 mgr tick
- 2017-07-11 14:00:58.752905 I | ceph-mgr: 2017-07-11 14:00:58.752851 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:00:58.753000 I | ceph-mgr: 2017-07-11 14:00:58.752984 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:00:58.753527 I | ceph-mgr: 2017-07-11 14:00:58.753509 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:00.756176 I | ceph-mgr: 2017-07-11 14:01:00.756130 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:00.756257 I | ceph-mgr: 2017-07-11 14:01:00.756242 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:00.756500 I | ceph-mgr: 2017-07-11 14:01:00.756484 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:02.766384 I | ceph-mgr: 2017-07-11 14:01:02.766313 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:02.767258 I | ceph-mgr: 2017-07-11 14:01:02.766493 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:02.767667 I | ceph-mgr: 2017-07-11 14:01:02.767650 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:04.772179 I | ceph-mgr: 2017-07-11 14:01:04.771330 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:04.772342 I | ceph-mgr: 2017-07-11 14:01:04.771335 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:04.772382 I | ceph-mgr: 2017-07-11 14:01:04.771357 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:06.779700 I | ceph-mgr: 2017-07-11 14:01:06.777817 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:06.779768 I | ceph-mgr: 2017-07-11 14:01:06.777826 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:06.779955 I | ceph-mgr: 2017-07-11 14:01:06.779893 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:08.796200 I | ceph-mgr: 2017-07-11 14:01:08.794597 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:08.796425 I | ceph-mgr: 2017-07-11 14:01:08.794611 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:08.796526 I | ceph-mgr: 2017-07-11 14:01:08.794642 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:10.797785 I | ceph-mgr: 2017-07-11 14:01:10.797734 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:10.798006 I | ceph-mgr: 2017-07-11 14:01:10.797971 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:10.800285 I | ceph-mgr: 2017-07-11 14:01:10.800262 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:12.822793 I | ceph-mgr: 2017-07-11 14:01:12.822751 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:12.822885 I | ceph-mgr: 2017-07-11 14:01:12.822870 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:12.823122 I | ceph-mgr: 2017-07-11 14:01:12.823106 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:14.826727 I | ceph-mgr: 2017-07-11 14:01:14.826690 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:14.834063 I | ceph-mgr: 2017-07-11 14:01:14.834046 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:14.834290 I | ceph-mgr: 2017-07-11 14:01:14.834274 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:16.836062 I | ceph-mgr: 2017-07-11 14:01:16.835992 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:16.836150 I | ceph-mgr: 2017-07-11 14:01:16.836135 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:16.842406 I | ceph-mgr: 2017-07-11 14:01:16.842387 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:18.852394 I | ceph-mgr: 2017-07-11 14:01:18.852326 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:18.852584 I | ceph-mgr: 2017-07-11 14:01:18.852498 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:18.852750 I | ceph-mgr: 2017-07-11 14:01:18.852735 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:20.859034 I | ceph-mgr: 2017-07-11 14:01:20.858988 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:20.859113 I | ceph-mgr: 2017-07-11 14:01:20.859097 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:20.859379 I | ceph-mgr: 2017-07-11 14:01:20.859363 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:22.870818 I | ceph-mgr: 2017-07-11 14:01:22.870766 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:22.870902 I | ceph-mgr: 2017-07-11 14:01:22.870887 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:22.871298 I | ceph-mgr: 2017-07-11 14:01:22.871280 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:24.874882 I | ceph-mgr: 2017-07-11 14:01:24.874833 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:24.875094 I | ceph-mgr: 2017-07-11 14:01:24.875078 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:24.878139 I | ceph-mgr: 2017-07-11 14:01:24.878109 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:26.896876 I | ceph-mgr: 2017-07-11 14:01:26.896827 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:26.896964 I | ceph-mgr: 2017-07-11 14:01:26.896949 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:26.897217 I | ceph-mgr: 2017-07-11 14:01:26.897202 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:28.901519 I | ceph-mgr: 2017-07-11 14:01:28.901469 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:28.901601 I | ceph-mgr: 2017-07-11 14:01:28.901587 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:28.901938 I | ceph-mgr: 2017-07-11 14:01:28.901923 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:30.904207 I | ceph-mgr: 2017-07-11 14:01:30.904164 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:30.904278 I | ceph-mgr: 2017-07-11 14:01:30.904263 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:30.904513 I | ceph-mgr: 2017-07-11 14:01:30.904498 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:32.912533 I | ceph-mgr: 2017-07-11 14:01:32.912502 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:32.912624 I | ceph-mgr: 2017-07-11 14:01:32.912608 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:32.912865 I | ceph-mgr: 2017-07-11 14:01:32.912849 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:34.923160 I | ceph-mgr: 2017-07-11 14:01:34.923048 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:34.923426 I | ceph-mgr: 2017-07-11 14:01:34.923272 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:34.923663 I | ceph-mgr: 2017-07-11 14:01:34.923648 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:36.928966 I | ceph-mgr: 2017-07-11 14:01:36.928933 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:36.929036 I | ceph-mgr: 2017-07-11 14:01:36.929022 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:36.929258 I | ceph-mgr: 2017-07-11 14:01:36.929142 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:38.932112 I | ceph-mgr: 2017-07-11 14:01:38.932064 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:38.932204 I | ceph-mgr: 2017-07-11 14:01:38.932187 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:38.932478 I | ceph-mgr: 2017-07-11 14:01:38.932462 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:40.948516 I | ceph-mgr: 2017-07-11 14:01:40.948465 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:40.948598 I | ceph-mgr: 2017-07-11 14:01:40.948582 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:40.948851 I | ceph-mgr: 2017-07-11 14:01:40.948836 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:42.968545 I | ceph-mgr: 2017-07-11 14:01:42.968498 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:42.968618 I | ceph-mgr: 2017-07-11 14:01:42.968603 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:42.974594 I | ceph-mgr: 2017-07-11 14:01:42.974575 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:44.978940 I | ceph-mgr: 2017-07-11 14:01:44.978891 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:44.979015 I | ceph-mgr: 2017-07-11 14:01:44.978996 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:44.979431 I | ceph-mgr: 2017-07-11 14:01:44.979413 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:46.989008 I | ceph-mgr: 2017-07-11 14:01:46.987082 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:46.989072 I | ceph-mgr: 2017-07-11 14:01:46.987100 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:46.989087 I | ceph-mgr: 2017-07-11 14:01:46.987146 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:48.995834 I | ceph-mgr: 2017-07-11 14:01:48.995753 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:48.996046 I | ceph-mgr: 2017-07-11 14:01:48.995955 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:48.996558 I | ceph-mgr: 2017-07-11 14:01:48.996537 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:51.003757 I | ceph-mgr: 2017-07-11 14:01:51.003715 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:51.003836 I | ceph-mgr: 2017-07-11 14:01:51.003822 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:51.004095 I | ceph-mgr: 2017-07-11 14:01:51.004079 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:53.010718 I | ceph-mgr: 2017-07-11 14:01:53.009770 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:53.010799 I | ceph-mgr: 2017-07-11 14:01:53.010784 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:53.011028 I | ceph-mgr: 2017-07-11 14:01:53.011013 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:55.015015 I | ceph-mgr: 2017-07-11 14:01:55.014965 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:55.015098 I | ceph-mgr: 2017-07-11 14:01:55.015083 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:55.015349 I | ceph-mgr: 2017-07-11 14:01:55.015333 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:57.041746 I | ceph-mgr: 2017-07-11 14:01:57.041535 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:57.042001 I | ceph-mgr: 2017-07-11 14:01:57.041868 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:57.042416 I | ceph-mgr: 2017-07-11 14:01:57.042391 7f4cc3226700 0 mgr tick
- 2017-07-11 14:01:59.047281 I | ceph-mgr: 2017-07-11 14:01:59.047220 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:01:59.048072 I | ceph-mgr: 2017-07-11 14:01:59.048052 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:01:59.063858 I | ceph-mgr: 2017-07-11 14:01:59.063836 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:01.068738 I | ceph-mgr: 2017-07-11 14:02:01.068678 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:01.070611 I | ceph-mgr: 2017-07-11 14:02:01.070595 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:01.070839 I | ceph-mgr: 2017-07-11 14:02:01.070815 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:03.082656 I | ceph-mgr: 2017-07-11 14:02:03.082615 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:03.082739 I | ceph-mgr: 2017-07-11 14:02:03.082724 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:03.083138 I | ceph-mgr: 2017-07-11 14:02:03.083122 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:05.095607 I | ceph-mgr: 2017-07-11 14:02:05.095551 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:05.095700 I | ceph-mgr: 2017-07-11 14:02:05.095685 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:05.095961 I | ceph-mgr: 2017-07-11 14:02:05.095946 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:07.104235 I | ceph-mgr: 2017-07-11 14:02:07.104191 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:07.104307 I | ceph-mgr: 2017-07-11 14:02:07.104293 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:07.104545 I | ceph-mgr: 2017-07-11 14:02:07.104529 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:09.112994 I | ceph-mgr: 2017-07-11 14:02:09.112942 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:09.113217 I | ceph-mgr: 2017-07-11 14:02:09.113201 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:09.116282 I | ceph-mgr: 2017-07-11 14:02:09.116251 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:11.134672 I | ceph-mgr: 2017-07-11 14:02:11.134626 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:11.134741 I | ceph-mgr: 2017-07-11 14:02:11.134727 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:11.134974 I | ceph-mgr: 2017-07-11 14:02:11.134959 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:13.140135 I | ceph-mgr: 2017-07-11 14:02:13.140087 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:13.140213 I | ceph-mgr: 2017-07-11 14:02:13.140199 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:13.140459 I | ceph-mgr: 2017-07-11 14:02:13.140443 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:15.142657 I | ceph-mgr: 2017-07-11 14:02:15.142623 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:15.142732 I | ceph-mgr: 2017-07-11 14:02:15.142718 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:15.143121 I | ceph-mgr: 2017-07-11 14:02:15.142911 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:17.161860 I | ceph-mgr: 2017-07-11 14:02:17.161811 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:17.161938 I | ceph-mgr: 2017-07-11 14:02:17.161923 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:17.162202 I | ceph-mgr: 2017-07-11 14:02:17.162185 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:19.170202 I | ceph-mgr: 2017-07-11 14:02:19.170144 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:19.170283 I | ceph-mgr: 2017-07-11 14:02:19.170268 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:19.170523 I | ceph-mgr: 2017-07-11 14:02:19.170508 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:21.194267 I | ceph-mgr: 2017-07-11 14:02:21.194191 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:21.194517 I | ceph-mgr: 2017-07-11 14:02:21.194372 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:21.194775 I | ceph-mgr: 2017-07-11 14:02:21.194761 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:23.203234 I | ceph-mgr: 2017-07-11 14:02:23.203186 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:23.203350 I | ceph-mgr: 2017-07-11 14:02:23.203324 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:23.203656 I | ceph-mgr: 2017-07-11 14:02:23.203641 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:25.208332 I | ceph-mgr: 2017-07-11 14:02:25.208138 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:25.208418 I | ceph-mgr: 2017-07-11 14:02:25.208403 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:25.208680 I | ceph-mgr: 2017-07-11 14:02:25.208664 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:27.218977 I | ceph-mgr: 2017-07-11 14:02:27.218931 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:27.219050 I | ceph-mgr: 2017-07-11 14:02:27.219036 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:27.225081 I | ceph-mgr: 2017-07-11 14:02:27.225063 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:29.226988 I | ceph-mgr: 2017-07-11 14:02:29.226939 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:29.227067 I | ceph-mgr: 2017-07-11 14:02:29.227052 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:29.227322 I | ceph-mgr: 2017-07-11 14:02:29.227306 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:31.237649 I | ceph-mgr: 2017-07-11 14:02:31.237177 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:31.237804 I | ceph-mgr: 2017-07-11 14:02:31.237189 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:31.237850 I | ceph-mgr: 2017-07-11 14:02:31.237224 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:33.257621 I | ceph-mgr: 2017-07-11 14:02:33.257576 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:33.257700 I | ceph-mgr: 2017-07-11 14:02:33.257685 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:33.264604 I | ceph-mgr: 2017-07-11 14:02:33.264586 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:35.273569 I | ceph-mgr: 2017-07-11 14:02:35.269931 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:35.273647 I | ceph-mgr: 2017-07-11 14:02:35.273632 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:35.279475 I | ceph-mgr: 2017-07-11 14:02:35.279456 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:37.284557 I | ceph-mgr: 2017-07-11 14:02:37.284507 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:37.284638 I | ceph-mgr: 2017-07-11 14:02:37.284623 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:37.284880 I | ceph-mgr: 2017-07-11 14:02:37.284864 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:39.310106 I | ceph-mgr: 2017-07-11 14:02:39.307915 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:39.317820 I | ceph-mgr: 2017-07-11 14:02:39.317776 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:39.327758 I | ceph-mgr: 2017-07-11 14:02:39.327741 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:41.342565 I | ceph-mgr: 2017-07-11 14:02:41.342519 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:41.342652 I | ceph-mgr: 2017-07-11 14:02:41.342637 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:41.342906 I | ceph-mgr: 2017-07-11 14:02:41.342890 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:43.356996 I | ceph-mgr: 2017-07-11 14:02:43.356936 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:43.357196 I | ceph-mgr: 2017-07-11 14:02:43.357108 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:43.357413 I | ceph-mgr: 2017-07-11 14:02:43.357301 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:45.361648 I | ceph-mgr: 2017-07-11 14:02:45.361578 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:45.363359 I | ceph-mgr: 2017-07-11 14:02:45.363341 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:45.363563 I | ceph-mgr: 2017-07-11 14:02:45.363534 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:47.368575 I | ceph-mgr: 2017-07-11 14:02:47.367097 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:47.368779 I | ceph-mgr: 2017-07-11 14:02:47.367103 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:47.368885 I | ceph-mgr: 2017-07-11 14:02:47.367135 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:49.371143 I | ceph-mgr: 2017-07-11 14:02:49.371098 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:49.371215 I | ceph-mgr: 2017-07-11 14:02:49.371201 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:49.371454 I | ceph-mgr: 2017-07-11 14:02:49.371439 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:51.384642 I | ceph-mgr: 2017-07-11 14:02:51.384578 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:51.384864 I | ceph-mgr: 2017-07-11 14:02:51.384848 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:51.386861 I | ceph-mgr: 2017-07-11 14:02:51.386845 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:53.397201 I | ceph-mgr: 2017-07-11 14:02:53.397167 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:53.397365 I | ceph-mgr: 2017-07-11 14:02:53.397350 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:53.400578 I | ceph-mgr: 2017-07-11 14:02:53.400560 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:55.417881 I | ceph-mgr: 2017-07-11 14:02:55.417835 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:55.418100 I | ceph-mgr: 2017-07-11 14:02:55.418085 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:55.425145 I | ceph-mgr: 2017-07-11 14:02:55.425101 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:57.428771 I | ceph-mgr: 2017-07-11 14:02:57.428721 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:57.428857 I | ceph-mgr: 2017-07-11 14:02:57.428843 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:57.429103 I | ceph-mgr: 2017-07-11 14:02:57.429086 7f4cc3226700 0 mgr tick
- 2017-07-11 14:02:59.452771 I | ceph-mgr: 2017-07-11 14:02:59.452721 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:02:59.452862 I | ceph-mgr: 2017-07-11 14:02:59.452847 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:02:59.453105 I | ceph-mgr: 2017-07-11 14:02:59.453089 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:01.460010 I | ceph-mgr: 2017-07-11 14:03:01.459956 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:01.460089 I | ceph-mgr: 2017-07-11 14:03:01.460074 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:01.460331 I | ceph-mgr: 2017-07-11 14:03:01.460316 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:03.463993 I | ceph-mgr: 2017-07-11 14:03:03.463955 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:03.464171 I | ceph-mgr: 2017-07-11 14:03:03.464154 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:03.467446 I | ceph-mgr: 2017-07-11 14:03:03.467430 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:05.491618 I | ceph-mgr: 2017-07-11 14:03:05.491554 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:05.491715 I | ceph-mgr: 2017-07-11 14:03:05.491689 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:05.492206 I | ceph-mgr: 2017-07-11 14:03:05.492189 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:07.512702 I | ceph-mgr: 2017-07-11 14:03:07.512666 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:07.512788 I | ceph-mgr: 2017-07-11 14:03:07.512774 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:07.528776 I | ceph-mgr: 2017-07-11 14:03:07.528757 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:09.537189 I | ceph-mgr: 2017-07-11 14:03:09.537135 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:09.537285 I | ceph-mgr: 2017-07-11 14:03:09.537271 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:09.537361 I | ceph-mgr: 2017-07-11 14:03:09.537351 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:11.540356 I | ceph-mgr: 2017-07-11 14:03:11.540247 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:11.540474 I | ceph-mgr: 2017-07-11 14:03:11.540458 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:11.540560 I | ceph-mgr: 2017-07-11 14:03:11.540550 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:13.542675 I | ceph-mgr: 2017-07-11 14:03:13.542552 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:13.542950 I | ceph-mgr: 2017-07-11 14:03:13.542796 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:13.543384 I | ceph-mgr: 2017-07-11 14:03:13.543367 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:15.546635 I | ceph-mgr: 2017-07-11 14:03:15.546593 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:15.546708 I | ceph-mgr: 2017-07-11 14:03:15.546693 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:15.546947 I | ceph-mgr: 2017-07-11 14:03:15.546931 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:17.569268 I | ceph-mgr: 2017-07-11 14:03:17.569202 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:17.569386 I | ceph-mgr: 2017-07-11 14:03:17.569371 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:17.569631 I | ceph-mgr: 2017-07-11 14:03:17.569615 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:19.576596 I | ceph-mgr: 2017-07-11 14:03:19.576557 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:19.576674 I | ceph-mgr: 2017-07-11 14:03:19.576659 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:19.576916 I | ceph-mgr: 2017-07-11 14:03:19.576891 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:21.578776 I | ceph-mgr: 2017-07-11 14:03:21.578741 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:21.578848 I | ceph-mgr: 2017-07-11 14:03:21.578834 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:21.579093 I | ceph-mgr: 2017-07-11 14:03:21.579077 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:23.590162 I | ceph-mgr: 2017-07-11 14:03:23.589993 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:23.590352 I | ceph-mgr: 2017-07-11 14:03:23.590274 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:23.590522 I | ceph-mgr: 2017-07-11 14:03:23.590507 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:25.593668 I | ceph-mgr: 2017-07-11 14:03:25.593568 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:25.593751 I | ceph-mgr: 2017-07-11 14:03:25.593736 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:25.594002 I | ceph-mgr: 2017-07-11 14:03:25.593986 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:27.610798 I | ceph-mgr: 2017-07-11 14:03:27.610748 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:27.610885 I | ceph-mgr: 2017-07-11 14:03:27.610871 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:27.611136 I | ceph-mgr: 2017-07-11 14:03:27.611120 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:29.615242 I | ceph-mgr: 2017-07-11 14:03:29.615210 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:29.615329 I | ceph-mgr: 2017-07-11 14:03:29.615315 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:29.615568 I | ceph-mgr: 2017-07-11 14:03:29.615544 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:31.630255 I | ceph-mgr: 2017-07-11 14:03:31.630219 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:31.630428 I | ceph-mgr: 2017-07-11 14:03:31.630412 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:31.633579 I | ceph-mgr: 2017-07-11 14:03:31.633564 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:33.658239 I | ceph-mgr: 2017-07-11 14:03:33.658199 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:33.658313 I | ceph-mgr: 2017-07-11 14:03:33.658297 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:33.658538 I | ceph-mgr: 2017-07-11 14:03:33.658523 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:35.660307 I | ceph-mgr: 2017-07-11 14:03:35.660264 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:35.660525 I | ceph-mgr: 2017-07-11 14:03:35.660509 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:35.666968 I | ceph-mgr: 2017-07-11 14:03:35.666948 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:37.670761 I | ceph-mgr: 2017-07-11 14:03:37.670725 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:37.670838 I | ceph-mgr: 2017-07-11 14:03:37.670824 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:37.671078 I | ceph-mgr: 2017-07-11 14:03:37.671063 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:39.679522 I | ceph-mgr: 2017-07-11 14:03:39.679482 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:39.679605 I | ceph-mgr: 2017-07-11 14:03:39.679591 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:39.679843 I | ceph-mgr: 2017-07-11 14:03:39.679825 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:41.688183 I | ceph-mgr: 2017-07-11 14:03:41.688131 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:41.688263 I | ceph-mgr: 2017-07-11 14:03:41.688249 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:41.688524 I | ceph-mgr: 2017-07-11 14:03:41.688508 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:43.697002 I | ceph-mgr: 2017-07-11 14:03:43.695608 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:43.697064 I | ceph-mgr: 2017-07-11 14:03:43.695624 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:43.697079 I | ceph-mgr: 2017-07-11 14:03:43.695654 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:45.704009 I | ceph-mgr: 2017-07-11 14:03:45.703936 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:45.704108 I | ceph-mgr: 2017-07-11 14:03:45.704094 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:45.704188 I | ceph-mgr: 2017-07-11 14:03:45.704178 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:47.706599 I | ceph-mgr: 2017-07-11 14:03:47.706547 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:47.706686 I | ceph-mgr: 2017-07-11 14:03:47.706671 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:47.706769 I | ceph-mgr: 2017-07-11 14:03:47.706749 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:49.720188 I | ceph-mgr: 2017-07-11 14:03:49.720153 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:49.720267 I | ceph-mgr: 2017-07-11 14:03:49.720253 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:49.720496 I | ceph-mgr: 2017-07-11 14:03:49.720480 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:51.741551 I | ceph-mgr: 2017-07-11 14:03:51.724516 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:51.741822 I | ceph-mgr: 2017-07-11 14:03:51.724527 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:51.741907 I | ceph-mgr: 2017-07-11 14:03:51.724564 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:53.743774 I | ceph-mgr: 2017-07-11 14:03:53.743720 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:53.743859 I | ceph-mgr: 2017-07-11 14:03:53.743844 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:53.744137 I | ceph-mgr: 2017-07-11 14:03:53.744120 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:55.759845 I | ceph-mgr: 2017-07-11 14:03:55.756686 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:55.759928 I | ceph-mgr: 2017-07-11 14:03:55.759912 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:55.760170 I | ceph-mgr: 2017-07-11 14:03:55.760154 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:57.777172 I | ceph-mgr: 2017-07-11 14:03:57.770823 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:57.777264 I | ceph-mgr: 2017-07-11 14:03:57.777247 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:57.778532 I | ceph-mgr: 2017-07-11 14:03:57.778514 7f4cc3226700 0 mgr tick
- 2017-07-11 14:03:59.780731 I | ceph-mgr: 2017-07-11 14:03:59.780674 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:03:59.780806 I | ceph-mgr: 2017-07-11 14:03:59.780791 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:03:59.780980 I | ceph-mgr: 2017-07-11 14:03:59.780965 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:01.788632 I | ceph-mgr: 2017-07-11 14:04:01.788578 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:01.788703 I | ceph-mgr: 2017-07-11 14:04:01.788689 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:01.789285 I | ceph-mgr: 2017-07-11 14:04:01.789267 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:03.795573 I | ceph-mgr: 2017-07-11 14:04:03.793713 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:03.795657 I | ceph-mgr: 2017-07-11 14:04:03.795643 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:03.795877 I | ceph-mgr: 2017-07-11 14:04:03.795862 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:05.831212 I | ceph-mgr: 2017-07-11 14:04:05.813835 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:05.831272 I | ceph-mgr: 2017-07-11 14:04:05.813848 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:05.831290 I | ceph-mgr: 2017-07-11 14:04:05.813878 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:07.833488 I | ceph-mgr: 2017-07-11 14:04:07.833456 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:07.833567 I | ceph-mgr: 2017-07-11 14:04:07.833553 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:07.833778 I | ceph-mgr: 2017-07-11 14:04:07.833662 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:09.841561 I | ceph-mgr: 2017-07-11 14:04:09.841469 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:09.841740 I | ceph-mgr: 2017-07-11 14:04:09.841725 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:09.842005 I | ceph-mgr: 2017-07-11 14:04:09.841985 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:11.847706 I | ceph-mgr: 2017-07-11 14:04:11.847643 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:11.847802 I | ceph-mgr: 2017-07-11 14:04:11.847787 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:11.848064 I | ceph-mgr: 2017-07-11 14:04:11.848048 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:13.870317 I | ceph-mgr: 2017-07-11 14:04:13.868939 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:13.870534 I | ceph-mgr: 2017-07-11 14:04:13.868949 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:13.870630 I | ceph-mgr: 2017-07-11 14:04:13.868977 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:15.893709 I | ceph-mgr: 2017-07-11 14:04:15.873653 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:15.893792 I | ceph-mgr: 2017-07-11 14:04:15.873667 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:15.893812 I | ceph-mgr: 2017-07-11 14:04:15.873751 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:17.902369 I | ceph-mgr: 2017-07-11 14:04:17.894921 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:17.902447 I | ceph-mgr: 2017-07-11 14:04:17.902431 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:17.902708 I | ceph-mgr: 2017-07-11 14:04:17.902692 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:19.912525 I | ceph-mgr: 2017-07-11 14:04:19.912483 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:19.912623 I | ceph-mgr: 2017-07-11 14:04:19.912587 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:19.912944 I | ceph-mgr: 2017-07-11 14:04:19.912927 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:21.928185 I | ceph-mgr: 2017-07-11 14:04:21.928140 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:21.928329 I | ceph-mgr: 2017-07-11 14:04:21.928261 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:21.928608 I | ceph-mgr: 2017-07-11 14:04:21.928592 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:23.936604 I | ceph-mgr: 2017-07-11 14:04:23.936556 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:23.936784 I | ceph-mgr: 2017-07-11 14:04:23.936705 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:23.937018 I | ceph-mgr: 2017-07-11 14:04:23.936997 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:25.943170 I | ceph-mgr: 2017-07-11 14:04:25.943117 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:25.943263 I | ceph-mgr: 2017-07-11 14:04:25.943248 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:25.943519 I | ceph-mgr: 2017-07-11 14:04:25.943503 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:27.945525 I | ceph-mgr: 2017-07-11 14:04:27.945476 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:27.951633 I | ceph-mgr: 2017-07-11 14:04:27.951616 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:27.951795 I | ceph-mgr: 2017-07-11 14:04:27.951769 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:29.955976 I | ceph-mgr: 2017-07-11 14:04:29.955891 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:29.956245 I | ceph-mgr: 2017-07-11 14:04:29.956092 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:29.956489 I | ceph-mgr: 2017-07-11 14:04:29.956473 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:31.958936 I | ceph-mgr: 2017-07-11 14:04:31.958891 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:31.959038 I | ceph-mgr: 2017-07-11 14:04:31.959011 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:31.959278 I | ceph-mgr: 2017-07-11 14:04:31.959250 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:33.979997 I | ceph-mgr: 2017-07-11 14:04:33.979951 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:33.980217 I | ceph-mgr: 2017-07-11 14:04:33.980202 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:33.981669 I | ceph-mgr: 2017-07-11 14:04:33.981434 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:35.995524 I | ceph-mgr: 2017-07-11 14:04:35.995488 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:35.997826 I | ceph-mgr: 2017-07-11 14:04:35.997810 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:35.998035 I | ceph-mgr: 2017-07-11 14:04:35.998019 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:38.009978 I | ceph-mgr: 2017-07-11 14:04:38.009945 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:38.010055 I | ceph-mgr: 2017-07-11 14:04:38.010041 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:38.010272 I | ceph-mgr: 2017-07-11 14:04:38.010157 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:40.026110 I | ceph-mgr: 2017-07-11 14:04:40.026022 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:40.026217 I | ceph-mgr: 2017-07-11 14:04:40.026202 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:40.026510 I | ceph-mgr: 2017-07-11 14:04:40.026493 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:42.030964 I | ceph-mgr: 2017-07-11 14:04:42.030916 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:42.031049 I | ceph-mgr: 2017-07-11 14:04:42.031034 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:42.031313 I | ceph-mgr: 2017-07-11 14:04:42.031297 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:44.054498 I | ceph-mgr: 2017-07-11 14:04:44.054440 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:44.054639 I | ceph-mgr: 2017-07-11 14:04:44.054622 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:44.055007 I | ceph-mgr: 2017-07-11 14:04:44.054991 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:46.059934 I | ceph-mgr: 2017-07-11 14:04:46.059893 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:46.060159 I | ceph-mgr: 2017-07-11 14:04:46.060143 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:46.062591 I | ceph-mgr: 2017-07-11 14:04:46.062559 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:48.081722 I | ceph-mgr: 2017-07-11 14:04:48.080322 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:48.088435 I | ceph-mgr: 2017-07-11 14:04:48.080327 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:48.088470 I | ceph-mgr: 2017-07-11 14:04:48.080348 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:50.086898 I | ceph-mgr: 2017-07-11 14:04:50.086823 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:50.087006 I | ceph-mgr: 2017-07-11 14:04:50.086992 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:50.087269 I | ceph-mgr: 2017-07-11 14:04:50.087253 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:52.096122 I | ceph-mgr: 2017-07-11 14:04:52.096076 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:52.096214 I | ceph-mgr: 2017-07-11 14:04:52.096199 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:52.096644 I | ceph-mgr: 2017-07-11 14:04:52.096628 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:54.100000 I | ceph-mgr: 2017-07-11 14:04:54.099952 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:54.100110 I | ceph-mgr: 2017-07-11 14:04:54.100094 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:54.100362 I | ceph-mgr: 2017-07-11 14:04:54.100327 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:56.113153 I | ceph-mgr: 2017-07-11 14:04:56.111701 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:56.113320 I | ceph-mgr: 2017-07-11 14:04:56.111715 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:56.113454 I | ceph-mgr: 2017-07-11 14:04:56.111746 7f4cc3226700 0 mgr tick
- 2017-07-11 14:04:58.116013 I | ceph-mgr: 2017-07-11 14:04:58.114867 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:04:58.116163 I | ceph-mgr: 2017-07-11 14:04:58.114877 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:04:58.116210 I | ceph-mgr: 2017-07-11 14:04:58.114916 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:00.122900 I | ceph-mgr: 2017-07-11 14:05:00.122833 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:00.127331 I | ceph-mgr: 2017-07-11 14:05:00.127295 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:00.127749 I | ceph-mgr: 2017-07-11 14:05:00.127525 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:02.133045 I | ceph-mgr: 2017-07-11 14:05:02.133001 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:02.133115 I | ceph-mgr: 2017-07-11 14:05:02.133101 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:02.133351 I | ceph-mgr: 2017-07-11 14:05:02.133336 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:04.137048 I | ceph-mgr: 2017-07-11 14:05:04.137000 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:04.137138 I | ceph-mgr: 2017-07-11 14:05:04.137124 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:04.152909 I | ceph-mgr: 2017-07-11 14:05:04.152892 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:06.155513 I | ceph-mgr: 2017-07-11 14:05:06.155466 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:06.155597 I | ceph-mgr: 2017-07-11 14:05:06.155582 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:06.155843 I | ceph-mgr: 2017-07-11 14:05:06.155826 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:08.164057 I | ceph-mgr: 2017-07-11 14:05:08.163837 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:08.164136 I | ceph-mgr: 2017-07-11 14:05:08.164121 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:08.164370 I | ceph-mgr: 2017-07-11 14:05:08.164355 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:10.169824 I | ceph-mgr: 2017-07-11 14:05:10.169613 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:10.169905 I | ceph-mgr: 2017-07-11 14:05:10.169890 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:10.170146 I | ceph-mgr: 2017-07-11 14:05:10.170129 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:12.175317 I | ceph-mgr: 2017-07-11 14:05:12.175274 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:12.175386 I | ceph-mgr: 2017-07-11 14:05:12.175372 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:12.175638 I | ceph-mgr: 2017-07-11 14:05:12.175623 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:14.185270 I | ceph-mgr: 2017-07-11 14:05:14.185221 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:14.185362 I | ceph-mgr: 2017-07-11 14:05:14.185347 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:14.185813 I | ceph-mgr: 2017-07-11 14:05:14.185795 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:16.203170 I | ceph-mgr: 2017-07-11 14:05:16.203124 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:16.203251 I | ceph-mgr: 2017-07-11 14:05:16.203236 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:16.203525 I | ceph-mgr: 2017-07-11 14:05:16.203508 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:18.206880 I | ceph-mgr: 2017-07-11 14:05:18.206842 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:18.206997 I | ceph-mgr: 2017-07-11 14:05:18.206982 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:18.207267 I | ceph-mgr: 2017-07-11 14:05:18.207151 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:20.213009 I | ceph-mgr: 2017-07-11 14:05:20.212313 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:20.213176 I | ceph-mgr: 2017-07-11 14:05:20.212323 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:20.213369 I | ceph-mgr: 2017-07-11 14:05:20.212348 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:22.223214 I | ceph-mgr: 2017-07-11 14:05:22.221868 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:22.223429 I | ceph-mgr: 2017-07-11 14:05:22.221883 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:22.223456 I | ceph-mgr: 2017-07-11 14:05:22.221915 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:24.229411 I | ceph-mgr: 2017-07-11 14:05:24.229338 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:24.229498 I | ceph-mgr: 2017-07-11 14:05:24.229483 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:24.229966 I | ceph-mgr: 2017-07-11 14:05:24.229949 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:26.232701 I | ceph-mgr: 2017-07-11 14:05:26.232655 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:26.232787 I | ceph-mgr: 2017-07-11 14:05:26.232773 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:26.233040 I | ceph-mgr: 2017-07-11 14:05:26.233024 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:28.254321 I | ceph-mgr: 2017-07-11 14:05:28.254266 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:28.254392 I | ceph-mgr: 2017-07-11 14:05:28.254378 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:28.254654 I | ceph-mgr: 2017-07-11 14:05:28.254638 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:30.256353 I | ceph-mgr: 2017-07-11 14:05:30.256313 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:30.256441 I | ceph-mgr: 2017-07-11 14:05:30.256427 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:30.256661 I | ceph-mgr: 2017-07-11 14:05:30.256646 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:32.283712 I | ceph-mgr: 2017-07-11 14:05:32.274508 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:32.283813 I | ceph-mgr: 2017-07-11 14:05:32.283795 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:32.286542 I | ceph-mgr: 2017-07-11 14:05:32.286524 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:34.348961 I | ceph-mgr: 2017-07-11 14:05:34.348922 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:34.349031 I | ceph-mgr: 2017-07-11 14:05:34.349017 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:34.349263 I | ceph-mgr: 2017-07-11 14:05:34.349248 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:36.351977 I | ceph-mgr: 2017-07-11 14:05:36.351931 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:36.352057 I | ceph-mgr: 2017-07-11 14:05:36.352042 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:36.352315 I | ceph-mgr: 2017-07-11 14:05:36.352299 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:38.362043 I | ceph-mgr: 2017-07-11 14:05:38.362008 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:38.362118 I | ceph-mgr: 2017-07-11 14:05:38.362104 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:38.368157 I | ceph-mgr: 2017-07-11 14:05:38.368120 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:40.432832 I | ceph-mgr: 2017-07-11 14:05:40.387930 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:40.433048 I | ceph-mgr: 2017-07-11 14:05:40.387944 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:40.433074 I | ceph-mgr: 2017-07-11 14:05:40.387975 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:42.514413 I | ceph-mgr: 2017-07-11 14:05:42.444697 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:42.523176 I | ceph-mgr: 2017-07-11 14:05:42.444711 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:42.523208 I | ceph-mgr: 2017-07-11 14:05:42.444755 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:44.451230 I | ceph-mgr: 2017-07-11 14:05:44.451184 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:44.451417 I | ceph-mgr: 2017-07-11 14:05:44.451401 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:44.463288 I | ceph-mgr: 2017-07-11 14:05:44.463271 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:46.482762 I | ceph-mgr: 2017-07-11 14:05:46.482727 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:46.482838 I | ceph-mgr: 2017-07-11 14:05:46.482823 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:46.483068 I | ceph-mgr: 2017-07-11 14:05:46.483053 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:48.501646 I | ceph-mgr: 2017-07-11 14:05:48.501595 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:48.501913 I | ceph-mgr: 2017-07-11 14:05:48.501895 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:48.503518 I | ceph-mgr: 2017-07-11 14:05:48.503499 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:50.508368 I | ceph-mgr: 2017-07-11 14:05:50.508303 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:50.508589 I | ceph-mgr: 2017-07-11 14:05:50.508573 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:50.511135 I | ceph-mgr: 2017-07-11 14:05:50.511117 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:52.531560 I | ceph-mgr: 2017-07-11 14:05:52.529923 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:52.538171 I | ceph-mgr: 2017-07-11 14:05:52.529933 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:52.538208 I | ceph-mgr: 2017-07-11 14:05:52.529960 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:54.540133 I | ceph-mgr: 2017-07-11 14:05:54.540086 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:54.540232 I | ceph-mgr: 2017-07-11 14:05:54.540215 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:54.540479 I | ceph-mgr: 2017-07-11 14:05:54.540462 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:56.559584 I | ceph-mgr: 2017-07-11 14:05:56.559537 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:56.559808 I | ceph-mgr: 2017-07-11 14:05:56.559792 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:56.562135 I | ceph-mgr: 2017-07-11 14:05:56.562105 7f4cc3226700 0 mgr tick
- 2017-07-11 14:05:58.582095 I | ceph-mgr: 2017-07-11 14:05:58.582045 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:05:58.582339 I | ceph-mgr: 2017-07-11 14:05:58.582311 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:05:58.588653 I | ceph-mgr: 2017-07-11 14:05:58.588598 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:00.594357 I | ceph-mgr: 2017-07-11 14:06:00.594284 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:00.594581 I | ceph-mgr: 2017-07-11 14:06:00.594565 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:00.595809 I | ceph-mgr: 2017-07-11 14:06:00.595791 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:02.616968 I | ceph-mgr: 2017-07-11 14:06:02.616924 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:02.617059 I | ceph-mgr: 2017-07-11 14:06:02.617045 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:02.617303 I | ceph-mgr: 2017-07-11 14:06:02.617287 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:04.624918 I | ceph-mgr: 2017-07-11 14:06:04.624871 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:04.625022 I | ceph-mgr: 2017-07-11 14:06:04.625007 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:04.625329 I | ceph-mgr: 2017-07-11 14:06:04.625313 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:06.647414 I | ceph-mgr: 2017-07-11 14:06:06.647377 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:06.647557 I | ceph-mgr: 2017-07-11 14:06:06.647489 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:06.647790 I | ceph-mgr: 2017-07-11 14:06:06.647775 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:08.653918 I | ceph-mgr: 2017-07-11 14:06:08.653879 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:08.653998 I | ceph-mgr: 2017-07-11 14:06:08.653984 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:08.654241 I | ceph-mgr: 2017-07-11 14:06:08.654220 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:10.656047 I | ceph-mgr: 2017-07-11 14:06:10.655990 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:10.656138 I | ceph-mgr: 2017-07-11 14:06:10.656124 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:10.656606 I | ceph-mgr: 2017-07-11 14:06:10.656589 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:12.676385 I | ceph-mgr: 2017-07-11 14:06:12.676334 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:12.676480 I | ceph-mgr: 2017-07-11 14:06:12.676466 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:12.676724 I | ceph-mgr: 2017-07-11 14:06:12.676709 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:14.692363 I | ceph-mgr: 2017-07-11 14:06:14.692331 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:14.692441 I | ceph-mgr: 2017-07-11 14:06:14.692426 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:14.692661 I | ceph-mgr: 2017-07-11 14:06:14.692645 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:16.706255 I | ceph-mgr: 2017-07-11 14:06:16.706214 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:16.706431 I | ceph-mgr: 2017-07-11 14:06:16.706414 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:16.708085 I | ceph-mgr: 2017-07-11 14:06:16.708069 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:18.722554 I | ceph-mgr: 2017-07-11 14:06:18.722515 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:18.722631 I | ceph-mgr: 2017-07-11 14:06:18.722617 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:18.722857 I | ceph-mgr: 2017-07-11 14:06:18.722841 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:20.726117 I | ceph-mgr: 2017-07-11 14:06:20.726068 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:20.726198 I | ceph-mgr: 2017-07-11 14:06:20.726183 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:20.726456 I | ceph-mgr: 2017-07-11 14:06:20.726440 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:22.746061 I | ceph-mgr: 2017-07-11 14:06:22.745023 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:22.746122 I | ceph-mgr: 2017-07-11 14:06:22.745039 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:22.746139 I | ceph-mgr: 2017-07-11 14:06:22.745062 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:24.755494 I | ceph-mgr: 2017-07-11 14:06:24.751768 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:24.755719 I | ceph-mgr: 2017-07-11 14:06:24.751775 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:24.755748 I | ceph-mgr: 2017-07-11 14:06:24.751800 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:26.755307 I | ceph-mgr: 2017-07-11 14:06:26.755275 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:26.755379 I | ceph-mgr: 2017-07-11 14:06:26.755366 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:26.755592 I | ceph-mgr: 2017-07-11 14:06:26.755476 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:28.760403 I | ceph-mgr: 2017-07-11 14:06:28.760350 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:28.760503 I | ceph-mgr: 2017-07-11 14:06:28.760486 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:28.761045 I | ceph-mgr: 2017-07-11 14:06:28.761028 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:30.781801 I | ceph-mgr: 2017-07-11 14:06:30.781714 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:30.781904 I | ceph-mgr: 2017-07-11 14:06:30.781889 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:30.782149 I | ceph-mgr: 2017-07-11 14:06:30.782133 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:32.790610 I | ceph-mgr: 2017-07-11 14:06:32.790513 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:32.790685 I | ceph-mgr: 2017-07-11 14:06:32.790668 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:32.791102 I | ceph-mgr: 2017-07-11 14:06:32.790864 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:34.793949 I | ceph-mgr: 2017-07-11 14:06:34.793804 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:34.794036 I | ceph-mgr: 2017-07-11 14:06:34.794022 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:34.794280 I | ceph-mgr: 2017-07-11 14:06:34.794264 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:36.814553 I | ceph-mgr: 2017-07-11 14:06:36.814514 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:36.814626 I | ceph-mgr: 2017-07-11 14:06:36.814612 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:36.814868 I | ceph-mgr: 2017-07-11 14:06:36.814851 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:38.821932 I | ceph-mgr: 2017-07-11 14:06:38.821887 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:38.822013 I | ceph-mgr: 2017-07-11 14:06:38.821997 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:38.822276 I | ceph-mgr: 2017-07-11 14:06:38.822260 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:40.835864 I | ceph-mgr: 2017-07-11 14:06:40.832879 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:40.835948 I | ceph-mgr: 2017-07-11 14:06:40.835932 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:40.836183 I | ceph-mgr: 2017-07-11 14:06:40.836167 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:42.860965 I | ceph-mgr: 2017-07-11 14:06:42.859215 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:42.868823 I | ceph-mgr: 2017-07-11 14:06:42.859229 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:42.868860 I | ceph-mgr: 2017-07-11 14:06:42.859277 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:44.866896 I | ceph-mgr: 2017-07-11 14:06:44.866863 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:44.866986 I | ceph-mgr: 2017-07-11 14:06:44.866971 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:44.867232 I | ceph-mgr: 2017-07-11 14:06:44.867215 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:46.874500 I | ceph-mgr: 2017-07-11 14:06:46.872991 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:46.875191 I | ceph-mgr: 2017-07-11 14:06:46.873007 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:46.875222 I | ceph-mgr: 2017-07-11 14:06:46.873062 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:48.874846 I | ceph-mgr: 2017-07-11 14:06:48.874787 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:48.882194 I | ceph-mgr: 2017-07-11 14:06:48.882174 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:48.894817 I | ceph-mgr: 2017-07-11 14:06:48.894794 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:50.915696 I | ceph-mgr: 2017-07-11 14:06:50.915653 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:50.915778 I | ceph-mgr: 2017-07-11 14:06:50.915763 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:50.921865 I | ceph-mgr: 2017-07-11 14:06:50.921844 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:52.949262 I | ceph-mgr: 2017-07-11 14:06:52.949217 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:52.949338 I | ceph-mgr: 2017-07-11 14:06:52.949325 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:52.949571 I | ceph-mgr: 2017-07-11 14:06:52.949555 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:55.005354 I | ceph-mgr: 2017-07-11 14:06:55.002189 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:55.005370 I | ceph-mgr: 2017-07-11 14:06:55.002201 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:55.005373 I | ceph-mgr: 2017-07-11 14:06:55.002230 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:57.004271 I | ceph-mgr: 2017-07-11 14:06:57.004154 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:57.004345 I | ceph-mgr: 2017-07-11 14:06:57.004331 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:57.004595 I | ceph-mgr: 2017-07-11 14:06:57.004579 7f4cc3226700 0 mgr tick
- 2017-07-11 14:06:59.011892 I | ceph-mgr: 2017-07-11 14:06:59.011838 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:06:59.012086 I | ceph-mgr: 2017-07-11 14:06:59.012068 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:06:59.012323 I | ceph-mgr: 2017-07-11 14:06:59.012306 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:01.036019 I | ceph-mgr: 2017-07-11 14:07:01.035944 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:01.036206 I | ceph-mgr: 2017-07-11 14:07:01.036129 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:01.036416 I | ceph-mgr: 2017-07-11 14:07:01.036385 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:03.041747 I | ceph-mgr: 2017-07-11 14:07:03.041702 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:03.048076 I | ceph-mgr: 2017-07-11 14:07:03.048054 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:03.060779 I | ceph-mgr: 2017-07-11 14:07:03.060761 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:05.080063 I | ceph-mgr: 2017-07-11 14:07:05.079995 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:05.080288 I | ceph-mgr: 2017-07-11 14:07:05.080272 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:05.081591 I | ceph-mgr: 2017-07-11 14:07:05.081559 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:07.090227 I | ceph-mgr: 2017-07-11 14:07:07.090061 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:07.090327 I | ceph-mgr: 2017-07-11 14:07:07.090311 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:07.090592 I | ceph-mgr: 2017-07-11 14:07:07.090574 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:09.099745 I | ceph-mgr: 2017-07-11 14:07:09.099699 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:09.101482 I | ceph-mgr: 2017-07-11 14:07:09.099926 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:09.101904 I | ceph-mgr: 2017-07-11 14:07:09.101887 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:11.111027 I | ceph-mgr: 2017-07-11 14:07:11.109487 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:11.111237 I | ceph-mgr: 2017-07-11 14:07:11.109511 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:11.111334 I | ceph-mgr: 2017-07-11 14:07:11.109552 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:13.118871 I | ceph-mgr: 2017-07-11 14:07:13.117503 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:13.119078 I | ceph-mgr: 2017-07-11 14:07:13.117508 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:13.119105 I | ceph-mgr: 2017-07-11 14:07:13.117530 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:15.127185 I | ceph-mgr: 2017-07-11 14:07:15.127120 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:15.127439 I | ceph-mgr: 2017-07-11 14:07:15.127292 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:15.127889 I | ceph-mgr: 2017-07-11 14:07:15.127872 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:17.134960 I | ceph-mgr: 2017-07-11 14:07:17.134916 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:17.135048 I | ceph-mgr: 2017-07-11 14:07:17.135033 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:17.135292 I | ceph-mgr: 2017-07-11 14:07:17.135275 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:19.143260 I | ceph-mgr: 2017-07-11 14:07:19.143186 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:19.143536 I | ceph-mgr: 2017-07-11 14:07:19.143376 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:19.143774 I | ceph-mgr: 2017-07-11 14:07:19.143759 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:21.147562 I | ceph-mgr: 2017-07-11 14:07:21.147501 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:21.147662 I | ceph-mgr: 2017-07-11 14:07:21.147647 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:21.147886 I | ceph-mgr: 2017-07-11 14:07:21.147870 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:23.150921 I | ceph-mgr: 2017-07-11 14:07:23.150890 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:23.150998 I | ceph-mgr: 2017-07-11 14:07:23.150983 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:23.151211 I | ceph-mgr: 2017-07-11 14:07:23.151096 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:25.170951 I | ceph-mgr: 2017-07-11 14:07:25.170894 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:25.171024 I | ceph-mgr: 2017-07-11 14:07:25.171009 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:25.171271 I | ceph-mgr: 2017-07-11 14:07:25.171256 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:27.176092 I | ceph-mgr: 2017-07-11 14:07:27.176031 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:27.176181 I | ceph-mgr: 2017-07-11 14:07:27.176166 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:27.176650 I | ceph-mgr: 2017-07-11 14:07:27.176631 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:29.186414 I | ceph-mgr: 2017-07-11 14:07:29.186369 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:29.186506 I | ceph-mgr: 2017-07-11 14:07:29.186491 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:29.186767 I | ceph-mgr: 2017-07-11 14:07:29.186750 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:31.193318 I | ceph-mgr: 2017-07-11 14:07:31.193282 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:31.193406 I | ceph-mgr: 2017-07-11 14:07:31.193391 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:31.193616 I | ceph-mgr: 2017-07-11 14:07:31.193499 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:33.196112 I | ceph-mgr: 2017-07-11 14:07:33.196081 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:33.196194 I | ceph-mgr: 2017-07-11 14:07:33.196179 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:33.213514 I | ceph-mgr: 2017-07-11 14:07:33.212009 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:35.222880 I | ceph-mgr: 2017-07-11 14:07:35.221094 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:35.223101 I | ceph-mgr: 2017-07-11 14:07:35.221122 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:35.223201 I | ceph-mgr: 2017-07-11 14:07:35.221261 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:37.230283 I | ceph-mgr: 2017-07-11 14:07:37.228697 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:37.230353 I | ceph-mgr: 2017-07-11 14:07:37.228712 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:37.230374 I | ceph-mgr: 2017-07-11 14:07:37.228823 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:39.235323 I | ceph-mgr: 2017-07-11 14:07:39.235255 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:39.235409 I | ceph-mgr: 2017-07-11 14:07:39.235396 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:39.238865 I | ceph-mgr: 2017-07-11 14:07:39.238849 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:41.262955 I | ceph-mgr: 2017-07-11 14:07:41.261467 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:41.263174 I | ceph-mgr: 2017-07-11 14:07:41.261485 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:41.263274 I | ceph-mgr: 2017-07-11 14:07:41.261533 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:43.279849 I | ceph-mgr: 2017-07-11 14:07:43.270266 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:43.279914 I | ceph-mgr: 2017-07-11 14:07:43.270276 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:43.280113 I | ceph-mgr: 2017-07-11 14:07:43.270301 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:45.298306 I | ceph-mgr: 2017-07-11 14:07:45.298267 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:45.298385 I | ceph-mgr: 2017-07-11 14:07:45.298371 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:45.298616 I | ceph-mgr: 2017-07-11 14:07:45.298600 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:47.315980 I | ceph-mgr: 2017-07-11 14:07:47.315935 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:47.316064 I | ceph-mgr: 2017-07-11 14:07:47.316049 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:47.316334 I | ceph-mgr: 2017-07-11 14:07:47.316317 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:49.338435 I | ceph-mgr: 2017-07-11 14:07:49.338372 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:49.338515 I | ceph-mgr: 2017-07-11 14:07:49.338500 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:49.338773 I | ceph-mgr: 2017-07-11 14:07:49.338757 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:51.347060 I | ceph-mgr: 2017-07-11 14:07:51.347013 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:51.347136 I | ceph-mgr: 2017-07-11 14:07:51.347122 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:51.347388 I | ceph-mgr: 2017-07-11 14:07:51.347373 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:53.352439 I | ceph-mgr: 2017-07-11 14:07:53.352408 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:53.352519 I | ceph-mgr: 2017-07-11 14:07:53.352506 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:53.352735 I | ceph-mgr: 2017-07-11 14:07:53.352720 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:55.371812 I | ceph-mgr: 2017-07-11 14:07:55.371771 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:55.371903 I | ceph-mgr: 2017-07-11 14:07:55.371888 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:55.372137 I | ceph-mgr: 2017-07-11 14:07:55.372121 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:57.375575 I | ceph-mgr: 2017-07-11 14:07:57.374027 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:57.375698 I | ceph-mgr: 2017-07-11 14:07:57.375681 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:57.376021 I | ceph-mgr: 2017-07-11 14:07:57.376004 7f4cc3226700 0 mgr tick
- 2017-07-11 14:07:59.382334 I | ceph-mgr: 2017-07-11 14:07:59.382287 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:07:59.382424 I | ceph-mgr: 2017-07-11 14:07:59.382410 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:07:59.382671 I | ceph-mgr: 2017-07-11 14:07:59.382655 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:01.396593 I | ceph-mgr: 2017-07-11 14:08:01.396547 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:01.396676 I | ceph-mgr: 2017-07-11 14:08:01.396661 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:01.396916 I | ceph-mgr: 2017-07-11 14:08:01.396901 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:03.411547 I | ceph-mgr: 2017-07-11 14:08:03.401708 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:03.411785 I | ceph-mgr: 2017-07-11 14:08:03.411767 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:03.442820 I | ceph-mgr: 2017-07-11 14:08:03.441099 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:05.482158 I | ceph-mgr: 2017-07-11 14:08:05.444352 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:05.482233 I | ceph-mgr: 2017-07-11 14:08:05.451996 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:05.482250 I | ceph-mgr: 2017-07-11 14:08:05.452114 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:07.490261 I | ceph-mgr: 2017-07-11 14:08:07.490181 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:07.490516 I | ceph-mgr: 2017-07-11 14:08:07.490376 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:07.490867 I | ceph-mgr: 2017-07-11 14:08:07.490649 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:09.494484 I | ceph-mgr: 2017-07-11 14:08:09.492851 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:09.494575 I | ceph-mgr: 2017-07-11 14:08:09.494559 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:09.494818 I | ceph-mgr: 2017-07-11 14:08:09.494803 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:11.496754 I | ceph-mgr: 2017-07-11 14:08:11.496716 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:11.496833 I | ceph-mgr: 2017-07-11 14:08:11.496818 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:11.497063 I | ceph-mgr: 2017-07-11 14:08:11.497047 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:13.517203 I | ceph-mgr: 2017-07-11 14:08:13.516643 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:13.517299 I | ceph-mgr: 2017-07-11 14:08:13.517284 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:13.517532 I | ceph-mgr: 2017-07-11 14:08:13.517517 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:15.519916 I | ceph-mgr: 2017-07-11 14:08:15.519873 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:15.520148 I | ceph-mgr: 2017-07-11 14:08:15.520130 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:15.523175 I | ceph-mgr: 2017-07-11 14:08:15.523159 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:17.546671 I | ceph-mgr: 2017-07-11 14:08:17.546640 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:17.546755 I | ceph-mgr: 2017-07-11 14:08:17.546741 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:17.546973 I | ceph-mgr: 2017-07-11 14:08:17.546958 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:19.551315 I | ceph-mgr: 2017-07-11 14:08:19.551271 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:19.551389 I | ceph-mgr: 2017-07-11 14:08:19.551374 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:19.551629 I | ceph-mgr: 2017-07-11 14:08:19.551612 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:21.576882 I | ceph-mgr: 2017-07-11 14:08:21.576847 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:21.576956 I | ceph-mgr: 2017-07-11 14:08:21.576942 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:21.577177 I | ceph-mgr: 2017-07-11 14:08:21.577162 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:23.585488 I | ceph-mgr: 2017-07-11 14:08:23.585381 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:23.585699 I | ceph-mgr: 2017-07-11 14:08:23.585612 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:23.585912 I | ceph-mgr: 2017-07-11 14:08:23.585896 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:25.596035 I | ceph-mgr: 2017-07-11 14:08:25.595877 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:25.596136 I | ceph-mgr: 2017-07-11 14:08:25.596119 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:25.596405 I | ceph-mgr: 2017-07-11 14:08:25.596388 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:27.598851 I | ceph-mgr: 2017-07-11 14:08:27.598802 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:27.645215 I | ceph-mgr: 2017-07-11 14:08:27.614967 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:27.645252 I | ceph-mgr: 2017-07-11 14:08:27.615087 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:29.620631 I | ceph-mgr: 2017-07-11 14:08:29.620567 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:29.620930 I | ceph-mgr: 2017-07-11 14:08:29.620914 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:29.622547 I | ceph-mgr: 2017-07-11 14:08:29.622369 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:31.626861 I | ceph-mgr: 2017-07-11 14:08:31.626828 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:31.626933 I | ceph-mgr: 2017-07-11 14:08:31.626919 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:31.627164 I | ceph-mgr: 2017-07-11 14:08:31.627148 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:33.652151 I | ceph-mgr: 2017-07-11 14:08:33.650829 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:33.659702 I | ceph-mgr: 2017-07-11 14:08:33.650834 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:33.659739 I | ceph-mgr: 2017-07-11 14:08:33.650852 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:35.668785 I | ceph-mgr: 2017-07-11 14:08:35.668737 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:35.669006 I | ceph-mgr: 2017-07-11 14:08:35.668989 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:35.669256 I | ceph-mgr: 2017-07-11 14:08:35.669241 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:37.673481 I | ceph-mgr: 2017-07-11 14:08:37.673417 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:37.683327 I | ceph-mgr: 2017-07-11 14:08:37.683283 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:37.683797 I | ceph-mgr: 2017-07-11 14:08:37.683779 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:39.690303 I | ceph-mgr: 2017-07-11 14:08:39.690270 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:39.690392 I | ceph-mgr: 2017-07-11 14:08:39.690378 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:39.690615 I | ceph-mgr: 2017-07-11 14:08:39.690598 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:41.695340 I | ceph-mgr: 2017-07-11 14:08:41.695289 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:41.695560 I | ceph-mgr: 2017-07-11 14:08:41.695544 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:41.697362 I | ceph-mgr: 2017-07-11 14:08:41.697347 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:43.705435 I | ceph-mgr: 2017-07-11 14:08:43.705363 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:43.705530 I | ceph-mgr: 2017-07-11 14:08:43.705514 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:43.706067 I | ceph-mgr: 2017-07-11 14:08:43.706048 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:45.713347 I | ceph-mgr: 2017-07-11 14:08:45.712800 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:45.713559 I | ceph-mgr: 2017-07-11 14:08:45.712813 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:45.713586 I | ceph-mgr: 2017-07-11 14:08:45.712843 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:47.733296 I | ceph-mgr: 2017-07-11 14:08:47.733267 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:47.733363 I | ceph-mgr: 2017-07-11 14:08:47.733349 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:47.733582 I | ceph-mgr: 2017-07-11 14:08:47.733467 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:49.756220 I | ceph-mgr: 2017-07-11 14:08:49.756187 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:49.756320 I | ceph-mgr: 2017-07-11 14:08:49.756305 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:49.756550 I | ceph-mgr: 2017-07-11 14:08:49.756534 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:51.763906 I | ceph-mgr: 2017-07-11 14:08:51.763859 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:51.763981 I | ceph-mgr: 2017-07-11 14:08:51.763967 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:51.764204 I | ceph-mgr: 2017-07-11 14:08:51.764086 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:53.768574 I | ceph-mgr: 2017-07-11 14:08:53.768522 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:53.768703 I | ceph-mgr: 2017-07-11 14:08:53.768688 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:53.769027 I | ceph-mgr: 2017-07-11 14:08:53.769011 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:55.776641 I | ceph-mgr: 2017-07-11 14:08:55.776562 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:55.776750 I | ceph-mgr: 2017-07-11 14:08:55.776735 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:55.777013 I | ceph-mgr: 2017-07-11 14:08:55.776997 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:57.782179 I | ceph-mgr: 2017-07-11 14:08:57.782103 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:57.785460 I | ceph-mgr: 2017-07-11 14:08:57.785444 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:57.785907 I | ceph-mgr: 2017-07-11 14:08:57.785890 7f4cc3226700 0 mgr tick
- 2017-07-11 14:08:59.805449 I | ceph-mgr: 2017-07-11 14:08:59.805417 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:08:59.805621 I | ceph-mgr: 2017-07-11 14:08:59.805605 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:08:59.807680 I | ceph-mgr: 2017-07-11 14:08:59.807665 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:01.810962 I | ceph-mgr: 2017-07-11 14:09:01.810916 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:01.811186 I | ceph-mgr: 2017-07-11 14:09:01.811170 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:01.811490 I | ceph-mgr: 2017-07-11 14:09:01.811475 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:03.817596 I | ceph-mgr: 2017-07-11 14:09:03.817551 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:03.817700 I | ceph-mgr: 2017-07-11 14:09:03.817673 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:03.833462 I | ceph-mgr: 2017-07-11 14:09:03.833442 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:05.838909 I | ceph-mgr: 2017-07-11 14:09:05.838861 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:05.841183 I | ceph-mgr: 2017-07-11 14:09:05.841142 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:05.841277 I | ceph-mgr: 2017-07-11 14:09:05.841266 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:07.861536 I | ceph-mgr: 2017-07-11 14:09:07.861500 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:07.861606 I | ceph-mgr: 2017-07-11 14:09:07.861592 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:07.861850 I | ceph-mgr: 2017-07-11 14:09:07.861833 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:09.866807 I | ceph-mgr: 2017-07-11 14:09:09.866763 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:09.868032 I | ceph-mgr: 2017-07-11 14:09:09.866988 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:09.868277 I | ceph-mgr: 2017-07-11 14:09:09.868252 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:11.878880 I | ceph-mgr: 2017-07-11 14:09:11.878773 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:11.878966 I | ceph-mgr: 2017-07-11 14:09:11.878951 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:11.879221 I | ceph-mgr: 2017-07-11 14:09:11.879205 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:13.885668 I | ceph-mgr: 2017-07-11 14:09:13.884705 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:13.885754 I | ceph-mgr: 2017-07-11 14:09:13.885738 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:13.886000 I | ceph-mgr: 2017-07-11 14:09:13.885984 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:15.887870 I | ceph-mgr: 2017-07-11 14:09:15.887827 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:15.887955 I | ceph-mgr: 2017-07-11 14:09:15.887940 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:15.896120 I | ceph-mgr: 2017-07-11 14:09:15.896102 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:17.905352 I | ceph-mgr: 2017-07-11 14:09:17.905294 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:17.905439 I | ceph-mgr: 2017-07-11 14:09:17.905422 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:17.905706 I | ceph-mgr: 2017-07-11 14:09:17.905690 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:19.907633 I | ceph-mgr: 2017-07-11 14:09:19.907540 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:19.907716 I | ceph-mgr: 2017-07-11 14:09:19.907702 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:19.907942 I | ceph-mgr: 2017-07-11 14:09:19.907920 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:21.913286 I | ceph-mgr: 2017-07-11 14:09:21.913225 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:21.913607 I | ceph-mgr: 2017-07-11 14:09:21.913592 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:21.914820 I | ceph-mgr: 2017-07-11 14:09:21.914804 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:23.921268 I | ceph-mgr: 2017-07-11 14:09:23.921196 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:23.923116 I | ceph-mgr: 2017-07-11 14:09:23.923094 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:23.923564 I | ceph-mgr: 2017-07-11 14:09:23.923547 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:25.931788 I | ceph-mgr: 2017-07-11 14:09:25.931741 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:25.931885 I | ceph-mgr: 2017-07-11 14:09:25.931869 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:25.932156 I | ceph-mgr: 2017-07-11 14:09:25.932120 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:27.955997 I | ceph-mgr: 2017-07-11 14:09:27.955948 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:27.956169 I | ceph-mgr: 2017-07-11 14:09:27.956075 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:27.956652 I | ceph-mgr: 2017-07-11 14:09:27.956635 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:29.960170 I | ceph-mgr: 2017-07-11 14:09:29.960140 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:29.960242 I | ceph-mgr: 2017-07-11 14:09:29.960228 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:29.960410 I | ceph-mgr: 2017-07-11 14:09:29.960346 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:31.981134 I | ceph-mgr: 2017-07-11 14:09:31.963446 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:31.981249 I | ceph-mgr: 2017-07-11 14:09:31.978955 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:31.981266 I | ceph-mgr: 2017-07-11 14:09:31.979076 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:33.990910 I | ceph-mgr: 2017-07-11 14:09:33.981032 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:33.990994 I | ceph-mgr: 2017-07-11 14:09:33.981050 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:33.991011 I | ceph-mgr: 2017-07-11 14:09:33.981136 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:35.998610 I | ceph-mgr: 2017-07-11 14:09:35.996723 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:35.998720 I | ceph-mgr: 2017-07-11 14:09:35.998704 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:35.998955 I | ceph-mgr: 2017-07-11 14:09:35.998939 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:38.000794 I | ceph-mgr: 2017-07-11 14:09:38.000722 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:38.000889 I | ceph-mgr: 2017-07-11 14:09:38.000874 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:38.001117 I | ceph-mgr: 2017-07-11 14:09:38.001101 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:40.018459 I | ceph-mgr: 2017-07-11 14:09:40.018407 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:40.018548 I | ceph-mgr: 2017-07-11 14:09:40.018533 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:40.018810 I | ceph-mgr: 2017-07-11 14:09:40.018792 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:42.027460 I | ceph-mgr: 2017-07-11 14:09:42.027417 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:42.027532 I | ceph-mgr: 2017-07-11 14:09:42.027516 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:42.027780 I | ceph-mgr: 2017-07-11 14:09:42.027765 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:44.037178 I | ceph-mgr: 2017-07-11 14:09:44.036540 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:44.037311 I | ceph-mgr: 2017-07-11 14:09:44.037279 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:44.037793 I | ceph-mgr: 2017-07-11 14:09:44.037775 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:46.044796 I | ceph-mgr: 2017-07-11 14:09:46.044754 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:46.044876 I | ceph-mgr: 2017-07-11 14:09:46.044859 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:46.045140 I | ceph-mgr: 2017-07-11 14:09:46.045122 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:48.048797 I | ceph-mgr: 2017-07-11 14:09:48.048753 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:48.048874 I | ceph-mgr: 2017-07-11 14:09:48.048860 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:48.049116 I | ceph-mgr: 2017-07-11 14:09:48.049100 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:50.059515 I | ceph-mgr: 2017-07-11 14:09:50.059469 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:50.059587 I | ceph-mgr: 2017-07-11 14:09:50.059572 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:50.059822 I | ceph-mgr: 2017-07-11 14:09:50.059806 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:52.085931 I | ceph-mgr: 2017-07-11 14:09:52.085866 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:52.086055 I | ceph-mgr: 2017-07-11 14:09:52.086030 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:52.086360 I | ceph-mgr: 2017-07-11 14:09:52.086344 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:54.093751 I | ceph-mgr: 2017-07-11 14:09:54.093709 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:54.093805 I | ceph-mgr: 2017-07-11 14:09:54.093789 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:54.093920 I | ceph-mgr: 2017-07-11 14:09:54.093906 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:56.111881 I | ceph-mgr: 2017-07-11 14:09:56.111809 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:56.112202 I | ceph-mgr: 2017-07-11 14:09:56.112148 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:56.112518 I | ceph-mgr: 2017-07-11 14:09:56.112350 7f4cc3226700 0 mgr tick
- 2017-07-11 14:09:58.117660 I | ceph-mgr: 2017-07-11 14:09:58.117610 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:09:58.117741 I | ceph-mgr: 2017-07-11 14:09:58.117726 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:09:58.118205 I | ceph-mgr: 2017-07-11 14:09:58.118188 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:00.131057 I | ceph-mgr: 2017-07-11 14:10:00.131028 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:00.131275 I | ceph-mgr: 2017-07-11 14:10:00.131260 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:00.131498 I | ceph-mgr: 2017-07-11 14:10:00.131472 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:02.135406 I | ceph-mgr: 2017-07-11 14:10:02.135359 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:02.135505 I | ceph-mgr: 2017-07-11 14:10:02.135490 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:02.135777 I | ceph-mgr: 2017-07-11 14:10:02.135761 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:04.151417 I | ceph-mgr: 2017-07-11 14:10:04.151379 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:04.151495 I | ceph-mgr: 2017-07-11 14:10:04.151481 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:04.151725 I | ceph-mgr: 2017-07-11 14:10:04.151709 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:06.172821 I | ceph-mgr: 2017-07-11 14:10:06.172781 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:06.173045 I | ceph-mgr: 2017-07-11 14:10:06.173030 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:06.176728 I | ceph-mgr: 2017-07-11 14:10:06.176713 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:08.190197 I | ceph-mgr: 2017-07-11 14:10:08.190130 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:08.190237 I | ceph-mgr: 2017-07-11 14:10:08.190224 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:08.190363 I | ceph-mgr: 2017-07-11 14:10:08.190349 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:10.196851 I | ceph-mgr: 2017-07-11 14:10:10.196801 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:10.196942 I | ceph-mgr: 2017-07-11 14:10:10.196927 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:10.197194 I | ceph-mgr: 2017-07-11 14:10:10.197178 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:12.207280 I | ceph-mgr: 2017-07-11 14:10:12.205802 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:12.207494 I | ceph-mgr: 2017-07-11 14:10:12.205817 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:12.207591 I | ceph-mgr: 2017-07-11 14:10:12.205849 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:14.208312 I | ceph-mgr: 2017-07-11 14:10:14.208218 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:14.208405 I | ceph-mgr: 2017-07-11 14:10:14.208391 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:14.208634 I | ceph-mgr: 2017-07-11 14:10:14.208619 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:16.213255 I | ceph-mgr: 2017-07-11 14:10:16.211782 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:16.221475 I | ceph-mgr: 2017-07-11 14:10:16.221418 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:16.225004 I | ceph-mgr: 2017-07-11 14:10:16.224987 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:18.256903 I | ceph-mgr: 2017-07-11 14:10:18.256824 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:18.258549 I | ceph-mgr: 2017-07-11 14:10:18.258486 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:18.258773 I | ceph-mgr: 2017-07-11 14:10:18.258757 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:20.263631 I | ceph-mgr: 2017-07-11 14:10:20.263449 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:20.263888 I | ceph-mgr: 2017-07-11 14:10:20.263736 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:20.264143 I | ceph-mgr: 2017-07-11 14:10:20.264128 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:22.273264 I | ceph-mgr: 2017-07-11 14:10:22.273218 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:22.273340 I | ceph-mgr: 2017-07-11 14:10:22.273326 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:22.273589 I | ceph-mgr: 2017-07-11 14:10:22.273573 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:24.291838 I | ceph-mgr: 2017-07-11 14:10:24.291789 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:24.291923 I | ceph-mgr: 2017-07-11 14:10:24.291909 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:24.292171 I | ceph-mgr: 2017-07-11 14:10:24.292156 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:26.294371 I | ceph-mgr: 2017-07-11 14:10:26.294324 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:26.294461 I | ceph-mgr: 2017-07-11 14:10:26.294434 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:26.294761 I | ceph-mgr: 2017-07-11 14:10:26.294744 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:28.335222 I | ceph-mgr: 2017-07-11 14:10:28.318320 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:28.335528 I | ceph-mgr: 2017-07-11 14:10:28.318327 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:28.335559 I | ceph-mgr: 2017-07-11 14:10:28.318355 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:30.338243 I | ceph-mgr: 2017-07-11 14:10:30.338201 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:30.338436 I | ceph-mgr: 2017-07-11 14:10:30.338420 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:30.340148 I | ceph-mgr: 2017-07-11 14:10:30.340132 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:32.349356 I | ceph-mgr: 2017-07-11 14:10:32.349305 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:32.349443 I | ceph-mgr: 2017-07-11 14:10:32.349429 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:32.352061 I | ceph-mgr: 2017-07-11 14:10:32.352038 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:34.365706 I | ceph-mgr: 2017-07-11 14:10:34.365602 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:34.365810 I | ceph-mgr: 2017-07-11 14:10:34.365792 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:34.366183 I | ceph-mgr: 2017-07-11 14:10:34.366167 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:36.370526 I | ceph-mgr: 2017-07-11 14:10:36.370455 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:36.370603 I | ceph-mgr: 2017-07-11 14:10:36.370589 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:36.370844 I | ceph-mgr: 2017-07-11 14:10:36.370829 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:38.374609 I | ceph-mgr: 2017-07-11 14:10:38.374572 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:38.374689 I | ceph-mgr: 2017-07-11 14:10:38.374675 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:38.374922 I | ceph-mgr: 2017-07-11 14:10:38.374906 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:40.378033 I | ceph-mgr: 2017-07-11 14:10:40.377993 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:40.378261 I | ceph-mgr: 2017-07-11 14:10:40.378243 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:40.379663 I | ceph-mgr: 2017-07-11 14:10:40.379636 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:42.382413 I | ceph-mgr: 2017-07-11 14:10:42.382361 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:42.382509 I | ceph-mgr: 2017-07-11 14:10:42.382494 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:42.382781 I | ceph-mgr: 2017-07-11 14:10:42.382754 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:44.400243 I | ceph-mgr: 2017-07-11 14:10:44.400194 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:44.400321 I | ceph-mgr: 2017-07-11 14:10:44.400306 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:44.400569 I | ceph-mgr: 2017-07-11 14:10:44.400554 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:46.425804 I | ceph-mgr: 2017-07-11 14:10:46.425725 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:46.425986 I | ceph-mgr: 2017-07-11 14:10:46.425970 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:46.426267 I | ceph-mgr: 2017-07-11 14:10:46.426250 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:48.431608 I | ceph-mgr: 2017-07-11 14:10:48.431575 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:48.431779 I | ceph-mgr: 2017-07-11 14:10:48.431764 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:48.433906 I | ceph-mgr: 2017-07-11 14:10:48.433889 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:50.439049 I | ceph-mgr: 2017-07-11 14:10:50.439014 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:50.439216 I | ceph-mgr: 2017-07-11 14:10:50.439200 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:50.440702 I | ceph-mgr: 2017-07-11 14:10:50.440687 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:52.450988 I | ceph-mgr: 2017-07-11 14:10:52.449597 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:52.451197 I | ceph-mgr: 2017-07-11 14:10:52.449602 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:52.451224 I | ceph-mgr: 2017-07-11 14:10:52.449623 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:54.453645 I | ceph-mgr: 2017-07-11 14:10:54.453601 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:54.453717 I | ceph-mgr: 2017-07-11 14:10:54.453703 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:54.453956 I | ceph-mgr: 2017-07-11 14:10:54.453940 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:56.464981 I | ceph-mgr: 2017-07-11 14:10:56.464946 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:56.465070 I | ceph-mgr: 2017-07-11 14:10:56.465055 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:56.465286 I | ceph-mgr: 2017-07-11 14:10:56.465271 7f4cc3226700 0 mgr tick
- 2017-07-11 14:10:58.483044 I | ceph-mgr: 2017-07-11 14:10:58.482990 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:10:58.483300 I | ceph-mgr: 2017-07-11 14:10:58.483282 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:10:58.483752 I | ceph-mgr: 2017-07-11 14:10:58.483728 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:00.495377 I | ceph-mgr: 2017-07-11 14:11:00.495304 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:00.495684 I | ceph-mgr: 2017-07-11 14:11:00.495668 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:00.495956 I | ceph-mgr: 2017-07-11 14:11:00.495941 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:02.536786 I | ceph-mgr: 2017-07-11 14:11:02.536750 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:02.536864 I | ceph-mgr: 2017-07-11 14:11:02.536850 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:02.537103 I | ceph-mgr: 2017-07-11 14:11:02.537088 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:04.540371 I | ceph-mgr: 2017-07-11 14:11:04.540324 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:04.540410 I | ceph-mgr: 2017-07-11 14:11:04.540398 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:04.540542 I | ceph-mgr: 2017-07-11 14:11:04.540528 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:06.551116 I | ceph-mgr: 2017-07-11 14:11:06.551082 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:06.551189 I | ceph-mgr: 2017-07-11 14:11:06.551175 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:06.551365 I | ceph-mgr: 2017-07-11 14:11:06.551292 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:08.569122 I | ceph-mgr: 2017-07-11 14:11:08.569065 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:08.569325 I | ceph-mgr: 2017-07-11 14:11:08.569221 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:08.569695 I | ceph-mgr: 2017-07-11 14:11:08.569679 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:10.572608 I | ceph-mgr: 2017-07-11 14:11:10.572529 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:10.572745 I | ceph-mgr: 2017-07-11 14:11:10.572727 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:10.573416 I | ceph-mgr: 2017-07-11 14:11:10.573398 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:12.579615 I | ceph-mgr: 2017-07-11 14:11:12.577960 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:12.579715 I | ceph-mgr: 2017-07-11 14:11:12.579698 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:12.579992 I | ceph-mgr: 2017-07-11 14:11:12.579966 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:14.591730 I | ceph-mgr: 2017-07-11 14:11:14.590237 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:14.591817 I | ceph-mgr: 2017-07-11 14:11:14.591801 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:14.592091 I | ceph-mgr: 2017-07-11 14:11:14.592075 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:16.622077 I | ceph-mgr: 2017-07-11 14:11:16.622045 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:16.622147 I | ceph-mgr: 2017-07-11 14:11:16.622133 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:16.622373 I | ceph-mgr: 2017-07-11 14:11:16.622358 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:18.640186 I | ceph-mgr: 2017-07-11 14:11:18.638827 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:18.640408 I | ceph-mgr: 2017-07-11 14:11:18.638833 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:18.640565 I | ceph-mgr: 2017-07-11 14:11:18.638856 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:20.645100 I | ceph-mgr: 2017-07-11 14:11:20.644967 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:20.655579 I | ceph-mgr: 2017-07-11 14:11:20.655557 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:20.655861 I | ceph-mgr: 2017-07-11 14:11:20.655834 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:22.662724 I | ceph-mgr: 2017-07-11 14:11:22.662687 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:22.662951 I | ceph-mgr: 2017-07-11 14:11:22.662934 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:22.664395 I | ceph-mgr: 2017-07-11 14:11:22.664379 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:24.671655 I | ceph-mgr: 2017-07-11 14:11:24.671605 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:24.671880 I | ceph-mgr: 2017-07-11 14:11:24.671865 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:24.674356 I | ceph-mgr: 2017-07-11 14:11:24.674341 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:26.697295 I | ceph-mgr: 2017-07-11 14:11:26.697246 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:26.697383 I | ceph-mgr: 2017-07-11 14:11:26.697370 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:26.697901 I | ceph-mgr: 2017-07-11 14:11:26.697884 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:28.715692 I | ceph-mgr: 2017-07-11 14:11:28.714259 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:28.715758 I | ceph-mgr: 2017-07-11 14:11:28.714278 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:28.715773 I | ceph-mgr: 2017-07-11 14:11:28.714327 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:30.721288 I | ceph-mgr: 2017-07-11 14:11:30.721244 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:30.721361 I | ceph-mgr: 2017-07-11 14:11:30.721347 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:30.721601 I | ceph-mgr: 2017-07-11 14:11:30.721586 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:32.731943 I | ceph-mgr: 2017-07-11 14:11:32.731891 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:32.732028 I | ceph-mgr: 2017-07-11 14:11:32.732013 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:32.732259 I | ceph-mgr: 2017-07-11 14:11:32.732244 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:34.737146 I | ceph-mgr: 2017-07-11 14:11:34.737113 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:34.737226 I | ceph-mgr: 2017-07-11 14:11:34.737212 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:34.737448 I | ceph-mgr: 2017-07-11 14:11:34.737432 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:36.743399 I | ceph-mgr: 2017-07-11 14:11:36.743281 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:36.743477 I | ceph-mgr: 2017-07-11 14:11:36.743459 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:36.743715 I | ceph-mgr: 2017-07-11 14:11:36.743690 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:38.754097 I | ceph-mgr: 2017-07-11 14:11:38.745453 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:38.754182 I | ceph-mgr: 2017-07-11 14:11:38.754164 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:38.755148 I | ceph-mgr: 2017-07-11 14:11:38.755129 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:40.757986 I | ceph-mgr: 2017-07-11 14:11:40.757353 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:40.758075 I | ceph-mgr: 2017-07-11 14:11:40.758058 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:40.758349 I | ceph-mgr: 2017-07-11 14:11:40.758333 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:42.826381 I | ceph-mgr: 2017-07-11 14:11:42.826331 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:42.826606 I | ceph-mgr: 2017-07-11 14:11:42.826589 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:42.828264 I | ceph-mgr: 2017-07-11 14:11:42.828246 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:44.832024 I | ceph-mgr: 2017-07-11 14:11:44.831989 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:44.832105 I | ceph-mgr: 2017-07-11 14:11:44.832090 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:44.832279 I | ceph-mgr: 2017-07-11 14:11:44.832263 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:46.837954 I | ceph-mgr: 2017-07-11 14:11:46.837910 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:46.838179 I | ceph-mgr: 2017-07-11 14:11:46.838162 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:46.851258 I | ceph-mgr: 2017-07-11 14:11:46.851216 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:48.878411 I | ceph-mgr: 2017-07-11 14:11:48.878378 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:48.878487 I | ceph-mgr: 2017-07-11 14:11:48.878473 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:48.878719 I | ceph-mgr: 2017-07-11 14:11:48.878588 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:50.882767 I | ceph-mgr: 2017-07-11 14:11:50.882723 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:50.882851 I | ceph-mgr: 2017-07-11 14:11:50.882837 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:50.883092 I | ceph-mgr: 2017-07-11 14:11:50.883076 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:52.886751 I | ceph-mgr: 2017-07-11 14:11:52.886717 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:52.886822 I | ceph-mgr: 2017-07-11 14:11:52.886808 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:52.892789 I | ceph-mgr: 2017-07-11 14:11:52.892759 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:54.898768 I | ceph-mgr: 2017-07-11 14:11:54.898720 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:54.899048 I | ceph-mgr: 2017-07-11 14:11:54.899023 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:54.899454 I | ceph-mgr: 2017-07-11 14:11:54.899438 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:56.901945 I | ceph-mgr: 2017-07-11 14:11:56.901900 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:56.902025 I | ceph-mgr: 2017-07-11 14:11:56.902011 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:56.902270 I | ceph-mgr: 2017-07-11 14:11:56.902254 7f4cc3226700 0 mgr tick
- 2017-07-11 14:11:58.909507 I | ceph-mgr: 2017-07-11 14:11:58.909409 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:11:58.909604 I | ceph-mgr: 2017-07-11 14:11:58.909588 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:11:58.909927 I | ceph-mgr: 2017-07-11 14:11:58.909912 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:00.913136 I | ceph-mgr: 2017-07-11 14:12:00.913065 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:00.913217 I | ceph-mgr: 2017-07-11 14:12:00.913203 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:00.913453 I | ceph-mgr: 2017-07-11 14:12:00.913437 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:02.917399 I | ceph-mgr: 2017-07-11 14:12:02.917359 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:02.923157 I | ceph-mgr: 2017-07-11 14:12:02.923134 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:02.923307 I | ceph-mgr: 2017-07-11 14:12:02.923290 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:04.930232 I | ceph-mgr: 2017-07-11 14:12:04.930186 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:04.930328 I | ceph-mgr: 2017-07-11 14:12:04.930314 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:04.930798 I | ceph-mgr: 2017-07-11 14:12:04.930782 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:06.951896 I | ceph-mgr: 2017-07-11 14:12:06.951856 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:06.951969 I | ceph-mgr: 2017-07-11 14:12:06.951955 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:06.952206 I | ceph-mgr: 2017-07-11 14:12:06.952190 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:08.960592 I | ceph-mgr: 2017-07-11 14:12:08.960545 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:08.964000 I | ceph-mgr: 2017-07-11 14:12:08.963979 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:08.964591 I | ceph-mgr: 2017-07-11 14:12:08.964573 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:10.982605 I | ceph-mgr: 2017-07-11 14:12:10.982546 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:10.982686 I | ceph-mgr: 2017-07-11 14:12:10.982672 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:10.982943 I | ceph-mgr: 2017-07-11 14:12:10.982924 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:13.006836 I | ceph-mgr: 2017-07-11 14:12:13.006792 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:13.006907 I | ceph-mgr: 2017-07-11 14:12:13.006893 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:13.007150 I | ceph-mgr: 2017-07-11 14:12:13.007134 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:15.010830 I | ceph-mgr: 2017-07-11 14:12:15.010768 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:15.010939 I | ceph-mgr: 2017-07-11 14:12:15.010911 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:15.011466 I | ceph-mgr: 2017-07-11 14:12:15.011448 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:17.017077 I | ceph-mgr: 2017-07-11 14:12:17.017030 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:17.017157 I | ceph-mgr: 2017-07-11 14:12:17.017143 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:17.017417 I | ceph-mgr: 2017-07-11 14:12:17.017402 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:19.023806 I | ceph-mgr: 2017-07-11 14:12:19.023766 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:19.023969 I | ceph-mgr: 2017-07-11 14:12:19.023954 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:19.025081 I | ceph-mgr: 2017-07-11 14:12:19.025050 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:21.027873 I | ceph-mgr: 2017-07-11 14:12:21.027222 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:21.027954 I | ceph-mgr: 2017-07-11 14:12:21.027938 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:21.036908 I | ceph-mgr: 2017-07-11 14:12:21.036889 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:23.039713 I | ceph-mgr: 2017-07-11 14:12:23.039677 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:23.039783 I | ceph-mgr: 2017-07-11 14:12:23.039769 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:23.045991 I | ceph-mgr: 2017-07-11 14:12:23.045972 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:25.047737 I | ceph-mgr: 2017-07-11 14:12:25.047688 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:25.047832 I | ceph-mgr: 2017-07-11 14:12:25.047808 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:25.055301 I | ceph-mgr: 2017-07-11 14:12:25.055271 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:27.061442 I | ceph-mgr: 2017-07-11 14:12:27.061394 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:27.061528 I | ceph-mgr: 2017-07-11 14:12:27.061511 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:27.061779 I | ceph-mgr: 2017-07-11 14:12:27.061763 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:29.076109 I | ceph-mgr: 2017-07-11 14:12:29.076057 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:29.077423 I | ceph-mgr: 2017-07-11 14:12:29.077403 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:29.077866 I | ceph-mgr: 2017-07-11 14:12:29.077836 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:31.094158 I | ceph-mgr: 2017-07-11 14:12:31.092701 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:31.094359 I | ceph-mgr: 2017-07-11 14:12:31.092710 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:31.094386 I | ceph-mgr: 2017-07-11 14:12:31.092736 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:33.106604 I | ceph-mgr: 2017-07-11 14:12:33.097013 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:33.106669 I | ceph-mgr: 2017-07-11 14:12:33.097033 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:33.106695 I | ceph-mgr: 2017-07-11 14:12:33.097061 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:35.099390 I | ceph-mgr: 2017-07-11 14:12:35.098936 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:35.099466 I | ceph-mgr: 2017-07-11 14:12:35.099451 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:35.099981 I | ceph-mgr: 2017-07-11 14:12:35.099687 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:37.104313 I | ceph-mgr: 2017-07-11 14:12:37.104264 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:37.104394 I | ceph-mgr: 2017-07-11 14:12:37.104362 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:37.104629 I | ceph-mgr: 2017-07-11 14:12:37.104613 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:39.128673 I | ceph-mgr: 2017-07-11 14:12:39.128618 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:39.128761 I | ceph-mgr: 2017-07-11 14:12:39.128745 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:39.129015 I | ceph-mgr: 2017-07-11 14:12:39.128998 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:41.133400 I | ceph-mgr: 2017-07-11 14:12:41.133357 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:41.133636 I | ceph-mgr: 2017-07-11 14:12:41.133616 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:41.133866 I | ceph-mgr: 2017-07-11 14:12:41.133852 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:43.146295 I | ceph-mgr: 2017-07-11 14:12:43.146248 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:43.146373 I | ceph-mgr: 2017-07-11 14:12:43.146359 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:43.146627 I | ceph-mgr: 2017-07-11 14:12:43.146611 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:45.150273 I | ceph-mgr: 2017-07-11 14:12:45.150235 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:45.150385 I | ceph-mgr: 2017-07-11 14:12:45.150368 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:45.150636 I | ceph-mgr: 2017-07-11 14:12:45.150619 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:47.170879 I | ceph-mgr: 2017-07-11 14:12:47.170828 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:47.173737 I | ceph-mgr: 2017-07-11 14:12:47.173721 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:47.173959 I | ceph-mgr: 2017-07-11 14:12:47.173935 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:49.195388 I | ceph-mgr: 2017-07-11 14:12:49.195326 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:49.195458 I | ceph-mgr: 2017-07-11 14:12:49.195444 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:49.195696 I | ceph-mgr: 2017-07-11 14:12:49.195680 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:51.204259 I | ceph-mgr: 2017-07-11 14:12:51.204231 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:51.204340 I | ceph-mgr: 2017-07-11 14:12:51.204325 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:51.204677 I | ceph-mgr: 2017-07-11 14:12:51.204661 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:53.212890 I | ceph-mgr: 2017-07-11 14:12:53.212431 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:53.213403 I | ceph-mgr: 2017-07-11 14:12:53.212998 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:53.213652 I | ceph-mgr: 2017-07-11 14:12:53.213626 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:55.228828 I | ceph-mgr: 2017-07-11 14:12:55.228778 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:55.229722 I | ceph-mgr: 2017-07-11 14:12:55.229703 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:55.230234 I | ceph-mgr: 2017-07-11 14:12:55.230214 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:57.232832 I | ceph-mgr: 2017-07-11 14:12:57.232745 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:57.232931 I | ceph-mgr: 2017-07-11 14:12:57.232915 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:57.233250 I | ceph-mgr: 2017-07-11 14:12:57.233234 7f4cc3226700 0 mgr tick
- 2017-07-11 14:12:59.245199 I | ceph-mgr: 2017-07-11 14:12:59.245149 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:12:59.245422 I | ceph-mgr: 2017-07-11 14:12:59.245406 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:12:59.248849 I | ceph-mgr: 2017-07-11 14:12:59.248818 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:01.268443 I | ceph-mgr: 2017-07-11 14:13:01.268387 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:01.268524 I | ceph-mgr: 2017-07-11 14:13:01.268510 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:01.268758 I | ceph-mgr: 2017-07-11 14:13:01.268742 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:03.290958 I | ceph-mgr: 2017-07-11 14:13:03.290912 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:03.291048 I | ceph-mgr: 2017-07-11 14:13:03.291034 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:03.291283 I | ceph-mgr: 2017-07-11 14:13:03.291267 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:05.296443 I | ceph-mgr: 2017-07-11 14:13:05.296388 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:05.296522 I | ceph-mgr: 2017-07-11 14:13:05.296508 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:05.296758 I | ceph-mgr: 2017-07-11 14:13:05.296742 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:07.304345 I | ceph-mgr: 2017-07-11 14:13:07.304302 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:07.304430 I | ceph-mgr: 2017-07-11 14:13:07.304417 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:07.304665 I | ceph-mgr: 2017-07-11 14:13:07.304650 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:09.309169 I | ceph-mgr: 2017-07-11 14:13:09.309115 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:09.309245 I | ceph-mgr: 2017-07-11 14:13:09.309230 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:09.309490 I | ceph-mgr: 2017-07-11 14:13:09.309474 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:11.311261 I | ceph-mgr: 2017-07-11 14:13:11.311141 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:11.311340 I | ceph-mgr: 2017-07-11 14:13:11.311324 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:11.311585 I | ceph-mgr: 2017-07-11 14:13:11.311570 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:13.313635 I | ceph-mgr: 2017-07-11 14:13:13.313576 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:13.313900 I | ceph-mgr: 2017-07-11 14:13:13.313885 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:13.317553 I | ceph-mgr: 2017-07-11 14:13:13.317526 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:15.328371 I | ceph-mgr: 2017-07-11 14:13:15.328328 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:15.328568 I | ceph-mgr: 2017-07-11 14:13:15.328553 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:15.329749 I | ceph-mgr: 2017-07-11 14:13:15.329733 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:17.333215 I | ceph-mgr: 2017-07-11 14:13:17.333171 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:17.333307 I | ceph-mgr: 2017-07-11 14:13:17.333293 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:17.333559 I | ceph-mgr: 2017-07-11 14:13:17.333544 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:19.339080 I | ceph-mgr: 2017-07-11 14:13:19.339011 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:19.339152 I | ceph-mgr: 2017-07-11 14:13:19.339137 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:19.339386 I | ceph-mgr: 2017-07-11 14:13:19.339370 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:21.350064 I | ceph-mgr: 2017-07-11 14:13:21.341253 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:21.350268 I | ceph-mgr: 2017-07-11 14:13:21.341266 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:21.350300 I | ceph-mgr: 2017-07-11 14:13:21.341296 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:23.346767 I | ceph-mgr: 2017-07-11 14:13:23.345254 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:23.354227 I | ceph-mgr: 2017-07-11 14:13:23.345265 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:23.354301 I | ceph-mgr: 2017-07-11 14:13:23.345292 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:25.349307 I | ceph-mgr: 2017-07-11 14:13:25.349256 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:25.349401 I | ceph-mgr: 2017-07-11 14:13:25.349387 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:25.349871 I | ceph-mgr: 2017-07-11 14:13:25.349854 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:27.360517 I | ceph-mgr: 2017-07-11 14:13:27.360478 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:27.360587 I | ceph-mgr: 2017-07-11 14:13:27.360573 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:27.360817 I | ceph-mgr: 2017-07-11 14:13:27.360801 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:29.381505 I | ceph-mgr: 2017-07-11 14:13:29.381395 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:29.381592 I | ceph-mgr: 2017-07-11 14:13:29.381576 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:29.381832 I | ceph-mgr: 2017-07-11 14:13:29.381816 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:31.403890 I | ceph-mgr: 2017-07-11 14:13:31.403843 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:31.403966 I | ceph-mgr: 2017-07-11 14:13:31.403952 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:31.404208 I | ceph-mgr: 2017-07-11 14:13:31.404193 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:33.421791 I | ceph-mgr: 2017-07-11 14:13:33.421736 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:33.421889 I | ceph-mgr: 2017-07-11 14:13:33.421874 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:33.422127 I | ceph-mgr: 2017-07-11 14:13:33.422111 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:35.423885 I | ceph-mgr: 2017-07-11 14:13:35.423846 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:35.424068 I | ceph-mgr: 2017-07-11 14:13:35.424051 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:35.432407 I | ceph-mgr: 2017-07-11 14:13:35.432387 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:37.439664 I | ceph-mgr: 2017-07-11 14:13:37.439627 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:37.439703 I | ceph-mgr: 2017-07-11 14:13:37.439690 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:37.439876 I | ceph-mgr: 2017-07-11 14:13:37.439858 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:39.465190 I | ceph-mgr: 2017-07-11 14:13:39.465148 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:39.465261 I | ceph-mgr: 2017-07-11 14:13:39.465246 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:39.465513 I | ceph-mgr: 2017-07-11 14:13:39.465496 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:41.469744 I | ceph-mgr: 2017-07-11 14:13:41.469674 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:41.470001 I | ceph-mgr: 2017-07-11 14:13:41.469852 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:41.470197 I | ceph-mgr: 2017-07-11 14:13:41.470181 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:43.479174 I | ceph-mgr: 2017-07-11 14:13:43.477570 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:43.479631 I | ceph-mgr: 2017-07-11 14:13:43.477576 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:43.479699 I | ceph-mgr: 2017-07-11 14:13:43.477598 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:45.485113 I | ceph-mgr: 2017-07-11 14:13:45.485064 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:45.485198 I | ceph-mgr: 2017-07-11 14:13:45.485184 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:45.487220 I | ceph-mgr: 2017-07-11 14:13:45.487203 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:47.506902 I | ceph-mgr: 2017-07-11 14:13:47.506868 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:47.506972 I | ceph-mgr: 2017-07-11 14:13:47.506958 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:47.507222 I | ceph-mgr: 2017-07-11 14:13:47.507206 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:49.522578 I | ceph-mgr: 2017-07-11 14:13:49.521233 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:49.522638 I | ceph-mgr: 2017-07-11 14:13:49.521242 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:49.522654 I | ceph-mgr: 2017-07-11 14:13:49.521272 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:51.523115 I | ceph-mgr: 2017-07-11 14:13:51.523084 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:51.523186 I | ceph-mgr: 2017-07-11 14:13:51.523172 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:51.523434 I | ceph-mgr: 2017-07-11 14:13:51.523416 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:53.546952 I | ceph-mgr: 2017-07-11 14:13:53.546916 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:53.547031 I | ceph-mgr: 2017-07-11 14:13:53.547018 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:53.547233 I | ceph-mgr: 2017-07-11 14:13:53.547123 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:55.555289 I | ceph-mgr: 2017-07-11 14:13:55.555222 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:55.555468 I | ceph-mgr: 2017-07-11 14:13:55.555371 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:55.555967 I | ceph-mgr: 2017-07-11 14:13:55.555949 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:57.561711 I | ceph-mgr: 2017-07-11 14:13:57.559713 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:57.568591 I | ceph-mgr: 2017-07-11 14:13:57.568536 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:57.577461 I | ceph-mgr: 2017-07-11 14:13:57.577443 7f4cc3226700 0 mgr tick
- 2017-07-11 14:13:59.606536 I | ceph-mgr: 2017-07-11 14:13:59.606499 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:13:59.606694 I | ceph-mgr: 2017-07-11 14:13:59.606679 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:13:59.606993 I | ceph-mgr: 2017-07-11 14:13:59.606977 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:01.633159 I | ceph-mgr: 2017-07-11 14:14:01.633120 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:01.633262 I | ceph-mgr: 2017-07-11 14:14:01.633231 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:01.633561 I | ceph-mgr: 2017-07-11 14:14:01.633545 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:03.635493 I | ceph-mgr: 2017-07-11 14:14:03.635465 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:03.635621 I | ceph-mgr: 2017-07-11 14:14:03.635606 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:03.635841 I | ceph-mgr: 2017-07-11 14:14:03.635825 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:05.662192 I | ceph-mgr: 2017-07-11 14:14:05.662117 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:05.662455 I | ceph-mgr: 2017-07-11 14:14:05.662304 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:05.662898 I | ceph-mgr: 2017-07-11 14:14:05.662882 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:07.672628 I | ceph-mgr: 2017-07-11 14:14:07.672596 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:07.672697 I | ceph-mgr: 2017-07-11 14:14:07.672683 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:07.672925 I | ceph-mgr: 2017-07-11 14:14:07.672910 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:09.717261 I | ceph-mgr: 2017-07-11 14:14:09.717209 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:09.717344 I | ceph-mgr: 2017-07-11 14:14:09.717330 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:09.717611 I | ceph-mgr: 2017-07-11 14:14:09.717595 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:11.721201 I | ceph-mgr: 2017-07-11 14:14:11.721115 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:11.721295 I | ceph-mgr: 2017-07-11 14:14:11.721280 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:11.721540 I | ceph-mgr: 2017-07-11 14:14:11.721524 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:13.730026 I | ceph-mgr: 2017-07-11 14:14:13.728307 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:13.730091 I | ceph-mgr: 2017-07-11 14:14:13.728315 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:13.730107 I | ceph-mgr: 2017-07-11 14:14:13.728350 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:15.747479 I | ceph-mgr: 2017-07-11 14:14:15.747428 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:15.747518 I | ceph-mgr: 2017-07-11 14:14:15.747505 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:15.764547 I | ceph-mgr: 2017-07-11 14:14:15.764527 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:17.767824 I | ceph-mgr: 2017-07-11 14:14:17.767782 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:17.767899 I | ceph-mgr: 2017-07-11 14:14:17.767885 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:17.767972 I | ceph-mgr: 2017-07-11 14:14:17.767962 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:19.790960 I | ceph-mgr: 2017-07-11 14:14:19.790927 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:19.791038 I | ceph-mgr: 2017-07-11 14:14:19.791024 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:19.791346 I | ceph-mgr: 2017-07-11 14:14:19.791141 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:21.797790 I | ceph-mgr: 2017-07-11 14:14:21.797755 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:21.797867 I | ceph-mgr: 2017-07-11 14:14:21.797853 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:21.798108 I | ceph-mgr: 2017-07-11 14:14:21.798092 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:23.815597 I | ceph-mgr: 2017-07-11 14:14:23.805455 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:23.815680 I | ceph-mgr: 2017-07-11 14:14:23.815662 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:23.820052 I | ceph-mgr: 2017-07-11 14:14:23.820033 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:25.944411 I | ceph-mgr: 2017-07-11 14:14:25.944366 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:25.944451 I | ceph-mgr: 2017-07-11 14:14:25.944436 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:25.944569 I | ceph-mgr: 2017-07-11 14:14:25.944554 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:27.957849 I | ceph-mgr: 2017-07-11 14:14:27.957796 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:27.957935 I | ceph-mgr: 2017-07-11 14:14:27.957920 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:27.958200 I | ceph-mgr: 2017-07-11 14:14:27.958184 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:29.960164 I | ceph-mgr: 2017-07-11 14:14:29.959923 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:29.960252 I | ceph-mgr: 2017-07-11 14:14:29.960237 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:29.966209 I | ceph-mgr: 2017-07-11 14:14:29.966191 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:31.976501 I | ceph-mgr: 2017-07-11 14:14:31.976459 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:31.976740 I | ceph-mgr: 2017-07-11 14:14:31.976723 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:31.977151 I | ceph-mgr: 2017-07-11 14:14:31.977134 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:33.995742 I | ceph-mgr: 2017-07-11 14:14:33.994387 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:33.995806 I | ceph-mgr: 2017-07-11 14:14:33.994395 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:33.995822 I | ceph-mgr: 2017-07-11 14:14:33.994423 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:36.004070 I | ceph-mgr: 2017-07-11 14:14:35.995907 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:36.004309 I | ceph-mgr: 2017-07-11 14:14:36.004169 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:36.006317 I | ceph-mgr: 2017-07-11 14:14:36.004692 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:38.009094 I | ceph-mgr: 2017-07-11 14:14:38.006455 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:38.009143 I | ceph-mgr: 2017-07-11 14:14:38.006484 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:38.009168 I | ceph-mgr: 2017-07-11 14:14:38.006587 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:40.011649 I | ceph-mgr: 2017-07-11 14:14:40.011593 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:40.011735 I | ceph-mgr: 2017-07-11 14:14:40.011703 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:40.011987 I | ceph-mgr: 2017-07-11 14:14:40.011972 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:42.033943 I | ceph-mgr: 2017-07-11 14:14:42.033904 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:42.034018 I | ceph-mgr: 2017-07-11 14:14:42.034004 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:42.034340 I | ceph-mgr: 2017-07-11 14:14:42.034324 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:44.056772 I | ceph-mgr: 2017-07-11 14:14:44.056725 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:44.056993 I | ceph-mgr: 2017-07-11 14:14:44.056977 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:44.058003 I | ceph-mgr: 2017-07-11 14:14:44.057972 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:46.062154 I | ceph-mgr: 2017-07-11 14:14:46.062082 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:46.062382 I | ceph-mgr: 2017-07-11 14:14:46.062366 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:46.062622 I | ceph-mgr: 2017-07-11 14:14:46.062607 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:48.075922 I | ceph-mgr: 2017-07-11 14:14:48.075514 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:48.076085 I | ceph-mgr: 2017-07-11 14:14:48.075527 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:48.076220 I | ceph-mgr: 2017-07-11 14:14:48.075558 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:50.081437 I | ceph-mgr: 2017-07-11 14:14:50.081392 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:50.081582 I | ceph-mgr: 2017-07-11 14:14:50.081494 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:50.081798 I | ceph-mgr: 2017-07-11 14:14:50.081675 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:52.106630 I | ceph-mgr: 2017-07-11 14:14:52.106561 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:52.106911 I | ceph-mgr: 2017-07-11 14:14:52.106750 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:52.107122 I | ceph-mgr: 2017-07-11 14:14:52.107094 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:54.112499 I | ceph-mgr: 2017-07-11 14:14:54.108986 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:54.118675 I | ceph-mgr: 2017-07-11 14:14:54.109000 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:54.118689 I | ceph-mgr: 2017-07-11 14:14:54.109045 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:56.127803 I | ceph-mgr: 2017-07-11 14:14:56.117129 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:56.127900 I | ceph-mgr: 2017-07-11 14:14:56.117143 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:56.127935 I | ceph-mgr: 2017-07-11 14:14:56.118270 7f4cc3226700 0 mgr tick
- 2017-07-11 14:14:58.133960 I | ceph-mgr: 2017-07-11 14:14:58.133879 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:14:58.134025 I | ceph-mgr: 2017-07-11 14:14:58.133894 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:14:58.134283 I | ceph-mgr: 2017-07-11 14:14:58.134235 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:00.136453 I | ceph-mgr: 2017-07-11 14:15:00.136368 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:00.136549 I | ceph-mgr: 2017-07-11 14:15:00.136535 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:00.136875 I | ceph-mgr: 2017-07-11 14:15:00.136858 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:02.148574 I | ceph-mgr: 2017-07-11 14:15:02.148529 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:02.148653 I | ceph-mgr: 2017-07-11 14:15:02.148640 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:02.148911 I | ceph-mgr: 2017-07-11 14:15:02.148896 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:04.158713 I | ceph-mgr: 2017-07-11 14:15:04.158521 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:04.158822 I | ceph-mgr: 2017-07-11 14:15:04.158804 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:04.159177 I | ceph-mgr: 2017-07-11 14:15:04.159147 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:06.168373 I | ceph-mgr: 2017-07-11 14:15:06.168304 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:06.168460 I | ceph-mgr: 2017-07-11 14:15:06.168444 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:06.168685 I | ceph-mgr: 2017-07-11 14:15:06.168669 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:08.175827 I | ceph-mgr: 2017-07-11 14:15:08.175750 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:08.175901 I | ceph-mgr: 2017-07-11 14:15:08.175887 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:08.176134 I | ceph-mgr: 2017-07-11 14:15:08.176119 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:10.177912 I | ceph-mgr: 2017-07-11 14:15:10.177863 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:10.177993 I | ceph-mgr: 2017-07-11 14:15:10.177978 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:10.178237 I | ceph-mgr: 2017-07-11 14:15:10.178222 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:12.192418 I | ceph-mgr: 2017-07-11 14:15:12.192356 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:12.192500 I | ceph-mgr: 2017-07-11 14:15:12.192486 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:12.192757 I | ceph-mgr: 2017-07-11 14:15:12.192742 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:14.212911 I | ceph-mgr: 2017-07-11 14:15:14.212365 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:14.212953 I | ceph-mgr: 2017-07-11 14:15:14.212935 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:14.213084 I | ceph-mgr: 2017-07-11 14:15:14.213069 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:16.252785 I | ceph-mgr: 2017-07-11 14:15:16.251106 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:16.252832 I | ceph-mgr: 2017-07-11 14:15:16.252818 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:16.252969 I | ceph-mgr: 2017-07-11 14:15:16.252955 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:18.271725 I | ceph-mgr: 2017-07-11 14:15:18.271688 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:18.271761 I | ceph-mgr: 2017-07-11 14:15:18.271749 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:18.271890 I | ceph-mgr: 2017-07-11 14:15:18.271873 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:20.278242 I | ceph-mgr: 2017-07-11 14:15:20.278162 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:20.278432 I | ceph-mgr: 2017-07-11 14:15:20.278415 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:20.278895 I | ceph-mgr: 2017-07-11 14:15:20.278879 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:22.287214 I | ceph-mgr: 2017-07-11 14:15:22.287157 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:22.287291 I | ceph-mgr: 2017-07-11 14:15:22.287277 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:22.287566 I | ceph-mgr: 2017-07-11 14:15:22.287551 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:24.290276 I | ceph-mgr: 2017-07-11 14:15:24.290220 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:24.290354 I | ceph-mgr: 2017-07-11 14:15:24.290340 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:24.290588 I | ceph-mgr: 2017-07-11 14:15:24.290573 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:26.314113 I | ceph-mgr: 2017-07-11 14:15:26.314075 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:26.314193 I | ceph-mgr: 2017-07-11 14:15:26.314179 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:26.314431 I | ceph-mgr: 2017-07-11 14:15:26.314415 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:28.317436 I | ceph-mgr: 2017-07-11 14:15:28.317393 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:28.317524 I | ceph-mgr: 2017-07-11 14:15:28.317510 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:28.317770 I | ceph-mgr: 2017-07-11 14:15:28.317754 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:30.338221 I | ceph-mgr: 2017-07-11 14:15:30.338075 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:30.338300 I | ceph-mgr: 2017-07-11 14:15:30.338286 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:30.338528 I | ceph-mgr: 2017-07-11 14:15:30.338512 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:32.348370 I | ceph-mgr: 2017-07-11 14:15:32.348253 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:32.348445 I | ceph-mgr: 2017-07-11 14:15:32.348431 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:32.348679 I | ceph-mgr: 2017-07-11 14:15:32.348664 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:34.351463 I | ceph-mgr: 2017-07-11 14:15:34.351410 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:34.357346 I | ceph-mgr: 2017-07-11 14:15:34.357281 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:34.357595 I | ceph-mgr: 2017-07-11 14:15:34.357560 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:36.364821 I | ceph-mgr: 2017-07-11 14:15:36.364742 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:36.365050 I | ceph-mgr: 2017-07-11 14:15:36.365033 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:36.367338 I | ceph-mgr: 2017-07-11 14:15:36.367321 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:38.374888 I | ceph-mgr: 2017-07-11 14:15:38.374824 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:38.374977 I | ceph-mgr: 2017-07-11 14:15:38.374963 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:38.375238 I | ceph-mgr: 2017-07-11 14:15:38.375223 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:40.383536 I | ceph-mgr: 2017-07-11 14:15:40.381989 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:40.383553 I | ceph-mgr: 2017-07-11 14:15:40.381998 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:40.383556 I | ceph-mgr: 2017-07-11 14:15:40.382030 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:42.390812 I | ceph-mgr: 2017-07-11 14:15:42.390752 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:42.390899 I | ceph-mgr: 2017-07-11 14:15:42.390884 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:42.391802 I | ceph-mgr: 2017-07-11 14:15:42.391327 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:44.394824 I | ceph-mgr: 2017-07-11 14:15:44.394777 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:44.394903 I | ceph-mgr: 2017-07-11 14:15:44.394888 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:44.395141 I | ceph-mgr: 2017-07-11 14:15:44.395125 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:46.406618 I | ceph-mgr: 2017-07-11 14:15:46.406554 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:46.406695 I | ceph-mgr: 2017-07-11 14:15:46.406680 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:46.406951 I | ceph-mgr: 2017-07-11 14:15:46.406935 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:48.418614 I | ceph-mgr: 2017-07-11 14:15:48.417022 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:48.418772 I | ceph-mgr: 2017-07-11 14:15:48.417039 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:48.418927 I | ceph-mgr: 2017-07-11 14:15:48.417076 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:50.430191 I | ceph-mgr: 2017-07-11 14:15:50.430151 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:50.430414 I | ceph-mgr: 2017-07-11 14:15:50.430398 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:50.432837 I | ceph-mgr: 2017-07-11 14:15:50.432817 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:52.454960 I | ceph-mgr: 2017-07-11 14:15:52.454916 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:52.455035 I | ceph-mgr: 2017-07-11 14:15:52.455020 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:52.455267 I | ceph-mgr: 2017-07-11 14:15:52.455251 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:54.465742 I | ceph-mgr: 2017-07-11 14:15:54.457652 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:54.465938 I | ceph-mgr: 2017-07-11 14:15:54.457657 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:54.466006 I | ceph-mgr: 2017-07-11 14:15:54.457690 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:56.103929 I | ceph-mgr: 2017-07-11 14:15:56.103834 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4818 10.233.124.0:0/1563645941' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:15:56.113773 I | ceph-mgr: 2017-07-11 14:15:56.103861 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:15:56.459735 I | ceph-mgr: 2017-07-11 14:15:56.459020 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:56.459848 I | ceph-mgr: 2017-07-11 14:15:56.459024 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:56.459867 I | ceph-mgr: 2017-07-11 14:15:56.459044 7f4cc3226700 0 mgr tick
- 2017-07-11 14:15:57.787187 I | ceph-mgr: 2017-07-11 14:15:57.787084 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4726 10.233.124.5:0/3557732441' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:15:57.787352 I | ceph-mgr: 2017-07-11 14:15:57.787146 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:15:58.482440 I | ceph-mgr: 2017-07-11 14:15:58.482377 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:15:58.482516 I | ceph-mgr: 2017-07-11 14:15:58.482502 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:15:58.482944 I | ceph-mgr: 2017-07-11 14:15:58.482922 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:00.489025 I | ceph-mgr: 2017-07-11 14:16:00.487641 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:00.494892 I | ceph-mgr: 2017-07-11 14:16:00.487647 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:00.494902 I | ceph-mgr: 2017-07-11 14:16:00.487668 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:01.060712 I | ceph-mgr: 2017-07-11 14:16:01.060657 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4766 10.233.124.5:0/635136932' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:01.060878 I | ceph-mgr: 2017-07-11 14:16:01.060786 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:02.383411 I | ceph-mgr: 2017-07-11 14:16:02.383318 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4836 10.233.124.0:0/528540062' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:02.383633 I | ceph-mgr: 2017-07-11 14:16:02.383522 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:02.509059 I | ceph-mgr: 2017-07-11 14:16:02.492309 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:02.509267 I | ceph-mgr: 2017-07-11 14:16:02.492316 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:02.509366 I | ceph-mgr: 2017-07-11 14:16:02.492338 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:04.519802 I | ceph-mgr: 2017-07-11 14:16:04.517119 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:04.526948 I | ceph-mgr: 2017-07-11 14:16:04.526929 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:04.527956 I | ceph-mgr: 2017-07-11 14:16:04.527939 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:06.387089 I | ceph-mgr: 2017-07-11 14:16:06.387021 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4775 10.233.124.5:0/892070477' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:06.387198 I | ceph-mgr: 2017-07-11 14:16:06.387165 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:06.535638 I | ceph-mgr: 2017-07-11 14:16:06.535522 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:06.545802 I | ceph-mgr: 2017-07-11 14:16:06.545783 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:06.546267 I | ceph-mgr: 2017-07-11 14:16:06.546250 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:07.385230 I | ceph-mgr: 2017-07-11 14:16:07.385157 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4854 10.233.124.0:0/4013855125' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:07.385319 I | ceph-mgr: 2017-07-11 14:16:07.385293 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:08.567608 I | ceph-mgr: 2017-07-11 14:16:08.549875 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:08.567656 I | ceph-mgr: 2017-07-11 14:16:08.549878 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:08.567681 I | ceph-mgr: 2017-07-11 14:16:08.549899 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:10.577825 I | ceph-mgr: 2017-07-11 14:16:10.567886 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:10.577879 I | ceph-mgr: 2017-07-11 14:16:10.567898 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:10.577914 I | ceph-mgr: 2017-07-11 14:16:10.567923 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:11.070323 I | ceph-mgr: 2017-07-11 14:16:11.070292 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4784 10.233.124.5:0/3205486027' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:11.073882 I | ceph-mgr: 2017-07-11 14:16:11.073865 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:12.078592 I | ceph-mgr: 2017-07-11 14:16:12.078561 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4790 10.233.124.5:0/2856478914' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:12.081531 I | ceph-mgr: 2017-07-11 14:16:12.081510 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:12.586503 I | ceph-mgr: 2017-07-11 14:16:12.570976 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:12.586622 I | ceph-mgr: 2017-07-11 14:16:12.570985 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:12.586780 I | ceph-mgr: 2017-07-11 14:16:12.571011 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:14.593192 I | ceph-mgr: 2017-07-11 14:16:14.593162 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:14.593281 I | ceph-mgr: 2017-07-11 14:16:14.593267 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:14.593488 I | ceph-mgr: 2017-07-11 14:16:14.593376 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:16.546628 I | ceph-mgr: 2017-07-11 14:16:16.536812 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4881 10.233.124.0:0/2185136717' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:16.546743 I | ceph-mgr: 2017-07-11 14:16:16.536860 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:16.596133 I | ceph-mgr: 2017-07-11 14:16:16.596111 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:16.596201 I | ceph-mgr: 2017-07-11 14:16:16.596170 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:16.596412 I | ceph-mgr: 2017-07-11 14:16:16.596299 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:17.600283 I | ceph-mgr: 2017-07-11 14:16:17.600196 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4805 10.233.124.5:0/3750161671' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:17.600341 I | ceph-mgr: 2017-07-11 14:16:17.600244 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:18.611336 I | ceph-mgr: 2017-07-11 14:16:18.601462 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:18.611543 I | ceph-mgr: 2017-07-11 14:16:18.601472 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:18.611640 I | ceph-mgr: 2017-07-11 14:16:18.601512 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:20.602944 I | ceph-mgr: 2017-07-11 14:16:20.602914 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:20.603036 I | ceph-mgr: 2017-07-11 14:16:20.603022 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:20.603210 I | ceph-mgr: 2017-07-11 14:16:20.603097 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:21.527002 I | ceph-mgr: 2017-07-11 14:16:21.526935 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4814 10.233.124.5:0/2292719856' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:21.527018 I | ceph-mgr: 2017-07-11 14:16:21.526955 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:22.501668 I | ceph-mgr: 2017-07-11 14:16:22.501583 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4817 10.233.124.5:0/3509350737' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:22.501731 I | ceph-mgr: 2017-07-11 14:16:22.501629 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:22.627792 I | ceph-mgr: 2017-07-11 14:16:22.627770 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:22.627866 I | ceph-mgr: 2017-07-11 14:16:22.627833 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:22.628087 I | ceph-mgr: 2017-07-11 14:16:22.628072 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:24.635555 I | ceph-mgr: 2017-07-11 14:16:24.635493 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:24.635741 I | ceph-mgr: 2017-07-11 14:16:24.635652 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:24.636869 I | ceph-mgr: 2017-07-11 14:16:24.636850 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:26.475694 I | ceph-mgr: 2017-07-11 14:16:26.475644 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4829 10.233.124.5:0/2795789365' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:26.475794 I | ceph-mgr: 2017-07-11 14:16:26.475762 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:26.645582 I | ceph-mgr: 2017-07-11 14:16:26.642642 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:26.645781 I | ceph-mgr: 2017-07-11 14:16:26.642665 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:26.645808 I | ceph-mgr: 2017-07-11 14:16:26.642695 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:27.824026 I | ceph-mgr: 2017-07-11 14:16:27.823946 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4835 10.233.124.5:0/31851738' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:27.824204 I | ceph-mgr: 2017-07-11 14:16:27.824114 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:28.650248 I | ceph-mgr: 2017-07-11 14:16:28.648619 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:28.650494 I | ceph-mgr: 2017-07-11 14:16:28.648636 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:28.650575 I | ceph-mgr: 2017-07-11 14:16:28.648675 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:30.656263 I | ceph-mgr: 2017-07-11 14:16:30.656233 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:30.656329 I | ceph-mgr: 2017-07-11 14:16:30.656316 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:30.656540 I | ceph-mgr: 2017-07-11 14:16:30.656429 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:31.071421 I | ceph-mgr: 2017-07-11 14:16:31.071396 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4844 10.233.124.5:0/617273331' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:31.071572 I | ceph-mgr: 2017-07-11 14:16:31.071512 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:32.383469 I | ceph-mgr: 2017-07-11 14:16:32.383394 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4850 10.233.124.5:0/513444823' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:32.398750 I | ceph-mgr: 2017-07-11 14:16:32.383537 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:32.662935 I | ceph-mgr: 2017-07-11 14:16:32.661596 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:32.663093 I | ceph-mgr: 2017-07-11 14:16:32.661602 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:32.663113 I | ceph-mgr: 2017-07-11 14:16:32.661625 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:34.667290 I | ceph-mgr: 2017-07-11 14:16:34.667248 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:34.667383 I | ceph-mgr: 2017-07-11 14:16:34.667367 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:34.667551 I | ceph-mgr: 2017-07-11 14:16:34.667536 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:36.545752 I | ceph-mgr: 2017-07-11 14:16:36.545704 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4868 10.233.124.5:0/3446995926' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:36.545839 I | ceph-mgr: 2017-07-11 14:16:36.545813 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:36.692076 I | ceph-mgr: 2017-07-11 14:16:36.675504 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:36.692486 I | ceph-mgr: 2017-07-11 14:16:36.675514 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:36.692517 I | ceph-mgr: 2017-07-11 14:16:36.675539 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:37.499720 I | ceph-mgr: 2017-07-11 14:16:37.499605 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4874 10.233.124.5:0/3433587446' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:37.499790 I | ceph-mgr: 2017-07-11 14:16:37.499667 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:38.695212 I | ceph-mgr: 2017-07-11 14:16:38.695139 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:38.695296 I | ceph-mgr: 2017-07-11 14:16:38.695282 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:38.695467 I | ceph-mgr: 2017-07-11 14:16:38.695452 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:40.705110 I | ceph-mgr: 2017-07-11 14:16:40.703587 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:40.705692 I | ceph-mgr: 2017-07-11 14:16:40.703593 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:40.705738 I | ceph-mgr: 2017-07-11 14:16:40.703616 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:40.821768 I | ceph-mgr: 2017-07-11 14:16:40.821645 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4889 10.233.124.5:0/2739820055' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:40.821818 I | ceph-mgr: 2017-07-11 14:16:40.821678 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:41.838976 I | ceph-mgr: 2017-07-11 14:16:41.838896 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4892 10.233.124.5:0/993241129' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:41.839264 I | ceph-mgr: 2017-07-11 14:16:41.839124 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:42.726404 I | ceph-mgr: 2017-07-11 14:16:42.705584 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:42.726614 I | ceph-mgr: 2017-07-11 14:16:42.705597 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:42.726709 I | ceph-mgr: 2017-07-11 14:16:42.705665 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:44.729274 I | ceph-mgr: 2017-07-11 14:16:44.729243 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:44.729350 I | ceph-mgr: 2017-07-11 14:16:44.729336 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:44.729587 I | ceph-mgr: 2017-07-11 14:16:44.729572 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:45.923342 I | ceph-mgr: 2017-07-11 14:16:45.923281 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4907 10.233.124.5:0/2322915338' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:45.925229 I | ceph-mgr: 2017-07-11 14:16:45.923302 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:46.747382 I | ceph-mgr: 2017-07-11 14:16:46.747351 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:46.747598 I | ceph-mgr: 2017-07-11 14:16:46.747451 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:46.747948 I | ceph-mgr: 2017-07-11 14:16:46.747736 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:46.883289 I | ceph-mgr: 2017-07-11 14:16:46.883213 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4910 10.233.124.5:0/3097096152' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:46.883327 I | ceph-mgr: 2017-07-11 14:16:46.883259 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:48.778578 I | ceph-mgr: 2017-07-11 14:16:48.777252 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:48.778638 I | ceph-mgr: 2017-07-11 14:16:48.777257 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:48.778654 I | ceph-mgr: 2017-07-11 14:16:48.777276 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:50.785618 I | ceph-mgr: 2017-07-11 14:16:50.784224 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:50.785676 I | ceph-mgr: 2017-07-11 14:16:50.784257 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:50.785692 I | ceph-mgr: 2017-07-11 14:16:50.784287 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:51.124055 I | ceph-mgr: 2017-07-11 14:16:51.123999 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4925 10.233.124.5:0/3329861468' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:51.124142 I | ceph-mgr: 2017-07-11 14:16:51.124113 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:52.416799 I | ceph-mgr: 2017-07-11 14:16:52.416768 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4974 10.233.124.0:0/3582497599' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:52.422589 I | ceph-mgr: 2017-07-11 14:16:52.422570 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:52.793517 I | ceph-mgr: 2017-07-11 14:16:52.792621 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:52.793576 I | ceph-mgr: 2017-07-11 14:16:52.792639 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:52.793592 I | ceph-mgr: 2017-07-11 14:16:52.792659 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:54.798550 I | ceph-mgr: 2017-07-11 14:16:54.797371 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:54.800037 I | ceph-mgr: 2017-07-11 14:16:54.797376 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:54.800137 I | ceph-mgr: 2017-07-11 14:16:54.800084 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:55.796582 I | ceph-mgr: 2017-07-11 14:16:55.796551 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4943 10.233.124.5:0/1167120412' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:55.796756 I | ceph-mgr: 2017-07-11 14:16:55.796683 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:56.765906 I | ceph-mgr: 2017-07-11 14:16:56.765874 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4946 10.233.124.5:0/429470252' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:16:56.775260 I | ceph-mgr: 2017-07-11 14:16:56.775241 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:16:56.805592 I | ceph-mgr: 2017-07-11 14:16:56.805570 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:56.805643 I | ceph-mgr: 2017-07-11 14:16:56.805630 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:56.805712 I | ceph-mgr: 2017-07-11 14:16:56.805701 7f4cc3226700 0 mgr tick
- 2017-07-11 14:16:58.809543 I | ceph-mgr: 2017-07-11 14:16:58.809505 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:16:58.809640 I | ceph-mgr: 2017-07-11 14:16:58.809625 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:16:58.825577 I | ceph-mgr: 2017-07-11 14:16:58.825557 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:00.564738 I | ceph-mgr: 2017-07-11 14:17:00.564675 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4952 10.233.124.5:0/679145565' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:00.564804 I | ceph-mgr: 2017-07-11 14:17:00.564695 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:00.829826 I | ceph-mgr: 2017-07-11 14:17:00.829798 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:00.829981 I | ceph-mgr: 2017-07-11 14:17:00.829965 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:00.830217 I | ceph-mgr: 2017-07-11 14:17:00.830202 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:01.577242 I | ceph-mgr: 2017-07-11 14:17:01.577154 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4955 10.233.124.5:0/4058240699' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:01.577310 I | ceph-mgr: 2017-07-11 14:17:01.577202 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:02.837109 I | ceph-mgr: 2017-07-11 14:17:02.837062 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:02.837191 I | ceph-mgr: 2017-07-11 14:17:02.837177 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:02.837444 I | ceph-mgr: 2017-07-11 14:17:02.837416 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:04.860248 I | ceph-mgr: 2017-07-11 14:17:04.860203 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:04.860412 I | ceph-mgr: 2017-07-11 14:17:04.860397 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:04.863586 I | ceph-mgr: 2017-07-11 14:17:04.863570 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:05.821283 I | ceph-mgr: 2017-07-11 14:17:05.821214 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4970 10.233.124.5:0/2521633153' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:05.822673 I | ceph-mgr: 2017-07-11 14:17:05.821235 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:06.837412 I | ceph-mgr: 2017-07-11 14:17:06.837310 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5016 10.233.124.0:0/1245304885' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:06.853276 I | ceph-mgr: 2017-07-11 14:17:06.837363 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:06.884807 I | ceph-mgr: 2017-07-11 14:17:06.882880 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:06.884842 I | ceph-mgr: 2017-07-11 14:17:06.882897 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:06.884856 I | ceph-mgr: 2017-07-11 14:17:06.882936 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:08.897041 I | ceph-mgr: 2017-07-11 14:17:08.889167 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:08.897120 I | ceph-mgr: 2017-07-11 14:17:08.889200 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:08.897137 I | ceph-mgr: 2017-07-11 14:17:08.889317 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:10.566817 I | ceph-mgr: 2017-07-11 14:17:10.566670 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5031 10.233.124.0:0/320736811' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:10.566893 I | ceph-mgr: 2017-07-11 14:17:10.566719 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:10.905751 I | ceph-mgr: 2017-07-11 14:17:10.895957 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:10.905885 I | ceph-mgr: 2017-07-11 14:17:10.895982 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:10.906086 I | ceph-mgr: 2017-07-11 14:17:10.896077 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:11.587154 I | ceph-mgr: 2017-07-11 14:17:11.587005 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5037 10.233.124.0:0/3735486117' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:11.587203 I | ceph-mgr: 2017-07-11 14:17:11.587067 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:12.915649 I | ceph-mgr: 2017-07-11 14:17:12.914394 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:12.915933 I | ceph-mgr: 2017-07-11 14:17:12.915714 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:12.916365 I | ceph-mgr: 2017-07-11 14:17:12.916347 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:14.923428 I | ceph-mgr: 2017-07-11 14:17:14.922148 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:14.923490 I | ceph-mgr: 2017-07-11 14:17:14.922153 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:14.923680 I | ceph-mgr: 2017-07-11 14:17:14.922171 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:15.609859 I | ceph-mgr: 2017-07-11 14:17:15.609834 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5046 10.233.124.0:0/876125000' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:15.610004 I | ceph-mgr: 2017-07-11 14:17:15.609944 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:16.577256 I | ceph-mgr: 2017-07-11 14:17:16.577230 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5052 10.233.124.0:0/2181369187' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:16.577427 I | ceph-mgr: 2017-07-11 14:17:16.577412 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:16.930943 I | ceph-mgr: 2017-07-11 14:17:16.929542 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:16.931153 I | ceph-mgr: 2017-07-11 14:17:16.929547 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:16.931181 I | ceph-mgr: 2017-07-11 14:17:16.929568 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:18.931373 I | ceph-mgr: 2017-07-11 14:17:18.931323 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:18.931452 I | ceph-mgr: 2017-07-11 14:17:18.931438 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:18.931693 I | ceph-mgr: 2017-07-11 14:17:18.931677 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:20.503345 I | ceph-mgr: 2017-07-11 14:17:20.503318 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5009 10.233.124.5:0/1174135636' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:20.503446 I | ceph-mgr: 2017-07-11 14:17:20.503432 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:20.935222 I | ceph-mgr: 2017-07-11 14:17:20.935193 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:20.935284 I | ceph-mgr: 2017-07-11 14:17:20.935270 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:20.935490 I | ceph-mgr: 2017-07-11 14:17:20.935380 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:21.587245 I | ceph-mgr: 2017-07-11 14:17:21.587132 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5061 10.233.124.0:0/602374285' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:21.587333 I | ceph-mgr: 2017-07-11 14:17:21.587184 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:22.952159 I | ceph-mgr: 2017-07-11 14:17:22.952123 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:22.952229 I | ceph-mgr: 2017-07-11 14:17:22.952215 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:22.952595 I | ceph-mgr: 2017-07-11 14:17:22.952580 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:24.974232 I | ceph-mgr: 2017-07-11 14:17:24.974183 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:24.974453 I | ceph-mgr: 2017-07-11 14:17:24.974438 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:24.976642 I | ceph-mgr: 2017-07-11 14:17:24.976626 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:25.366013 I | ceph-mgr: 2017-07-11 14:17:25.365945 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5073 10.233.124.0:0/1076879418' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:25.366085 I | ceph-mgr: 2017-07-11 14:17:25.365965 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:26.490273 I | ceph-mgr: 2017-07-11 14:17:26.490182 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5021 10.233.124.5:0/3557021983' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:26.490341 I | ceph-mgr: 2017-07-11 14:17:26.490232 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:26.994089 I | ceph-mgr: 2017-07-11 14:17:26.994055 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:26.994168 I | ceph-mgr: 2017-07-11 14:17:26.994154 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:26.994420 I | ceph-mgr: 2017-07-11 14:17:26.994405 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:29.009189 I | ceph-mgr: 2017-07-11 14:17:29.006059 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:29.009268 I | ceph-mgr: 2017-07-11 14:17:29.006072 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:29.009284 I | ceph-mgr: 2017-07-11 14:17:29.006101 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:30.237656 I | ceph-mgr: 2017-07-11 14:17:30.237608 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5033 10.233.124.5:0/2342233061' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:30.237743 I | ceph-mgr: 2017-07-11 14:17:30.237717 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:31.011396 I | ceph-mgr: 2017-07-11 14:17:31.011210 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:31.011624 I | ceph-mgr: 2017-07-11 14:17:31.011217 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:31.011785 I | ceph-mgr: 2017-07-11 14:17:31.011239 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:31.260365 I | ceph-mgr: 2017-07-11 14:17:31.260286 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5036 10.233.124.5:0/2399045151' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:31.260411 I | ceph-mgr: 2017-07-11 14:17:31.260333 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:33.019906 I | ceph-mgr: 2017-07-11 14:17:33.019873 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:33.019973 I | ceph-mgr: 2017-07-11 14:17:33.019959 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:33.020053 I | ceph-mgr: 2017-07-11 14:17:33.020036 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:35.035610 I | ceph-mgr: 2017-07-11 14:17:35.035053 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:35.035683 I | ceph-mgr: 2017-07-11 14:17:35.035668 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:35.035846 I | ceph-mgr: 2017-07-11 14:17:35.035786 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:35.084865 I | ceph-mgr: 2017-07-11 14:17:35.084813 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5045 10.233.124.5:0/3110605102' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:35.084932 I | ceph-mgr: 2017-07-11 14:17:35.084908 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:36.123335 I | ceph-mgr: 2017-07-11 14:17:36.123258 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5106 10.233.124.0:0/2504410468' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:36.131964 I | ceph-mgr: 2017-07-11 14:17:36.131929 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:37.039424 I | ceph-mgr: 2017-07-11 14:17:37.037317 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:37.045689 I | ceph-mgr: 2017-07-11 14:17:37.045668 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:37.046713 I | ceph-mgr: 2017-07-11 14:17:37.046603 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:39.051027 I | ceph-mgr: 2017-07-11 14:17:39.050985 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:39.051068 I | ceph-mgr: 2017-07-11 14:17:39.051054 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:39.051395 I | ceph-mgr: 2017-07-11 14:17:39.051378 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:40.076825 I | ceph-mgr: 2017-07-11 14:17:40.076750 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5054 10.233.124.5:0/3895700424' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:40.076911 I | ceph-mgr: 2017-07-11 14:17:40.076770 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:40.974899 I | ceph-mgr: 2017-07-11 14:17:40.974817 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5121 10.233.124.0:0/2420263698' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:40.975030 I | ceph-mgr: 2017-07-11 14:17:40.974976 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:41.104865 I | ceph-mgr: 2017-07-11 14:17:41.095590 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:41.104941 I | ceph-mgr: 2017-07-11 14:17:41.104923 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:41.107981 I | ceph-mgr: 2017-07-11 14:17:41.107963 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:43.135334 I | ceph-mgr: 2017-07-11 14:17:43.133774 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:43.135540 I | ceph-mgr: 2017-07-11 14:17:43.133781 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:43.135577 I | ceph-mgr: 2017-07-11 14:17:43.133810 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:44.989851 I | ceph-mgr: 2017-07-11 14:17:44.989802 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5069 10.233.124.5:0/3185883319' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:44.989937 I | ceph-mgr: 2017-07-11 14:17:44.989912 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:45.136887 I | ceph-mgr: 2017-07-11 14:17:45.135514 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:45.137043 I | ceph-mgr: 2017-07-11 14:17:45.135519 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:45.137081 I | ceph-mgr: 2017-07-11 14:17:45.135538 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:46.008390 I | ceph-mgr: 2017-07-11 14:17:46.008318 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5075 10.233.124.5:0/4140440348' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:46.008478 I | ceph-mgr: 2017-07-11 14:17:46.008452 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:47.148629 I | ceph-mgr: 2017-07-11 14:17:47.147263 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:47.148785 I | ceph-mgr: 2017-07-11 14:17:47.147277 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:47.148829 I | ceph-mgr: 2017-07-11 14:17:47.147325 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:49.152183 I | ceph-mgr: 2017-07-11 14:17:49.151265 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:49.152245 I | ceph-mgr: 2017-07-11 14:17:49.151270 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:49.152267 I | ceph-mgr: 2017-07-11 14:17:49.151297 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:49.894365 I | ceph-mgr: 2017-07-11 14:17:49.894317 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5087 10.233.124.5:0/835255040' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:49.894456 I | ceph-mgr: 2017-07-11 14:17:49.894430 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:50.855333 I | ceph-mgr: 2017-07-11 14:17:50.855253 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5093 10.233.124.5:0/413547159' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:50.858011 I | ceph-mgr: 2017-07-11 14:17:50.857982 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:51.153974 I | ceph-mgr: 2017-07-11 14:17:51.153228 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:51.154168 I | ceph-mgr: 2017-07-11 14:17:51.153241 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:51.154205 I | ceph-mgr: 2017-07-11 14:17:51.153272 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:53.173280 I | ceph-mgr: 2017-07-11 14:17:53.173246 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:53.173364 I | ceph-mgr: 2017-07-11 14:17:53.173350 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:53.173635 I | ceph-mgr: 2017-07-11 14:17:53.173618 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:55.117166 I | ceph-mgr: 2017-07-11 14:17:55.117075 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5160 10.233.124.0:0/1880211250' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:55.118863 I | ceph-mgr: 2017-07-11 14:17:55.117095 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:55.179179 I | ceph-mgr: 2017-07-11 14:17:55.177819 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:55.179323 I | ceph-mgr: 2017-07-11 14:17:55.177824 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:55.179343 I | ceph-mgr: 2017-07-11 14:17:55.177844 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:56.201883 I | ceph-mgr: 2017-07-11 14:17:56.201807 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5166 10.233.124.0:0/849999543' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:56.202264 I | ceph-mgr: 2017-07-11 14:17:56.202221 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:17:57.182292 I | ceph-mgr: 2017-07-11 14:17:57.182243 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:57.182381 I | ceph-mgr: 2017-07-11 14:17:57.182366 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:57.182622 I | ceph-mgr: 2017-07-11 14:17:57.182607 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:59.188713 I | ceph-mgr: 2017-07-11 14:17:59.188650 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:17:59.188836 I | ceph-mgr: 2017-07-11 14:17:59.188821 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:17:59.189100 I | ceph-mgr: 2017-07-11 14:17:59.188993 7f4cc3226700 0 mgr tick
- 2017-07-11 14:17:59.822298 I | ceph-mgr: 2017-07-11 14:17:59.822248 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5175 10.233.124.0:0/3103197433' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:17:59.831295 I | ceph-mgr: 2017-07-11 14:17:59.831264 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:00.820979 I | ceph-mgr: 2017-07-11 14:18:00.820889 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5123 10.233.124.5:0/3227207748' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:00.821164 I | ceph-mgr: 2017-07-11 14:18:00.821069 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:01.191647 I | ceph-mgr: 2017-07-11 14:18:01.191580 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:01.191756 I | ceph-mgr: 2017-07-11 14:18:01.191729 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:01.191995 I | ceph-mgr: 2017-07-11 14:18:01.191979 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:03.206262 I | ceph-mgr: 2017-07-11 14:18:03.195885 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:03.206491 I | ceph-mgr: 2017-07-11 14:18:03.195896 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:03.206589 I | ceph-mgr: 2017-07-11 14:18:03.195939 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:04.717817 I | ceph-mgr: 2017-07-11 14:18:04.717772 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5138 10.233.124.5:0/2886493972' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:04.723640 I | ceph-mgr: 2017-07-11 14:18:04.723610 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:05.212706 I | ceph-mgr: 2017-07-11 14:18:05.212669 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:05.212794 I | ceph-mgr: 2017-07-11 14:18:05.212780 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:05.213023 I | ceph-mgr: 2017-07-11 14:18:05.213007 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:05.740641 I | ceph-mgr: 2017-07-11 14:18:05.740567 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5196 10.233.124.0:0/554163170' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:05.740737 I | ceph-mgr: 2017-07-11 14:18:05.740710 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:07.228324 I | ceph-mgr: 2017-07-11 14:18:07.228257 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:07.228410 I | ceph-mgr: 2017-07-11 14:18:07.228395 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:07.228644 I | ceph-mgr: 2017-07-11 14:18:07.228629 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:09.243516 I | ceph-mgr: 2017-07-11 14:18:09.233674 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:09.243724 I | ceph-mgr: 2017-07-11 14:18:09.233679 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:09.244182 I | ceph-mgr: 2017-07-11 14:18:09.233701 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:09.658334 I | ceph-mgr: 2017-07-11 14:18:09.658281 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5156 10.233.124.5:0/703562625' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:09.658525 I | ceph-mgr: 2017-07-11 14:18:09.658430 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:10.523369 I | ceph-mgr: 2017-07-11 14:18:10.523267 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5214 10.233.124.0:0/3826526649' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:10.529382 I | ceph-mgr: 2017-07-11 14:18:10.529342 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:11.254421 I | ceph-mgr: 2017-07-11 14:18:11.246513 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:11.254660 I | ceph-mgr: 2017-07-11 14:18:11.246522 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:11.254687 I | ceph-mgr: 2017-07-11 14:18:11.246545 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:13.259735 I | ceph-mgr: 2017-07-11 14:18:13.259588 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:13.259882 I | ceph-mgr: 2017-07-11 14:18:13.259593 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:13.259931 I | ceph-mgr: 2017-07-11 14:18:13.259626 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:14.797715 I | ceph-mgr: 2017-07-11 14:18:14.797657 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5174 10.233.124.5:0/2438040053' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:14.797772 I | ceph-mgr: 2017-07-11 14:18:14.797676 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:15.267910 I | ceph-mgr: 2017-07-11 14:18:15.266234 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:15.267969 I | ceph-mgr: 2017-07-11 14:18:15.266244 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:15.267985 I | ceph-mgr: 2017-07-11 14:18:15.266282 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:15.843855 I | ceph-mgr: 2017-07-11 14:18:15.843773 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5226 10.233.124.0:0/1866046457' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:15.843904 I | ceph-mgr: 2017-07-11 14:18:15.843820 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:17.273499 I | ceph-mgr: 2017-07-11 14:18:17.272153 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:17.273703 I | ceph-mgr: 2017-07-11 14:18:17.272165 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:17.273729 I | ceph-mgr: 2017-07-11 14:18:17.272195 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:19.275261 I | ceph-mgr: 2017-07-11 14:18:19.273787 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:19.276656 I | ceph-mgr: 2017-07-11 14:18:19.273797 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:19.276687 I | ceph-mgr: 2017-07-11 14:18:19.273825 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:19.832041 I | ceph-mgr: 2017-07-11 14:18:19.831993 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5192 10.233.124.5:0/1516583973' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:19.832132 I | ceph-mgr: 2017-07-11 14:18:19.832106 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:20.741895 I | ceph-mgr: 2017-07-11 14:18:20.741811 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5195 10.233.124.5:0/1142112896' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:20.741991 I | ceph-mgr: 2017-07-11 14:18:20.741959 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:21.286208 I | ceph-mgr: 2017-07-11 14:18:21.282617 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:21.286221 I | ceph-mgr: 2017-07-11 14:18:21.282623 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:21.286224 I | ceph-mgr: 2017-07-11 14:18:21.282649 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:23.286720 I | ceph-mgr: 2017-07-11 14:18:23.285344 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:23.287202 I | ceph-mgr: 2017-07-11 14:18:23.285349 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:23.287249 I | ceph-mgr: 2017-07-11 14:18:23.285373 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:24.703589 I | ceph-mgr: 2017-07-11 14:18:24.703515 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5201 10.233.124.5:0/2719461865' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:24.703817 I | ceph-mgr: 2017-07-11 14:18:24.703774 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:25.290248 I | ceph-mgr: 2017-07-11 14:18:25.288064 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:25.298379 I | ceph-mgr: 2017-07-11 14:18:25.288076 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:25.298452 I | ceph-mgr: 2017-07-11 14:18:25.288104 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:25.822292 I | ceph-mgr: 2017-07-11 14:18:25.806231 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5207 10.233.124.5:0/2987548372' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:25.822470 I | ceph-mgr: 2017-07-11 14:18:25.822387 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:27.307131 I | ceph-mgr: 2017-07-11 14:18:27.290782 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:27.307333 I | ceph-mgr: 2017-07-11 14:18:27.290795 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:27.307363 I | ceph-mgr: 2017-07-11 14:18:27.290825 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:29.308537 I | ceph-mgr: 2017-07-11 14:18:29.308507 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:29.308632 I | ceph-mgr: 2017-07-11 14:18:29.308618 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:29.308852 I | ceph-mgr: 2017-07-11 14:18:29.308826 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:29.491086 I | ceph-mgr: 2017-07-11 14:18:29.491035 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5216 10.233.124.5:0/2171432283' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:29.491125 I | ceph-mgr: 2017-07-11 14:18:29.491056 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:30.476506 I | ceph-mgr: 2017-07-11 14:18:30.476412 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5265 10.233.124.0:0/3570578242' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:30.476578 I | ceph-mgr: 2017-07-11 14:18:30.476459 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:31.330434 I | ceph-mgr: 2017-07-11 14:18:31.330326 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:31.330539 I | ceph-mgr: 2017-07-11 14:18:31.330523 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:31.330819 I | ceph-mgr: 2017-07-11 14:18:31.330802 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:33.332591 I | ceph-mgr: 2017-07-11 14:18:33.332528 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:33.332673 I | ceph-mgr: 2017-07-11 14:18:33.332658 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:33.332880 I | ceph-mgr: 2017-07-11 14:18:33.332768 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:34.359033 I | ceph-mgr: 2017-07-11 14:18:34.358946 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5277 10.233.124.0:0/1715498389' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:34.359098 I | ceph-mgr: 2017-07-11 14:18:34.358966 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:35.331778 I | ceph-mgr: 2017-07-11 14:18:35.331700 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5231 10.233.124.5:0/2407123659' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:35.331862 I | ceph-mgr: 2017-07-11 14:18:35.331836 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:35.342701 I | ceph-mgr: 2017-07-11 14:18:35.342676 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:35.342776 I | ceph-mgr: 2017-07-11 14:18:35.342761 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:35.342883 I | ceph-mgr: 2017-07-11 14:18:35.342869 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:37.366151 I | ceph-mgr: 2017-07-11 14:18:37.366091 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:37.366423 I | ceph-mgr: 2017-07-11 14:18:37.366270 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:37.366604 I | ceph-mgr: 2017-07-11 14:18:37.366589 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:39.334864 I | ceph-mgr: 2017-07-11 14:18:39.334800 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5246 10.233.124.5:0/2824951766' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:39.334954 I | ceph-mgr: 2017-07-11 14:18:39.334928 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:39.372206 I | ceph-mgr: 2017-07-11 14:18:39.372147 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:39.375648 I | ceph-mgr: 2017-07-11 14:18:39.372293 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:39.375860 I | ceph-mgr: 2017-07-11 14:18:39.375843 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:40.248320 I | ceph-mgr: 2017-07-11 14:18:40.248233 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5249 10.233.124.5:0/1254605575' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:40.248382 I | ceph-mgr: 2017-07-11 14:18:40.248280 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:41.383290 I | ceph-mgr: 2017-07-11 14:18:41.383206 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:41.383378 I | ceph-mgr: 2017-07-11 14:18:41.383362 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:41.383582 I | ceph-mgr: 2017-07-11 14:18:41.383566 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:43.391830 I | ceph-mgr: 2017-07-11 14:18:43.388421 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:43.391886 I | ceph-mgr: 2017-07-11 14:18:43.388428 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:43.391901 I | ceph-mgr: 2017-07-11 14:18:43.388452 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:44.151943 I | ceph-mgr: 2017-07-11 14:18:44.151889 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5258 10.233.124.5:0/2958249601' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:44.152058 I | ceph-mgr: 2017-07-11 14:18:44.152029 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:45.159173 I | ceph-mgr: 2017-07-11 14:18:45.159138 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5264 10.233.124.5:0/978671393' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:45.159381 I | ceph-mgr: 2017-07-11 14:18:45.159346 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:45.395925 I | ceph-mgr: 2017-07-11 14:18:45.394887 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:45.395979 I | ceph-mgr: 2017-07-11 14:18:45.394899 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:45.395995 I | ceph-mgr: 2017-07-11 14:18:45.394928 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:47.404960 I | ceph-mgr: 2017-07-11 14:18:47.404879 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:47.405054 I | ceph-mgr: 2017-07-11 14:18:47.405040 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:47.405534 I | ceph-mgr: 2017-07-11 14:18:47.405518 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:49.251754 I | ceph-mgr: 2017-07-11 14:18:49.251725 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5285 10.233.124.5:0/35695997' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:49.253173 I | ceph-mgr: 2017-07-11 14:18:49.253157 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:49.409278 I | ceph-mgr: 2017-07-11 14:18:49.409233 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:49.409371 I | ceph-mgr: 2017-07-11 14:18:49.409357 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:49.409449 I | ceph-mgr: 2017-07-11 14:18:49.409439 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:50.257753 I | ceph-mgr: 2017-07-11 14:18:50.257722 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5328 10.233.124.0:0/2446786619' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:50.267688 I | ceph-mgr: 2017-07-11 14:18:50.267640 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:51.418132 I | ceph-mgr: 2017-07-11 14:18:51.414681 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:51.424677 I | ceph-mgr: 2017-07-11 14:18:51.424657 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:51.426161 I | ceph-mgr: 2017-07-11 14:18:51.424763 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:53.439698 I | ceph-mgr: 2017-07-11 14:18:53.438310 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:53.439753 I | ceph-mgr: 2017-07-11 14:18:53.438321 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:53.439769 I | ceph-mgr: 2017-07-11 14:18:53.438358 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:54.054283 I | ceph-mgr: 2017-07-11 14:18:54.054230 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5340 10.233.124.0:0/2976019664' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:54.064174 I | ceph-mgr: 2017-07-11 14:18:54.064142 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:55.110254 I | ceph-mgr: 2017-07-11 14:18:55.110225 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5300 10.233.124.5:0/1422396715' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:55.118094 I | ceph-mgr: 2017-07-11 14:18:55.118076 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:55.443386 I | ceph-mgr: 2017-07-11 14:18:55.442064 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:55.451239 I | ceph-mgr: 2017-07-11 14:18:55.442070 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:55.451275 I | ceph-mgr: 2017-07-11 14:18:55.442091 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:57.445892 I | ceph-mgr: 2017-07-11 14:18:57.444506 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:57.445970 I | ceph-mgr: 2017-07-11 14:18:57.444515 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:57.445987 I | ceph-mgr: 2017-07-11 14:18:57.444541 7f4cc3226700 0 mgr tick
- 2017-07-11 14:18:59.131396 I | ceph-mgr: 2017-07-11 14:18:59.131331 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5309 10.233.124.5:0/724144561' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:18:59.131473 I | ceph-mgr: 2017-07-11 14:18:59.131352 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:18:59.464427 I | ceph-mgr: 2017-07-11 14:18:59.464402 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:18:59.464487 I | ceph-mgr: 2017-07-11 14:18:59.464473 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:18:59.464738 I | ceph-mgr: 2017-07-11 14:18:59.464695 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:00.134882 I | ceph-mgr: 2017-07-11 14:19:00.134770 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5364 10.233.124.5:0/757066163' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:00.134953 I | ceph-mgr: 2017-07-11 14:19:00.134819 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:01.478884 I | ceph-mgr: 2017-07-11 14:19:01.475045 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:01.484853 I | ceph-mgr: 2017-07-11 14:19:01.475058 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:01.484896 I | ceph-mgr: 2017-07-11 14:19:01.475089 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:03.478737 I | ceph-mgr: 2017-07-11 14:19:03.478709 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:03.478826 I | ceph-mgr: 2017-07-11 14:19:03.478801 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:03.479032 I | ceph-mgr: 2017-07-11 14:19:03.478928 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:04.108799 I | ceph-mgr: 2017-07-11 14:19:04.108750 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5370 10.233.124.5:0/3001214657' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:04.110746 I | ceph-mgr: 2017-07-11 14:19:04.110720 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:05.058106 I | ceph-mgr: 2017-07-11 14:19:05.058022 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5373 10.233.124.5:0/1615505875' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:05.058295 I | ceph-mgr: 2017-07-11 14:19:05.058207 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:05.506723 I | ceph-mgr: 2017-07-11 14:19:05.497682 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:05.506936 I | ceph-mgr: 2017-07-11 14:19:05.497687 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:05.507033 I | ceph-mgr: 2017-07-11 14:19:05.497711 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:07.516788 I | ceph-mgr: 2017-07-11 14:19:07.515351 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:07.516995 I | ceph-mgr: 2017-07-11 14:19:07.515358 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:07.517092 I | ceph-mgr: 2017-07-11 14:19:07.515388 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:09.010963 I | ceph-mgr: 2017-07-11 14:19:09.010883 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5339 10.233.124.5:0/970122958' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:09.011032 I | ceph-mgr: 2017-07-11 14:19:09.010909 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:09.519418 I | ceph-mgr: 2017-07-11 14:19:09.517048 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:09.519573 I | ceph-mgr: 2017-07-11 14:19:09.517059 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:09.519615 I | ceph-mgr: 2017-07-11 14:19:09.517082 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:09.900720 I | ceph-mgr: 2017-07-11 14:19:09.900615 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5400 10.233.124.0:0/2506642879' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:09.903359 I | ceph-mgr: 2017-07-11 14:19:09.900663 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:11.527773 I | ceph-mgr: 2017-07-11 14:19:11.526290 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:11.535210 I | ceph-mgr: 2017-07-11 14:19:11.526310 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:11.535248 I | ceph-mgr: 2017-07-11 14:19:11.526339 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:13.531804 I | ceph-mgr: 2017-07-11 14:19:13.530276 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:13.539494 I | ceph-mgr: 2017-07-11 14:19:13.530283 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:13.539528 I | ceph-mgr: 2017-07-11 14:19:13.530308 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:13.974479 I | ceph-mgr: 2017-07-11 14:19:13.974446 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5351 10.233.124.5:0/3665672564' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:13.974581 I | ceph-mgr: 2017-07-11 14:19:13.974566 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:14.959625 I | ceph-mgr: 2017-07-11 14:19:14.959593 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5357 10.233.124.5:0/1209534095' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:14.959808 I | ceph-mgr: 2017-07-11 14:19:14.959792 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:15.539649 I | ceph-mgr: 2017-07-11 14:19:15.538274 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:15.547599 I | ceph-mgr: 2017-07-11 14:19:15.538280 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:15.547633 I | ceph-mgr: 2017-07-11 14:19:15.538300 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:17.550381 I | ceph-mgr: 2017-07-11 14:19:17.540353 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:17.550452 I | ceph-mgr: 2017-07-11 14:19:17.540364 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:17.550468 I | ceph-mgr: 2017-07-11 14:19:17.540400 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:18.811943 I | ceph-mgr: 2017-07-11 14:19:18.811918 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5427 10.233.124.0:0/2772764420' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:18.812576 I | ceph-mgr: 2017-07-11 14:19:18.812560 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:19.555273 I | ceph-mgr: 2017-07-11 14:19:19.555239 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:19.555442 I | ceph-mgr: 2017-07-11 14:19:19.555426 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:19.556608 I | ceph-mgr: 2017-07-11 14:19:19.556590 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:19.832698 I | ceph-mgr: 2017-07-11 14:19:19.832677 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5366 10.233.124.5:0/3994955966' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:19.832868 I | ceph-mgr: 2017-07-11 14:19:19.832852 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:21.565409 I | ceph-mgr: 2017-07-11 14:19:21.565374 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:21.565495 I | ceph-mgr: 2017-07-11 14:19:21.565480 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:21.565990 I | ceph-mgr: 2017-07-11 14:19:21.565973 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:23.568079 I | ceph-mgr: 2017-07-11 14:19:23.568050 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:23.568158 I | ceph-mgr: 2017-07-11 14:19:23.568144 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:23.584373 I | ceph-mgr: 2017-07-11 14:19:23.584303 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:23.752234 I | ceph-mgr: 2017-07-11 14:19:23.752158 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5381 10.233.124.5:0/2394032611' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:23.752362 I | ceph-mgr: 2017-07-11 14:19:23.752323 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:24.641643 I | ceph-mgr: 2017-07-11 14:19:24.641562 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5384 10.233.124.5:0/2527762003' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:24.642771 I | ceph-mgr: 2017-07-11 14:19:24.642741 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:25.609004 I | ceph-mgr: 2017-07-11 14:19:25.588201 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:25.609083 I | ceph-mgr: 2017-07-11 14:19:25.588216 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:25.609100 I | ceph-mgr: 2017-07-11 14:19:25.588249 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:27.593598 I | ceph-mgr: 2017-07-11 14:19:27.592288 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:27.593662 I | ceph-mgr: 2017-07-11 14:19:27.592294 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:27.593677 I | ceph-mgr: 2017-07-11 14:19:27.592314 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:28.661164 I | ceph-mgr: 2017-07-11 14:19:28.661108 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5396 10.233.124.5:0/359081322' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:28.663197 I | ceph-mgr: 2017-07-11 14:19:28.663169 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:29.597623 I | ceph-mgr: 2017-07-11 14:19:29.596289 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:29.597685 I | ceph-mgr: 2017-07-11 14:19:29.596299 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:29.597700 I | ceph-mgr: 2017-07-11 14:19:29.596327 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:29.607453 I | ceph-mgr: 2017-07-11 14:19:29.607385 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5451 10.233.124.0:0/2973206010' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:29.607538 I | ceph-mgr: 2017-07-11 14:19:29.607496 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:31.603664 I | ceph-mgr: 2017-07-11 14:19:31.603461 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:31.603733 I | ceph-mgr: 2017-07-11 14:19:31.603467 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:31.603749 I | ceph-mgr: 2017-07-11 14:19:31.603487 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:33.608497 I | ceph-mgr: 2017-07-11 14:19:33.608345 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:33.608561 I | ceph-mgr: 2017-07-11 14:19:33.608351 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:33.608643 I | ceph-mgr: 2017-07-11 14:19:33.608578 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:33.646938 I | ceph-mgr: 2017-07-11 14:19:33.646903 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5466 10.233.124.0:0/960413022' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:33.647007 I | ceph-mgr: 2017-07-11 14:19:33.646983 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:34.521960 I | ceph-mgr: 2017-07-11 14:19:34.521885 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5472 10.233.124.0:0/388742017' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:34.522051 I | ceph-mgr: 2017-07-11 14:19:34.522026 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:35.612889 I | ceph-mgr: 2017-07-11 14:19:35.611633 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:35.612942 I | ceph-mgr: 2017-07-11 14:19:35.611638 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:35.612957 I | ceph-mgr: 2017-07-11 14:19:35.611660 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:37.616102 I | ceph-mgr: 2017-07-11 14:19:37.615008 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:37.616163 I | ceph-mgr: 2017-07-11 14:19:37.615013 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:37.616178 I | ceph-mgr: 2017-07-11 14:19:37.615033 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:38.470665 I | ceph-mgr: 2017-07-11 14:19:38.470622 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5484 10.233.124.0:0/1459261890' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:38.470748 I | ceph-mgr: 2017-07-11 14:19:38.470723 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:39.406973 I | ceph-mgr: 2017-07-11 14:19:39.406888 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5420 10.233.124.5:0/2072988570' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:39.407074 I | ceph-mgr: 2017-07-11 14:19:39.407048 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:39.626955 I | ceph-mgr: 2017-07-11 14:19:39.625540 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:39.627043 I | ceph-mgr: 2017-07-11 14:19:39.625559 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:39.627059 I | ceph-mgr: 2017-07-11 14:19:39.625608 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:41.632482 I | ceph-mgr: 2017-07-11 14:19:41.630412 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:41.633004 I | ceph-mgr: 2017-07-11 14:19:41.630430 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:41.633057 I | ceph-mgr: 2017-07-11 14:19:41.630481 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:43.592459 I | ceph-mgr: 2017-07-11 14:19:43.592411 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5438 10.233.124.5:0/2801788329' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:43.592601 I | ceph-mgr: 2017-07-11 14:19:43.592522 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:43.648584 I | ceph-mgr: 2017-07-11 14:19:43.647349 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:43.648629 I | ceph-mgr: 2017-07-11 14:19:43.647354 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:43.648646 I | ceph-mgr: 2017-07-11 14:19:43.647372 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:44.454200 I | ceph-mgr: 2017-07-11 14:19:44.454121 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5502 10.233.124.0:0/1860069477' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:44.461189 I | ceph-mgr: 2017-07-11 14:19:44.461157 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:45.656745 I | ceph-mgr: 2017-07-11 14:19:45.655617 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:45.656798 I | ceph-mgr: 2017-07-11 14:19:45.655630 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:45.656814 I | ceph-mgr: 2017-07-11 14:19:45.655673 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:47.676157 I | ceph-mgr: 2017-07-11 14:19:47.659685 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:47.676320 I | ceph-mgr: 2017-07-11 14:19:47.659691 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:47.676369 I | ceph-mgr: 2017-07-11 14:19:47.659713 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:49.019502 I | ceph-mgr: 2017-07-11 14:19:49.019443 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4876 10.233.124.0:0/1381276543' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:49.019557 I | ceph-mgr: 2017-07-11 14:19:49.019462 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:49.677152 I | ceph-mgr: 2017-07-11 14:19:49.677099 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:49.677224 I | ceph-mgr: 2017-07-11 14:19:49.677210 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:49.683022 I | ceph-mgr: 2017-07-11 14:19:49.683006 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:50.026170 I | ceph-mgr: 2017-07-11 14:19:50.026089 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5450 10.233.124.5:0/3041667924' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:50.027692 I | ceph-mgr: 2017-07-11 14:19:50.026135 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:51.684826 I | ceph-mgr: 2017-07-11 14:19:51.684784 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:51.684904 I | ceph-mgr: 2017-07-11 14:19:51.684890 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:51.685129 I | ceph-mgr: 2017-07-11 14:19:51.685114 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:53.550996 I | ceph-mgr: 2017-07-11 14:19:53.550933 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5465 10.233.124.5:0/4055004005' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:53.551064 I | ceph-mgr: 2017-07-11 14:19:53.550953 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:53.701031 I | ceph-mgr: 2017-07-11 14:19:53.697635 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:53.707432 I | ceph-mgr: 2017-07-11 14:19:53.707362 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:53.711138 I | ceph-mgr: 2017-07-11 14:19:53.711122 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:54.523069 I | ceph-mgr: 2017-07-11 14:19:54.522983 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5526 10.233.124.0:0/2663456100' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:54.523124 I | ceph-mgr: 2017-07-11 14:19:54.523029 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:55.738942 I | ceph-mgr: 2017-07-11 14:19:55.738896 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:55.739028 I | ceph-mgr: 2017-07-11 14:19:55.739014 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:55.739291 I | ceph-mgr: 2017-07-11 14:19:55.739264 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:57.761440 I | ceph-mgr: 2017-07-11 14:19:57.761406 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:57.761528 I | ceph-mgr: 2017-07-11 14:19:57.761515 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:57.761747 I | ceph-mgr: 2017-07-11 14:19:57.761731 7f4cc3226700 0 mgr tick
- 2017-07-11 14:19:58.193657 I | ceph-mgr: 2017-07-11 14:19:58.193536 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5480 10.233.124.5:0/2813387374' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:58.193725 I | ceph-mgr: 2017-07-11 14:19:58.193600 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:59.101919 I | ceph-mgr: 2017-07-11 14:19:59.101835 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5538 10.233.124.5:0/3064744255' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:19:59.102100 I | ceph-mgr: 2017-07-11 14:19:59.102009 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:19:59.775228 I | ceph-mgr: 2017-07-11 14:19:59.765404 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:19:59.775704 I | ceph-mgr: 2017-07-11 14:19:59.765410 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:19:59.775736 I | ceph-mgr: 2017-07-11 14:19:59.765431 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:01.769652 I | ceph-mgr: 2017-07-11 14:20:01.768248 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:01.769863 I | ceph-mgr: 2017-07-11 14:20:01.768253 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:01.769958 I | ceph-mgr: 2017-07-11 14:20:01.768274 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:03.457031 I | ceph-mgr: 2017-07-11 14:20:03.456988 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5501 10.233.124.5:0/3448672251' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:20:03.459762 I | ceph-mgr: 2017-07-11 14:20:03.459732 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:20:03.776286 I | ceph-mgr: 2017-07-11 14:20:03.773113 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:03.776351 I | ceph-mgr: 2017-07-11 14:20:03.773124 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:03.776365 I | ceph-mgr: 2017-07-11 14:20:03.773162 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:04.788996 I | ceph-mgr: 2017-07-11 14:20:04.788905 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4891 10.233.124.0:0/913079312' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:20:04.789057 I | ceph-mgr: 2017-07-11 14:20:04.788954 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:20:05.778284 I | ceph-mgr: 2017-07-11 14:20:05.778239 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:05.778366 I | ceph-mgr: 2017-07-11 14:20:05.778352 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:05.778608 I | ceph-mgr: 2017-07-11 14:20:05.778431 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:07.787924 I | ceph-mgr: 2017-07-11 14:20:07.780463 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:07.788002 I | ceph-mgr: 2017-07-11 14:20:07.780475 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:07.788017 I | ceph-mgr: 2017-07-11 14:20:07.780504 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:08.041961 I | ceph-mgr: 2017-07-11 14:20:08.041900 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5516 10.233.124.5:0/1031294498' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:20:08.044491 I | ceph-mgr: 2017-07-11 14:20:08.044465 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:20:08.952481 I | ceph-mgr: 2017-07-11 14:20:08.952376 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5519 10.233.124.5:0/2084813735' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:20:08.952647 I | ceph-mgr: 2017-07-11 14:20:08.952562 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:20:09.796615 I | ceph-mgr: 2017-07-11 14:20:09.786863 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:09.796692 I | ceph-mgr: 2017-07-11 14:20:09.786876 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:09.796707 I | ceph-mgr: 2017-07-11 14:20:09.786905 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:11.793578 I | ceph-mgr: 2017-07-11 14:20:11.792218 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:11.800669 I | ceph-mgr: 2017-07-11 14:20:11.792223 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:11.800704 I | ceph-mgr: 2017-07-11 14:20:11.792247 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:13.072350 I | ceph-mgr: 2017-07-11 14:20:13.072299 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5574 10.233.124.0:0/3721233974' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:20:13.072445 I | ceph-mgr: 2017-07-11 14:20:13.072419 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:20:13.797562 I | ceph-mgr: 2017-07-11 14:20:13.796214 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:13.805277 I | ceph-mgr: 2017-07-11 14:20:13.796220 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:13.805314 I | ceph-mgr: 2017-07-11 14:20:13.796241 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:13.992456 I | ceph-mgr: 2017-07-11 14:20:13.992375 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5528 10.233.124.5:0/3621697274' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:20:13.992571 I | ceph-mgr: 2017-07-11 14:20:13.992543 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:20:15.801633 I | ceph-mgr: 2017-07-11 14:20:15.800237 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:15.801700 I | ceph-mgr: 2017-07-11 14:20:15.800246 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:15.801716 I | ceph-mgr: 2017-07-11 14:20:15.800279 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:17.808785 I | ceph-mgr: 2017-07-11 14:20:17.807693 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:17.808848 I | ceph-mgr: 2017-07-11 14:20:17.807703 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:17.808906 I | ceph-mgr: 2017-07-11 14:20:17.807731 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:18.021739 I | ceph-mgr: 2017-07-11 14:20:18.021703 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5537 10.233.124.5:0/678454714' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:20:18.021811 I | ceph-mgr: 2017-07-11 14:20:18.021787 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:20:19.391685 I | ceph-mgr: 2017-07-11 14:20:19.391609 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5598 10.233.124.0:0/378527480' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:20:19.391782 I | ceph-mgr: 2017-07-11 14:20:19.391754 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:20:19.815193 I | ceph-mgr: 2017-07-11 14:20:19.813522 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:19.815245 I | ceph-mgr: 2017-07-11 14:20:19.813527 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:19.815261 I | ceph-mgr: 2017-07-11 14:20:19.813546 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:21.822176 I | ceph-mgr: 2017-07-11 14:20:21.820803 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:21.824246 I | ceph-mgr: 2017-07-11 14:20:21.820808 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:21.830062 I | ceph-mgr: 2017-07-11 14:20:21.820829 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:23.829703 I | ceph-mgr: 2017-07-11 14:20:23.829637 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:23.829921 I | ceph-mgr: 2017-07-11 14:20:23.829905 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:23.830121 I | ceph-mgr: 2017-07-11 14:20:23.830109 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:25.833547 I | ceph-mgr: 2017-07-11 14:20:25.833497 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:25.833771 I | ceph-mgr: 2017-07-11 14:20:25.833755 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:25.836175 I | ceph-mgr: 2017-07-11 14:20:25.833884 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:27.861209 I | ceph-mgr: 2017-07-11 14:20:27.859701 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:27.861276 I | ceph-mgr: 2017-07-11 14:20:27.859712 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:27.861293 I | ceph-mgr: 2017-07-11 14:20:27.859737 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:29.867661 I | ceph-mgr: 2017-07-11 14:20:29.867115 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:29.867731 I | ceph-mgr: 2017-07-11 14:20:29.867717 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:29.867902 I | ceph-mgr: 2017-07-11 14:20:29.867837 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:31.876780 I | ceph-mgr: 2017-07-11 14:20:31.876748 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:31.876852 I | ceph-mgr: 2017-07-11 14:20:31.876838 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:31.877092 I | ceph-mgr: 2017-07-11 14:20:31.877077 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:33.884496 I | ceph-mgr: 2017-07-11 14:20:33.884383 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:33.884588 I | ceph-mgr: 2017-07-11 14:20:33.884574 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:33.884843 I | ceph-mgr: 2017-07-11 14:20:33.884827 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:35.890669 I | ceph-mgr: 2017-07-11 14:20:35.888904 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:35.890742 I | ceph-mgr: 2017-07-11 14:20:35.888917 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:35.890858 I | ceph-mgr: 2017-07-11 14:20:35.890766 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:37.904080 I | ceph-mgr: 2017-07-11 14:20:37.903736 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:37.904169 I | ceph-mgr: 2017-07-11 14:20:37.904153 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:37.906397 I | ceph-mgr: 2017-07-11 14:20:37.904384 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:39.917075 I | ceph-mgr: 2017-07-11 14:20:39.907420 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:39.917181 I | ceph-mgr: 2017-07-11 14:20:39.907431 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:39.917245 I | ceph-mgr: 2017-07-11 14:20:39.907459 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:41.911009 I | ceph-mgr: 2017-07-11 14:20:41.910971 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:41.914633 I | ceph-mgr: 2017-07-11 14:20:41.911192 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:41.914744 I | ceph-mgr: 2017-07-11 14:20:41.914732 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:43.940316 I | ceph-mgr: 2017-07-11 14:20:43.938828 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:43.940419 I | ceph-mgr: 2017-07-11 14:20:43.938845 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:43.940723 I | ceph-mgr: 2017-07-11 14:20:43.938890 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:45.941819 I | ceph-mgr: 2017-07-11 14:20:45.941776 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:45.941896 I | ceph-mgr: 2017-07-11 14:20:45.941882 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:45.942120 I | ceph-mgr: 2017-07-11 14:20:45.942105 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:47.962699 I | ceph-mgr: 2017-07-11 14:20:47.962665 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:47.962776 I | ceph-mgr: 2017-07-11 14:20:47.962761 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:47.963001 I | ceph-mgr: 2017-07-11 14:20:47.962986 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:49.986905 I | ceph-mgr: 2017-07-11 14:20:49.986874 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:49.986977 I | ceph-mgr: 2017-07-11 14:20:49.986964 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:49.987321 I | ceph-mgr: 2017-07-11 14:20:49.987074 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:51.989221 I | ceph-mgr: 2017-07-11 14:20:51.989118 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:51.989343 I | ceph-mgr: 2017-07-11 14:20:51.989326 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:51.989587 I | ceph-mgr: 2017-07-11 14:20:51.989572 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:53.998045 I | ceph-mgr: 2017-07-11 14:20:53.998004 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:53.998138 I | ceph-mgr: 2017-07-11 14:20:53.998113 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:53.998404 I | ceph-mgr: 2017-07-11 14:20:53.998388 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:56.019130 I | ceph-mgr: 2017-07-11 14:20:56.015956 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:56.019221 I | ceph-mgr: 2017-07-11 14:20:56.019205 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:56.019463 I | ceph-mgr: 2017-07-11 14:20:56.019449 7f4cc3226700 0 mgr tick
- 2017-07-11 14:20:58.036847 I | ceph-mgr: 2017-07-11 14:20:58.036799 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:20:58.036928 I | ceph-mgr: 2017-07-11 14:20:58.036912 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:20:58.037424 I | ceph-mgr: 2017-07-11 14:20:58.037405 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:00.054469 I | ceph-mgr: 2017-07-11 14:21:00.054438 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:00.054648 I | ceph-mgr: 2017-07-11 14:21:00.054632 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:00.062001 I | ceph-mgr: 2017-07-11 14:21:00.061983 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:02.064036 I | ceph-mgr: 2017-07-11 14:21:02.063977 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:02.065629 I | ceph-mgr: 2017-07-11 14:21:02.065612 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:02.065898 I | ceph-mgr: 2017-07-11 14:21:02.065880 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:04.078282 I | ceph-mgr: 2017-07-11 14:21:04.070612 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:04.078363 I | ceph-mgr: 2017-07-11 14:21:04.070619 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:04.078379 I | ceph-mgr: 2017-07-11 14:21:04.070643 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:06.085521 I | ceph-mgr: 2017-07-11 14:21:06.085473 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:06.085704 I | ceph-mgr: 2017-07-11 14:21:06.085608 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:06.086138 I | ceph-mgr: 2017-07-11 14:21:06.086122 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:08.093211 I | ceph-mgr: 2017-07-11 14:21:08.093135 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:08.093473 I | ceph-mgr: 2017-07-11 14:21:08.093321 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:08.093879 I | ceph-mgr: 2017-07-11 14:21:08.093863 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:10.096771 I | ceph-mgr: 2017-07-11 14:21:10.096735 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:10.096952 I | ceph-mgr: 2017-07-11 14:21:10.096935 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:10.098392 I | ceph-mgr: 2017-07-11 14:21:10.098375 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:12.107123 I | ceph-mgr: 2017-07-11 14:21:12.107049 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:12.107384 I | ceph-mgr: 2017-07-11 14:21:12.107368 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:12.107804 I | ceph-mgr: 2017-07-11 14:21:12.107787 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:14.115157 I | ceph-mgr: 2017-07-11 14:21:14.115113 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:14.115253 I | ceph-mgr: 2017-07-11 14:21:14.115238 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:14.115480 I | ceph-mgr: 2017-07-11 14:21:14.115463 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:16.117419 I | ceph-mgr: 2017-07-11 14:21:16.117376 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:16.117495 I | ceph-mgr: 2017-07-11 14:21:16.117481 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:16.117727 I | ceph-mgr: 2017-07-11 14:21:16.117712 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:18.134931 I | ceph-mgr: 2017-07-11 14:21:18.134874 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:18.135025 I | ceph-mgr: 2017-07-11 14:21:18.135010 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:18.135494 I | ceph-mgr: 2017-07-11 14:21:18.135477 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:20.156231 I | ceph-mgr: 2017-07-11 14:21:20.156160 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:20.156309 I | ceph-mgr: 2017-07-11 14:21:20.156295 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:20.156768 I | ceph-mgr: 2017-07-11 14:21:20.156751 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:22.162177 I | ceph-mgr: 2017-07-11 14:21:22.162117 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:22.164645 I | ceph-mgr: 2017-07-11 14:21:22.164626 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:22.165076 I | ceph-mgr: 2017-07-11 14:21:22.165059 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:24.188713 I | ceph-mgr: 2017-07-11 14:21:24.188087 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:24.188877 I | ceph-mgr: 2017-07-11 14:21:24.188101 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:24.189010 I | ceph-mgr: 2017-07-11 14:21:24.188130 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:25.285850 I | ceph-mgr: 2017-07-11 14:21:25.285818 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5558 10.233.124.5:0/3459648095' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:25.286059 I | ceph-mgr: 2017-07-11 14:21:25.286030 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:26.192650 I | ceph-mgr: 2017-07-11 14:21:26.192615 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:26.192729 I | ceph-mgr: 2017-07-11 14:21:26.192715 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:26.192950 I | ceph-mgr: 2017-07-11 14:21:26.192793 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:26.398153 I | ceph-mgr: 2017-07-11 14:21:26.398132 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5610 10.233.124.0:0/3845189929' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:26.398331 I | ceph-mgr: 2017-07-11 14:21:26.398315 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:28.207919 I | ceph-mgr: 2017-07-11 14:21:28.207848 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:28.208108 I | ceph-mgr: 2017-07-11 14:21:28.208092 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:28.208241 I | ceph-mgr: 2017-07-11 14:21:28.208230 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:29.323784 I | ceph-mgr: 2017-07-11 14:21:29.323754 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5622 10.233.124.0:0/2362104680' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:29.323925 I | ceph-mgr: 2017-07-11 14:21:29.323863 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:30.230369 I | ceph-mgr: 2017-07-11 14:21:30.210830 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:30.230915 I | ceph-mgr: 2017-07-11 14:21:30.210835 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:30.231053 I | ceph-mgr: 2017-07-11 14:21:30.210854 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:30.292299 I | ceph-mgr: 2017-07-11 14:21:30.292172 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5628 10.233.124.0:0/2487847596' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:30.292345 I | ceph-mgr: 2017-07-11 14:21:30.292215 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:32.220438 I | ceph-mgr: 2017-07-11 14:21:32.219086 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:32.220647 I | ceph-mgr: 2017-07-11 14:21:32.219091 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:32.220680 I | ceph-mgr: 2017-07-11 14:21:32.219111 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:33.114841 I | ceph-mgr: 2017-07-11 14:21:33.114717 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5643 10.233.124.0:0/2075263796' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:33.114925 I | ceph-mgr: 2017-07-11 14:21:33.114747 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:34.003167 I | ceph-mgr: 2017-07-11 14:21:34.003023 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5649 10.233.124.0:0/1081564930' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:34.003365 I | ceph-mgr: 2017-07-11 14:21:34.003288 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:34.228004 I | ceph-mgr: 2017-07-11 14:21:34.220500 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:34.228108 I | ceph-mgr: 2017-07-11 14:21:34.220506 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:34.228252 I | ceph-mgr: 2017-07-11 14:21:34.220525 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:36.298748 I | ceph-mgr: 2017-07-11 14:21:36.279618 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:36.298762 I | ceph-mgr: 2017-07-11 14:21:36.279624 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:36.298765 I | ceph-mgr: 2017-07-11 14:21:36.279645 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:37.413327 I | ceph-mgr: 2017-07-11 14:21:37.413245 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5600 10.233.124.5:0/158120756' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:37.413430 I | ceph-mgr: 2017-07-11 14:21:37.413402 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:38.316724 I | ceph-mgr: 2017-07-11 14:21:38.300674 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:38.316956 I | ceph-mgr: 2017-07-11 14:21:38.300680 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:38.317016 I | ceph-mgr: 2017-07-11 14:21:38.300703 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:38.338837 I | ceph-mgr: 2017-07-11 14:21:38.338761 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5603 10.233.124.5:0/1686594458' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:38.338895 I | ceph-mgr: 2017-07-11 14:21:38.338806 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:40.325703 I | ceph-mgr: 2017-07-11 14:21:40.325656 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:40.325796 I | ceph-mgr: 2017-07-11 14:21:40.325781 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:40.326059 I | ceph-mgr: 2017-07-11 14:21:40.326043 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:41.142909 I | ceph-mgr: 2017-07-11 14:21:41.142834 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5609 10.233.124.5:0/2820355778' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:41.142979 I | ceph-mgr: 2017-07-11 14:21:41.142865 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:42.100135 I | ceph-mgr: 2017-07-11 14:21:42.100056 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5679 10.233.124.0:0/2167167647' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:42.100301 I | ceph-mgr: 2017-07-11 14:21:42.100221 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:42.343847 I | ceph-mgr: 2017-07-11 14:21:42.343812 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:42.343907 I | ceph-mgr: 2017-07-11 14:21:42.343893 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:42.344136 I | ceph-mgr: 2017-07-11 14:21:42.344005 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:44.357915 I | ceph-mgr: 2017-07-11 14:21:44.356576 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:44.358142 I | ceph-mgr: 2017-07-11 14:21:44.356581 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:44.358169 I | ceph-mgr: 2017-07-11 14:21:44.356603 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:44.845260 I | ceph-mgr: 2017-07-11 14:21:44.845233 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5691 10.233.124.0:0/2525036257' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:44.845355 I | ceph-mgr: 2017-07-11 14:21:44.845341 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:45.896256 I | ceph-mgr: 2017-07-11 14:21:45.896229 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5694 10.233.124.0:0/3372105089' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:45.911996 I | ceph-mgr: 2017-07-11 14:21:45.911940 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:46.369010 I | ceph-mgr: 2017-07-11 14:21:46.358957 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:46.369219 I | ceph-mgr: 2017-07-11 14:21:46.358962 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:46.369319 I | ceph-mgr: 2017-07-11 14:21:46.358985 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:48.372827 I | ceph-mgr: 2017-07-11 14:21:48.371477 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:48.380094 I | ceph-mgr: 2017-07-11 14:21:48.371482 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:48.380127 I | ceph-mgr: 2017-07-11 14:21:48.371503 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:48.743646 I | ceph-mgr: 2017-07-11 14:21:48.743628 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5712 10.233.124.0:0/91885172' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:48.743722 I | ceph-mgr: 2017-07-11 14:21:48.743709 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:49.857523 I | ceph-mgr: 2017-07-11 14:21:49.857495 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4951 10.233.124.5:0/277741719' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:49.857782 I | ceph-mgr: 2017-07-11 14:21:49.857752 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:50.375507 I | ceph-mgr: 2017-07-11 14:21:50.375478 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:50.375574 I | ceph-mgr: 2017-07-11 14:21:50.375559 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:50.375819 I | ceph-mgr: 2017-07-11 14:21:50.375803 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:52.386688 I | ceph-mgr: 2017-07-11 14:21:52.386655 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:52.386865 I | ceph-mgr: 2017-07-11 14:21:52.386849 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:52.387827 I | ceph-mgr: 2017-07-11 14:21:52.387807 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:52.652579 I | ceph-mgr: 2017-07-11 14:21:52.652556 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5633 10.233.124.5:0/2596932350' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:52.654696 I | ceph-mgr: 2017-07-11 14:21:52.654681 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:53.778760 I | ceph-mgr: 2017-07-11 14:21:53.778726 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5639 10.233.124.5:0/3984908993' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:53.786301 I | ceph-mgr: 2017-07-11 14:21:53.786277 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:54.398694 I | ceph-mgr: 2017-07-11 14:21:54.398662 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:54.398779 I | ceph-mgr: 2017-07-11 14:21:54.398754 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:54.398994 I | ceph-mgr: 2017-07-11 14:21:54.398978 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:56.419118 I | ceph-mgr: 2017-07-11 14:21:56.419085 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:56.419189 I | ceph-mgr: 2017-07-11 14:21:56.419176 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:56.419411 I | ceph-mgr: 2017-07-11 14:21:56.419292 7f4cc3226700 0 mgr tick
- 2017-07-11 14:21:56.739303 I | ceph-mgr: 2017-07-11 14:21:56.739242 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5648 10.233.124.5:0/1983617453' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:56.739375 I | ceph-mgr: 2017-07-11 14:21:56.739261 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:57.960807 I | ceph-mgr: 2017-07-11 14:21:57.960710 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5742 10.233.124.0:0/2062631524' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:21:57.960988 I | ceph-mgr: 2017-07-11 14:21:57.960889 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:21:58.423193 I | ceph-mgr: 2017-07-11 14:21:58.423165 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:21:58.438763 I | ceph-mgr: 2017-07-11 14:21:58.438720 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:21:58.439127 I | ceph-mgr: 2017-07-11 14:21:58.439092 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:00.443163 I | ceph-mgr: 2017-07-11 14:22:00.443132 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:00.443230 I | ceph-mgr: 2017-07-11 14:22:00.443216 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:00.443384 I | ceph-mgr: 2017-07-11 14:22:00.443330 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:01.035264 I | ceph-mgr: 2017-07-11 14:22:01.035212 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5663 10.233.124.5:0/3948203061' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:01.035375 I | ceph-mgr: 2017-07-11 14:22:01.035348 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:02.163070 I | ceph-mgr: 2017-07-11 14:22:02.162989 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5751 10.233.124.0:0/3199452033' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:02.163306 I | ceph-mgr: 2017-07-11 14:22:02.163276 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:02.498885 I | ceph-mgr: 2017-07-11 14:22:02.498860 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:02.498942 I | ceph-mgr: 2017-07-11 14:22:02.498929 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:02.499143 I | ceph-mgr: 2017-07-11 14:22:02.499044 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:04.502891 I | ceph-mgr: 2017-07-11 14:22:04.502858 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:04.502959 I | ceph-mgr: 2017-07-11 14:22:04.502945 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:04.503184 I | ceph-mgr: 2017-07-11 14:22:04.503169 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:05.183358 I | ceph-mgr: 2017-07-11 14:22:05.183289 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5678 10.233.124.5:0/3814308975' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:05.225643 I | ceph-mgr: 2017-07-11 14:22:05.225604 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:06.356120 I | ceph-mgr: 2017-07-11 14:22:06.356019 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5684 10.233.124.5:0/569867211' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:06.356190 I | ceph-mgr: 2017-07-11 14:22:06.356067 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:06.513695 I | ceph-mgr: 2017-07-11 14:22:06.512407 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:06.514577 I | ceph-mgr: 2017-07-11 14:22:06.512413 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:06.514615 I | ceph-mgr: 2017-07-11 14:22:06.512432 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:08.516825 I | ceph-mgr: 2017-07-11 14:22:08.516752 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:08.520460 I | ceph-mgr: 2017-07-11 14:22:08.520439 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:08.520548 I | ceph-mgr: 2017-07-11 14:22:08.520537 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:09.112733 I | ceph-mgr: 2017-07-11 14:22:09.112674 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5699 10.233.124.5:0/2279158592' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:09.115839 I | ceph-mgr: 2017-07-11 14:22:09.112693 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:10.059893 I | ceph-mgr: 2017-07-11 14:22:10.059815 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5775 10.233.124.0:0/842010074' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:10.060070 I | ceph-mgr: 2017-07-11 14:22:10.059981 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:10.541825 I | ceph-mgr: 2017-07-11 14:22:10.540406 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:10.542034 I | ceph-mgr: 2017-07-11 14:22:10.540413 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:10.547763 I | ceph-mgr: 2017-07-11 14:22:10.540438 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:12.546375 I | ceph-mgr: 2017-07-11 14:22:12.542561 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:12.552077 I | ceph-mgr: 2017-07-11 14:22:12.542566 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:12.552097 I | ceph-mgr: 2017-07-11 14:22:12.542592 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:13.211224 I | ceph-mgr: 2017-07-11 14:22:13.211178 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5711 10.233.124.5:0/2380794421' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:13.213514 I | ceph-mgr: 2017-07-11 14:22:13.213477 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:14.123089 I | ceph-mgr: 2017-07-11 14:22:14.122997 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5717 10.233.124.5:0/1061754350' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:14.123273 I | ceph-mgr: 2017-07-11 14:22:14.123175 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:14.551105 I | ceph-mgr: 2017-07-11 14:22:14.549732 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:14.551258 I | ceph-mgr: 2017-07-11 14:22:14.549738 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:14.551303 I | ceph-mgr: 2017-07-11 14:22:14.549772 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:16.570913 I | ceph-mgr: 2017-07-11 14:22:16.560197 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:16.571264 I | ceph-mgr: 2017-07-11 14:22:16.560210 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:16.571296 I | ceph-mgr: 2017-07-11 14:22:16.560251 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:17.172341 I | ceph-mgr: 2017-07-11 14:22:17.172293 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5726 10.233.124.5:0/4233898308' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:17.174559 I | ceph-mgr: 2017-07-11 14:22:17.174530 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:18.082891 I | ceph-mgr: 2017-07-11 14:22:18.082813 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5808 10.233.124.0:0/3225000217' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:18.085876 I | ceph-mgr: 2017-07-11 14:22:18.085849 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:18.568404 I | ceph-mgr: 2017-07-11 14:22:18.567985 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:18.568473 I | ceph-mgr: 2017-07-11 14:22:18.567995 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:18.568535 I | ceph-mgr: 2017-07-11 14:22:18.568036 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:20.571881 I | ceph-mgr: 2017-07-11 14:22:20.570520 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:20.578766 I | ceph-mgr: 2017-07-11 14:22:20.570526 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:20.578800 I | ceph-mgr: 2017-07-11 14:22:20.570545 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:20.824085 I | ceph-mgr: 2017-07-11 14:22:20.824047 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5823 10.233.124.0:0/564570214' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:20.825298 I | ceph-mgr: 2017-07-11 14:22:20.825267 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:21.995131 I | ceph-mgr: 2017-07-11 14:22:21.995034 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5826 10.233.124.0:0/2129416824' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:21.995298 I | ceph-mgr: 2017-07-11 14:22:21.995201 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:22.588941 I | ceph-mgr: 2017-07-11 14:22:22.573016 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:22.589138 I | ceph-mgr: 2017-07-11 14:22:22.573020 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:22.589171 I | ceph-mgr: 2017-07-11 14:22:22.573038 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:24.592247 I | ceph-mgr: 2017-07-11 14:22:24.592215 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:24.592338 I | ceph-mgr: 2017-07-11 14:22:24.592322 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:24.592830 I | ceph-mgr: 2017-07-11 14:22:24.592816 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:24.785223 I | ceph-mgr: 2017-07-11 14:22:24.785158 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5747 10.233.124.5:0/2623978847' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:24.785286 I | ceph-mgr: 2017-07-11 14:22:24.785180 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:25.856368 I | ceph-mgr: 2017-07-11 14:22:25.856251 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5753 10.233.124.0:0/4064408363' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:25.856456 I | ceph-mgr: 2017-07-11 14:22:25.856323 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:26.607123 I | ceph-mgr: 2017-07-11 14:22:26.607082 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:26.607201 I | ceph-mgr: 2017-07-11 14:22:26.607187 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:26.607443 I | ceph-mgr: 2017-07-11 14:22:26.607426 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:28.625414 I | ceph-mgr: 2017-07-11 14:22:28.625349 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:28.627102 I | ceph-mgr: 2017-07-11 14:22:28.627086 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:28.627495 I | ceph-mgr: 2017-07-11 14:22:28.627479 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:28.922360 I | ceph-mgr: 2017-07-11 14:22:28.922293 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5850 10.233.124.5:0/731564984' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:28.922420 I | ceph-mgr: 2017-07-11 14:22:28.922313 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:29.872588 I | ceph-mgr: 2017-07-11 14:22:29.872497 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5768 10.233.124.5:0/3129583857' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:29.872670 I | ceph-mgr: 2017-07-11 14:22:29.872543 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:30.629160 I | ceph-mgr: 2017-07-11 14:22:30.629133 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:30.629381 I | ceph-mgr: 2017-07-11 14:22:30.629366 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:30.629658 I | ceph-mgr: 2017-07-11 14:22:30.629642 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:32.644618 I | ceph-mgr: 2017-07-11 14:22:32.640985 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:32.644760 I | ceph-mgr: 2017-07-11 14:22:32.640990 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:32.644806 I | ceph-mgr: 2017-07-11 14:22:32.641018 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:32.729414 I | ceph-mgr: 2017-07-11 14:22:32.729357 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5786 10.233.124.5:0/2832691288' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:32.729457 I | ceph-mgr: 2017-07-11 14:22:32.729380 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:33.620905 I | ceph-mgr: 2017-07-11 14:22:33.620806 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5792 10.233.124.5:0/1445665542' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:33.620967 I | ceph-mgr: 2017-07-11 14:22:33.620865 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:34.649847 I | ceph-mgr: 2017-07-11 14:22:34.649814 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:34.649920 I | ceph-mgr: 2017-07-11 14:22:34.649906 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:34.650155 I | ceph-mgr: 2017-07-11 14:22:34.650025 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:36.623693 I | ceph-mgr: 2017-07-11 14:22:36.623644 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5807 10.233.124.5:0/3115881295' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:36.623899 I | ceph-mgr: 2017-07-11 14:22:36.623856 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:36.655610 I | ceph-mgr: 2017-07-11 14:22:36.652895 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:36.662921 I | ceph-mgr: 2017-07-11 14:22:36.652911 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:36.662966 I | ceph-mgr: 2017-07-11 14:22:36.652932 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:37.533231 I | ceph-mgr: 2017-07-11 14:22:37.533158 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5871 10.233.124.5:0/1526704407' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:37.533982 I | ceph-mgr: 2017-07-11 14:22:37.533954 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:38.656982 I | ceph-mgr: 2017-07-11 14:22:38.655544 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:38.665084 I | ceph-mgr: 2017-07-11 14:22:38.655549 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:38.665119 I | ceph-mgr: 2017-07-11 14:22:38.655574 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:40.341987 I | ceph-mgr: 2017-07-11 14:22:40.341917 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5825 10.233.124.5:0/4233152994' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:40.342068 I | ceph-mgr: 2017-07-11 14:22:40.341940 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:40.675937 I | ceph-mgr: 2017-07-11 14:22:40.659543 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:40.676011 I | ceph-mgr: 2017-07-11 14:22:40.659549 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:40.676026 I | ceph-mgr: 2017-07-11 14:22:40.659572 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:41.336160 I | ceph-mgr: 2017-07-11 14:22:41.336069 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5831 10.233.124.5:0/1069974289' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:41.336219 I | ceph-mgr: 2017-07-11 14:22:41.336117 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:42.677717 I | ceph-mgr: 2017-07-11 14:22:42.677660 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:42.677917 I | ceph-mgr: 2017-07-11 14:22:42.677811 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:42.678183 I | ceph-mgr: 2017-07-11 14:22:42.678021 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:44.390544 I | ceph-mgr: 2017-07-11 14:22:44.390483 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5843 10.233.124.5:0/2882327234' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:44.390604 I | ceph-mgr: 2017-07-11 14:22:44.390577 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:44.699639 I | ceph-mgr: 2017-07-11 14:22:44.699588 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:44.699812 I | ceph-mgr: 2017-07-11 14:22:44.699795 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:44.701683 I | ceph-mgr: 2017-07-11 14:22:44.701663 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:45.278751 I | ceph-mgr: 2017-07-11 14:22:45.278634 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5849 10.233.124.5:0/5063866' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:45.278810 I | ceph-mgr: 2017-07-11 14:22:45.278702 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:46.708372 I | ceph-mgr: 2017-07-11 14:22:46.708340 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:46.708447 I | ceph-mgr: 2017-07-11 14:22:46.708434 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:46.708651 I | ceph-mgr: 2017-07-11 14:22:46.708542 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:48.201063 I | ceph-mgr: 2017-07-11 14:22:48.201005 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5861 10.233.124.5:0/1827841757' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:48.201383 I | ceph-mgr: 2017-07-11 14:22:48.201026 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:48.717040 I | ceph-mgr: 2017-07-11 14:22:48.716982 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:48.717269 I | ceph-mgr: 2017-07-11 14:22:48.717136 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:48.717469 I | ceph-mgr: 2017-07-11 14:22:48.717453 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:49.068346 I | ceph-mgr: 2017-07-11 14:22:49.068259 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5867 10.233.124.5:0/227593386' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:49.068415 I | ceph-mgr: 2017-07-11 14:22:49.068306 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:50.722851 I | ceph-mgr: 2017-07-11 14:22:50.722823 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:50.722921 I | ceph-mgr: 2017-07-11 14:22:50.722907 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:50.723130 I | ceph-mgr: 2017-07-11 14:22:50.723018 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:52.099423 I | ceph-mgr: 2017-07-11 14:22:52.099376 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5882 10.233.124.5:0/3401250614' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:52.099778 I | ceph-mgr: 2017-07-11 14:22:52.099749 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:52.732963 I | ceph-mgr: 2017-07-11 14:22:52.732915 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:52.733053 I | ceph-mgr: 2017-07-11 14:22:52.733039 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:52.741268 I | ceph-mgr: 2017-07-11 14:22:52.741249 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:53.082589 I | ceph-mgr: 2017-07-11 14:22:53.082501 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5913 10.233.124.0:0/3572122374' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:53.084857 I | ceph-mgr: 2017-07-11 14:22:53.082550 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:54.774327 I | ceph-mgr: 2017-07-11 14:22:54.774239 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:54.774410 I | ceph-mgr: 2017-07-11 14:22:54.774395 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:54.774637 I | ceph-mgr: 2017-07-11 14:22:54.774620 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:56.246157 I | ceph-mgr: 2017-07-11 14:22:56.236239 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5888 10.233.124.5:0/958378099' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:56.246222 I | ceph-mgr: 2017-07-11 14:22:56.236276 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:56.779859 I | ceph-mgr: 2017-07-11 14:22:56.779831 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:56.779894 I | ceph-mgr: 2017-07-11 14:22:56.779882 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:56.780010 I | ceph-mgr: 2017-07-11 14:22:56.779995 7f4cc3226700 0 mgr tick
- 2017-07-11 14:22:57.216742 I | ceph-mgr: 2017-07-11 14:22:57.216589 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5894 10.233.124.5:0/1239142818' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:22:57.216811 I | ceph-mgr: 2017-07-11 14:22:57.216696 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:22:58.784619 I | ceph-mgr: 2017-07-11 14:22:58.784581 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:22:58.784705 I | ceph-mgr: 2017-07-11 14:22:58.784692 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:22:58.790480 I | ceph-mgr: 2017-07-11 14:22:58.790460 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:00.156698 I | ceph-mgr: 2017-07-11 14:23:00.156641 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.4999 10.233.124.0:0/3320202822' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:00.156791 I | ceph-mgr: 2017-07-11 14:23:00.156766 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:00.796606 I | ceph-mgr: 2017-07-11 14:23:00.795629 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:00.796665 I | ceph-mgr: 2017-07-11 14:23:00.795634 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:00.796680 I | ceph-mgr: 2017-07-11 14:23:00.795655 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:01.070682 I | ceph-mgr: 2017-07-11 14:23:01.070554 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5909 10.233.124.5:0/282055251' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:01.070857 I | ceph-mgr: 2017-07-11 14:23:01.070767 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:02.800455 I | ceph-mgr: 2017-07-11 14:23:02.800172 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:02.800549 I | ceph-mgr: 2017-07-11 14:23:02.800179 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:02.800656 I | ceph-mgr: 2017-07-11 14:23:02.800200 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:04.347864 I | ceph-mgr: 2017-07-11 14:23:04.347793 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5918 10.233.124.5:0/987453530' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:04.347919 I | ceph-mgr: 2017-07-11 14:23:04.347813 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:04.839768 I | ceph-mgr: 2017-07-11 14:23:04.817363 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:04.839849 I | ceph-mgr: 2017-07-11 14:23:04.817366 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:04.839865 I | ceph-mgr: 2017-07-11 14:23:04.817383 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:05.249707 I | ceph-mgr: 2017-07-11 14:23:05.249618 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5924 10.233.124.5:0/2389124966' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:05.249802 I | ceph-mgr: 2017-07-11 14:23:05.249775 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:06.821348 I | ceph-mgr: 2017-07-11 14:23:06.820529 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:06.821409 I | ceph-mgr: 2017-07-11 14:23:06.820536 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:06.821426 I | ceph-mgr: 2017-07-11 14:23:06.820558 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:08.360588 I | ceph-mgr: 2017-07-11 14:23:08.360538 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5958 10.233.124.0:0/3619390600' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:08.360680 I | ceph-mgr: 2017-07-11 14:23:08.360655 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:08.831146 I | ceph-mgr: 2017-07-11 14:23:08.823767 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:08.831237 I | ceph-mgr: 2017-07-11 14:23:08.823771 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:08.831253 I | ceph-mgr: 2017-07-11 14:23:08.823792 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:09.449938 I | ceph-mgr: 2017-07-11 14:23:09.449854 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5933 10.233.124.5:0/2726238070' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:09.450877 I | ceph-mgr: 2017-07-11 14:23:09.450850 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:10.840092 I | ceph-mgr: 2017-07-11 14:23:10.836449 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:10.840179 I | ceph-mgr: 2017-07-11 14:23:10.836455 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:10.840202 I | ceph-mgr: 2017-07-11 14:23:10.836477 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:12.377180 I | ceph-mgr: 2017-07-11 14:23:12.377132 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5948 10.233.124.5:0/1376005904' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:12.377294 I | ceph-mgr: 2017-07-11 14:23:12.377267 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:12.848721 I | ceph-mgr: 2017-07-11 14:23:12.839238 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:12.848816 I | ceph-mgr: 2017-07-11 14:23:12.839245 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:12.848877 I | ceph-mgr: 2017-07-11 14:23:12.839270 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:13.285838 I | ceph-mgr: 2017-07-11 14:23:13.285712 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5973 10.233.124.0:0/3186957485' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:13.285929 I | ceph-mgr: 2017-07-11 14:23:13.285902 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:14.845174 I | ceph-mgr: 2017-07-11 14:23:14.844144 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:14.845240 I | ceph-mgr: 2017-07-11 14:23:14.844155 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:14.845257 I | ceph-mgr: 2017-07-11 14:23:14.844190 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:16.853955 I | ceph-mgr: 2017-07-11 14:23:16.852646 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:16.854011 I | ceph-mgr: 2017-07-11 14:23:16.852654 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:16.854026 I | ceph-mgr: 2017-07-11 14:23:16.852679 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:18.856195 I | ceph-mgr: 2017-07-11 14:23:18.856151 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:18.856280 I | ceph-mgr: 2017-07-11 14:23:18.856265 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:18.856427 I | ceph-mgr: 2017-07-11 14:23:18.856416 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:20.864667 I | ceph-mgr: 2017-07-11 14:23:20.864621 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:20.864758 I | ceph-mgr: 2017-07-11 14:23:20.864743 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:20.864985 I | ceph-mgr: 2017-07-11 14:23:20.864820 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:22.899829 I | ceph-mgr: 2017-07-11 14:23:22.888665 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:22.900166 I | ceph-mgr: 2017-07-11 14:23:22.888680 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:22.900198 I | ceph-mgr: 2017-07-11 14:23:22.888724 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:24.903592 I | ceph-mgr: 2017-07-11 14:23:24.903153 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:24.903835 I | ceph-mgr: 2017-07-11 14:23:24.903805 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:24.905325 I | ceph-mgr: 2017-07-11 14:23:24.905308 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:26.931636 I | ceph-mgr: 2017-07-11 14:23:26.927671 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:26.931698 I | ceph-mgr: 2017-07-11 14:23:26.927680 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:26.931716 I | ceph-mgr: 2017-07-11 14:23:26.927708 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:28.962689 I | ceph-mgr: 2017-07-11 14:23:28.953167 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:28.962805 I | ceph-mgr: 2017-07-11 14:23:28.953172 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:28.962983 I | ceph-mgr: 2017-07-11 14:23:28.953194 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:30.958235 I | ceph-mgr: 2017-07-11 14:23:30.958186 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:30.958307 I | ceph-mgr: 2017-07-11 14:23:30.958291 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:30.958710 I | ceph-mgr: 2017-07-11 14:23:30.958694 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:32.966135 I | ceph-mgr: 2017-07-11 14:23:32.966083 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:32.966209 I | ceph-mgr: 2017-07-11 14:23:32.966195 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:32.966442 I | ceph-mgr: 2017-07-11 14:23:32.966426 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:34.969867 I | ceph-mgr: 2017-07-11 14:23:34.969838 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:34.969944 I | ceph-mgr: 2017-07-11 14:23:34.969929 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:34.970170 I | ceph-mgr: 2017-07-11 14:23:34.970155 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:36.977530 I | ceph-mgr: 2017-07-11 14:23:36.977478 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:36.977613 I | ceph-mgr: 2017-07-11 14:23:36.977596 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:36.978100 I | ceph-mgr: 2017-07-11 14:23:36.978083 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:38.982185 I | ceph-mgr: 2017-07-11 14:23:38.982148 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:38.982260 I | ceph-mgr: 2017-07-11 14:23:38.982246 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:38.982480 I | ceph-mgr: 2017-07-11 14:23:38.982364 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:40.989768 I | ceph-mgr: 2017-07-11 14:23:40.989638 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:40.989845 I | ceph-mgr: 2017-07-11 14:23:40.989830 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:40.990088 I | ceph-mgr: 2017-07-11 14:23:40.990073 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:42.993867 I | ceph-mgr: 2017-07-11 14:23:42.993816 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:42.993949 I | ceph-mgr: 2017-07-11 14:23:42.993934 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:42.994600 I | ceph-mgr: 2017-07-11 14:23:42.994582 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:45.008587 I | ceph-mgr: 2017-07-11 14:23:45.008553 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:45.008664 I | ceph-mgr: 2017-07-11 14:23:45.008650 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:45.008848 I | ceph-mgr: 2017-07-11 14:23:45.008833 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:46.824062 I | ceph-mgr: 2017-07-11 14:23:46.824007 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5963 10.233.124.5:0/2654232756' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:46.831241 I | ceph-mgr: 2017-07-11 14:23:46.824026 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:47.017796 I | ceph-mgr: 2017-07-11 14:23:47.017769 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:47.017878 I | ceph-mgr: 2017-07-11 14:23:47.017860 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:47.018023 I | ceph-mgr: 2017-07-11 14:23:47.018009 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:47.741829 I | ceph-mgr: 2017-07-11 14:23:47.741741 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5991 10.233.124.0:0/549695831' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:47.741892 I | ceph-mgr: 2017-07-11 14:23:47.741790 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:49.026689 I | ceph-mgr: 2017-07-11 14:23:49.025378 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:49.026740 I | ceph-mgr: 2017-07-11 14:23:49.025383 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:49.026756 I | ceph-mgr: 2017-07-11 14:23:49.025414 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:50.459386 I | ceph-mgr: 2017-07-11 14:23:50.459340 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6006 10.233.124.0:0/2135823838' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:50.459476 I | ceph-mgr: 2017-07-11 14:23:50.459450 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:51.027266 I | ceph-mgr: 2017-07-11 14:23:51.026701 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:51.027312 I | ceph-mgr: 2017-07-11 14:23:51.026706 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:51.027327 I | ceph-mgr: 2017-07-11 14:23:51.026726 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:51.412852 I | ceph-mgr: 2017-07-11 14:23:51.412775 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5981 10.233.124.5:0/1530361051' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:51.413200 I | ceph-mgr: 2017-07-11 14:23:51.413170 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:53.031507 I | ceph-mgr: 2017-07-11 14:23:53.030236 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:53.031557 I | ceph-mgr: 2017-07-11 14:23:53.030241 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:53.031573 I | ceph-mgr: 2017-07-11 14:23:53.030261 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:54.369978 I | ceph-mgr: 2017-07-11 14:23:54.369927 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5990 10.233.124.5:0/2331036090' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:54.370062 I | ceph-mgr: 2017-07-11 14:23:54.370037 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:55.037887 I | ceph-mgr: 2017-07-11 14:23:55.036551 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:55.037959 I | ceph-mgr: 2017-07-11 14:23:55.036556 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:55.037975 I | ceph-mgr: 2017-07-11 14:23:55.036577 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:55.309213 I | ceph-mgr: 2017-07-11 14:23:55.309137 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5993 10.233.124.5:0/3840864683' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:55.310286 I | ceph-mgr: 2017-07-11 14:23:55.310256 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:57.055819 I | ceph-mgr: 2017-07-11 14:23:57.039747 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:57.055898 I | ceph-mgr: 2017-07-11 14:23:57.039752 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:57.055914 I | ceph-mgr: 2017-07-11 14:23:57.039774 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:58.264889 I | ceph-mgr: 2017-07-11 14:23:58.255223 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6002 10.233.124.5:0/3541320578' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:58.264973 I | ceph-mgr: 2017-07-11 14:23:58.255242 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:23:59.058412 I | ceph-mgr: 2017-07-11 14:23:59.058377 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:23:59.058634 I | ceph-mgr: 2017-07-11 14:23:59.058618 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:23:59.059150 I | ceph-mgr: 2017-07-11 14:23:59.059133 7f4cc3226700 0 mgr tick
- 2017-07-11 14:23:59.155663 I | ceph-mgr: 2017-07-11 14:23:59.155565 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6008 10.233.124.5:0/2618169981' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:23:59.155736 I | ceph-mgr: 2017-07-11 14:23:59.155614 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:01.060853 I | ceph-mgr: 2017-07-11 14:24:01.060814 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:01.060927 I | ceph-mgr: 2017-07-11 14:24:01.060913 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:01.068624 I | ceph-mgr: 2017-07-11 14:24:01.068604 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:02.285145 I | ceph-mgr: 2017-07-11 14:24:02.285081 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6020 10.233.124.5:0/2593970103' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:02.290839 I | ceph-mgr: 2017-07-11 14:24:02.285101 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:03.080995 I | ceph-mgr: 2017-07-11 14:24:03.079689 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:03.087822 I | ceph-mgr: 2017-07-11 14:24:03.079694 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:03.087879 I | ceph-mgr: 2017-07-11 14:24:03.079715 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:03.186129 I | ceph-mgr: 2017-07-11 14:24:03.185997 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6023 10.233.124.5:0/2108128839' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:03.186174 I | ceph-mgr: 2017-07-11 14:24:03.186078 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:05.085742 I | ceph-mgr: 2017-07-11 14:24:05.084907 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:05.085805 I | ceph-mgr: 2017-07-11 14:24:05.084912 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:05.085822 I | ceph-mgr: 2017-07-11 14:24:05.084933 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:06.091920 I | ceph-mgr: 2017-07-11 14:24:06.091870 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6035 10.233.124.5:0/403016126' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:06.092021 I | ceph-mgr: 2017-07-11 14:24:06.091995 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:07.098031 I | ceph-mgr: 2017-07-11 14:24:07.088553 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:07.098128 I | ceph-mgr: 2017-07-11 14:24:07.088560 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:07.098226 I | ceph-mgr: 2017-07-11 14:24:07.088585 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:07.299656 I | ceph-mgr: 2017-07-11 14:24:07.299570 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6038 10.233.124.5:0/2410124963' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:07.299709 I | ceph-mgr: 2017-07-11 14:24:07.299618 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:09.092524 I | ceph-mgr: 2017-07-11 14:24:09.092463 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:09.092601 I | ceph-mgr: 2017-07-11 14:24:09.092588 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:09.092843 I | ceph-mgr: 2017-07-11 14:24:09.092667 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:10.153955 I | ceph-mgr: 2017-07-11 14:24:10.153908 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6066 10.233.124.0:0/2742791192' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:10.154120 I | ceph-mgr: 2017-07-11 14:24:10.154035 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:11.050457 I | ceph-mgr: 2017-07-11 14:24:11.048383 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6050 10.233.124.5:0/1159985002' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:11.050548 I | ceph-mgr: 2017-07-11 14:24:11.050519 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:11.096775 I | ceph-mgr: 2017-07-11 14:24:11.096728 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:11.100511 I | ceph-mgr: 2017-07-11 14:24:11.100494 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:11.100729 I | ceph-mgr: 2017-07-11 14:24:11.100713 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:13.142691 I | ceph-mgr: 2017-07-11 14:24:13.122102 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:13.143256 I | ceph-mgr: 2017-07-11 14:24:13.122112 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:13.143290 I | ceph-mgr: 2017-07-11 14:24:13.122142 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:14.185554 I | ceph-mgr: 2017-07-11 14:24:14.185463 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6059 10.233.124.5:0/646181521' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:14.185652 I | ceph-mgr: 2017-07-11 14:24:14.185625 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:15.125183 I | ceph-mgr: 2017-07-11 14:24:15.125150 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:15.125255 I | ceph-mgr: 2017-07-11 14:24:15.125241 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:15.125560 I | ceph-mgr: 2017-07-11 14:24:15.125538 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:15.201521 I | ceph-mgr: 2017-07-11 14:24:15.201420 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6065 10.233.124.5:0/239472242' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:15.201572 I | ceph-mgr: 2017-07-11 14:24:15.201486 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:17.145762 I | ceph-mgr: 2017-07-11 14:24:17.144420 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:17.154850 I | ceph-mgr: 2017-07-11 14:24:17.144424 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:17.154860 I | ceph-mgr: 2017-07-11 14:24:17.144444 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:18.543365 I | ceph-mgr: 2017-07-11 14:24:18.543314 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6096 10.233.124.0:0/2779801785' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:18.543474 I | ceph-mgr: 2017-07-11 14:24:18.543448 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:19.147841 I | ceph-mgr: 2017-07-11 14:24:19.147154 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:19.148079 I | ceph-mgr: 2017-07-11 14:24:19.147159 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:19.148138 I | ceph-mgr: 2017-07-11 14:24:19.147924 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:19.593700 I | ceph-mgr: 2017-07-11 14:24:19.593624 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6083 10.233.124.5:0/4152454140' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:19.594590 I | ceph-mgr: 2017-07-11 14:24:19.594557 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:21.167698 I | ceph-mgr: 2017-07-11 14:24:21.157745 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:21.167907 I | ceph-mgr: 2017-07-11 14:24:21.157758 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:21.167934 I | ceph-mgr: 2017-07-11 14:24:21.157790 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:22.583900 I | ceph-mgr: 2017-07-11 14:24:22.583610 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6108 10.233.124.0:0/3658102749' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:22.583947 I | ceph-mgr: 2017-07-11 14:24:22.583629 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:23.174379 I | ceph-mgr: 2017-07-11 14:24:23.174201 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:23.174587 I | ceph-mgr: 2017-07-11 14:24:23.174206 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:23.174610 I | ceph-mgr: 2017-07-11 14:24:23.174228 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:23.535456 I | ceph-mgr: 2017-07-11 14:24:23.535391 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6098 10.233.124.5:0/1101883591' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:23.537564 I | ceph-mgr: 2017-07-11 14:24:23.537535 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:25.185481 I | ceph-mgr: 2017-07-11 14:24:25.184202 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:25.193220 I | ceph-mgr: 2017-07-11 14:24:25.184209 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:25.193319 I | ceph-mgr: 2017-07-11 14:24:25.184232 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:26.706996 I | ceph-mgr: 2017-07-11 14:24:26.706946 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6123 10.233.124.0:0/2554976988' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:26.707088 I | ceph-mgr: 2017-07-11 14:24:26.707062 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:27.199676 I | ceph-mgr: 2017-07-11 14:24:27.190029 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:27.199735 I | ceph-mgr: 2017-07-11 14:24:27.190034 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:27.199749 I | ceph-mgr: 2017-07-11 14:24:27.190056 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:27.667165 I | ceph-mgr: 2017-07-11 14:24:27.667061 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6113 10.233.124.5:0/1253921268' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:27.667289 I | ceph-mgr: 2017-07-11 14:24:27.667242 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:29.204588 I | ceph-mgr: 2017-07-11 14:24:29.203249 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:29.204653 I | ceph-mgr: 2017-07-11 14:24:29.203263 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:29.204675 I | ceph-mgr: 2017-07-11 14:24:29.203293 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:30.474456 I | ceph-mgr: 2017-07-11 14:24:30.474392 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6122 10.233.124.5:0/3036917640' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:30.474514 I | ceph-mgr: 2017-07-11 14:24:30.474412 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:31.209395 I | ceph-mgr: 2017-07-11 14:24:31.208093 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:31.209464 I | ceph-mgr: 2017-07-11 14:24:31.208098 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:31.209479 I | ceph-mgr: 2017-07-11 14:24:31.208124 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:31.443439 I | ceph-mgr: 2017-07-11 14:24:31.443362 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6128 10.233.124.5:0/1076847262' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:31.443478 I | ceph-mgr: 2017-07-11 14:24:31.443408 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:33.215352 I | ceph-mgr: 2017-07-11 14:24:33.215315 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:33.215427 I | ceph-mgr: 2017-07-11 14:24:33.215412 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:33.215504 I | ceph-mgr: 2017-07-11 14:24:33.215494 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:34.373907 I | ceph-mgr: 2017-07-11 14:24:34.373839 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6153 10.233.124.0:0/2639802026' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:34.373970 I | ceph-mgr: 2017-07-11 14:24:34.373859 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:35.235352 I | ceph-mgr: 2017-07-11 14:24:35.235321 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:35.235435 I | ceph-mgr: 2017-07-11 14:24:35.235421 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:35.235652 I | ceph-mgr: 2017-07-11 14:24:35.235636 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:35.267762 I | ceph-mgr: 2017-07-11 14:24:35.267674 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6159 10.233.124.0:0/1834063720' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:35.267802 I | ceph-mgr: 2017-07-11 14:24:35.267719 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:37.243241 I | ceph-mgr: 2017-07-11 14:24:37.242477 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:37.243315 I | ceph-mgr: 2017-07-11 14:24:37.242483 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:37.243332 I | ceph-mgr: 2017-07-11 14:24:37.242505 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:38.283412 I | ceph-mgr: 2017-07-11 14:24:38.283342 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6165 10.233.124.0:0/1484579534' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:38.283564 I | ceph-mgr: 2017-07-11 14:24:38.283490 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:39.150386 I | ceph-mgr: 2017-07-11 14:24:39.150307 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6161 10.233.124.5:0/3547105582' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:39.150486 I | ceph-mgr: 2017-07-11 14:24:39.150458 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:39.247662 I | ceph-mgr: 2017-07-11 14:24:39.247621 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:39.247773 I | ceph-mgr: 2017-07-11 14:24:39.247756 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:39.248004 I | ceph-mgr: 2017-07-11 14:24:39.247987 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:41.267184 I | ceph-mgr: 2017-07-11 14:24:41.267152 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:41.267274 I | ceph-mgr: 2017-07-11 14:24:41.267260 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:41.267485 I | ceph-mgr: 2017-07-11 14:24:41.267469 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:42.040489 I | ceph-mgr: 2017-07-11 14:24:42.040428 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6176 10.233.124.5:0/2798296290' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:42.040569 I | ceph-mgr: 2017-07-11 14:24:42.040447 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:42.925666 I | ceph-mgr: 2017-07-11 14:24:42.925566 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6177 10.233.124.5:0/3383999116' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:42.925735 I | ceph-mgr: 2017-07-11 14:24:42.925615 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:43.279575 I | ceph-mgr: 2017-07-11 14:24:43.279548 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:43.279637 I | ceph-mgr: 2017-07-11 14:24:43.279624 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:43.279840 I | ceph-mgr: 2017-07-11 14:24:43.279733 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:45.300272 I | ceph-mgr: 2017-07-11 14:24:45.298953 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:45.300331 I | ceph-mgr: 2017-07-11 14:24:45.298958 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:45.300346 I | ceph-mgr: 2017-07-11 14:24:45.298981 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:45.906015 I | ceph-mgr: 2017-07-11 14:24:45.905940 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6191 10.233.124.5:0/1393020119' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:45.906219 I | ceph-mgr: 2017-07-11 14:24:45.906124 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:46.916491 I | ceph-mgr: 2017-07-11 14:24:46.916418 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6197 10.233.124.5:0/1539235747' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:46.919589 I | ceph-mgr: 2017-07-11 14:24:46.919487 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:47.316753 I | ceph-mgr: 2017-07-11 14:24:47.306315 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:47.316811 I | ceph-mgr: 2017-07-11 14:24:47.306327 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:47.316827 I | ceph-mgr: 2017-07-11 14:24:47.306368 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:49.327653 I | ceph-mgr: 2017-07-11 14:24:49.308026 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:49.327703 I | ceph-mgr: 2017-07-11 14:24:49.308032 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:49.327727 I | ceph-mgr: 2017-07-11 14:24:49.308054 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:49.550721 I | ceph-mgr: 2017-07-11 14:24:49.548475 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6215 10.233.124.5:0/2116450529' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:49.550909 I | ceph-mgr: 2017-07-11 14:24:49.550864 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:50.467522 I | ceph-mgr: 2017-07-11 14:24:50.467432 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6195 10.233.124.5:0/3836600429' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:50.467584 I | ceph-mgr: 2017-07-11 14:24:50.467477 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:51.332176 I | ceph-mgr: 2017-07-11 14:24:51.331966 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:51.332265 I | ceph-mgr: 2017-07-11 14:24:51.332250 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:51.332490 I | ceph-mgr: 2017-07-11 14:24:51.332474 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:53.351923 I | ceph-mgr: 2017-07-11 14:24:53.351892 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:53.352009 I | ceph-mgr: 2017-07-11 14:24:53.351995 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:53.352240 I | ceph-mgr: 2017-07-11 14:24:53.352071 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:53.353913 I | ceph-mgr: 2017-07-11 14:24:53.353897 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6233 10.233.124.5:0/648456093' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:53.354207 I | ceph-mgr: 2017-07-11 14:24:53.354191 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:54.583755 I | ceph-mgr: 2017-07-11 14:24:54.583723 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6239 10.233.124.5:0/1462346088' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:54.584012 I | ceph-mgr: 2017-07-11 14:24:54.583994 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:55.376820 I | ceph-mgr: 2017-07-11 14:24:55.354591 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:55.376838 I | ceph-mgr: 2017-07-11 14:24:55.354609 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:55.376841 I | ceph-mgr: 2017-07-11 14:24:55.354657 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:57.357311 I | ceph-mgr: 2017-07-11 14:24:57.357276 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:57.357400 I | ceph-mgr: 2017-07-11 14:24:57.357386 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:57.357615 I | ceph-mgr: 2017-07-11 14:24:57.357464 7f4cc3226700 0 mgr tick
- 2017-07-11 14:24:57.525411 I | ceph-mgr: 2017-07-11 14:24:57.525381 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6254 10.233.124.5:0/1797217286' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:57.525531 I | ceph-mgr: 2017-07-11 14:24:57.525516 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:58.398509 I | ceph-mgr: 2017-07-11 14:24:58.398481 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6260 10.233.124.5:0/255179775' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:24:58.398748 I | ceph-mgr: 2017-07-11 14:24:58.398732 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:24:59.365308 I | ceph-mgr: 2017-07-11 14:24:59.365275 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:24:59.365459 I | ceph-mgr: 2017-07-11 14:24:59.365400 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:24:59.365688 I | ceph-mgr: 2017-07-11 14:24:59.365673 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:01.442387 I | ceph-mgr: 2017-07-11 14:25:01.370715 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:01.442480 I | ceph-mgr: 2017-07-11 14:25:01.442463 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:01.442743 I | ceph-mgr: 2017-07-11 14:25:01.442726 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:01.658971 I | ceph-mgr: 2017-07-11 14:25:01.658954 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6219 10.233.124.5:0/3546996067' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:01.659049 I | ceph-mgr: 2017-07-11 14:25:01.659035 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:02.571854 I | ceph-mgr: 2017-07-11 14:25:02.571779 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6225 10.233.124.0:0/3106518868' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:02.571953 I | ceph-mgr: 2017-07-11 14:25:02.571917 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:03.447226 I | ceph-mgr: 2017-07-11 14:25:03.445898 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:03.447578 I | ceph-mgr: 2017-07-11 14:25:03.445909 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:03.447595 I | ceph-mgr: 2017-07-11 14:25:03.445938 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:05.305922 I | ceph-mgr: 2017-07-11 14:25:05.305869 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6281 10.233.124.5:0/819807136' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:05.306132 I | ceph-mgr: 2017-07-11 14:25:05.306018 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:05.451346 I | ceph-mgr: 2017-07-11 14:25:05.450081 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:05.451401 I | ceph-mgr: 2017-07-11 14:25:05.450086 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:05.451418 I | ceph-mgr: 2017-07-11 14:25:05.450104 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:06.470301 I | ceph-mgr: 2017-07-11 14:25:06.470218 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6284 10.233.124.5:0/2553944301' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:06.470406 I | ceph-mgr: 2017-07-11 14:25:06.470379 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:07.456565 I | ceph-mgr: 2017-07-11 14:25:07.453588 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:07.456628 I | ceph-mgr: 2017-07-11 14:25:07.453593 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:07.456713 I | ceph-mgr: 2017-07-11 14:25:07.453616 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:09.318425 I | ceph-mgr: 2017-07-11 14:25:09.318346 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6290 10.233.124.5:0/2640939643' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:09.318488 I | ceph-mgr: 2017-07-11 14:25:09.318371 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:09.478089 I | ceph-mgr: 2017-07-11 14:25:09.478061 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:09.478146 I | ceph-mgr: 2017-07-11 14:25:09.478132 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:09.478359 I | ceph-mgr: 2017-07-11 14:25:09.478245 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:10.241535 I | ceph-mgr: 2017-07-11 14:25:10.240911 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6258 10.233.124.5:0/1792539016' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:10.241608 I | ceph-mgr: 2017-07-11 14:25:10.240960 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:11.496918 I | ceph-mgr: 2017-07-11 14:25:11.496852 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:11.497040 I | ceph-mgr: 2017-07-11 14:25:11.497025 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:11.497311 I | ceph-mgr: 2017-07-11 14:25:11.497294 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:13.319256 I | ceph-mgr: 2017-07-11 14:25:13.319206 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6305 10.233.124.5:0/2859663031' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:13.319356 I | ceph-mgr: 2017-07-11 14:25:13.319329 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:13.506278 I | ceph-mgr: 2017-07-11 14:25:13.506209 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:13.506356 I | ceph-mgr: 2017-07-11 14:25:13.506340 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:13.506598 I | ceph-mgr: 2017-07-11 14:25:13.506572 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:14.777878 I | ceph-mgr: 2017-07-11 14:25:14.777741 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6308 10.233.124.5:0/3734174594' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:14.779106 I | ceph-mgr: 2017-07-11 14:25:14.777832 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:15.526634 I | ceph-mgr: 2017-07-11 14:25:15.524178 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:15.526686 I | ceph-mgr: 2017-07-11 14:25:15.524183 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:15.526702 I | ceph-mgr: 2017-07-11 14:25:15.524203 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:17.529393 I | ceph-mgr: 2017-07-11 14:25:17.528117 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:17.529456 I | ceph-mgr: 2017-07-11 14:25:17.528123 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:17.529486 I | ceph-mgr: 2017-07-11 14:25:17.528147 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:17.858403 I | ceph-mgr: 2017-07-11 14:25:17.858354 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6323 10.233.124.5:0/3014417147' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:17.860330 I | ceph-mgr: 2017-07-11 14:25:17.860295 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:18.778763 I | ceph-mgr: 2017-07-11 14:25:18.778660 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6282 10.233.124.0:0/3451694516' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:18.778822 I | ceph-mgr: 2017-07-11 14:25:18.778712 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:19.545566 I | ceph-mgr: 2017-07-11 14:25:19.529371 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:19.545677 I | ceph-mgr: 2017-07-11 14:25:19.529376 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:19.545817 I | ceph-mgr: 2017-07-11 14:25:19.529403 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:21.549875 I | ceph-mgr: 2017-07-11 14:25:21.549761 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:21.549980 I | ceph-mgr: 2017-07-11 14:25:21.549965 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:21.550223 I | ceph-mgr: 2017-07-11 14:25:21.550207 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:21.905874 I | ceph-mgr: 2017-07-11 14:25:21.905821 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5092 10.233.124.0:0/2458129464' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:21.905917 I | ceph-mgr: 2017-07-11 14:25:21.905839 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:22.804397 I | ceph-mgr: 2017-07-11 14:25:22.804301 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6341 10.233.124.5:0/2919872225' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:22.804469 I | ceph-mgr: 2017-07-11 14:25:22.804350 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:23.553578 I | ceph-mgr: 2017-07-11 14:25:23.552186 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:23.561435 I | ceph-mgr: 2017-07-11 14:25:23.552191 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:23.561469 I | ceph-mgr: 2017-07-11 14:25:23.552212 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:25.561568 I | ceph-mgr: 2017-07-11 14:25:25.559892 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:25.561643 I | ceph-mgr: 2017-07-11 14:25:25.559900 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:25.561658 I | ceph-mgr: 2017-07-11 14:25:25.559925 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:25.806119 I | ceph-mgr: 2017-07-11 14:25:25.806069 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6303 10.233.124.5:0/1608635512' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:25.806296 I | ceph-mgr: 2017-07-11 14:25:25.806202 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:26.840258 I | ceph-mgr: 2017-07-11 14:25:26.840167 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6306 10.233.124.5:0/3861847641' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:26.840313 I | ceph-mgr: 2017-07-11 14:25:26.840217 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:27.566928 I | ceph-mgr: 2017-07-11 14:25:27.565547 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:27.566991 I | ceph-mgr: 2017-07-11 14:25:27.565566 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:27.567006 I | ceph-mgr: 2017-07-11 14:25:27.565625 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:29.589154 I | ceph-mgr: 2017-07-11 14:25:29.573288 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:29.589253 I | ceph-mgr: 2017-07-11 14:25:29.573302 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:29.589325 I | ceph-mgr: 2017-07-11 14:25:29.573326 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:29.601436 I | ceph-mgr: 2017-07-11 14:25:29.601390 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6362 10.233.124.5:0/2786856971' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:29.601474 I | ceph-mgr: 2017-07-11 14:25:29.601407 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:30.670551 I | ceph-mgr: 2017-07-11 14:25:30.670467 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5098 10.233.124.0:0/3476790923' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:30.670603 I | ceph-mgr: 2017-07-11 14:25:30.670512 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:31.593094 I | ceph-mgr: 2017-07-11 14:25:31.593063 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:31.593163 I | ceph-mgr: 2017-07-11 14:25:31.593149 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:31.593402 I | ceph-mgr: 2017-07-11 14:25:31.593385 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:33.551200 I | ceph-mgr: 2017-07-11 14:25:33.551128 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6374 10.233.124.5:0/3247567937' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:33.551294 I | ceph-mgr: 2017-07-11 14:25:33.551149 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:33.602255 I | ceph-mgr: 2017-07-11 14:25:33.602233 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:33.602309 I | ceph-mgr: 2017-07-11 14:25:33.602295 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:33.602518 I | ceph-mgr: 2017-07-11 14:25:33.602409 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:34.600202 I | ceph-mgr: 2017-07-11 14:25:34.600106 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6333 10.233.124.0:0/3622006171' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:34.600262 I | ceph-mgr: 2017-07-11 14:25:34.600155 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:35.625241 I | ceph-mgr: 2017-07-11 14:25:35.625210 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:35.625309 I | ceph-mgr: 2017-07-11 14:25:35.625295 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:35.625519 I | ceph-mgr: 2017-07-11 14:25:35.625406 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:37.639693 I | ceph-mgr: 2017-07-11 14:25:37.639597 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:37.639919 I | ceph-mgr: 2017-07-11 14:25:37.639903 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:37.642212 I | ceph-mgr: 2017-07-11 14:25:37.642196 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:37.931623 I | ceph-mgr: 2017-07-11 14:25:37.931575 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5110 10.233.124.0:0/1920656086' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:37.931666 I | ceph-mgr: 2017-07-11 14:25:37.931593 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:38.831253 I | ceph-mgr: 2017-07-11 14:25:38.831155 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6389 10.233.124.5:0/444412226' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:38.831337 I | ceph-mgr: 2017-07-11 14:25:38.831203 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:39.651738 I | ceph-mgr: 2017-07-11 14:25:39.651696 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:39.651925 I | ceph-mgr: 2017-07-11 14:25:39.651908 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:39.653266 I | ceph-mgr: 2017-07-11 14:25:39.653232 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:41.636573 I | ceph-mgr: 2017-07-11 14:25:41.636495 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6360 10.233.124.0:0/2717907225' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:41.636590 I | ceph-mgr: 2017-07-11 14:25:41.636516 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:41.655467 I | ceph-mgr: 2017-07-11 14:25:41.655430 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:41.655597 I | ceph-mgr: 2017-07-11 14:25:41.655581 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:41.656412 I | ceph-mgr: 2017-07-11 14:25:41.656395 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:42.533618 I | ceph-mgr: 2017-07-11 14:25:42.533538 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6366 10.233.124.0:0/3717561048' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:42.533806 I | ceph-mgr: 2017-07-11 14:25:42.533699 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:43.683181 I | ceph-mgr: 2017-07-11 14:25:43.667290 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:43.683238 I | ceph-mgr: 2017-07-11 14:25:43.667302 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:43.683300 I | ceph-mgr: 2017-07-11 14:25:43.667333 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:45.367701 I | ceph-mgr: 2017-07-11 14:25:45.367571 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6407 10.233.124.5:0/363190348' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:45.369134 I | ceph-mgr: 2017-07-11 14:25:45.367609 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:45.699414 I | ceph-mgr: 2017-07-11 14:25:45.689766 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:45.699842 I | ceph-mgr: 2017-07-11 14:25:45.689772 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:45.699877 I | ceph-mgr: 2017-07-11 14:25:45.689793 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:46.519386 I | ceph-mgr: 2017-07-11 14:25:46.519296 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6375 10.233.124.0:0/46622287' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:46.519539 I | ceph-mgr: 2017-07-11 14:25:46.519343 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:47.712346 I | ceph-mgr: 2017-07-11 14:25:47.712251 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:47.712431 I | ceph-mgr: 2017-07-11 14:25:47.712416 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:47.712652 I | ceph-mgr: 2017-07-11 14:25:47.712637 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:49.204668 I | ceph-mgr: 2017-07-11 14:25:49.204614 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6419 10.233.124.5:0/621272043' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:49.204762 I | ceph-mgr: 2017-07-11 14:25:49.204737 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:49.717870 I | ceph-mgr: 2017-07-11 14:25:49.717840 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:49.717951 I | ceph-mgr: 2017-07-11 14:25:49.717937 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:49.733534 I | ceph-mgr: 2017-07-11 14:25:49.718057 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:50.078005 I | ceph-mgr: 2017-07-11 14:25:50.077925 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6387 10.233.124.0:0/621709548' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:50.078051 I | ceph-mgr: 2017-07-11 14:25:50.077972 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:51.740939 I | ceph-mgr: 2017-07-11 14:25:51.740834 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:51.741014 I | ceph-mgr: 2017-07-11 14:25:51.741000 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:51.741240 I | ceph-mgr: 2017-07-11 14:25:51.741224 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:53.060245 I | ceph-mgr: 2017-07-11 14:25:53.059969 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6434 10.233.124.5:0/1825799726' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:53.060291 I | ceph-mgr: 2017-07-11 14:25:53.059989 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:53.743881 I | ceph-mgr: 2017-07-11 14:25:53.743836 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:53.743969 I | ceph-mgr: 2017-07-11 14:25:53.743954 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:53.744193 I | ceph-mgr: 2017-07-11 14:25:53.744177 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:54.044089 I | ceph-mgr: 2017-07-11 14:25:54.043994 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6408 10.233.124.0:0/2881343054' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:54.044165 I | ceph-mgr: 2017-07-11 14:25:54.044041 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:55.759864 I | ceph-mgr: 2017-07-11 14:25:55.756350 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:55.759921 I | ceph-mgr: 2017-07-11 14:25:55.756362 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:55.759939 I | ceph-mgr: 2017-07-11 14:25:55.756392 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:57.071738 I | ceph-mgr: 2017-07-11 14:25:57.071690 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6455 10.233.124.5:0/3092633926' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:57.071833 I | ceph-mgr: 2017-07-11 14:25:57.071808 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:57.757947 I | ceph-mgr: 2017-07-11 14:25:57.757807 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:57.758461 I | ceph-mgr: 2017-07-11 14:25:57.757821 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:57.758496 I | ceph-mgr: 2017-07-11 14:25:57.758063 7f4cc3226700 0 mgr tick
- 2017-07-11 14:25:57.978792 I | ceph-mgr: 2017-07-11 14:25:57.978715 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6458 10.233.124.5:0/49330856' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:25:57.978889 I | ceph-mgr: 2017-07-11 14:25:57.978862 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:25:59.767899 I | ceph-mgr: 2017-07-11 14:25:59.767225 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:25:59.767973 I | ceph-mgr: 2017-07-11 14:25:59.767234 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:25:59.767989 I | ceph-mgr: 2017-07-11 14:25:59.767260 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:00.936026 I | ceph-mgr: 2017-07-11 14:26:00.935970 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6432 10.233.124.0:0/2163762458' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:00.936088 I | ceph-mgr: 2017-07-11 14:26:00.935990 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:01.787032 I | ceph-mgr: 2017-07-11 14:26:01.770965 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:01.787088 I | ceph-mgr: 2017-07-11 14:26:01.770970 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:01.787104 I | ceph-mgr: 2017-07-11 14:26:01.770991 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:01.896352 I | ceph-mgr: 2017-07-11 14:26:01.896186 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6467 10.233.124.5:0/3461735790' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:01.898974 I | ceph-mgr: 2017-07-11 14:26:01.896283 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:03.791863 I | ceph-mgr: 2017-07-11 14:26:03.790368 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:03.797945 I | ceph-mgr: 2017-07-11 14:26:03.790373 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:03.797986 I | ceph-mgr: 2017-07-11 14:26:03.790393 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:04.666400 I | ceph-mgr: 2017-07-11 14:26:04.666350 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6450 10.233.124.0:0/2004041817' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:04.666499 I | ceph-mgr: 2017-07-11 14:26:04.666472 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:05.755817 I | ceph-mgr: 2017-07-11 14:26:05.755747 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6476 10.233.124.5:0/3759617216' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:05.755903 I | ceph-mgr: 2017-07-11 14:26:05.755877 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:05.796392 I | ceph-mgr: 2017-07-11 14:26:05.794941 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:05.796534 I | ceph-mgr: 2017-07-11 14:26:05.794952 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:05.796586 I | ceph-mgr: 2017-07-11 14:26:05.795003 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:07.802816 I | ceph-mgr: 2017-07-11 14:26:07.801614 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:07.802978 I | ceph-mgr: 2017-07-11 14:26:07.801620 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:07.803015 I | ceph-mgr: 2017-07-11 14:26:07.801643 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:08.967440 I | ceph-mgr: 2017-07-11 14:26:08.967373 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6465 10.233.124.0:0/828624852' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:08.967523 I | ceph-mgr: 2017-07-11 14:26:08.967393 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:09.807236 I | ceph-mgr: 2017-07-11 14:26:09.805596 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:09.807353 I | ceph-mgr: 2017-07-11 14:26:09.807336 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:09.807875 I | ceph-mgr: 2017-07-11 14:26:09.807858 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:09.847048 I | ceph-mgr: 2017-07-11 14:26:09.846953 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6468 10.233.124.0:0/834257505' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:09.847110 I | ceph-mgr: 2017-07-11 14:26:09.847000 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:11.818078 I | ceph-mgr: 2017-07-11 14:26:11.818037 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:11.826080 I | ceph-mgr: 2017-07-11 14:26:11.826046 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:11.835594 I | ceph-mgr: 2017-07-11 14:26:11.826241 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:12.888053 I | ceph-mgr: 2017-07-11 14:26:12.887981 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6500 10.233.124.5:0/4084254169' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:12.888121 I | ceph-mgr: 2017-07-11 14:26:12.888002 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:13.918308 I | ceph-mgr: 2017-07-11 14:26:13.918142 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:13.918411 I | ceph-mgr: 2017-07-11 14:26:13.918395 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:13.918773 I | ceph-mgr: 2017-07-11 14:26:13.918757 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:13.957038 I | ceph-mgr: 2017-07-11 14:26:13.956936 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5140 10.233.124.5:0/280634807' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:13.957165 I | ceph-mgr: 2017-07-11 14:26:13.956990 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:15.934071 I | ceph-mgr: 2017-07-11 14:26:15.933814 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:15.934135 I | ceph-mgr: 2017-07-11 14:26:15.933819 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:15.934151 I | ceph-mgr: 2017-07-11 14:26:15.933839 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:17.097397 I | ceph-mgr: 2017-07-11 14:26:17.097349 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6495 10.233.124.0:0/3901098669' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:17.097490 I | ceph-mgr: 2017-07-11 14:26:17.097465 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:17.936796 I | ceph-mgr: 2017-07-11 14:26:17.936148 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:17.936868 I | ceph-mgr: 2017-07-11 14:26:17.936159 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:17.936883 I | ceph-mgr: 2017-07-11 14:26:17.936188 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:18.186136 I | ceph-mgr: 2017-07-11 14:26:18.186056 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6498 10.233.124.0:0/350497087' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:18.186232 I | ceph-mgr: 2017-07-11 14:26:18.186205 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:19.944759 I | ceph-mgr: 2017-07-11 14:26:19.943492 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:19.944813 I | ceph-mgr: 2017-07-11 14:26:19.943498 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:19.944832 I | ceph-mgr: 2017-07-11 14:26:19.943519 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:21.001128 I | ceph-mgr: 2017-07-11 14:26:20.985473 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6521 10.233.124.5:0/1705353962' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:21.001211 I | ceph-mgr: 2017-07-11 14:26:21.001022 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:21.947418 I | ceph-mgr: 2017-07-11 14:26:21.947315 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:21.947478 I | ceph-mgr: 2017-07-11 14:26:21.947320 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:21.947494 I | ceph-mgr: 2017-07-11 14:26:21.947342 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:21.998439 I | ceph-mgr: 2017-07-11 14:26:21.998350 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6524 10.233.124.5:0/20718527' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:21.998514 I | ceph-mgr: 2017-07-11 14:26:21.998402 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:23.955705 I | ceph-mgr: 2017-07-11 14:26:23.955665 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:23.955895 I | ceph-mgr: 2017-07-11 14:26:23.955865 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:23.955990 I | ceph-mgr: 2017-07-11 14:26:23.955949 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:24.899265 I | ceph-mgr: 2017-07-11 14:26:24.899203 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6536 10.233.124.5:0/4242124226' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:24.899370 I | ceph-mgr: 2017-07-11 14:26:24.899344 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:25.957417 I | ceph-mgr: 2017-07-11 14:26:25.957371 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:25.957510 I | ceph-mgr: 2017-07-11 14:26:25.957495 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:25.957727 I | ceph-mgr: 2017-07-11 14:26:25.957576 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:25.974315 I | ceph-mgr: 2017-07-11 14:26:25.974288 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6542 10.233.124.5:0/959594831' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:25.975209 I | ceph-mgr: 2017-07-11 14:26:25.975132 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:27.978842 I | ceph-mgr: 2017-07-11 14:26:27.978800 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:27.978946 I | ceph-mgr: 2017-07-11 14:26:27.978921 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:27.979262 I | ceph-mgr: 2017-07-11 14:26:27.979246 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:28.815017 I | ceph-mgr: 2017-07-11 14:26:28.814948 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6557 10.233.124.5:0/1248329722' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:28.817861 I | ceph-mgr: 2017-07-11 14:26:28.814969 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:29.948835 I | ceph-mgr: 2017-07-11 14:26:29.948750 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6563 10.233.124.5:0/2182840558' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:29.948923 I | ceph-mgr: 2017-07-11 14:26:29.948897 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:29.995151 I | ceph-mgr: 2017-07-11 14:26:29.995090 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:29.998807 I | ceph-mgr: 2017-07-11 14:26:29.995247 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:30.004781 I | ceph-mgr: 2017-07-11 14:26:30.004764 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:32.009652 I | ceph-mgr: 2017-07-11 14:26:32.009622 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:32.009826 I | ceph-mgr: 2017-07-11 14:26:32.009810 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:32.011050 I | ceph-mgr: 2017-07-11 14:26:32.011033 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:32.921772 I | ceph-mgr: 2017-07-11 14:26:32.921725 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6546 10.233.124.0:0/289658791' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:32.930478 I | ceph-mgr: 2017-07-11 14:26:32.930448 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:33.813785 I | ceph-mgr: 2017-07-11 14:26:33.813702 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6552 10.233.124.0:0/1334350868' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:33.813853 I | ceph-mgr: 2017-07-11 14:26:33.813748 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:34.025019 I | ceph-mgr: 2017-07-11 14:26:34.024959 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:34.025137 I | ceph-mgr: 2017-07-11 14:26:34.025124 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:34.025327 I | ceph-mgr: 2017-07-11 14:26:34.025311 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:36.042663 I | ceph-mgr: 2017-07-11 14:26:36.026861 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:36.042935 I | ceph-mgr: 2017-07-11 14:26:36.026867 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:36.043003 I | ceph-mgr: 2017-07-11 14:26:36.026890 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:36.790910 I | ceph-mgr: 2017-07-11 14:26:36.790852 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6584 10.233.124.5:0/1891004876' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:36.792356 I | ceph-mgr: 2017-07-11 14:26:36.790872 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:37.799171 I | ceph-mgr: 2017-07-11 14:26:37.799076 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6590 10.233.124.5:0/1639151408' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:37.799230 I | ceph-mgr: 2017-07-11 14:26:37.799123 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:38.051063 I | ceph-mgr: 2017-07-11 14:26:38.049658 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:38.052955 I | ceph-mgr: 2017-07-11 14:26:38.049670 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:38.059186 I | ceph-mgr: 2017-07-11 14:26:38.049700 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:40.065900 I | ceph-mgr: 2017-07-11 14:26:40.058239 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:40.065952 I | ceph-mgr: 2017-07-11 14:26:40.058261 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:40.065986 I | ceph-mgr: 2017-07-11 14:26:40.058338 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:40.559468 I | ceph-mgr: 2017-07-11 14:26:40.557337 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6596 10.233.124.5:0/2032901855' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:40.559519 I | ceph-mgr: 2017-07-11 14:26:40.557373 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:41.557418 I | ceph-mgr: 2017-07-11 14:26:41.557333 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6582 10.233.124.0:0/175347627' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:41.557522 I | ceph-mgr: 2017-07-11 14:26:41.557490 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:42.071174 I | ceph-mgr: 2017-07-11 14:26:42.062398 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:42.071254 I | ceph-mgr: 2017-07-11 14:26:42.062417 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:42.071271 I | ceph-mgr: 2017-07-11 14:26:42.062491 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:44.072421 I | ceph-mgr: 2017-07-11 14:26:44.072383 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:44.072598 I | ceph-mgr: 2017-07-11 14:26:44.072582 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:44.072834 I | ceph-mgr: 2017-07-11 14:26:44.072819 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:44.411810 I | ceph-mgr: 2017-07-11 14:26:44.411754 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6617 10.233.124.5:0/3777530777' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:44.412224 I | ceph-mgr: 2017-07-11 14:26:44.412123 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:45.275845 I | ceph-mgr: 2017-07-11 14:26:45.275734 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6594 10.233.124.5:0/2786093435' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:45.277240 I | ceph-mgr: 2017-07-11 14:26:45.275805 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:46.090946 I | ceph-mgr: 2017-07-11 14:26:46.089569 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:46.091150 I | ceph-mgr: 2017-07-11 14:26:46.089574 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:46.091177 I | ceph-mgr: 2017-07-11 14:26:46.089594 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:48.042353 I | ceph-mgr: 2017-07-11 14:26:48.042310 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6603 10.233.124.0:0/3394668103' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:48.042440 I | ceph-mgr: 2017-07-11 14:26:48.042414 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:48.094057 I | ceph-mgr: 2017-07-11 14:26:48.092668 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:48.099877 I | ceph-mgr: 2017-07-11 14:26:48.092673 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:48.099912 I | ceph-mgr: 2017-07-11 14:26:48.092693 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:48.898906 I | ceph-mgr: 2017-07-11 14:26:48.898818 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6609 10.233.124.0:0/58938686' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:48.898999 I | ceph-mgr: 2017-07-11 14:26:48.898971 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:50.101169 I | ceph-mgr: 2017-07-11 14:26:50.099666 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:50.101372 I | ceph-mgr: 2017-07-11 14:26:50.099671 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:50.101400 I | ceph-mgr: 2017-07-11 14:26:50.099692 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:51.547710 I | ceph-mgr: 2017-07-11 14:26:51.547661 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6621 10.233.124.0:0/2075662587' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:51.547871 I | ceph-mgr: 2017-07-11 14:26:51.547787 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:52.110166 I | ceph-mgr: 2017-07-11 14:26:52.108690 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:52.110373 I | ceph-mgr: 2017-07-11 14:26:52.108702 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:52.110483 I | ceph-mgr: 2017-07-11 14:26:52.108749 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:52.383708 I | ceph-mgr: 2017-07-11 14:26:52.383642 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6641 10.233.124.5:0/1398582645' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:52.383784 I | ceph-mgr: 2017-07-11 14:26:52.383759 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:54.117763 I | ceph-mgr: 2017-07-11 14:26:54.116265 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:54.117998 I | ceph-mgr: 2017-07-11 14:26:54.116277 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:54.118031 I | ceph-mgr: 2017-07-11 14:26:54.116318 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:55.180879 I | ceph-mgr: 2017-07-11 14:26:55.180856 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6653 10.233.124.5:0/407457191' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:55.181112 I | ceph-mgr: 2017-07-11 14:26:55.181097 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:56.133933 I | ceph-mgr: 2017-07-11 14:26:56.123546 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:56.134007 I | ceph-mgr: 2017-07-11 14:26:56.123553 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:56.134025 I | ceph-mgr: 2017-07-11 14:26:56.123579 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:56.170280 I | ceph-mgr: 2017-07-11 14:26:56.170263 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6656 10.233.124.5:0/3436184580' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:56.170473 I | ceph-mgr: 2017-07-11 14:26:56.170438 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:26:58.169615 I | ceph-mgr: 2017-07-11 14:26:58.130398 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:26:58.179017 I | ceph-mgr: 2017-07-11 14:26:58.130412 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:26:58.179153 I | ceph-mgr: 2017-07-11 14:26:58.130461 7f4cc3226700 0 mgr tick
- 2017-07-11 14:26:59.467068 I | ceph-mgr: 2017-07-11 14:26:59.467019 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6639 10.233.124.0:0/976545869' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:26:59.467153 I | ceph-mgr: 2017-07-11 14:26:59.467128 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:00.191272 I | ceph-mgr: 2017-07-11 14:27:00.182751 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:00.191338 I | ceph-mgr: 2017-07-11 14:27:00.182756 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:00.191355 I | ceph-mgr: 2017-07-11 14:27:00.182777 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:00.337718 I | ceph-mgr: 2017-07-11 14:27:00.337655 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6677 10.233.124.5:0/2286176970' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:00.337803 I | ceph-mgr: 2017-07-11 14:27:00.337776 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:02.191431 I | ceph-mgr: 2017-07-11 14:27:02.190065 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:02.198581 I | ceph-mgr: 2017-07-11 14:27:02.190073 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:02.198650 I | ceph-mgr: 2017-07-11 14:27:02.190095 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:03.271960 I | ceph-mgr: 2017-07-11 14:27:03.271914 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6689 10.233.124.5:0/2964482774' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:03.274102 I | ceph-mgr: 2017-07-11 14:27:03.274074 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:04.151020 I | ceph-mgr: 2017-07-11 14:27:04.150943 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6695 10.233.124.5:0/3828060005' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:04.151108 I | ceph-mgr: 2017-07-11 14:27:04.151083 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:04.209248 I | ceph-mgr: 2017-07-11 14:27:04.192542 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:04.209482 I | ceph-mgr: 2017-07-11 14:27:04.192547 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:04.209509 I | ceph-mgr: 2017-07-11 14:27:04.192571 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:06.226688 I | ceph-mgr: 2017-07-11 14:27:06.210090 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:06.227071 I | ceph-mgr: 2017-07-11 14:27:06.210096 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:06.227101 I | ceph-mgr: 2017-07-11 14:27:06.210120 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:07.309977 I | ceph-mgr: 2017-07-11 14:27:07.309915 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6663 10.233.124.0:0/3195672451' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:07.310043 I | ceph-mgr: 2017-07-11 14:27:07.309935 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:08.224562 I | ceph-mgr: 2017-07-11 14:27:08.224534 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6669 10.233.124.0:0/2309528950' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:08.224760 I | ceph-mgr: 2017-07-11 14:27:08.224728 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:08.234627 I | ceph-mgr: 2017-07-11 14:27:08.233293 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:08.234770 I | ceph-mgr: 2017-07-11 14:27:08.233298 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:08.234791 I | ceph-mgr: 2017-07-11 14:27:08.233317 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:10.241948 I | ceph-mgr: 2017-07-11 14:27:10.240634 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:10.242014 I | ceph-mgr: 2017-07-11 14:27:10.240640 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:10.242029 I | ceph-mgr: 2017-07-11 14:27:10.240662 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:10.763969 I | ceph-mgr: 2017-07-11 14:27:10.763940 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6678 10.233.124.0:0/3668595873' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:10.764144 I | ceph-mgr: 2017-07-11 14:27:10.764071 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:11.710952 I | ceph-mgr: 2017-07-11 14:27:11.710922 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6713 10.233.124.5:0/3359428838' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:11.716984 I | ceph-mgr: 2017-07-11 14:27:11.716959 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:12.248425 I | ceph-mgr: 2017-07-11 14:27:12.248391 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:12.248498 I | ceph-mgr: 2017-07-11 14:27:12.248483 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:12.248576 I | ceph-mgr: 2017-07-11 14:27:12.248562 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:14.259019 I | ceph-mgr: 2017-07-11 14:27:14.258863 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:14.259105 I | ceph-mgr: 2017-07-11 14:27:14.259089 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:14.259177 I | ceph-mgr: 2017-07-11 14:27:14.259167 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:14.492902 I | ceph-mgr: 2017-07-11 14:27:14.492849 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6722 10.233.124.5:0/1662607917' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:14.498631 I | ceph-mgr: 2017-07-11 14:27:14.492867 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:15.439057 I | ceph-mgr: 2017-07-11 14:27:15.438969 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6728 10.233.124.5:0/2803149027' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:15.439128 I | ceph-mgr: 2017-07-11 14:27:15.439016 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:16.282716 I | ceph-mgr: 2017-07-11 14:27:16.281262 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:16.282788 I | ceph-mgr: 2017-07-11 14:27:16.281291 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:16.282805 I | ceph-mgr: 2017-07-11 14:27:16.281322 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:18.284273 I | ceph-mgr: 2017-07-11 14:27:18.282880 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:18.284343 I | ceph-mgr: 2017-07-11 14:27:18.282886 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:18.284410 I | ceph-mgr: 2017-07-11 14:27:18.284358 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:18.291186 I | ceph-mgr: 2017-07-11 14:27:18.291165 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6737 10.233.124.5:0/1737988333' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:18.294307 I | ceph-mgr: 2017-07-11 14:27:18.294244 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:19.171117 I | ceph-mgr: 2017-07-11 14:27:19.171000 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6708 10.233.124.0:0/2254462845' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:19.171187 I | ceph-mgr: 2017-07-11 14:27:19.171070 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:20.295611 I | ceph-mgr: 2017-07-11 14:27:20.294933 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:20.296749 I | ceph-mgr: 2017-07-11 14:27:20.296731 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:20.297004 I | ceph-mgr: 2017-07-11 14:27:20.296989 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:22.286472 I | ceph-mgr: 2017-07-11 14:27:22.286370 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6749 10.233.124.5:0/3466101774' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:22.292581 I | ceph-mgr: 2017-07-11 14:27:22.286391 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:22.331452 I | ceph-mgr: 2017-07-11 14:27:22.331403 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:22.331570 I | ceph-mgr: 2017-07-11 14:27:22.331540 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:22.331879 I | ceph-mgr: 2017-07-11 14:27:22.331862 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:23.306292 I | ceph-mgr: 2017-07-11 14:27:23.306200 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6755 10.233.124.5:0/4113948968' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:23.306348 I | ceph-mgr: 2017-07-11 14:27:23.306247 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:24.337409 I | ceph-mgr: 2017-07-11 14:27:24.337372 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:24.337497 I | ceph-mgr: 2017-07-11 14:27:24.337481 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:24.337720 I | ceph-mgr: 2017-07-11 14:27:24.337703 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:26.337285 I | ceph-mgr: 2017-07-11 14:27:26.337228 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6773 10.233.124.5:0/2404747352' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:26.337382 I | ceph-mgr: 2017-07-11 14:27:26.337356 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:26.344708 I | ceph-mgr: 2017-07-11 14:27:26.344690 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:26.344760 I | ceph-mgr: 2017-07-11 14:27:26.344747 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:26.344870 I | ceph-mgr: 2017-07-11 14:27:26.344856 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:27.394400 I | ceph-mgr: 2017-07-11 14:27:27.394288 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6720 10.233.124.0:0/3171399762' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:27.394460 I | ceph-mgr: 2017-07-11 14:27:27.394359 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:28.359801 I | ceph-mgr: 2017-07-11 14:27:28.350009 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:28.359949 I | ceph-mgr: 2017-07-11 14:27:28.350014 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:28.359997 I | ceph-mgr: 2017-07-11 14:27:28.350037 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:29.949617 I | ceph-mgr: 2017-07-11 14:27:29.949565 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6735 10.233.124.0:0/1115989072' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:29.953382 I | ceph-mgr: 2017-07-11 14:27:29.953345 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:30.373963 I | ceph-mgr: 2017-07-11 14:27:30.362188 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:30.374118 I | ceph-mgr: 2017-07-11 14:27:30.362193 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:30.374151 I | ceph-mgr: 2017-07-11 14:27:30.362216 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:31.108401 I | ceph-mgr: 2017-07-11 14:27:31.108318 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6782 10.233.124.5:0/725527693' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:31.116080 I | ceph-mgr: 2017-07-11 14:27:31.116048 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:32.384451 I | ceph-mgr: 2017-07-11 14:27:32.383031 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:32.392404 I | ceph-mgr: 2017-07-11 14:27:32.383037 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:32.392508 I | ceph-mgr: 2017-07-11 14:27:32.383059 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:33.727251 I | ceph-mgr: 2017-07-11 14:27:33.727207 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6744 10.233.124.0:0/1186461933' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:33.727339 I | ceph-mgr: 2017-07-11 14:27:33.727314 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:34.389623 I | ceph-mgr: 2017-07-11 14:27:34.388199 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:34.389769 I | ceph-mgr: 2017-07-11 14:27:34.388208 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:34.390741 I | ceph-mgr: 2017-07-11 14:27:34.388246 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:34.563747 I | ceph-mgr: 2017-07-11 14:27:34.563669 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6750 10.233.124.0:0/3302799808' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:34.563820 I | ceph-mgr: 2017-07-11 14:27:34.563795 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:36.398294 I | ceph-mgr: 2017-07-11 14:27:36.390002 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:36.398641 I | ceph-mgr: 2017-07-11 14:27:36.390008 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:36.398671 I | ceph-mgr: 2017-07-11 14:27:36.390030 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:37.359747 I | ceph-mgr: 2017-07-11 14:27:37.359702 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6806 10.233.124.5:0/879447529' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:37.359830 I | ceph-mgr: 2017-07-11 14:27:37.359806 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:38.227836 I | ceph-mgr: 2017-07-11 14:27:38.227725 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6812 10.233.124.5:0/3566147222' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:38.227927 I | ceph-mgr: 2017-07-11 14:27:38.227900 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:38.413236 I | ceph-mgr: 2017-07-11 14:27:38.403313 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:38.413374 I | ceph-mgr: 2017-07-11 14:27:38.403324 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:38.413394 I | ceph-mgr: 2017-07-11 14:27:38.403361 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:40.421111 I | ceph-mgr: 2017-07-11 14:27:40.419597 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:40.421281 I | ceph-mgr: 2017-07-11 14:27:40.419608 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:40.421314 I | ceph-mgr: 2017-07-11 14:27:40.419634 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:40.803762 I | ceph-mgr: 2017-07-11 14:27:40.803707 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6818 10.233.124.5:0/3189964045' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:40.803821 I | ceph-mgr: 2017-07-11 14:27:40.803726 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:41.794709 I | ceph-mgr: 2017-07-11 14:27:41.794596 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6821 10.233.124.5:0/1560043131' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:41.794789 I | ceph-mgr: 2017-07-11 14:27:41.794644 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:42.422764 I | ceph-mgr: 2017-07-11 14:27:42.421611 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:42.422844 I | ceph-mgr: 2017-07-11 14:27:42.421618 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:42.422885 I | ceph-mgr: 2017-07-11 14:27:42.421642 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:44.430480 I | ceph-mgr: 2017-07-11 14:27:44.430445 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:44.430559 I | ceph-mgr: 2017-07-11 14:27:44.430545 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:44.430645 I | ceph-mgr: 2017-07-11 14:27:44.430631 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:44.449010 I | ceph-mgr: 2017-07-11 14:27:44.448955 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6833 10.233.124.5:0/3847209191' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:44.449082 I | ceph-mgr: 2017-07-11 14:27:44.449057 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:45.506606 I | ceph-mgr: 2017-07-11 14:27:45.506537 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6836 10.233.124.5:0/482090093' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:45.506691 I | ceph-mgr: 2017-07-11 14:27:45.506664 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:46.436622 I | ceph-mgr: 2017-07-11 14:27:46.436591 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:46.436698 I | ceph-mgr: 2017-07-11 14:27:46.436684 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:46.436785 I | ceph-mgr: 2017-07-11 14:27:46.436773 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:48.382051 I | ceph-mgr: 2017-07-11 14:27:48.382006 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6801 10.233.124.0:0/1167683841' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:48.382139 I | ceph-mgr: 2017-07-11 14:27:48.382114 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:48.438684 I | ceph-mgr: 2017-07-11 14:27:48.438415 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:48.438859 I | ceph-mgr: 2017-07-11 14:27:48.438841 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:48.438944 I | ceph-mgr: 2017-07-11 14:27:48.438933 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:49.418050 I | ceph-mgr: 2017-07-11 14:27:49.417965 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6804 10.233.124.0:0/1599838772' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:49.418102 I | ceph-mgr: 2017-07-11 14:27:49.418011 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:50.465634 I | ceph-mgr: 2017-07-11 14:27:50.462500 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:50.465704 I | ceph-mgr: 2017-07-11 14:27:50.462511 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:50.465719 I | ceph-mgr: 2017-07-11 14:27:50.462551 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:52.283551 I | ceph-mgr: 2017-07-11 14:27:52.283486 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6857 10.233.124.5:0/3361809519' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:52.283618 I | ceph-mgr: 2017-07-11 14:27:52.283505 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:52.473348 I | ceph-mgr: 2017-07-11 14:27:52.471919 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:52.473431 I | ceph-mgr: 2017-07-11 14:27:52.471927 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:52.473448 I | ceph-mgr: 2017-07-11 14:27:52.471954 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:53.248670 I | ceph-mgr: 2017-07-11 14:27:53.248594 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6860 10.233.124.5:0/643578326' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:53.248777 I | ceph-mgr: 2017-07-11 14:27:53.248748 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:54.479402 I | ceph-mgr: 2017-07-11 14:27:54.478081 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:54.479466 I | ceph-mgr: 2017-07-11 14:27:54.478086 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:54.479482 I | ceph-mgr: 2017-07-11 14:27:54.478110 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:56.479425 I | ceph-mgr: 2017-07-11 14:27:56.479389 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:56.479598 I | ceph-mgr: 2017-07-11 14:27:56.479582 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:56.488978 I | ceph-mgr: 2017-07-11 14:27:56.488959 7f4cc3226700 0 mgr tick
- 2017-07-11 14:27:56.744249 I | ceph-mgr: 2017-07-11 14:27:56.744197 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6869 10.233.124.5:0/3470557497' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:56.744376 I | ceph-mgr: 2017-07-11 14:27:56.744360 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:57.654594 I | ceph-mgr: 2017-07-11 14:27:57.654513 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6875 10.233.124.5:0/998492316' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:27:57.654689 I | ceph-mgr: 2017-07-11 14:27:57.654657 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:27:58.496265 I | ceph-mgr: 2017-07-11 14:27:58.493086 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:27:58.496478 I | ceph-mgr: 2017-07-11 14:27:58.493100 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:27:58.496506 I | ceph-mgr: 2017-07-11 14:27:58.493142 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:00.502112 I | ceph-mgr: 2017-07-11 14:28:00.500673 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:00.502318 I | ceph-mgr: 2017-07-11 14:28:00.500684 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:00.502356 I | ceph-mgr: 2017-07-11 14:28:00.500724 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:01.747821 I | ceph-mgr: 2017-07-11 14:28:01.747759 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6843 10.233.124.0:0/2980258501' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:01.747880 I | ceph-mgr: 2017-07-11 14:28:01.747778 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:02.504344 I | ceph-mgr: 2017-07-11 14:28:02.503069 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:02.510820 I | ceph-mgr: 2017-07-11 14:28:02.503074 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:02.510870 I | ceph-mgr: 2017-07-11 14:28:02.503094 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:02.597585 I | ceph-mgr: 2017-07-11 14:28:02.597510 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5224 10.233.124.0:0/105074443' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:02.597653 I | ceph-mgr: 2017-07-11 14:28:02.597628 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:04.511179 I | ceph-mgr: 2017-07-11 14:28:04.508152 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:04.511378 I | ceph-mgr: 2017-07-11 14:28:04.508157 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:04.511404 I | ceph-mgr: 2017-07-11 14:28:04.508180 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:06.351381 I | ceph-mgr: 2017-07-11 14:28:06.341815 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6855 10.233.124.0:0/1269433124' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:06.351575 I | ceph-mgr: 2017-07-11 14:28:06.351484 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:06.592858 I | ceph-mgr: 2017-07-11 14:28:06.585253 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:06.593213 I | ceph-mgr: 2017-07-11 14:28:06.585263 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:06.593241 I | ceph-mgr: 2017-07-11 14:28:06.585314 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:07.342524 I | ceph-mgr: 2017-07-11 14:28:07.342430 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6858 10.233.124.0:0/3333472799' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:07.342580 I | ceph-mgr: 2017-07-11 14:28:07.342554 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:08.599869 I | ceph-mgr: 2017-07-11 14:28:08.598237 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:08.600081 I | ceph-mgr: 2017-07-11 14:28:08.598248 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:08.600108 I | ceph-mgr: 2017-07-11 14:28:08.598276 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:10.606439 I | ceph-mgr: 2017-07-11 14:28:10.604994 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:10.606593 I | ceph-mgr: 2017-07-11 14:28:10.605006 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:10.606640 I | ceph-mgr: 2017-07-11 14:28:10.605034 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:11.589206 I | ceph-mgr: 2017-07-11 14:28:11.589137 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6864 10.233.124.0:0/1527358061' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:11.589306 I | ceph-mgr: 2017-07-11 14:28:11.589274 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:12.433406 I | ceph-mgr: 2017-07-11 14:28:12.423669 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6920 10.233.124.5:0/1743855177' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:12.443140 I | ceph-mgr: 2017-07-11 14:28:12.433507 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:12.609508 I | ceph-mgr: 2017-07-11 14:28:12.606665 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:12.609883 I | ceph-mgr: 2017-07-11 14:28:12.606676 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:12.609991 I | ceph-mgr: 2017-07-11 14:28:12.606717 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:14.629459 I | ceph-mgr: 2017-07-11 14:28:14.629429 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:14.629619 I | ceph-mgr: 2017-07-11 14:28:14.629603 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:14.630073 I | ceph-mgr: 2017-07-11 14:28:14.630057 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:16.232080 I | ceph-mgr: 2017-07-11 14:28:16.232011 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6879 10.233.124.5:0/899597720' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:16.232144 I | ceph-mgr: 2017-07-11 14:28:16.232038 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:16.645223 I | ceph-mgr: 2017-07-11 14:28:16.645187 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:16.647215 I | ceph-mgr: 2017-07-11 14:28:16.647199 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:16.647575 I | ceph-mgr: 2017-07-11 14:28:16.647387 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:17.171454 I | ceph-mgr: 2017-07-11 14:28:17.171360 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6882 10.233.124.0:0/1427904014' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:17.171540 I | ceph-mgr: 2017-07-11 14:28:17.171409 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:18.672876 I | ceph-mgr: 2017-07-11 14:28:18.672836 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:18.672944 I | ceph-mgr: 2017-07-11 14:28:18.672930 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:18.673122 I | ceph-mgr: 2017-07-11 14:28:18.673107 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:20.676458 I | ceph-mgr: 2017-07-11 14:28:20.676382 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:20.676536 I | ceph-mgr: 2017-07-11 14:28:20.676521 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:20.676772 I | ceph-mgr: 2017-07-11 14:28:20.676757 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:20.928709 I | ceph-mgr: 2017-07-11 14:28:20.928662 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6888 10.233.124.0:0/3161130320' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:20.928788 I | ceph-mgr: 2017-07-11 14:28:20.928764 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:21.865566 I | ceph-mgr: 2017-07-11 14:28:21.865487 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6891 10.233.124.0:0/1462121365' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:21.865655 I | ceph-mgr: 2017-07-11 14:28:21.865629 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:22.697412 I | ceph-mgr: 2017-07-11 14:28:22.696055 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:22.697473 I | ceph-mgr: 2017-07-11 14:28:22.696061 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:22.697509 I | ceph-mgr: 2017-07-11 14:28:22.696083 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:24.704317 I | ceph-mgr: 2017-07-11 14:28:24.703690 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:24.704379 I | ceph-mgr: 2017-07-11 14:28:24.703703 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:24.704395 I | ceph-mgr: 2017-07-11 14:28:24.703734 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:26.230399 I | ceph-mgr: 2017-07-11 14:28:26.230343 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6956 10.233.124.5:0/1253671918' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:26.230515 I | ceph-mgr: 2017-07-11 14:28:26.230486 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:26.707951 I | ceph-mgr: 2017-07-11 14:28:26.707882 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:26.708059 I | ceph-mgr: 2017-07-11 14:28:26.708042 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:26.708213 I | ceph-mgr: 2017-07-11 14:28:26.708198 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:27.159487 I | ceph-mgr: 2017-07-11 14:28:27.159410 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6909 10.233.124.0:0/2590149714' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:27.159591 I | ceph-mgr: 2017-07-11 14:28:27.159566 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:28.714403 I | ceph-mgr: 2017-07-11 14:28:28.714282 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:28.714574 I | ceph-mgr: 2017-07-11 14:28:28.714557 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:28.714651 I | ceph-mgr: 2017-07-11 14:28:28.714640 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:30.727045 I | ceph-mgr: 2017-07-11 14:28:30.725685 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:30.727240 I | ceph-mgr: 2017-07-11 14:28:30.725690 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:30.727266 I | ceph-mgr: 2017-07-11 14:28:30.725710 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:30.843451 I | ceph-mgr: 2017-07-11 14:28:30.843414 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6974 10.233.124.5:0/1531442507' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:30.843527 I | ceph-mgr: 2017-07-11 14:28:30.843500 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:31.778442 I | ceph-mgr: 2017-07-11 14:28:31.778368 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6918 10.233.124.0:0/3980292714' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:31.778537 I | ceph-mgr: 2017-07-11 14:28:31.778511 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:32.731524 I | ceph-mgr: 2017-07-11 14:28:32.730230 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:32.731588 I | ceph-mgr: 2017-07-11 14:28:32.730235 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:32.731604 I | ceph-mgr: 2017-07-11 14:28:32.730256 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:34.748546 I | ceph-mgr: 2017-07-11 14:28:34.748516 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:34.748630 I | ceph-mgr: 2017-07-11 14:28:34.748617 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:34.758387 I | ceph-mgr: 2017-07-11 14:28:34.752117 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:35.940523 I | ceph-mgr: 2017-07-11 14:28:35.940491 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6992 10.233.124.5:0/935193287' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:35.940620 I | ceph-mgr: 2017-07-11 14:28:35.940607 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:36.767344 I | ceph-mgr: 2017-07-11 14:28:36.767314 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:36.767410 I | ceph-mgr: 2017-07-11 14:28:36.767395 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:36.767627 I | ceph-mgr: 2017-07-11 14:28:36.767472 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:37.085739 I | ceph-mgr: 2017-07-11 14:28:37.085714 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6998 10.233.124.5:0/3737442284' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:37.085902 I | ceph-mgr: 2017-07-11 14:28:37.085886 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:38.783428 I | ceph-mgr: 2017-07-11 14:28:38.781924 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:38.783830 I | ceph-mgr: 2017-07-11 14:28:38.781930 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:38.783862 I | ceph-mgr: 2017-07-11 14:28:38.781953 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:40.607126 I | ceph-mgr: 2017-07-11 14:28:40.607062 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6948 10.233.124.0:0/1622051744' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:40.607336 I | ceph-mgr: 2017-07-11 14:28:40.607204 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:40.787616 I | ceph-mgr: 2017-07-11 14:28:40.786572 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:40.787704 I | ceph-mgr: 2017-07-11 14:28:40.786581 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:40.787724 I | ceph-mgr: 2017-07-11 14:28:40.786607 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:41.645457 I | ceph-mgr: 2017-07-11 14:28:41.645372 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6954 10.233.124.0:0/398600967' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:41.648789 I | ceph-mgr: 2017-07-11 14:28:41.648759 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:42.788823 I | ceph-mgr: 2017-07-11 14:28:42.788620 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:42.788994 I | ceph-mgr: 2017-07-11 14:28:42.788628 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:42.794763 I | ceph-mgr: 2017-07-11 14:28:42.788655 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:44.798115 I | ceph-mgr: 2017-07-11 14:28:44.796745 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:44.804791 I | ceph-mgr: 2017-07-11 14:28:44.796750 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:44.804824 I | ceph-mgr: 2017-07-11 14:28:44.796770 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:45.591445 I | ceph-mgr: 2017-07-11 14:28:45.591399 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6969 10.233.124.5:0/3946544805' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:45.591634 I | ceph-mgr: 2017-07-11 14:28:45.591516 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:46.654426 I | ceph-mgr: 2017-07-11 14:28:46.654283 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7010 10.233.124.5:0/2948610522' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:46.654628 I | ceph-mgr: 2017-07-11 14:28:46.654549 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:46.805977 I | ceph-mgr: 2017-07-11 14:28:46.803064 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:46.806140 I | ceph-mgr: 2017-07-11 14:28:46.803069 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:46.806282 I | ceph-mgr: 2017-07-11 14:28:46.803091 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:48.822796 I | ceph-mgr: 2017-07-11 14:28:48.807084 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:48.822903 I | ceph-mgr: 2017-07-11 14:28:48.807089 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:48.822918 I | ceph-mgr: 2017-07-11 14:28:48.807109 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:50.543246 I | ceph-mgr: 2017-07-11 14:28:50.543167 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7022 10.233.124.5:0/1352861733' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:50.543302 I | ceph-mgr: 2017-07-11 14:28:50.543201 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:50.827113 I | ceph-mgr: 2017-07-11 14:28:50.827089 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:50.827168 I | ceph-mgr: 2017-07-11 14:28:50.827154 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:50.827276 I | ceph-mgr: 2017-07-11 14:28:50.827261 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:51.433736 I | ceph-mgr: 2017-07-11 14:28:51.433651 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7028 10.233.124.5:0/2005186021' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:51.433823 I | ceph-mgr: 2017-07-11 14:28:51.433797 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:52.829933 I | ceph-mgr: 2017-07-11 14:28:52.829896 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:52.830009 I | ceph-mgr: 2017-07-11 14:28:52.829995 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:52.830234 I | ceph-mgr: 2017-07-11 14:28:52.830219 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:54.833688 I | ceph-mgr: 2017-07-11 14:28:54.833647 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:54.833789 I | ceph-mgr: 2017-07-11 14:28:54.833774 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:54.834301 I | ceph-mgr: 2017-07-11 14:28:54.834025 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:55.380420 I | ceph-mgr: 2017-07-11 14:28:55.380346 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6999 10.233.124.5:0/1496607826' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:55.380497 I | ceph-mgr: 2017-07-11 14:28:55.380367 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:56.389839 I | ceph-mgr: 2017-07-11 14:28:56.389758 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7002 10.233.124.0:0/2663868881' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:28:56.389930 I | ceph-mgr: 2017-07-11 14:28:56.389903 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:28:56.846535 I | ceph-mgr: 2017-07-11 14:28:56.846488 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:56.846626 I | ceph-mgr: 2017-07-11 14:28:56.846611 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:56.846868 I | ceph-mgr: 2017-07-11 14:28:56.846853 7f4cc3226700 0 mgr tick
- 2017-07-11 14:28:58.855673 I | ceph-mgr: 2017-07-11 14:28:58.855593 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:28:58.855785 I | ceph-mgr: 2017-07-11 14:28:58.855770 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:28:58.856677 I | ceph-mgr: 2017-07-11 14:28:58.856658 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:00.580370 I | ceph-mgr: 2017-07-11 14:29:00.580321 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7014 10.233.124.5:0/2824342956' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:00.583750 I | ceph-mgr: 2017-07-11 14:29:00.583721 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:00.863749 I | ceph-mgr: 2017-07-11 14:29:00.863725 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:00.863813 I | ceph-mgr: 2017-07-11 14:29:00.863798 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:00.864029 I | ceph-mgr: 2017-07-11 14:29:00.863914 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:01.431911 I | ceph-mgr: 2017-07-11 14:29:01.431834 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7017 10.233.124.0:0/3847735745' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:01.432010 I | ceph-mgr: 2017-07-11 14:29:01.431976 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:02.868413 I | ceph-mgr: 2017-07-11 14:29:02.867032 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:02.876260 I | ceph-mgr: 2017-07-11 14:29:02.867045 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:02.876293 I | ceph-mgr: 2017-07-11 14:29:02.867074 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:04.876920 I | ceph-mgr: 2017-07-11 14:29:04.875393 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:04.877429 I | ceph-mgr: 2017-07-11 14:29:04.875398 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:04.877463 I | ceph-mgr: 2017-07-11 14:29:04.875421 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:05.431740 I | ceph-mgr: 2017-07-11 14:29:05.431689 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7020 10.233.124.0:0/1883867407' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:05.431851 I | ceph-mgr: 2017-07-11 14:29:05.431823 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:06.499211 I | ceph-mgr: 2017-07-11 14:29:06.499136 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7064 10.233.124.5:0/3101362421' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:06.499374 I | ceph-mgr: 2017-07-11 14:29:06.499285 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:06.883725 I | ceph-mgr: 2017-07-11 14:29:06.882373 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:06.883876 I | ceph-mgr: 2017-07-11 14:29:06.882379 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:06.883926 I | ceph-mgr: 2017-07-11 14:29:06.882401 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:08.900807 I | ceph-mgr: 2017-07-11 14:29:08.885178 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:08.900980 I | ceph-mgr: 2017-07-11 14:29:08.885186 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:08.901111 I | ceph-mgr: 2017-07-11 14:29:08.885212 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:10.298684 I | ceph-mgr: 2017-07-11 14:29:10.298614 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7035 10.233.124.0:0/2608178655' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:10.298764 I | ceph-mgr: 2017-07-11 14:29:10.298635 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:10.903377 I | ceph-mgr: 2017-07-11 14:29:10.903343 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:10.909748 I | ceph-mgr: 2017-07-11 14:29:10.903546 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:10.910073 I | ceph-mgr: 2017-07-11 14:29:10.910057 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:11.286596 I | ceph-mgr: 2017-07-11 14:29:11.286484 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7082 10.233.124.5:0/2717238223' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:11.286644 I | ceph-mgr: 2017-07-11 14:29:11.286544 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:12.920907 I | ceph-mgr: 2017-07-11 14:29:12.919442 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:12.921064 I | ceph-mgr: 2017-07-11 14:29:12.919455 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:12.921205 I | ceph-mgr: 2017-07-11 14:29:12.919486 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:14.923655 I | ceph-mgr: 2017-07-11 14:29:14.922339 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:14.923826 I | ceph-mgr: 2017-07-11 14:29:14.922344 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:14.923847 I | ceph-mgr: 2017-07-11 14:29:14.922364 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:15.254489 I | ceph-mgr: 2017-07-11 14:29:15.254465 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7091 10.233.124.5:0/3891180124' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:15.254596 I | ceph-mgr: 2017-07-11 14:29:15.254572 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:16.313246 I | ceph-mgr: 2017-07-11 14:29:16.313220 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7050 10.233.124.0:0/2723893360' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:16.313456 I | ceph-mgr: 2017-07-11 14:29:16.313422 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:16.923693 I | ceph-mgr: 2017-07-11 14:29:16.923643 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:16.923763 I | ceph-mgr: 2017-07-11 14:29:16.923749 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:16.924269 I | ceph-mgr: 2017-07-11 14:29:16.924250 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:18.937293 I | ceph-mgr: 2017-07-11 14:29:18.933336 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:18.943203 I | ceph-mgr: 2017-07-11 14:29:18.933347 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:18.943286 I | ceph-mgr: 2017-07-11 14:29:18.933389 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:20.372109 I | ceph-mgr: 2017-07-11 14:29:20.372043 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7068 10.233.124.0:0/3440340219' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:20.372184 I | ceph-mgr: 2017-07-11 14:29:20.372063 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:20.942996 I | ceph-mgr: 2017-07-11 14:29:20.942963 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:20.943490 I | ceph-mgr: 2017-07-11 14:29:20.943449 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:20.943580 I | ceph-mgr: 2017-07-11 14:29:20.943565 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:21.256736 I | ceph-mgr: 2017-07-11 14:29:21.256658 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7097 10.233.124.5:0/3535297811' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:21.256901 I | ceph-mgr: 2017-07-11 14:29:21.256814 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:22.955548 I | ceph-mgr: 2017-07-11 14:29:22.946635 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:22.955707 I | ceph-mgr: 2017-07-11 14:29:22.946640 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:22.955802 I | ceph-mgr: 2017-07-11 14:29:22.946662 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:24.968204 I | ceph-mgr: 2017-07-11 14:29:24.966809 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:24.968372 I | ceph-mgr: 2017-07-11 14:29:24.966816 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:24.968504 I | ceph-mgr: 2017-07-11 14:29:24.966840 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:25.076827 I | ceph-mgr: 2017-07-11 14:29:25.076810 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7112 10.233.124.5:0/693321183' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:25.076903 I | ceph-mgr: 2017-07-11 14:29:25.076888 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:26.478027 I | ceph-mgr: 2017-07-11 14:29:26.478000 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7115 10.233.124.5:0/3754658545' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:26.493754 I | ceph-mgr: 2017-07-11 14:29:26.493734 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:26.998442 I | ceph-mgr: 2017-07-11 14:29:26.970366 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:26.998460 I | ceph-mgr: 2017-07-11 14:29:26.970380 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:26.998463 I | ceph-mgr: 2017-07-11 14:29:26.970410 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:29.004666 I | ceph-mgr: 2017-07-11 14:29:29.004620 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:29.004888 I | ceph-mgr: 2017-07-11 14:29:29.004873 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:29.006417 I | ceph-mgr: 2017-07-11 14:29:29.006402 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:29.989218 I | ceph-mgr: 2017-07-11 14:29:29.989167 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5275 10.233.124.0:0/359593651' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:29.989324 I | ceph-mgr: 2017-07-11 14:29:29.989298 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:30.822536 I | ceph-mgr: 2017-07-11 14:29:30.822447 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7130 10.233.124.5:0/1616244729' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:30.822601 I | ceph-mgr: 2017-07-11 14:29:30.822494 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:31.019641 I | ceph-mgr: 2017-07-11 14:29:31.018351 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:31.027788 I | ceph-mgr: 2017-07-11 14:29:31.018356 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:31.027797 I | ceph-mgr: 2017-07-11 14:29:31.018375 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:33.026311 I | ceph-mgr: 2017-07-11 14:29:33.025022 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:33.026375 I | ceph-mgr: 2017-07-11 14:29:33.025027 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:33.026393 I | ceph-mgr: 2017-07-11 14:29:33.025046 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:34.957208 I | ceph-mgr: 2017-07-11 14:29:34.957158 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7098 10.233.124.0:0/1605245531' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:34.957356 I | ceph-mgr: 2017-07-11 14:29:34.957298 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:35.028333 I | ceph-mgr: 2017-07-11 14:29:35.027097 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:35.034191 I | ceph-mgr: 2017-07-11 14:29:35.027102 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:35.034225 I | ceph-mgr: 2017-07-11 14:29:35.027121 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:36.012718 I | ceph-mgr: 2017-07-11 14:29:36.012646 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7142 10.233.124.5:0/1338894697' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:36.012803 I | ceph-mgr: 2017-07-11 14:29:36.012778 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:37.038774 I | ceph-mgr: 2017-07-11 14:29:37.029220 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:37.038993 I | ceph-mgr: 2017-07-11 14:29:37.029233 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:37.039079 I | ceph-mgr: 2017-07-11 14:29:37.029262 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:39.056153 I | ceph-mgr: 2017-07-11 14:29:39.056090 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:39.056498 I | ceph-mgr: 2017-07-11 14:29:39.056460 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:39.057276 I | ceph-mgr: 2017-07-11 14:29:39.057260 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:40.305453 I | ceph-mgr: 2017-07-11 14:29:40.305371 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7151 10.233.124.5:0/3801868412' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:40.305518 I | ceph-mgr: 2017-07-11 14:29:40.305397 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:41.062230 I | ceph-mgr: 2017-07-11 14:29:41.062199 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:41.062312 I | ceph-mgr: 2017-07-11 14:29:41.062298 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:41.062527 I | ceph-mgr: 2017-07-11 14:29:41.062413 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:41.217860 I | ceph-mgr: 2017-07-11 14:29:41.217781 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7157 10.233.124.5:0/4223459359' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:41.219604 I | ceph-mgr: 2017-07-11 14:29:41.217828 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:43.071842 I | ceph-mgr: 2017-07-11 14:29:43.068636 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:43.071937 I | ceph-mgr: 2017-07-11 14:29:43.071922 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:43.072275 I | ceph-mgr: 2017-07-11 14:29:43.072259 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:44.897493 I | ceph-mgr: 2017-07-11 14:29:44.897380 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7166 10.233.124.5:0/2209929127' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:44.897577 I | ceph-mgr: 2017-07-11 14:29:44.897552 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:45.090473 I | ceph-mgr: 2017-07-11 14:29:45.090423 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:45.091826 I | ceph-mgr: 2017-07-11 14:29:45.091809 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:45.092189 I | ceph-mgr: 2017-07-11 14:29:45.092173 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:45.991911 I | ceph-mgr: 2017-07-11 14:29:45.991838 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7134 10.233.124.0:0/4103069635' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:45.992008 I | ceph-mgr: 2017-07-11 14:29:45.991981 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:47.093827 I | ceph-mgr: 2017-07-11 14:29:47.093797 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:47.093905 I | ceph-mgr: 2017-07-11 14:29:47.093890 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:47.094137 I | ceph-mgr: 2017-07-11 14:29:47.094004 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:49.112125 I | ceph-mgr: 2017-07-11 14:29:49.112027 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:49.113906 I | ceph-mgr: 2017-07-11 14:29:49.113890 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:49.114236 I | ceph-mgr: 2017-07-11 14:29:49.114032 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:49.854954 I | ceph-mgr: 2017-07-11 14:29:49.854854 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7181 10.233.124.5:0/4110403509' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:49.855017 I | ceph-mgr: 2017-07-11 14:29:49.854895 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:50.833274 I | ceph-mgr: 2017-07-11 14:29:50.833186 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7187 10.233.124.5:0/1774759962' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:50.833334 I | ceph-mgr: 2017-07-11 14:29:50.833234 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:51.120039 I | ceph-mgr: 2017-07-11 14:29:51.120014 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:51.120096 I | ceph-mgr: 2017-07-11 14:29:51.120083 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:51.120334 I | ceph-mgr: 2017-07-11 14:29:51.120216 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:53.140665 I | ceph-mgr: 2017-07-11 14:29:53.140634 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:53.140835 I | ceph-mgr: 2017-07-11 14:29:53.140819 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:53.142534 I | ceph-mgr: 2017-07-11 14:29:53.142518 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:55.147813 I | ceph-mgr: 2017-07-11 14:29:55.146507 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:55.147884 I | ceph-mgr: 2017-07-11 14:29:55.146512 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:55.147903 I | ceph-mgr: 2017-07-11 14:29:55.146532 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:55.232129 I | ceph-mgr: 2017-07-11 14:29:55.232083 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7199 10.233.124.5:0/2613446153' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:55.232168 I | ceph-mgr: 2017-07-11 14:29:55.232100 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:56.450682 I | ceph-mgr: 2017-07-11 14:29:56.450603 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7155 10.233.124.0:0/2399861818' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:56.450780 I | ceph-mgr: 2017-07-11 14:29:56.450753 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:29:57.150311 I | ceph-mgr: 2017-07-11 14:29:57.149819 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:57.150378 I | ceph-mgr: 2017-07-11 14:29:57.149824 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:57.150396 I | ceph-mgr: 2017-07-11 14:29:57.149844 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:59.158471 I | ceph-mgr: 2017-07-11 14:29:59.154968 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:29:59.158713 I | ceph-mgr: 2017-07-11 14:29:59.154980 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:29:59.158758 I | ceph-mgr: 2017-07-11 14:29:59.155008 7f4cc3226700 0 mgr tick
- 2017-07-11 14:29:59.666388 I | ceph-mgr: 2017-07-11 14:29:59.666342 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7214 10.233.124.5:0/2031683794' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:29:59.681951 I | ceph-mgr: 2017-07-11 14:29:59.681920 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:00.582453 I | ceph-mgr: 2017-07-11 14:30:00.582361 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7217 10.233.124.5:0/948051260' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:00.582509 I | ceph-mgr: 2017-07-11 14:30:00.582409 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:01.162328 I | ceph-mgr: 2017-07-11 14:30:01.161471 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:01.162382 I | ceph-mgr: 2017-07-11 14:30:01.161477 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:01.162398 I | ceph-mgr: 2017-07-11 14:30:01.161497 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:03.171736 I | ceph-mgr: 2017-07-11 14:30:03.171707 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:03.171819 I | ceph-mgr: 2017-07-11 14:30:03.171805 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:03.171886 I | ceph-mgr: 2017-07-11 14:30:03.171876 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:04.653747 I | ceph-mgr: 2017-07-11 14:30:04.652073 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7182 10.233.124.0:0/1033153098' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:04.653964 I | ceph-mgr: 2017-07-11 14:30:04.652113 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:05.202544 I | ceph-mgr: 2017-07-11 14:30:05.192845 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:05.202626 I | ceph-mgr: 2017-07-11 14:30:05.192851 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:05.202642 I | ceph-mgr: 2017-07-11 14:30:05.192875 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:05.643956 I | ceph-mgr: 2017-07-11 14:30:05.643801 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7235 10.233.124.5:0/1666920869' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:05.644008 I | ceph-mgr: 2017-07-11 14:30:05.643863 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:07.195194 I | ceph-mgr: 2017-07-11 14:30:07.194394 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:07.195259 I | ceph-mgr: 2017-07-11 14:30:07.194406 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:07.195274 I | ceph-mgr: 2017-07-11 14:30:07.194448 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:09.199260 I | ceph-mgr: 2017-07-11 14:30:09.198950 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:09.199610 I | ceph-mgr: 2017-07-11 14:30:09.198959 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:09.199640 I | ceph-mgr: 2017-07-11 14:30:09.198979 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:09.596077 I | ceph-mgr: 2017-07-11 14:30:09.596029 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7244 10.233.124.5:0/2267345607' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:09.596244 I | ceph-mgr: 2017-07-11 14:30:09.596158 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:10.576756 I | ceph-mgr: 2017-07-11 14:30:10.576662 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7206 10.233.124.0:0/333727725' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:10.576832 I | ceph-mgr: 2017-07-11 14:30:10.576709 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:11.216935 I | ceph-mgr: 2017-07-11 14:30:11.201177 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:11.217006 I | ceph-mgr: 2017-07-11 14:30:11.201184 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:11.217184 I | ceph-mgr: 2017-07-11 14:30:11.201212 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:13.218608 I | ceph-mgr: 2017-07-11 14:30:13.218531 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:13.218697 I | ceph-mgr: 2017-07-11 14:30:13.218683 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:13.218919 I | ceph-mgr: 2017-07-11 14:30:13.218903 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:14.572920 I | ceph-mgr: 2017-07-11 14:30:14.572856 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7256 10.233.124.5:0/412418386' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:14.572989 I | ceph-mgr: 2017-07-11 14:30:14.572876 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:15.228020 I | ceph-mgr: 2017-07-11 14:30:15.227995 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:15.228090 I | ceph-mgr: 2017-07-11 14:30:15.228076 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:15.228387 I | ceph-mgr: 2017-07-11 14:30:15.228185 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:15.592449 I | ceph-mgr: 2017-07-11 14:30:15.592353 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7218 10.233.124.0:0/2029367628' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:15.592506 I | ceph-mgr: 2017-07-11 14:30:15.592410 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:17.260535 I | ceph-mgr: 2017-07-11 14:30:17.235204 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:17.260736 I | ceph-mgr: 2017-07-11 14:30:17.244511 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:17.260773 I | ceph-mgr: 2017-07-11 14:30:17.244607 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:19.264359 I | ceph-mgr: 2017-07-11 14:30:19.263013 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:19.271323 I | ceph-mgr: 2017-07-11 14:30:19.263018 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:19.271420 I | ceph-mgr: 2017-07-11 14:30:19.263049 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:19.351139 I | ceph-mgr: 2017-07-11 14:30:19.351094 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7262 10.233.124.5:0/2927694944' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:19.351205 I | ceph-mgr: 2017-07-11 14:30:19.351182 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:20.428517 I | ceph-mgr: 2017-07-11 14:30:20.428445 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7236 10.233.124.5:0/837050436' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:20.428613 I | ceph-mgr: 2017-07-11 14:30:20.428586 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:21.270898 I | ceph-mgr: 2017-07-11 14:30:21.269605 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:21.271253 I | ceph-mgr: 2017-07-11 14:30:21.269610 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:21.271287 I | ceph-mgr: 2017-07-11 14:30:21.269628 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:23.272256 I | ceph-mgr: 2017-07-11 14:30:23.272220 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:23.272336 I | ceph-mgr: 2017-07-11 14:30:23.272322 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:23.272558 I | ceph-mgr: 2017-07-11 14:30:23.272543 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:24.431240 I | ceph-mgr: 2017-07-11 14:30:24.431194 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7251 10.233.124.5:0/1099671786' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:24.431352 I | ceph-mgr: 2017-07-11 14:30:24.431324 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:25.280748 I | ceph-mgr: 2017-07-11 14:30:25.280714 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:25.283516 I | ceph-mgr: 2017-07-11 14:30:25.283484 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:25.283736 I | ceph-mgr: 2017-07-11 14:30:25.283720 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:25.381029 I | ceph-mgr: 2017-07-11 14:30:25.380927 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7257 10.233.124.5:0/135671639' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:25.381107 I | ceph-mgr: 2017-07-11 14:30:25.380985 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:27.303559 I | ceph-mgr: 2017-07-11 14:30:27.302118 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:27.304012 I | ceph-mgr: 2017-07-11 14:30:27.302122 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:27.304048 I | ceph-mgr: 2017-07-11 14:30:27.302151 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:29.240276 I | ceph-mgr: 2017-07-11 14:30:29.240211 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7283 10.233.124.5:0/1019180254' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:29.240365 I | ceph-mgr: 2017-07-11 14:30:29.240231 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:29.306948 I | ceph-mgr: 2017-07-11 14:30:29.305606 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:29.313597 I | ceph-mgr: 2017-07-11 14:30:29.305611 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:29.313632 I | ceph-mgr: 2017-07-11 14:30:29.305630 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:30.136695 I | ceph-mgr: 2017-07-11 14:30:30.136618 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7286 10.233.124.5:0/3406159515' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:30.136796 I | ceph-mgr: 2017-07-11 14:30:30.136771 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:31.309310 I | ceph-mgr: 2017-07-11 14:30:31.307990 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:31.310823 I | ceph-mgr: 2017-07-11 14:30:31.307995 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:31.310850 I | ceph-mgr: 2017-07-11 14:30:31.308015 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:33.317996 I | ceph-mgr: 2017-07-11 14:30:33.309714 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:33.318059 I | ceph-mgr: 2017-07-11 14:30:33.309721 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:33.318075 I | ceph-mgr: 2017-07-11 14:30:33.309745 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:34.382944 I | ceph-mgr: 2017-07-11 14:30:34.382862 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7298 10.233.124.5:0/709073244' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:34.390220 I | ceph-mgr: 2017-07-11 14:30:34.383105 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:35.259035 I | ceph-mgr: 2017-07-11 14:30:35.258965 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7287 10.233.124.0:0/1885898645' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:35.259126 I | ceph-mgr: 2017-07-11 14:30:35.259101 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:35.326548 I | ceph-mgr: 2017-07-11 14:30:35.318753 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:35.326631 I | ceph-mgr: 2017-07-11 14:30:35.318758 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:35.326660 I | ceph-mgr: 2017-07-11 14:30:35.318776 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:37.338616 I | ceph-mgr: 2017-07-11 14:30:37.329846 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:37.338685 I | ceph-mgr: 2017-07-11 14:30:37.329851 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:37.338702 I | ceph-mgr: 2017-07-11 14:30:37.329874 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:39.078056 I | ceph-mgr: 2017-07-11 14:30:39.077999 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7296 10.233.124.5:0/3687252146' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:39.078269 I | ceph-mgr: 2017-07-11 14:30:39.078159 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:39.339884 I | ceph-mgr: 2017-07-11 14:30:39.338506 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:39.339945 I | ceph-mgr: 2017-07-11 14:30:39.338519 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:39.339961 I | ceph-mgr: 2017-07-11 14:30:39.338562 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:40.174029 I | ceph-mgr: 2017-07-11 14:30:40.173999 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5326 10.233.124.0:0/2683789562' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:40.174231 I | ceph-mgr: 2017-07-11 14:30:40.174205 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:41.348598 I | ceph-mgr: 2017-07-11 14:30:41.347181 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:41.348665 I | ceph-mgr: 2017-07-11 14:30:41.347191 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:41.348682 I | ceph-mgr: 2017-07-11 14:30:41.347230 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:43.360685 I | ceph-mgr: 2017-07-11 14:30:43.350619 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:43.360745 I | ceph-mgr: 2017-07-11 14:30:43.350625 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:43.360760 I | ceph-mgr: 2017-07-11 14:30:43.350648 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:44.177409 I | ceph-mgr: 2017-07-11 14:30:44.177378 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7325 10.233.124.5:0/2174047002' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:44.177578 I | ceph-mgr: 2017-07-11 14:30:44.177506 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:45.115307 I | ceph-mgr: 2017-07-11 14:30:45.115280 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7331 10.233.124.5:0/3041824471' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:45.127814 I | ceph-mgr: 2017-07-11 14:30:45.127795 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:45.363136 I | ceph-mgr: 2017-07-11 14:30:45.361802 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:45.363790 I | ceph-mgr: 2017-07-11 14:30:45.361806 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:45.363818 I | ceph-mgr: 2017-07-11 14:30:45.361824 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:47.365000 I | ceph-mgr: 2017-07-11 14:30:47.363701 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:47.372193 I | ceph-mgr: 2017-07-11 14:30:47.363707 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:47.372228 I | ceph-mgr: 2017-07-11 14:30:47.363730 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:48.930336 I | ceph-mgr: 2017-07-11 14:30:48.930310 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7344 10.233.124.5:0/91643244' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:48.930433 I | ceph-mgr: 2017-07-11 14:30:48.930419 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:49.369152 I | ceph-mgr: 2017-07-11 14:30:49.368926 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:49.369241 I | ceph-mgr: 2017-07-11 14:30:49.369217 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:49.369451 I | ceph-mgr: 2017-07-11 14:30:49.369300 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:49.847436 I | ceph-mgr: 2017-07-11 14:30:49.847406 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7340 10.233.124.5:0/3067949767' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:49.848222 I | ceph-mgr: 2017-07-11 14:30:49.848205 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:51.376998 I | ceph-mgr: 2017-07-11 14:30:51.375702 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:51.377057 I | ceph-mgr: 2017-07-11 14:30:51.375707 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:51.377072 I | ceph-mgr: 2017-07-11 14:30:51.375727 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:53.393869 I | ceph-mgr: 2017-07-11 14:30:53.377461 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:53.394279 I | ceph-mgr: 2017-07-11 14:30:53.377466 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:53.394310 I | ceph-mgr: 2017-07-11 14:30:53.377488 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:54.149649 I | ceph-mgr: 2017-07-11 14:30:54.149583 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7352 10.233.124.5:0/769248794' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:54.149833 I | ceph-mgr: 2017-07-11 14:30:54.149603 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:55.057356 I | ceph-mgr: 2017-07-11 14:30:55.057246 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7358 10.233.124.5:0/1889993607' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:55.057419 I | ceph-mgr: 2017-07-11 14:30:55.057310 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:55.401497 I | ceph-mgr: 2017-07-11 14:30:55.401463 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:55.401584 I | ceph-mgr: 2017-07-11 14:30:55.401570 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:55.401808 I | ceph-mgr: 2017-07-11 14:30:55.401792 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:57.405163 I | ceph-mgr: 2017-07-11 14:30:57.405131 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:57.405243 I | ceph-mgr: 2017-07-11 14:30:57.405229 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:57.405465 I | ceph-mgr: 2017-07-11 14:30:57.405447 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:59.077206 I | ceph-mgr: 2017-07-11 14:30:59.077139 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7359 10.233.124.0:0/2047581209' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:59.086742 I | ceph-mgr: 2017-07-11 14:30:59.077160 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:30:59.419502 I | ceph-mgr: 2017-07-11 14:30:59.419444 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:30:59.419825 I | ceph-mgr: 2017-07-11 14:30:59.419810 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:30:59.421255 I | ceph-mgr: 2017-07-11 14:30:59.421236 7f4cc3226700 0 mgr tick
- 2017-07-11 14:30:59.985351 I | ceph-mgr: 2017-07-11 14:30:59.985261 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7379 10.233.124.5:0/1739280265' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:30:59.985413 I | ceph-mgr: 2017-07-11 14:30:59.985308 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:01.434870 I | ceph-mgr: 2017-07-11 14:31:01.434738 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:01.434993 I | ceph-mgr: 2017-07-11 14:31:01.434978 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:01.435209 I | ceph-mgr: 2017-07-11 14:31:01.435193 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:03.439017 I | ceph-mgr: 2017-07-11 14:31:03.438981 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:03.439097 I | ceph-mgr: 2017-07-11 14:31:03.439083 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:03.439314 I | ceph-mgr: 2017-07-11 14:31:03.439199 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:04.273544 I | ceph-mgr: 2017-07-11 14:31:04.273434 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7391 10.233.124.5:0/85791597' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:04.273623 I | ceph-mgr: 2017-07-11 14:31:04.273471 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:05.239209 I | ceph-mgr: 2017-07-11 14:31:05.239125 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7394 10.233.124.5:0/3329602197' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:05.244988 I | ceph-mgr: 2017-07-11 14:31:05.244927 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:05.457552 I | ceph-mgr: 2017-07-11 14:31:05.457531 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:05.457602 I | ceph-mgr: 2017-07-11 14:31:05.457589 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:05.457712 I | ceph-mgr: 2017-07-11 14:31:05.457698 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:07.476686 I | ceph-mgr: 2017-07-11 14:31:07.476625 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:07.480524 I | ceph-mgr: 2017-07-11 14:31:07.480508 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:07.486534 I | ceph-mgr: 2017-07-11 14:31:07.486516 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:08.753723 I | ceph-mgr: 2017-07-11 14:31:08.753673 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7380 10.233.124.5:0/3663810781' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:08.754046 I | ceph-mgr: 2017-07-11 14:31:08.753885 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:09.489826 I | ceph-mgr: 2017-07-11 14:31:09.488538 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:09.496691 I | ceph-mgr: 2017-07-11 14:31:09.488544 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:09.496792 I | ceph-mgr: 2017-07-11 14:31:09.488565 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:09.866221 I | ceph-mgr: 2017-07-11 14:31:09.866144 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7412 10.233.124.5:0/3349923854' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:09.866339 I | ceph-mgr: 2017-07-11 14:31:09.866311 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:11.506396 I | ceph-mgr: 2017-07-11 14:31:11.489837 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:11.506463 I | ceph-mgr: 2017-07-11 14:31:11.489846 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:11.506478 I | ceph-mgr: 2017-07-11 14:31:11.489873 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:13.515203 I | ceph-mgr: 2017-07-11 14:31:13.513319 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:13.515692 I | ceph-mgr: 2017-07-11 14:31:13.513324 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:13.515729 I | ceph-mgr: 2017-07-11 14:31:13.513346 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:13.687495 I | ceph-mgr: 2017-07-11 14:31:13.687342 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7389 10.233.124.0:0/2337204142' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:13.687732 I | ceph-mgr: 2017-07-11 14:31:13.687399 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:14.806610 I | ceph-mgr: 2017-07-11 14:31:14.806467 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7427 10.233.124.5:0/2846311020' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:14.806671 I | ceph-mgr: 2017-07-11 14:31:14.806520 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:15.538976 I | ceph-mgr: 2017-07-11 14:31:15.522824 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:15.539070 I | ceph-mgr: 2017-07-11 14:31:15.522834 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:15.539092 I | ceph-mgr: 2017-07-11 14:31:15.522861 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:17.556167 I | ceph-mgr: 2017-07-11 14:31:17.540343 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:17.556221 I | ceph-mgr: 2017-07-11 14:31:17.540348 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:17.556236 I | ceph-mgr: 2017-07-11 14:31:17.540368 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:18.415343 I | ceph-mgr: 2017-07-11 14:31:18.415281 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7404 10.233.124.0:0/382388237' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:18.415418 I | ceph-mgr: 2017-07-11 14:31:18.415300 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:19.248531 I | ceph-mgr: 2017-07-11 14:31:19.248434 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7407 10.233.124.0:0/3068465139' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:19.248626 I | ceph-mgr: 2017-07-11 14:31:19.248599 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:19.559486 I | ceph-mgr: 2017-07-11 14:31:19.559465 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:19.559537 I | ceph-mgr: 2017-07-11 14:31:19.559524 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:19.559744 I | ceph-mgr: 2017-07-11 14:31:19.559636 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:21.562669 I | ceph-mgr: 2017-07-11 14:31:21.562634 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:21.562840 I | ceph-mgr: 2017-07-11 14:31:21.562824 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:21.564400 I | ceph-mgr: 2017-07-11 14:31:21.564383 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:23.359782 I | ceph-mgr: 2017-07-11 14:31:23.359722 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7448 10.233.124.5:0/2415879365' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:23.359851 I | ceph-mgr: 2017-07-11 14:31:23.359742 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:23.583473 I | ceph-mgr: 2017-07-11 14:31:23.566132 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:23.583513 I | ceph-mgr: 2017-07-11 14:31:23.566136 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:23.583529 I | ceph-mgr: 2017-07-11 14:31:23.566154 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:24.263817 I | ceph-mgr: 2017-07-11 14:31:24.263721 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7451 10.233.124.5:0/2128435856' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:24.263892 I | ceph-mgr: 2017-07-11 14:31:24.263774 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:25.590734 I | ceph-mgr: 2017-07-11 14:31:25.590680 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:25.590819 I | ceph-mgr: 2017-07-11 14:31:25.590804 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:25.591082 I | ceph-mgr: 2017-07-11 14:31:25.591064 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:27.593658 I | ceph-mgr: 2017-07-11 14:31:27.593625 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:27.593739 I | ceph-mgr: 2017-07-11 14:31:27.593725 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:27.593963 I | ceph-mgr: 2017-07-11 14:31:27.593948 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:28.185215 I | ceph-mgr: 2017-07-11 14:31:28.185148 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7460 10.233.124.5:0/4137093472' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:28.185283 I | ceph-mgr: 2017-07-11 14:31:28.185167 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:29.002632 I | ceph-mgr: 2017-07-11 14:31:29.002552 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7463 10.233.124.5:0/1543853987' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:29.002800 I | ceph-mgr: 2017-07-11 14:31:29.002714 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:29.622442 I | ceph-mgr: 2017-07-11 14:31:29.622410 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:29.622517 I | ceph-mgr: 2017-07-11 14:31:29.622504 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:29.622783 I | ceph-mgr: 2017-07-11 14:31:29.622618 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:31.626094 I | ceph-mgr: 2017-07-11 14:31:31.626058 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:31.626175 I | ceph-mgr: 2017-07-11 14:31:31.626160 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:31.626414 I | ceph-mgr: 2017-07-11 14:31:31.626394 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:33.183189 I | ceph-mgr: 2017-07-11 14:31:33.183142 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7452 10.233.124.0:0/1524157827' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:33.183289 I | ceph-mgr: 2017-07-11 14:31:33.183263 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:33.719070 I | ceph-mgr: 2017-07-11 14:31:33.719044 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:33.719134 I | ceph-mgr: 2017-07-11 14:31:33.719121 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:33.719345 I | ceph-mgr: 2017-07-11 14:31:33.719232 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:34.079299 I | ceph-mgr: 2017-07-11 14:31:34.079183 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5362 10.233.124.0:0/2409271281' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:34.079369 I | ceph-mgr: 2017-07-11 14:31:34.079236 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:35.731330 I | ceph-mgr: 2017-07-11 14:31:35.721352 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:35.731542 I | ceph-mgr: 2017-07-11 14:31:35.721365 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:35.731641 I | ceph-mgr: 2017-07-11 14:31:35.721406 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:37.732165 I | ceph-mgr: 2017-07-11 14:31:37.730715 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:37.732374 I | ceph-mgr: 2017-07-11 14:31:37.730720 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:37.732412 I | ceph-mgr: 2017-07-11 14:31:37.730741 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:38.255055 I | ceph-mgr: 2017-07-11 14:31:38.255006 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7484 10.233.124.5:0/906631413' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:38.255217 I | ceph-mgr: 2017-07-11 14:31:38.255123 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:39.158218 I | ceph-mgr: 2017-07-11 14:31:39.158144 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7490 10.233.124.5:0/2067794583' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:39.163970 I | ceph-mgr: 2017-07-11 14:31:39.163938 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:39.748245 I | ceph-mgr: 2017-07-11 14:31:39.732052 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:39.748407 I | ceph-mgr: 2017-07-11 14:31:39.732061 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:39.748441 I | ceph-mgr: 2017-07-11 14:31:39.732088 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:41.754700 I | ceph-mgr: 2017-07-11 14:31:41.754666 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:41.754791 I | ceph-mgr: 2017-07-11 14:31:41.754777 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:41.755009 I | ceph-mgr: 2017-07-11 14:31:41.754994 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:43.214981 I | ceph-mgr: 2017-07-11 14:31:43.214913 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7502 10.233.124.5:0/2812021779' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:43.215045 I | ceph-mgr: 2017-07-11 14:31:43.214933 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:43.768787 I | ceph-mgr: 2017-07-11 14:31:43.768724 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:43.769040 I | ceph-mgr: 2017-07-11 14:31:43.768893 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:43.769361 I | ceph-mgr: 2017-07-11 14:31:43.769345 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:44.041949 I | ceph-mgr: 2017-07-11 14:31:44.041859 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7505 10.233.124.5:0/1684693993' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:44.042053 I | ceph-mgr: 2017-07-11 14:31:44.042027 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:45.771016 I | ceph-mgr: 2017-07-11 14:31:45.770980 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:45.771103 I | ceph-mgr: 2017-07-11 14:31:45.771089 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:45.786991 I | ceph-mgr: 2017-07-11 14:31:45.786960 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:47.804563 I | ceph-mgr: 2017-07-11 14:31:47.788716 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:47.804614 I | ceph-mgr: 2017-07-11 14:31:47.788721 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:47.804631 I | ceph-mgr: 2017-07-11 14:31:47.788747 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:47.960394 I | ceph-mgr: 2017-07-11 14:31:47.960343 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7520 10.233.124.5:0/3505203326' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:47.960432 I | ceph-mgr: 2017-07-11 14:31:47.960362 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:48.809044 I | ceph-mgr: 2017-07-11 14:31:48.793321 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7485 10.233.124.0:0/2615341294' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:48.809257 I | ceph-mgr: 2017-07-11 14:31:48.809239 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:49.815148 I | ceph-mgr: 2017-07-11 14:31:49.807979 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:49.815201 I | ceph-mgr: 2017-07-11 14:31:49.807987 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:49.815218 I | ceph-mgr: 2017-07-11 14:31:49.808010 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:51.819498 I | ceph-mgr: 2017-07-11 14:31:51.816170 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:51.819553 I | ceph-mgr: 2017-07-11 14:31:51.816173 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:51.819568 I | ceph-mgr: 2017-07-11 14:31:51.816191 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:52.857232 I | ceph-mgr: 2017-07-11 14:31:52.857205 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7497 10.233.124.0:0/920500312' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:52.859538 I | ceph-mgr: 2017-07-11 14:31:52.859522 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:53.777305 I | ceph-mgr: 2017-07-11 14:31:53.777280 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7500 10.233.124.0:0/362324857' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:53.783551 I | ceph-mgr: 2017-07-11 14:31:53.783529 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:53.820123 I | ceph-mgr: 2017-07-11 14:31:53.820089 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:53.820290 I | ceph-mgr: 2017-07-11 14:31:53.820274 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:53.820457 I | ceph-mgr: 2017-07-11 14:31:53.820446 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:55.839530 I | ceph-mgr: 2017-07-11 14:31:55.830315 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:55.839607 I | ceph-mgr: 2017-07-11 14:31:55.830325 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:55.839623 I | ceph-mgr: 2017-07-11 14:31:55.830354 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:57.853716 I | ceph-mgr: 2017-07-11 14:31:57.852348 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:57.853786 I | ceph-mgr: 2017-07-11 14:31:57.852355 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:57.853804 I | ceph-mgr: 2017-07-11 14:31:57.852378 7f4cc3226700 0 mgr tick
- 2017-07-11 14:31:58.372109 I | ceph-mgr: 2017-07-11 14:31:58.372048 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7515 10.233.124.0:0/1226665445' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:58.372170 I | ceph-mgr: 2017-07-11 14:31:58.372068 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:59.342075 I | ceph-mgr: 2017-07-11 14:31:59.342000 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5383 10.233.124.5:0/558304207' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:31:59.342177 I | ceph-mgr: 2017-07-11 14:31:59.342150 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:31:59.856657 I | ceph-mgr: 2017-07-11 14:31:59.856627 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:31:59.857912 I | ceph-mgr: 2017-07-11 14:31:59.856827 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:31:59.858053 I | ceph-mgr: 2017-07-11 14:31:59.857967 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:01.863250 I | ceph-mgr: 2017-07-11 14:32:01.861895 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:01.874630 I | ceph-mgr: 2017-07-11 14:32:01.861901 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:01.874640 I | ceph-mgr: 2017-07-11 14:32:01.861922 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:02.739706 I | ceph-mgr: 2017-07-11 14:32:02.739650 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7556 10.233.124.5:0/956835243' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:02.739803 I | ceph-mgr: 2017-07-11 14:32:02.739778 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:03.643777 I | ceph-mgr: 2017-07-11 14:32:03.643214 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7559 10.233.124.5:0/2795895172' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:03.643875 I | ceph-mgr: 2017-07-11 14:32:03.643847 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:03.869951 I | ceph-mgr: 2017-07-11 14:32:03.869070 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:03.870086 I | ceph-mgr: 2017-07-11 14:32:03.869075 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:03.870106 I | ceph-mgr: 2017-07-11 14:32:03.869095 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:05.899762 I | ceph-mgr: 2017-07-11 14:32:05.889959 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:05.899779 I | ceph-mgr: 2017-07-11 14:32:05.889966 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:05.899782 I | ceph-mgr: 2017-07-11 14:32:05.889991 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:07.859281 I | ceph-mgr: 2017-07-11 14:32:07.859233 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7571 10.233.124.5:0/1627435536' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:07.862120 I | ceph-mgr: 2017-07-11 14:32:07.862082 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:07.898137 I | ceph-mgr: 2017-07-11 14:32:07.896976 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:07.898271 I | ceph-mgr: 2017-07-11 14:32:07.896986 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:07.898290 I | ceph-mgr: 2017-07-11 14:32:07.897006 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:08.928130 I | ceph-mgr: 2017-07-11 14:32:08.928035 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7577 10.233.124.5:0/119312080' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:08.928206 I | ceph-mgr: 2017-07-11 14:32:08.928083 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:09.902779 I | ceph-mgr: 2017-07-11 14:32:09.900546 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:09.902986 I | ceph-mgr: 2017-07-11 14:32:09.901921 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:09.903012 I | ceph-mgr: 2017-07-11 14:32:09.901951 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:11.907306 I | ceph-mgr: 2017-07-11 14:32:11.905701 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:11.908407 I | ceph-mgr: 2017-07-11 14:32:11.905716 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:11.908441 I | ceph-mgr: 2017-07-11 14:32:11.905772 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:12.752282 I | ceph-mgr: 2017-07-11 14:32:12.752233 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7589 10.233.124.5:0/2844801567' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:12.752390 I | ceph-mgr: 2017-07-11 14:32:12.752363 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:13.594498 I | ceph-mgr: 2017-07-11 14:32:13.594419 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7548 10.233.124.0:0/221912518' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:13.610005 I | ceph-mgr: 2017-07-11 14:32:13.594599 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:13.912510 I | ceph-mgr: 2017-07-11 14:32:13.911153 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:13.912704 I | ceph-mgr: 2017-07-11 14:32:13.911158 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:13.912725 I | ceph-mgr: 2017-07-11 14:32:13.911177 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:15.922805 I | ceph-mgr: 2017-07-11 14:32:15.921424 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:15.923013 I | ceph-mgr: 2017-07-11 14:32:15.921436 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:15.923041 I | ceph-mgr: 2017-07-11 14:32:15.921477 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:17.721140 I | ceph-mgr: 2017-07-11 14:32:17.721081 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7560 10.233.124.5:0/1388372132' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:17.722324 I | ceph-mgr: 2017-07-11 14:32:17.721100 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:17.927605 I | ceph-mgr: 2017-07-11 14:32:17.926323 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:17.927649 I | ceph-mgr: 2017-07-11 14:32:17.926329 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:17.927665 I | ceph-mgr: 2017-07-11 14:32:17.926349 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:18.520681 I | ceph-mgr: 2017-07-11 14:32:18.520580 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7604 10.233.124.5:0/2885431373' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:18.522328 I | ceph-mgr: 2017-07-11 14:32:18.520629 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:19.931584 I | ceph-mgr: 2017-07-11 14:32:19.931526 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:19.931911 I | ceph-mgr: 2017-07-11 14:32:19.931894 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:19.932019 I | ceph-mgr: 2017-07-11 14:32:19.932008 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:21.948532 I | ceph-mgr: 2017-07-11 14:32:21.938325 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:21.952212 I | ceph-mgr: 2017-07-11 14:32:21.952191 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:21.968034 I | ceph-mgr: 2017-07-11 14:32:21.960245 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:22.684347 I | ceph-mgr: 2017-07-11 14:32:22.684287 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7622 10.233.124.5:0/1968937632' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:22.684449 I | ceph-mgr: 2017-07-11 14:32:22.684424 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:23.531907 I | ceph-mgr: 2017-07-11 14:32:23.531828 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7628 10.233.124.5:0/145632062' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:23.537682 I | ceph-mgr: 2017-07-11 14:32:23.537651 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:24.001712 I | ceph-mgr: 2017-07-11 14:32:24.001680 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:24.001939 I | ceph-mgr: 2017-07-11 14:32:24.001923 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:24.002015 I | ceph-mgr: 2017-07-11 14:32:24.002005 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:26.005430 I | ceph-mgr: 2017-07-11 14:32:26.004173 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:26.011701 I | ceph-mgr: 2017-07-11 14:32:26.004178 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:26.011737 I | ceph-mgr: 2017-07-11 14:32:26.004198 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:27.435874 I | ceph-mgr: 2017-07-11 14:32:27.435822 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7640 10.233.124.5:0/3677603825' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:27.436085 I | ceph-mgr: 2017-07-11 14:32:27.435968 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:28.013347 I | ceph-mgr: 2017-07-11 14:32:28.010421 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:28.013408 I | ceph-mgr: 2017-07-11 14:32:28.010427 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:28.013423 I | ceph-mgr: 2017-07-11 14:32:28.010459 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:28.243504 I | ceph-mgr: 2017-07-11 14:32:28.243316 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7649 10.233.124.5:0/1598649203' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:28.246068 I | ceph-mgr: 2017-07-11 14:32:28.243429 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:30.018526 I | ceph-mgr: 2017-07-11 14:32:30.017170 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:30.018581 I | ceph-mgr: 2017-07-11 14:32:30.017180 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:30.018596 I | ceph-mgr: 2017-07-11 14:32:30.017229 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:32.036129 I | ceph-mgr: 2017-07-11 14:32:32.020619 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:32.036197 I | ceph-mgr: 2017-07-11 14:32:32.020624 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:32.036443 I | ceph-mgr: 2017-07-11 14:32:32.036394 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:32.346231 I | ceph-mgr: 2017-07-11 14:32:32.346176 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7664 10.233.124.5:0/941817407' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:32.346406 I | ceph-mgr: 2017-07-11 14:32:32.346333 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:33.189397 I | ceph-mgr: 2017-07-11 14:32:33.189339 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7667 10.233.124.5:0/1669341294' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:33.192016 I | ceph-mgr: 2017-07-11 14:32:33.191997 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:34.064743 I | ceph-mgr: 2017-07-11 14:32:34.063133 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:34.064811 I | ceph-mgr: 2017-07-11 14:32:34.063146 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:34.064828 I | ceph-mgr: 2017-07-11 14:32:34.063176 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:36.064769 I | ceph-mgr: 2017-07-11 14:32:36.064394 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:36.065032 I | ceph-mgr: 2017-07-11 14:32:36.064399 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:36.065062 I | ceph-mgr: 2017-07-11 14:32:36.064419 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:37.348185 I | ceph-mgr: 2017-07-11 14:32:37.348136 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7605 10.233.124.5:0/4263786602' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:37.351574 I | ceph-mgr: 2017-07-11 14:32:37.351543 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:38.071489 I | ceph-mgr: 2017-07-11 14:32:38.070169 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:38.071643 I | ceph-mgr: 2017-07-11 14:32:38.070175 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:38.071688 I | ceph-mgr: 2017-07-11 14:32:38.070195 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:38.244143 I | ceph-mgr: 2017-07-11 14:32:38.244080 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7682 10.233.124.5:0/1430772433' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:38.246206 I | ceph-mgr: 2017-07-11 14:32:38.246178 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:40.076876 I | ceph-mgr: 2017-07-11 14:32:40.074018 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:40.082803 I | ceph-mgr: 2017-07-11 14:32:40.074024 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:40.082897 I | ceph-mgr: 2017-07-11 14:32:40.074048 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:42.089017 I | ceph-mgr: 2017-07-11 14:32:42.085845 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:42.089215 I | ceph-mgr: 2017-07-11 14:32:42.085850 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:42.089242 I | ceph-mgr: 2017-07-11 14:32:42.085870 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:42.222845 I | ceph-mgr: 2017-07-11 14:32:42.217017 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7617 10.233.124.0:0/3480978756' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:42.222921 I | ceph-mgr: 2017-07-11 14:32:42.222893 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:43.293105 I | ceph-mgr: 2017-07-11 14:32:43.293020 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7703 10.233.124.5:0/487779135' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:43.293198 I | ceph-mgr: 2017-07-11 14:32:43.293173 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:44.095358 I | ceph-mgr: 2017-07-11 14:32:44.091230 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:44.095442 I | ceph-mgr: 2017-07-11 14:32:44.091243 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:44.096762 I | ceph-mgr: 2017-07-11 14:32:44.091274 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:46.116086 I | ceph-mgr: 2017-07-11 14:32:46.116038 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:46.116278 I | ceph-mgr: 2017-07-11 14:32:46.116262 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:46.118589 I | ceph-mgr: 2017-07-11 14:32:46.116599 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:47.250862 I | ceph-mgr: 2017-07-11 14:32:47.250803 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7623 10.233.124.0:0/1086757824' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:47.250925 I | ceph-mgr: 2017-07-11 14:32:47.250822 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:48.059235 I | ceph-mgr: 2017-07-11 14:32:48.059128 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7721 10.233.124.5:0/1712695466' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:48.059294 I | ceph-mgr: 2017-07-11 14:32:48.059187 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:48.136315 I | ceph-mgr: 2017-07-11 14:32:48.136291 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:48.136372 I | ceph-mgr: 2017-07-11 14:32:48.136357 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:48.137752 I | ceph-mgr: 2017-07-11 14:32:48.137735 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:50.161406 I | ceph-mgr: 2017-07-11 14:32:50.160898 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:50.161480 I | ceph-mgr: 2017-07-11 14:32:50.161466 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:50.161692 I | ceph-mgr: 2017-07-11 14:32:50.161578 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:51.998474 I | ceph-mgr: 2017-07-11 14:32:51.998446 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7641 10.233.124.5:0/1599507685' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:51.998570 I | ceph-mgr: 2017-07-11 14:32:51.998555 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:52.166359 I | ceph-mgr: 2017-07-11 14:32:52.165944 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:52.166401 I | ceph-mgr: 2017-07-11 14:32:52.165949 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:52.166417 I | ceph-mgr: 2017-07-11 14:32:52.165973 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:52.860657 I | ceph-mgr: 2017-07-11 14:32:52.860581 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7730 10.233.124.5:0/2864698120' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:52.879769 I | ceph-mgr: 2017-07-11 14:32:52.870063 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:54.190193 I | ceph-mgr: 2017-07-11 14:32:54.188249 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:54.190395 I | ceph-mgr: 2017-07-11 14:32:54.188259 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:54.190422 I | ceph-mgr: 2017-07-11 14:32:54.188284 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:56.205015 I | ceph-mgr: 2017-07-11 14:32:56.197676 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:56.205028 I | ceph-mgr: 2017-07-11 14:32:56.197680 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:56.205031 I | ceph-mgr: 2017-07-11 14:32:56.197700 7f4cc3226700 0 mgr tick
- 2017-07-11 14:32:57.138534 I | ceph-mgr: 2017-07-11 14:32:57.138481 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7739 10.233.124.5:0/2642311453' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:57.138629 I | ceph-mgr: 2017-07-11 14:32:57.138603 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:58.090679 I | ceph-mgr: 2017-07-11 14:32:58.088957 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7665 10.233.124.0:0/1338111608' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:32:58.090746 I | ceph-mgr: 2017-07-11 14:32:58.090715 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:32:58.223116 I | ceph-mgr: 2017-07-11 14:32:58.206666 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:32:58.223158 I | ceph-mgr: 2017-07-11 14:32:58.206682 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:32:58.223173 I | ceph-mgr: 2017-07-11 14:32:58.206700 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:00.226709 I | ceph-mgr: 2017-07-11 14:33:00.226672 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:00.226789 I | ceph-mgr: 2017-07-11 14:33:00.226774 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:00.227209 I | ceph-mgr: 2017-07-11 14:33:00.227193 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:01.840866 I | ceph-mgr: 2017-07-11 14:33:01.840806 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7680 10.233.124.0:0/4211901357' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:01.840924 I | ceph-mgr: 2017-07-11 14:33:01.840826 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:02.230067 I | ceph-mgr: 2017-07-11 14:33:02.230016 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:02.230148 I | ceph-mgr: 2017-07-11 14:33:02.230133 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:02.230404 I | ceph-mgr: 2017-07-11 14:33:02.230386 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:02.727551 I | ceph-mgr: 2017-07-11 14:33:02.727457 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7757 10.233.124.5:0/3560204510' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:02.727607 I | ceph-mgr: 2017-07-11 14:33:02.727504 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:04.233031 I | ceph-mgr: 2017-07-11 14:33:04.232999 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:04.233107 I | ceph-mgr: 2017-07-11 14:33:04.233094 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:04.233324 I | ceph-mgr: 2017-07-11 14:33:04.233209 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:06.237025 I | ceph-mgr: 2017-07-11 14:33:06.236990 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:06.237103 I | ceph-mgr: 2017-07-11 14:33:06.237090 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:06.237324 I | ceph-mgr: 2017-07-11 14:33:06.237208 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:07.048810 I | ceph-mgr: 2017-07-11 14:33:07.048750 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7698 10.233.124.5:0/2364942346' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:07.048886 I | ceph-mgr: 2017-07-11 14:33:07.048771 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:07.929495 I | ceph-mgr: 2017-07-11 14:33:07.929367 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7772 10.233.124.5:0/2390438631' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:07.929552 I | ceph-mgr: 2017-07-11 14:33:07.929455 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:08.261484 I | ceph-mgr: 2017-07-11 14:33:08.261455 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:08.261550 I | ceph-mgr: 2017-07-11 14:33:08.261537 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:08.261759 I | ceph-mgr: 2017-07-11 14:33:08.261649 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:10.274361 I | ceph-mgr: 2017-07-11 14:33:10.264625 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:10.274836 I | ceph-mgr: 2017-07-11 14:33:10.264631 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:10.274866 I | ceph-mgr: 2017-07-11 14:33:10.264653 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:11.560110 I | ceph-mgr: 2017-07-11 14:33:11.559969 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7784 10.233.124.5:0/3000494057' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:11.569672 I | ceph-mgr: 2017-07-11 14:33:11.559996 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:12.271567 I | ceph-mgr: 2017-07-11 14:33:12.268445 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:12.271627 I | ceph-mgr: 2017-07-11 14:33:12.268451 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:12.271643 I | ceph-mgr: 2017-07-11 14:33:12.268474 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:12.635398 I | ceph-mgr: 2017-07-11 14:33:12.635313 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7716 10.233.124.0:0/1021645911' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:12.635462 I | ceph-mgr: 2017-07-11 14:33:12.635359 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:14.290355 I | ceph-mgr: 2017-07-11 14:33:14.290307 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:14.291292 I | ceph-mgr: 2017-07-11 14:33:14.291261 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:14.291545 I | ceph-mgr: 2017-07-11 14:33:14.291529 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:16.304542 I | ceph-mgr: 2017-07-11 14:33:16.304512 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:16.304610 I | ceph-mgr: 2017-07-11 14:33:16.304597 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:16.304718 I | ceph-mgr: 2017-07-11 14:33:16.304704 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:16.695159 I | ceph-mgr: 2017-07-11 14:33:16.695069 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7728 10.233.124.0:0/2194714179' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:16.695222 I | ceph-mgr: 2017-07-11 14:33:16.695090 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:17.873057 I | ceph-mgr: 2017-07-11 14:33:17.873022 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7805 10.233.124.5:0/4274025552' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:17.873259 I | ceph-mgr: 2017-07-11 14:33:17.873229 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:18.313956 I | ceph-mgr: 2017-07-11 14:33:18.310742 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:18.314022 I | ceph-mgr: 2017-07-11 14:33:18.310749 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:18.314037 I | ceph-mgr: 2017-07-11 14:33:18.310773 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:20.319194 I | ceph-mgr: 2017-07-11 14:33:20.317940 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:20.321024 I | ceph-mgr: 2017-07-11 14:33:20.317945 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:20.321049 I | ceph-mgr: 2017-07-11 14:33:20.317967 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:21.606415 I | ceph-mgr: 2017-07-11 14:33:21.606390 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7817 10.233.124.5:0/3144120996' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:21.606510 I | ceph-mgr: 2017-07-11 14:33:21.606496 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:22.323309 I | ceph-mgr: 2017-07-11 14:33:22.323239 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:22.323592 I | ceph-mgr: 2017-07-11 14:33:22.323445 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:22.323815 I | ceph-mgr: 2017-07-11 14:33:22.323653 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:22.528932 I | ceph-mgr: 2017-07-11 14:33:22.528915 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7823 10.233.124.5:0/290949767' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:22.529077 I | ceph-mgr: 2017-07-11 14:33:22.529021 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:24.327851 I | ceph-mgr: 2017-07-11 14:33:24.327812 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:24.327948 I | ceph-mgr: 2017-07-11 14:33:24.327931 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:24.328171 I | ceph-mgr: 2017-07-11 14:33:24.328013 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:26.347012 I | ceph-mgr: 2017-07-11 14:33:26.346982 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:26.347190 I | ceph-mgr: 2017-07-11 14:33:26.347172 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:26.349451 I | ceph-mgr: 2017-07-11 14:33:26.349265 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:26.582853 I | ceph-mgr: 2017-07-11 14:33:26.582788 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7746 10.233.124.0:0/1472122141' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:26.585130 I | ceph-mgr: 2017-07-11 14:33:26.582810 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:27.484837 I | ceph-mgr: 2017-07-11 14:33:27.484759 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7841 10.233.124.5:0/1331338329' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:27.485019 I | ceph-mgr: 2017-07-11 14:33:27.484920 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:28.356669 I | ceph-mgr: 2017-07-11 14:33:28.356630 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:28.356740 I | ceph-mgr: 2017-07-11 14:33:28.356726 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:28.356963 I | ceph-mgr: 2017-07-11 14:33:28.356805 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:30.372709 I | ceph-mgr: 2017-07-11 14:33:30.372677 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:30.372794 I | ceph-mgr: 2017-07-11 14:33:30.372780 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:30.372999 I | ceph-mgr: 2017-07-11 14:33:30.372852 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:31.253397 I | ceph-mgr: 2017-07-11 14:33:31.253312 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7847 10.233.124.5:0/686441386' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:31.253619 I | ceph-mgr: 2017-07-11 14:33:31.253523 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:32.159581 I | ceph-mgr: 2017-07-11 14:33:32.159508 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7853 10.233.124.5:0/4089621142' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:32.163139 I | ceph-mgr: 2017-07-11 14:33:32.163109 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:32.374424 I | ceph-mgr: 2017-07-11 14:33:32.374396 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:32.374511 I | ceph-mgr: 2017-07-11 14:33:32.374486 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:32.374692 I | ceph-mgr: 2017-07-11 14:33:32.374583 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:34.378999 I | ceph-mgr: 2017-07-11 14:33:34.378967 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:34.379397 I | ceph-mgr: 2017-07-11 14:33:34.379381 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:34.379562 I | ceph-mgr: 2017-07-11 14:33:34.379547 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:36.383156 I | ceph-mgr: 2017-07-11 14:33:36.383111 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:36.383270 I | ceph-mgr: 2017-07-11 14:33:36.383256 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:36.383560 I | ceph-mgr: 2017-07-11 14:33:36.383544 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:36.548121 I | ceph-mgr: 2017-07-11 14:33:36.548073 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7779 10.233.124.0:0/3444940640' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:36.551105 I | ceph-mgr: 2017-07-11 14:33:36.548091 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:37.552200 I | ceph-mgr: 2017-07-11 14:33:37.552152 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7868 10.233.124.5:0/2810181965' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:37.552374 I | ceph-mgr: 2017-07-11 14:33:37.552360 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:38.409039 I | ceph-mgr: 2017-07-11 14:33:38.392565 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:38.409098 I | ceph-mgr: 2017-07-11 14:33:38.392573 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:38.409114 I | ceph-mgr: 2017-07-11 14:33:38.392599 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:40.418008 I | ceph-mgr: 2017-07-11 14:33:40.414462 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:40.418103 I | ceph-mgr: 2017-07-11 14:33:40.418087 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:40.418343 I | ceph-mgr: 2017-07-11 14:33:40.418327 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:41.374697 I | ceph-mgr: 2017-07-11 14:33:41.374647 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7794 10.233.124.0:0/2478887921' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:41.374790 I | ceph-mgr: 2017-07-11 14:33:41.374764 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:42.392280 I | ceph-mgr: 2017-07-11 14:33:42.392202 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7886 10.233.124.5:0/2560893826' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:42.392376 I | ceph-mgr: 2017-07-11 14:33:42.392350 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:42.439252 I | ceph-mgr: 2017-07-11 14:33:42.430081 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:42.439435 I | ceph-mgr: 2017-07-11 14:33:42.430087 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:42.439472 I | ceph-mgr: 2017-07-11 14:33:42.430107 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:44.434555 I | ceph-mgr: 2017-07-11 14:33:44.433736 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:44.434661 I | ceph-mgr: 2017-07-11 14:33:44.433747 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:44.434747 I | ceph-mgr: 2017-07-11 14:33:44.433787 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:46.286256 I | ceph-mgr: 2017-07-11 14:33:46.286227 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7901 10.233.124.5:0/3873587226' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:46.286354 I | ceph-mgr: 2017-07-11 14:33:46.286341 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:46.443413 I | ceph-mgr: 2017-07-11 14:33:46.442084 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:46.451550 I | ceph-mgr: 2017-07-11 14:33:46.442089 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:46.451584 I | ceph-mgr: 2017-07-11 14:33:46.442108 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:47.251837 I | ceph-mgr: 2017-07-11 14:33:47.251753 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7806 10.233.124.0:0/3066750378' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:47.251937 I | ceph-mgr: 2017-07-11 14:33:47.251908 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:48.446429 I | ceph-mgr: 2017-07-11 14:33:48.444876 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:48.446638 I | ceph-mgr: 2017-07-11 14:33:48.444887 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:48.446667 I | ceph-mgr: 2017-07-11 14:33:48.444927 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:50.454030 I | ceph-mgr: 2017-07-11 14:33:50.452584 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:50.454234 I | ceph-mgr: 2017-07-11 14:33:50.452589 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:50.454261 I | ceph-mgr: 2017-07-11 14:33:50.452611 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:51.048050 I | ceph-mgr: 2017-07-11 14:33:51.048005 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7910 10.233.124.5:0/291461957' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:51.048206 I | ceph-mgr: 2017-07-11 14:33:51.048110 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:51.958298 I | ceph-mgr: 2017-07-11 14:33:51.958198 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7827 10.233.124.0:0/2836546721' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:51.958355 I | ceph-mgr: 2017-07-11 14:33:51.958246 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:52.456959 I | ceph-mgr: 2017-07-11 14:33:52.454767 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:52.457116 I | ceph-mgr: 2017-07-11 14:33:52.454778 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:52.457165 I | ceph-mgr: 2017-07-11 14:33:52.454818 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:54.458302 I | ceph-mgr: 2017-07-11 14:33:54.458264 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:54.458380 I | ceph-mgr: 2017-07-11 14:33:54.458367 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:54.475649 I | ceph-mgr: 2017-07-11 14:33:54.458481 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:56.191357 I | ceph-mgr: 2017-07-11 14:33:56.175658 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7922 10.233.124.5:0/877492869' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:56.191412 I | ceph-mgr: 2017-07-11 14:33:56.191252 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:56.485441 I | ceph-mgr: 2017-07-11 14:33:56.476890 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:56.485534 I | ceph-mgr: 2017-07-11 14:33:56.476894 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:56.485554 I | ceph-mgr: 2017-07-11 14:33:56.476913 7f4cc3226700 0 mgr tick
- 2017-07-11 14:33:57.117960 I | ceph-mgr: 2017-07-11 14:33:57.111600 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7928 10.233.124.5:0/2680342285' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:33:57.118079 I | ceph-mgr: 2017-07-11 14:33:57.111648 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:33:58.487500 I | ceph-mgr: 2017-07-11 14:33:58.485602 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:33:58.487579 I | ceph-mgr: 2017-07-11 14:33:58.485652 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:33:58.487596 I | ceph-mgr: 2017-07-11 14:33:58.485723 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:00.492573 I | ceph-mgr: 2017-07-11 14:34:00.490768 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:00.492652 I | ceph-mgr: 2017-07-11 14:34:00.490793 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:00.492669 I | ceph-mgr: 2017-07-11 14:34:00.490898 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:00.873749 I | ceph-mgr: 2017-07-11 14:34:00.873631 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7940 10.233.124.5:0/3082100632' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:00.873805 I | ceph-mgr: 2017-07-11 14:34:00.873650 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:01.943619 I | ceph-mgr: 2017-07-11 14:34:01.941743 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7943 10.233.124.5:0/2828029840' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:01.943673 I | ceph-mgr: 2017-07-11 14:34:01.941791 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:02.495799 I | ceph-mgr: 2017-07-11 14:34:02.495736 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:02.495907 I | ceph-mgr: 2017-07-11 14:34:02.495892 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:02.496131 I | ceph-mgr: 2017-07-11 14:34:02.496116 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:04.502970 I | ceph-mgr: 2017-07-11 14:34:04.502918 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:04.503047 I | ceph-mgr: 2017-07-11 14:34:04.503033 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:04.503215 I | ceph-mgr: 2017-07-11 14:34:04.503200 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:06.009080 I | ceph-mgr: 2017-07-11 14:34:06.009035 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7952 10.233.124.5:0/1480494359' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:06.009232 I | ceph-mgr: 2017-07-11 14:34:06.009162 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:06.511103 I | ceph-mgr: 2017-07-11 14:34:06.511069 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:06.511271 I | ceph-mgr: 2017-07-11 14:34:06.511255 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:06.512493 I | ceph-mgr: 2017-07-11 14:34:06.512369 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:07.068440 I | ceph-mgr: 2017-07-11 14:34:07.068338 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7955 10.233.124.5:0/2344063497' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:07.068498 I | ceph-mgr: 2017-07-11 14:34:07.068389 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:08.522876 I | ceph-mgr: 2017-07-11 14:34:08.522580 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:08.523006 I | ceph-mgr: 2017-07-11 14:34:08.522990 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:08.525943 I | ceph-mgr: 2017-07-11 14:34:08.525927 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:10.547997 I | ceph-mgr: 2017-07-11 14:34:10.543244 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:10.548220 I | ceph-mgr: 2017-07-11 14:34:10.543259 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:10.548248 I | ceph-mgr: 2017-07-11 14:34:10.543303 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:10.770512 I | ceph-mgr: 2017-07-11 14:34:10.770433 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7884 10.233.124.0:0/3432885863' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:10.770583 I | ceph-mgr: 2017-07-11 14:34:10.770465 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:11.645368 I | ceph-mgr: 2017-07-11 14:34:11.645285 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7973 10.233.124.5:0/277658122' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:11.645575 I | ceph-mgr: 2017-07-11 14:34:11.645452 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:12.549302 I | ceph-mgr: 2017-07-11 14:34:12.547581 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:12.549472 I | ceph-mgr: 2017-07-11 14:34:12.547591 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:12.549505 I | ceph-mgr: 2017-07-11 14:34:12.547619 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:14.565667 I | ceph-mgr: 2017-07-11 14:34:14.555905 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:14.565889 I | ceph-mgr: 2017-07-11 14:34:14.555912 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:14.565995 I | ceph-mgr: 2017-07-11 14:34:14.555947 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:15.932798 I | ceph-mgr: 2017-07-11 14:34:15.932744 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7988 10.233.124.5:0/4046655421' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:15.932985 I | ceph-mgr: 2017-07-11 14:34:15.932886 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:16.581286 I | ceph-mgr: 2017-07-11 14:34:16.572579 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:16.581509 I | ceph-mgr: 2017-07-11 14:34:16.572584 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:16.581605 I | ceph-mgr: 2017-07-11 14:34:16.572603 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:16.977552 I | ceph-mgr: 2017-07-11 14:34:16.977477 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7994 10.233.124.5:0/1065122900' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:16.978926 I | ceph-mgr: 2017-07-11 14:34:16.978891 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:18.574809 I | ceph-mgr: 2017-07-11 14:34:18.573889 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:18.575006 I | ceph-mgr: 2017-07-11 14:34:18.573898 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:18.575033 I | ceph-mgr: 2017-07-11 14:34:18.573926 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:20.510915 I | ceph-mgr: 2017-07-11 14:34:20.510862 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8006 10.233.124.5:0/3876771307' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:20.511068 I | ceph-mgr: 2017-07-11 14:34:20.510978 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:20.581210 I | ceph-mgr: 2017-07-11 14:34:20.577989 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:20.581341 I | ceph-mgr: 2017-07-11 14:34:20.577994 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:20.581376 I | ceph-mgr: 2017-07-11 14:34:20.578021 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:21.373129 I | ceph-mgr: 2017-07-11 14:34:21.373053 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7908 10.233.124.5:0/1946267197' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:21.373220 I | ceph-mgr: 2017-07-11 14:34:21.373193 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:22.597074 I | ceph-mgr: 2017-07-11 14:34:22.580496 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:22.597174 I | ceph-mgr: 2017-07-11 14:34:22.580503 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:22.597237 I | ceph-mgr: 2017-07-11 14:34:22.580548 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:24.604560 I | ceph-mgr: 2017-07-11 14:34:24.604509 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:24.604649 I | ceph-mgr: 2017-07-11 14:34:24.604634 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:24.604915 I | ceph-mgr: 2017-07-11 14:34:24.604898 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:25.930144 I | ceph-mgr: 2017-07-11 14:34:25.930079 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8027 10.233.124.5:0/1610225390' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:25.930212 I | ceph-mgr: 2017-07-11 14:34:25.930100 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:26.614369 I | ceph-mgr: 2017-07-11 14:34:26.614334 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:26.614456 I | ceph-mgr: 2017-07-11 14:34:26.614443 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:26.614683 I | ceph-mgr: 2017-07-11 14:34:26.614667 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:26.860631 I | ceph-mgr: 2017-07-11 14:34:26.860517 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7920 10.233.124.0:0/3011482421' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:26.860707 I | ceph-mgr: 2017-07-11 14:34:26.860589 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:28.624317 I | ceph-mgr: 2017-07-11 14:34:28.624236 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:28.624495 I | ceph-mgr: 2017-07-11 14:34:28.624395 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:28.624941 I | ceph-mgr: 2017-07-11 14:34:28.624925 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:30.448689 I | ceph-mgr: 2017-07-11 14:34:30.448644 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7935 10.233.124.0:0/2337560747' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:30.450660 I | ceph-mgr: 2017-07-11 14:34:30.450632 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:30.626510 I | ceph-mgr: 2017-07-11 14:34:30.626475 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:30.626577 I | ceph-mgr: 2017-07-11 14:34:30.626564 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:30.626748 I | ceph-mgr: 2017-07-11 14:34:30.626681 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:31.263796 I | ceph-mgr: 2017-07-11 14:34:31.263720 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8039 10.233.124.5:0/507016450' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:31.263888 I | ceph-mgr: 2017-07-11 14:34:31.263861 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:32.628453 I | ceph-mgr: 2017-07-11 14:34:32.628421 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:32.628561 I | ceph-mgr: 2017-07-11 14:34:32.628546 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:32.628802 I | ceph-mgr: 2017-07-11 14:34:32.628785 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:34.651733 I | ceph-mgr: 2017-07-11 14:34:34.651685 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:34.651956 I | ceph-mgr: 2017-07-11 14:34:34.651940 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:34.653356 I | ceph-mgr: 2017-07-11 14:34:34.653339 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:35.267282 I | ceph-mgr: 2017-07-11 14:34:35.267232 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7953 10.233.124.0:0/3252804405' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:35.267353 I | ceph-mgr: 2017-07-11 14:34:35.267251 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:36.301197 I | ceph-mgr: 2017-07-11 14:34:36.301090 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.7959 10.233.124.0:0/1624650527' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:36.301265 I | ceph-mgr: 2017-07-11 14:34:36.301138 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:36.661670 I | ceph-mgr: 2017-07-11 14:34:36.661642 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:36.661734 I | ceph-mgr: 2017-07-11 14:34:36.661720 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:36.662007 I | ceph-mgr: 2017-07-11 14:34:36.661987 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:38.678676 I | ceph-mgr: 2017-07-11 14:34:38.677287 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:38.678882 I | ceph-mgr: 2017-07-11 14:34:38.677293 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:38.678910 I | ceph-mgr: 2017-07-11 14:34:38.677315 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:40.293203 I | ceph-mgr: 2017-07-11 14:34:40.293149 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8066 10.233.124.5:0/925816868' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:40.293336 I | ceph-mgr: 2017-07-11 14:34:40.293263 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:40.679959 I | ceph-mgr: 2017-07-11 14:34:40.679917 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:40.680048 I | ceph-mgr: 2017-07-11 14:34:40.680034 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:40.687666 I | ceph-mgr: 2017-07-11 14:34:40.680251 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:41.096311 I | ceph-mgr: 2017-07-11 14:34:41.089492 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8069 10.233.124.5:0/2738126129' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:41.096388 I | ceph-mgr: 2017-07-11 14:34:41.089560 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:42.689512 I | ceph-mgr: 2017-07-11 14:34:42.687927 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:42.690150 I | ceph-mgr: 2017-07-11 14:34:42.687938 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:42.690186 I | ceph-mgr: 2017-07-11 14:34:42.687969 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:44.690612 I | ceph-mgr: 2017-07-11 14:34:44.690579 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:44.690790 I | ceph-mgr: 2017-07-11 14:34:44.690775 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:44.691234 I | ceph-mgr: 2017-07-11 14:34:44.690941 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:45.147101 I | ceph-mgr: 2017-07-11 14:34:45.147081 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8084 10.233.124.5:0/779051049' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:45.147182 I | ceph-mgr: 2017-07-11 14:34:45.147168 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:46.151364 I | ceph-mgr: 2017-07-11 14:34:46.151335 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8087 10.233.124.5:0/4067371701' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:46.151587 I | ceph-mgr: 2017-07-11 14:34:46.151572 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:46.704676 I | ceph-mgr: 2017-07-11 14:34:46.704432 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:46.704768 I | ceph-mgr: 2017-07-11 14:34:46.704741 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:46.704968 I | ceph-mgr: 2017-07-11 14:34:46.704942 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:48.726187 I | ceph-mgr: 2017-07-11 14:34:48.726155 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:48.726264 I | ceph-mgr: 2017-07-11 14:34:48.726249 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:48.726485 I | ceph-mgr: 2017-07-11 14:34:48.726470 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:50.107293 I | ceph-mgr: 2017-07-11 14:34:50.107236 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8102 10.233.124.5:0/1312124050' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:50.107348 I | ceph-mgr: 2017-07-11 14:34:50.107254 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:50.733982 I | ceph-mgr: 2017-07-11 14:34:50.733920 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:50.734100 I | ceph-mgr: 2017-07-11 14:34:50.734085 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:50.734378 I | ceph-mgr: 2017-07-11 14:34:50.734363 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:50.929887 I | ceph-mgr: 2017-07-11 14:34:50.929810 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8010 10.233.124.0:0/2954361959' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:50.929927 I | ceph-mgr: 2017-07-11 14:34:50.929856 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:52.737031 I | ceph-mgr: 2017-07-11 14:34:52.736998 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:52.737103 I | ceph-mgr: 2017-07-11 14:34:52.737089 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:52.737279 I | ceph-mgr: 2017-07-11 14:34:52.737263 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:54.744686 I | ceph-mgr: 2017-07-11 14:34:54.744571 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:54.744782 I | ceph-mgr: 2017-07-11 14:34:54.744768 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:54.744948 I | ceph-mgr: 2017-07-11 14:34:54.744934 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:55.112620 I | ceph-mgr: 2017-07-11 14:34:55.112557 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8114 10.233.124.5:0/451745941' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:55.112682 I | ceph-mgr: 2017-07-11 14:34:55.112577 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:56.014989 I | ceph-mgr: 2017-07-11 14:34:56.014895 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8117 10.233.124.5:0/4293026989' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:56.016987 I | ceph-mgr: 2017-07-11 14:34:56.014944 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:34:56.752700 I | ceph-mgr: 2017-07-11 14:34:56.751264 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:56.752779 I | ceph-mgr: 2017-07-11 14:34:56.751281 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:56.752795 I | ceph-mgr: 2017-07-11 14:34:56.751334 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:58.762596 I | ceph-mgr: 2017-07-11 14:34:58.755095 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:34:58.762675 I | ceph-mgr: 2017-07-11 14:34:58.762659 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:34:58.764811 I | ceph-mgr: 2017-07-11 14:34:58.762745 7f4cc3226700 0 mgr tick
- 2017-07-11 14:34:59.976153 I | ceph-mgr: 2017-07-11 14:34:59.976128 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8037 10.233.124.0:0/3836808986' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:34:59.976258 I | ceph-mgr: 2017-07-11 14:34:59.976245 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:00.776583 I | ceph-mgr: 2017-07-11 14:35:00.776491 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:00.776653 I | ceph-mgr: 2017-07-11 14:35:00.776637 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:00.776731 I | ceph-mgr: 2017-07-11 14:35:00.776720 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:01.413679 I | ceph-mgr: 2017-07-11 14:35:01.413601 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8129 10.233.124.5:0/4167017235' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:01.413768 I | ceph-mgr: 2017-07-11 14:35:01.413742 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:02.778973 I | ceph-mgr: 2017-07-11 14:35:02.778939 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:02.779060 I | ceph-mgr: 2017-07-11 14:35:02.779046 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:02.779281 I | ceph-mgr: 2017-07-11 14:35:02.779128 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:04.782514 I | ceph-mgr: 2017-07-11 14:35:04.782449 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:04.782778 I | ceph-mgr: 2017-07-11 14:35:04.782631 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:04.782850 I | ceph-mgr: 2017-07-11 14:35:04.782838 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:04.939158 I | ceph-mgr: 2017-07-11 14:35:04.939121 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8058 10.233.124.0:0/3207289958' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:04.939242 I | ceph-mgr: 2017-07-11 14:35:04.939216 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:05.954742 I | ceph-mgr: 2017-07-11 14:35:05.947165 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8061 10.233.124.5:0/3630044047' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:05.964444 I | ceph-mgr: 2017-07-11 14:35:05.964411 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:06.787235 I | ceph-mgr: 2017-07-11 14:35:06.785559 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:06.787294 I | ceph-mgr: 2017-07-11 14:35:06.785571 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:06.787311 I | ceph-mgr: 2017-07-11 14:35:06.785613 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:08.794127 I | ceph-mgr: 2017-07-11 14:35:08.792848 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:08.794193 I | ceph-mgr: 2017-07-11 14:35:08.792855 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:08.794208 I | ceph-mgr: 2017-07-11 14:35:08.792878 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:10.140357 I | ceph-mgr: 2017-07-11 14:35:10.140308 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8147 10.233.124.5:0/2520358350' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:10.156101 I | ceph-mgr: 2017-07-11 14:35:10.140425 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:10.799891 I | ceph-mgr: 2017-07-11 14:35:10.797887 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:10.799952 I | ceph-mgr: 2017-07-11 14:35:10.797899 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:10.799968 I | ceph-mgr: 2017-07-11 14:35:10.797935 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:11.018544 I | ceph-mgr: 2017-07-11 14:35:11.018516 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8073 10.233.124.0:0/1894125898' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:11.018733 I | ceph-mgr: 2017-07-11 14:35:11.018663 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:12.805287 I | ceph-mgr: 2017-07-11 14:35:12.805222 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:12.805546 I | ceph-mgr: 2017-07-11 14:35:12.805517 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:12.805936 I | ceph-mgr: 2017-07-11 14:35:12.805845 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:14.819495 I | ceph-mgr: 2017-07-11 14:35:14.819455 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:14.819575 I | ceph-mgr: 2017-07-11 14:35:14.819561 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:14.819795 I | ceph-mgr: 2017-07-11 14:35:14.819635 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:14.838647 I | ceph-mgr: 2017-07-11 14:35:14.838611 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8088 10.233.124.0:0/2497199028' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:14.838827 I | ceph-mgr: 2017-07-11 14:35:14.838773 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:16.130074 I | ceph-mgr: 2017-07-11 14:35:16.130045 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8159 10.233.124.5:0/2377484858' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:16.130333 I | ceph-mgr: 2017-07-11 14:35:16.130316 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:16.827404 I | ceph-mgr: 2017-07-11 14:35:16.826755 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:16.827472 I | ceph-mgr: 2017-07-11 14:35:16.826760 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:16.827497 I | ceph-mgr: 2017-07-11 14:35:16.826791 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:18.860910 I | ceph-mgr: 2017-07-11 14:35:18.847842 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:18.860965 I | ceph-mgr: 2017-07-11 14:35:18.847853 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:18.860980 I | ceph-mgr: 2017-07-11 14:35:18.847890 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:19.569693 I | ceph-mgr: 2017-07-11 14:35:19.569634 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8171 10.233.124.5:0/194973852' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:19.569751 I | ceph-mgr: 2017-07-11 14:35:19.569654 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:20.608361 I | ceph-mgr: 2017-07-11 14:35:20.608287 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5524 10.233.124.5:0/368188915' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:20.608450 I | ceph-mgr: 2017-07-11 14:35:20.608424 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:20.853529 I | ceph-mgr: 2017-07-11 14:35:20.853506 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:20.853584 I | ceph-mgr: 2017-07-11 14:35:20.853571 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:20.853653 I | ceph-mgr: 2017-07-11 14:35:20.853643 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:22.858865 I | ceph-mgr: 2017-07-11 14:35:22.858824 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:22.858949 I | ceph-mgr: 2017-07-11 14:35:22.858934 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:22.859024 I | ceph-mgr: 2017-07-11 14:35:22.859012 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:24.766838 I | ceph-mgr: 2017-07-11 14:35:24.766778 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8112 10.233.124.0:0/1694996448' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:24.766941 I | ceph-mgr: 2017-07-11 14:35:24.766909 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:24.865937 I | ceph-mgr: 2017-07-11 14:35:24.865823 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:24.866019 I | ceph-mgr: 2017-07-11 14:35:24.866004 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:24.866094 I | ceph-mgr: 2017-07-11 14:35:24.866084 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:25.595160 I | ceph-mgr: 2017-07-11 14:35:25.595072 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8115 10.233.124.0:0/3737078843' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:25.595338 I | ceph-mgr: 2017-07-11 14:35:25.595240 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:26.958060 I | ceph-mgr: 2017-07-11 14:35:26.958012 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:26.958153 I | ceph-mgr: 2017-07-11 14:35:26.958138 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:26.958226 I | ceph-mgr: 2017-07-11 14:35:26.958216 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:28.969418 I | ceph-mgr: 2017-07-11 14:35:28.969380 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:28.969494 I | ceph-mgr: 2017-07-11 14:35:28.969480 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:28.969660 I | ceph-mgr: 2017-07-11 14:35:28.969556 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:29.549913 I | ceph-mgr: 2017-07-11 14:35:29.549801 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8195 10.233.124.5:0/356982138' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:29.549979 I | ceph-mgr: 2017-07-11 14:35:29.549841 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:30.427934 I | ceph-mgr: 2017-07-11 14:35:30.427750 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8201 10.233.124.5:0/324226329' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:30.428000 I | ceph-mgr: 2017-07-11 14:35:30.427883 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:30.976838 I | ceph-mgr: 2017-07-11 14:35:30.976753 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:30.976917 I | ceph-mgr: 2017-07-11 14:35:30.976901 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:30.977167 I | ceph-mgr: 2017-07-11 14:35:30.977151 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:32.987259 I | ceph-mgr: 2017-07-11 14:35:32.985760 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:32.987467 I | ceph-mgr: 2017-07-11 14:35:32.985771 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:32.987495 I | ceph-mgr: 2017-07-11 14:35:32.985812 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:34.469163 I | ceph-mgr: 2017-07-11 14:35:34.469134 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8216 10.233.124.5:0/214577166' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:34.469252 I | ceph-mgr: 2017-07-11 14:35:34.469239 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:34.989660 I | ceph-mgr: 2017-07-11 14:35:34.988975 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:34.989857 I | ceph-mgr: 2017-07-11 14:35:34.988980 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:34.989886 I | ceph-mgr: 2017-07-11 14:35:34.989000 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:35.387450 I | ceph-mgr: 2017-07-11 14:35:35.387363 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8130 10.233.124.0:0/2182803147' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:35.389451 I | ceph-mgr: 2017-07-11 14:35:35.387411 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:37.012251 I | ceph-mgr: 2017-07-11 14:35:37.012215 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:37.012427 I | ceph-mgr: 2017-07-11 14:35:37.012411 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:37.014479 I | ceph-mgr: 2017-07-11 14:35:37.014461 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:39.021514 I | ceph-mgr: 2017-07-11 14:35:39.021465 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:39.022040 I | ceph-mgr: 2017-07-11 14:35:39.022022 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:39.022287 I | ceph-mgr: 2017-07-11 14:35:39.022254 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:39.396860 I | ceph-mgr: 2017-07-11 14:35:39.396791 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8234 10.233.124.5:0/3484191728' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:39.396919 I | ceph-mgr: 2017-07-11 14:35:39.396813 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:40.287900 I | ceph-mgr: 2017-07-11 14:35:40.287863 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8237 10.233.124.5:0/2589749101' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:40.288114 I | ceph-mgr: 2017-07-11 14:35:40.288070 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:41.044432 I | ceph-mgr: 2017-07-11 14:35:41.026031 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:41.044636 I | ceph-mgr: 2017-07-11 14:35:41.026041 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:41.044662 I | ceph-mgr: 2017-07-11 14:35:41.026068 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:43.048070 I | ceph-mgr: 2017-07-11 14:35:43.047995 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:43.050431 I | ceph-mgr: 2017-07-11 14:35:43.050414 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:43.050935 I | ceph-mgr: 2017-07-11 14:35:43.050916 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:44.400065 I | ceph-mgr: 2017-07-11 14:35:44.400005 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8157 10.233.124.0:0/211473153' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:44.400219 I | ceph-mgr: 2017-07-11 14:35:44.400147 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:45.076162 I | ceph-mgr: 2017-07-11 14:35:45.074423 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:45.076206 I | ceph-mgr: 2017-07-11 14:35:45.074435 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:45.076221 I | ceph-mgr: 2017-07-11 14:35:45.074472 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:45.266555 I | ceph-mgr: 2017-07-11 14:35:45.266491 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8163 10.233.124.0:0/316313864' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:45.266645 I | ceph-mgr: 2017-07-11 14:35:45.266618 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:47.078703 I | ceph-mgr: 2017-07-11 14:35:47.077184 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:47.078765 I | ceph-mgr: 2017-07-11 14:35:47.077192 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:47.078832 I | ceph-mgr: 2017-07-11 14:35:47.078802 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:49.094883 I | ceph-mgr: 2017-07-11 14:35:49.091624 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:49.094958 I | ceph-mgr: 2017-07-11 14:35:49.094942 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:49.095178 I | ceph-mgr: 2017-07-11 14:35:49.095067 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:49.192583 I | ceph-mgr: 2017-07-11 14:35:49.192529 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8258 10.233.124.5:0/2910576212' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:49.192630 I | ceph-mgr: 2017-07-11 14:35:49.192549 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:50.108642 I | ceph-mgr: 2017-07-11 14:35:50.108532 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8181 10.233.124.0:0/522208572' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:50.108707 I | ceph-mgr: 2017-07-11 14:35:50.108596 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:51.124458 I | ceph-mgr: 2017-07-11 14:35:51.124422 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:51.124527 I | ceph-mgr: 2017-07-11 14:35:51.124513 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:51.124746 I | ceph-mgr: 2017-07-11 14:35:51.124632 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:53.137538 I | ceph-mgr: 2017-07-11 14:35:53.137506 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:53.137606 I | ceph-mgr: 2017-07-11 14:35:53.137593 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:53.137859 I | ceph-mgr: 2017-07-11 14:35:53.137844 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:54.195249 I | ceph-mgr: 2017-07-11 14:35:54.195183 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8193 10.233.124.0:0/3156001756' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:54.195339 I | ceph-mgr: 2017-07-11 14:35:54.195203 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:55.013334 I | ceph-mgr: 2017-07-11 14:35:55.013191 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8199 10.233.124.0:0/1564394931' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:55.014799 I | ceph-mgr: 2017-07-11 14:35:55.014772 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:35:55.140398 I | ceph-mgr: 2017-07-11 14:35:55.140376 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:55.140537 I | ceph-mgr: 2017-07-11 14:35:55.140522 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:55.140774 I | ceph-mgr: 2017-07-11 14:35:55.140759 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:57.183793 I | ceph-mgr: 2017-07-11 14:35:57.167105 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:57.183958 I | ceph-mgr: 2017-07-11 14:35:57.167118 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:57.184008 I | ceph-mgr: 2017-07-11 14:35:57.167147 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:59.184756 I | ceph-mgr: 2017-07-11 14:35:59.184689 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:35:59.184852 I | ceph-mgr: 2017-07-11 14:35:59.184836 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:35:59.185104 I | ceph-mgr: 2017-07-11 14:35:59.185087 7f4cc3226700 0 mgr tick
- 2017-07-11 14:35:59.223057 I | ceph-mgr: 2017-07-11 14:35:59.222996 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8282 10.233.124.5:0/1519136598' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:35:59.223221 I | ceph-mgr: 2017-07-11 14:35:59.223015 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:00.241861 I | ceph-mgr: 2017-07-11 14:36:00.241770 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8288 10.233.124.5:0/1713946252' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:00.241916 I | ceph-mgr: 2017-07-11 14:36:00.241816 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:01.190661 I | ceph-mgr: 2017-07-11 14:36:01.190619 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:01.190768 I | ceph-mgr: 2017-07-11 14:36:01.190755 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:01.191024 I | ceph-mgr: 2017-07-11 14:36:01.191008 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:03.201140 I | ceph-mgr: 2017-07-11 14:36:03.201057 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:03.201357 I | ceph-mgr: 2017-07-11 14:36:03.201238 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:03.201708 I | ceph-mgr: 2017-07-11 14:36:03.201692 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:04.181775 I | ceph-mgr: 2017-07-11 14:36:04.181721 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8297 10.233.124.5:0/1857296420' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:04.181827 I | ceph-mgr: 2017-07-11 14:36:04.181740 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:05.098476 I | ceph-mgr: 2017-07-11 14:36:05.098382 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8226 10.233.124.0:0/2539123172' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:05.098550 I | ceph-mgr: 2017-07-11 14:36:05.098428 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:05.209552 I | ceph-mgr: 2017-07-11 14:36:05.209505 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:05.209653 I | ceph-mgr: 2017-07-11 14:36:05.209626 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:05.209967 I | ceph-mgr: 2017-07-11 14:36:05.209950 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:07.221181 I | ceph-mgr: 2017-07-11 14:36:07.221136 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:07.221261 I | ceph-mgr: 2017-07-11 14:36:07.221246 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:07.221497 I | ceph-mgr: 2017-07-11 14:36:07.221481 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:09.021304 I | ceph-mgr: 2017-07-11 14:36:09.021252 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8232 10.233.124.0:0/1385479696' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:09.021469 I | ceph-mgr: 2017-07-11 14:36:09.021386 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:09.250401 I | ceph-mgr: 2017-07-11 14:36:09.240803 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:09.250457 I | ceph-mgr: 2017-07-11 14:36:09.240812 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:09.250472 I | ceph-mgr: 2017-07-11 14:36:09.240835 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:09.843728 I | ceph-mgr: 2017-07-11 14:36:09.843654 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8315 10.233.124.5:0/1080782346' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:09.843820 I | ceph-mgr: 2017-07-11 14:36:09.843794 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:11.253195 I | ceph-mgr: 2017-07-11 14:36:11.251751 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:11.253285 I | ceph-mgr: 2017-07-11 14:36:11.251761 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:11.253314 I | ceph-mgr: 2017-07-11 14:36:11.251788 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:13.269911 I | ceph-mgr: 2017-07-11 14:36:13.268090 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:13.269968 I | ceph-mgr: 2017-07-11 14:36:13.268097 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:13.269984 I | ceph-mgr: 2017-07-11 14:36:13.268139 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:13.895086 I | ceph-mgr: 2017-07-11 14:36:13.895032 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8253 10.233.124.5:0/20393928' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:13.895277 I | ceph-mgr: 2017-07-11 14:36:13.895179 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:14.706409 I | ceph-mgr: 2017-07-11 14:36:14.696994 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8330 10.233.124.5:0/4037115312' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:14.706673 I | ceph-mgr: 2017-07-11 14:36:14.706632 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:15.272796 I | ceph-mgr: 2017-07-11 14:36:15.270903 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:15.272993 I | ceph-mgr: 2017-07-11 14:36:15.270914 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:15.273020 I | ceph-mgr: 2017-07-11 14:36:15.270951 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:17.278768 I | ceph-mgr: 2017-07-11 14:36:17.278723 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:17.278870 I | ceph-mgr: 2017-07-11 14:36:17.278854 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:17.279115 I | ceph-mgr: 2017-07-11 14:36:17.279098 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:18.952783 I | ceph-mgr: 2017-07-11 14:36:18.952733 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8342 10.233.124.5:0/519023150' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:18.952949 I | ceph-mgr: 2017-07-11 14:36:18.952857 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:19.302039 I | ceph-mgr: 2017-07-11 14:36:19.302015 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:19.302095 I | ceph-mgr: 2017-07-11 14:36:19.302081 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:19.302322 I | ceph-mgr: 2017-07-11 14:36:19.302305 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:19.797548 I | ceph-mgr: 2017-07-11 14:36:19.797437 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8348 10.233.124.5:0/3487104467' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:19.797606 I | ceph-mgr: 2017-07-11 14:36:19.797496 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:21.310796 I | ceph-mgr: 2017-07-11 14:36:21.310001 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:21.310947 I | ceph-mgr: 2017-07-11 14:36:21.310010 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:21.311171 I | ceph-mgr: 2017-07-11 14:36:21.310037 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:23.328651 I | ceph-mgr: 2017-07-11 14:36:23.312257 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:23.328716 I | ceph-mgr: 2017-07-11 14:36:23.312263 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:23.328731 I | ceph-mgr: 2017-07-11 14:36:23.312285 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:23.735383 I | ceph-mgr: 2017-07-11 14:36:23.735323 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8363 10.233.124.5:0/2239285886' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:23.735438 I | ceph-mgr: 2017-07-11 14:36:23.735342 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:24.547113 I | ceph-mgr: 2017-07-11 14:36:24.546962 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8277 10.233.124.0:0/572596442' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:24.548262 I | ceph-mgr: 2017-07-11 14:36:24.548234 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:25.331032 I | ceph-mgr: 2017-07-11 14:36:25.329527 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:25.331099 I | ceph-mgr: 2017-07-11 14:36:25.329540 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:25.331155 I | ceph-mgr: 2017-07-11 14:36:25.329573 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:27.342383 I | ceph-mgr: 2017-07-11 14:36:27.332416 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:27.342870 I | ceph-mgr: 2017-07-11 14:36:27.332426 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:27.342905 I | ceph-mgr: 2017-07-11 14:36:27.332478 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:28.686093 I | ceph-mgr: 2017-07-11 14:36:28.686065 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8289 10.233.124.0:0/89584107' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:28.686261 I | ceph-mgr: 2017-07-11 14:36:28.686189 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:29.338364 I | ceph-mgr: 2017-07-11 14:36:29.337864 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:29.338531 I | ceph-mgr: 2017-07-11 14:36:29.337868 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:29.338664 I | ceph-mgr: 2017-07-11 14:36:29.337891 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:29.486072 I | ceph-mgr: 2017-07-11 14:36:29.486052 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8292 10.233.124.0:0/4107178160' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:29.486226 I | ceph-mgr: 2017-07-11 14:36:29.486210 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:31.346356 I | ceph-mgr: 2017-07-11 14:36:31.346310 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:31.346441 I | ceph-mgr: 2017-07-11 14:36:31.346427 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:31.346690 I | ceph-mgr: 2017-07-11 14:36:31.346675 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:33.355157 I | ceph-mgr: 2017-07-11 14:36:33.354278 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:33.355309 I | ceph-mgr: 2017-07-11 14:36:33.354284 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:33.355353 I | ceph-mgr: 2017-07-11 14:36:33.354305 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:33.553685 I | ceph-mgr: 2017-07-11 14:36:33.553635 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8390 10.233.124.5:0/136471988' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:33.557357 I | ceph-mgr: 2017-07-11 14:36:33.553654 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:34.439127 I | ceph-mgr: 2017-07-11 14:36:34.439041 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8396 10.233.124.5:0/3690284756' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:34.439312 I | ceph-mgr: 2017-07-11 14:36:34.439230 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:35.371848 I | ceph-mgr: 2017-07-11 14:36:35.370463 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:35.372001 I | ceph-mgr: 2017-07-11 14:36:35.370475 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:35.372021 I | ceph-mgr: 2017-07-11 14:36:35.370516 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:37.371949 I | ceph-mgr: 2017-07-11 14:36:37.371873 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:37.372022 I | ceph-mgr: 2017-07-11 14:36:37.371895 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:37.372117 I | ceph-mgr: 2017-07-11 14:36:37.372040 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:38.548232 I | ceph-mgr: 2017-07-11 14:36:38.548121 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8316 10.233.124.0:0/325928635' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:38.548302 I | ceph-mgr: 2017-07-11 14:36:38.548141 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:39.362055 I | ceph-mgr: 2017-07-11 14:36:39.352295 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8322 10.233.124.0:0/1648205155' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:39.362133 I | ceph-mgr: 2017-07-11 14:36:39.352343 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:39.382426 I | ceph-mgr: 2017-07-11 14:36:39.381051 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:39.382573 I | ceph-mgr: 2017-07-11 14:36:39.381068 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:39.382598 I | ceph-mgr: 2017-07-11 14:36:39.381088 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:41.399874 I | ceph-mgr: 2017-07-11 14:36:41.383834 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:41.399949 I | ceph-mgr: 2017-07-11 14:36:41.383844 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:41.399970 I | ceph-mgr: 2017-07-11 14:36:41.383918 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:43.405914 I | ceph-mgr: 2017-07-11 14:36:43.405331 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:43.406084 I | ceph-mgr: 2017-07-11 14:36:43.405341 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:43.406213 I | ceph-mgr: 2017-07-11 14:36:43.405368 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:43.415165 I | ceph-mgr: 2017-07-11 14:36:43.415130 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8414 10.233.124.5:0/225317618' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:43.417882 I | ceph-mgr: 2017-07-11 14:36:43.417854 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:44.230054 I | ceph-mgr: 2017-07-11 14:36:44.229976 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8417 10.233.124.5:0/1625536230' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:44.230163 I | ceph-mgr: 2017-07-11 14:36:44.230135 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:45.417314 I | ceph-mgr: 2017-07-11 14:36:45.407468 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:45.417526 I | ceph-mgr: 2017-07-11 14:36:45.407473 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:45.417553 I | ceph-mgr: 2017-07-11 14:36:45.407495 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:47.413020 I | ceph-mgr: 2017-07-11 14:36:47.411700 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:47.420505 I | ceph-mgr: 2017-07-11 14:36:47.411705 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:47.420597 I | ceph-mgr: 2017-07-11 14:36:47.411733 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:48.547114 I | ceph-mgr: 2017-07-11 14:36:48.547084 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8429 10.233.124.5:0/11881069' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:48.547396 I | ceph-mgr: 2017-07-11 14:36:48.547370 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:49.415766 I | ceph-mgr: 2017-07-11 14:36:49.415020 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:49.415968 I | ceph-mgr: 2017-07-11 14:36:49.415025 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:49.416011 I | ceph-mgr: 2017-07-11 14:36:49.415062 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:49.454280 I | ceph-mgr: 2017-07-11 14:36:49.454243 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8435 10.233.124.5:0/74595819' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:49.454516 I | ceph-mgr: 2017-07-11 14:36:49.454481 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:51.423757 I | ceph-mgr: 2017-07-11 14:36:51.423473 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:51.423963 I | ceph-mgr: 2017-07-11 14:36:51.423484 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:51.423991 I | ceph-mgr: 2017-07-11 14:36:51.423510 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:53.430690 I | ceph-mgr: 2017-07-11 14:36:53.430655 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:53.430762 I | ceph-mgr: 2017-07-11 14:36:53.430748 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:53.430982 I | ceph-mgr: 2017-07-11 14:36:53.430866 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:53.848226 I | ceph-mgr: 2017-07-11 14:36:53.848196 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8450 10.233.124.5:0/4010318877' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:53.848904 I | ceph-mgr: 2017-07-11 14:36:53.848886 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:54.649161 I | ceph-mgr: 2017-07-11 14:36:54.649111 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8459 10.233.124.5:0/1554858773' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:54.649404 I | ceph-mgr: 2017-07-11 14:36:54.649388 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:55.438329 I | ceph-mgr: 2017-07-11 14:36:55.438281 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:55.438413 I | ceph-mgr: 2017-07-11 14:36:55.438398 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:55.438664 I | ceph-mgr: 2017-07-11 14:36:55.438648 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:57.444468 I | ceph-mgr: 2017-07-11 14:36:57.444436 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:57.444660 I | ceph-mgr: 2017-07-11 14:36:57.444603 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:57.444880 I | ceph-mgr: 2017-07-11 14:36:57.444864 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:58.831247 I | ceph-mgr: 2017-07-11 14:36:58.831183 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8361 10.233.124.0:0/4250284107' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:58.831325 I | ceph-mgr: 2017-07-11 14:36:58.831204 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:36:59.464570 I | ceph-mgr: 2017-07-11 14:36:59.464538 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:36:59.464607 I | ceph-mgr: 2017-07-11 14:36:59.464595 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:36:59.464713 I | ceph-mgr: 2017-07-11 14:36:59.464698 7f4cc3226700 0 mgr tick
- 2017-07-11 14:36:59.810096 I | ceph-mgr: 2017-07-11 14:36:59.791372 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8367 10.233.124.0:0/2428839537' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:36:59.810165 I | ceph-mgr: 2017-07-11 14:36:59.791467 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:01.483826 I | ceph-mgr: 2017-07-11 14:37:01.483783 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:01.483932 I | ceph-mgr: 2017-07-11 14:37:01.483918 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:01.484155 I | ceph-mgr: 2017-07-11 14:37:01.484140 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:03.491672 I | ceph-mgr: 2017-07-11 14:37:03.491639 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:03.491743 I | ceph-mgr: 2017-07-11 14:37:03.491729 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:03.491986 I | ceph-mgr: 2017-07-11 14:37:03.491971 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:04.084618 I | ceph-mgr: 2017-07-11 14:37:04.084525 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8382 10.233.124.0:0/4022033002' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:04.084682 I | ceph-mgr: 2017-07-11 14:37:04.084578 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:04.972110 I | ceph-mgr: 2017-07-11 14:37:04.972011 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8489 10.233.124.5:0/4278541456' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:04.978410 I | ceph-mgr: 2017-07-11 14:37:04.972056 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:05.495916 I | ceph-mgr: 2017-07-11 14:37:05.495882 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:05.495990 I | ceph-mgr: 2017-07-11 14:37:05.495975 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:05.496210 I | ceph-mgr: 2017-07-11 14:37:05.496089 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:07.514502 I | ceph-mgr: 2017-07-11 14:37:07.514471 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:07.514581 I | ceph-mgr: 2017-07-11 14:37:07.514566 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:07.514798 I | ceph-mgr: 2017-07-11 14:37:07.514678 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:09.062747 I | ceph-mgr: 2017-07-11 14:37:09.062681 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8501 10.233.124.5:0/1083418646' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:09.062816 I | ceph-mgr: 2017-07-11 14:37:09.062701 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:09.524126 I | ceph-mgr: 2017-07-11 14:37:09.524069 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:09.524226 I | ceph-mgr: 2017-07-11 14:37:09.524212 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:09.524442 I | ceph-mgr: 2017-07-11 14:37:09.524326 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:09.915454 I | ceph-mgr: 2017-07-11 14:37:09.915353 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8504 10.233.124.5:0/283570508' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:09.915540 I | ceph-mgr: 2017-07-11 14:37:09.915404 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:11.540512 I | ceph-mgr: 2017-07-11 14:37:11.540484 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:11.540590 I | ceph-mgr: 2017-07-11 14:37:11.540576 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:11.541021 I | ceph-mgr: 2017-07-11 14:37:11.540975 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:13.547876 I | ceph-mgr: 2017-07-11 14:37:13.547833 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:13.548071 I | ceph-mgr: 2017-07-11 14:37:13.548055 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:13.550049 I | ceph-mgr: 2017-07-11 14:37:13.550033 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:13.976186 I | ceph-mgr: 2017-07-11 14:37:13.976121 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8516 10.233.124.5:0/1209888337' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:13.976264 I | ceph-mgr: 2017-07-11 14:37:13.976141 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:14.897771 I | ceph-mgr: 2017-07-11 14:37:14.897700 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8409 10.233.124.0:0/835404653' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:14.897937 I | ceph-mgr: 2017-07-11 14:37:14.897852 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:15.567932 I | ceph-mgr: 2017-07-11 14:37:15.567184 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:15.567989 I | ceph-mgr: 2017-07-11 14:37:15.567196 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:15.568004 I | ceph-mgr: 2017-07-11 14:37:15.567223 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:17.574061 I | ceph-mgr: 2017-07-11 14:37:17.574025 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:17.574139 I | ceph-mgr: 2017-07-11 14:37:17.574125 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:17.583916 I | ceph-mgr: 2017-07-11 14:37:17.583896 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:18.622697 I | ceph-mgr: 2017-07-11 14:37:18.622638 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8534 10.233.124.5:0/2354585306' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:18.622751 I | ceph-mgr: 2017-07-11 14:37:18.622657 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:19.438673 I | ceph-mgr: 2017-07-11 14:37:19.438570 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8421 10.233.124.0:0/2660618373' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:19.438774 I | ceph-mgr: 2017-07-11 14:37:19.438747 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:19.617344 I | ceph-mgr: 2017-07-11 14:37:19.615719 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:19.617478 I | ceph-mgr: 2017-07-11 14:37:19.615724 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:19.617530 I | ceph-mgr: 2017-07-11 14:37:19.615744 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:21.638432 I | ceph-mgr: 2017-07-11 14:37:21.637190 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:21.638614 I | ceph-mgr: 2017-07-11 14:37:21.638596 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:21.645526 I | ceph-mgr: 2017-07-11 14:37:21.645509 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:23.332973 I | ceph-mgr: 2017-07-11 14:37:23.332947 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8430 10.233.124.0:0/3257179938' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:23.333031 I | ceph-mgr: 2017-07-11 14:37:23.333018 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:23.650639 I | ceph-mgr: 2017-07-11 14:37:23.649224 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:23.650822 I | ceph-mgr: 2017-07-11 14:37:23.649234 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:23.650960 I | ceph-mgr: 2017-07-11 14:37:23.649283 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:24.171823 I | ceph-mgr: 2017-07-11 14:37:24.171746 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8555 10.233.124.5:0/3810012242' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:24.172011 I | ceph-mgr: 2017-07-11 14:37:24.171919 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:25.669248 I | ceph-mgr: 2017-07-11 14:37:25.652775 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:25.669662 I | ceph-mgr: 2017-07-11 14:37:25.652788 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:25.669691 I | ceph-mgr: 2017-07-11 14:37:25.652821 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:27.678303 I | ceph-mgr: 2017-07-11 14:37:27.676869 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:27.678517 I | ceph-mgr: 2017-07-11 14:37:27.676875 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:27.678619 I | ceph-mgr: 2017-07-11 14:37:27.676899 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:28.584626 I | ceph-mgr: 2017-07-11 14:37:28.584560 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8573 10.233.124.5:0/2084078329' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:28.584709 I | ceph-mgr: 2017-07-11 14:37:28.584580 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:29.488574 I | ceph-mgr: 2017-07-11 14:37:29.488499 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8442 10.233.124.0:0/2823913108' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:29.504071 I | ceph-mgr: 2017-07-11 14:37:29.488643 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:29.682817 I | ceph-mgr: 2017-07-11 14:37:29.680051 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:29.682958 I | ceph-mgr: 2017-07-11 14:37:29.680057 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:29.682979 I | ceph-mgr: 2017-07-11 14:37:29.680077 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:31.700430 I | ceph-mgr: 2017-07-11 14:37:31.700399 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:31.700505 I | ceph-mgr: 2017-07-11 14:37:31.700491 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:31.706517 I | ceph-mgr: 2017-07-11 14:37:31.700603 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:33.299924 I | ceph-mgr: 2017-07-11 14:37:33.299841 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8591 10.233.124.5:0/3753708386' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:33.299979 I | ceph-mgr: 2017-07-11 14:37:33.299860 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:33.724195 I | ceph-mgr: 2017-07-11 14:37:33.714061 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:33.724397 I | ceph-mgr: 2017-07-11 14:37:33.714072 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:33.724424 I | ceph-mgr: 2017-07-11 14:37:33.714112 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:34.247747 I | ceph-mgr: 2017-07-11 14:37:34.247673 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8597 10.233.124.5:0/2330299617' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:34.247836 I | ceph-mgr: 2017-07-11 14:37:34.247810 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:35.721182 I | ceph-mgr: 2017-07-11 14:37:35.719897 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:35.721256 I | ceph-mgr: 2017-07-11 14:37:35.719904 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:35.727044 I | ceph-mgr: 2017-07-11 14:37:35.719928 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:37.730339 I | ceph-mgr: 2017-07-11 14:37:37.728793 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:37.730546 I | ceph-mgr: 2017-07-11 14:37:37.728804 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:37.730645 I | ceph-mgr: 2017-07-11 14:37:37.728845 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:38.237224 I | ceph-mgr: 2017-07-11 14:37:38.237177 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8612 10.233.124.5:0/1660145697' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:38.237393 I | ceph-mgr: 2017-07-11 14:37:38.237306 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:39.057276 I | ceph-mgr: 2017-07-11 14:37:39.057174 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8618 10.233.124.5:0/4121120465' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:39.057374 I | ceph-mgr: 2017-07-11 14:37:39.057223 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:39.735817 I | ceph-mgr: 2017-07-11 14:37:39.734336 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:39.736024 I | ceph-mgr: 2017-07-11 14:37:39.734352 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:39.736051 I | ceph-mgr: 2017-07-11 14:37:39.734396 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:41.743673 I | ceph-mgr: 2017-07-11 14:37:41.742229 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:41.743764 I | ceph-mgr: 2017-07-11 14:37:41.742241 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:41.743813 I | ceph-mgr: 2017-07-11 14:37:41.742280 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:43.107376 I | ceph-mgr: 2017-07-11 14:37:43.107306 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8630 10.233.124.5:0/651844326' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:43.107440 I | ceph-mgr: 2017-07-11 14:37:43.107326 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:43.744139 I | ceph-mgr: 2017-07-11 14:37:43.744093 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:43.744246 I | ceph-mgr: 2017-07-11 14:37:43.744215 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:43.760302 I | ceph-mgr: 2017-07-11 14:37:43.760289 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:44.068804 I | ceph-mgr: 2017-07-11 14:37:44.068711 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8636 10.233.124.5:0/766161247' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:44.068920 I | ceph-mgr: 2017-07-11 14:37:44.068875 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:45.762034 I | ceph-mgr: 2017-07-11 14:37:45.761983 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:45.762108 I | ceph-mgr: 2017-07-11 14:37:45.762093 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:45.762185 I | ceph-mgr: 2017-07-11 14:37:45.762174 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:47.767330 I | ceph-mgr: 2017-07-11 14:37:47.766017 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:47.767387 I | ceph-mgr: 2017-07-11 14:37:47.766023 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:47.767403 I | ceph-mgr: 2017-07-11 14:37:47.766045 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:48.070163 I | ceph-mgr: 2017-07-11 14:37:48.070121 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8487 10.233.124.0:0/2752892553' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:48.070246 I | ceph-mgr: 2017-07-11 14:37:48.070222 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:48.926212 I | ceph-mgr: 2017-07-11 14:37:48.926123 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8490 10.233.124.0:0/3749596222' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:48.926311 I | ceph-mgr: 2017-07-11 14:37:48.926284 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:49.773445 I | ceph-mgr: 2017-07-11 14:37:49.772065 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:49.773516 I | ceph-mgr: 2017-07-11 14:37:49.772070 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:49.773533 I | ceph-mgr: 2017-07-11 14:37:49.772091 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:51.782043 I | ceph-mgr: 2017-07-11 14:37:51.781702 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:51.782115 I | ceph-mgr: 2017-07-11 14:37:51.781707 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:51.782132 I | ceph-mgr: 2017-07-11 14:37:51.781722 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:53.039208 I | ceph-mgr: 2017-07-11 14:37:53.039137 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8505 10.233.124.0:0/2386281427' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:53.039265 I | ceph-mgr: 2017-07-11 14:37:53.039162 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:53.799971 I | ceph-mgr: 2017-07-11 14:37:53.799937 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:53.800134 I | ceph-mgr: 2017-07-11 14:37:53.800118 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:53.802275 I | ceph-mgr: 2017-07-11 14:37:53.802259 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:53.839690 I | ceph-mgr: 2017-07-11 14:37:53.839590 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8660 10.233.124.5:0/3670358282' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:53.839765 I | ceph-mgr: 2017-07-11 14:37:53.839640 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:55.806819 I | ceph-mgr: 2017-07-11 14:37:55.806767 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:55.807047 I | ceph-mgr: 2017-07-11 14:37:55.807026 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:55.816574 I | ceph-mgr: 2017-07-11 14:37:55.816556 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:57.831382 I | ceph-mgr: 2017-07-11 14:37:57.821750 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:57.831593 I | ceph-mgr: 2017-07-11 14:37:57.821762 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:57.831623 I | ceph-mgr: 2017-07-11 14:37:57.821791 7f4cc3226700 0 mgr tick
- 2017-07-11 14:37:57.970016 I | ceph-mgr: 2017-07-11 14:37:57.969953 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8669 10.233.124.5:0/3447161343' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:57.978555 I | ceph-mgr: 2017-07-11 14:37:57.970121 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:58.805927 I | ceph-mgr: 2017-07-11 14:37:58.805898 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8523 10.233.124.0:0/1654561331' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:37:58.806157 I | ceph-mgr: 2017-07-11 14:37:58.806120 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:37:59.831441 I | ceph-mgr: 2017-07-11 14:37:59.829947 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:37:59.831597 I | ceph-mgr: 2017-07-11 14:37:59.829958 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:37:59.831641 I | ceph-mgr: 2017-07-11 14:37:59.829996 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:01.837775 I | ceph-mgr: 2017-07-11 14:38:01.837745 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:01.837863 I | ceph-mgr: 2017-07-11 14:38:01.837848 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:01.838231 I | ceph-mgr: 2017-07-11 14:38:01.837962 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:03.124221 I | ceph-mgr: 2017-07-11 14:38:03.124159 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8526 10.233.124.0:0/1738458199' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:03.126608 I | ceph-mgr: 2017-07-11 14:38:03.124180 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:03.862526 I | ceph-mgr: 2017-07-11 14:38:03.862491 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:03.862617 I | ceph-mgr: 2017-07-11 14:38:03.862603 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:03.862835 I | ceph-mgr: 2017-07-11 14:38:03.862820 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:04.050778 I | ceph-mgr: 2017-07-11 14:38:04.050699 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8687 10.233.124.5:0/2025284188' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:04.056494 I | ceph-mgr: 2017-07-11 14:38:04.050743 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:05.869625 I | ceph-mgr: 2017-07-11 14:38:05.869590 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:05.869715 I | ceph-mgr: 2017-07-11 14:38:05.869701 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:05.869929 I | ceph-mgr: 2017-07-11 14:38:05.869915 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:07.793776 I | ceph-mgr: 2017-07-11 14:38:07.793719 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8538 10.233.124.0:0/1113673522' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:07.793828 I | ceph-mgr: 2017-07-11 14:38:07.793739 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:07.873631 I | ceph-mgr: 2017-07-11 14:38:07.873609 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:07.873685 I | ceph-mgr: 2017-07-11 14:38:07.873670 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:07.873798 I | ceph-mgr: 2017-07-11 14:38:07.873783 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:08.703008 I | ceph-mgr: 2017-07-11 14:38:08.693377 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8702 10.233.124.5:0/2889791880' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:08.773041 I | ceph-mgr: 2017-07-11 14:38:08.705648 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:09.886612 I | ceph-mgr: 2017-07-11 14:38:09.877574 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:09.886690 I | ceph-mgr: 2017-07-11 14:38:09.877587 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:09.886707 I | ceph-mgr: 2017-07-11 14:38:09.877624 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:11.887996 I | ceph-mgr: 2017-07-11 14:38:11.879471 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:11.888073 I | ceph-mgr: 2017-07-11 14:38:11.879499 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:11.888090 I | ceph-mgr: 2017-07-11 14:38:11.879605 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:12.854709 I | ceph-mgr: 2017-07-11 14:38:12.854568 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8559 10.233.124.0:0/3239914181' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:12.854798 I | ceph-mgr: 2017-07-11 14:38:12.854607 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:13.742192 I | ceph-mgr: 2017-07-11 14:38:13.742105 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8565 10.233.124.0:0/1708926142' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:13.742324 I | ceph-mgr: 2017-07-11 14:38:13.742295 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:13.893856 I | ceph-mgr: 2017-07-11 14:38:13.884842 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:13.893938 I | ceph-mgr: 2017-07-11 14:38:13.884870 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:13.893956 I | ceph-mgr: 2017-07-11 14:38:13.884983 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:15.894251 I | ceph-mgr: 2017-07-11 14:38:15.894209 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:15.894340 I | ceph-mgr: 2017-07-11 14:38:15.894307 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:15.894731 I | ceph-mgr: 2017-07-11 14:38:15.894705 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:17.767193 I | ceph-mgr: 2017-07-11 14:38:17.767134 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8732 10.233.124.5:0/2351134744' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:17.767440 I | ceph-mgr: 2017-07-11 14:38:17.767412 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:17.896522 I | ceph-mgr: 2017-07-11 14:38:17.896499 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:17.896581 I | ceph-mgr: 2017-07-11 14:38:17.896567 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:17.896816 I | ceph-mgr: 2017-07-11 14:38:17.896689 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:18.645807 I | ceph-mgr: 2017-07-11 14:38:18.645634 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8580 10.233.124.0:0/288582593' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:18.646022 I | ceph-mgr: 2017-07-11 14:38:18.645955 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:19.899727 I | ceph-mgr: 2017-07-11 14:38:19.899687 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:19.906381 I | ceph-mgr: 2017-07-11 14:38:19.906327 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:19.916410 I | ceph-mgr: 2017-07-11 14:38:19.916392 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:21.961790 I | ceph-mgr: 2017-07-11 14:38:21.961757 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:21.961888 I | ceph-mgr: 2017-07-11 14:38:21.961875 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:21.962112 I | ceph-mgr: 2017-07-11 14:38:21.962096 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:22.704952 I | ceph-mgr: 2017-07-11 14:38:22.704912 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8747 10.233.124.5:0/557270766' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:22.705056 I | ceph-mgr: 2017-07-11 14:38:22.705041 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:23.553149 I | ceph-mgr: 2017-07-11 14:38:23.553122 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8753 10.233.124.5:0/763176903' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:23.555451 I | ceph-mgr: 2017-07-11 14:38:23.555433 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:23.983521 I | ceph-mgr: 2017-07-11 14:38:23.967344 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:23.983819 I | ceph-mgr: 2017-07-11 14:38:23.967350 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:23.983849 I | ceph-mgr: 2017-07-11 14:38:23.967371 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:25.990095 I | ceph-mgr: 2017-07-11 14:38:25.990033 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:25.990356 I | ceph-mgr: 2017-07-11 14:38:25.990203 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:25.990605 I | ceph-mgr: 2017-07-11 14:38:25.990590 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:27.631279 I | ceph-mgr: 2017-07-11 14:38:27.631223 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8771 10.233.124.5:0/3421612002' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:27.631350 I | ceph-mgr: 2017-07-11 14:38:27.631317 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:27.995732 I | ceph-mgr: 2017-07-11 14:38:27.995686 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:27.995837 I | ceph-mgr: 2017-07-11 14:38:27.995812 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:27.996136 I | ceph-mgr: 2017-07-11 14:38:27.996119 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:28.466244 I | ceph-mgr: 2017-07-11 14:38:28.466162 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8777 10.233.124.5:0/57758110' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:28.466342 I | ceph-mgr: 2017-07-11 14:38:28.466316 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:30.007221 I | ceph-mgr: 2017-07-11 14:38:30.007193 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:30.007296 I | ceph-mgr: 2017-07-11 14:38:30.007282 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:30.007649 I | ceph-mgr: 2017-07-11 14:38:30.007395 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:32.009292 I | ceph-mgr: 2017-07-11 14:38:32.009163 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:32.009371 I | ceph-mgr: 2017-07-11 14:38:32.009356 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:32.025072 I | ceph-mgr: 2017-07-11 14:38:32.025030 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:32.584905 I | ceph-mgr: 2017-07-11 14:38:32.584837 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8783 10.233.124.5:0/4228416477' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:32.584996 I | ceph-mgr: 2017-07-11 14:38:32.584861 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:33.515589 I | ceph-mgr: 2017-07-11 14:38:33.515487 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8616 10.233.124.0:0/1202463257' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:33.515664 I | ceph-mgr: 2017-07-11 14:38:33.515537 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:34.029935 I | ceph-mgr: 2017-07-11 14:38:34.029876 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:34.030171 I | ceph-mgr: 2017-07-11 14:38:34.030155 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:34.030288 I | ceph-mgr: 2017-07-11 14:38:34.030277 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:36.037949 I | ceph-mgr: 2017-07-11 14:38:36.037888 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:36.038185 I | ceph-mgr: 2017-07-11 14:38:36.038170 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:36.038363 I | ceph-mgr: 2017-07-11 14:38:36.038352 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:37.448458 I | ceph-mgr: 2017-07-11 14:38:37.448411 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8637 10.233.124.0:0/2627902650' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:37.448571 I | ceph-mgr: 2017-07-11 14:38:37.448544 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:38.049802 I | ceph-mgr: 2017-07-11 14:38:38.048266 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:38.055947 I | ceph-mgr: 2017-07-11 14:38:38.048276 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:38.056013 I | ceph-mgr: 2017-07-11 14:38:38.048300 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:38.312148 I | ceph-mgr: 2017-07-11 14:38:38.312082 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8795 10.233.124.5:0/483937305' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:38.312222 I | ceph-mgr: 2017-07-11 14:38:38.312197 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:40.053915 I | ceph-mgr: 2017-07-11 14:38:40.052524 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:40.054122 I | ceph-mgr: 2017-07-11 14:38:40.052529 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:40.054227 I | ceph-mgr: 2017-07-11 14:38:40.052550 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:42.137036 I | ceph-mgr: 2017-07-11 14:38:42.056842 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:42.137313 I | ceph-mgr: 2017-07-11 14:38:42.056848 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:42.137344 I | ceph-mgr: 2017-07-11 14:38:42.056883 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:42.275016 I | ceph-mgr: 2017-07-11 14:38:42.274634 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8649 10.233.124.0:0/2057758491' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:42.275095 I | ceph-mgr: 2017-07-11 14:38:42.275066 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:43.138849 I | ceph-mgr: 2017-07-11 14:38:43.138753 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5653 10.233.124.0:0/3212503414' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:43.138925 I | ceph-mgr: 2017-07-11 14:38:43.138805 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:44.158427 I | ceph-mgr: 2017-07-11 14:38:44.142992 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:44.158792 I | ceph-mgr: 2017-07-11 14:38:44.143003 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:44.158824 I | ceph-mgr: 2017-07-11 14:38:44.143033 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:46.166935 I | ceph-mgr: 2017-07-11 14:38:46.166560 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:46.167026 I | ceph-mgr: 2017-07-11 14:38:46.167009 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:46.167244 I | ceph-mgr: 2017-07-11 14:38:46.167229 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:47.419001 I | ceph-mgr: 2017-07-11 14:38:47.418934 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8664 10.233.124.0:0/2000628841' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:47.419064 I | ceph-mgr: 2017-07-11 14:38:47.418954 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:48.174132 I | ceph-mgr: 2017-07-11 14:38:48.174096 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:48.174211 I | ceph-mgr: 2017-07-11 14:38:48.174197 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:48.174421 I | ceph-mgr: 2017-07-11 14:38:48.174307 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:48.242281 I | ceph-mgr: 2017-07-11 14:38:48.242191 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8670 10.233.124.0:0/120654476' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:48.244546 I | ceph-mgr: 2017-07-11 14:38:48.242250 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:50.178610 I | ceph-mgr: 2017-07-11 14:38:50.178574 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:50.178785 I | ceph-mgr: 2017-07-11 14:38:50.178770 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:50.180452 I | ceph-mgr: 2017-07-11 14:38:50.180436 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:52.012705 I | ceph-mgr: 2017-07-11 14:38:52.012657 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8816 10.233.124.5:0/1588693158' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:52.012792 I | ceph-mgr: 2017-07-11 14:38:52.012768 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:52.190993 I | ceph-mgr: 2017-07-11 14:38:52.190935 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:52.191204 I | ceph-mgr: 2017-07-11 14:38:52.191089 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:52.191483 I | ceph-mgr: 2017-07-11 14:38:52.191468 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:52.907619 I | ceph-mgr: 2017-07-11 14:38:52.907495 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8819 10.233.124.5:0/1613218650' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:52.907680 I | ceph-mgr: 2017-07-11 14:38:52.907546 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:54.193539 I | ceph-mgr: 2017-07-11 14:38:54.193496 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:54.193632 I | ceph-mgr: 2017-07-11 14:38:54.193617 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:54.193859 I | ceph-mgr: 2017-07-11 14:38:54.193843 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:56.209523 I | ceph-mgr: 2017-07-11 14:38:56.206735 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:56.209595 I | ceph-mgr: 2017-07-11 14:38:56.206739 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:56.225103 I | ceph-mgr: 2017-07-11 14:38:56.206759 7f4cc3226700 0 mgr tick
- 2017-07-11 14:38:57.265930 I | ceph-mgr: 2017-07-11 14:38:57.265881 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8834 10.233.124.5:0/1309649837' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:57.267579 I | ceph-mgr: 2017-07-11 14:38:57.267551 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:58.120284 I | ceph-mgr: 2017-07-11 14:38:58.120252 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8840 10.233.124.5:0/2970492070' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:38:58.120526 I | ceph-mgr: 2017-07-11 14:38:58.120510 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:38:58.225135 I | ceph-mgr: 2017-07-11 14:38:58.208185 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:38:58.225236 I | ceph-mgr: 2017-07-11 14:38:58.208190 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:38:58.225255 I | ceph-mgr: 2017-07-11 14:38:58.208209 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:00.233690 I | ceph-mgr: 2017-07-11 14:39:00.233655 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:00.233765 I | ceph-mgr: 2017-07-11 14:39:00.233751 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:00.233985 I | ceph-mgr: 2017-07-11 14:39:00.233969 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:02.086851 I | ceph-mgr: 2017-07-11 14:39:02.086606 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8855 10.233.124.5:0/1639622238' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:02.086925 I | ceph-mgr: 2017-07-11 14:39:02.086656 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:02.243177 I | ceph-mgr: 2017-07-11 14:39:02.241471 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:02.249244 I | ceph-mgr: 2017-07-11 14:39:02.241479 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:02.249286 I | ceph-mgr: 2017-07-11 14:39:02.241504 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:03.362250 I | ceph-mgr: 2017-07-11 14:39:03.341946 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8861 10.233.124.5:0/1708384763' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:03.362294 I | ceph-mgr: 2017-07-11 14:39:03.341995 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:04.246301 I | ceph-mgr: 2017-07-11 14:39:04.244952 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:04.261772 I | ceph-mgr: 2017-07-11 14:39:04.244967 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:04.261811 I | ceph-mgr: 2017-07-11 14:39:04.244994 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:06.248059 I | ceph-mgr: 2017-07-11 14:39:06.246722 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:06.254751 I | ceph-mgr: 2017-07-11 14:39:06.246726 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:06.254790 I | ceph-mgr: 2017-07-11 14:39:06.246747 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:07.708719 I | ceph-mgr: 2017-07-11 14:39:07.708659 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8712 10.233.124.0:0/4294368393' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:07.708779 I | ceph-mgr: 2017-07-11 14:39:07.708679 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:08.248658 I | ceph-mgr: 2017-07-11 14:39:08.248597 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:08.248712 I | ceph-mgr: 2017-07-11 14:39:08.248601 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:08.248903 I | ceph-mgr: 2017-07-11 14:39:08.248887 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:08.606340 I | ceph-mgr: 2017-07-11 14:39:08.606242 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8876 10.233.124.5:0/2238679024' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:08.606430 I | ceph-mgr: 2017-07-11 14:39:08.606294 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:10.293679 I | ceph-mgr: 2017-07-11 14:39:10.293625 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:10.293770 I | ceph-mgr: 2017-07-11 14:39:10.293755 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:10.293959 I | ceph-mgr: 2017-07-11 14:39:10.293932 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:11.960826 I | ceph-mgr: 2017-07-11 14:39:11.960721 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5668 10.233.124.0:0/455003876' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:11.960899 I | ceph-mgr: 2017-07-11 14:39:11.960740 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:12.306744 I | ceph-mgr: 2017-07-11 14:39:12.297690 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:12.307359 I | ceph-mgr: 2017-07-11 14:39:12.297696 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:12.307400 I | ceph-mgr: 2017-07-11 14:39:12.297717 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:12.931908 I | ceph-mgr: 2017-07-11 14:39:12.931732 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8733 10.233.124.0:0/1524790894' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:12.931993 I | ceph-mgr: 2017-07-11 14:39:12.931798 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:14.317370 I | ceph-mgr: 2017-07-11 14:39:14.301693 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:14.317576 I | ceph-mgr: 2017-07-11 14:39:14.301707 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:14.317616 I | ceph-mgr: 2017-07-11 14:39:14.301803 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:16.334815 I | ceph-mgr: 2017-07-11 14:39:16.318683 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:16.334970 I | ceph-mgr: 2017-07-11 14:39:16.318688 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:16.335005 I | ceph-mgr: 2017-07-11 14:39:16.318710 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:16.989759 I | ceph-mgr: 2017-07-11 14:39:16.989731 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8745 10.233.124.0:0/2881437821' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:16.989860 I | ceph-mgr: 2017-07-11 14:39:16.989846 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:18.167337 I | ceph-mgr: 2017-07-11 14:39:18.167310 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5671 10.233.124.5:0/214729054' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:18.168938 I | ceph-mgr: 2017-07-11 14:39:18.168917 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:18.342528 I | ceph-mgr: 2017-07-11 14:39:18.341987 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:18.342694 I | ceph-mgr: 2017-07-11 14:39:18.342006 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:18.342832 I | ceph-mgr: 2017-07-11 14:39:18.342033 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:20.347677 I | ceph-mgr: 2017-07-11 14:39:20.346345 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:20.348203 I | ceph-mgr: 2017-07-11 14:39:20.346351 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:20.348303 I | ceph-mgr: 2017-07-11 14:39:20.346372 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:21.868038 I | ceph-mgr: 2017-07-11 14:39:21.868013 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8909 10.233.124.5:0/308228110' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:21.868182 I | ceph-mgr: 2017-07-11 14:39:21.868114 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:22.357319 I | ceph-mgr: 2017-07-11 14:39:22.347803 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:22.357394 I | ceph-mgr: 2017-07-11 14:39:22.347810 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:22.357410 I | ceph-mgr: 2017-07-11 14:39:22.347833 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:23.098173 I | ceph-mgr: 2017-07-11 14:39:23.098149 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8915 10.233.124.5:0/927542244' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:23.098394 I | ceph-mgr: 2017-07-11 14:39:23.098378 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:24.355821 I | ceph-mgr: 2017-07-11 14:39:24.355778 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:24.355891 I | ceph-mgr: 2017-07-11 14:39:24.355876 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:24.356105 I | ceph-mgr: 2017-07-11 14:39:24.355953 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:26.365379 I | ceph-mgr: 2017-07-11 14:39:26.358123 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:26.365488 I | ceph-mgr: 2017-07-11 14:39:26.358127 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:26.365516 I | ceph-mgr: 2017-07-11 14:39:26.358151 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:26.952221 I | ceph-mgr: 2017-07-11 14:39:26.952177 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8772 10.233.124.5:0/551391597' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:26.952408 I | ceph-mgr: 2017-07-11 14:39:26.952309 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:27.884843 I | ceph-mgr: 2017-07-11 14:39:27.884719 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8775 10.233.124.0:0/3846989990' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:27.884929 I | ceph-mgr: 2017-07-11 14:39:27.884779 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:28.380722 I | ceph-mgr: 2017-07-11 14:39:28.364612 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:28.380784 I | ceph-mgr: 2017-07-11 14:39:28.364617 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:28.380799 I | ceph-mgr: 2017-07-11 14:39:28.364640 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:30.382351 I | ceph-mgr: 2017-07-11 14:39:30.382304 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:30.384634 I | ceph-mgr: 2017-07-11 14:39:30.384618 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:30.384847 I | ceph-mgr: 2017-07-11 14:39:30.384827 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:31.603839 I | ceph-mgr: 2017-07-11 14:39:31.603776 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8948 10.233.124.5:0/1869640802' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:31.604614 I | ceph-mgr: 2017-07-11 14:39:31.603796 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:32.402567 I | ceph-mgr: 2017-07-11 14:39:32.402533 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:32.402747 I | ceph-mgr: 2017-07-11 14:39:32.402730 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:32.405585 I | ceph-mgr: 2017-07-11 14:39:32.405568 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:32.533801 I | ceph-mgr: 2017-07-11 14:39:32.533718 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8784 10.233.124.0:0/1050592868' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:32.533851 I | ceph-mgr: 2017-07-11 14:39:32.533764 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:34.426823 I | ceph-mgr: 2017-07-11 14:39:34.426782 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:34.426901 I | ceph-mgr: 2017-07-11 14:39:34.426887 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:34.427130 I | ceph-mgr: 2017-07-11 14:39:34.427114 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:36.434411 I | ceph-mgr: 2017-07-11 14:39:36.434378 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:36.434482 I | ceph-mgr: 2017-07-11 14:39:36.434468 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:36.434700 I | ceph-mgr: 2017-07-11 14:39:36.434584 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:36.638082 I | ceph-mgr: 2017-07-11 14:39:36.638041 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8796 10.233.124.5:0/3248232120' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:36.638158 I | ceph-mgr: 2017-07-11 14:39:36.638144 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:37.556170 I | ceph-mgr: 2017-07-11 14:39:37.556143 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8966 10.233.124.5:0/646634828' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:37.556344 I | ceph-mgr: 2017-07-11 14:39:37.556328 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:38.447776 I | ceph-mgr: 2017-07-11 14:39:38.437997 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:38.447933 I | ceph-mgr: 2017-07-11 14:39:38.438003 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:38.448071 I | ceph-mgr: 2017-07-11 14:39:38.438026 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:40.453552 I | ceph-mgr: 2017-07-11 14:39:40.451646 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:40.453733 I | ceph-mgr: 2017-07-11 14:39:40.451652 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:40.453768 I | ceph-mgr: 2017-07-11 14:39:40.451685 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:41.386528 I | ceph-mgr: 2017-07-11 14:39:41.386466 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8975 10.233.124.5:0/3721465905' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:41.386544 I | ceph-mgr: 2017-07-11 14:39:41.386485 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:42.346795 I | ceph-mgr: 2017-07-11 14:39:42.346764 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8817 10.233.124.0:0/3209121151' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:42.356561 I | ceph-mgr: 2017-07-11 14:39:42.349284 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:42.495388 I | ceph-mgr: 2017-07-11 14:39:42.478918 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:42.497145 I | ceph-mgr: 2017-07-11 14:39:42.478930 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:42.497192 I | ceph-mgr: 2017-07-11 14:39:42.478959 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:44.501456 I | ceph-mgr: 2017-07-11 14:39:44.501425 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:44.501529 I | ceph-mgr: 2017-07-11 14:39:44.501515 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:44.501977 I | ceph-mgr: 2017-07-11 14:39:44.501942 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:46.513167 I | ceph-mgr: 2017-07-11 14:39:46.510764 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:46.519221 I | ceph-mgr: 2017-07-11 14:39:46.519203 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:46.520969 I | ceph-mgr: 2017-07-11 14:39:46.520953 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:46.550697 I | ceph-mgr: 2017-07-11 14:39:46.550675 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8993 10.233.124.5:0/4032294932' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:46.551455 I | ceph-mgr: 2017-07-11 14:39:46.551430 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:47.468475 I | ceph-mgr: 2017-07-11 14:39:47.468365 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8999 10.233.124.5:0/613196188' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:47.468528 I | ceph-mgr: 2017-07-11 14:39:47.468413 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:48.554030 I | ceph-mgr: 2017-07-11 14:39:48.553924 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:48.554105 I | ceph-mgr: 2017-07-11 14:39:48.554090 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:48.554333 I | ceph-mgr: 2017-07-11 14:39:48.554316 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:50.555908 I | ceph-mgr: 2017-07-11 14:39:50.555870 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:50.555986 I | ceph-mgr: 2017-07-11 14:39:50.555971 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:50.556217 I | ceph-mgr: 2017-07-11 14:39:50.556201 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:51.238067 I | ceph-mgr: 2017-07-11 14:39:51.238006 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9011 10.233.124.5:0/3465317633' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:51.238141 I | ceph-mgr: 2017-07-11 14:39:51.238026 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:52.113542 I | ceph-mgr: 2017-07-11 14:39:52.113465 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9014 10.233.124.5:0/4000481299' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:52.113632 I | ceph-mgr: 2017-07-11 14:39:52.113605 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:52.577550 I | ceph-mgr: 2017-07-11 14:39:52.575936 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:52.577777 I | ceph-mgr: 2017-07-11 14:39:52.575938 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:52.577803 I | ceph-mgr: 2017-07-11 14:39:52.575956 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:54.577386 I | ceph-mgr: 2017-07-11 14:39:54.577347 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:54.577606 I | ceph-mgr: 2017-07-11 14:39:54.577590 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:54.580643 I | ceph-mgr: 2017-07-11 14:39:54.580626 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:56.639264 I | ceph-mgr: 2017-07-11 14:39:56.639219 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:56.639354 I | ceph-mgr: 2017-07-11 14:39:56.639340 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:56.639600 I | ceph-mgr: 2017-07-11 14:39:56.639584 7f4cc3226700 0 mgr tick
- 2017-07-11 14:39:56.721694 I | ceph-mgr: 2017-07-11 14:39:56.721587 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9029 10.233.124.5:0/3423313251' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:56.721758 I | ceph-mgr: 2017-07-11 14:39:56.721606 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:57.727216 I | ceph-mgr: 2017-07-11 14:39:57.727130 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8856 10.233.124.0:0/3555833184' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:39:57.727322 I | ceph-mgr: 2017-07-11 14:39:57.727293 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:39:58.669806 I | ceph-mgr: 2017-07-11 14:39:58.653192 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:39:58.669878 I | ceph-mgr: 2017-07-11 14:39:58.653204 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:39:58.669894 I | ceph-mgr: 2017-07-11 14:39:58.653237 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:00.678753 I | ceph-mgr: 2017-07-11 14:40:00.678694 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:00.679015 I | ceph-mgr: 2017-07-11 14:40:00.678863 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:00.679397 I | ceph-mgr: 2017-07-11 14:40:00.679381 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:01.283644 I | ceph-mgr: 2017-07-11 14:40:01.283537 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9041 10.233.124.5:0/2777647099' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:01.283706 I | ceph-mgr: 2017-07-11 14:40:01.283573 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:02.369854 I | ceph-mgr: 2017-07-11 14:40:02.369762 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8868 10.233.124.0:0/215698651' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:02.374113 I | ceph-mgr: 2017-07-11 14:40:02.369810 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:02.688572 I | ceph-mgr: 2017-07-11 14:40:02.687239 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:02.688628 I | ceph-mgr: 2017-07-11 14:40:02.687244 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:02.688644 I | ceph-mgr: 2017-07-11 14:40:02.687264 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:04.691354 I | ceph-mgr: 2017-07-11 14:40:04.690091 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:04.691412 I | ceph-mgr: 2017-07-11 14:40:04.690096 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:04.697211 I | ceph-mgr: 2017-07-11 14:40:04.690117 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:06.336753 I | ceph-mgr: 2017-07-11 14:40:06.336706 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9059 10.233.124.5:0/4165297752' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:06.336805 I | ceph-mgr: 2017-07-11 14:40:06.336780 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:06.698323 I | ceph-mgr: 2017-07-11 14:40:06.697233 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:06.698387 I | ceph-mgr: 2017-07-11 14:40:06.697238 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:06.698405 I | ceph-mgr: 2017-07-11 14:40:06.697258 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:07.257006 I | ceph-mgr: 2017-07-11 14:40:07.256904 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9065 10.233.124.5:0/47120331' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:07.257104 I | ceph-mgr: 2017-07-11 14:40:07.256956 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:08.699348 I | ceph-mgr: 2017-07-11 14:40:08.699315 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:08.699415 I | ceph-mgr: 2017-07-11 14:40:08.699401 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:08.699490 I | ceph-mgr: 2017-07-11 14:40:08.699480 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:10.712959 I | ceph-mgr: 2017-07-11 14:40:10.712833 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:10.713147 I | ceph-mgr: 2017-07-11 14:40:10.713059 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:10.713263 I | ceph-mgr: 2017-07-11 14:40:10.713248 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:11.103293 I | ceph-mgr: 2017-07-11 14:40:11.103242 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8892 10.233.124.0:0/3694085366' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:11.103454 I | ceph-mgr: 2017-07-11 14:40:11.103421 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:12.344070 I | ceph-mgr: 2017-07-11 14:40:12.343987 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9080 10.233.124.5:0/2949032447' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:12.344247 I | ceph-mgr: 2017-07-11 14:40:12.344164 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:12.715897 I | ceph-mgr: 2017-07-11 14:40:12.715848 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:12.715986 I | ceph-mgr: 2017-07-11 14:40:12.715969 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:12.716255 I | ceph-mgr: 2017-07-11 14:40:12.716058 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:14.735786 I | ceph-mgr: 2017-07-11 14:40:14.734454 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:14.742942 I | ceph-mgr: 2017-07-11 14:40:14.734458 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:14.743039 I | ceph-mgr: 2017-07-11 14:40:14.734478 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:16.108106 I | ceph-mgr: 2017-07-11 14:40:16.108049 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9092 10.233.124.5:0/1745451018' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:16.108213 I | ceph-mgr: 2017-07-11 14:40:16.108185 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:16.743934 I | ceph-mgr: 2017-07-11 14:40:16.740475 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:16.744143 I | ceph-mgr: 2017-07-11 14:40:16.740487 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:16.744170 I | ceph-mgr: 2017-07-11 14:40:16.740525 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:17.042985 I | ceph-mgr: 2017-07-11 14:40:17.042885 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8907 10.233.124.0:0/2303366350' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:17.043048 I | ceph-mgr: 2017-07-11 14:40:17.042933 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:18.752049 I | ceph-mgr: 2017-07-11 14:40:18.742377 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:18.752454 I | ceph-mgr: 2017-07-11 14:40:18.742389 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:18.752483 I | ceph-mgr: 2017-07-11 14:40:18.742418 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:20.748029 I | ceph-mgr: 2017-07-11 14:40:20.746608 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:20.748504 I | ceph-mgr: 2017-07-11 14:40:20.746619 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:20.748535 I | ceph-mgr: 2017-07-11 14:40:20.746660 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:20.971643 I | ceph-mgr: 2017-07-11 14:40:20.971602 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9107 10.233.124.5:0/972620022' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:20.974382 I | ceph-mgr: 2017-07-11 14:40:20.974354 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:21.961809 I | ceph-mgr: 2017-07-11 14:40:21.961731 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8925 10.233.124.0:0/2196130819' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:21.961987 I | ceph-mgr: 2017-07-11 14:40:21.961908 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:22.757041 I | ceph-mgr: 2017-07-11 14:40:22.754872 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:22.757249 I | ceph-mgr: 2017-07-11 14:40:22.754885 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:22.757278 I | ceph-mgr: 2017-07-11 14:40:22.754926 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:24.759041 I | ceph-mgr: 2017-07-11 14:40:24.759002 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:24.759132 I | ceph-mgr: 2017-07-11 14:40:24.759118 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:24.759565 I | ceph-mgr: 2017-07-11 14:40:24.759548 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:26.073257 I | ceph-mgr: 2017-07-11 14:40:26.073195 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9125 10.233.124.5:0/340054178' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:26.073333 I | ceph-mgr: 2017-07-11 14:40:26.073216 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:26.761560 I | ceph-mgr: 2017-07-11 14:40:26.761100 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:26.761651 I | ceph-mgr: 2017-07-11 14:40:26.761635 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:26.761881 I | ceph-mgr: 2017-07-11 14:40:26.761723 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:26.875970 I | ceph-mgr: 2017-07-11 14:40:26.875891 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9128 10.233.124.5:0/576211230' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:26.876065 I | ceph-mgr: 2017-07-11 14:40:26.876038 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:28.765753 I | ceph-mgr: 2017-07-11 14:40:28.765680 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:28.766013 I | ceph-mgr: 2017-07-11 14:40:28.765863 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:28.766286 I | ceph-mgr: 2017-07-11 14:40:28.766261 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:30.775646 I | ceph-mgr: 2017-07-11 14:40:30.768760 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:30.775727 I | ceph-mgr: 2017-07-11 14:40:30.775711 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:30.776508 I | ceph-mgr: 2017-07-11 14:40:30.776492 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:31.224056 I | ceph-mgr: 2017-07-11 14:40:31.223996 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9149 10.233.124.5:0/4223325326' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:31.224121 I | ceph-mgr: 2017-07-11 14:40:31.224016 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:32.345437 I | ceph-mgr: 2017-07-11 14:40:32.345360 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8940 10.233.124.0:0/3867348306' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:32.348283 I | ceph-mgr: 2017-07-11 14:40:32.348253 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:32.780761 I | ceph-mgr: 2017-07-11 14:40:32.780728 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:32.780833 I | ceph-mgr: 2017-07-11 14:40:32.780819 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:32.781050 I | ceph-mgr: 2017-07-11 14:40:32.780893 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:34.792357 I | ceph-mgr: 2017-07-11 14:40:34.791064 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:34.792410 I | ceph-mgr: 2017-07-11 14:40:34.791074 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:34.792424 I | ceph-mgr: 2017-07-11 14:40:34.791113 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:35.804842 I | ceph-mgr: 2017-07-11 14:40:35.796332 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9164 10.233.124.5:0/569732397' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:35.804947 I | ceph-mgr: 2017-07-11 14:40:35.804932 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:36.752501 I | ceph-mgr: 2017-07-11 14:40:36.752460 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8961 10.233.124.5:0/1790977035' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:36.753389 I | ceph-mgr: 2017-07-11 14:40:36.753355 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:36.810507 I | ceph-mgr: 2017-07-11 14:40:36.808870 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:36.810552 I | ceph-mgr: 2017-07-11 14:40:36.808875 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:36.810569 I | ceph-mgr: 2017-07-11 14:40:36.808893 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:38.811619 I | ceph-mgr: 2017-07-11 14:40:38.811569 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:38.811709 I | ceph-mgr: 2017-07-11 14:40:38.811682 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:38.811794 I | ceph-mgr: 2017-07-11 14:40:38.811783 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:40.846665 I | ceph-mgr: 2017-07-11 14:40:40.830871 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:40.846737 I | ceph-mgr: 2017-07-11 14:40:40.830878 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:40.846754 I | ceph-mgr: 2017-07-11 14:40:40.830901 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:41.182819 I | ceph-mgr: 2017-07-11 14:40:41.182759 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.8973 10.233.124.0:0/2293406817' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:41.182878 I | ceph-mgr: 2017-07-11 14:40:41.182778 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:42.011773 I | ceph-mgr: 2017-07-11 14:40:42.011686 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9182 10.233.124.5:0/736502592' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:42.011885 I | ceph-mgr: 2017-07-11 14:40:42.011857 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:42.853265 I | ceph-mgr: 2017-07-11 14:40:42.853215 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:42.853359 I | ceph-mgr: 2017-07-11 14:40:42.853344 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:42.853610 I | ceph-mgr: 2017-07-11 14:40:42.853594 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:44.856633 I | ceph-mgr: 2017-07-11 14:40:44.856600 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:44.856721 I | ceph-mgr: 2017-07-11 14:40:44.856706 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:44.856953 I | ceph-mgr: 2017-07-11 14:40:44.856937 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:45.685897 I | ceph-mgr: 2017-07-11 14:40:45.685814 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9194 10.233.124.5:0/2711550897' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:45.686108 I | ceph-mgr: 2017-07-11 14:40:45.686036 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:46.774368 I | ceph-mgr: 2017-07-11 14:40:46.774292 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5755 10.233.124.0:0/2285728813' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:46.774468 I | ceph-mgr: 2017-07-11 14:40:46.774441 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:46.874266 I | ceph-mgr: 2017-07-11 14:40:46.871013 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:46.874442 I | ceph-mgr: 2017-07-11 14:40:46.871021 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:46.874481 I | ceph-mgr: 2017-07-11 14:40:46.871044 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:48.889578 I | ceph-mgr: 2017-07-11 14:40:48.872664 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:48.889891 I | ceph-mgr: 2017-07-11 14:40:48.872669 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:48.889921 I | ceph-mgr: 2017-07-11 14:40:48.872692 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:50.503784 I | ceph-mgr: 2017-07-11 14:40:50.503724 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9203 10.233.124.5:0/1109552073' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:50.506001 I | ceph-mgr: 2017-07-11 14:40:50.503744 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:50.894115 I | ceph-mgr: 2017-07-11 14:40:50.894079 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:50.894298 I | ceph-mgr: 2017-07-11 14:40:50.894281 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:50.895266 I | ceph-mgr: 2017-07-11 14:40:50.895228 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:51.373182 I | ceph-mgr: 2017-07-11 14:40:51.373092 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9209 10.233.124.5:0/2912534106' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:51.375672 I | ceph-mgr: 2017-07-11 14:40:51.373140 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:52.905110 I | ceph-mgr: 2017-07-11 14:40:52.904928 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:52.905291 I | ceph-mgr: 2017-07-11 14:40:52.905213 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:52.905457 I | ceph-mgr: 2017-07-11 14:40:52.905441 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:54.911871 I | ceph-mgr: 2017-07-11 14:40:54.911825 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:54.912039 I | ceph-mgr: 2017-07-11 14:40:54.911964 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:54.912279 I | ceph-mgr: 2017-07-11 14:40:54.912264 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:55.364045 I | ceph-mgr: 2017-07-11 14:40:55.363967 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9221 10.233.124.5:0/2220392725' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:55.364118 I | ceph-mgr: 2017-07-11 14:40:55.363986 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:56.458698 I | ceph-mgr: 2017-07-11 14:40:56.458553 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9018 10.233.124.0:0/1290927650' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:40:56.459820 I | ceph-mgr: 2017-07-11 14:40:56.458658 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:40:56.939859 I | ceph-mgr: 2017-07-11 14:40:56.939820 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:56.939933 I | ceph-mgr: 2017-07-11 14:40:56.939919 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:56.940107 I | ceph-mgr: 2017-07-11 14:40:56.940092 7f4cc3226700 0 mgr tick
- 2017-07-11 14:40:58.968241 I | ceph-mgr: 2017-07-11 14:40:58.959889 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:40:58.968345 I | ceph-mgr: 2017-07-11 14:40:58.959895 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:40:58.968556 I | ceph-mgr: 2017-07-11 14:40:58.968539 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:00.476473 I | ceph-mgr: 2017-07-11 14:41:00.476407 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9233 10.233.124.5:0/3100098548' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:00.476534 I | ceph-mgr: 2017-07-11 14:41:00.476427 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:00.986462 I | ceph-mgr: 2017-07-11 14:41:00.986438 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:00.986523 I | ceph-mgr: 2017-07-11 14:41:00.986509 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:00.986746 I | ceph-mgr: 2017-07-11 14:41:00.986628 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:01.327186 I | ceph-mgr: 2017-07-11 14:41:01.327082 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9236 10.233.124.5:0/3599391040' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:01.327202 I | ceph-mgr: 2017-07-11 14:41:01.327129 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:02.994904 I | ceph-mgr: 2017-07-11 14:41:02.993297 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:02.994991 I | ceph-mgr: 2017-07-11 14:41:02.994976 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:02.995236 I | ceph-mgr: 2017-07-11 14:41:02.995220 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:05.000739 I | ceph-mgr: 2017-07-11 14:41:05.000676 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:05.000978 I | ceph-mgr: 2017-07-11 14:41:05.000963 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:05.003623 I | ceph-mgr: 2017-07-11 14:41:05.003607 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:05.332902 I | ceph-mgr: 2017-07-11 14:41:05.332842 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9257 10.233.124.5:0/771513857' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:05.332998 I | ceph-mgr: 2017-07-11 14:41:05.332861 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:06.324437 I | ceph-mgr: 2017-07-11 14:41:06.324352 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9045 10.233.124.0:0/3733640194' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:06.324526 I | ceph-mgr: 2017-07-11 14:41:06.324499 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:07.027531 I | ceph-mgr: 2017-07-11 14:41:07.027486 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:07.027614 I | ceph-mgr: 2017-07-11 14:41:07.027598 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:07.028054 I | ceph-mgr: 2017-07-11 14:41:07.028036 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:09.040885 I | ceph-mgr: 2017-07-11 14:41:09.040657 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:09.041317 I | ceph-mgr: 2017-07-11 14:41:09.040666 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:09.041348 I | ceph-mgr: 2017-07-11 14:41:09.040691 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:10.232443 I | ceph-mgr: 2017-07-11 14:41:10.232413 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9275 10.233.124.5:0/3669035421' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:10.232604 I | ceph-mgr: 2017-07-11 14:41:10.232537 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:11.039040 I | ceph-mgr: 2017-07-11 14:41:11.039012 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9281 10.233.124.5:0/2594356836' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:11.039215 I | ceph-mgr: 2017-07-11 14:41:11.039199 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:11.048347 I | ceph-mgr: 2017-07-11 14:41:11.048245 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:11.048429 I | ceph-mgr: 2017-07-11 14:41:11.048255 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:11.048823 I | ceph-mgr: 2017-07-11 14:41:11.048533 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:13.051389 I | ceph-mgr: 2017-07-11 14:41:13.051348 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:13.051486 I | ceph-mgr: 2017-07-11 14:41:13.051472 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:13.051706 I | ceph-mgr: 2017-07-11 14:41:13.051691 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:15.057412 I | ceph-mgr: 2017-07-11 14:41:15.057382 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:15.057493 I | ceph-mgr: 2017-07-11 14:41:15.057480 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:15.057701 I | ceph-mgr: 2017-07-11 14:41:15.057589 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:15.079094 I | ceph-mgr: 2017-07-11 14:41:15.079077 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9293 10.233.124.5:0/2237726290' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:15.079167 I | ceph-mgr: 2017-07-11 14:41:15.079153 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:16.190335 I | ceph-mgr: 2017-07-11 14:41:16.190302 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9066 10.233.124.0:0/852729169' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:16.191076 I | ceph-mgr: 2017-07-11 14:41:16.191060 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:17.074289 I | ceph-mgr: 2017-07-11 14:41:17.074224 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:17.074539 I | ceph-mgr: 2017-07-11 14:41:17.074394 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:17.075006 I | ceph-mgr: 2017-07-11 14:41:17.074990 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:19.107985 I | ceph-mgr: 2017-07-11 14:41:19.080063 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:19.108064 I | ceph-mgr: 2017-07-11 14:41:19.081726 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:19.108081 I | ceph-mgr: 2017-07-11 14:41:19.081753 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:20.176822 I | ceph-mgr: 2017-07-11 14:41:20.176757 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9311 10.233.124.5:0/2331453248' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:20.176894 I | ceph-mgr: 2017-07-11 14:41:20.176778 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:21.024614 I | ceph-mgr: 2017-07-11 14:41:21.024520 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9320 10.233.124.5:0/4144153186' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:21.032678 I | ceph-mgr: 2017-07-11 14:41:21.032647 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:21.111606 I | ceph-mgr: 2017-07-11 14:41:21.111379 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:21.111670 I | ceph-mgr: 2017-07-11 14:41:21.111655 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:21.111879 I | ceph-mgr: 2017-07-11 14:41:21.111768 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:23.117313 I | ceph-mgr: 2017-07-11 14:41:23.117268 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:23.117391 I | ceph-mgr: 2017-07-11 14:41:23.117377 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:23.117651 I | ceph-mgr: 2017-07-11 14:41:23.117627 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:24.977582 I | ceph-mgr: 2017-07-11 14:41:24.977479 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9084 10.233.124.0:0/457574570' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:24.977673 I | ceph-mgr: 2017-07-11 14:41:24.977501 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:25.127712 I | ceph-mgr: 2017-07-11 14:41:25.127671 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:25.127790 I | ceph-mgr: 2017-07-11 14:41:25.127775 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:25.128019 I | ceph-mgr: 2017-07-11 14:41:25.128003 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:25.945290 I | ceph-mgr: 2017-07-11 14:41:25.945213 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9335 10.233.124.5:0/3347369271' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:25.945504 I | ceph-mgr: 2017-07-11 14:41:25.945450 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:27.145308 I | ceph-mgr: 2017-07-11 14:41:27.145264 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:27.145481 I | ceph-mgr: 2017-07-11 14:41:27.145465 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:27.154578 I | ceph-mgr: 2017-07-11 14:41:27.154558 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:29.161652 I | ceph-mgr: 2017-07-11 14:41:29.161612 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:29.161724 I | ceph-mgr: 2017-07-11 14:41:29.161710 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:29.161977 I | ceph-mgr: 2017-07-11 14:41:29.161951 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:29.973381 I | ceph-mgr: 2017-07-11 14:41:29.973315 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9096 10.233.124.5:0/3258075665' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:29.975101 I | ceph-mgr: 2017-07-11 14:41:29.973335 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:30.791278 I | ceph-mgr: 2017-07-11 14:41:30.791192 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9353 10.233.124.5:0/2003804634' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:30.791333 I | ceph-mgr: 2017-07-11 14:41:30.791237 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:31.179063 I | ceph-mgr: 2017-07-11 14:41:31.178992 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:31.197548 I | ceph-mgr: 2017-07-11 14:41:31.195199 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:31.197579 I | ceph-mgr: 2017-07-11 14:41:31.195308 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:33.199538 I | ceph-mgr: 2017-07-11 14:41:33.198269 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:33.201068 I | ceph-mgr: 2017-07-11 14:41:33.198274 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:33.201195 I | ceph-mgr: 2017-07-11 14:41:33.198295 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:34.938272 I | ceph-mgr: 2017-07-11 14:41:34.938235 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5794 10.233.124.0:0/4184023559' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:34.938366 I | ceph-mgr: 2017-07-11 14:41:34.938352 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:35.202206 I | ceph-mgr: 2017-07-11 14:41:35.200850 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:35.208746 I | ceph-mgr: 2017-07-11 14:41:35.200854 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:35.208780 I | ceph-mgr: 2017-07-11 14:41:35.200873 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:35.978034 I | ceph-mgr: 2017-07-11 14:41:35.977961 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9105 10.233.124.0:0/2904449479' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:35.978121 I | ceph-mgr: 2017-07-11 14:41:35.978095 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:37.301064 I | ceph-mgr: 2017-07-11 14:41:37.284302 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:37.301133 I | ceph-mgr: 2017-07-11 14:41:37.284312 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:37.301149 I | ceph-mgr: 2017-07-11 14:41:37.284339 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:39.307916 I | ceph-mgr: 2017-07-11 14:41:39.307872 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:39.307993 I | ceph-mgr: 2017-07-11 14:41:39.307980 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:39.308240 I | ceph-mgr: 2017-07-11 14:41:39.308226 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:41.310521 I | ceph-mgr: 2017-07-11 14:41:41.310485 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:41.310609 I | ceph-mgr: 2017-07-11 14:41:41.310595 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:41.310831 I | ceph-mgr: 2017-07-11 14:41:41.310816 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:41.617403 I | ceph-mgr: 2017-07-11 14:41:41.617336 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9123 10.233.124.0:0/295367023' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:41.618493 I | ceph-mgr: 2017-07-11 14:41:41.617356 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:42.544257 I | ceph-mgr: 2017-07-11 14:41:42.544172 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9129 10.233.124.0:0/311472999' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:42.544432 I | ceph-mgr: 2017-07-11 14:41:42.544342 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:43.321998 I | ceph-mgr: 2017-07-11 14:41:43.320546 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:43.322097 I | ceph-mgr: 2017-07-11 14:41:43.320560 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:43.322174 I | ceph-mgr: 2017-07-11 14:41:43.320596 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:45.327939 I | ceph-mgr: 2017-07-11 14:41:45.326064 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:45.327994 I | ceph-mgr: 2017-07-11 14:41:45.326069 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:45.328010 I | ceph-mgr: 2017-07-11 14:41:45.326089 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:46.995131 I | ceph-mgr: 2017-07-11 14:41:46.995065 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9144 10.233.124.0:0/627235258' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:46.995189 I | ceph-mgr: 2017-07-11 14:41:46.995087 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:47.335630 I | ceph-mgr: 2017-07-11 14:41:47.335600 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:47.335714 I | ceph-mgr: 2017-07-11 14:41:47.335699 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:47.335794 I | ceph-mgr: 2017-07-11 14:41:47.335773 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:48.076004 I | ceph-mgr: 2017-07-11 14:41:48.075911 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9398 10.233.124.5:0/3351917634' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:48.076101 I | ceph-mgr: 2017-07-11 14:41:48.076073 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:49.341330 I | ceph-mgr: 2017-07-11 14:41:49.339786 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:49.348946 I | ceph-mgr: 2017-07-11 14:41:49.339805 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:49.348981 I | ceph-mgr: 2017-07-11 14:41:49.339832 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:51.347913 I | ceph-mgr: 2017-07-11 14:41:51.347688 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:51.348057 I | ceph-mgr: 2017-07-11 14:41:51.347699 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:51.348119 I | ceph-mgr: 2017-07-11 14:41:51.347749 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:51.826536 I | ceph-mgr: 2017-07-11 14:41:51.826490 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9410 10.233.124.5:0/1739782208' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:51.827828 I | ceph-mgr: 2017-07-11 14:41:51.827795 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:52.803530 I | ceph-mgr: 2017-07-11 14:41:52.803445 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9413 10.233.124.5:0/3561209691' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:52.803624 I | ceph-mgr: 2017-07-11 14:41:52.803597 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:53.355053 I | ceph-mgr: 2017-07-11 14:41:53.351277 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:53.355280 I | ceph-mgr: 2017-07-11 14:41:53.351288 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:53.355308 I | ceph-mgr: 2017-07-11 14:41:53.351327 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:55.369557 I | ceph-mgr: 2017-07-11 14:41:55.367747 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:55.369765 I | ceph-mgr: 2017-07-11 14:41:55.367758 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:55.369793 I | ceph-mgr: 2017-07-11 14:41:55.367789 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:56.668455 I | ceph-mgr: 2017-07-11 14:41:56.668395 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9428 10.233.124.5:0/1065242512' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:56.668628 I | ceph-mgr: 2017-07-11 14:41:56.668536 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:57.391659 I | ceph-mgr: 2017-07-11 14:41:57.372027 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:57.391736 I | ceph-mgr: 2017-07-11 14:41:57.372032 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:57.391752 I | ceph-mgr: 2017-07-11 14:41:57.372053 7f4cc3226700 0 mgr tick
- 2017-07-11 14:41:57.596025 I | ceph-mgr: 2017-07-11 14:41:57.595933 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9437 10.233.124.5:0/2529548738' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:41:57.598594 I | ceph-mgr: 2017-07-11 14:41:57.598544 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:41:59.378653 I | ceph-mgr: 2017-07-11 14:41:59.375428 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:41:59.378716 I | ceph-mgr: 2017-07-11 14:41:59.375443 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:41:59.378743 I | ceph-mgr: 2017-07-11 14:41:59.375487 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:01.382363 I | ceph-mgr: 2017-07-11 14:42:01.382301 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:01.384437 I | ceph-mgr: 2017-07-11 14:42:01.384420 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:01.384520 I | ceph-mgr: 2017-07-11 14:42:01.384510 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:01.501269 I | ceph-mgr: 2017-07-11 14:42:01.501182 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9449 10.233.124.5:0/1280673629' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:01.501343 I | ceph-mgr: 2017-07-11 14:42:01.501207 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:02.447706 I | ceph-mgr: 2017-07-11 14:42:02.447190 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9452 10.233.124.5:0/2029625743' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:02.447778 I | ceph-mgr: 2017-07-11 14:42:02.447237 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:03.389889 I | ceph-mgr: 2017-07-11 14:42:03.389848 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:03.389966 I | ceph-mgr: 2017-07-11 14:42:03.389952 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:03.390039 I | ceph-mgr: 2017-07-11 14:42:03.390029 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:05.411319 I | ceph-mgr: 2017-07-11 14:42:05.408356 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:05.411419 I | ceph-mgr: 2017-07-11 14:42:05.411402 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:05.411679 I | ceph-mgr: 2017-07-11 14:42:05.411575 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:06.417843 I | ceph-mgr: 2017-07-11 14:42:06.417774 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9458 10.233.124.5:0/352041686' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:06.417901 I | ceph-mgr: 2017-07-11 14:42:06.417794 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:07.433037 I | ceph-mgr: 2017-07-11 14:42:07.433006 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:07.433107 I | ceph-mgr: 2017-07-11 14:42:07.433093 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:07.433334 I | ceph-mgr: 2017-07-11 14:42:07.433211 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:07.801099 I | ceph-mgr: 2017-07-11 14:42:07.801022 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5827 10.233.124.0:0/1929224854' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:07.801148 I | ceph-mgr: 2017-07-11 14:42:07.801067 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:09.449055 I | ceph-mgr: 2017-07-11 14:42:09.449018 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:09.449129 I | ceph-mgr: 2017-07-11 14:42:09.449116 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:09.449347 I | ceph-mgr: 2017-07-11 14:42:09.449233 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:11.456774 I | ceph-mgr: 2017-07-11 14:42:11.456721 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:11.456849 I | ceph-mgr: 2017-07-11 14:42:11.456835 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:11.457089 I | ceph-mgr: 2017-07-11 14:42:11.457074 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:11.687253 I | ceph-mgr: 2017-07-11 14:42:11.687189 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9470 10.233.124.5:0/2092907641' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:11.693094 I | ceph-mgr: 2017-07-11 14:42:11.687210 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:12.781903 I | ceph-mgr: 2017-07-11 14:42:12.781870 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9222 10.233.124.0:0/2518907060' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:12.785691 I | ceph-mgr: 2017-07-11 14:42:12.782124 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:13.467094 I | ceph-mgr: 2017-07-11 14:42:13.465785 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:13.473257 I | ceph-mgr: 2017-07-11 14:42:13.465795 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:13.473292 I | ceph-mgr: 2017-07-11 14:42:13.465820 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:15.469803 I | ceph-mgr: 2017-07-11 14:42:15.467142 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:15.469861 I | ceph-mgr: 2017-07-11 14:42:15.467155 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:15.469877 I | ceph-mgr: 2017-07-11 14:42:15.467196 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:16.269444 I | ceph-mgr: 2017-07-11 14:42:16.269382 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9485 10.233.124.5:0/3696964975' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:16.269502 I | ceph-mgr: 2017-07-11 14:42:16.269401 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:17.165989 I | ceph-mgr: 2017-07-11 14:42:17.165890 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9240 10.233.124.0:0/2595358950' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:17.166053 I | ceph-mgr: 2017-07-11 14:42:17.165944 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:17.478170 I | ceph-mgr: 2017-07-11 14:42:17.475530 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:17.478225 I | ceph-mgr: 2017-07-11 14:42:17.475541 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:17.478241 I | ceph-mgr: 2017-07-11 14:42:17.475579 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:19.484353 I | ceph-mgr: 2017-07-11 14:42:19.484315 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:19.484432 I | ceph-mgr: 2017-07-11 14:42:19.484418 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:19.484504 I | ceph-mgr: 2017-07-11 14:42:19.484494 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:21.100144 I | ceph-mgr: 2017-07-11 14:42:21.097521 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9255 10.233.124.0:0/1623004089' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:21.107299 I | ceph-mgr: 2017-07-11 14:42:21.107262 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:21.487670 I | ceph-mgr: 2017-07-11 14:42:21.487645 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:21.487699 I | ceph-mgr: 2017-07-11 14:42:21.487687 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:21.487799 I | ceph-mgr: 2017-07-11 14:42:21.487730 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:21.940491 I | ceph-mgr: 2017-07-11 14:42:21.940407 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9503 10.233.124.5:0/793789074' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:21.940570 I | ceph-mgr: 2017-07-11 14:42:21.940545 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:23.503379 I | ceph-mgr: 2017-07-11 14:42:23.503346 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:23.514778 I | ceph-mgr: 2017-07-11 14:42:23.513819 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:23.514997 I | ceph-mgr: 2017-07-11 14:42:23.514962 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:25.524492 I | ceph-mgr: 2017-07-11 14:42:25.524387 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:25.524584 I | ceph-mgr: 2017-07-11 14:42:25.524568 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:25.524819 I | ceph-mgr: 2017-07-11 14:42:25.524804 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:26.120270 I | ceph-mgr: 2017-07-11 14:42:26.120225 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9270 10.233.124.5:0/3065556260' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:26.123196 I | ceph-mgr: 2017-07-11 14:42:26.123157 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:27.041091 I | ceph-mgr: 2017-07-11 14:42:27.041017 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9276 10.233.124.0:0/545235362' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:27.041187 I | ceph-mgr: 2017-07-11 14:42:27.041160 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:27.526588 I | ceph-mgr: 2017-07-11 14:42:27.526542 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:27.526680 I | ceph-mgr: 2017-07-11 14:42:27.526665 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:27.526935 I | ceph-mgr: 2017-07-11 14:42:27.526919 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:29.547867 I | ceph-mgr: 2017-07-11 14:42:29.547833 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:29.564995 I | ceph-mgr: 2017-07-11 14:42:29.547924 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:29.565143 I | ceph-mgr: 2017-07-11 14:42:29.563284 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:31.084537 I | ceph-mgr: 2017-07-11 14:42:31.084472 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9524 10.233.124.5:0/3008071619' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:31.084602 I | ceph-mgr: 2017-07-11 14:42:31.084494 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:31.577908 I | ceph-mgr: 2017-07-11 14:42:31.567834 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:31.587216 I | ceph-mgr: 2017-07-11 14:42:31.567839 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:31.587311 I | ceph-mgr: 2017-07-11 14:42:31.567862 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:31.899994 I | ceph-mgr: 2017-07-11 14:42:31.899925 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9530 10.233.124.5:0/4203560281' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:31.900079 I | ceph-mgr: 2017-07-11 14:42:31.900053 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:33.574569 I | ceph-mgr: 2017-07-11 14:42:33.574222 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:33.574646 I | ceph-mgr: 2017-07-11 14:42:33.574629 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:33.574833 I | ceph-mgr: 2017-07-11 14:42:33.574817 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:35.581531 I | ceph-mgr: 2017-07-11 14:42:35.581480 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:35.581640 I | ceph-mgr: 2017-07-11 14:42:35.581626 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:35.581848 I | ceph-mgr: 2017-07-11 14:42:35.581832 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:36.225468 I | ceph-mgr: 2017-07-11 14:42:36.225421 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9303 10.233.124.0:0/4164118607' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:36.225569 I | ceph-mgr: 2017-07-11 14:42:36.225536 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:37.104566 I | ceph-mgr: 2017-07-11 14:42:37.104492 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9539 10.233.124.5:0/3977287376' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:37.104658 I | ceph-mgr: 2017-07-11 14:42:37.104632 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:37.590406 I | ceph-mgr: 2017-07-11 14:42:37.590306 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:37.590485 I | ceph-mgr: 2017-07-11 14:42:37.590470 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:37.590718 I | ceph-mgr: 2017-07-11 14:42:37.590702 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:39.597759 I | ceph-mgr: 2017-07-11 14:42:39.597718 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:39.597842 I | ceph-mgr: 2017-07-11 14:42:39.597828 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:39.598106 I | ceph-mgr: 2017-07-11 14:42:39.598089 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:40.775851 I | ceph-mgr: 2017-07-11 14:42:40.775764 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9560 10.233.124.5:0/2595864991' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:40.775928 I | ceph-mgr: 2017-07-11 14:42:40.775784 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:41.621223 I | ceph-mgr: 2017-07-11 14:42:41.621175 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:41.621447 I | ceph-mgr: 2017-07-11 14:42:41.621431 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:41.622201 I | ceph-mgr: 2017-07-11 14:42:41.622184 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:41.681925 I | ceph-mgr: 2017-07-11 14:42:41.681832 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9566 10.233.124.5:0/1154471133' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:41.681996 I | ceph-mgr: 2017-07-11 14:42:41.681884 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:43.638426 I | ceph-mgr: 2017-07-11 14:42:43.637051 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:43.638609 I | ceph-mgr: 2017-07-11 14:42:43.637061 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:43.638733 I | ceph-mgr: 2017-07-11 14:42:43.637087 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:45.641057 I | ceph-mgr: 2017-07-11 14:42:45.639443 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:45.641111 I | ceph-mgr: 2017-07-11 14:42:45.639453 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:45.641225 I | ceph-mgr: 2017-07-11 14:42:45.641147 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:46.017830 I | ceph-mgr: 2017-07-11 14:42:46.017782 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9584 10.233.124.5:0/1724085188' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:46.017917 I | ceph-mgr: 2017-07-11 14:42:46.017890 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:47.025212 I | ceph-mgr: 2017-07-11 14:42:47.025132 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9587 10.233.124.5:0/1092435884' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:47.025296 I | ceph-mgr: 2017-07-11 14:42:47.025270 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:47.660143 I | ceph-mgr: 2017-07-11 14:42:47.643333 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:47.660199 I | ceph-mgr: 2017-07-11 14:42:47.643338 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:47.660394 I | ceph-mgr: 2017-07-11 14:42:47.643358 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:49.677658 I | ceph-mgr: 2017-07-11 14:42:49.661734 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:49.677823 I | ceph-mgr: 2017-07-11 14:42:49.661743 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:49.677860 I | ceph-mgr: 2017-07-11 14:42:49.661770 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:51.057200 I | ceph-mgr: 2017-07-11 14:42:51.057139 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9602 10.233.124.5:0/858498031' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:51.059335 I | ceph-mgr: 2017-07-11 14:42:51.057159 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:51.682713 I | ceph-mgr: 2017-07-11 14:42:51.682645 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:51.682835 I | ceph-mgr: 2017-07-11 14:42:51.682811 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:51.682987 I | ceph-mgr: 2017-07-11 14:42:51.682973 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:52.046010 I | ceph-mgr: 2017-07-11 14:42:52.045924 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9327 10.233.124.0:0/1339963401' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:52.046068 I | ceph-mgr: 2017-07-11 14:42:52.045972 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:53.690012 I | ceph-mgr: 2017-07-11 14:42:53.688714 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:53.697895 I | ceph-mgr: 2017-07-11 14:42:53.688727 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:53.697929 I | ceph-mgr: 2017-07-11 14:42:53.688755 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:55.698360 I | ceph-mgr: 2017-07-11 14:42:55.696051 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:55.698434 I | ceph-mgr: 2017-07-11 14:42:55.696065 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:55.698450 I | ceph-mgr: 2017-07-11 14:42:55.696094 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:55.845435 I | ceph-mgr: 2017-07-11 14:42:55.845389 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9617 10.233.124.5:0/2988370331' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:55.845535 I | ceph-mgr: 2017-07-11 14:42:55.845498 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:56.693886 I | ceph-mgr: 2017-07-11 14:42:56.693805 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9339 10.233.124.0:0/4050499877' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:42:56.693987 I | ceph-mgr: 2017-07-11 14:42:56.693961 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:42:57.702514 I | ceph-mgr: 2017-07-11 14:42:57.701009 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:57.702639 I | ceph-mgr: 2017-07-11 14:42:57.701019 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:57.702659 I | ceph-mgr: 2017-07-11 14:42:57.701061 7f4cc3226700 0 mgr tick
- 2017-07-11 14:42:59.710385 I | ceph-mgr: 2017-07-11 14:42:59.709106 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:42:59.710447 I | ceph-mgr: 2017-07-11 14:42:59.709111 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:42:59.710465 I | ceph-mgr: 2017-07-11 14:42:59.709132 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:00.780872 I | ceph-mgr: 2017-07-11 14:43:00.780846 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9638 10.233.124.5:0/3580874277' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:00.780981 I | ceph-mgr: 2017-07-11 14:43:00.780967 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:01.628847 I | ceph-mgr: 2017-07-11 14:43:01.628821 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9641 10.233.124.5:0/905098063' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:01.629082 I | ceph-mgr: 2017-07-11 14:43:01.629066 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:01.715766 I | ceph-mgr: 2017-07-11 14:43:01.713459 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:01.715901 I | ceph-mgr: 2017-07-11 14:43:01.713464 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:01.715920 I | ceph-mgr: 2017-07-11 14:43:01.715833 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:03.734303 I | ceph-mgr: 2017-07-11 14:43:03.734267 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:03.734388 I | ceph-mgr: 2017-07-11 14:43:03.734373 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:03.734619 I | ceph-mgr: 2017-07-11 14:43:03.734604 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:05.480598 I | ceph-mgr: 2017-07-11 14:43:05.480546 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9653 10.233.124.5:0/315390892' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:05.480696 I | ceph-mgr: 2017-07-11 14:43:05.480670 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:05.754160 I | ceph-mgr: 2017-07-11 14:43:05.754130 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:05.754332 I | ceph-mgr: 2017-07-11 14:43:05.754315 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:05.754686 I | ceph-mgr: 2017-07-11 14:43:05.754624 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:06.444319 I | ceph-mgr: 2017-07-11 14:43:06.444136 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9378 10.233.124.0:0/2723727231' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:06.444628 I | ceph-mgr: 2017-07-11 14:43:06.444586 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:07.757285 I | ceph-mgr: 2017-07-11 14:43:07.757252 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:07.757517 I | ceph-mgr: 2017-07-11 14:43:07.757500 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:07.759693 I | ceph-mgr: 2017-07-11 14:43:07.759674 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:09.791328 I | ceph-mgr: 2017-07-11 14:43:09.782301 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:09.791507 I | ceph-mgr: 2017-07-11 14:43:09.782309 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:09.791599 I | ceph-mgr: 2017-07-11 14:43:09.782335 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:10.571346 I | ceph-mgr: 2017-07-11 14:43:10.571289 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9671 10.233.124.5:0/2561798507' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:10.571521 I | ceph-mgr: 2017-07-11 14:43:10.571440 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:11.526534 I | ceph-mgr: 2017-07-11 14:43:11.526432 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9390 10.233.124.0:0/3659842180' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:11.542110 I | ceph-mgr: 2017-07-11 14:43:11.526479 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:11.807068 I | ceph-mgr: 2017-07-11 14:43:11.790298 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:11.807122 I | ceph-mgr: 2017-07-11 14:43:11.790303 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:11.807137 I | ceph-mgr: 2017-07-11 14:43:11.790323 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:13.811123 I | ceph-mgr: 2017-07-11 14:43:13.811078 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:13.811334 I | ceph-mgr: 2017-07-11 14:43:13.811305 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:13.811963 I | ceph-mgr: 2017-07-11 14:43:13.811947 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:15.315491 I | ceph-mgr: 2017-07-11 14:43:15.315431 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9402 10.233.124.0:0/4111146829' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:15.315555 I | ceph-mgr: 2017-07-11 14:43:15.315450 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:15.823831 I | ceph-mgr: 2017-07-11 14:43:15.823803 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:15.823902 I | ceph-mgr: 2017-07-11 14:43:15.823888 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:15.824111 I | ceph-mgr: 2017-07-11 14:43:15.823999 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:16.235600 I | ceph-mgr: 2017-07-11 14:43:16.235494 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9405 10.233.124.0:0/288262652' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:16.235667 I | ceph-mgr: 2017-07-11 14:43:16.235554 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:17.828670 I | ceph-mgr: 2017-07-11 14:43:17.828542 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:17.828749 I | ceph-mgr: 2017-07-11 14:43:17.828734 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:17.828998 I | ceph-mgr: 2017-07-11 14:43:17.828981 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:19.840818 I | ceph-mgr: 2017-07-11 14:43:19.838144 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:19.840899 I | ceph-mgr: 2017-07-11 14:43:19.840867 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:19.841106 I | ceph-mgr: 2017-07-11 14:43:19.840996 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:20.309993 I | ceph-mgr: 2017-07-11 14:43:20.309925 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9414 10.233.124.0:0/1818683424' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:20.310060 I | ceph-mgr: 2017-07-11 14:43:20.309948 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:21.128496 I | ceph-mgr: 2017-07-11 14:43:21.128406 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9417 10.233.124.5:0/697974408' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:21.128556 I | ceph-mgr: 2017-07-11 14:43:21.128455 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:21.859412 I | ceph-mgr: 2017-07-11 14:43:21.859381 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:21.859489 I | ceph-mgr: 2017-07-11 14:43:21.859475 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:21.859710 I | ceph-mgr: 2017-07-11 14:43:21.859694 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:23.873145 I | ceph-mgr: 2017-07-11 14:43:23.873089 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:23.873237 I | ceph-mgr: 2017-07-11 14:43:23.873223 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:23.873471 I | ceph-mgr: 2017-07-11 14:43:23.873455 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:25.229221 I | ceph-mgr: 2017-07-11 14:43:25.229156 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9423 10.233.124.5:0/3155209863' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:25.229297 I | ceph-mgr: 2017-07-11 14:43:25.229178 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:25.888406 I | ceph-mgr: 2017-07-11 14:43:25.888331 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:25.888496 I | ceph-mgr: 2017-07-11 14:43:25.888482 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:25.888740 I | ceph-mgr: 2017-07-11 14:43:25.888724 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:26.159506 I | ceph-mgr: 2017-07-11 14:43:26.159413 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9429 10.233.124.5:0/186464458' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:26.161093 I | ceph-mgr: 2017-07-11 14:43:26.159460 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:27.897796 I | ceph-mgr: 2017-07-11 14:43:27.895087 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:27.905011 I | ceph-mgr: 2017-07-11 14:43:27.904985 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:27.907112 I | ceph-mgr: 2017-07-11 14:43:27.907089 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:29.954117 I | ceph-mgr: 2017-07-11 14:43:29.954081 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:29.954189 I | ceph-mgr: 2017-07-11 14:43:29.954175 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:29.954410 I | ceph-mgr: 2017-07-11 14:43:29.954394 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:30.322484 I | ceph-mgr: 2017-07-11 14:43:30.322385 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9728 10.233.124.5:0/3101914668' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:30.322549 I | ceph-mgr: 2017-07-11 14:43:30.322429 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:31.191734 I | ceph-mgr: 2017-07-11 14:43:31.191658 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9447 10.233.124.0:0/3408185040' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:31.191827 I | ceph-mgr: 2017-07-11 14:43:31.191800 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:31.976391 I | ceph-mgr: 2017-07-11 14:43:31.974976 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:31.993175 I | ceph-mgr: 2017-07-11 14:43:31.974981 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:31.993215 I | ceph-mgr: 2017-07-11 14:43:31.975013 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:33.982050 I | ceph-mgr: 2017-07-11 14:43:33.979941 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:33.989685 I | ceph-mgr: 2017-07-11 14:43:33.979951 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:33.990184 I | ceph-mgr: 2017-07-11 14:43:33.979978 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:35.032569 I | ceph-mgr: 2017-07-11 14:43:35.032516 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9746 10.233.124.5:0/2538870498' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:35.032656 I | ceph-mgr: 2017-07-11 14:43:35.032631 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:35.959383 I | ceph-mgr: 2017-07-11 14:43:35.959309 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9749 10.233.124.5:0/634094756' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:35.959470 I | ceph-mgr: 2017-07-11 14:43:35.959444 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:35.998070 I | ceph-mgr: 2017-07-11 14:43:35.988236 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:35.998200 I | ceph-mgr: 2017-07-11 14:43:35.988241 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:35.998220 I | ceph-mgr: 2017-07-11 14:43:35.988261 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:38.018184 I | ceph-mgr: 2017-07-11 14:43:38.018151 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:38.019123 I | ceph-mgr: 2017-07-11 14:43:38.019090 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:38.019336 I | ceph-mgr: 2017-07-11 14:43:38.019223 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:40.003212 I | ceph-mgr: 2017-07-11 14:43:40.003162 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9471 10.233.124.0:0/1291007057' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:40.003379 I | ceph-mgr: 2017-07-11 14:43:40.003284 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:40.020767 I | ceph-mgr: 2017-07-11 14:43:40.020742 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:40.020820 I | ceph-mgr: 2017-07-11 14:43:40.020806 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:40.021044 I | ceph-mgr: 2017-07-11 14:43:40.020930 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:40.855240 I | ceph-mgr: 2017-07-11 14:43:40.855129 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9764 10.233.124.5:0/1902565393' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:40.864394 I | ceph-mgr: 2017-07-11 14:43:40.855179 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:42.027743 I | ceph-mgr: 2017-07-11 14:43:42.027683 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:42.027836 I | ceph-mgr: 2017-07-11 14:43:42.027819 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:42.028079 I | ceph-mgr: 2017-07-11 14:43:42.028064 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:44.030308 I | ceph-mgr: 2017-07-11 14:43:44.030268 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:44.033358 I | ceph-mgr: 2017-07-11 14:43:44.030477 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:44.048665 I | ceph-mgr: 2017-07-11 14:43:44.033496 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:45.239488 I | ceph-mgr: 2017-07-11 14:43:45.239424 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9486 10.233.124.0:0/1663597500' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:45.241487 I | ceph-mgr: 2017-07-11 14:43:45.239443 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:46.058467 I | ceph-mgr: 2017-07-11 14:43:46.058405 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:46.058726 I | ceph-mgr: 2017-07-11 14:43:46.058575 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:46.058948 I | ceph-mgr: 2017-07-11 14:43:46.058933 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:46.301223 I | ceph-mgr: 2017-07-11 14:43:46.301059 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9779 10.233.124.5:0/2501697812' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:46.301302 I | ceph-mgr: 2017-07-11 14:43:46.301155 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:48.060497 I | ceph-mgr: 2017-07-11 14:43:48.060443 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:48.060658 I | ceph-mgr: 2017-07-11 14:43:48.060592 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:48.067116 I | ceph-mgr: 2017-07-11 14:43:48.067097 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:50.071056 I | ceph-mgr: 2017-07-11 14:43:50.070968 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:50.071114 I | ceph-mgr: 2017-07-11 14:43:50.070976 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:50.071130 I | ceph-mgr: 2017-07-11 14:43:50.071000 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:50.072631 I | ceph-mgr: 2017-07-11 14:43:50.072597 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9797 10.233.124.5:0/2218014432' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:50.072705 I | ceph-mgr: 2017-07-11 14:43:50.072673 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:51.085375 I | ceph-mgr: 2017-07-11 14:43:51.085292 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9803 10.233.124.5:0/3926504296' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:51.085470 I | ceph-mgr: 2017-07-11 14:43:51.085442 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:52.073400 I | ceph-mgr: 2017-07-11 14:43:52.073104 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:52.073460 I | ceph-mgr: 2017-07-11 14:43:52.073127 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:52.073479 I | ceph-mgr: 2017-07-11 14:43:52.073155 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:54.079309 I | ceph-mgr: 2017-07-11 14:43:54.077932 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:54.079402 I | ceph-mgr: 2017-07-11 14:43:54.077937 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:54.079436 I | ceph-mgr: 2017-07-11 14:43:54.077959 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:55.099812 I | ceph-mgr: 2017-07-11 14:43:55.099760 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9821 10.233.124.5:0/3336366242' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:55.099914 I | ceph-mgr: 2017-07-11 14:43:55.099887 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:56.083642 I | ceph-mgr: 2017-07-11 14:43:56.079840 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:56.083693 I | ceph-mgr: 2017-07-11 14:43:56.079852 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:56.083718 I | ceph-mgr: 2017-07-11 14:43:56.079892 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:56.177204 I | ceph-mgr: 2017-07-11 14:43:56.177129 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9827 10.233.124.5:0/1340083394' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:56.179652 I | ceph-mgr: 2017-07-11 14:43:56.179624 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:43:58.083366 I | ceph-mgr: 2017-07-11 14:43:58.083320 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:43:58.083589 I | ceph-mgr: 2017-07-11 14:43:58.083573 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:43:58.083790 I | ceph-mgr: 2017-07-11 14:43:58.083778 7f4cc3226700 0 mgr tick
- 2017-07-11 14:43:59.837120 I | ceph-mgr: 2017-07-11 14:43:59.837074 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9833 10.233.124.5:0/2658090101' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:43:59.837221 I | ceph-mgr: 2017-07-11 14:43:59.837197 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:00.107595 I | ceph-mgr: 2017-07-11 14:44:00.107561 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:00.107664 I | ceph-mgr: 2017-07-11 14:44:00.107650 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:00.107878 I | ceph-mgr: 2017-07-11 14:44:00.107763 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:00.760234 I | ceph-mgr: 2017-07-11 14:44:00.760146 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9522 10.233.124.0:0/1956689419' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:00.760249 I | ceph-mgr: 2017-07-11 14:44:00.760193 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:02.116459 I | ceph-mgr: 2017-07-11 14:44:02.116380 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:02.116734 I | ceph-mgr: 2017-07-11 14:44:02.116583 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:02.116964 I | ceph-mgr: 2017-07-11 14:44:02.116943 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:04.124489 I | ceph-mgr: 2017-07-11 14:44:04.123622 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:04.124557 I | ceph-mgr: 2017-07-11 14:44:04.123627 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:04.124574 I | ceph-mgr: 2017-07-11 14:44:04.123648 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:04.665143 I | ceph-mgr: 2017-07-11 14:44:04.665118 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9534 10.233.124.5:0/1238357441' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:04.665240 I | ceph-mgr: 2017-07-11 14:44:04.665226 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:05.479663 I | ceph-mgr: 2017-07-11 14:44:05.479629 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9540 10.233.124.0:0/3627530080' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:05.479883 I | ceph-mgr: 2017-07-11 14:44:05.479846 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:06.131705 I | ceph-mgr: 2017-07-11 14:44:06.130238 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:06.131760 I | ceph-mgr: 2017-07-11 14:44:06.130244 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:06.131777 I | ceph-mgr: 2017-07-11 14:44:06.130265 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:08.133373 I | ceph-mgr: 2017-07-11 14:44:08.133340 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:08.133439 I | ceph-mgr: 2017-07-11 14:44:08.133425 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:08.133509 I | ceph-mgr: 2017-07-11 14:44:08.133499 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:10.031526 I | ceph-mgr: 2017-07-11 14:44:10.031470 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9854 10.233.124.5:0/4148927451' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:10.031613 I | ceph-mgr: 2017-07-11 14:44:10.031586 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:10.154414 I | ceph-mgr: 2017-07-11 14:44:10.153169 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:10.154461 I | ceph-mgr: 2017-07-11 14:44:10.153174 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:10.154476 I | ceph-mgr: 2017-07-11 14:44:10.153194 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:11.446504 I | ceph-mgr: 2017-07-11 14:44:11.446426 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9860 10.233.124.5:0/153908997' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:11.446596 I | ceph-mgr: 2017-07-11 14:44:11.446569 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:12.164392 I | ceph-mgr: 2017-07-11 14:44:12.162818 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:12.164456 I | ceph-mgr: 2017-07-11 14:44:12.162832 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:12.164472 I | ceph-mgr: 2017-07-11 14:44:12.162876 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:14.166703 I | ceph-mgr: 2017-07-11 14:44:14.165679 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:14.166770 I | ceph-mgr: 2017-07-11 14:44:14.165685 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:14.166785 I | ceph-mgr: 2017-07-11 14:44:14.165709 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:14.542226 I | ceph-mgr: 2017-07-11 14:44:14.542196 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9558 10.233.124.0:0/4215014650' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:14.543921 I | ceph-mgr: 2017-07-11 14:44:14.543904 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:15.617837 I | ceph-mgr: 2017-07-11 14:44:15.617807 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9878 10.233.124.5:0/4229291611' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:15.618066 I | ceph-mgr: 2017-07-11 14:44:15.618049 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:16.189309 I | ceph-mgr: 2017-07-11 14:44:16.173620 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:16.189369 I | ceph-mgr: 2017-07-11 14:44:16.173627 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:16.189446 I | ceph-mgr: 2017-07-11 14:44:16.173649 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:18.197291 I | ceph-mgr: 2017-07-11 14:44:18.195988 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:18.197368 I | ceph-mgr: 2017-07-11 14:44:18.195994 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:18.197385 I | ceph-mgr: 2017-07-11 14:44:18.196014 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:19.912187 I | ceph-mgr: 2017-07-11 14:44:19.912139 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9576 10.233.124.0:0/303705539' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:19.912269 I | ceph-mgr: 2017-07-11 14:44:19.912246 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:20.199962 I | ceph-mgr: 2017-07-11 14:44:20.198601 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:20.207139 I | ceph-mgr: 2017-07-11 14:44:20.198606 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:20.207214 I | ceph-mgr: 2017-07-11 14:44:20.198626 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:20.761128 I | ceph-mgr: 2017-07-11 14:44:20.761048 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9582 10.233.124.0:0/200139165' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:20.762616 I | ceph-mgr: 2017-07-11 14:44:20.762588 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:22.220607 I | ceph-mgr: 2017-07-11 14:44:22.202589 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:22.220638 I | ceph-mgr: 2017-07-11 14:44:22.202597 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:22.220641 I | ceph-mgr: 2017-07-11 14:44:22.202624 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:24.232088 I | ceph-mgr: 2017-07-11 14:44:24.232055 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:24.232164 I | ceph-mgr: 2017-07-11 14:44:24.232150 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:24.232268 I | ceph-mgr: 2017-07-11 14:44:24.232254 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:24.396603 I | ceph-mgr: 2017-07-11 14:44:24.396529 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9902 10.233.124.5:0/760696839' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:24.396657 I | ceph-mgr: 2017-07-11 14:44:24.396549 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:25.254809 I | ceph-mgr: 2017-07-11 14:44:25.254494 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9594 10.233.124.0:0/1326261672' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:25.254874 I | ceph-mgr: 2017-07-11 14:44:25.254543 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:26.269839 I | ceph-mgr: 2017-07-11 14:44:26.243470 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:26.270060 I | ceph-mgr: 2017-07-11 14:44:26.243482 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:26.270157 I | ceph-mgr: 2017-07-11 14:44:26.243512 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:28.318435 I | ceph-mgr: 2017-07-11 14:44:28.316941 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:28.318640 I | ceph-mgr: 2017-07-11 14:44:28.316952 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:28.318666 I | ceph-mgr: 2017-07-11 14:44:28.317000 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:29.404570 I | ceph-mgr: 2017-07-11 14:44:29.404479 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9920 10.233.124.5:0/1330345113' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:29.404635 I | ceph-mgr: 2017-07-11 14:44:29.404524 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:30.242408 I | ceph-mgr: 2017-07-11 14:44:30.242381 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9926 10.233.124.5:0/761489180' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:30.242642 I | ceph-mgr: 2017-07-11 14:44:30.242627 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:30.330161 I | ceph-mgr: 2017-07-11 14:44:30.320296 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:30.330550 I | ceph-mgr: 2017-07-11 14:44:30.320301 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:30.330581 I | ceph-mgr: 2017-07-11 14:44:30.320321 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:32.328260 I | ceph-mgr: 2017-07-11 14:44:32.328226 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:32.328334 I | ceph-mgr: 2017-07-11 14:44:32.328321 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:32.328556 I | ceph-mgr: 2017-07-11 14:44:32.328540 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:34.233391 I | ceph-mgr: 2017-07-11 14:44:34.233365 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9935 10.233.124.5:0/2435226021' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:34.233489 I | ceph-mgr: 2017-07-11 14:44:34.233474 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:34.336717 I | ceph-mgr: 2017-07-11 14:44:34.336693 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:34.336775 I | ceph-mgr: 2017-07-11 14:44:34.336760 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:34.336888 I | ceph-mgr: 2017-07-11 14:44:34.336872 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:35.048272 I | ceph-mgr: 2017-07-11 14:44:35.048242 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9941 10.233.124.5:0/1347158784' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:35.048447 I | ceph-mgr: 2017-07-11 14:44:35.048374 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:36.345284 I | ceph-mgr: 2017-07-11 14:44:36.345249 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:36.345357 I | ceph-mgr: 2017-07-11 14:44:36.345343 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:36.345579 I | ceph-mgr: 2017-07-11 14:44:36.345563 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:38.349249 I | ceph-mgr: 2017-07-11 14:44:38.347874 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:38.349321 I | ceph-mgr: 2017-07-11 14:44:38.347880 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:38.349337 I | ceph-mgr: 2017-07-11 14:44:38.347900 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:39.360171 I | ceph-mgr: 2017-07-11 14:44:39.360104 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9953 10.233.124.5:0/313368013' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:39.360268 I | ceph-mgr: 2017-07-11 14:44:39.360241 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:40.150950 I | ceph-mgr: 2017-07-11 14:44:40.150821 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9959 10.233.124.5:0/821296234' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:40.151034 I | ceph-mgr: 2017-07-11 14:44:40.150866 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:40.373905 I | ceph-mgr: 2017-07-11 14:44:40.354222 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:40.373981 I | ceph-mgr: 2017-07-11 14:44:40.354234 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:40.373997 I | ceph-mgr: 2017-07-11 14:44:40.354265 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:42.362804 I | ceph-mgr: 2017-07-11 14:44:42.355583 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:42.362910 I | ceph-mgr: 2017-07-11 14:44:42.355590 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:42.362965 I | ceph-mgr: 2017-07-11 14:44:42.355625 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:44.369854 I | ceph-mgr: 2017-07-11 14:44:44.350592 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9654 10.233.124.0:0/2908999990' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:44.370233 I | ceph-mgr: 2017-07-11 14:44:44.360131 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:44.370262 I | ceph-mgr: 2017-07-11 14:44:44.360142 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:44.370276 I | ceph-mgr: 2017-07-11 14:44:44.360185 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:44.370711 I | ceph-mgr: 2017-07-11 14:44:44.370682 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:45.196443 I | ceph-mgr: 2017-07-11 14:44:45.196366 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9974 10.233.124.5:0/653323584' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:45.196692 I | ceph-mgr: 2017-07-11 14:44:45.196664 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:46.376151 I | ceph-mgr: 2017-07-11 14:44:46.374818 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:46.376306 I | ceph-mgr: 2017-07-11 14:44:46.374826 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:46.376444 I | ceph-mgr: 2017-07-11 14:44:46.374850 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:48.381468 I | ceph-mgr: 2017-07-11 14:44:48.378385 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:48.381544 I | ceph-mgr: 2017-07-11 14:44:48.378398 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:48.381560 I | ceph-mgr: 2017-07-11 14:44:48.378443 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:49.060100 I | ceph-mgr: 2017-07-11 14:44:49.060036 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9666 10.233.124.5:0/1717131352' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:49.060164 I | ceph-mgr: 2017-07-11 14:44:49.060055 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:49.885100 I | ceph-mgr: 2017-07-11 14:44:49.885013 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9669 10.233.124.0:0/3702957170' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:49.885429 I | ceph-mgr: 2017-07-11 14:44:49.885062 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:50.399214 I | ceph-mgr: 2017-07-11 14:44:50.382594 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:50.399270 I | ceph-mgr: 2017-07-11 14:44:50.382599 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:50.399285 I | ceph-mgr: 2017-07-11 14:44:50.382618 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:52.485186 I | ceph-mgr: 2017-07-11 14:44:52.485153 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:52.485405 I | ceph-mgr: 2017-07-11 14:44:52.485390 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:52.487344 I | ceph-mgr: 2017-07-11 14:44:52.487327 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:54.159950 I | ceph-mgr: 2017-07-11 14:44:54.150527 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10001 10.233.124.5:0/1639595869' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:54.160028 I | ceph-mgr: 2017-07-11 14:44:54.150548 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:54.505745 I | ceph-mgr: 2017-07-11 14:44:54.505718 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:54.505817 I | ceph-mgr: 2017-07-11 14:44:54.505804 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:54.506036 I | ceph-mgr: 2017-07-11 14:44:54.506020 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:55.176523 I | ceph-mgr: 2017-07-11 14:44:55.176427 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10004 10.233.124.5:0/4124923592' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:55.179435 I | ceph-mgr: 2017-07-11 14:44:55.176479 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:44:56.523333 I | ceph-mgr: 2017-07-11 14:44:56.523290 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:56.523413 I | ceph-mgr: 2017-07-11 14:44:56.523398 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:56.531321 I | ceph-mgr: 2017-07-11 14:44:56.531303 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:58.535858 I | ceph-mgr: 2017-07-11 14:44:58.535502 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:44:58.535946 I | ceph-mgr: 2017-07-11 14:44:58.535929 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:44:58.536178 I | ceph-mgr: 2017-07-11 14:44:58.536152 7f4cc3226700 0 mgr tick
- 2017-07-11 14:44:59.101743 I | ceph-mgr: 2017-07-11 14:44:59.101676 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10025 10.233.124.5:0/475440595' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:44:59.108026 I | ceph-mgr: 2017-07-11 14:44:59.101697 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:00.108537 I | ceph-mgr: 2017-07-11 14:45:00.108443 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10034 10.233.124.5:0/371402914' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:00.108614 I | ceph-mgr: 2017-07-11 14:45:00.108495 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:00.546467 I | ceph-mgr: 2017-07-11 14:45:00.545101 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:00.546528 I | ceph-mgr: 2017-07-11 14:45:00.545107 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:00.546544 I | ceph-mgr: 2017-07-11 14:45:00.545137 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:02.557572 I | ceph-mgr: 2017-07-11 14:45:02.547657 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:02.557654 I | ceph-mgr: 2017-07-11 14:45:02.547669 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:02.557669 I | ceph-mgr: 2017-07-11 14:45:02.547710 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:04.204479 I | ceph-mgr: 2017-07-11 14:45:04.204419 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9696 10.233.124.0:0/384039080' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:04.204540 I | ceph-mgr: 2017-07-11 14:45:04.204438 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:04.555367 I | ceph-mgr: 2017-07-11 14:45:04.553294 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:04.555513 I | ceph-mgr: 2017-07-11 14:45:04.555494 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:04.555648 I | ceph-mgr: 2017-07-11 14:45:04.555634 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:05.019764 I | ceph-mgr: 2017-07-11 14:45:05.019676 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10055 10.233.124.5:0/81321056' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:05.019820 I | ceph-mgr: 2017-07-11 14:45:05.019723 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:06.579839 I | ceph-mgr: 2017-07-11 14:45:06.573664 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:06.581661 I | ceph-mgr: 2017-07-11 14:45:06.573669 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:06.581705 I | ceph-mgr: 2017-07-11 14:45:06.573690 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:08.591855 I | ceph-mgr: 2017-07-11 14:45:08.588028 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:08.597559 I | ceph-mgr: 2017-07-11 14:45:08.588034 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:08.597569 I | ceph-mgr: 2017-07-11 14:45:08.588057 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:08.983922 I | ceph-mgr: 2017-07-11 14:45:08.983835 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10070 10.233.124.5:0/585924021' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:08.984094 I | ceph-mgr: 2017-07-11 14:45:08.984018 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:09.843149 I | ceph-mgr: 2017-07-11 14:45:09.843063 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9705 10.233.124.5:0/1999421467' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:09.843319 I | ceph-mgr: 2017-07-11 14:45:09.843234 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:10.609777 I | ceph-mgr: 2017-07-11 14:45:10.599396 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:10.609987 I | ceph-mgr: 2017-07-11 14:45:10.599408 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:10.610013 I | ceph-mgr: 2017-07-11 14:45:10.599438 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:12.605318 I | ceph-mgr: 2017-07-11 14:45:12.603781 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:12.613171 I | ceph-mgr: 2017-07-11 14:45:12.603793 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:12.613213 I | ceph-mgr: 2017-07-11 14:45:12.603834 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:14.055209 I | ceph-mgr: 2017-07-11 14:45:14.055146 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10091 10.233.124.5:0/3066100452' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:14.056709 I | ceph-mgr: 2017-07-11 14:45:14.056678 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:14.622735 I | ceph-mgr: 2017-07-11 14:45:14.607026 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:14.622843 I | ceph-mgr: 2017-07-11 14:45:14.607031 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:14.622995 I | ceph-mgr: 2017-07-11 14:45:14.607055 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:14.875269 I | ceph-mgr: 2017-07-11 14:45:14.875173 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9717 10.233.124.0:0/1271840996' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:14.875522 I | ceph-mgr: 2017-07-11 14:45:14.875222 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:16.648699 I | ceph-mgr: 2017-07-11 14:45:16.648656 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:16.648802 I | ceph-mgr: 2017-07-11 14:45:16.648787 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:16.649098 I | ceph-mgr: 2017-07-11 14:45:16.649081 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:18.670574 I | ceph-mgr: 2017-07-11 14:45:18.670196 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:18.670652 I | ceph-mgr: 2017-07-11 14:45:18.670637 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:18.670872 I | ceph-mgr: 2017-07-11 14:45:18.670857 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:18.795995 I | ceph-mgr: 2017-07-11 14:45:18.795942 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10103 10.233.124.5:0/1565027153' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:18.796051 I | ceph-mgr: 2017-07-11 14:45:18.795961 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:19.959586 I | ceph-mgr: 2017-07-11 14:45:19.959484 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9732 10.233.124.0:0/2896721592' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:19.959635 I | ceph-mgr: 2017-07-11 14:45:19.959550 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:20.678559 I | ceph-mgr: 2017-07-11 14:45:20.678519 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:20.678634 I | ceph-mgr: 2017-07-11 14:45:20.678620 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:20.678858 I | ceph-mgr: 2017-07-11 14:45:20.678842 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:22.681498 I | ceph-mgr: 2017-07-11 14:45:22.681462 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:22.681580 I | ceph-mgr: 2017-07-11 14:45:22.681565 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:22.681817 I | ceph-mgr: 2017-07-11 14:45:22.681801 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:23.744493 I | ceph-mgr: 2017-07-11 14:45:23.744433 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9744 10.233.124.0:0/2070022035' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:23.744553 I | ceph-mgr: 2017-07-11 14:45:23.744452 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:24.573480 I | ceph-mgr: 2017-07-11 14:45:24.571111 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9747 10.233.124.0:0/1713854026' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:24.581245 I | ceph-mgr: 2017-07-11 14:45:24.573565 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:24.690112 I | ceph-mgr: 2017-07-11 14:45:24.690014 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:24.690224 I | ceph-mgr: 2017-07-11 14:45:24.690209 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:24.690548 I | ceph-mgr: 2017-07-11 14:45:24.690532 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:26.699186 I | ceph-mgr: 2017-07-11 14:45:26.699153 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:26.699266 I | ceph-mgr: 2017-07-11 14:45:26.699252 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:26.699548 I | ceph-mgr: 2017-07-11 14:45:26.699532 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:28.700316 I | ceph-mgr: 2017-07-11 14:45:28.699551 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10127 10.233.124.5:0/1328488925' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:28.700419 I | ceph-mgr: 2017-07-11 14:45:28.700388 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:28.702857 I | ceph-mgr: 2017-07-11 14:45:28.702838 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:28.702911 I | ceph-mgr: 2017-07-11 14:45:28.702896 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:28.709617 I | ceph-mgr: 2017-07-11 14:45:28.709597 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:29.678575 I | ceph-mgr: 2017-07-11 14:45:29.678474 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10133 10.233.124.5:0/3769359083' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:29.678659 I | ceph-mgr: 2017-07-11 14:45:29.678633 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:30.716343 I | ceph-mgr: 2017-07-11 14:45:30.716298 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:30.716424 I | ceph-mgr: 2017-07-11 14:45:30.716410 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:30.716695 I | ceph-mgr: 2017-07-11 14:45:30.716680 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:32.726061 I | ceph-mgr: 2017-07-11 14:45:32.726033 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:32.726161 I | ceph-mgr: 2017-07-11 14:45:32.726146 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:32.726376 I | ceph-mgr: 2017-07-11 14:45:32.726259 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:33.492965 I | ceph-mgr: 2017-07-11 14:45:33.492901 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9771 10.233.124.0:0/2370878109' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:33.493021 I | ceph-mgr: 2017-07-11 14:45:33.492920 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:34.373043 I | ceph-mgr: 2017-07-11 14:45:34.372953 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10151 10.233.124.5:0/27382177' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:34.373105 I | ceph-mgr: 2017-07-11 14:45:34.373000 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:34.733923 I | ceph-mgr: 2017-07-11 14:45:34.733888 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:34.734014 I | ceph-mgr: 2017-07-11 14:45:34.734000 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:34.734233 I | ceph-mgr: 2017-07-11 14:45:34.734217 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:36.740422 I | ceph-mgr: 2017-07-11 14:45:36.740389 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:36.740510 I | ceph-mgr: 2017-07-11 14:45:36.740487 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:36.740727 I | ceph-mgr: 2017-07-11 14:45:36.740711 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:38.558009 I | ceph-mgr: 2017-07-11 14:45:38.557939 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10169 10.233.124.5:0/2509369546' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:38.558071 I | ceph-mgr: 2017-07-11 14:45:38.557960 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:38.745828 I | ceph-mgr: 2017-07-11 14:45:38.745801 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:38.745891 I | ceph-mgr: 2017-07-11 14:45:38.745877 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:38.746099 I | ceph-mgr: 2017-07-11 14:45:38.745988 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:39.361199 I | ceph-mgr: 2017-07-11 14:45:39.361101 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9783 10.233.124.0:0/3890367685' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:39.361256 I | ceph-mgr: 2017-07-11 14:45:39.361149 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:40.763954 I | ceph-mgr: 2017-07-11 14:45:40.763881 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:40.764039 I | ceph-mgr: 2017-07-11 14:45:40.764025 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:40.764310 I | ceph-mgr: 2017-07-11 14:45:40.764294 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:42.778885 I | ceph-mgr: 2017-07-11 14:45:42.774671 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:42.779370 I | ceph-mgr: 2017-07-11 14:45:42.774678 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:42.779627 I | ceph-mgr: 2017-07-11 14:45:42.774704 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:43.460974 I | ceph-mgr: 2017-07-11 14:45:43.460912 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9792 10.233.124.0:0/1721218736' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:43.461050 I | ceph-mgr: 2017-07-11 14:45:43.460933 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:44.450695 I | ceph-mgr: 2017-07-11 14:45:44.450620 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9798 10.233.124.5:0/2878366475' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:44.450790 I | ceph-mgr: 2017-07-11 14:45:44.450758 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:44.781779 I | ceph-mgr: 2017-07-11 14:45:44.781747 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:44.781850 I | ceph-mgr: 2017-07-11 14:45:44.781836 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:44.782058 I | ceph-mgr: 2017-07-11 14:45:44.781946 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:46.789489 I | ceph-mgr: 2017-07-11 14:45:46.789454 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:46.789563 I | ceph-mgr: 2017-07-11 14:45:46.789550 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:46.789799 I | ceph-mgr: 2017-07-11 14:45:46.789783 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:48.442707 I | ceph-mgr: 2017-07-11 14:45:48.442645 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.5989 10.233.124.5:0/4006977818' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:48.444572 I | ceph-mgr: 2017-07-11 14:45:48.442665 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:48.799577 I | ceph-mgr: 2017-07-11 14:45:48.799539 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:48.799658 I | ceph-mgr: 2017-07-11 14:45:48.799645 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:48.802039 I | ceph-mgr: 2017-07-11 14:45:48.802023 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:49.325427 I | ceph-mgr: 2017-07-11 14:45:49.325332 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10196 10.233.124.5:0/1276361994' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:49.325484 I | ceph-mgr: 2017-07-11 14:45:49.325377 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:50.826329 I | ceph-mgr: 2017-07-11 14:45:50.823428 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:50.826533 I | ceph-mgr: 2017-07-11 14:45:50.823438 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:50.826631 I | ceph-mgr: 2017-07-11 14:45:50.823464 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:52.841201 I | ceph-mgr: 2017-07-11 14:45:52.825034 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:52.841256 I | ceph-mgr: 2017-07-11 14:45:52.825039 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:52.841281 I | ceph-mgr: 2017-07-11 14:45:52.825060 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:53.249174 I | ceph-mgr: 2017-07-11 14:45:53.249122 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10205 10.233.124.5:0/1724545881' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:53.256854 I | ceph-mgr: 2017-07-11 14:45:53.249140 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:54.515519 I | ceph-mgr: 2017-07-11 14:45:54.515443 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10211 10.233.124.5:0/1057119346' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:54.517095 I | ceph-mgr: 2017-07-11 14:45:54.517064 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:54.846275 I | ceph-mgr: 2017-07-11 14:45:54.846208 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:54.846635 I | ceph-mgr: 2017-07-11 14:45:54.846618 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:54.849130 I | ceph-mgr: 2017-07-11 14:45:54.849112 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:56.934088 I | ceph-mgr: 2017-07-11 14:45:56.932746 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:56.934295 I | ceph-mgr: 2017-07-11 14:45:56.932753 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:56.934323 I | ceph-mgr: 2017-07-11 14:45:56.932779 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:58.497714 I | ceph-mgr: 2017-07-11 14:45:58.497666 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9831 10.233.124.0:0/616658204' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:58.497809 I | ceph-mgr: 2017-07-11 14:45:58.497784 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:45:58.957227 I | ceph-mgr: 2017-07-11 14:45:58.941191 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:45:58.957293 I | ceph-mgr: 2017-07-11 14:45:58.941203 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:45:58.957313 I | ceph-mgr: 2017-07-11 14:45:58.941232 7f4cc3226700 0 mgr tick
- 2017-07-11 14:45:59.456818 I | ceph-mgr: 2017-07-11 14:45:59.456700 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10232 10.233.124.5:0/1000029552' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:45:59.456896 I | ceph-mgr: 2017-07-11 14:45:59.456757 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:00.965761 I | ceph-mgr: 2017-07-11 14:46:00.965690 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:00.965967 I | ceph-mgr: 2017-07-11 14:46:00.965864 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:00.966377 I | ceph-mgr: 2017-07-11 14:46:00.966361 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:02.985579 I | ceph-mgr: 2017-07-11 14:46:02.968569 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:02.985657 I | ceph-mgr: 2017-07-11 14:46:02.968574 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:02.985673 I | ceph-mgr: 2017-07-11 14:46:02.968595 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:03.260166 I | ceph-mgr: 2017-07-11 14:46:03.260117 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10241 10.233.124.5:0/16647806' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:03.260217 I | ceph-mgr: 2017-07-11 14:46:03.260136 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:04.140763 I | ceph-mgr: 2017-07-11 14:46:04.140675 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10247 10.233.124.5:0/2989832577' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:04.140826 I | ceph-mgr: 2017-07-11 14:46:04.140721 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:04.990577 I | ceph-mgr: 2017-07-11 14:46:04.990462 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:04.990659 I | ceph-mgr: 2017-07-11 14:46:04.990645 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:04.990873 I | ceph-mgr: 2017-07-11 14:46:04.990858 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:06.998960 I | ceph-mgr: 2017-07-11 14:46:06.998918 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:07.000647 I | ceph-mgr: 2017-07-11 14:46:07.000533 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:07.001011 I | ceph-mgr: 2017-07-11 14:46:07.000995 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:08.039772 I | ceph-mgr: 2017-07-11 14:46:08.039717 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10262 10.233.124.5:0/171189301' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:08.039839 I | ceph-mgr: 2017-07-11 14:46:08.039736 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:08.929584 I | ceph-mgr: 2017-07-11 14:46:08.929466 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9849 10.233.124.0:0/2371892857' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:08.929806 I | ceph-mgr: 2017-07-11 14:46:08.929775 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:09.025249 I | ceph-mgr: 2017-07-11 14:46:09.023067 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:09.033042 I | ceph-mgr: 2017-07-11 14:46:09.023076 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:09.033075 I | ceph-mgr: 2017-07-11 14:46:09.023101 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:11.029005 I | ceph-mgr: 2017-07-11 14:46:11.028107 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:11.029153 I | ceph-mgr: 2017-07-11 14:46:11.028112 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:11.029173 I | ceph-mgr: 2017-07-11 14:46:11.028133 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:13.044237 I | ceph-mgr: 2017-07-11 14:46:13.034599 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:13.044311 I | ceph-mgr: 2017-07-11 14:46:13.034608 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:13.044326 I | ceph-mgr: 2017-07-11 14:46:13.034633 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:13.045008 I | ceph-mgr: 2017-07-11 14:46:13.044971 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10277 10.233.124.5:0/2110019104' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:13.045071 I | ceph-mgr: 2017-07-11 14:46:13.045047 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:13.964444 I | ceph-mgr: 2017-07-11 14:46:13.964338 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10283 10.233.124.5:0/1416430156' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:13.964626 I | ceph-mgr: 2017-07-11 14:46:13.964532 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:15.056982 I | ceph-mgr: 2017-07-11 14:46:15.039888 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:15.057045 I | ceph-mgr: 2017-07-11 14:46:15.039892 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:15.057060 I | ceph-mgr: 2017-07-11 14:46:15.039912 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:17.057924 I | ceph-mgr: 2017-07-11 14:46:17.057888 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:17.058085 I | ceph-mgr: 2017-07-11 14:46:17.058010 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:17.058309 I | ceph-mgr: 2017-07-11 14:46:17.058293 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:18.089222 I | ceph-mgr: 2017-07-11 14:46:18.089162 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10301 10.233.124.5:0/2508365278' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:18.089287 I | ceph-mgr: 2017-07-11 14:46:18.089181 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:19.019273 I | ceph-mgr: 2017-07-11 14:46:19.019199 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10304 10.233.124.5:0/1702605819' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:19.019364 I | ceph-mgr: 2017-07-11 14:46:19.019338 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:19.079129 I | ceph-mgr: 2017-07-11 14:46:19.079104 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:19.079186 I | ceph-mgr: 2017-07-11 14:46:19.079173 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:19.079392 I | ceph-mgr: 2017-07-11 14:46:19.079282 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:21.098202 I | ceph-mgr: 2017-07-11 14:46:21.096839 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:21.098414 I | ceph-mgr: 2017-07-11 14:46:21.096849 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:21.098443 I | ceph-mgr: 2017-07-11 14:46:21.096889 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:22.990427 I | ceph-mgr: 2017-07-11 14:46:22.990394 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9891 10.233.124.0:0/3179868911' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:22.990525 I | ceph-mgr: 2017-07-11 14:46:22.990511 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:23.099631 I | ceph-mgr: 2017-07-11 14:46:23.098130 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:23.099767 I | ceph-mgr: 2017-07-11 14:46:23.098135 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:23.099787 I | ceph-mgr: 2017-07-11 14:46:23.098153 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:24.167921 I | ceph-mgr: 2017-07-11 14:46:24.167892 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10316 10.233.124.5:0/3909629761' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:24.168680 I | ceph-mgr: 2017-07-11 14:46:24.168651 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:25.105465 I | ceph-mgr: 2017-07-11 14:46:25.105415 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:25.105676 I | ceph-mgr: 2017-07-11 14:46:25.105583 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:25.105964 I | ceph-mgr: 2017-07-11 14:46:25.105949 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:27.109533 I | ceph-mgr: 2017-07-11 14:46:27.109486 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:27.109754 I | ceph-mgr: 2017-07-11 14:46:27.109738 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:27.112665 I | ceph-mgr: 2017-07-11 14:46:27.112637 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:28.172683 I | ceph-mgr: 2017-07-11 14:46:28.172630 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10325 10.233.124.5:0/3170383064' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:28.174313 I | ceph-mgr: 2017-07-11 14:46:28.174276 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:29.150504 I | ceph-mgr: 2017-07-11 14:46:29.134265 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:29.150741 I | ceph-mgr: 2017-07-11 14:46:29.134279 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:29.150777 I | ceph-mgr: 2017-07-11 14:46:29.134324 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:29.238521 I | ceph-mgr: 2017-07-11 14:46:29.238394 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10328 10.233.124.5:0/1674396100' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:29.238663 I | ceph-mgr: 2017-07-11 14:46:29.238609 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:31.160766 I | ceph-mgr: 2017-07-11 14:46:31.159374 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:31.160941 I | ceph-mgr: 2017-07-11 14:46:31.159385 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:31.161072 I | ceph-mgr: 2017-07-11 14:46:31.159424 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:32.745726 I | ceph-mgr: 2017-07-11 14:46:32.745673 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10343 10.233.124.5:0/2284963347' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:32.745884 I | ceph-mgr: 2017-07-11 14:46:32.745804 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:33.162087 I | ceph-mgr: 2017-07-11 14:46:33.161670 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:33.162135 I | ceph-mgr: 2017-07-11 14:46:33.161675 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:33.162149 I | ceph-mgr: 2017-07-11 14:46:33.161694 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:33.645002 I | ceph-mgr: 2017-07-11 14:46:33.644923 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10346 10.233.124.5:0/444083154' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:33.645045 I | ceph-mgr: 2017-07-11 14:46:33.644968 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:35.175386 I | ceph-mgr: 2017-07-11 14:46:35.169178 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:35.175437 I | ceph-mgr: 2017-07-11 14:46:35.175411 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:35.175533 I | ceph-mgr: 2017-07-11 14:46:35.175518 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:37.206828 I | ceph-mgr: 2017-07-11 14:46:37.192741 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:37.212690 I | ceph-mgr: 2017-07-11 14:46:37.192746 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:37.212739 I | ceph-mgr: 2017-07-11 14:46:37.192767 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:37.814777 I | ceph-mgr: 2017-07-11 14:46:37.814727 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9939 10.233.124.0:0/655453394' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:37.814884 I | ceph-mgr: 2017-07-11 14:46:37.814858 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:38.794472 I | ceph-mgr: 2017-07-11 14:46:38.794397 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9945 10.233.124.5:0/1031834056' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:38.795782 I | ceph-mgr: 2017-07-11 14:46:38.795753 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:39.201327 I | ceph-mgr: 2017-07-11 14:46:39.199873 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:39.201401 I | ceph-mgr: 2017-07-11 14:46:39.199881 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:39.201417 I | ceph-mgr: 2017-07-11 14:46:39.199904 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:41.207773 I | ceph-mgr: 2017-07-11 14:46:41.207735 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:41.207845 I | ceph-mgr: 2017-07-11 14:46:41.207830 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:41.223582 I | ceph-mgr: 2017-07-11 14:46:41.207905 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:42.887141 I | ceph-mgr: 2017-07-11 14:46:42.887073 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10364 10.233.124.5:0/2556363872' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:42.889836 I | ceph-mgr: 2017-07-11 14:46:42.889807 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:43.240461 I | ceph-mgr: 2017-07-11 14:46:43.224182 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:43.240533 I | ceph-mgr: 2017-07-11 14:46:43.224187 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:43.240548 I | ceph-mgr: 2017-07-11 14:46:43.224207 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:44.001588 I | ceph-mgr: 2017-07-11 14:46:44.001486 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10370 10.233.124.5:0/1754158528' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:44.001778 I | ceph-mgr: 2017-07-11 14:46:44.001538 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:45.249551 I | ceph-mgr: 2017-07-11 14:46:45.249519 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:45.249647 I | ceph-mgr: 2017-07-11 14:46:45.249633 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:45.249907 I | ceph-mgr: 2017-07-11 14:46:45.249891 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:47.273676 I | ceph-mgr: 2017-07-11 14:46:47.273638 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:47.273754 I | ceph-mgr: 2017-07-11 14:46:47.273740 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:47.273986 I | ceph-mgr: 2017-07-11 14:46:47.273971 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:47.717745 I | ceph-mgr: 2017-07-11 14:46:47.717687 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10388 10.233.124.5:0/3210147722' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:47.717792 I | ceph-mgr: 2017-07-11 14:46:47.717706 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:48.690389 I | ceph-mgr: 2017-07-11 14:46:48.690305 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6049 10.233.124.0:0/3858043884' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:48.690448 I | ceph-mgr: 2017-07-11 14:46:48.690350 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:49.282980 I | ceph-mgr: 2017-07-11 14:46:49.282947 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:49.283058 I | ceph-mgr: 2017-07-11 14:46:49.283044 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:49.283283 I | ceph-mgr: 2017-07-11 14:46:49.283268 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:51.300272 I | ceph-mgr: 2017-07-11 14:46:51.300244 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:51.300357 I | ceph-mgr: 2017-07-11 14:46:51.300342 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:51.300574 I | ceph-mgr: 2017-07-11 14:46:51.300558 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:52.876849 I | ceph-mgr: 2017-07-11 14:46:52.876790 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9990 10.233.124.0:0/903165097' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:52.877918 I | ceph-mgr: 2017-07-11 14:46:52.876810 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:53.314183 I | ceph-mgr: 2017-07-11 14:46:53.314138 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:53.314350 I | ceph-mgr: 2017-07-11 14:46:53.314319 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:53.314472 I | ceph-mgr: 2017-07-11 14:46:53.314458 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:53.759743 I | ceph-mgr: 2017-07-11 14:46:53.759599 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.9996 10.233.124.0:0/1205330903' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:53.761142 I | ceph-mgr: 2017-07-11 14:46:53.759704 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:55.317765 I | ceph-mgr: 2017-07-11 14:46:55.317633 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:55.317968 I | ceph-mgr: 2017-07-11 14:46:55.317883 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:55.318305 I | ceph-mgr: 2017-07-11 14:46:55.318286 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:57.325079 I | ceph-mgr: 2017-07-11 14:46:57.321386 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:57.325249 I | ceph-mgr: 2017-07-11 14:46:57.321392 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:57.325298 I | ceph-mgr: 2017-07-11 14:46:57.321415 7f4cc3226700 0 mgr tick
- 2017-07-11 14:46:58.134454 I | ceph-mgr: 2017-07-11 14:46:58.134383 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10415 10.233.124.5:0/949404692' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:58.134525 I | ceph-mgr: 2017-07-11 14:46:58.134403 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:59.192733 I | ceph-mgr: 2017-07-11 14:46:59.192638 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10418 10.233.124.5:0/2419548162' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:46:59.196304 I | ceph-mgr: 2017-07-11 14:46:59.192686 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:46:59.347179 I | ceph-mgr: 2017-07-11 14:46:59.345728 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:46:59.347335 I | ceph-mgr: 2017-07-11 14:46:59.345739 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:46:59.347355 I | ceph-mgr: 2017-07-11 14:46:59.345779 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:01.349633 I | ceph-mgr: 2017-07-11 14:47:01.348305 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:01.357476 I | ceph-mgr: 2017-07-11 14:47:01.348310 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:01.357606 I | ceph-mgr: 2017-07-11 14:47:01.348331 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:02.383506 I | ceph-mgr: 2017-07-11 14:47:02.383446 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10433 10.233.124.5:0/221608262' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:02.383754 I | ceph-mgr: 2017-07-11 14:47:02.383466 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:03.355259 I | ceph-mgr: 2017-07-11 14:47:03.354054 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:03.356811 I | ceph-mgr: 2017-07-11 14:47:03.354059 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:03.372534 I | ceph-mgr: 2017-07-11 14:47:03.354079 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:03.372583 I | ceph-mgr: 2017-07-11 14:47:03.372415 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10032 10.233.124.0:0/2921950206' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:03.372599 I | ceph-mgr: 2017-07-11 14:47:03.372459 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:05.370144 I | ceph-mgr: 2017-07-11 14:47:05.362061 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:05.377638 I | ceph-mgr: 2017-07-11 14:47:05.362071 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:05.377674 I | ceph-mgr: 2017-07-11 14:47:05.362098 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:07.384641 I | ceph-mgr: 2017-07-11 14:47:07.384613 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:07.384719 I | ceph-mgr: 2017-07-11 14:47:07.384706 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:07.384933 I | ceph-mgr: 2017-07-11 14:47:07.384818 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:07.669543 I | ceph-mgr: 2017-07-11 14:47:07.669496 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10448 10.233.124.5:0/1819767914' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:07.675530 I | ceph-mgr: 2017-07-11 14:47:07.669513 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:08.805619 I | ceph-mgr: 2017-07-11 14:47:08.805515 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10454 10.233.124.5:0/4093875801' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:08.805739 I | ceph-mgr: 2017-07-11 14:47:08.805574 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:09.388174 I | ceph-mgr: 2017-07-11 14:47:09.388110 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:09.388428 I | ceph-mgr: 2017-07-11 14:47:09.388277 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:09.388640 I | ceph-mgr: 2017-07-11 14:47:09.388625 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:11.392796 I | ceph-mgr: 2017-07-11 14:47:11.392390 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:11.392891 I | ceph-mgr: 2017-07-11 14:47:11.392874 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:11.393109 I | ceph-mgr: 2017-07-11 14:47:11.393093 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:12.213539 I | ceph-mgr: 2017-07-11 14:47:12.213473 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10050 10.233.124.0:0/2589079441' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:12.213606 I | ceph-mgr: 2017-07-11 14:47:12.213494 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:13.201666 I | ceph-mgr: 2017-07-11 14:47:13.201597 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10475 10.233.124.5:0/1412070437' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:13.201757 I | ceph-mgr: 2017-07-11 14:47:13.201731 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:13.395964 I | ceph-mgr: 2017-07-11 14:47:13.395933 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:13.396021 I | ceph-mgr: 2017-07-11 14:47:13.396008 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:13.396187 I | ceph-mgr: 2017-07-11 14:47:13.396126 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:15.404745 I | ceph-mgr: 2017-07-11 14:47:15.404704 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:15.404811 I | ceph-mgr: 2017-07-11 14:47:15.404796 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:15.405005 I | ceph-mgr: 2017-07-11 14:47:15.404906 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:17.238562 I | ceph-mgr: 2017-07-11 14:47:17.238503 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10490 10.233.124.5:0/1500333868' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:17.238807 I | ceph-mgr: 2017-07-11 14:47:17.238681 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:17.415879 I | ceph-mgr: 2017-07-11 14:47:17.415445 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:17.415968 I | ceph-mgr: 2017-07-11 14:47:17.415952 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:17.416226 I | ceph-mgr: 2017-07-11 14:47:17.416209 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:18.469878 I | ceph-mgr: 2017-07-11 14:47:18.469697 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10059 10.233.124.0:0/263875178' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:18.469940 I | ceph-mgr: 2017-07-11 14:47:18.469792 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:19.429096 I | ceph-mgr: 2017-07-11 14:47:19.429050 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:19.429178 I | ceph-mgr: 2017-07-11 14:47:19.429165 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:19.429426 I | ceph-mgr: 2017-07-11 14:47:19.429411 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:21.431984 I | ceph-mgr: 2017-07-11 14:47:21.431846 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:21.432073 I | ceph-mgr: 2017-07-11 14:47:21.432057 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:21.432504 I | ceph-mgr: 2017-07-11 14:47:21.432487 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:22.093228 I | ceph-mgr: 2017-07-11 14:47:22.093156 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10074 10.233.124.0:0/2003018434' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:22.093298 I | ceph-mgr: 2017-07-11 14:47:22.093176 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:23.078336 I | ceph-mgr: 2017-07-11 14:47:23.078239 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10077 10.233.124.5:0/3617684185' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:23.078402 I | ceph-mgr: 2017-07-11 14:47:23.078295 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:23.452480 I | ceph-mgr: 2017-07-11 14:47:23.452410 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:23.454570 I | ceph-mgr: 2017-07-11 14:47:23.454551 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:23.454823 I | ceph-mgr: 2017-07-11 14:47:23.454798 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:25.479489 I | ceph-mgr: 2017-07-11 14:47:25.477790 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:25.479555 I | ceph-mgr: 2017-07-11 14:47:25.477802 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:25.479573 I | ceph-mgr: 2017-07-11 14:47:25.477832 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:27.249411 I | ceph-mgr: 2017-07-11 14:47:27.249364 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10514 10.233.124.5:0/2918326614' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:27.250442 I | ceph-mgr: 2017-07-11 14:47:27.250389 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:27.502387 I | ceph-mgr: 2017-07-11 14:47:27.500125 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:27.502485 I | ceph-mgr: 2017-07-11 14:47:27.502456 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:27.502807 I | ceph-mgr: 2017-07-11 14:47:27.502791 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:28.389349 I | ceph-mgr: 2017-07-11 14:47:28.389322 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10520 10.233.124.5:0/4056896728' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:28.391422 I | ceph-mgr: 2017-07-11 14:47:28.389861 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:29.527447 I | ceph-mgr: 2017-07-11 14:47:29.527404 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:29.527531 I | ceph-mgr: 2017-07-11 14:47:29.527517 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:29.527768 I | ceph-mgr: 2017-07-11 14:47:29.527752 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:31.535427 I | ceph-mgr: 2017-07-11 14:47:31.535400 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:31.535497 I | ceph-mgr: 2017-07-11 14:47:31.535483 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:31.535664 I | ceph-mgr: 2017-07-11 14:47:31.535599 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:31.922645 I | ceph-mgr: 2017-07-11 14:47:31.922587 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10538 10.233.124.5:0/2771508888' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:31.922702 I | ceph-mgr: 2017-07-11 14:47:31.922607 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:32.951838 I | ceph-mgr: 2017-07-11 14:47:32.951763 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10544 10.233.124.5:0/2945713365' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:32.951937 I | ceph-mgr: 2017-07-11 14:47:32.951904 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:33.554329 I | ceph-mgr: 2017-07-11 14:47:33.552941 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:33.554535 I | ceph-mgr: 2017-07-11 14:47:33.552958 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:33.554632 I | ceph-mgr: 2017-07-11 14:47:33.552983 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:35.567834 I | ceph-mgr: 2017-07-11 14:47:35.557915 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:35.568260 I | ceph-mgr: 2017-07-11 14:47:35.557921 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:35.568290 I | ceph-mgr: 2017-07-11 14:47:35.557942 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:36.975227 I | ceph-mgr: 2017-07-11 14:47:36.975169 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10562 10.233.124.5:0/1106608124' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:36.975388 I | ceph-mgr: 2017-07-11 14:47:36.975297 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:37.645938 I | ceph-mgr: 2017-07-11 14:47:37.629498 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:37.646152 I | ceph-mgr: 2017-07-11 14:47:37.629505 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:37.646178 I | ceph-mgr: 2017-07-11 14:47:37.629528 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:38.216328 I | ceph-mgr: 2017-07-11 14:47:38.216221 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10565 10.233.124.5:0/2350360168' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:38.218466 I | ceph-mgr: 2017-07-11 14:47:38.216272 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:39.652633 I | ceph-mgr: 2017-07-11 14:47:39.652559 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:39.652887 I | ceph-mgr: 2017-07-11 14:47:39.652741 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:39.653078 I | ceph-mgr: 2017-07-11 14:47:39.653064 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:41.669146 I | ceph-mgr: 2017-07-11 14:47:41.669101 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:41.669321 I | ceph-mgr: 2017-07-11 14:47:41.669305 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:41.669610 I | ceph-mgr: 2017-07-11 14:47:41.669584 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:41.823247 I | ceph-mgr: 2017-07-11 14:47:41.823184 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10577 10.233.124.5:0/2224636787' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:41.824230 I | ceph-mgr: 2017-07-11 14:47:41.823204 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:42.891910 I | ceph-mgr: 2017-07-11 14:47:42.891821 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10580 10.233.124.5:0/3849982964' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:42.891967 I | ceph-mgr: 2017-07-11 14:47:42.891868 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:43.694168 I | ceph-mgr: 2017-07-11 14:47:43.694125 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:43.694253 I | ceph-mgr: 2017-07-11 14:47:43.694239 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:43.694527 I | ceph-mgr: 2017-07-11 14:47:43.694511 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:45.704432 I | ceph-mgr: 2017-07-11 14:47:45.704402 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:45.704522 I | ceph-mgr: 2017-07-11 14:47:45.704509 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:45.704711 I | ceph-mgr: 2017-07-11 14:47:45.704684 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:46.721563 I | ceph-mgr: 2017-07-11 14:47:46.721505 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10589 10.233.124.5:0/1335855120' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:46.721620 I | ceph-mgr: 2017-07-11 14:47:46.721525 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:47.710738 I | ceph-mgr: 2017-07-11 14:47:47.708653 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:47.712538 I | ceph-mgr: 2017-07-11 14:47:47.708663 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:47.712569 I | ceph-mgr: 2017-07-11 14:47:47.708688 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:48.171142 I | ceph-mgr: 2017-07-11 14:47:48.171065 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10137 10.233.124.0:0/1933847084' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:48.171232 I | ceph-mgr: 2017-07-11 14:47:48.171200 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:49.726495 I | ceph-mgr: 2017-07-11 14:47:49.710653 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:49.726579 I | ceph-mgr: 2017-07-11 14:47:49.710659 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:49.726603 I | ceph-mgr: 2017-07-11 14:47:49.710680 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:51.588535 I | ceph-mgr: 2017-07-11 14:47:51.588453 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10149 10.233.124.0:0/476589543' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:51.588596 I | ceph-mgr: 2017-07-11 14:47:51.588483 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:51.735009 I | ceph-mgr: 2017-07-11 14:47:51.734988 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:51.735066 I | ceph-mgr: 2017-07-11 14:47:51.735053 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:51.735173 I | ceph-mgr: 2017-07-11 14:47:51.735159 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:52.642962 I | ceph-mgr: 2017-07-11 14:47:52.642862 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10155 10.233.124.5:0/2523456320' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:52.648824 I | ceph-mgr: 2017-07-11 14:47:52.642908 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:53.755872 I | ceph-mgr: 2017-07-11 14:47:53.755810 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:53.756169 I | ceph-mgr: 2017-07-11 14:47:53.756154 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:53.758816 I | ceph-mgr: 2017-07-11 14:47:53.758801 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:55.780986 I | ceph-mgr: 2017-07-11 14:47:55.780933 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:55.781108 I | ceph-mgr: 2017-07-11 14:47:55.781093 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:55.781686 I | ceph-mgr: 2017-07-11 14:47:55.781667 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:56.824355 I | ceph-mgr: 2017-07-11 14:47:56.824290 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6118 10.233.124.0:0/1945127282' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:56.824452 I | ceph-mgr: 2017-07-11 14:47:56.824310 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:57.793137 I | ceph-mgr: 2017-07-11 14:47:57.793100 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:57.793221 I | ceph-mgr: 2017-07-11 14:47:57.793206 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:57.793496 I | ceph-mgr: 2017-07-11 14:47:57.793479 7f4cc3226700 0 mgr tick
- 2017-07-11 14:47:58.017819 I | ceph-mgr: 2017-07-11 14:47:58.017728 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10619 10.233.124.5:0/2101288957' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:47:58.017892 I | ceph-mgr: 2017-07-11 14:47:58.017774 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:47:59.800361 I | ceph-mgr: 2017-07-11 14:47:59.798829 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:47:59.800439 I | ceph-mgr: 2017-07-11 14:47:59.800424 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:47:59.800661 I | ceph-mgr: 2017-07-11 14:47:59.800646 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:01.385684 I | ceph-mgr: 2017-07-11 14:48:01.385622 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10634 10.233.124.5:0/878690511' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:01.386354 I | ceph-mgr: 2017-07-11 14:48:01.385642 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:01.836933 I | ceph-mgr: 2017-07-11 14:48:01.826647 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:01.837128 I | ceph-mgr: 2017-07-11 14:48:01.826652 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:01.837155 I | ceph-mgr: 2017-07-11 14:48:01.826673 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:02.282552 I | ceph-mgr: 2017-07-11 14:48:02.282460 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10173 10.233.124.0:0/1212428047' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:02.282726 I | ceph-mgr: 2017-07-11 14:48:02.282635 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:03.835684 I | ceph-mgr: 2017-07-11 14:48:03.834408 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:03.842947 I | ceph-mgr: 2017-07-11 14:48:03.834419 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:03.842991 I | ceph-mgr: 2017-07-11 14:48:03.834445 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:05.840914 I | ceph-mgr: 2017-07-11 14:48:05.839572 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:05.841356 I | ceph-mgr: 2017-07-11 14:48:05.839581 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:05.841377 I | ceph-mgr: 2017-07-11 14:48:05.839608 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:06.460550 I | ceph-mgr: 2017-07-11 14:48:06.460505 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10652 10.233.124.5:0/860460090' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:06.460732 I | ceph-mgr: 2017-07-11 14:48:06.460636 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:07.410935 I | ceph-mgr: 2017-07-11 14:48:07.410860 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10658 10.233.124.5:0/4219386086' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:07.411036 I | ceph-mgr: 2017-07-11 14:48:07.411009 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:07.850045 I | ceph-mgr: 2017-07-11 14:48:07.849888 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:07.850162 I | ceph-mgr: 2017-07-11 14:48:07.849900 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:07.850431 I | ceph-mgr: 2017-07-11 14:48:07.850415 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:09.851987 I | ceph-mgr: 2017-07-11 14:48:09.851950 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:09.852057 I | ceph-mgr: 2017-07-11 14:48:09.852043 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:09.852317 I | ceph-mgr: 2017-07-11 14:48:09.852300 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:11.301084 I | ceph-mgr: 2017-07-11 14:48:11.301031 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10670 10.233.124.5:0/3436406943' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:11.301266 I | ceph-mgr: 2017-07-11 14:48:11.301170 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:11.874374 I | ceph-mgr: 2017-07-11 14:48:11.873035 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:11.874443 I | ceph-mgr: 2017-07-11 14:48:11.873058 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:11.874459 I | ceph-mgr: 2017-07-11 14:48:11.873091 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:12.343327 I | ceph-mgr: 2017-07-11 14:48:12.343250 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10673 10.233.124.5:0/3452575382' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:12.343421 I | ceph-mgr: 2017-07-11 14:48:12.343394 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:13.896853 I | ceph-mgr: 2017-07-11 14:48:13.878907 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:13.897434 I | ceph-mgr: 2017-07-11 14:48:13.878925 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:13.897468 I | ceph-mgr: 2017-07-11 14:48:13.878956 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:15.889207 I | ceph-mgr: 2017-07-11 14:48:15.887851 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:15.889267 I | ceph-mgr: 2017-07-11 14:48:15.887862 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:15.889283 I | ceph-mgr: 2017-07-11 14:48:15.887902 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:16.291048 I | ceph-mgr: 2017-07-11 14:48:16.290986 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10206 10.233.124.0:0/316542411' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:16.291093 I | ceph-mgr: 2017-07-11 14:48:16.291005 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:17.179076 I | ceph-mgr: 2017-07-11 14:48:17.179002 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10688 10.233.124.5:0/3536386569' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:17.179162 I | ceph-mgr: 2017-07-11 14:48:17.179136 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:17.904694 I | ceph-mgr: 2017-07-11 14:48:17.896149 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:17.904846 I | ceph-mgr: 2017-07-11 14:48:17.896155 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:17.904865 I | ceph-mgr: 2017-07-11 14:48:17.898442 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:19.917321 I | ceph-mgr: 2017-07-11 14:48:19.917273 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:19.917539 I | ceph-mgr: 2017-07-11 14:48:19.917524 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:19.918125 I | ceph-mgr: 2017-07-11 14:48:19.917648 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:21.183185 I | ceph-mgr: 2017-07-11 14:48:21.183060 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10703 10.233.124.5:0/1625259584' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:21.183262 I | ceph-mgr: 2017-07-11 14:48:21.183098 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:21.928869 I | ceph-mgr: 2017-07-11 14:48:21.928835 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:21.928948 I | ceph-mgr: 2017-07-11 14:48:21.928934 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:21.946287 I | ceph-mgr: 2017-07-11 14:48:21.929050 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:22.108734 I | ceph-mgr: 2017-07-11 14:48:22.108581 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10709 10.233.124.5:0/333980016' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:22.108802 I | ceph-mgr: 2017-07-11 14:48:22.108633 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:23.955143 I | ceph-mgr: 2017-07-11 14:48:23.947378 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:23.955549 I | ceph-mgr: 2017-07-11 14:48:23.947392 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:23.955595 I | ceph-mgr: 2017-07-11 14:48:23.947491 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:25.963460 I | ceph-mgr: 2017-07-11 14:48:25.955384 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:25.963486 I | ceph-mgr: 2017-07-11 14:48:25.955403 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:25.972476 I | ceph-mgr: 2017-07-11 14:48:25.955480 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:26.331619 I | ceph-mgr: 2017-07-11 14:48:26.331516 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10718 10.233.124.5:0/2329470293' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:26.341348 I | ceph-mgr: 2017-07-11 14:48:26.331542 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:27.232998 I | ceph-mgr: 2017-07-11 14:48:27.232825 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10724 10.233.124.5:0/1535180442' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:27.233063 I | ceph-mgr: 2017-07-11 14:48:27.232891 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:27.975401 I | ceph-mgr: 2017-07-11 14:48:27.975274 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:27.975471 I | ceph-mgr: 2017-07-11 14:48:27.975291 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:27.975755 I | ceph-mgr: 2017-07-11 14:48:27.975579 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:29.978508 I | ceph-mgr: 2017-07-11 14:48:29.978473 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:29.978680 I | ceph-mgr: 2017-07-11 14:48:29.978665 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:29.980632 I | ceph-mgr: 2017-07-11 14:48:29.980441 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:31.208029 I | ceph-mgr: 2017-07-11 14:48:31.207981 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10730 10.233.124.5:0/4120731343' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:31.217099 I | ceph-mgr: 2017-07-11 14:48:31.217068 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:31.989441 I | ceph-mgr: 2017-07-11 14:48:31.989380 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:31.989626 I | ceph-mgr: 2017-07-11 14:48:31.989545 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:31.989855 I | ceph-mgr: 2017-07-11 14:48:31.989840 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:32.138990 I | ceph-mgr: 2017-07-11 14:48:32.138929 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10733 10.233.124.5:0/1452106068' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:32.139060 I | ceph-mgr: 2017-07-11 14:48:32.139035 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:33.997065 I | ceph-mgr: 2017-07-11 14:48:33.996446 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:33.997132 I | ceph-mgr: 2017-07-11 14:48:33.996456 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:33.997147 I | ceph-mgr: 2017-07-11 14:48:33.996493 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:35.998358 I | ceph-mgr: 2017-07-11 14:48:35.998322 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:35.998428 I | ceph-mgr: 2017-07-11 14:48:35.998414 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:35.998634 I | ceph-mgr: 2017-07-11 14:48:35.998487 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:36.185463 I | ceph-mgr: 2017-07-11 14:48:36.185423 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10745 10.233.124.5:0/3407377619' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:36.185529 I | ceph-mgr: 2017-07-11 14:48:36.185505 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:37.065242 I | ceph-mgr: 2017-07-11 14:48:37.065167 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10260 10.233.124.5:0/870650516' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:37.065417 I | ceph-mgr: 2017-07-11 14:48:37.065333 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:38.004929 I | ceph-mgr: 2017-07-11 14:48:38.004895 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:38.005010 I | ceph-mgr: 2017-07-11 14:48:38.004996 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:38.005090 I | ceph-mgr: 2017-07-11 14:48:38.005081 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:40.024932 I | ceph-mgr: 2017-07-11 14:48:40.024886 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:40.032825 I | ceph-mgr: 2017-07-11 14:48:40.032782 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:40.042999 I | ceph-mgr: 2017-07-11 14:48:40.042982 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:41.045103 I | ceph-mgr: 2017-07-11 14:48:41.045050 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10275 10.233.124.0:0/593965065' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:41.060442 I | ceph-mgr: 2017-07-11 14:48:41.045172 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:41.981042 I | ceph-mgr: 2017-07-11 14:48:41.981014 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10763 10.233.124.5:0/354908893' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:41.981281 I | ceph-mgr: 2017-07-11 14:48:41.981265 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:42.050226 I | ceph-mgr: 2017-07-11 14:48:42.048874 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:42.050661 I | ceph-mgr: 2017-07-11 14:48:42.048879 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:42.050694 I | ceph-mgr: 2017-07-11 14:48:42.048898 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:44.055583 I | ceph-mgr: 2017-07-11 14:48:44.052413 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:44.055647 I | ceph-mgr: 2017-07-11 14:48:44.052431 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:44.055662 I | ceph-mgr: 2017-07-11 14:48:44.052480 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:45.934452 I | ceph-mgr: 2017-07-11 14:48:45.934403 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10775 10.233.124.5:0/3170500789' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:45.934634 I | ceph-mgr: 2017-07-11 14:48:45.934529 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:46.074006 I | ceph-mgr: 2017-07-11 14:48:46.072727 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:46.080852 I | ceph-mgr: 2017-07-11 14:48:46.072732 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:46.080885 I | ceph-mgr: 2017-07-11 14:48:46.072751 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:47.136509 I | ceph-mgr: 2017-07-11 14:48:47.136433 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10781 10.233.124.5:0/2909010573' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:47.136594 I | ceph-mgr: 2017-07-11 14:48:47.136567 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:48.075470 I | ceph-mgr: 2017-07-11 14:48:48.074032 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:48.075671 I | ceph-mgr: 2017-07-11 14:48:48.074051 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:48.075822 I | ceph-mgr: 2017-07-11 14:48:48.074094 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:50.078181 I | ceph-mgr: 2017-07-11 14:48:50.078147 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:50.078276 I | ceph-mgr: 2017-07-11 14:48:50.078262 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:50.078498 I | ceph-mgr: 2017-07-11 14:48:50.078483 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:50.831495 I | ceph-mgr: 2017-07-11 14:48:50.831470 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10296 10.233.124.0:0/3641581431' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:50.831588 I | ceph-mgr: 2017-07-11 14:48:50.831574 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:52.088178 I | ceph-mgr: 2017-07-11 14:48:52.088143 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:52.088265 I | ceph-mgr: 2017-07-11 14:48:52.088250 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:52.088513 I | ceph-mgr: 2017-07-11 14:48:52.088496 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:52.565955 I | ceph-mgr: 2017-07-11 14:48:52.565927 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10802 10.233.124.5:0/3011591468' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:52.567444 I | ceph-mgr: 2017-07-11 14:48:52.567419 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:54.096168 I | ceph-mgr: 2017-07-11 14:48:54.096099 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:54.096375 I | ceph-mgr: 2017-07-11 14:48:54.096286 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:54.096620 I | ceph-mgr: 2017-07-11 14:48:54.096605 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:56.077427 I | ceph-mgr: 2017-07-11 14:48:56.077402 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10311 10.233.124.0:0/1616264221' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:56.077619 I | ceph-mgr: 2017-07-11 14:48:56.077603 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:56.105963 I | ceph-mgr: 2017-07-11 14:48:56.105913 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:56.106080 I | ceph-mgr: 2017-07-11 14:48:56.106051 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:56.106351 I | ceph-mgr: 2017-07-11 14:48:56.106242 7f4cc3226700 0 mgr tick
- 2017-07-11 14:48:57.000297 I | ceph-mgr: 2017-07-11 14:48:57.000223 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10320 10.233.124.0:0/354949254' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:48:57.000385 I | ceph-mgr: 2017-07-11 14:48:57.000370 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:48:58.111136 I | ceph-mgr: 2017-07-11 14:48:58.111083 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:48:58.111240 I | ceph-mgr: 2017-07-11 14:48:58.111225 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:48:58.111544 I | ceph-mgr: 2017-07-11 14:48:58.111529 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:00.125028 I | ceph-mgr: 2017-07-11 14:49:00.115256 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:00.125102 I | ceph-mgr: 2017-07-11 14:49:00.115262 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:00.125118 I | ceph-mgr: 2017-07-11 14:49:00.115285 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:00.799927 I | ceph-mgr: 2017-07-11 14:49:00.799875 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10817 10.233.124.5:0/2613409411' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:00.800013 I | ceph-mgr: 2017-07-11 14:49:00.799986 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:01.908092 I | ceph-mgr: 2017-07-11 14:49:01.908021 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10338 10.233.124.0:0/992051986' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:01.908184 I | ceph-mgr: 2017-07-11 14:49:01.908157 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:02.138328 I | ceph-mgr: 2017-07-11 14:49:02.128555 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:02.138547 I | ceph-mgr: 2017-07-11 14:49:02.128569 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:02.138646 I | ceph-mgr: 2017-07-11 14:49:02.128611 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:04.149194 I | ceph-mgr: 2017-07-11 14:49:04.144920 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:04.154989 I | ceph-mgr: 2017-07-11 14:49:04.144925 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:04.155038 I | ceph-mgr: 2017-07-11 14:49:04.144949 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:05.643120 I | ceph-mgr: 2017-07-11 14:49:05.643066 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10344 10.233.124.0:0/3374338299' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:05.643219 I | ceph-mgr: 2017-07-11 14:49:05.643193 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:06.154527 I | ceph-mgr: 2017-07-11 14:49:06.150928 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:06.154585 I | ceph-mgr: 2017-07-11 14:49:06.150934 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:06.154601 I | ceph-mgr: 2017-07-11 14:49:06.150956 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:06.610698 I | ceph-mgr: 2017-07-11 14:49:06.610614 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10841 10.233.124.5:0/2750702861' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:06.610775 I | ceph-mgr: 2017-07-11 14:49:06.610748 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:08.169116 I | ceph-mgr: 2017-07-11 14:49:08.152590 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:08.169322 I | ceph-mgr: 2017-07-11 14:49:08.152600 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:08.169351 I | ceph-mgr: 2017-07-11 14:49:08.152626 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:10.171612 I | ceph-mgr: 2017-07-11 14:49:10.171555 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:10.171797 I | ceph-mgr: 2017-07-11 14:49:10.171712 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:10.172054 I | ceph-mgr: 2017-07-11 14:49:10.172037 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:10.565378 I | ceph-mgr: 2017-07-11 14:49:10.565313 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10856 10.233.124.5:0/3818633514' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:10.565442 I | ceph-mgr: 2017-07-11 14:49:10.565334 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:11.478037 I | ceph-mgr: 2017-07-11 14:49:11.477957 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10362 10.233.124.0:0/563270105' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:11.478125 I | ceph-mgr: 2017-07-11 14:49:11.478098 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:12.192281 I | ceph-mgr: 2017-07-11 14:49:12.190976 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:12.192445 I | ceph-mgr: 2017-07-11 14:49:12.190983 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:12.208075 I | ceph-mgr: 2017-07-11 14:49:12.191007 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:14.196953 I | ceph-mgr: 2017-07-11 14:49:14.194122 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:14.197034 I | ceph-mgr: 2017-07-11 14:49:14.194136 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:14.197051 I | ceph-mgr: 2017-07-11 14:49:14.194171 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:15.852803 I | ceph-mgr: 2017-07-11 14:49:15.843114 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10871 10.233.124.5:0/894074873' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:15.852850 I | ceph-mgr: 2017-07-11 14:49:15.843136 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:16.208778 I | ceph-mgr: 2017-07-11 14:49:16.200469 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:16.208830 I | ceph-mgr: 2017-07-11 14:49:16.200474 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:16.208856 I | ceph-mgr: 2017-07-11 14:49:16.200493 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:17.058092 I | ceph-mgr: 2017-07-11 14:49:17.057883 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10874 10.233.124.5:0/1507541469' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:17.058188 I | ceph-mgr: 2017-07-11 14:49:17.057959 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:18.215523 I | ceph-mgr: 2017-07-11 14:49:18.205792 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:18.215598 I | ceph-mgr: 2017-07-11 14:49:18.205818 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:18.215614 I | ceph-mgr: 2017-07-11 14:49:18.205904 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:20.234014 I | ceph-mgr: 2017-07-11 14:49:20.217138 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:20.234091 I | ceph-mgr: 2017-07-11 14:49:20.217155 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:20.234108 I | ceph-mgr: 2017-07-11 14:49:20.217223 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:20.350610 I | ceph-mgr: 2017-07-11 14:49:20.350563 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6193 10.233.124.0:0/32012632' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:20.350648 I | ceph-mgr: 2017-07-11 14:49:20.350581 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:21.269267 I | ceph-mgr: 2017-07-11 14:49:21.259017 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10392 10.233.124.0:0/665368388' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:21.269385 I | ceph-mgr: 2017-07-11 14:49:21.259084 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:22.240017 I | ceph-mgr: 2017-07-11 14:49:22.238457 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:22.240195 I | ceph-mgr: 2017-07-11 14:49:22.238471 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:22.240255 I | ceph-mgr: 2017-07-11 14:49:22.238505 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:24.252900 I | ceph-mgr: 2017-07-11 14:49:24.243622 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:24.252966 I | ceph-mgr: 2017-07-11 14:49:24.243631 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:24.252982 I | ceph-mgr: 2017-07-11 14:49:24.243656 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:25.472731 I | ceph-mgr: 2017-07-11 14:49:25.472680 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10895 10.233.124.5:0/3880671909' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:25.473061 I | ceph-mgr: 2017-07-11 14:49:25.473032 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:26.248262 I | ceph-mgr: 2017-07-11 14:49:26.247493 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:26.248490 I | ceph-mgr: 2017-07-11 14:49:26.247498 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:26.248587 I | ceph-mgr: 2017-07-11 14:49:26.247519 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:26.386640 I | ceph-mgr: 2017-07-11 14:49:26.386573 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10901 10.233.124.5:0/3606243879' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:26.386714 I | ceph-mgr: 2017-07-11 14:49:26.386687 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:28.250989 I | ceph-mgr: 2017-07-11 14:49:28.250807 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:28.251137 I | ceph-mgr: 2017-07-11 14:49:28.250812 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:28.251184 I | ceph-mgr: 2017-07-11 14:49:28.250834 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:30.231955 I | ceph-mgr: 2017-07-11 14:49:30.231851 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10913 10.233.124.5:0/2707382996' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:30.232020 I | ceph-mgr: 2017-07-11 14:49:30.231888 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:30.270640 I | ceph-mgr: 2017-07-11 14:49:30.254918 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:30.270783 I | ceph-mgr: 2017-07-11 14:49:30.254923 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:30.270802 I | ceph-mgr: 2017-07-11 14:49:30.254943 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:31.131150 I | ceph-mgr: 2017-07-11 14:49:31.131062 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10916 10.233.124.5:0/3684595180' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:31.131304 I | ceph-mgr: 2017-07-11 14:49:31.131108 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:32.281608 I | ceph-mgr: 2017-07-11 14:49:32.280180 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:32.281816 I | ceph-mgr: 2017-07-11 14:49:32.280194 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:32.281913 I | ceph-mgr: 2017-07-11 14:49:32.280223 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:34.284005 I | ceph-mgr: 2017-07-11 14:49:34.282699 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:34.290558 I | ceph-mgr: 2017-07-11 14:49:34.282704 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:34.290594 I | ceph-mgr: 2017-07-11 14:49:34.282724 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:35.098846 I | ceph-mgr: 2017-07-11 14:49:35.098798 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10934 10.233.124.5:0/244800531' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:35.098942 I | ceph-mgr: 2017-07-11 14:49:35.098917 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:36.227751 I | ceph-mgr: 2017-07-11 14:49:36.227666 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10940 10.233.124.5:0/2755415483' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:36.227856 I | ceph-mgr: 2017-07-11 14:49:36.227829 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:36.286723 I | ceph-mgr: 2017-07-11 14:49:36.286701 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:36.286774 I | ceph-mgr: 2017-07-11 14:49:36.286761 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:36.287000 I | ceph-mgr: 2017-07-11 14:49:36.286887 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:38.303467 I | ceph-mgr: 2017-07-11 14:49:38.303435 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:38.303546 I | ceph-mgr: 2017-07-11 14:49:38.303533 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:38.303775 I | ceph-mgr: 2017-07-11 14:49:38.303759 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:40.216196 I | ceph-mgr: 2017-07-11 14:49:40.216125 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10952 10.233.124.5:0/3829022366' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:40.216398 I | ceph-mgr: 2017-07-11 14:49:40.216290 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:40.307801 I | ceph-mgr: 2017-07-11 14:49:40.306420 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:40.316156 I | ceph-mgr: 2017-07-11 14:49:40.306426 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:40.316189 I | ceph-mgr: 2017-07-11 14:49:40.306447 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:41.123579 I | ceph-mgr: 2017-07-11 14:49:41.123484 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10446 10.233.124.5:0/138426935' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:41.123643 I | ceph-mgr: 2017-07-11 14:49:41.123537 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:42.311986 I | ceph-mgr: 2017-07-11 14:49:42.311361 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:42.312048 I | ceph-mgr: 2017-07-11 14:49:42.311370 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:42.312064 I | ceph-mgr: 2017-07-11 14:49:42.311397 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:44.319079 I | ceph-mgr: 2017-07-11 14:49:44.317918 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:44.319152 I | ceph-mgr: 2017-07-11 14:49:44.317924 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:44.319169 I | ceph-mgr: 2017-07-11 14:49:44.317946 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:45.198991 I | ceph-mgr: 2017-07-11 14:49:45.198908 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10455 10.233.124.0:0/1728625318' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:45.199132 I | ceph-mgr: 2017-07-11 14:49:45.199105 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:46.339124 I | ceph-mgr: 2017-07-11 14:49:46.323038 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:46.339186 I | ceph-mgr: 2017-07-11 14:49:46.323043 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:46.339202 I | ceph-mgr: 2017-07-11 14:49:46.323063 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:46.427293 I | ceph-mgr: 2017-07-11 14:49:46.427217 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10970 10.233.124.5:0/758298369' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:46.427487 I | ceph-mgr: 2017-07-11 14:49:46.427262 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:48.340297 I | ceph-mgr: 2017-07-11 14:49:48.340260 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:48.340375 I | ceph-mgr: 2017-07-11 14:49:48.340361 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:48.346319 I | ceph-mgr: 2017-07-11 14:49:48.340471 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:50.350307 I | ceph-mgr: 2017-07-11 14:49:50.350275 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:50.350385 I | ceph-mgr: 2017-07-11 14:49:50.350371 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:50.350560 I | ceph-mgr: 2017-07-11 14:49:50.350486 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:50.409372 I | ceph-mgr: 2017-07-11 14:49:50.409324 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10464 10.233.124.0:0/2472035997' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:50.412613 I | ceph-mgr: 2017-07-11 14:49:50.409342 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:51.261614 I | ceph-mgr: 2017-07-11 14:49:51.261505 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10988 10.233.124.5:0/3671595109' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:51.268176 I | ceph-mgr: 2017-07-11 14:49:51.261552 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:52.354708 I | ceph-mgr: 2017-07-11 14:49:52.354672 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:52.354889 I | ceph-mgr: 2017-07-11 14:49:52.354873 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:52.356694 I | ceph-mgr: 2017-07-11 14:49:52.356665 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:54.359165 I | ceph-mgr: 2017-07-11 14:49:54.359134 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:54.362403 I | ceph-mgr: 2017-07-11 14:49:54.362386 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:54.362604 I | ceph-mgr: 2017-07-11 14:49:54.362492 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:55.026088 I | ceph-mgr: 2017-07-11 14:49:55.026009 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10479 10.233.124.0:0/1405044727' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:55.026163 I | ceph-mgr: 2017-07-11 14:49:55.026040 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:56.276139 I | ceph-mgr: 2017-07-11 14:49:56.276052 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11006 10.233.124.5:0/2152270090' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:56.278692 I | ceph-mgr: 2017-07-11 14:49:56.276100 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:49:56.383699 I | ceph-mgr: 2017-07-11 14:49:56.383645 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:56.383901 I | ceph-mgr: 2017-07-11 14:49:56.383886 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:56.387158 I | ceph-mgr: 2017-07-11 14:49:56.387141 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:58.411282 I | ceph-mgr: 2017-07-11 14:49:58.411250 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:49:58.411367 I | ceph-mgr: 2017-07-11 14:49:58.411353 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:49:58.411719 I | ceph-mgr: 2017-07-11 14:49:58.411527 7f4cc3226700 0 mgr tick
- 2017-07-11 14:49:59.740122 I | ceph-mgr: 2017-07-11 14:49:59.740061 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10494 10.233.124.0:0/1736954221' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:49:59.740184 I | ceph-mgr: 2017-07-11 14:49:59.740081 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:00.415990 I | ceph-mgr: 2017-07-11 14:50:00.415960 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:00.416071 I | ceph-mgr: 2017-07-11 14:50:00.416058 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:00.416343 I | ceph-mgr: 2017-07-11 14:50:00.416326 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:00.678967 I | ceph-mgr: 2017-07-11 14:50:00.678885 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11015 10.233.124.5:0/2526817514' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:00.679017 I | ceph-mgr: 2017-07-11 14:50:00.678930 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:02.419136 I | ceph-mgr: 2017-07-11 14:50:02.419089 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:02.419215 I | ceph-mgr: 2017-07-11 14:50:02.419199 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:02.419490 I | ceph-mgr: 2017-07-11 14:50:02.419473 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:04.428997 I | ceph-mgr: 2017-07-11 14:50:04.428966 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:04.429083 I | ceph-mgr: 2017-07-11 14:50:04.429067 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:04.429300 I | ceph-mgr: 2017-07-11 14:50:04.429285 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:04.710900 I | ceph-mgr: 2017-07-11 14:50:04.710846 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11024 10.233.124.5:0/1553340565' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:04.710949 I | ceph-mgr: 2017-07-11 14:50:04.710865 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:05.782379 I | ceph-mgr: 2017-07-11 14:50:05.782258 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10512 10.233.124.0:0/671828285' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:05.782433 I | ceph-mgr: 2017-07-11 14:50:05.782338 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:06.432095 I | ceph-mgr: 2017-07-11 14:50:06.432059 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:06.432183 I | ceph-mgr: 2017-07-11 14:50:06.432169 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:06.432411 I | ceph-mgr: 2017-07-11 14:50:06.432396 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:08.452147 I | ceph-mgr: 2017-07-11 14:50:08.452120 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:08.452225 I | ceph-mgr: 2017-07-11 14:50:08.452212 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:08.452618 I | ceph-mgr: 2017-07-11 14:50:08.452329 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:09.858639 I | ceph-mgr: 2017-07-11 14:50:09.858561 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11045 10.233.124.5:0/3137393961' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:09.858746 I | ceph-mgr: 2017-07-11 14:50:09.858583 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:10.457991 I | ceph-mgr: 2017-07-11 14:50:10.457959 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:10.458217 I | ceph-mgr: 2017-07-11 14:50:10.458202 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:10.459908 I | ceph-mgr: 2017-07-11 14:50:10.459893 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:10.756282 I | ceph-mgr: 2017-07-11 14:50:10.756166 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11051 10.233.124.5:0/219819722' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:10.758059 I | ceph-mgr: 2017-07-11 14:50:10.756226 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:12.461729 I | ceph-mgr: 2017-07-11 14:50:12.461689 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:12.461839 I | ceph-mgr: 2017-07-11 14:50:12.461814 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:12.462144 I | ceph-mgr: 2017-07-11 14:50:12.462118 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:14.465779 I | ceph-mgr: 2017-07-11 14:50:14.465745 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:14.465860 I | ceph-mgr: 2017-07-11 14:50:14.465846 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:14.466036 I | ceph-mgr: 2017-07-11 14:50:14.466021 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:14.679077 I | ceph-mgr: 2017-07-11 14:50:14.679012 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11069 10.233.124.0:0/2205642310' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:14.679127 I | ceph-mgr: 2017-07-11 14:50:14.679031 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:15.730268 I | ceph-mgr: 2017-07-11 14:50:15.730177 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10533 10.233.124.0:0/3516074934' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:15.730323 I | ceph-mgr: 2017-07-11 14:50:15.730223 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:16.487809 I | ceph-mgr: 2017-07-11 14:50:16.487770 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:16.487980 I | ceph-mgr: 2017-07-11 14:50:16.487965 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:16.489024 I | ceph-mgr: 2017-07-11 14:50:16.489009 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:18.502156 I | ceph-mgr: 2017-07-11 14:50:18.499104 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:18.502591 I | ceph-mgr: 2017-07-11 14:50:18.499109 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:18.502625 I | ceph-mgr: 2017-07-11 14:50:18.499128 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:19.487497 I | ceph-mgr: 2017-07-11 14:50:19.487405 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10545 10.233.124.0:0/246158959' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:19.487567 I | ceph-mgr: 2017-07-11 14:50:19.487424 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:20.385956 I | ceph-mgr: 2017-07-11 14:50:20.385879 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11087 10.233.124.5:0/2423471367' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:20.388908 I | ceph-mgr: 2017-07-11 14:50:20.388878 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:20.512075 I | ceph-mgr: 2017-07-11 14:50:20.505095 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:20.512149 I | ceph-mgr: 2017-07-11 14:50:20.512132 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:20.521790 I | ceph-mgr: 2017-07-11 14:50:20.512252 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:22.539893 I | ceph-mgr: 2017-07-11 14:50:22.539847 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:22.539984 I | ceph-mgr: 2017-07-11 14:50:22.539971 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:22.540243 I | ceph-mgr: 2017-07-11 14:50:22.540228 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:24.537337 I | ceph-mgr: 2017-07-11 14:50:24.537287 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11099 10.233.124.5:0/631818007' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:24.537510 I | ceph-mgr: 2017-07-11 14:50:24.537426 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:24.546650 I | ceph-mgr: 2017-07-11 14:50:24.546629 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:24.546796 I | ceph-mgr: 2017-07-11 14:50:24.546782 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:24.546943 I | ceph-mgr: 2017-07-11 14:50:24.546893 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:25.761072 I | ceph-mgr: 2017-07-11 14:50:25.760990 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10563 10.233.124.0:0/279377413' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:25.761254 I | ceph-mgr: 2017-07-11 14:50:25.761157 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:26.558794 I | ceph-mgr: 2017-07-11 14:50:26.558755 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:26.558878 I | ceph-mgr: 2017-07-11 14:50:26.558862 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:26.559202 I | ceph-mgr: 2017-07-11 14:50:26.559176 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:28.567256 I | ceph-mgr: 2017-07-11 14:50:28.567192 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:28.567408 I | ceph-mgr: 2017-07-11 14:50:28.567345 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:28.567590 I | ceph-mgr: 2017-07-11 14:50:28.567506 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:29.334995 I | ceph-mgr: 2017-07-11 14:50:29.334930 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10572 10.233.124.0:0/1756354141' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:29.336720 I | ceph-mgr: 2017-07-11 14:50:29.334950 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:30.247217 I | ceph-mgr: 2017-07-11 14:50:30.247137 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10578 10.233.124.0:0/1818277536' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:30.247306 I | ceph-mgr: 2017-07-11 14:50:30.247281 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:30.569910 I | ceph-mgr: 2017-07-11 14:50:30.569858 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:30.570143 I | ceph-mgr: 2017-07-11 14:50:30.570000 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:30.570412 I | ceph-mgr: 2017-07-11 14:50:30.570396 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:32.588087 I | ceph-mgr: 2017-07-11 14:50:32.577942 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:32.588525 I | ceph-mgr: 2017-07-11 14:50:32.577954 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:32.588556 I | ceph-mgr: 2017-07-11 14:50:32.577994 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:34.342393 I | ceph-mgr: 2017-07-11 14:50:34.342365 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11126 10.233.124.5:0/4182996758' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:34.342501 I | ceph-mgr: 2017-07-11 14:50:34.342487 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:34.592984 I | ceph-mgr: 2017-07-11 14:50:34.582780 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:34.593028 I | ceph-mgr: 2017-07-11 14:50:34.582793 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:34.593044 I | ceph-mgr: 2017-07-11 14:50:34.582832 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:35.344019 I | ceph-mgr: 2017-07-11 14:50:35.343992 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10590 10.233.124.0:0/1720935816' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:35.344213 I | ceph-mgr: 2017-07-11 14:50:35.344182 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:36.596394 I | ceph-mgr: 2017-07-11 14:50:36.596323 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:36.596620 I | ceph-mgr: 2017-07-11 14:50:36.596604 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:36.596884 I | ceph-mgr: 2017-07-11 14:50:36.596869 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:38.621302 I | ceph-mgr: 2017-07-11 14:50:38.612259 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:38.621360 I | ceph-mgr: 2017-07-11 14:50:38.612266 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:38.621488 I | ceph-mgr: 2017-07-11 14:50:38.612290 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:39.308464 I | ceph-mgr: 2017-07-11 14:50:39.308435 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10611 10.233.124.0:0/2212028751' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:39.308564 I | ceph-mgr: 2017-07-11 14:50:39.308550 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:40.316627 I | ceph-mgr: 2017-07-11 14:50:40.316547 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11138 10.233.124.5:0/1687902295' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:40.316831 I | ceph-mgr: 2017-07-11 14:50:40.316711 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:40.635495 I | ceph-mgr: 2017-07-11 14:50:40.622670 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:40.648860 I | ceph-mgr: 2017-07-11 14:50:40.622678 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:40.648912 I | ceph-mgr: 2017-07-11 14:50:40.622703 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:42.651338 I | ceph-mgr: 2017-07-11 14:50:42.651283 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:42.651428 I | ceph-mgr: 2017-07-11 14:50:42.651413 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:42.661292 I | ceph-mgr: 2017-07-11 14:50:42.661269 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:44.109925 I | ceph-mgr: 2017-07-11 14:50:44.109862 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11147 10.233.124.5:0/3187184639' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:44.110024 I | ceph-mgr: 2017-07-11 14:50:44.109998 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:44.663784 I | ceph-mgr: 2017-07-11 14:50:44.663753 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:44.664008 I | ceph-mgr: 2017-07-11 14:50:44.663992 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:44.664314 I | ceph-mgr: 2017-07-11 14:50:44.664298 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:45.029748 I | ceph-mgr: 2017-07-11 14:50:45.029590 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10626 10.233.124.0:0/2068379116' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:45.031491 I | ceph-mgr: 2017-07-11 14:50:45.029686 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:46.688546 I | ceph-mgr: 2017-07-11 14:50:46.688501 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:46.688626 I | ceph-mgr: 2017-07-11 14:50:46.688610 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:46.688876 I | ceph-mgr: 2017-07-11 14:50:46.688860 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:48.724520 I | ceph-mgr: 2017-07-11 14:50:48.724491 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:48.724591 I | ceph-mgr: 2017-07-11 14:50:48.724577 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:48.724693 I | ceph-mgr: 2017-07-11 14:50:48.724680 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:49.089175 I | ceph-mgr: 2017-07-11 14:50:49.089111 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10641 10.233.124.0:0/2779007790' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:49.091404 I | ceph-mgr: 2017-07-11 14:50:49.089130 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:50.188666 I | ceph-mgr: 2017-07-11 14:50:50.188580 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11162 10.233.124.5:0/1512183903' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:50.188722 I | ceph-mgr: 2017-07-11 14:50:50.188625 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:50.756129 I | ceph-mgr: 2017-07-11 14:50:50.756100 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:50.756197 I | ceph-mgr: 2017-07-11 14:50:50.756183 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:50.756403 I | ceph-mgr: 2017-07-11 14:50:50.756293 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:52.779135 I | ceph-mgr: 2017-07-11 14:50:52.779098 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:52.779252 I | ceph-mgr: 2017-07-11 14:50:52.779238 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:52.779528 I | ceph-mgr: 2017-07-11 14:50:52.779410 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:54.156621 I | ceph-mgr: 2017-07-11 14:50:54.156568 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10656 10.233.124.0:0/2528432733' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:54.156817 I | ceph-mgr: 2017-07-11 14:50:54.156705 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:54.786798 I | ceph-mgr: 2017-07-11 14:50:54.786754 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:54.787013 I | ceph-mgr: 2017-07-11 14:50:54.786998 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:54.787274 I | ceph-mgr: 2017-07-11 14:50:54.787259 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:55.061240 I | ceph-mgr: 2017-07-11 14:50:55.061147 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10659 10.233.124.0:0/3741314066' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:55.061740 I | ceph-mgr: 2017-07-11 14:50:55.061198 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:56.806644 I | ceph-mgr: 2017-07-11 14:50:56.806585 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:56.806733 I | ceph-mgr: 2017-07-11 14:50:56.806719 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:56.806950 I | ceph-mgr: 2017-07-11 14:50:56.806934 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:58.812950 I | ceph-mgr: 2017-07-11 14:50:58.812889 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:50:58.815109 I | ceph-mgr: 2017-07-11 14:50:58.815092 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:50:58.815341 I | ceph-mgr: 2017-07-11 14:50:58.815326 7f4cc3226700 0 mgr tick
- 2017-07-11 14:50:59.008079 I | ceph-mgr: 2017-07-11 14:50:59.007998 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11195 10.233.124.5:0/3129744424' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:59.008096 I | ceph-mgr: 2017-07-11 14:50:59.008019 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:50:59.888443 I | ceph-mgr: 2017-07-11 14:50:59.888343 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11201 10.233.124.5:0/2768798256' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:50:59.888505 I | ceph-mgr: 2017-07-11 14:50:59.888400 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:00.826511 I | ceph-mgr: 2017-07-11 14:51:00.826475 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:00.826657 I | ceph-mgr: 2017-07-11 14:51:00.826642 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:00.826917 I | ceph-mgr: 2017-07-11 14:51:00.826902 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:02.834057 I | ceph-mgr: 2017-07-11 14:51:02.833935 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:02.834341 I | ceph-mgr: 2017-07-11 14:51:02.834176 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:02.834566 I | ceph-mgr: 2017-07-11 14:51:02.834550 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:03.749641 I | ceph-mgr: 2017-07-11 14:51:03.749580 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10695 10.233.124.0:0/3546065795' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:03.751533 I | ceph-mgr: 2017-07-11 14:51:03.751492 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:04.680835 I | ceph-mgr: 2017-07-11 14:51:04.680741 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10701 10.233.124.0:0/3433932173' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:04.680938 I | ceph-mgr: 2017-07-11 14:51:04.680908 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:04.853615 I | ceph-mgr: 2017-07-11 14:51:04.837323 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:04.853699 I | ceph-mgr: 2017-07-11 14:51:04.837328 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:04.853728 I | ceph-mgr: 2017-07-11 14:51:04.837348 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:06.860232 I | ceph-mgr: 2017-07-11 14:51:06.860169 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:06.860317 I | ceph-mgr: 2017-07-11 14:51:06.860302 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:06.860547 I | ceph-mgr: 2017-07-11 14:51:06.860532 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:08.755223 I | ceph-mgr: 2017-07-11 14:51:08.755168 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11222 10.233.124.5:0/3852519512' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:08.757353 I | ceph-mgr: 2017-07-11 14:51:08.755186 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:08.864341 I | ceph-mgr: 2017-07-11 14:51:08.864296 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:08.864529 I | ceph-mgr: 2017-07-11 14:51:08.864436 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:08.864807 I | ceph-mgr: 2017-07-11 14:51:08.864780 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:09.675891 I | ceph-mgr: 2017-07-11 14:51:09.675799 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11225 10.233.124.5:0/3707382365' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:09.677964 I | ceph-mgr: 2017-07-11 14:51:09.675847 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:10.884084 I | ceph-mgr: 2017-07-11 14:51:10.882844 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:10.884304 I | ceph-mgr: 2017-07-11 14:51:10.884288 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:10.884541 I | ceph-mgr: 2017-07-11 14:51:10.884526 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:12.894307 I | ceph-mgr: 2017-07-11 14:51:12.894269 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:12.894384 I | ceph-mgr: 2017-07-11 14:51:12.894370 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:12.894611 I | ceph-mgr: 2017-07-11 14:51:12.894596 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:13.565908 I | ceph-mgr: 2017-07-11 14:51:13.565835 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10737 10.233.124.0:0/2731583064' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:13.565972 I | ceph-mgr: 2017-07-11 14:51:13.565857 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:14.677939 I | ceph-mgr: 2017-07-11 14:51:14.677850 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11240 10.233.124.5:0/3744598935' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:14.680415 I | ceph-mgr: 2017-07-11 14:51:14.677896 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:14.930591 I | ceph-mgr: 2017-07-11 14:51:14.901306 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:14.933478 I | ceph-mgr: 2017-07-11 14:51:14.901319 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:14.933486 I | ceph-mgr: 2017-07-11 14:51:14.901349 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:16.958481 I | ceph-mgr: 2017-07-11 14:51:16.942367 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:16.958708 I | ceph-mgr: 2017-07-11 14:51:16.942373 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:16.958735 I | ceph-mgr: 2017-07-11 14:51:16.942392 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:18.826751 I | ceph-mgr: 2017-07-11 14:51:18.826723 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11258 10.233.124.5:0/2982668916' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:18.826841 I | ceph-mgr: 2017-07-11 14:51:18.826827 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:18.964416 I | ceph-mgr: 2017-07-11 14:51:18.963113 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:18.972064 I | ceph-mgr: 2017-07-11 14:51:18.963124 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:18.972099 I | ceph-mgr: 2017-07-11 14:51:18.963143 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:19.748736 I | ceph-mgr: 2017-07-11 14:51:19.748708 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11264 10.233.124.5:0/2916947012' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:19.748948 I | ceph-mgr: 2017-07-11 14:51:19.748914 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:20.965911 I | ceph-mgr: 2017-07-11 14:51:20.964581 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:20.973796 I | ceph-mgr: 2017-07-11 14:51:20.964586 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:20.973830 I | ceph-mgr: 2017-07-11 14:51:20.964617 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:22.966881 I | ceph-mgr: 2017-07-11 14:51:22.966834 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:22.966983 I | ceph-mgr: 2017-07-11 14:51:22.966969 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:22.967256 I | ceph-mgr: 2017-07-11 14:51:22.967143 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:23.702410 I | ceph-mgr: 2017-07-11 14:51:23.692919 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10767 10.233.124.0:0/420338052' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:23.702479 I | ceph-mgr: 2017-07-11 14:51:23.692939 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:24.843829 I | ceph-mgr: 2017-07-11 14:51:24.843744 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11276 10.233.124.5:0/128056902' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:24.846154 I | ceph-mgr: 2017-07-11 14:51:24.846120 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:24.978131 I | ceph-mgr: 2017-07-11 14:51:24.978090 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:24.979484 I | ceph-mgr: 2017-07-11 14:51:24.978322 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:24.979897 I | ceph-mgr: 2017-07-11 14:51:24.979881 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:26.989281 I | ceph-mgr: 2017-07-11 14:51:26.989229 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:26.989370 I | ceph-mgr: 2017-07-11 14:51:26.989355 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:26.989601 I | ceph-mgr: 2017-07-11 14:51:26.989585 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:28.655348 I | ceph-mgr: 2017-07-11 14:51:28.655287 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11288 10.233.124.5:0/4134932141' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:28.655424 I | ceph-mgr: 2017-07-11 14:51:28.655306 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:29.013576 I | ceph-mgr: 2017-07-11 14:51:29.013526 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:29.013658 I | ceph-mgr: 2017-07-11 14:51:29.013644 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:29.013884 I | ceph-mgr: 2017-07-11 14:51:29.013869 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:29.543339 I | ceph-mgr: 2017-07-11 14:51:29.543244 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11297 10.233.124.5:0/1790711800' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:29.543406 I | ceph-mgr: 2017-07-11 14:51:29.543292 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:31.025594 I | ceph-mgr: 2017-07-11 14:51:31.025557 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:31.025640 I | ceph-mgr: 2017-07-11 14:51:31.025627 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:31.025763 I | ceph-mgr: 2017-07-11 14:51:31.025748 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:33.040382 I | ceph-mgr: 2017-07-11 14:51:33.040350 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:33.040451 I | ceph-mgr: 2017-07-11 14:51:33.040438 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:33.040663 I | ceph-mgr: 2017-07-11 14:51:33.040549 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:33.400538 I | ceph-mgr: 2017-07-11 14:51:33.400474 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10791 10.233.124.0:0/3043374341' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:33.400596 I | ceph-mgr: 2017-07-11 14:51:33.400495 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:34.268579 I | ceph-mgr: 2017-07-11 14:51:34.268496 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11312 10.233.124.5:0/2533465586' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:34.269859 I | ceph-mgr: 2017-07-11 14:51:34.269830 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:35.053723 I | ceph-mgr: 2017-07-11 14:51:35.044352 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:35.053797 I | ceph-mgr: 2017-07-11 14:51:35.044362 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:35.053813 I | ceph-mgr: 2017-07-11 14:51:35.044388 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:37.060019 I | ceph-mgr: 2017-07-11 14:51:37.050016 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:37.060508 I | ceph-mgr: 2017-07-11 14:51:37.050023 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:37.060542 I | ceph-mgr: 2017-07-11 14:51:37.050057 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:38.638027 I | ceph-mgr: 2017-07-11 14:51:38.637983 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11327 10.233.124.5:0/3099261647' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:38.638118 I | ceph-mgr: 2017-07-11 14:51:38.638092 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:39.056510 I | ceph-mgr: 2017-07-11 14:51:39.055074 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:39.058634 I | ceph-mgr: 2017-07-11 14:51:39.055081 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:39.058683 I | ceph-mgr: 2017-07-11 14:51:39.055107 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:39.528703 I | ceph-mgr: 2017-07-11 14:51:39.528631 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10806 10.233.124.0:0/821774512' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:39.528805 I | ceph-mgr: 2017-07-11 14:51:39.528777 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:41.060372 I | ceph-mgr: 2017-07-11 14:51:41.058985 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:41.060579 I | ceph-mgr: 2017-07-11 14:51:41.058998 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:41.060606 I | ceph-mgr: 2017-07-11 14:51:41.059030 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:43.078529 I | ceph-mgr: 2017-07-11 14:51:43.062385 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:43.078745 I | ceph-mgr: 2017-07-11 14:51:43.062398 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:43.078901 I | ceph-mgr: 2017-07-11 14:51:43.062428 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:43.274533 I | ceph-mgr: 2017-07-11 14:51:43.274474 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10818 10.233.124.0:0/217376063' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:43.274601 I | ceph-mgr: 2017-07-11 14:51:43.274494 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:44.366283 I | ceph-mgr: 2017-07-11 14:51:44.366179 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10824 10.233.124.0:0/418833051' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:44.366436 I | ceph-mgr: 2017-07-11 14:51:44.366358 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:45.081509 I | ceph-mgr: 2017-07-11 14:51:45.081466 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:45.081586 I | ceph-mgr: 2017-07-11 14:51:45.081572 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:45.081804 I | ceph-mgr: 2017-07-11 14:51:45.081688 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:47.090425 I | ceph-mgr: 2017-07-11 14:51:47.090391 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:47.098066 I | ceph-mgr: 2017-07-11 14:51:47.098048 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:47.107851 I | ceph-mgr: 2017-07-11 14:51:47.098282 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:48.182720 I | ceph-mgr: 2017-07-11 14:51:48.182662 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10833 10.233.124.0:0/2734994321' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:48.182782 I | ceph-mgr: 2017-07-11 14:51:48.182681 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:49.122571 I | ceph-mgr: 2017-07-11 14:51:49.122491 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:49.122786 I | ceph-mgr: 2017-07-11 14:51:49.122771 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:49.123016 I | ceph-mgr: 2017-07-11 14:51:49.123002 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:49.370868 I | ceph-mgr: 2017-07-11 14:51:49.370700 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11360 10.233.124.5:0/3351919108' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:49.370922 I | ceph-mgr: 2017-07-11 14:51:49.370760 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:51.130566 I | ceph-mgr: 2017-07-11 14:51:51.127001 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:51.130659 I | ceph-mgr: 2017-07-11 14:51:51.130625 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:51.130873 I | ceph-mgr: 2017-07-11 14:51:51.130756 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:53.166934 I | ceph-mgr: 2017-07-11 14:51:53.148335 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:53.166995 I | ceph-mgr: 2017-07-11 14:51:53.148340 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:53.167011 I | ceph-mgr: 2017-07-11 14:51:53.148360 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:53.272378 I | ceph-mgr: 2017-07-11 14:51:53.272312 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10857 10.233.124.0:0/1481273613' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:53.272555 I | ceph-mgr: 2017-07-11 14:51:53.272462 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:54.191698 I | ceph-mgr: 2017-07-11 14:51:54.191599 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11366 10.233.124.5:0/2108059732' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:54.191767 I | ceph-mgr: 2017-07-11 14:51:54.191648 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:55.189820 I | ceph-mgr: 2017-07-11 14:51:55.180907 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:55.189880 I | ceph-mgr: 2017-07-11 14:51:55.180912 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:55.189897 I | ceph-mgr: 2017-07-11 14:51:55.180934 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:57.182846 I | ceph-mgr: 2017-07-11 14:51:57.182815 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:57.182942 I | ceph-mgr: 2017-07-11 14:51:57.182927 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:57.183642 I | ceph-mgr: 2017-07-11 14:51:57.183625 7f4cc3226700 0 mgr tick
- 2017-07-11 14:51:57.987242 I | ceph-mgr: 2017-07-11 14:51:57.987166 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11381 10.233.124.5:0/1404622554' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:57.987314 I | ceph-mgr: 2017-07-11 14:51:57.987187 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:58.897672 I | ceph-mgr: 2017-07-11 14:51:58.897477 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11387 10.233.124.5:0/345432988' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:51:58.897758 I | ceph-mgr: 2017-07-11 14:51:58.897529 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:51:59.191129 I | ceph-mgr: 2017-07-11 14:51:59.190276 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:51:59.191312 I | ceph-mgr: 2017-07-11 14:51:59.190287 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:51:59.191350 I | ceph-mgr: 2017-07-11 14:51:59.190331 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:01.195446 I | ceph-mgr: 2017-07-11 14:52:01.195396 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:01.195537 I | ceph-mgr: 2017-07-11 14:52:01.195523 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:01.195990 I | ceph-mgr: 2017-07-11 14:52:01.195973 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:02.914560 I | ceph-mgr: 2017-07-11 14:52:02.914512 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11393 10.233.124.5:0/538810868' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:02.914749 I | ceph-mgr: 2017-07-11 14:52:02.914682 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:03.200643 I | ceph-mgr: 2017-07-11 14:52:03.197633 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:03.200835 I | ceph-mgr: 2017-07-11 14:52:03.197638 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:03.200863 I | ceph-mgr: 2017-07-11 14:52:03.197660 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:03.846037 I | ceph-mgr: 2017-07-11 14:52:03.845990 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10899 10.233.124.0:0/2388926363' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:03.847663 I | ceph-mgr: 2017-07-11 14:52:03.847647 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:05.208722 I | ceph-mgr: 2017-07-11 14:52:05.204476 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:05.209091 I | ceph-mgr: 2017-07-11 14:52:05.204481 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:05.209120 I | ceph-mgr: 2017-07-11 14:52:05.204504 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:07.216230 I | ceph-mgr: 2017-07-11 14:52:07.216195 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:07.216317 I | ceph-mgr: 2017-07-11 14:52:07.216302 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:07.216754 I | ceph-mgr: 2017-07-11 14:52:07.216723 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:07.835943 I | ceph-mgr: 2017-07-11 14:52:07.835883 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10905 10.233.124.0:0/1458857317' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:07.835960 I | ceph-mgr: 2017-07-11 14:52:07.835903 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:08.797471 I | ceph-mgr: 2017-07-11 14:52:08.797386 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11414 10.233.124.5:0/403608557' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:08.797530 I | ceph-mgr: 2017-07-11 14:52:08.797431 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:09.235360 I | ceph-mgr: 2017-07-11 14:52:09.235325 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:09.235439 I | ceph-mgr: 2017-07-11 14:52:09.235426 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:09.235667 I | ceph-mgr: 2017-07-11 14:52:09.235540 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:11.239360 I | ceph-mgr: 2017-07-11 14:52:11.239325 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:11.239437 I | ceph-mgr: 2017-07-11 14:52:11.239422 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:11.239660 I | ceph-mgr: 2017-07-11 14:52:11.239644 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:12.876195 I | ceph-mgr: 2017-07-11 14:52:12.876133 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11426 10.233.124.5:0/3858283552' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:12.876272 I | ceph-mgr: 2017-07-11 14:52:12.876152 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:13.256798 I | ceph-mgr: 2017-07-11 14:52:13.256766 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:13.256861 I | ceph-mgr: 2017-07-11 14:52:13.256848 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:13.263744 I | ceph-mgr: 2017-07-11 14:52:13.263726 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:13.776055 I | ceph-mgr: 2017-07-11 14:52:13.775982 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11432 10.233.124.5:0/3061829747' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:13.785252 I | ceph-mgr: 2017-07-11 14:52:13.785220 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:15.271685 I | ceph-mgr: 2017-07-11 14:52:15.271624 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:15.271772 I | ceph-mgr: 2017-07-11 14:52:15.271758 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:15.271990 I | ceph-mgr: 2017-07-11 14:52:15.271873 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:17.275286 I | ceph-mgr: 2017-07-11 14:52:17.275252 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:17.275459 I | ceph-mgr: 2017-07-11 14:52:17.275443 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:17.276798 I | ceph-mgr: 2017-07-11 14:52:17.276782 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:17.857948 I | ceph-mgr: 2017-07-11 14:52:17.857887 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6334 10.233.124.5:0/1611582939' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:17.858019 I | ceph-mgr: 2017-07-11 14:52:17.857908 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:18.823342 I | ceph-mgr: 2017-07-11 14:52:18.823266 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6337 10.233.124.0:0/3863702726' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:18.823438 I | ceph-mgr: 2017-07-11 14:52:18.823412 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:19.278549 I | ceph-mgr: 2017-07-11 14:52:19.278472 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:19.278632 I | ceph-mgr: 2017-07-11 14:52:19.278617 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:19.285307 I | ceph-mgr: 2017-07-11 14:52:19.285288 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:21.291119 I | ceph-mgr: 2017-07-11 14:52:21.289761 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:21.291191 I | ceph-mgr: 2017-07-11 14:52:21.289766 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:21.291208 I | ceph-mgr: 2017-07-11 14:52:21.289788 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:22.600381 I | ceph-mgr: 2017-07-11 14:52:22.600320 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11453 10.233.124.5:0/2020295403' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:22.600477 I | ceph-mgr: 2017-07-11 14:52:22.600443 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:23.295397 I | ceph-mgr: 2017-07-11 14:52:23.294615 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:23.295456 I | ceph-mgr: 2017-07-11 14:52:23.294620 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:23.295472 I | ceph-mgr: 2017-07-11 14:52:23.294642 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:23.621532 I | ceph-mgr: 2017-07-11 14:52:23.621458 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10950 10.233.124.0:0/3674212972' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:23.621582 I | ceph-mgr: 2017-07-11 14:52:23.621500 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:25.312981 I | ceph-mgr: 2017-07-11 14:52:25.312954 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:25.313017 I | ceph-mgr: 2017-07-11 14:52:25.313004 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:25.313111 I | ceph-mgr: 2017-07-11 14:52:25.313097 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:27.330558 I | ceph-mgr: 2017-07-11 14:52:27.330501 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:27.330659 I | ceph-mgr: 2017-07-11 14:52:27.330644 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:27.330919 I | ceph-mgr: 2017-07-11 14:52:27.330904 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:27.593089 I | ceph-mgr: 2017-07-11 14:52:27.593024 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11468 10.233.124.5:0/90553326' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:27.593153 I | ceph-mgr: 2017-07-11 14:52:27.593045 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:28.599585 I | ceph-mgr: 2017-07-11 14:52:28.599493 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11474 10.233.124.5:0/1843260371' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:28.599639 I | ceph-mgr: 2017-07-11 14:52:28.599540 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:29.334291 I | ceph-mgr: 2017-07-11 14:52:29.334253 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:29.334383 I | ceph-mgr: 2017-07-11 14:52:29.334359 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:29.334662 I | ceph-mgr: 2017-07-11 14:52:29.334647 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:31.347489 I | ceph-mgr: 2017-07-11 14:52:31.347456 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:31.347560 I | ceph-mgr: 2017-07-11 14:52:31.347546 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:31.347784 I | ceph-mgr: 2017-07-11 14:52:31.347769 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:32.324462 I | ceph-mgr: 2017-07-11 14:52:32.324398 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10968 10.233.124.0:0/2358724593' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:32.324546 I | ceph-mgr: 2017-07-11 14:52:32.324419 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:33.359509 I | ceph-mgr: 2017-07-11 14:52:33.359479 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:33.359671 I | ceph-mgr: 2017-07-11 14:52:33.359656 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:33.361555 I | ceph-mgr: 2017-07-11 14:52:33.361534 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:33.623771 I | ceph-mgr: 2017-07-11 14:52:33.623663 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10971 10.233.124.0:0/3985370982' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:33.623844 I | ceph-mgr: 2017-07-11 14:52:33.623728 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:35.369097 I | ceph-mgr: 2017-07-11 14:52:35.368931 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:35.369191 I | ceph-mgr: 2017-07-11 14:52:35.369176 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:35.369424 I | ceph-mgr: 2017-07-11 14:52:35.369410 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:37.383943 I | ceph-mgr: 2017-07-11 14:52:37.383899 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:37.387293 I | ceph-mgr: 2017-07-11 14:52:37.384049 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:37.393655 I | ceph-mgr: 2017-07-11 14:52:37.393629 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:37.611423 I | ceph-mgr: 2017-07-11 14:52:37.611371 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10980 10.233.124.0:0/4081735266' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:37.611470 I | ceph-mgr: 2017-07-11 14:52:37.611390 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:38.672683 I | ceph-mgr: 2017-07-11 14:52:38.666291 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.10986 10.233.124.0:0/3261809741' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:38.681739 I | ceph-mgr: 2017-07-11 14:52:38.681636 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:39.444928 I | ceph-mgr: 2017-07-11 14:52:39.444868 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:39.446227 I | ceph-mgr: 2017-07-11 14:52:39.446211 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:39.446421 I | ceph-mgr: 2017-07-11 14:52:39.446405 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:41.452362 I | ceph-mgr: 2017-07-11 14:52:41.452328 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:41.452440 I | ceph-mgr: 2017-07-11 14:52:41.452426 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:41.452663 I | ceph-mgr: 2017-07-11 14:52:41.452647 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:42.320662 I | ceph-mgr: 2017-07-11 14:52:42.320628 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11504 10.233.124.5:0/664156411' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:42.320824 I | ceph-mgr: 2017-07-11 14:52:42.320754 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:43.466159 I | ceph-mgr: 2017-07-11 14:52:43.456455 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:43.466711 I | ceph-mgr: 2017-07-11 14:52:43.456460 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:43.466742 I | ceph-mgr: 2017-07-11 14:52:43.456481 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:43.466960 I | ceph-mgr: 2017-07-11 14:52:43.466945 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11507 10.233.124.5:0/2919996655' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:43.467087 I | ceph-mgr: 2017-07-11 14:52:43.467040 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:45.470576 I | ceph-mgr: 2017-07-11 14:52:45.460810 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:45.471247 I | ceph-mgr: 2017-07-11 14:52:45.460815 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:45.471278 I | ceph-mgr: 2017-07-11 14:52:45.460838 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:47.248935 I | ceph-mgr: 2017-07-11 14:52:47.248874 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11519 10.233.124.5:0/1075537452' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:47.251144 I | ceph-mgr: 2017-07-11 14:52:47.248894 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:47.467204 I | ceph-mgr: 2017-07-11 14:52:47.464189 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:47.467349 I | ceph-mgr: 2017-07-11 14:52:47.464200 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:47.467369 I | ceph-mgr: 2017-07-11 14:52:47.464238 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:48.366814 I | ceph-mgr: 2017-07-11 14:52:48.366742 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11019 10.233.124.5:0/4225907797' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:48.366899 I | ceph-mgr: 2017-07-11 14:52:48.366874 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:49.467995 I | ceph-mgr: 2017-07-11 14:52:49.466656 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:49.474134 I | ceph-mgr: 2017-07-11 14:52:49.466665 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:49.474166 I | ceph-mgr: 2017-07-11 14:52:49.466690 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:51.472069 I | ceph-mgr: 2017-07-11 14:52:51.470655 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:51.472226 I | ceph-mgr: 2017-07-11 14:52:51.470660 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:51.472373 I | ceph-mgr: 2017-07-11 14:52:51.470683 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:52.698776 I | ceph-mgr: 2017-07-11 14:52:52.698680 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11537 10.233.124.5:0/1272185189' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:52.698866 I | ceph-mgr: 2017-07-11 14:52:52.698839 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:53.490809 I | ceph-mgr: 2017-07-11 14:52:53.474082 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:53.490994 I | ceph-mgr: 2017-07-11 14:52:53.474087 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:53.491043 I | ceph-mgr: 2017-07-11 14:52:53.474109 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:53.819166 I | ceph-mgr: 2017-07-11 14:52:53.818170 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6355 10.233.124.5:0/2051221331' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:53.819202 I | ceph-mgr: 2017-07-11 14:52:53.818214 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:55.508036 I | ceph-mgr: 2017-07-11 14:52:55.491560 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:55.508086 I | ceph-mgr: 2017-07-11 14:52:55.491573 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:55.508113 I | ceph-mgr: 2017-07-11 14:52:55.491606 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:57.206345 I | ceph-mgr: 2017-07-11 14:52:57.206295 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11037 10.233.124.5:0/3860520404' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:57.206460 I | ceph-mgr: 2017-07-11 14:52:57.206433 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:57.510017 I | ceph-mgr: 2017-07-11 14:52:57.509951 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:57.510206 I | ceph-mgr: 2017-07-11 14:52:57.510066 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:57.510313 I | ceph-mgr: 2017-07-11 14:52:57.510298 7f4cc3226700 0 mgr tick
- 2017-07-11 14:52:58.195376 I | ceph-mgr: 2017-07-11 14:52:58.195208 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11561 10.233.124.5:0/1035408066' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:52:58.195449 I | ceph-mgr: 2017-07-11 14:52:58.195259 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:52:59.523164 I | ceph-mgr: 2017-07-11 14:52:59.521506 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:52:59.523195 I | ceph-mgr: 2017-07-11 14:52:59.521517 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:52:59.523204 I | ceph-mgr: 2017-07-11 14:52:59.521545 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:01.532456 I | ceph-mgr: 2017-07-11 14:53:01.530941 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:01.532525 I | ceph-mgr: 2017-07-11 14:53:01.530947 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:01.532545 I | ceph-mgr: 2017-07-11 14:53:01.531011 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:01.921325 I | ceph-mgr: 2017-07-11 14:53:01.921202 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11046 10.233.124.5:0/4105967089' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:01.921388 I | ceph-mgr: 2017-07-11 14:53:01.921246 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:02.981659 I | ceph-mgr: 2017-07-11 14:53:02.981632 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11582 10.233.124.5:0/4173604498' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:02.981843 I | ceph-mgr: 2017-07-11 14:53:02.981827 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:03.541199 I | ceph-mgr: 2017-07-11 14:53:03.532807 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:03.541270 I | ceph-mgr: 2017-07-11 14:53:03.532812 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:03.541299 I | ceph-mgr: 2017-07-11 14:53:03.532834 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:05.538863 I | ceph-mgr: 2017-07-11 14:53:05.537530 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:05.538924 I | ceph-mgr: 2017-07-11 14:53:05.537537 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:05.538939 I | ceph-mgr: 2017-07-11 14:53:05.537558 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:06.986556 I | ceph-mgr: 2017-07-11 14:53:06.986529 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11597 10.233.124.5:0/3726967123' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:06.986723 I | ceph-mgr: 2017-07-11 14:53:06.986646 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:07.539816 I | ceph-mgr: 2017-07-11 14:53:07.539786 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:07.540812 I | ceph-mgr: 2017-07-11 14:53:07.539954 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:07.541159 I | ceph-mgr: 2017-07-11 14:53:07.540945 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:08.015780 I | ceph-mgr: 2017-07-11 14:53:08.015757 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11603 10.233.124.5:0/3060475615' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:08.016232 I | ceph-mgr: 2017-07-11 14:53:08.016211 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:09.547018 I | ceph-mgr: 2017-07-11 14:53:09.546982 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:09.547103 I | ceph-mgr: 2017-07-11 14:53:09.547089 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:09.547325 I | ceph-mgr: 2017-07-11 14:53:09.547310 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:11.550193 I | ceph-mgr: 2017-07-11 14:53:11.550161 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:11.550269 I | ceph-mgr: 2017-07-11 14:53:11.550255 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:11.550504 I | ceph-mgr: 2017-07-11 14:53:11.550370 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:11.728240 I | ceph-mgr: 2017-07-11 14:53:11.728177 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11067 10.233.124.0:0/3082400851' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:11.728304 I | ceph-mgr: 2017-07-11 14:53:11.728196 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:12.606488 I | ceph-mgr: 2017-07-11 14:53:12.606384 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11624 10.233.124.5:0/1134081086' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:12.606565 I | ceph-mgr: 2017-07-11 14:53:12.606436 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:13.567680 I | ceph-mgr: 2017-07-11 14:53:13.567643 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:13.567751 I | ceph-mgr: 2017-07-11 14:53:13.567736 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:13.568039 I | ceph-mgr: 2017-07-11 14:53:13.568023 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:15.572302 I | ceph-mgr: 2017-07-11 14:53:15.571875 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:15.573989 I | ceph-mgr: 2017-07-11 14:53:15.573927 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:15.574193 I | ceph-mgr: 2017-07-11 14:53:15.574085 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:16.834042 I | ceph-mgr: 2017-07-11 14:53:16.833995 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11079 10.233.124.0:0/2569048825' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:16.836956 I | ceph-mgr: 2017-07-11 14:53:16.836923 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:17.579216 I | ceph-mgr: 2017-07-11 14:53:17.577875 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:17.595208 I | ceph-mgr: 2017-07-11 14:53:17.577881 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:17.595245 I | ceph-mgr: 2017-07-11 14:53:17.577901 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:17.769889 I | ceph-mgr: 2017-07-11 14:53:17.769795 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6370 10.233.124.0:0/1902184351' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:17.769926 I | ceph-mgr: 2017-07-11 14:53:17.769841 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:19.585746 I | ceph-mgr: 2017-07-11 14:53:19.584479 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:19.585806 I | ceph-mgr: 2017-07-11 14:53:19.584489 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:19.585821 I | ceph-mgr: 2017-07-11 14:53:19.584516 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:21.590243 I | ceph-mgr: 2017-07-11 14:53:21.588807 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:21.590395 I | ceph-mgr: 2017-07-11 14:53:21.588811 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:21.590465 I | ceph-mgr: 2017-07-11 14:53:21.588831 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:21.746286 I | ceph-mgr: 2017-07-11 14:53:21.746247 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11651 10.233.124.5:0/3279118014' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:21.746354 I | ceph-mgr: 2017-07-11 14:53:21.746330 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:22.672454 I | ceph-mgr: 2017-07-11 14:53:22.672360 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11088 10.233.124.0:0/1167422768' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:22.672604 I | ceph-mgr: 2017-07-11 14:53:22.672534 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:23.603461 I | ceph-mgr: 2017-07-11 14:53:23.594232 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:23.603625 I | ceph-mgr: 2017-07-11 14:53:23.594238 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:23.603663 I | ceph-mgr: 2017-07-11 14:53:23.594260 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:25.612551 I | ceph-mgr: 2017-07-11 14:53:25.609134 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:25.612569 I | ceph-mgr: 2017-07-11 14:53:25.609140 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:25.612573 I | ceph-mgr: 2017-07-11 14:53:25.609177 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:26.681652 I | ceph-mgr: 2017-07-11 14:53:26.681587 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11663 10.233.124.5:0/423073843' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:26.681711 I | ceph-mgr: 2017-07-11 14:53:26.681606 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:27.562446 I | ceph-mgr: 2017-07-11 14:53:27.562371 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11109 10.233.124.0:0/1863582024' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:27.562546 I | ceph-mgr: 2017-07-11 14:53:27.562517 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:27.628160 I | ceph-mgr: 2017-07-11 14:53:27.628097 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:27.628242 I | ceph-mgr: 2017-07-11 14:53:27.628226 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:27.628492 I | ceph-mgr: 2017-07-11 14:53:27.628475 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:29.637731 I | ceph-mgr: 2017-07-11 14:53:29.637698 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:29.637806 I | ceph-mgr: 2017-07-11 14:53:29.637792 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:29.638044 I | ceph-mgr: 2017-07-11 14:53:29.638029 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:31.523388 I | ceph-mgr: 2017-07-11 14:53:31.523342 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11124 10.233.124.5:0/2269504646' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:31.523477 I | ceph-mgr: 2017-07-11 14:53:31.523451 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:31.653786 I | ceph-mgr: 2017-07-11 14:53:31.649931 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:31.653921 I | ceph-mgr: 2017-07-11 14:53:31.649942 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:31.653941 I | ceph-mgr: 2017-07-11 14:53:31.649981 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:32.393288 I | ceph-mgr: 2017-07-11 14:53:32.393200 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11675 10.233.124.5:0/915497939' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:32.393360 I | ceph-mgr: 2017-07-11 14:53:32.393246 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:33.657598 I | ceph-mgr: 2017-07-11 14:53:33.657486 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:33.657759 I | ceph-mgr: 2017-07-11 14:53:33.657676 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:33.657947 I | ceph-mgr: 2017-07-11 14:53:33.657931 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:35.662873 I | ceph-mgr: 2017-07-11 14:53:35.661913 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:35.662981 I | ceph-mgr: 2017-07-11 14:53:35.662965 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:35.663488 I | ceph-mgr: 2017-07-11 14:53:35.663457 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:36.735865 I | ceph-mgr: 2017-07-11 14:53:36.735815 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11133 10.233.124.5:0/1106954150' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:36.735953 I | ceph-mgr: 2017-07-11 14:53:36.735928 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:37.669655 I | ceph-mgr: 2017-07-11 14:53:37.669476 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:37.669831 I | ceph-mgr: 2017-07-11 14:53:37.669815 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:37.670068 I | ceph-mgr: 2017-07-11 14:53:37.670051 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:37.679393 I | ceph-mgr: 2017-07-11 14:53:37.679330 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6385 10.233.124.0:0/3025270152' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:37.679473 I | ceph-mgr: 2017-07-11 14:53:37.679441 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:39.681234 I | ceph-mgr: 2017-07-11 14:53:39.673773 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:39.681408 I | ceph-mgr: 2017-07-11 14:53:39.673785 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:39.681537 I | ceph-mgr: 2017-07-11 14:53:39.673827 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:41.687166 I | ceph-mgr: 2017-07-11 14:53:41.683313 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:41.693021 I | ceph-mgr: 2017-07-11 14:53:41.683553 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:41.693030 I | ceph-mgr: 2017-07-11 14:53:41.683580 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:41.723193 I | ceph-mgr: 2017-07-11 14:53:41.723145 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11145 10.233.124.0:0/1075028757' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:41.723271 I | ceph-mgr: 2017-07-11 14:53:41.723245 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:42.673285 I | ceph-mgr: 2017-07-11 14:53:42.673202 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11705 10.233.124.5:0/2771144525' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:42.673496 I | ceph-mgr: 2017-07-11 14:53:42.673374 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:43.697329 I | ceph-mgr: 2017-07-11 14:53:43.687907 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:43.697533 I | ceph-mgr: 2017-07-11 14:53:43.687920 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:43.697582 I | ceph-mgr: 2017-07-11 14:53:43.687956 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:45.695219 I | ceph-mgr: 2017-07-11 14:53:45.691721 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:45.695316 I | ceph-mgr: 2017-07-11 14:53:45.691738 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:45.695343 I | ceph-mgr: 2017-07-11 14:53:45.691757 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:46.744871 I | ceph-mgr: 2017-07-11 14:53:46.744810 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11717 10.233.124.5:0/1959245906' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:46.744937 I | ceph-mgr: 2017-07-11 14:53:46.744830 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:47.683471 I | ceph-mgr: 2017-07-11 14:53:47.683384 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11723 10.233.124.5:0/3553389385' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:47.683527 I | ceph-mgr: 2017-07-11 14:53:47.683431 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:47.695298 I | ceph-mgr: 2017-07-11 14:53:47.695280 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:47.695350 I | ceph-mgr: 2017-07-11 14:53:47.695337 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:47.695419 I | ceph-mgr: 2017-07-11 14:53:47.695392 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:49.706895 I | ceph-mgr: 2017-07-11 14:53:49.706864 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:49.706987 I | ceph-mgr: 2017-07-11 14:53:49.706973 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:49.707069 I | ceph-mgr: 2017-07-11 14:53:49.707059 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:51.380951 I | ceph-mgr: 2017-07-11 14:53:51.380905 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11169 10.233.124.0:0/2213814053' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:51.381038 I | ceph-mgr: 2017-07-11 14:53:51.381014 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:51.720681 I | ceph-mgr: 2017-07-11 14:53:51.720657 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:51.720843 I | ceph-mgr: 2017-07-11 14:53:51.720827 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:51.721074 I | ceph-mgr: 2017-07-11 14:53:51.720995 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:52.335220 I | ceph-mgr: 2017-07-11 14:53:52.335082 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11172 10.233.124.0:0/841762022' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:52.335316 I | ceph-mgr: 2017-07-11 14:53:52.335289 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:53.730928 I | ceph-mgr: 2017-07-11 14:53:53.730883 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:53.731023 I | ceph-mgr: 2017-07-11 14:53:53.731009 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:53.731292 I | ceph-mgr: 2017-07-11 14:53:53.731276 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:55.753062 I | ceph-mgr: 2017-07-11 14:53:55.751104 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:55.760711 I | ceph-mgr: 2017-07-11 14:53:55.760683 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:55.763220 I | ceph-mgr: 2017-07-11 14:53:55.763189 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:56.373551 I | ceph-mgr: 2017-07-11 14:53:56.373432 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11184 10.233.124.0:0/946038768' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:56.373612 I | ceph-mgr: 2017-07-11 14:53:56.373469 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:57.367115 I | ceph-mgr: 2017-07-11 14:53:57.366932 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11759 10.233.124.5:0/4202717820' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:53:57.368934 I | ceph-mgr: 2017-07-11 14:53:57.367029 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:53:57.780737 I | ceph-mgr: 2017-07-11 14:53:57.779508 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:57.788182 I | ceph-mgr: 2017-07-11 14:53:57.779514 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:57.788216 I | ceph-mgr: 2017-07-11 14:53:57.779537 7f4cc3226700 0 mgr tick
- 2017-07-11 14:53:59.784567 I | ceph-mgr: 2017-07-11 14:53:59.784535 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:53:59.784653 I | ceph-mgr: 2017-07-11 14:53:59.784639 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:53:59.784726 I | ceph-mgr: 2017-07-11 14:53:59.784715 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:01.204111 I | ceph-mgr: 2017-07-11 14:54:01.204048 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11774 10.233.124.5:0/3365900120' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:01.204340 I | ceph-mgr: 2017-07-11 14:54:01.204226 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:01.788843 I | ceph-mgr: 2017-07-11 14:54:01.788810 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:01.788922 I | ceph-mgr: 2017-07-11 14:54:01.788908 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:01.789015 I | ceph-mgr: 2017-07-11 14:54:01.788994 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:02.135309 I | ceph-mgr: 2017-07-11 14:54:02.135228 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11199 10.233.124.0:0/2259651874' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:02.135577 I | ceph-mgr: 2017-07-11 14:54:02.135548 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:03.796269 I | ceph-mgr: 2017-07-11 14:54:03.796228 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:03.796492 I | ceph-mgr: 2017-07-11 14:54:03.796475 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:03.796818 I | ceph-mgr: 2017-07-11 14:54:03.796604 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:05.817774 I | ceph-mgr: 2017-07-11 14:54:05.817739 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:05.817951 I | ceph-mgr: 2017-07-11 14:54:05.817935 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:05.820274 I | ceph-mgr: 2017-07-11 14:54:05.820257 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:06.256156 I | ceph-mgr: 2017-07-11 14:54:06.255898 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11214 10.233.124.0:0/4074743134' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:06.256519 I | ceph-mgr: 2017-07-11 14:54:06.255918 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:07.150334 I | ceph-mgr: 2017-07-11 14:54:07.150168 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11217 10.233.124.0:0/1841893178' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:07.152356 I | ceph-mgr: 2017-07-11 14:54:07.152317 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:07.823772 I | ceph-mgr: 2017-07-11 14:54:07.823740 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:07.823839 I | ceph-mgr: 2017-07-11 14:54:07.823825 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:07.824065 I | ceph-mgr: 2017-07-11 14:54:07.824049 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:09.940502 I | ceph-mgr: 2017-07-11 14:54:09.940468 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:09.940701 I | ceph-mgr: 2017-07-11 14:54:09.940686 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:09.940908 I | ceph-mgr: 2017-07-11 14:54:09.940893 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:10.926414 I | ceph-mgr: 2017-07-11 14:54:10.926327 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11792 10.233.124.5:0/4259880555' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:10.926525 I | ceph-mgr: 2017-07-11 14:54:10.926499 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:11.849598 I | ceph-mgr: 2017-07-11 14:54:11.849520 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11235 10.233.124.0:0/1993936659' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:11.855595 I | ceph-mgr: 2017-07-11 14:54:11.855563 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:11.943579 I | ceph-mgr: 2017-07-11 14:54:11.943506 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:11.943679 I | ceph-mgr: 2017-07-11 14:54:11.943663 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:11.943947 I | ceph-mgr: 2017-07-11 14:54:11.943930 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:13.947090 I | ceph-mgr: 2017-07-11 14:54:13.946975 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:13.947195 I | ceph-mgr: 2017-07-11 14:54:13.947178 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:13.947501 I | ceph-mgr: 2017-07-11 14:54:13.947484 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:15.952569 I | ceph-mgr: 2017-07-11 14:54:15.952536 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:15.952664 I | ceph-mgr: 2017-07-11 14:54:15.952650 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:15.952878 I | ceph-mgr: 2017-07-11 14:54:15.952863 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:16.238800 I | ceph-mgr: 2017-07-11 14:54:16.238733 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11253 10.233.124.0:0/1694865902' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:16.238871 I | ceph-mgr: 2017-07-11 14:54:16.238753 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:17.112504 I | ceph-mgr: 2017-07-11 14:54:17.112429 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11259 10.233.124.0:0/3110118756' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:17.115159 I | ceph-mgr: 2017-07-11 14:54:17.115129 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:17.957950 I | ceph-mgr: 2017-07-11 14:54:17.957915 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:17.958032 I | ceph-mgr: 2017-07-11 14:54:17.958019 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:17.958252 I | ceph-mgr: 2017-07-11 14:54:17.958136 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:19.962239 I | ceph-mgr: 2017-07-11 14:54:19.960552 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:19.962331 I | ceph-mgr: 2017-07-11 14:54:19.962316 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:19.962550 I | ceph-mgr: 2017-07-11 14:54:19.962534 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:20.819340 I | ceph-mgr: 2017-07-11 14:54:20.819278 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11813 10.233.124.5:0/2158404519' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:20.819402 I | ceph-mgr: 2017-07-11 14:54:20.819298 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:21.783324 I | ceph-mgr: 2017-07-11 14:54:21.783229 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11816 10.233.124.5:0/2658791232' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:21.783385 I | ceph-mgr: 2017-07-11 14:54:21.783286 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:21.967252 I | ceph-mgr: 2017-07-11 14:54:21.966369 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:21.967318 I | ceph-mgr: 2017-07-11 14:54:21.967303 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:21.967534 I | ceph-mgr: 2017-07-11 14:54:21.967423 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:23.970731 I | ceph-mgr: 2017-07-11 14:54:23.970691 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:23.976424 I | ceph-mgr: 2017-07-11 14:54:23.976405 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:23.976542 I | ceph-mgr: 2017-07-11 14:54:23.976527 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:25.842896 I | ceph-mgr: 2017-07-11 14:54:25.842831 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11828 10.233.124.5:0/1004552887' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:25.842996 I | ceph-mgr: 2017-07-11 14:54:25.842969 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:25.981435 I | ceph-mgr: 2017-07-11 14:54:25.981405 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:25.981494 I | ceph-mgr: 2017-07-11 14:54:25.981480 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:25.981731 I | ceph-mgr: 2017-07-11 14:54:25.981603 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:26.735301 I | ceph-mgr: 2017-07-11 14:54:26.735189 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11280 10.233.124.0:0/1550509085' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:26.735380 I | ceph-mgr: 2017-07-11 14:54:26.735256 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:28.001160 I | ceph-mgr: 2017-07-11 14:54:27.999607 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:28.001236 I | ceph-mgr: 2017-07-11 14:54:27.999617 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:28.001252 I | ceph-mgr: 2017-07-11 14:54:27.999646 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:30.001699 I | ceph-mgr: 2017-07-11 14:54:30.001670 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:30.007430 I | ceph-mgr: 2017-07-11 14:54:30.007412 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:30.007492 I | ceph-mgr: 2017-07-11 14:54:30.007481 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:30.648493 I | ceph-mgr: 2017-07-11 14:54:30.648447 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11298 10.233.124.0:0/4079630418' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:30.648924 I | ceph-mgr: 2017-07-11 14:54:30.648881 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:31.777180 I | ceph-mgr: 2017-07-11 14:54:31.777156 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11843 10.233.124.5:0/2810220526' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:31.777749 I | ceph-mgr: 2017-07-11 14:54:31.777728 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:32.021688 I | ceph-mgr: 2017-07-11 14:54:32.020640 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:32.021727 I | ceph-mgr: 2017-07-11 14:54:32.020646 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:32.021742 I | ceph-mgr: 2017-07-11 14:54:32.020663 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:34.024511 I | ceph-mgr: 2017-07-11 14:54:34.023335 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:34.024566 I | ceph-mgr: 2017-07-11 14:54:34.023341 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:34.024582 I | ceph-mgr: 2017-07-11 14:54:34.023361 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:35.822332 I | ceph-mgr: 2017-07-11 14:54:35.822304 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11852 10.233.124.5:0/3626115424' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:35.822690 I | ceph-mgr: 2017-07-11 14:54:35.822664 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:36.044218 I | ceph-mgr: 2017-07-11 14:54:36.034832 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:36.044406 I | ceph-mgr: 2017-07-11 14:54:36.044316 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:36.054194 I | ceph-mgr: 2017-07-11 14:54:36.044474 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:37.059881 I | ceph-mgr: 2017-07-11 14:54:37.059849 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11858 10.233.124.5:0/3803686320' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:37.060105 I | ceph-mgr: 2017-07-11 14:54:37.060067 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:38.129811 I | ceph-mgr: 2017-07-11 14:54:38.129776 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:38.130269 I | ceph-mgr: 2017-07-11 14:54:38.129994 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:38.133492 I | ceph-mgr: 2017-07-11 14:54:38.133477 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:40.153666 I | ceph-mgr: 2017-07-11 14:54:40.153618 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:40.153746 I | ceph-mgr: 2017-07-11 14:54:40.153732 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:40.154008 I | ceph-mgr: 2017-07-11 14:54:40.153981 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:40.558358 I | ceph-mgr: 2017-07-11 14:54:40.558296 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11876 10.233.124.5:0/3479131181' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:40.558413 I | ceph-mgr: 2017-07-11 14:54:40.558319 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:41.493851 I | ceph-mgr: 2017-07-11 14:54:41.493757 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11325 10.233.124.0:0/1395367252' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:41.495355 I | ceph-mgr: 2017-07-11 14:54:41.495309 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:42.177979 I | ceph-mgr: 2017-07-11 14:54:42.162156 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:42.178040 I | ceph-mgr: 2017-07-11 14:54:42.162162 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:42.178057 I | ceph-mgr: 2017-07-11 14:54:42.162184 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:44.180270 I | ceph-mgr: 2017-07-11 14:54:44.180217 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:44.180366 I | ceph-mgr: 2017-07-11 14:54:44.180351 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:44.180636 I | ceph-mgr: 2017-07-11 14:54:44.180620 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:45.572385 I | ceph-mgr: 2017-07-11 14:54:45.569345 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11340 10.233.124.0:0/561883869' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:45.581125 I | ceph-mgr: 2017-07-11 14:54:45.569367 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:46.186458 I | ceph-mgr: 2017-07-11 14:54:46.186412 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:46.186545 I | ceph-mgr: 2017-07-11 14:54:46.186530 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:46.186781 I | ceph-mgr: 2017-07-11 14:54:46.186766 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:46.552970 I | ceph-mgr: 2017-07-11 14:54:46.552896 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11894 10.233.124.5:0/1493147972' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:46.553010 I | ceph-mgr: 2017-07-11 14:54:46.552939 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:48.195777 I | ceph-mgr: 2017-07-11 14:54:48.195717 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:48.195984 I | ceph-mgr: 2017-07-11 14:54:48.195877 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:48.196153 I | ceph-mgr: 2017-07-11 14:54:48.196119 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:50.197801 I | ceph-mgr: 2017-07-11 14:54:50.197777 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:50.197888 I | ceph-mgr: 2017-07-11 14:54:50.197863 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:50.198169 I | ceph-mgr: 2017-07-11 14:54:50.198052 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:50.819843 I | ceph-mgr: 2017-07-11 14:54:50.819770 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11355 10.233.124.0:0/479138539' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:50.819908 I | ceph-mgr: 2017-07-11 14:54:50.819792 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:51.951829 I | ceph-mgr: 2017-07-11 14:54:51.951746 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11906 10.233.124.5:0/1621154756' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:51.951932 I | ceph-mgr: 2017-07-11 14:54:51.951904 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:52.206010 I | ceph-mgr: 2017-07-11 14:54:52.205990 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:52.206068 I | ceph-mgr: 2017-07-11 14:54:52.206054 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:52.206178 I | ceph-mgr: 2017-07-11 14:54:52.206163 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:54.230164 I | ceph-mgr: 2017-07-11 14:54:54.230132 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:54.230250 I | ceph-mgr: 2017-07-11 14:54:54.230235 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:54.230666 I | ceph-mgr: 2017-07-11 14:54:54.230648 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:55.449356 I | ceph-mgr: 2017-07-11 14:54:55.434330 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11921 10.233.124.5:0/3851262582' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:55.449658 I | ceph-mgr: 2017-07-11 14:54:55.449599 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:56.247806 I | ceph-mgr: 2017-07-11 14:54:56.246478 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:56.247953 I | ceph-mgr: 2017-07-11 14:54:56.246483 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:56.248009 I | ceph-mgr: 2017-07-11 14:54:56.246514 7f4cc3226700 0 mgr tick
- 2017-07-11 14:54:56.353856 I | ceph-mgr: 2017-07-11 14:54:56.353792 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11367 10.233.124.0:0/3421854610' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:54:56.353927 I | ceph-mgr: 2017-07-11 14:54:56.353902 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:54:58.250636 I | ceph-mgr: 2017-07-11 14:54:58.250262 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:54:58.250796 I | ceph-mgr: 2017-07-11 14:54:58.250284 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:54:58.250835 I | ceph-mgr: 2017-07-11 14:54:58.250308 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:00.274357 I | ceph-mgr: 2017-07-11 14:55:00.258555 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:00.274505 I | ceph-mgr: 2017-07-11 14:55:00.258560 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:00.274560 I | ceph-mgr: 2017-07-11 14:55:00.258581 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:00.666463 I | ceph-mgr: 2017-07-11 14:55:00.666402 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11933 10.233.124.5:0/3352613986' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:00.666529 I | ceph-mgr: 2017-07-11 14:55:00.666422 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:01.672379 I | ceph-mgr: 2017-07-11 14:55:01.672279 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11382 10.233.124.0:0/1046409098' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:01.672442 I | ceph-mgr: 2017-07-11 14:55:01.672325 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:02.278592 I | ceph-mgr: 2017-07-11 14:55:02.278555 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:02.278669 I | ceph-mgr: 2017-07-11 14:55:02.278655 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:02.278893 I | ceph-mgr: 2017-07-11 14:55:02.278878 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:04.302578 I | ceph-mgr: 2017-07-11 14:55:04.302524 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:04.302783 I | ceph-mgr: 2017-07-11 14:55:04.302654 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:04.308705 I | ceph-mgr: 2017-07-11 14:55:04.308686 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:05.461579 I | ceph-mgr: 2017-07-11 14:55:05.461519 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11948 10.233.124.5:0/3222265189' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:05.461656 I | ceph-mgr: 2017-07-11 14:55:05.461539 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:06.330230 I | ceph-mgr: 2017-07-11 14:55:06.328912 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:06.330296 I | ceph-mgr: 2017-07-11 14:55:06.328918 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:06.330314 I | ceph-mgr: 2017-07-11 14:55:06.328937 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:06.338253 I | ceph-mgr: 2017-07-11 14:55:06.338162 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11397 10.233.124.5:0/163604616' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:06.338292 I | ceph-mgr: 2017-07-11 14:55:06.338208 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:08.333834 I | ceph-mgr: 2017-07-11 14:55:08.330577 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:08.333905 I | ceph-mgr: 2017-07-11 14:55:08.330582 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:08.333923 I | ceph-mgr: 2017-07-11 14:55:08.330603 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:10.123364 I | ceph-mgr: 2017-07-11 14:55:10.123312 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6484 10.233.124.5:0/4147947898' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:10.123460 I | ceph-mgr: 2017-07-11 14:55:10.123434 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:10.366273 I | ceph-mgr: 2017-07-11 14:55:10.366247 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:10.366343 I | ceph-mgr: 2017-07-11 14:55:10.366329 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:10.366426 I | ceph-mgr: 2017-07-11 14:55:10.366415 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:10.993674 I | ceph-mgr: 2017-07-11 14:55:10.993557 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11954 10.233.124.5:0/2862878491' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:10.993857 I | ceph-mgr: 2017-07-11 14:55:10.993778 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:12.371440 I | ceph-mgr: 2017-07-11 14:55:12.371134 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:12.371526 I | ceph-mgr: 2017-07-11 14:55:12.371511 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:12.371601 I | ceph-mgr: 2017-07-11 14:55:12.371591 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:14.395376 I | ceph-mgr: 2017-07-11 14:55:14.395316 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:14.395457 I | ceph-mgr: 2017-07-11 14:55:14.395442 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:14.395680 I | ceph-mgr: 2017-07-11 14:55:14.395664 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:15.055494 I | ceph-mgr: 2017-07-11 14:55:15.055431 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11969 10.233.124.5:0/3965988208' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:15.055561 I | ceph-mgr: 2017-07-11 14:55:15.055450 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:16.363491 I | ceph-mgr: 2017-07-11 14:55:16.363400 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11972 10.233.124.5:0/3911108517' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:16.363546 I | ceph-mgr: 2017-07-11 14:55:16.363449 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:16.421443 I | ceph-mgr: 2017-07-11 14:55:16.405192 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:16.421482 I | ceph-mgr: 2017-07-11 14:55:16.405197 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:16.421497 I | ceph-mgr: 2017-07-11 14:55:16.405215 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:18.428747 I | ceph-mgr: 2017-07-11 14:55:18.428648 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:18.428823 I | ceph-mgr: 2017-07-11 14:55:18.428808 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:18.429033 I | ceph-mgr: 2017-07-11 14:55:18.428920 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:20.037406 I | ceph-mgr: 2017-07-11 14:55:20.037349 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11987 10.233.124.5:0/3369524441' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:20.038030 I | ceph-mgr: 2017-07-11 14:55:20.038000 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:20.435281 I | ceph-mgr: 2017-07-11 14:55:20.433987 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:20.450710 I | ceph-mgr: 2017-07-11 14:55:20.433992 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:20.450726 I | ceph-mgr: 2017-07-11 14:55:20.434011 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:20.938198 I | ceph-mgr: 2017-07-11 14:55:20.938126 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11990 10.233.124.5:0/3533166830' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:20.938285 I | ceph-mgr: 2017-07-11 14:55:20.938259 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:22.458712 I | ceph-mgr: 2017-07-11 14:55:22.441988 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:22.458778 I | ceph-mgr: 2017-07-11 14:55:22.442001 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:22.458795 I | ceph-mgr: 2017-07-11 14:55:22.442039 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:24.484610 I | ceph-mgr: 2017-07-11 14:55:24.468665 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:24.484676 I | ceph-mgr: 2017-07-11 14:55:24.468670 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:24.484692 I | ceph-mgr: 2017-07-11 14:55:24.468692 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:24.867913 I | ceph-mgr: 2017-07-11 14:55:24.852774 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11451 10.233.124.0:0/92467206' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:24.867985 I | ceph-mgr: 2017-07-11 14:55:24.852793 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:26.077072 I | ceph-mgr: 2017-07-11 14:55:26.076924 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12005 10.233.124.5:0/3650633599' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:26.077155 I | ceph-mgr: 2017-07-11 14:55:26.076970 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:26.498086 I | ceph-mgr: 2017-07-11 14:55:26.488642 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:26.504248 I | ceph-mgr: 2017-07-11 14:55:26.488647 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:26.504288 I | ceph-mgr: 2017-07-11 14:55:26.488668 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:28.511558 I | ceph-mgr: 2017-07-11 14:55:28.511521 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:28.511709 I | ceph-mgr: 2017-07-11 14:55:28.511646 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:28.511956 I | ceph-mgr: 2017-07-11 14:55:28.511938 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:30.073514 I | ceph-mgr: 2017-07-11 14:55:30.073448 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12023 10.233.124.5:0/3216553142' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:30.073766 I | ceph-mgr: 2017-07-11 14:55:30.073737 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:30.532254 I | ceph-mgr: 2017-07-11 14:55:30.532216 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:30.532324 I | ceph-mgr: 2017-07-11 14:55:30.532309 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:30.532488 I | ceph-mgr: 2017-07-11 14:55:30.532426 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:31.055426 I | ceph-mgr: 2017-07-11 14:55:31.055324 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12029 10.233.124.5:0/1847764206' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:31.055476 I | ceph-mgr: 2017-07-11 14:55:31.055374 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:32.541967 I | ceph-mgr: 2017-07-11 14:55:32.541911 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:32.542193 I | ceph-mgr: 2017-07-11 14:55:32.542167 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:32.543589 I | ceph-mgr: 2017-07-11 14:55:32.543569 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:34.548901 I | ceph-mgr: 2017-07-11 14:55:34.548858 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:34.557474 I | ceph-mgr: 2017-07-11 14:55:34.557439 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:34.558457 I | ceph-mgr: 2017-07-11 14:55:34.557565 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:35.650829 I | ceph-mgr: 2017-07-11 14:55:35.650745 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12044 10.233.124.5:0/3788417402' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:35.650912 I | ceph-mgr: 2017-07-11 14:55:35.650785 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:36.563186 I | ceph-mgr: 2017-07-11 14:55:36.555287 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11472 10.233.124.0:0/3934420462' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:36.563254 I | ceph-mgr: 2017-07-11 14:55:36.561950 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:36.563269 I | ceph-mgr: 2017-07-11 14:55:36.561955 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:36.563280 I | ceph-mgr: 2017-07-11 14:55:36.561971 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:36.563331 I | ceph-mgr: 2017-07-11 14:55:36.563309 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:38.571107 I | ceph-mgr: 2017-07-11 14:55:38.568131 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:38.571170 I | ceph-mgr: 2017-07-11 14:55:38.568136 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:38.571185 I | ceph-mgr: 2017-07-11 14:55:38.568157 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:39.947046 I | ceph-mgr: 2017-07-11 14:55:39.946985 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12059 10.233.124.5:0/1693319409' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:39.947226 I | ceph-mgr: 2017-07-11 14:55:39.947139 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:40.575109 I | ceph-mgr: 2017-07-11 14:55:40.574895 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:40.575166 I | ceph-mgr: 2017-07-11 14:55:40.574904 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:40.575181 I | ceph-mgr: 2017-07-11 14:55:40.574933 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:41.262575 I | ceph-mgr: 2017-07-11 14:55:41.262436 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11481 10.233.124.0:0/2170816579' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:41.271817 I | ceph-mgr: 2017-07-11 14:55:41.271777 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:42.579008 I | ceph-mgr: 2017-07-11 14:55:42.577695 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:42.579106 I | ceph-mgr: 2017-07-11 14:55:42.577709 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:42.579124 I | ceph-mgr: 2017-07-11 14:55:42.577738 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:44.579597 I | ceph-mgr: 2017-07-11 14:55:44.579565 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:44.579666 I | ceph-mgr: 2017-07-11 14:55:44.579652 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:44.579745 I | ceph-mgr: 2017-07-11 14:55:44.579735 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:44.599694 I | ceph-mgr: 2017-07-11 14:55:44.599659 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11490 10.233.124.0:0/1333817615' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:44.599765 I | ceph-mgr: 2017-07-11 14:55:44.599739 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:45.673163 I | ceph-mgr: 2017-07-11 14:55:45.673080 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11493 10.233.124.0:0/3115966760' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:45.673324 I | ceph-mgr: 2017-07-11 14:55:45.673239 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:46.583397 I | ceph-mgr: 2017-07-11 14:55:46.583348 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:46.583481 I | ceph-mgr: 2017-07-11 14:55:46.583466 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:46.583617 I | ceph-mgr: 2017-07-11 14:55:46.583547 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:48.603224 I | ceph-mgr: 2017-07-11 14:55:48.603191 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:48.603316 I | ceph-mgr: 2017-07-11 14:55:48.603301 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:48.603536 I | ceph-mgr: 2017-07-11 14:55:48.603520 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:49.647352 I | ceph-mgr: 2017-07-11 14:55:49.647294 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11508 10.233.124.5:0/1086623289' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:49.647419 I | ceph-mgr: 2017-07-11 14:55:49.647313 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:50.626514 I | ceph-mgr: 2017-07-11 14:55:50.623535 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:50.626570 I | ceph-mgr: 2017-07-11 14:55:50.623546 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:50.626587 I | ceph-mgr: 2017-07-11 14:55:50.623583 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:50.663384 I | ceph-mgr: 2017-07-11 14:55:50.663292 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11514 10.233.124.0:0/2577168558' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:50.663457 I | ceph-mgr: 2017-07-11 14:55:50.663431 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:52.627859 I | ceph-mgr: 2017-07-11 14:55:52.627191 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:52.628008 I | ceph-mgr: 2017-07-11 14:55:52.627196 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:52.628038 I | ceph-mgr: 2017-07-11 14:55:52.627217 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:54.645560 I | ceph-mgr: 2017-07-11 14:55:54.636541 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:54.645625 I | ceph-mgr: 2017-07-11 14:55:54.636547 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:54.645652 I | ceph-mgr: 2017-07-11 14:55:54.636564 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:54.694111 I | ceph-mgr: 2017-07-11 14:55:54.694030 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12104 10.233.124.5:0/3117455358' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:54.694235 I | ceph-mgr: 2017-07-11 14:55:54.694207 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:55.779173 I | ceph-mgr: 2017-07-11 14:55:55.779097 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11526 10.233.124.0:0/851455315' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:55.779272 I | ceph-mgr: 2017-07-11 14:55:55.779245 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:55:56.639718 I | ceph-mgr: 2017-07-11 14:55:56.638989 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:56.639796 I | ceph-mgr: 2017-07-11 14:55:56.638999 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:56.639812 I | ceph-mgr: 2017-07-11 14:55:56.639027 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:58.660330 I | ceph-mgr: 2017-07-11 14:55:58.658936 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:55:58.667743 I | ceph-mgr: 2017-07-11 14:55:58.658945 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:55:58.667784 I | ceph-mgr: 2017-07-11 14:55:58.658972 7f4cc3226700 0 mgr tick
- 2017-07-11 14:55:59.552552 I | ceph-mgr: 2017-07-11 14:55:59.552494 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11535 10.233.124.0:0/636634302' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:55:59.552614 I | ceph-mgr: 2017-07-11 14:55:59.552514 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:00.515245 I | ceph-mgr: 2017-07-11 14:56:00.515190 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11541 10.233.124.5:0/1123152268' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:00.515441 I | ceph-mgr: 2017-07-11 14:56:00.515400 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:00.664322 I | ceph-mgr: 2017-07-11 14:56:00.660733 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:00.664590 I | ceph-mgr: 2017-07-11 14:56:00.660746 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:00.664624 I | ceph-mgr: 2017-07-11 14:56:00.660792 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:02.667995 I | ceph-mgr: 2017-07-11 14:56:02.667964 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:02.668066 I | ceph-mgr: 2017-07-11 14:56:02.668052 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:02.668139 I | ceph-mgr: 2017-07-11 14:56:02.668129 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:04.373613 I | ceph-mgr: 2017-07-11 14:56:04.373584 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12140 10.233.124.5:0/484872011' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:04.373714 I | ceph-mgr: 2017-07-11 14:56:04.373700 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:04.682737 I | ceph-mgr: 2017-07-11 14:56:04.672972 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:04.682834 I | ceph-mgr: 2017-07-11 14:56:04.672977 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:04.682869 I | ceph-mgr: 2017-07-11 14:56:04.672994 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:05.265110 I | ceph-mgr: 2017-07-11 14:56:05.265078 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12146 10.233.124.5:0/3493037585' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:05.265325 I | ceph-mgr: 2017-07-11 14:56:05.265289 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:06.682688 I | ceph-mgr: 2017-07-11 14:56:06.681389 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:06.682758 I | ceph-mgr: 2017-07-11 14:56:06.681398 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:06.682774 I | ceph-mgr: 2017-07-11 14:56:06.681425 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:08.691834 I | ceph-mgr: 2017-07-11 14:56:08.691801 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:08.691913 I | ceph-mgr: 2017-07-11 14:56:08.691899 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:08.701973 I | ceph-mgr: 2017-07-11 14:56:08.692013 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:09.305327 I | ceph-mgr: 2017-07-11 14:56:09.305263 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11568 10.233.124.0:0/2589080333' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:09.307025 I | ceph-mgr: 2017-07-11 14:56:09.305283 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:10.257383 I | ceph-mgr: 2017-07-11 14:56:10.257296 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12155 10.233.124.0:0/2371654897' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:10.257441 I | ceph-mgr: 2017-07-11 14:56:10.257343 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:10.716109 I | ceph-mgr: 2017-07-11 14:56:10.716073 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:10.716291 I | ceph-mgr: 2017-07-11 14:56:10.716275 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:10.719369 I | ceph-mgr: 2017-07-11 14:56:10.719258 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:12.743163 I | ceph-mgr: 2017-07-11 14:56:12.743125 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:12.743398 I | ceph-mgr: 2017-07-11 14:56:12.743240 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:12.743835 I | ceph-mgr: 2017-07-11 14:56:12.743818 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:14.251618 I | ceph-mgr: 2017-07-11 14:56:14.242355 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11580 10.233.124.0:0/1139514102' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:14.251693 I | ceph-mgr: 2017-07-11 14:56:14.242375 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:14.760205 I | ceph-mgr: 2017-07-11 14:56:14.760176 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:14.760424 I | ceph-mgr: 2017-07-11 14:56:14.760408 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:14.769887 I | ceph-mgr: 2017-07-11 14:56:14.769859 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:15.160334 I | ceph-mgr: 2017-07-11 14:56:15.160256 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11586 10.233.124.0:0/4084192640' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:15.160417 I | ceph-mgr: 2017-07-11 14:56:15.160392 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:16.776176 I | ceph-mgr: 2017-07-11 14:56:16.776145 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:16.776262 I | ceph-mgr: 2017-07-11 14:56:16.776248 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:16.776496 I | ceph-mgr: 2017-07-11 14:56:16.776480 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:18.778829 I | ceph-mgr: 2017-07-11 14:56:18.778799 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:18.778906 I | ceph-mgr: 2017-07-11 14:56:18.778892 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:18.779129 I | ceph-mgr: 2017-07-11 14:56:18.779011 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:19.201863 I | ceph-mgr: 2017-07-11 14:56:19.201805 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11598 10.233.124.0:0/3601449942' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:19.203136 I | ceph-mgr: 2017-07-11 14:56:19.201824 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:20.308256 I | ceph-mgr: 2017-07-11 14:56:20.308167 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12188 10.233.124.5:0/22272659' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:20.310176 I | ceph-mgr: 2017-07-11 14:56:20.308213 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:20.796948 I | ceph-mgr: 2017-07-11 14:56:20.796912 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:20.797022 I | ceph-mgr: 2017-07-11 14:56:20.797008 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:20.812562 I | ceph-mgr: 2017-07-11 14:56:20.812544 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:22.818495 I | ceph-mgr: 2017-07-11 14:56:22.818466 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:22.818576 I | ceph-mgr: 2017-07-11 14:56:22.818562 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:22.818898 I | ceph-mgr: 2017-07-11 14:56:22.818673 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:24.456906 I | ceph-mgr: 2017-07-11 14:56:24.441586 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11610 10.233.124.0:0/1875007571' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:24.456981 I | ceph-mgr: 2017-07-11 14:56:24.441606 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:24.833522 I | ceph-mgr: 2017-07-11 14:56:24.825477 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:24.833573 I | ceph-mgr: 2017-07-11 14:56:24.825486 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:24.833600 I | ceph-mgr: 2017-07-11 14:56:24.825512 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:25.356025 I | ceph-mgr: 2017-07-11 14:56:25.355868 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11613 10.233.124.0:0/2341981372' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:25.356101 I | ceph-mgr: 2017-07-11 14:56:25.355919 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:26.834665 I | ceph-mgr: 2017-07-11 14:56:26.832851 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:26.834748 I | ceph-mgr: 2017-07-11 14:56:26.832885 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:26.834765 I | ceph-mgr: 2017-07-11 14:56:26.832921 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:28.840410 I | ceph-mgr: 2017-07-11 14:56:28.838958 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:28.840578 I | ceph-mgr: 2017-07-11 14:56:28.838968 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:28.840655 I | ceph-mgr: 2017-07-11 14:56:28.839009 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:29.253731 I | ceph-mgr: 2017-07-11 14:56:29.253657 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12215 10.233.124.5:0/3595067590' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:29.253842 I | ceph-mgr: 2017-07-11 14:56:29.253814 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:30.182196 I | ceph-mgr: 2017-07-11 14:56:30.182090 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11631 10.233.124.5:0/1760020751' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:30.182269 I | ceph-mgr: 2017-07-11 14:56:30.182144 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:30.862795 I | ceph-mgr: 2017-07-11 14:56:30.842699 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:30.871331 I | ceph-mgr: 2017-07-11 14:56:30.842706 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:30.871431 I | ceph-mgr: 2017-07-11 14:56:30.842729 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:32.892647 I | ceph-mgr: 2017-07-11 14:56:32.892579 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:32.894716 I | ceph-mgr: 2017-07-11 14:56:32.894700 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:32.895107 I | ceph-mgr: 2017-07-11 14:56:32.895091 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:34.031025 I | ceph-mgr: 2017-07-11 14:56:34.030977 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12233 10.233.124.5:0/2406556428' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:34.031118 I | ceph-mgr: 2017-07-11 14:56:34.031093 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:34.902908 I | ceph-mgr: 2017-07-11 14:56:34.901149 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:34.910843 I | ceph-mgr: 2017-07-11 14:56:34.910824 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:34.911071 I | ceph-mgr: 2017-07-11 14:56:34.911056 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:34.950126 I | ceph-mgr: 2017-07-11 14:56:34.950064 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12239 10.233.124.5:0/4117126522' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:34.950194 I | ceph-mgr: 2017-07-11 14:56:34.950169 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:36.950917 I | ceph-mgr: 2017-07-11 14:56:36.950884 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:36.950996 I | ceph-mgr: 2017-07-11 14:56:36.950982 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:36.951217 I | ceph-mgr: 2017-07-11 14:56:36.951201 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:38.965107 I | ceph-mgr: 2017-07-11 14:56:38.965053 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:38.965201 I | ceph-mgr: 2017-07-11 14:56:38.965186 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:38.965457 I | ceph-mgr: 2017-07-11 14:56:38.965433 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:38.969775 I | ceph-mgr: 2017-07-11 14:56:38.969740 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12254 10.233.124.5:0/3372985371' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:38.969859 I | ceph-mgr: 2017-07-11 14:56:38.969833 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:40.144167 I | ceph-mgr: 2017-07-11 14:56:40.144083 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11658 10.233.124.0:0/3174062049' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:40.144378 I | ceph-mgr: 2017-07-11 14:56:40.144265 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:40.970627 I | ceph-mgr: 2017-07-11 14:56:40.968503 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:40.970829 I | ceph-mgr: 2017-07-11 14:56:40.968520 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:40.970856 I | ceph-mgr: 2017-07-11 14:56:40.968543 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:43.065356 I | ceph-mgr: 2017-07-11 14:56:43.055984 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:43.065375 I | ceph-mgr: 2017-07-11 14:56:43.055994 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:43.065378 I | ceph-mgr: 2017-07-11 14:56:43.056028 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:43.986548 I | ceph-mgr: 2017-07-11 14:56:43.986488 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11670 10.233.124.0:0/3428627079' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:43.986731 I | ceph-mgr: 2017-07-11 14:56:43.986634 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:44.929432 I | ceph-mgr: 2017-07-11 14:56:44.929359 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12272 10.233.124.5:0/495961747' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:56:44.929520 I | ceph-mgr: 2017-07-11 14:56:44.929494 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:56:45.083679 I | ceph-mgr: 2017-07-11 14:56:45.067518 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:45.083816 I | ceph-mgr: 2017-07-11 14:56:45.067523 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:45.083847 I | ceph-mgr: 2017-07-11 14:56:45.067542 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:47.089385 I | ceph-mgr: 2017-07-11 14:56:47.089266 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:47.089469 I | ceph-mgr: 2017-07-11 14:56:47.089454 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:47.097311 I | ceph-mgr: 2017-07-11 14:56:47.097286 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:49.135174 I | ceph-mgr: 2017-07-11 14:56:49.135141 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:49.135270 I | ceph-mgr: 2017-07-11 14:56:49.135255 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:49.135487 I | ceph-mgr: 2017-07-11 14:56:49.135473 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:51.138864 I | ceph-mgr: 2017-07-11 14:56:51.138821 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:51.138936 I | ceph-mgr: 2017-07-11 14:56:51.138922 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:51.139168 I | ceph-mgr: 2017-07-11 14:56:51.139152 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:53.148324 I | ceph-mgr: 2017-07-11 14:56:53.148280 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:53.148402 I | ceph-mgr: 2017-07-11 14:56:53.148388 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:53.148638 I | ceph-mgr: 2017-07-11 14:56:53.148623 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:55.151869 I | ceph-mgr: 2017-07-11 14:56:55.151829 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:55.151946 I | ceph-mgr: 2017-07-11 14:56:55.151932 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:55.152180 I | ceph-mgr: 2017-07-11 14:56:55.152165 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:57.172329 I | ceph-mgr: 2017-07-11 14:56:57.172282 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:57.172407 I | ceph-mgr: 2017-07-11 14:56:57.172393 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:57.172650 I | ceph-mgr: 2017-07-11 14:56:57.172635 7f4cc3226700 0 mgr tick
- 2017-07-11 14:56:59.185613 I | ceph-mgr: 2017-07-11 14:56:59.185565 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:56:59.185706 I | ceph-mgr: 2017-07-11 14:56:59.185692 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:56:59.185949 I | ceph-mgr: 2017-07-11 14:56:59.185933 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:01.191236 I | ceph-mgr: 2017-07-11 14:57:01.190318 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:01.191312 I | ceph-mgr: 2017-07-11 14:57:01.191295 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:01.191596 I | ceph-mgr: 2017-07-11 14:57:01.191578 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:03.199389 I | ceph-mgr: 2017-07-11 14:57:03.199318 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:03.199458 I | ceph-mgr: 2017-07-11 14:57:03.199444 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:03.199688 I | ceph-mgr: 2017-07-11 14:57:03.199673 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:05.202182 I | ceph-mgr: 2017-07-11 14:57:05.202121 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:05.202277 I | ceph-mgr: 2017-07-11 14:57:05.202261 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:05.202544 I | ceph-mgr: 2017-07-11 14:57:05.202518 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:07.218183 I | ceph-mgr: 2017-07-11 14:57:07.215453 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:07.225259 I | ceph-mgr: 2017-07-11 14:57:07.225240 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:07.226715 I | ceph-mgr: 2017-07-11 14:57:07.226697 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:09.235481 I | ceph-mgr: 2017-07-11 14:57:09.235384 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:09.235587 I | ceph-mgr: 2017-07-11 14:57:09.235572 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:09.235808 I | ceph-mgr: 2017-07-11 14:57:09.235793 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:11.243638 I | ceph-mgr: 2017-07-11 14:57:11.243590 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:11.243733 I | ceph-mgr: 2017-07-11 14:57:11.243719 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:11.243972 I | ceph-mgr: 2017-07-11 14:57:11.243958 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:13.265589 I | ceph-mgr: 2017-07-11 14:57:13.265544 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:13.265673 I | ceph-mgr: 2017-07-11 14:57:13.265659 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:13.265900 I | ceph-mgr: 2017-07-11 14:57:13.265884 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:15.279130 I | ceph-mgr: 2017-07-11 14:57:15.279096 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:15.281550 I | ceph-mgr: 2017-07-11 14:57:15.279299 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:15.281900 I | ceph-mgr: 2017-07-11 14:57:15.281682 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:17.299159 I | ceph-mgr: 2017-07-11 14:57:17.299112 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:17.299228 I | ceph-mgr: 2017-07-11 14:57:17.299213 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:17.299462 I | ceph-mgr: 2017-07-11 14:57:17.299446 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:19.306254 I | ceph-mgr: 2017-07-11 14:57:19.306214 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:19.306350 I | ceph-mgr: 2017-07-11 14:57:19.306335 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:19.306647 I | ceph-mgr: 2017-07-11 14:57:19.306632 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:21.311129 I | ceph-mgr: 2017-07-11 14:57:21.308786 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:21.311220 I | ceph-mgr: 2017-07-11 14:57:21.311206 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:21.311668 I | ceph-mgr: 2017-07-11 14:57:21.311650 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:23.333028 I | ceph-mgr: 2017-07-11 14:57:23.332994 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:23.333106 I | ceph-mgr: 2017-07-11 14:57:23.333091 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:23.333338 I | ceph-mgr: 2017-07-11 14:57:23.333322 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:25.353420 I | ceph-mgr: 2017-07-11 14:57:25.353382 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:25.353503 I | ceph-mgr: 2017-07-11 14:57:25.353487 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:25.353948 I | ceph-mgr: 2017-07-11 14:57:25.353931 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:27.357426 I | ceph-mgr: 2017-07-11 14:57:27.357384 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:27.357507 I | ceph-mgr: 2017-07-11 14:57:27.357493 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:27.357758 I | ceph-mgr: 2017-07-11 14:57:27.357732 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:29.378019 I | ceph-mgr: 2017-07-11 14:57:29.377551 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:29.378079 I | ceph-mgr: 2017-07-11 14:57:29.377568 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:29.378106 I | ceph-mgr: 2017-07-11 14:57:29.377622 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:31.381670 I | ceph-mgr: 2017-07-11 14:57:31.381630 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:31.382190 I | ceph-mgr: 2017-07-11 14:57:31.382173 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:31.382315 I | ceph-mgr: 2017-07-11 14:57:31.382280 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:33.383713 I | ceph-mgr: 2017-07-11 14:57:33.383674 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:33.383787 I | ceph-mgr: 2017-07-11 14:57:33.383772 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:33.383867 I | ceph-mgr: 2017-07-11 14:57:33.383855 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:35.389836 I | ceph-mgr: 2017-07-11 14:57:35.389787 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:35.389911 I | ceph-mgr: 2017-07-11 14:57:35.389897 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:35.390137 I | ceph-mgr: 2017-07-11 14:57:35.389986 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:37.398779 I | ceph-mgr: 2017-07-11 14:57:37.398734 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:37.398855 I | ceph-mgr: 2017-07-11 14:57:37.398841 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:37.399110 I | ceph-mgr: 2017-07-11 14:57:37.399084 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:39.400839 I | ceph-mgr: 2017-07-11 14:57:39.400780 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:39.400932 I | ceph-mgr: 2017-07-11 14:57:39.400917 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:39.401170 I | ceph-mgr: 2017-07-11 14:57:39.401153 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:41.421085 I | ceph-mgr: 2017-07-11 14:57:41.421041 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:41.421164 I | ceph-mgr: 2017-07-11 14:57:41.421150 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:41.421405 I | ceph-mgr: 2017-07-11 14:57:41.421389 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:43.432029 I | ceph-mgr: 2017-07-11 14:57:43.431963 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:43.433411 I | ceph-mgr: 2017-07-11 14:57:43.433392 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:43.433828 I | ceph-mgr: 2017-07-11 14:57:43.433810 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:45.436587 I | ceph-mgr: 2017-07-11 14:57:45.436553 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:45.436660 I | ceph-mgr: 2017-07-11 14:57:45.436646 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:45.436915 I | ceph-mgr: 2017-07-11 14:57:45.436898 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:47.453958 I | ceph-mgr: 2017-07-11 14:57:47.453918 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:47.454116 I | ceph-mgr: 2017-07-11 14:57:47.454101 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:47.454352 I | ceph-mgr: 2017-07-11 14:57:47.454337 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:49.461592 I | ceph-mgr: 2017-07-11 14:57:49.461543 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:49.463114 I | ceph-mgr: 2017-07-11 14:57:49.463097 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:49.475201 I | ceph-mgr: 2017-07-11 14:57:49.475185 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:51.506935 I | ceph-mgr: 2017-07-11 14:57:51.506887 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:51.507029 I | ceph-mgr: 2017-07-11 14:57:51.507016 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:51.509496 I | ceph-mgr: 2017-07-11 14:57:51.509478 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:53.525065 I | ceph-mgr: 2017-07-11 14:57:53.522136 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:53.525217 I | ceph-mgr: 2017-07-11 14:57:53.522143 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:53.525264 I | ceph-mgr: 2017-07-11 14:57:53.522167 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:55.527782 I | ceph-mgr: 2017-07-11 14:57:55.526369 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:55.528317 I | ceph-mgr: 2017-07-11 14:57:55.526376 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:55.528359 I | ceph-mgr: 2017-07-11 14:57:55.526400 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:57.528589 I | ceph-mgr: 2017-07-11 14:57:57.528528 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:57.528678 I | ceph-mgr: 2017-07-11 14:57:57.528663 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:57.529011 I | ceph-mgr: 2017-07-11 14:57:57.528985 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:58.910732 I | ceph-mgr: 2017-07-11 14:57:58.910658 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12290 10.233.124.5:0/3660563333' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:57:58.910829 I | ceph-mgr: 2017-07-11 14:57:58.910688 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:57:59.548393 I | ceph-mgr: 2017-07-11 14:57:59.548355 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:57:59.548476 I | ceph-mgr: 2017-07-11 14:57:59.548463 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:57:59.548697 I | ceph-mgr: 2017-07-11 14:57:59.548682 7f4cc3226700 0 mgr tick
- 2017-07-11 14:57:59.873382 I | ceph-mgr: 2017-07-11 14:57:59.873305 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6595 10.233.124.5:0/573428886' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:57:59.873423 I | ceph-mgr: 2017-07-11 14:57:59.873351 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:01.577612 I | ceph-mgr: 2017-07-11 14:58:01.569303 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:01.577628 I | ceph-mgr: 2017-07-11 14:58:01.569308 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:01.577634 I | ceph-mgr: 2017-07-11 14:58:01.569330 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:02.746588 I | ceph-mgr: 2017-07-11 14:58:02.746560 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11685 10.233.124.5:0/4224243397' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:02.746681 I | ceph-mgr: 2017-07-11 14:58:02.746668 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:03.582391 I | ceph-mgr: 2017-07-11 14:58:03.580997 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:03.590627 I | ceph-mgr: 2017-07-11 14:58:03.581003 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:03.590698 I | ceph-mgr: 2017-07-11 14:58:03.581026 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:03.760932 I | ceph-mgr: 2017-07-11 14:58:03.760913 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12317 10.233.124.5:0/4222088909' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:03.761120 I | ceph-mgr: 2017-07-11 14:58:03.761102 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:05.594533 I | ceph-mgr: 2017-07-11 14:58:05.585003 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:05.600247 I | ceph-mgr: 2017-07-11 14:58:05.585009 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:05.600284 I | ceph-mgr: 2017-07-11 14:58:05.585032 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:06.599560 I | ceph-mgr: 2017-07-11 14:58:06.599514 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12329 10.233.124.5:0/2450480548' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:06.599655 I | ceph-mgr: 2017-07-11 14:58:06.599630 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:07.493171 I | ceph-mgr: 2017-07-11 14:58:07.493096 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12335 10.233.124.5:0/2963063621' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:07.493263 I | ceph-mgr: 2017-07-11 14:58:07.493236 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:07.773708 I | ceph-mgr: 2017-07-11 14:58:07.611618 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:07.773892 I | ceph-mgr: 2017-07-11 14:58:07.611623 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:07.773928 I | ceph-mgr: 2017-07-11 14:58:07.611643 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:09.781680 I | ceph-mgr: 2017-07-11 14:58:09.781613 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:09.781765 I | ceph-mgr: 2017-07-11 14:58:09.781752 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:09.782011 I | ceph-mgr: 2017-07-11 14:58:09.781996 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:10.285319 I | ceph-mgr: 2017-07-11 14:58:10.285258 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11715 10.233.124.0:0/303526198' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:10.285406 I | ceph-mgr: 2017-07-11 14:58:10.285276 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:11.190004 I | ceph-mgr: 2017-07-11 14:58:11.189893 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12347 10.233.124.5:0/1731099520' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:11.190034 I | ceph-mgr: 2017-07-11 14:58:11.189959 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:11.785202 I | ceph-mgr: 2017-07-11 14:58:11.785171 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:11.798659 I | ceph-mgr: 2017-07-11 14:58:11.798617 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:11.798969 I | ceph-mgr: 2017-07-11 14:58:11.798952 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:13.808613 I | ceph-mgr: 2017-07-11 14:58:13.807171 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:13.808825 I | ceph-mgr: 2017-07-11 14:58:13.807185 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:13.808852 I | ceph-mgr: 2017-07-11 14:58:13.807230 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:14.081044 I | ceph-mgr: 2017-07-11 14:58:14.080992 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11733 10.233.124.0:0/3436745596' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:14.082637 I | ceph-mgr: 2017-07-11 14:58:14.082608 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:14.988069 I | ceph-mgr: 2017-07-11 14:58:14.987982 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11736 10.233.124.5:0/34942001' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:14.988402 I | ceph-mgr: 2017-07-11 14:58:14.988030 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:15.817595 I | ceph-mgr: 2017-07-11 14:58:15.809661 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:15.817660 I | ceph-mgr: 2017-07-11 14:58:15.809672 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:15.817676 I | ceph-mgr: 2017-07-11 14:58:15.809701 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:17.816207 I | ceph-mgr: 2017-07-11 14:58:17.816148 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:17.816302 I | ceph-mgr: 2017-07-11 14:58:17.816288 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:17.816405 I | ceph-mgr: 2017-07-11 14:58:17.816362 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:17.963292 I | ceph-mgr: 2017-07-11 14:58:17.963247 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12365 10.233.124.5:0/871005616' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:17.965646 I | ceph-mgr: 2017-07-11 14:58:17.963337 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:18.990049 I | ceph-mgr: 2017-07-11 14:58:18.989975 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11754 10.233.124.5:0/4150643563' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:18.990205 I | ceph-mgr: 2017-07-11 14:58:18.990140 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:19.820220 I | ceph-mgr: 2017-07-11 14:58:19.820168 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:19.820375 I | ceph-mgr: 2017-07-11 14:58:19.820286 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:19.820481 I | ceph-mgr: 2017-07-11 14:58:19.820464 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:21.825991 I | ceph-mgr: 2017-07-11 14:58:21.825907 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:21.826068 I | ceph-mgr: 2017-07-11 14:58:21.826053 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:21.826281 I | ceph-mgr: 2017-07-11 14:58:21.826134 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:22.038023 I | ceph-mgr: 2017-07-11 14:58:22.037965 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11763 10.233.124.0:0/3405735762' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:22.038063 I | ceph-mgr: 2017-07-11 14:58:22.037983 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:23.355201 I | ceph-mgr: 2017-07-11 14:58:23.355106 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11766 10.233.124.0:0/1643536992' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:23.355256 I | ceph-mgr: 2017-07-11 14:58:23.355154 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:23.849457 I | ceph-mgr: 2017-07-11 14:58:23.849429 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:23.849518 I | ceph-mgr: 2017-07-11 14:58:23.849505 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:23.849726 I | ceph-mgr: 2017-07-11 14:58:23.849615 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:25.861122 I | ceph-mgr: 2017-07-11 14:58:25.851861 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:25.861184 I | ceph-mgr: 2017-07-11 14:58:25.851874 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:25.861201 I | ceph-mgr: 2017-07-11 14:58:25.851903 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:26.293582 I | ceph-mgr: 2017-07-11 14:58:26.293537 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12398 10.233.124.5:0/3328184904' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:26.293672 I | ceph-mgr: 2017-07-11 14:58:26.293646 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:27.231527 I | ceph-mgr: 2017-07-11 14:58:27.231423 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12401 10.233.124.5:0/170246249' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:27.233587 I | ceph-mgr: 2017-07-11 14:58:27.231487 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:27.868554 I | ceph-mgr: 2017-07-11 14:58:27.853145 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:27.868616 I | ceph-mgr: 2017-07-11 14:58:27.853153 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:27.868632 I | ceph-mgr: 2017-07-11 14:58:27.853178 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:29.872531 I | ceph-mgr: 2017-07-11 14:58:29.872498 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:29.872617 I | ceph-mgr: 2017-07-11 14:58:29.872603 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:29.872861 I | ceph-mgr: 2017-07-11 14:58:29.872845 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:30.014504 I | ceph-mgr: 2017-07-11 14:58:30.014454 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12410 10.233.124.5:0/1687291215' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:30.014542 I | ceph-mgr: 2017-07-11 14:58:30.014471 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:30.938291 I | ceph-mgr: 2017-07-11 14:58:30.938114 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12413 10.233.124.5:0/1776207697' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:30.938352 I | ceph-mgr: 2017-07-11 14:58:30.938160 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:31.895252 I | ceph-mgr: 2017-07-11 14:58:31.893961 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:31.895453 I | ceph-mgr: 2017-07-11 14:58:31.893968 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:31.895480 I | ceph-mgr: 2017-07-11 14:58:31.893991 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:33.900233 I | ceph-mgr: 2017-07-11 14:58:33.898879 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:33.917729 I | ceph-mgr: 2017-07-11 14:58:33.898884 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:33.917763 I | ceph-mgr: 2017-07-11 14:58:33.898906 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:34.175243 I | ceph-mgr: 2017-07-11 14:58:34.175192 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6625 10.233.124.0:0/2751109108' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:34.181073 I | ceph-mgr: 2017-07-11 14:58:34.181042 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:35.083176 I | ceph-mgr: 2017-07-11 14:58:35.083000 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11802 10.233.124.0:0/40121491' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:35.083277 I | ceph-mgr: 2017-07-11 14:58:35.083249 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:35.921453 I | ceph-mgr: 2017-07-11 14:58:35.902040 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:35.921587 I | ceph-mgr: 2017-07-11 14:58:35.902055 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:35.921663 I | ceph-mgr: 2017-07-11 14:58:35.902100 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:37.929211 I | ceph-mgr: 2017-07-11 14:58:37.925844 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:37.929362 I | ceph-mgr: 2017-07-11 14:58:37.925856 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:37.929382 I | ceph-mgr: 2017-07-11 14:58:37.925895 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:37.964933 I | ceph-mgr: 2017-07-11 14:58:37.964883 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11817 10.233.124.0:0/2128986515' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:37.966922 I | ceph-mgr: 2017-07-11 14:58:37.964902 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:39.324534 I | ceph-mgr: 2017-07-11 14:58:39.324460 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11820 10.233.124.0:0/3956586733' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:39.324597 I | ceph-mgr: 2017-07-11 14:58:39.324570 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:39.947942 I | ceph-mgr: 2017-07-11 14:58:39.946586 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:39.948018 I | ceph-mgr: 2017-07-11 14:58:39.946598 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:39.948034 I | ceph-mgr: 2017-07-11 14:58:39.946629 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:41.955860 I | ceph-mgr: 2017-07-11 14:58:41.954499 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:41.956066 I | ceph-mgr: 2017-07-11 14:58:41.954511 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:41.971179 I | ceph-mgr: 2017-07-11 14:58:41.954541 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:42.193955 I | ceph-mgr: 2017-07-11 14:58:42.193855 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12449 10.233.124.5:0/1354071805' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:42.193988 I | ceph-mgr: 2017-07-11 14:58:42.193873 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:43.208046 I | ceph-mgr: 2017-07-11 14:58:43.207554 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11832 10.233.124.0:0/1453343431' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:43.208138 I | ceph-mgr: 2017-07-11 14:58:43.207625 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:43.960797 I | ceph-mgr: 2017-07-11 14:58:43.958794 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:43.960888 I | ceph-mgr: 2017-07-11 14:58:43.958808 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:43.960906 I | ceph-mgr: 2017-07-11 14:58:43.958843 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:45.979390 I | ceph-mgr: 2017-07-11 14:58:45.963435 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:45.979554 I | ceph-mgr: 2017-07-11 14:58:45.963440 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:45.979597 I | ceph-mgr: 2017-07-11 14:58:45.963462 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:46.223660 I | ceph-mgr: 2017-07-11 14:58:46.223584 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11844 10.233.124.0:0/3228117165' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:46.231791 I | ceph-mgr: 2017-07-11 14:58:46.223604 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:47.215551 I | ceph-mgr: 2017-07-11 14:58:47.215451 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12461 10.233.124.5:0/1692228883' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:47.215609 I | ceph-mgr: 2017-07-11 14:58:47.215500 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:47.986325 I | ceph-mgr: 2017-07-11 14:58:47.984938 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:47.986545 I | ceph-mgr: 2017-07-11 14:58:47.984943 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:47.986573 I | ceph-mgr: 2017-07-11 14:58:47.984963 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:49.996307 I | ceph-mgr: 2017-07-11 14:58:49.994862 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:49.996508 I | ceph-mgr: 2017-07-11 14:58:49.994869 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:49.996534 I | ceph-mgr: 2017-07-11 14:58:49.994893 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:50.101679 I | ceph-mgr: 2017-07-11 14:58:50.101610 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12470 10.233.124.5:0/3858664278' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:50.101801 I | ceph-mgr: 2017-07-11 14:58:50.101764 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:51.069838 I | ceph-mgr: 2017-07-11 14:58:51.069766 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11871 10.233.124.5:0/196050135' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:51.069936 I | ceph-mgr: 2017-07-11 14:58:51.069899 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:52.003046 I | ceph-mgr: 2017-07-11 14:58:52.001687 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:52.010297 I | ceph-mgr: 2017-07-11 14:58:52.001693 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:52.010393 I | ceph-mgr: 2017-07-11 14:58:52.001716 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:54.003293 I | ceph-mgr: 2017-07-11 14:58:54.002988 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:54.003464 I | ceph-mgr: 2017-07-11 14:58:54.003014 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:54.003610 I | ceph-mgr: 2017-07-11 14:58:54.003048 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:54.019071 I | ceph-mgr: 2017-07-11 14:58:54.019039 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11880 10.233.124.0:0/2198450680' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:54.019443 I | ceph-mgr: 2017-07-11 14:58:54.019345 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:55.030929 I | ceph-mgr: 2017-07-11 14:58:55.030857 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11883 10.233.124.0:0/2928909259' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:55.031093 I | ceph-mgr: 2017-07-11 14:58:55.030988 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:56.038910 I | ceph-mgr: 2017-07-11 14:58:56.023208 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:56.039125 I | ceph-mgr: 2017-07-11 14:58:56.023216 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:56.039162 I | ceph-mgr: 2017-07-11 14:58:56.023240 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:57.976434 I | ceph-mgr: 2017-07-11 14:58:57.976384 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11898 10.233.124.0:0/2002601807' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:57.977983 I | ceph-mgr: 2017-07-11 14:58:57.977954 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:58:58.045680 I | ceph-mgr: 2017-07-11 14:58:58.042344 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:58:58.045782 I | ceph-mgr: 2017-07-11 14:58:58.042351 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:58:58.045817 I | ceph-mgr: 2017-07-11 14:58:58.042375 7f4cc3226700 0 mgr tick
- 2017-07-11 14:58:59.002425 I | ceph-mgr: 2017-07-11 14:58:59.002347 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12494 10.233.124.5:0/4285871244' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:58:59.002609 I | ceph-mgr: 2017-07-11 14:58:59.002514 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:00.067943 I | ceph-mgr: 2017-07-11 14:59:00.066626 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:00.068095 I | ceph-mgr: 2017-07-11 14:59:00.066631 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:00.068114 I | ceph-mgr: 2017-07-11 14:59:00.066657 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:01.685078 I | ceph-mgr: 2017-07-11 14:59:01.685026 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12506 10.233.124.5:0/3926960135' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:01.685250 I | ceph-mgr: 2017-07-11 14:59:01.685161 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:02.081320 I | ceph-mgr: 2017-07-11 14:59:02.071501 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:02.081384 I | ceph-mgr: 2017-07-11 14:59:02.071507 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:02.081403 I | ceph-mgr: 2017-07-11 14:59:02.071527 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:02.636459 I | ceph-mgr: 2017-07-11 14:59:02.636351 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12512 10.233.124.5:0/3677491723' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:02.636526 I | ceph-mgr: 2017-07-11 14:59:02.636401 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:04.078549 I | ceph-mgr: 2017-07-11 14:59:04.078515 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:04.078660 I | ceph-mgr: 2017-07-11 14:59:04.078645 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:04.078796 I | ceph-mgr: 2017-07-11 14:59:04.078784 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:06.013871 I | ceph-mgr: 2017-07-11 14:59:06.013824 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12521 10.233.124.5:0/4064312181' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:06.013957 I | ceph-mgr: 2017-07-11 14:59:06.013932 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:06.081961 I | ceph-mgr: 2017-07-11 14:59:06.081940 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:06.082037 I | ceph-mgr: 2017-07-11 14:59:06.082023 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:06.082208 I | ceph-mgr: 2017-07-11 14:59:06.082197 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:06.986742 I | ceph-mgr: 2017-07-11 14:59:06.986666 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11931 10.233.124.0:0/121830076' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:06.986827 I | ceph-mgr: 2017-07-11 14:59:06.986802 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:08.187193 I | ceph-mgr: 2017-07-11 14:59:08.185568 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:08.187268 I | ceph-mgr: 2017-07-11 14:59:08.185571 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:08.187284 I | ceph-mgr: 2017-07-11 14:59:08.185591 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:09.991429 I | ceph-mgr: 2017-07-11 14:59:09.991363 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.11946 10.233.124.0:0/3750469656' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:09.991513 I | ceph-mgr: 2017-07-11 14:59:09.991383 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:10.207353 I | ceph-mgr: 2017-07-11 14:59:10.207304 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:10.207553 I | ceph-mgr: 2017-07-11 14:59:10.207537 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:10.207809 I | ceph-mgr: 2017-07-11 14:59:10.207794 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:10.955801 I | ceph-mgr: 2017-07-11 14:59:10.955675 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12533 10.233.124.5:0/427478860' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:10.955872 I | ceph-mgr: 2017-07-11 14:59:10.955745 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:12.214574 I | ceph-mgr: 2017-07-11 14:59:12.214541 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:12.214789 I | ceph-mgr: 2017-07-11 14:59:12.214774 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:12.217924 I | ceph-mgr: 2017-07-11 14:59:12.217907 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:14.227477 I | ceph-mgr: 2017-07-11 14:59:14.227401 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12545 10.233.124.5:0/991108046' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:14.227570 I | ceph-mgr: 2017-07-11 14:59:14.227422 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:14.236461 I | ceph-mgr: 2017-07-11 14:59:14.236185 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:14.236498 I | ceph-mgr: 2017-07-11 14:59:14.236191 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:14.236513 I | ceph-mgr: 2017-07-11 14:59:14.236210 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:15.186572 I | ceph-mgr: 2017-07-11 14:59:15.186501 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12548 10.233.124.5:0/305606380' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:15.186681 I | ceph-mgr: 2017-07-11 14:59:15.186645 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:16.249673 I | ceph-mgr: 2017-07-11 14:59:16.248433 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:16.249734 I | ceph-mgr: 2017-07-11 14:59:16.248438 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:16.249748 I | ceph-mgr: 2017-07-11 14:59:16.248457 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:18.025043 I | ceph-mgr: 2017-07-11 14:59:18.024979 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12560 10.233.124.5:0/1310581063' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:18.025204 I | ceph-mgr: 2017-07-11 14:59:18.025126 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:18.253984 I | ceph-mgr: 2017-07-11 14:59:18.252773 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:18.255717 I | ceph-mgr: 2017-07-11 14:59:18.252778 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:18.255744 I | ceph-mgr: 2017-07-11 14:59:18.252797 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:19.014632 I | ceph-mgr: 2017-07-11 14:59:19.014541 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12563 10.233.124.5:0/3471196990' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:19.014725 I | ceph-mgr: 2017-07-11 14:59:19.014699 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:20.258933 I | ceph-mgr: 2017-07-11 14:59:20.257370 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:20.266543 I | ceph-mgr: 2017-07-11 14:59:20.257376 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:20.266584 I | ceph-mgr: 2017-07-11 14:59:20.257398 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:22.177973 I | ceph-mgr: 2017-07-11 14:59:22.177921 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12578 10.233.124.5:0/2617106115' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:22.178065 I | ceph-mgr: 2017-07-11 14:59:22.178039 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:22.264130 I | ceph-mgr: 2017-07-11 14:59:22.263463 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:22.264174 I | ceph-mgr: 2017-07-11 14:59:22.263468 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:22.264190 I | ceph-mgr: 2017-07-11 14:59:22.263487 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:23.203646 I | ceph-mgr: 2017-07-11 14:59:23.203572 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12584 10.233.124.5:0/2362968297' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:23.203734 I | ceph-mgr: 2017-07-11 14:59:23.203708 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:24.269864 I | ceph-mgr: 2017-07-11 14:59:24.266387 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:24.269939 I | ceph-mgr: 2017-07-11 14:59:24.266396 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:24.269965 I | ceph-mgr: 2017-07-11 14:59:24.266428 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:26.050014 I | ceph-mgr: 2017-07-11 14:59:26.049967 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12593 10.233.124.5:0/435286961' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:26.050111 I | ceph-mgr: 2017-07-11 14:59:26.050074 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:26.274213 I | ceph-mgr: 2017-07-11 14:59:26.273857 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:26.274436 I | ceph-mgr: 2017-07-11 14:59:26.273862 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:26.274452 I | ceph-mgr: 2017-07-11 14:59:26.273881 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:26.892393 I | ceph-mgr: 2017-07-11 14:59:26.892253 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12596 10.233.124.5:0/2301542673' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:26.892499 I | ceph-mgr: 2017-07-11 14:59:26.892469 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:28.292726 I | ceph-mgr: 2017-07-11 14:59:28.275985 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:28.293135 I | ceph-mgr: 2017-07-11 14:59:28.275990 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:28.293166 I | ceph-mgr: 2017-07-11 14:59:28.276010 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:29.976128 I | ceph-mgr: 2017-07-11 14:59:29.976079 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12599 10.233.124.5:0/593552077' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:29.976210 I | ceph-mgr: 2017-07-11 14:59:29.976186 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:30.301741 I | ceph-mgr: 2017-07-11 14:59:30.300476 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:30.301882 I | ceph-mgr: 2017-07-11 14:59:30.300481 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:30.301931 I | ceph-mgr: 2017-07-11 14:59:30.300501 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:30.868158 I | ceph-mgr: 2017-07-11 14:59:30.868083 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12602 10.233.124.5:0/2200158474' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:30.868256 I | ceph-mgr: 2017-07-11 14:59:30.868230 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:32.303141 I | ceph-mgr: 2017-07-11 14:59:32.301739 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:32.333971 I | ceph-mgr: 2017-07-11 14:59:32.301751 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:32.334005 I | ceph-mgr: 2017-07-11 14:59:32.301790 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:33.893449 I | ceph-mgr: 2017-07-11 14:59:33.893403 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12030 10.233.124.5:0/220640719' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:33.893534 I | ceph-mgr: 2017-07-11 14:59:33.893509 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:34.310134 I | ceph-mgr: 2017-07-11 14:59:34.307321 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:34.310190 I | ceph-mgr: 2017-07-11 14:59:34.307325 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:34.310209 I | ceph-mgr: 2017-07-11 14:59:34.307352 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:34.769525 I | ceph-mgr: 2017-07-11 14:59:34.769414 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12036 10.233.124.0:0/264759089' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:34.769594 I | ceph-mgr: 2017-07-11 14:59:34.769460 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:36.328636 I | ceph-mgr: 2017-07-11 14:59:36.328607 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:36.328711 I | ceph-mgr: 2017-07-11 14:59:36.328697 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:36.328885 I | ceph-mgr: 2017-07-11 14:59:36.328808 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:37.630270 I | ceph-mgr: 2017-07-11 14:59:37.630173 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12057 10.233.124.0:0/1352395329' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:37.630346 I | ceph-mgr: 2017-07-11 14:59:37.630193 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:38.354127 I | ceph-mgr: 2017-07-11 14:59:38.352729 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:38.354301 I | ceph-mgr: 2017-07-11 14:59:38.352734 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:38.354333 I | ceph-mgr: 2017-07-11 14:59:38.352755 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:38.652555 I | ceph-mgr: 2017-07-11 14:59:38.652472 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12620 10.233.124.5:0/4283273247' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:38.652599 I | ceph-mgr: 2017-07-11 14:59:38.652518 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:40.356793 I | ceph-mgr: 2017-07-11 14:59:40.356733 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:40.356850 I | ceph-mgr: 2017-07-11 14:59:40.356738 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:40.357085 I | ceph-mgr: 2017-07-11 14:59:40.357028 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:41.468036 I | ceph-mgr: 2017-07-11 14:59:41.467976 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12066 10.233.124.0:0/1096771915' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:41.468105 I | ceph-mgr: 2017-07-11 14:59:41.467995 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:42.336948 I | ceph-mgr: 2017-07-11 14:59:42.336872 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12072 10.233.124.0:0/3649694642' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:42.337063 I | ceph-mgr: 2017-07-11 14:59:42.337035 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:42.377406 I | ceph-mgr: 2017-07-11 14:59:42.377350 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:42.377527 I | ceph-mgr: 2017-07-11 14:59:42.377496 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:42.378092 I | ceph-mgr: 2017-07-11 14:59:42.377835 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:44.381704 I | ceph-mgr: 2017-07-11 14:59:44.381676 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:44.381779 I | ceph-mgr: 2017-07-11 14:59:44.381766 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:44.381984 I | ceph-mgr: 2017-07-11 14:59:44.381873 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:45.285774 I | ceph-mgr: 2017-07-11 14:59:45.285728 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12644 10.233.124.5:0/2219030334' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:45.285858 I | ceph-mgr: 2017-07-11 14:59:45.285833 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:46.393632 I | ceph-mgr: 2017-07-11 14:59:46.393598 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:46.393714 I | ceph-mgr: 2017-07-11 14:59:46.393689 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:46.393935 I | ceph-mgr: 2017-07-11 14:59:46.393919 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:46.410818 I | ceph-mgr: 2017-07-11 14:59:46.410794 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12647 10.233.124.5:0/2502745181' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:46.411393 I | ceph-mgr: 2017-07-11 14:59:46.411296 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:48.418797 I | ceph-mgr: 2017-07-11 14:59:48.418736 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:48.419044 I | ceph-mgr: 2017-07-11 14:59:48.418904 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:48.419448 I | ceph-mgr: 2017-07-11 14:59:48.419432 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:49.186616 I | ceph-mgr: 2017-07-11 14:59:49.186572 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12659 10.233.124.5:0/3078667515' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:49.188177 I | ceph-mgr: 2017-07-11 14:59:49.188151 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:50.097494 I | ceph-mgr: 2017-07-11 14:59:50.097401 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12662 10.233.124.5:0/2320655209' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:50.097579 I | ceph-mgr: 2017-07-11 14:59:50.097552 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:50.421485 I | ceph-mgr: 2017-07-11 14:59:50.421463 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:50.421626 I | ceph-mgr: 2017-07-11 14:59:50.421611 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:50.422329 I | ceph-mgr: 2017-07-11 14:59:50.422313 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:52.437852 I | ceph-mgr: 2017-07-11 14:59:52.437791 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:52.438128 I | ceph-mgr: 2017-07-11 14:59:52.437973 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:52.438388 I | ceph-mgr: 2017-07-11 14:59:52.438371 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:52.762405 I | ceph-mgr: 2017-07-11 14:59:52.762356 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12108 10.233.124.0:0/4150918703' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:52.777706 I | ceph-mgr: 2017-07-11 14:59:52.762454 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:54.267496 I | ceph-mgr: 2017-07-11 14:59:54.267466 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12674 10.233.124.5:0/2842342305' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:54.268609 I | ceph-mgr: 2017-07-11 14:59:54.268575 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:54.440602 I | ceph-mgr: 2017-07-11 14:59:54.440401 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:54.440743 I | ceph-mgr: 2017-07-11 14:59:54.440411 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:54.440885 I | ceph-mgr: 2017-07-11 14:59:54.440447 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:56.451177 I | ceph-mgr: 2017-07-11 14:59:56.442556 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:56.451395 I | ceph-mgr: 2017-07-11 14:59:56.442561 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:56.451423 I | ceph-mgr: 2017-07-11 14:59:56.442582 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:57.184685 I | ceph-mgr: 2017-07-11 14:59:57.184650 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12120 10.233.124.0:0/1455712960' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:57.184782 I | ceph-mgr: 2017-07-11 14:59:57.184767 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 14:59:58.445761 I | ceph-mgr: 2017-07-11 14:59:58.444412 7f4cc3226700 0 mgr tick tick
- 2017-07-11 14:59:58.445828 I | ceph-mgr: 2017-07-11 14:59:58.444419 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 14:59:58.445843 I | ceph-mgr: 2017-07-11 14:59:58.444446 7f4cc3226700 0 mgr tick
- 2017-07-11 14:59:58.526280 I | ceph-mgr: 2017-07-11 14:59:58.526252 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12686 10.233.124.5:0/4141998687' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 14:59:58.526435 I | ceph-mgr: 2017-07-11 14:59:58.526374 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:00.446847 I | ceph-mgr: 2017-07-11 15:00:00.446815 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:00.446916 I | ceph-mgr: 2017-07-11 15:00:00.446903 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:00.446986 I | ceph-mgr: 2017-07-11 15:00:00.446976 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:01.385854 I | ceph-mgr: 2017-07-11 15:00:01.385818 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12704 10.233.124.5:0/3668529741' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:01.386135 I | ceph-mgr: 2017-07-11 15:00:01.386119 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:02.242752 I | ceph-mgr: 2017-07-11 15:00:02.242702 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12710 10.233.124.5:0/1201328131' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:02.243177 I | ceph-mgr: 2017-07-11 15:00:02.243143 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:02.452719 I | ceph-mgr: 2017-07-11 15:00:02.451111 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:02.452818 I | ceph-mgr: 2017-07-11 15:00:02.452802 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:02.452961 I | ceph-mgr: 2017-07-11 15:00:02.452950 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:04.454408 I | ceph-mgr: 2017-07-11 15:00:04.454378 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:04.454480 I | ceph-mgr: 2017-07-11 15:00:04.454465 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:04.454562 I | ceph-mgr: 2017-07-11 15:00:04.454541 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:05.206590 I | ceph-mgr: 2017-07-11 15:00:05.206537 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12141 10.233.124.0:0/695407149' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:05.206774 I | ceph-mgr: 2017-07-11 15:00:05.206673 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:06.270583 I | ceph-mgr: 2017-07-11 15:00:06.270491 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12722 10.233.124.5:0/1330548745' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:06.270645 I | ceph-mgr: 2017-07-11 15:00:06.270540 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:06.467299 I | ceph-mgr: 2017-07-11 15:00:06.466066 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:06.467336 I | ceph-mgr: 2017-07-11 15:00:06.466071 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:06.467351 I | ceph-mgr: 2017-07-11 15:00:06.466089 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:08.469712 I | ceph-mgr: 2017-07-11 15:00:08.469681 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:08.469788 I | ceph-mgr: 2017-07-11 15:00:08.469774 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:08.469862 I | ceph-mgr: 2017-07-11 15:00:08.469852 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:09.160843 I | ceph-mgr: 2017-07-11 15:00:09.160776 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12156 10.233.124.0:0/4148968350' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:09.160898 I | ceph-mgr: 2017-07-11 15:00:09.160795 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:10.265051 I | ceph-mgr: 2017-07-11 15:00:10.264971 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12737 10.233.124.5:0/235934185' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:10.280861 I | ceph-mgr: 2017-07-11 15:00:10.265225 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:10.495183 I | ceph-mgr: 2017-07-11 15:00:10.493462 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:10.495228 I | ceph-mgr: 2017-07-11 15:00:10.493467 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:10.495254 I | ceph-mgr: 2017-07-11 15:00:10.493489 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:12.513865 I | ceph-mgr: 2017-07-11 15:00:12.497691 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:12.513943 I | ceph-mgr: 2017-07-11 15:00:12.497703 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:12.514211 I | ceph-mgr: 2017-07-11 15:00:12.514184 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:13.090046 I | ceph-mgr: 2017-07-11 15:00:13.089982 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12749 10.233.124.5:0/1671757186' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:13.092544 I | ceph-mgr: 2017-07-11 15:00:13.090001 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:14.178348 I | ceph-mgr: 2017-07-11 15:00:14.178267 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12752 10.233.124.5:0/2611659604' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:14.178539 I | ceph-mgr: 2017-07-11 15:00:14.178451 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:14.520830 I | ceph-mgr: 2017-07-11 15:00:14.520785 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:14.520906 I | ceph-mgr: 2017-07-11 15:00:14.520893 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:14.521295 I | ceph-mgr: 2017-07-11 15:00:14.520998 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:16.542340 I | ceph-mgr: 2017-07-11 15:00:16.542300 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:16.545717 I | ceph-mgr: 2017-07-11 15:00:16.545652 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:16.545955 I | ceph-mgr: 2017-07-11 15:00:16.545940 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:17.018307 I | ceph-mgr: 2017-07-11 15:00:17.018221 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12764 10.233.124.5:0/511738443' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:17.018373 I | ceph-mgr: 2017-07-11 15:00:17.018241 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:18.447396 I | ceph-mgr: 2017-07-11 15:00:18.447320 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12770 10.233.124.5:0/1395119422' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:18.447483 I | ceph-mgr: 2017-07-11 15:00:18.447456 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:18.556477 I | ceph-mgr: 2017-07-11 15:00:18.556457 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:18.556526 I | ceph-mgr: 2017-07-11 15:00:18.556512 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:18.556748 I | ceph-mgr: 2017-07-11 15:00:18.556635 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:20.559594 I | ceph-mgr: 2017-07-11 15:00:20.559569 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:20.559665 I | ceph-mgr: 2017-07-11 15:00:20.559652 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:20.559862 I | ceph-mgr: 2017-07-11 15:00:20.559759 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:21.372210 I | ceph-mgr: 2017-07-11 15:00:21.371677 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12189 10.233.124.0:0/852835864' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:21.372261 I | ceph-mgr: 2017-07-11 15:00:21.371696 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:22.279738 I | ceph-mgr: 2017-07-11 15:00:22.279664 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12788 10.233.124.5:0/3902049084' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:22.279839 I | ceph-mgr: 2017-07-11 15:00:22.279813 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:22.580911 I | ceph-mgr: 2017-07-11 15:00:22.580886 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:22.581055 I | ceph-mgr: 2017-07-11 15:00:22.581040 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:22.583490 I | ceph-mgr: 2017-07-11 15:00:22.583473 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:24.604919 I | ceph-mgr: 2017-07-11 15:00:24.604887 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:24.605105 I | ceph-mgr: 2017-07-11 15:00:24.605090 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:24.615035 I | ceph-mgr: 2017-07-11 15:00:24.614543 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:25.126523 I | ceph-mgr: 2017-07-11 15:00:25.126471 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12800 10.233.124.5:0/2107142828' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:25.127900 I | ceph-mgr: 2017-07-11 15:00:25.127872 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:26.269169 I | ceph-mgr: 2017-07-11 15:00:26.269097 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12806 10.233.124.5:0/799369231' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:26.269258 I | ceph-mgr: 2017-07-11 15:00:26.269231 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:26.617039 I | ceph-mgr: 2017-07-11 15:00:26.617016 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:26.617098 I | ceph-mgr: 2017-07-11 15:00:26.617084 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:26.617315 I | ceph-mgr: 2017-07-11 15:00:26.617205 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:28.634393 I | ceph-mgr: 2017-07-11 15:00:28.632996 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:28.634601 I | ceph-mgr: 2017-07-11 15:00:28.633001 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:28.634630 I | ceph-mgr: 2017-07-11 15:00:28.633024 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:29.086899 I | ceph-mgr: 2017-07-11 15:00:29.086830 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12210 10.233.124.0:0/3251568509' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:29.086967 I | ceph-mgr: 2017-07-11 15:00:29.086855 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:30.194152 I | ceph-mgr: 2017-07-11 15:00:30.194053 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12827 10.233.124.5:0/665669641' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:30.196391 I | ceph-mgr: 2017-07-11 15:00:30.196362 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:30.641895 I | ceph-mgr: 2017-07-11 15:00:30.641832 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:30.641983 I | ceph-mgr: 2017-07-11 15:00:30.641968 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:30.642284 I | ceph-mgr: 2017-07-11 15:00:30.642227 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:32.661784 I | ceph-mgr: 2017-07-11 15:00:32.661714 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:32.663068 I | ceph-mgr: 2017-07-11 15:00:32.663051 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:32.663501 I | ceph-mgr: 2017-07-11 15:00:32.663239 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:33.094014 I | ceph-mgr: 2017-07-11 15:00:33.093950 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12219 10.233.124.0:0/3417306340' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:33.094089 I | ceph-mgr: 2017-07-11 15:00:33.093971 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:34.150780 I | ceph-mgr: 2017-07-11 15:00:34.150691 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12842 10.233.124.5:0/1545568894' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:34.153564 I | ceph-mgr: 2017-07-11 15:00:34.150737 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:34.672779 I | ceph-mgr: 2017-07-11 15:00:34.671470 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:34.672818 I | ceph-mgr: 2017-07-11 15:00:34.671475 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:34.672845 I | ceph-mgr: 2017-07-11 15:00:34.671492 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:36.673993 I | ceph-mgr: 2017-07-11 15:00:36.673966 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:36.674084 I | ceph-mgr: 2017-07-11 15:00:36.674055 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:36.674354 I | ceph-mgr: 2017-07-11 15:00:36.674339 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:37.460635 I | ceph-mgr: 2017-07-11 15:00:37.460581 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12857 10.233.124.5:0/42550216' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:37.460690 I | ceph-mgr: 2017-07-11 15:00:37.460663 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:38.544309 I | ceph-mgr: 2017-07-11 15:00:38.544218 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12863 10.233.124.5:0/3642774234' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:38.544557 I | ceph-mgr: 2017-07-11 15:00:38.544469 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:38.682661 I | ceph-mgr: 2017-07-11 15:00:38.682581 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:38.682730 I | ceph-mgr: 2017-07-11 15:00:38.682715 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:38.683041 I | ceph-mgr: 2017-07-11 15:00:38.682940 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:40.691828 I | ceph-mgr: 2017-07-11 15:00:40.691783 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:40.691915 I | ceph-mgr: 2017-07-11 15:00:40.691900 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:40.692157 I | ceph-mgr: 2017-07-11 15:00:40.691989 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:41.261112 I | ceph-mgr: 2017-07-11 15:00:41.261054 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12246 10.233.124.5:0/23216326' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:41.261168 I | ceph-mgr: 2017-07-11 15:00:41.261143 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:42.251884 I | ceph-mgr: 2017-07-11 15:00:42.251852 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12878 10.233.124.5:0/2275760451' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:42.254624 I | ceph-mgr: 2017-07-11 15:00:42.254598 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:42.708602 I | ceph-mgr: 2017-07-11 15:00:42.699006 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:42.709161 I | ceph-mgr: 2017-07-11 15:00:42.699019 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:42.709186 I | ceph-mgr: 2017-07-11 15:00:42.699052 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:44.733092 I | ceph-mgr: 2017-07-11 15:00:44.722958 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:44.733175 I | ceph-mgr: 2017-07-11 15:00:44.722969 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:44.733191 I | ceph-mgr: 2017-07-11 15:00:44.723007 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:45.253801 I | ceph-mgr: 2017-07-11 15:00:45.253734 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12264 10.233.124.5:0/1455540267' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:45.253856 I | ceph-mgr: 2017-07-11 15:00:45.253755 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:46.569645 I | ceph-mgr: 2017-07-11 15:00:46.567918 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6730 10.233.124.5:0/3385654498' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:46.569704 I | ceph-mgr: 2017-07-11 15:00:46.567964 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:46.725637 I | ceph-mgr: 2017-07-11 15:00:46.725603 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:46.725717 I | ceph-mgr: 2017-07-11 15:00:46.725688 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:46.725947 I | ceph-mgr: 2017-07-11 15:00:46.725932 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:48.736051 I | ceph-mgr: 2017-07-11 15:00:48.735999 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:48.736145 I | ceph-mgr: 2017-07-11 15:00:48.736130 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:48.736426 I | ceph-mgr: 2017-07-11 15:00:48.736410 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:49.688993 I | ceph-mgr: 2017-07-11 15:00:49.688965 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12276 10.233.124.0:0/335243528' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:49.689089 I | ceph-mgr: 2017-07-11 15:00:49.689075 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:50.580341 I | ceph-mgr: 2017-07-11 15:00:50.580315 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12908 10.233.124.5:0/1954226569' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:50.580512 I | ceph-mgr: 2017-07-11 15:00:50.580497 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:50.743921 I | ceph-mgr: 2017-07-11 15:00:50.742547 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:50.744063 I | ceph-mgr: 2017-07-11 15:00:50.742558 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:50.744083 I | ceph-mgr: 2017-07-11 15:00:50.742595 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:52.744239 I | ceph-mgr: 2017-07-11 15:00:52.744208 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:52.744337 I | ceph-mgr: 2017-07-11 15:00:52.744313 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:52.744481 I | ceph-mgr: 2017-07-11 15:00:52.744470 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:53.479551 I | ceph-mgr: 2017-07-11 15:00:53.479519 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12923 10.233.124.5:0/2927694757' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:53.479655 I | ceph-mgr: 2017-07-11 15:00:53.479640 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:54.735606 I | ceph-mgr: 2017-07-11 15:00:54.735574 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12285 10.233.124.0:0/225171835' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:54.735838 I | ceph-mgr: 2017-07-11 15:00:54.735822 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:54.753855 I | ceph-mgr: 2017-07-11 15:00:54.753833 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:54.753883 I | ceph-mgr: 2017-07-11 15:00:54.753870 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:54.753972 I | ceph-mgr: 2017-07-11 15:00:54.753913 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:56.795936 I | ceph-mgr: 2017-07-11 15:00:56.779399 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:56.795999 I | ceph-mgr: 2017-07-11 15:00:56.779404 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:56.796014 I | ceph-mgr: 2017-07-11 15:00:56.779426 7f4cc3226700 0 mgr tick
- 2017-07-11 15:00:57.700538 I | ceph-mgr: 2017-07-11 15:00:57.700472 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12935 10.233.124.5:0/1804108054' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:57.700629 I | ceph-mgr: 2017-07-11 15:00:57.700491 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:58.714191 I | ceph-mgr: 2017-07-11 15:00:58.694095 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12303 10.233.124.0:0/2634772769' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:00:58.714485 I | ceph-mgr: 2017-07-11 15:00:58.714318 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:00:58.807919 I | ceph-mgr: 2017-07-11 15:00:58.806564 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:00:58.807976 I | ceph-mgr: 2017-07-11 15:00:58.806573 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:00:58.807991 I | ceph-mgr: 2017-07-11 15:00:58.806611 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:00.814134 I | ceph-mgr: 2017-07-11 15:01:00.810355 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:00.820168 I | ceph-mgr: 2017-07-11 15:01:00.810363 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:00.820273 I | ceph-mgr: 2017-07-11 15:01:00.810387 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:01.903638 I | ceph-mgr: 2017-07-11 15:01:01.903535 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12318 10.233.124.0:0/1097727398' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:01.903702 I | ceph-mgr: 2017-07-11 15:01:01.903554 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:02.778154 I | ceph-mgr: 2017-07-11 15:01:02.778025 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12324 10.233.124.0:0/842093851' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:02.778240 I | ceph-mgr: 2017-07-11 15:01:02.778071 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:02.819259 I | ceph-mgr: 2017-07-11 15:01:02.817934 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:02.819404 I | ceph-mgr: 2017-07-11 15:01:02.817939 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:02.819456 I | ceph-mgr: 2017-07-11 15:01:02.817957 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:04.836589 I | ceph-mgr: 2017-07-11 15:01:04.826429 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:04.836654 I | ceph-mgr: 2017-07-11 15:01:04.826434 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:04.836676 I | ceph-mgr: 2017-07-11 15:01:04.826957 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:05.667614 I | ceph-mgr: 2017-07-11 15:01:05.667563 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12333 10.233.124.0:0/2485127669' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:05.667701 I | ceph-mgr: 2017-07-11 15:01:05.667676 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:06.575838 I | ceph-mgr: 2017-07-11 15:01:06.575756 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12339 10.233.124.0:0/1097091990' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:06.576021 I | ceph-mgr: 2017-07-11 15:01:06.575922 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:06.855677 I | ceph-mgr: 2017-07-11 15:01:06.839467 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:06.855736 I | ceph-mgr: 2017-07-11 15:01:06.839471 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:06.855752 I | ceph-mgr: 2017-07-11 15:01:06.839490 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:08.858767 I | ceph-mgr: 2017-07-11 15:01:08.858723 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:08.858860 I | ceph-mgr: 2017-07-11 15:01:08.858844 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:08.859191 I | ceph-mgr: 2017-07-11 15:01:08.859151 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:09.474562 I | ceph-mgr: 2017-07-11 15:01:09.474504 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12971 10.233.124.5:0/4008356039' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:09.474616 I | ceph-mgr: 2017-07-11 15:01:09.474523 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:10.436384 I | ceph-mgr: 2017-07-11 15:01:10.436234 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12977 10.233.124.5:0/1699812277' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:10.436455 I | ceph-mgr: 2017-07-11 15:01:10.436339 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:10.878773 I | ceph-mgr: 2017-07-11 15:01:10.878735 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:10.878859 I | ceph-mgr: 2017-07-11 15:01:10.878844 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:10.879092 I | ceph-mgr: 2017-07-11 15:01:10.879075 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:12.886496 I | ceph-mgr: 2017-07-11 15:01:12.886202 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:12.886564 I | ceph-mgr: 2017-07-11 15:01:12.886549 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:12.886792 I | ceph-mgr: 2017-07-11 15:01:12.886775 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:13.429920 I | ceph-mgr: 2017-07-11 15:01:13.429848 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12986 10.233.124.5:0/3843094279' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:13.429986 I | ceph-mgr: 2017-07-11 15:01:13.429874 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:14.408390 I | ceph-mgr: 2017-07-11 15:01:14.408298 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12989 10.233.124.5:0/1500442376' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:14.408453 I | ceph-mgr: 2017-07-11 15:01:14.408347 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:14.907260 I | ceph-mgr: 2017-07-11 15:01:14.907229 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:14.907347 I | ceph-mgr: 2017-07-11 15:01:14.907333 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:14.907551 I | ceph-mgr: 2017-07-11 15:01:14.907439 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:16.911518 I | ceph-mgr: 2017-07-11 15:01:16.910276 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:16.913949 I | ceph-mgr: 2017-07-11 15:01:16.910281 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:16.913976 I | ceph-mgr: 2017-07-11 15:01:16.910301 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:17.429552 I | ceph-mgr: 2017-07-11 15:01:17.429502 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13001 10.233.124.5:0/1967908285' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:17.429666 I | ceph-mgr: 2017-07-11 15:01:17.429629 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:18.444172 I | ceph-mgr: 2017-07-11 15:01:18.444097 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12384 10.233.124.0:0/3633101422' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:18.453586 I | ceph-mgr: 2017-07-11 15:01:18.453502 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:18.928810 I | ceph-mgr: 2017-07-11 15:01:18.911898 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:18.928886 I | ceph-mgr: 2017-07-11 15:01:18.911905 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:18.928903 I | ceph-mgr: 2017-07-11 15:01:18.911928 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:20.932653 I | ceph-mgr: 2017-07-11 15:01:20.932475 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:20.932926 I | ceph-mgr: 2017-07-11 15:01:20.932910 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:20.933170 I | ceph-mgr: 2017-07-11 15:01:20.933154 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:21.447161 I | ceph-mgr: 2017-07-11 15:01:21.447096 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12396 10.233.124.5:0/2514949757' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:21.447233 I | ceph-mgr: 2017-07-11 15:01:21.447116 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:22.399915 I | ceph-mgr: 2017-07-11 15:01:22.399838 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13019 10.233.124.5:0/1780685008' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:22.400133 I | ceph-mgr: 2017-07-11 15:01:22.399999 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:22.935997 I | ceph-mgr: 2017-07-11 15:01:22.935970 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:22.936063 I | ceph-mgr: 2017-07-11 15:01:22.936050 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:22.936260 I | ceph-mgr: 2017-07-11 15:01:22.936166 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:24.959814 I | ceph-mgr: 2017-07-11 15:01:24.958473 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:24.959871 I | ceph-mgr: 2017-07-11 15:01:24.958485 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:24.959893 I | ceph-mgr: 2017-07-11 15:01:24.958515 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:25.359777 I | ceph-mgr: 2017-07-11 15:01:25.359726 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.6766 10.233.124.0:0/2858284444' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:25.359871 I | ceph-mgr: 2017-07-11 15:01:25.359846 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:26.375155 I | ceph-mgr: 2017-07-11 15:01:26.375062 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12411 10.233.124.0:0/66646497' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:26.375263 I | ceph-mgr: 2017-07-11 15:01:26.375236 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:26.961406 I | ceph-mgr: 2017-07-11 15:01:26.960097 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:26.969007 I | ceph-mgr: 2017-07-11 15:01:26.960106 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:26.969041 I | ceph-mgr: 2017-07-11 15:01:26.960132 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:28.964892 I | ceph-mgr: 2017-07-11 15:01:28.963508 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:28.964962 I | ceph-mgr: 2017-07-11 15:01:28.963522 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:28.964978 I | ceph-mgr: 2017-07-11 15:01:28.963556 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:29.629556 I | ceph-mgr: 2017-07-11 15:01:29.629507 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13052 10.233.124.5:0/720459432' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:29.630016 I | ceph-mgr: 2017-07-11 15:01:29.629988 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:30.579971 I | ceph-mgr: 2017-07-11 15:01:30.579895 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13055 10.233.124.5:0/1409783008' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:30.580136 I | ceph-mgr: 2017-07-11 15:01:30.580060 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:30.968753 I | ceph-mgr: 2017-07-11 15:01:30.967474 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:30.968813 I | ceph-mgr: 2017-07-11 15:01:30.967480 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:30.968828 I | ceph-mgr: 2017-07-11 15:01:30.967501 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:32.987691 I | ceph-mgr: 2017-07-11 15:01:32.971481 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:32.987793 I | ceph-mgr: 2017-07-11 15:01:32.971486 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:32.987858 I | ceph-mgr: 2017-07-11 15:01:32.971506 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:33.649218 I | ceph-mgr: 2017-07-11 15:01:33.649173 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12426 10.233.124.0:0/1019392831' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:33.649307 I | ceph-mgr: 2017-07-11 15:01:33.649278 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:34.593524 I | ceph-mgr: 2017-07-11 15:01:34.593449 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13070 10.233.124.5:0/3181566777' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:34.596572 I | ceph-mgr: 2017-07-11 15:01:34.596540 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:34.990343 I | ceph-mgr: 2017-07-11 15:01:34.989079 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:34.997964 I | ceph-mgr: 2017-07-11 15:01:34.989085 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:34.998000 I | ceph-mgr: 2017-07-11 15:01:34.989106 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:37.009358 I | ceph-mgr: 2017-07-11 15:01:36.993084 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:37.009521 I | ceph-mgr: 2017-07-11 15:01:36.993092 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:37.009569 I | ceph-mgr: 2017-07-11 15:01:36.993118 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:37.559179 I | ceph-mgr: 2017-07-11 15:01:37.559135 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12438 10.233.124.0:0/4111788832' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:37.559476 I | ceph-mgr: 2017-07-11 15:01:37.559445 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:38.706914 I | ceph-mgr: 2017-07-11 15:01:38.706888 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13082 10.233.124.5:0/1998801519' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:38.707100 I | ceph-mgr: 2017-07-11 15:01:38.707085 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:39.026553 I | ceph-mgr: 2017-07-11 15:01:39.010799 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:39.026626 I | ceph-mgr: 2017-07-11 15:01:39.010813 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:39.026642 I | ceph-mgr: 2017-07-11 15:01:39.010833 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:41.030908 I | ceph-mgr: 2017-07-11 15:01:41.030867 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:41.031003 I | ceph-mgr: 2017-07-11 15:01:41.030989 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:41.038079 I | ceph-mgr: 2017-07-11 15:01:41.038063 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:41.531876 I | ceph-mgr: 2017-07-11 15:01:41.531786 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12450 10.233.124.5:0/1156021879' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:41.531943 I | ceph-mgr: 2017-07-11 15:01:41.531818 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:42.413429 I | ceph-mgr: 2017-07-11 15:01:42.413330 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13097 10.233.124.5:0/2522067716' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:42.413501 I | ceph-mgr: 2017-07-11 15:01:42.413379 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:43.070086 I | ceph-mgr: 2017-07-11 15:01:43.070042 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:43.070855 I | ceph-mgr: 2017-07-11 15:01:43.070838 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:43.071077 I | ceph-mgr: 2017-07-11 15:01:43.071061 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:45.114298 I | ceph-mgr: 2017-07-11 15:01:45.081979 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:45.114388 I | ceph-mgr: 2017-07-11 15:01:45.081984 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:45.114406 I | ceph-mgr: 2017-07-11 15:01:45.082005 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:45.229703 I | ceph-mgr: 2017-07-11 15:01:45.229686 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12474 10.233.124.0:0/3427580768' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:45.229776 I | ceph-mgr: 2017-07-11 15:01:45.229763 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:46.258049 I | ceph-mgr: 2017-07-11 15:01:46.258006 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13103 10.233.124.5:0/259958249' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:46.258262 I | ceph-mgr: 2017-07-11 15:01:46.258227 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:47.090918 I | ceph-mgr: 2017-07-11 15:01:47.089582 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:47.090982 I | ceph-mgr: 2017-07-11 15:01:47.089588 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:47.090999 I | ceph-mgr: 2017-07-11 15:01:47.089609 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:49.096410 I | ceph-mgr: 2017-07-11 15:01:49.096374 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:49.096484 I | ceph-mgr: 2017-07-11 15:01:49.096469 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:49.096584 I | ceph-mgr: 2017-07-11 15:01:49.096547 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:49.125284 I | ceph-mgr: 2017-07-11 15:01:49.125266 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13115 10.233.124.5:0/745369987' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:49.125370 I | ceph-mgr: 2017-07-11 15:01:49.125355 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:49.964583 I | ceph-mgr: 2017-07-11 15:01:49.964552 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13121 10.233.124.5:0/2492905343' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:49.964808 I | ceph-mgr: 2017-07-11 15:01:49.964793 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:51.101684 I | ceph-mgr: 2017-07-11 15:01:51.100374 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:51.107890 I | ceph-mgr: 2017-07-11 15:01:51.100386 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:51.107989 I | ceph-mgr: 2017-07-11 15:01:51.100414 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:52.655838 I | ceph-mgr: 2017-07-11 15:01:52.655777 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13130 10.233.124.5:0/1355585533' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:52.656005 I | ceph-mgr: 2017-07-11 15:01:52.655920 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:53.116415 I | ceph-mgr: 2017-07-11 15:01:53.108373 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:53.116488 I | ceph-mgr: 2017-07-11 15:01:53.108378 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:53.116504 I | ceph-mgr: 2017-07-11 15:01:53.108399 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:53.631898 I | ceph-mgr: 2017-07-11 15:01:53.631785 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13133 10.233.124.5:0/3567256785' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:53.631961 I | ceph-mgr: 2017-07-11 15:01:53.631833 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:55.125922 I | ceph-mgr: 2017-07-11 15:01:55.125881 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:55.126001 I | ceph-mgr: 2017-07-11 15:01:55.125988 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:55.126172 I | ceph-mgr: 2017-07-11 15:01:55.126096 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:56.754741 I | ceph-mgr: 2017-07-11 15:01:56.754687 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12510 10.233.124.0:0/3503893181' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:56.763220 I | ceph-mgr: 2017-07-11 15:01:56.763181 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:57.149904 I | ceph-mgr: 2017-07-11 15:01:57.149688 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:57.149982 I | ceph-mgr: 2017-07-11 15:01:57.149696 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:57.149998 I | ceph-mgr: 2017-07-11 15:01:57.149720 7f4cc3226700 0 mgr tick
- 2017-07-11 15:01:57.605439 I | ceph-mgr: 2017-07-11 15:01:57.605357 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13154 10.233.124.5:0/3134657939' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:01:57.605929 I | ceph-mgr: 2017-07-11 15:01:57.605898 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:01:59.152209 I | ceph-mgr: 2017-07-11 15:01:59.151566 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:01:59.152290 I | ceph-mgr: 2017-07-11 15:01:59.151575 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:01:59.152307 I | ceph-mgr: 2017-07-11 15:01:59.151611 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:00.392492 I | ceph-mgr: 2017-07-11 15:02:00.392447 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13172 10.233.124.5:0/2567704370' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:00.392657 I | ceph-mgr: 2017-07-11 15:02:00.392565 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:01.158132 I | ceph-mgr: 2017-07-11 15:02:01.156882 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:01.158195 I | ceph-mgr: 2017-07-11 15:02:01.156887 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:01.158213 I | ceph-mgr: 2017-07-11 15:02:01.156910 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:01.224774 I | ceph-mgr: 2017-07-11 15:02:01.224712 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13175 10.233.124.5:0/261117031' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:01.224845 I | ceph-mgr: 2017-07-11 15:02:01.224820 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:03.277477 I | ceph-mgr: 2017-07-11 15:02:03.160035 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:03.277556 I | ceph-mgr: 2017-07-11 15:02:03.160041 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:03.277574 I | ceph-mgr: 2017-07-11 15:02:03.160063 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:03.959075 I | ceph-mgr: 2017-07-11 15:02:03.959012 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13187 10.233.124.5:0/1937714169' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:03.959150 I | ceph-mgr: 2017-07-11 15:02:03.959032 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:05.100194 I | ceph-mgr: 2017-07-11 15:02:05.100120 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13196 10.233.124.5:0/1272568639' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:05.100365 I | ceph-mgr: 2017-07-11 15:02:05.100273 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:05.282988 I | ceph-mgr: 2017-07-11 15:02:05.282941 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:05.283072 I | ceph-mgr: 2017-07-11 15:02:05.283058 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:05.283592 I | ceph-mgr: 2017-07-11 15:02:05.283574 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:07.292041 I | ceph-mgr: 2017-07-11 15:02:07.292003 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:07.292121 I | ceph-mgr: 2017-07-11 15:02:07.292107 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:07.292344 I | ceph-mgr: 2017-07-11 15:02:07.292329 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:07.756741 I | ceph-mgr: 2017-07-11 15:02:07.756678 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13205 10.233.124.5:0/3985879829' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:07.760046 I | ceph-mgr: 2017-07-11 15:02:07.756697 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:08.725548 I | ceph-mgr: 2017-07-11 15:02:08.725443 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13208 10.233.124.5:0/1356955153' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:08.725608 I | ceph-mgr: 2017-07-11 15:02:08.725497 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:09.310127 I | ceph-mgr: 2017-07-11 15:02:09.310091 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:09.310207 I | ceph-mgr: 2017-07-11 15:02:09.310193 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:09.310422 I | ceph-mgr: 2017-07-11 15:02:09.310308 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:11.322312 I | ceph-mgr: 2017-07-11 15:02:11.322254 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:11.322585 I | ceph-mgr: 2017-07-11 15:02:11.322568 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:11.322823 I | ceph-mgr: 2017-07-11 15:02:11.322652 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:11.460716 I | ceph-mgr: 2017-07-11 15:02:11.460682 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13220 10.233.124.5:0/2693160882' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:11.460786 I | ceph-mgr: 2017-07-11 15:02:11.460762 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:12.681592 I | ceph-mgr: 2017-07-11 15:02:12.681478 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12561 10.233.124.0:0/3937489349' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:12.681776 I | ceph-mgr: 2017-07-11 15:02:12.681677 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:13.326138 I | ceph-mgr: 2017-07-11 15:02:13.326104 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:13.326214 I | ceph-mgr: 2017-07-11 15:02:13.326201 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:13.326429 I | ceph-mgr: 2017-07-11 15:02:13.326276 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:15.328104 I | ceph-mgr: 2017-07-11 15:02:15.328073 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:15.328188 I | ceph-mgr: 2017-07-11 15:02:15.328175 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:15.328396 I | ceph-mgr: 2017-07-11 15:02:15.328248 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:15.462034 I | ceph-mgr: 2017-07-11 15:02:15.458969 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13238 10.233.124.5:0/1836184492' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:15.468591 I | ceph-mgr: 2017-07-11 15:02:15.459003 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:16.448599 I | ceph-mgr: 2017-07-11 15:02:16.448499 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13244 10.233.124.5:0/1255305732' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:16.448652 I | ceph-mgr: 2017-07-11 15:02:16.448549 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:17.362051 I | ceph-mgr: 2017-07-11 15:02:17.358692 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:17.362115 I | ceph-mgr: 2017-07-11 15:02:17.358703 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:17.362132 I | ceph-mgr: 2017-07-11 15:02:17.358741 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:19.020358 I | ceph-mgr: 2017-07-11 15:02:19.020311 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13256 10.233.124.5:0/4265401826' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:19.020441 I | ceph-mgr: 2017-07-11 15:02:19.020416 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:19.376244 I | ceph-mgr: 2017-07-11 15:02:19.360203 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:19.376322 I | ceph-mgr: 2017-07-11 15:02:19.360213 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:19.376339 I | ceph-mgr: 2017-07-11 15:02:19.360238 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:19.956376 I | ceph-mgr: 2017-07-11 15:02:19.956293 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12591 10.233.124.0:0/4023247503' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:19.963387 I | ceph-mgr: 2017-07-11 15:02:19.956339 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:21.385385 I | ceph-mgr: 2017-07-11 15:02:21.385329 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:21.385479 I | ceph-mgr: 2017-07-11 15:02:21.385464 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:21.385708 I | ceph-mgr: 2017-07-11 15:02:21.385693 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:23.392372 I | ceph-mgr: 2017-07-11 15:02:23.391956 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:23.392458 I | ceph-mgr: 2017-07-11 15:02:23.392442 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:23.392784 I | ceph-mgr: 2017-07-11 15:02:23.392556 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:23.563403 I | ceph-mgr: 2017-07-11 15:02:23.563357 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12597 10.233.124.0:0/673219674' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:23.563443 I | ceph-mgr: 2017-07-11 15:02:23.563374 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:24.424100 I | ceph-mgr: 2017-07-11 15:02:24.424004 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13274 10.233.124.5:0/1420429893' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:24.424159 I | ceph-mgr: 2017-07-11 15:02:24.424052 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:25.396533 I | ceph-mgr: 2017-07-11 15:02:25.395272 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:25.403809 I | ceph-mgr: 2017-07-11 15:02:25.395282 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:25.403845 I | ceph-mgr: 2017-07-11 15:02:25.395309 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:27.401137 I | ceph-mgr: 2017-07-11 15:02:27.399944 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:27.401211 I | ceph-mgr: 2017-07-11 15:02:27.399949 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:27.401228 I | ceph-mgr: 2017-07-11 15:02:27.399971 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:28.613146 I | ceph-mgr: 2017-07-11 15:02:28.613086 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.13286 10.233.124.5:0/2060593544' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:28.613688 I | ceph-mgr: 2017-07-11 15:02:28.613657 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:29.414512 I | ceph-mgr: 2017-07-11 15:02:29.405057 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:29.414584 I | ceph-mgr: 2017-07-11 15:02:29.405071 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:29.414601 I | ceph-mgr: 2017-07-11 15:02:29.405112 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:29.433804 I | ceph-mgr: 2017-07-11 15:02:29.433741 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12612 10.233.124.0:0/4101657862' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:29.433874 I | ceph-mgr: 2017-07-11 15:02:29.433849 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:31.423578 I | ceph-mgr: 2017-07-11 15:02:31.422252 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:31.423640 I | ceph-mgr: 2017-07-11 15:02:31.422261 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:31.423655 I | ceph-mgr: 2017-07-11 15:02:31.422288 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:33.447000 I | ceph-mgr: 2017-07-11 15:02:33.430182 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:33.447100 I | ceph-mgr: 2017-07-11 15:02:33.430188 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:33.447169 I | ceph-mgr: 2017-07-11 15:02:33.430210 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:33.468089 I | ceph-mgr: 2017-07-11 15:02:33.468044 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12621 10.233.124.0:0/3378839240' entity='client.admin' cmd=[{"prefix": "osd perf", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:33.468128 I | ceph-mgr: 2017-07-11 15:02:33.468062 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:34.480738 I | ceph-mgr: 2017-07-11 15:02:34.480662 7f4cc1a23700 0 log_channel(audit) log [DBG] : from='client.12627 10.233.124.0:0/2317103416' entity='client.admin' cmd=[{"prefix": "osd df", "target": ["mgr", ""], "format": "json"}]: dispatch
- 2017-07-11 15:02:34.480834 I | ceph-mgr: 2017-07-11 15:02:34.480807 7f4cc1a23700 1 mgr.server reply do_command r=0
- 2017-07-11 15:02:35.449855 I | ceph-mgr: 2017-07-11 15:02:35.448570 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:35.455838 I | ceph-mgr: 2017-07-11 15:02:35.448579 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:35.455873 I | ceph-mgr: 2017-07-11 15:02:35.448603 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:37.449923 I | ceph-mgr: 2017-07-11 15:02:37.449855 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:37.450016 I | ceph-mgr: 2017-07-11 15:02:37.450000 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:37.450177 I | ceph-mgr: 2017-07-11 15:02:37.450107 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:39.467681 I | ceph-mgr: 2017-07-11 15:02:39.467636 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:39.467759 I | ceph-mgr: 2017-07-11 15:02:39.467744 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:39.473486 I | ceph-mgr: 2017-07-11 15:02:39.473471 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:41.487736 I | ceph-mgr: 2017-07-11 15:02:41.484609 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:41.487918 I | ceph-mgr: 2017-07-11 15:02:41.484621 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:41.488016 I | ceph-mgr: 2017-07-11 15:02:41.484648 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:43.486936 I | ceph-mgr: 2017-07-11 15:02:43.485899 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:43.487155 I | ceph-mgr: 2017-07-11 15:02:43.485904 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:43.487253 I | ceph-mgr: 2017-07-11 15:02:43.485925 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:45.494800 I | ceph-mgr: 2017-07-11 15:02:45.494768 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:45.494881 I | ceph-mgr: 2017-07-11 15:02:45.494867 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:45.495103 I | ceph-mgr: 2017-07-11 15:02:45.495088 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:47.527986 I | ceph-mgr: 2017-07-11 15:02:47.526663 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:47.528054 I | ceph-mgr: 2017-07-11 15:02:47.526678 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:47.528070 I | ceph-mgr: 2017-07-11 15:02:47.526708 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:49.535309 I | ceph-mgr: 2017-07-11 15:02:49.535267 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:49.535386 I | ceph-mgr: 2017-07-11 15:02:49.535373 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:49.535460 I | ceph-mgr: 2017-07-11 15:02:49.535451 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:51.538186 I | ceph-mgr: 2017-07-11 15:02:51.538145 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:51.538257 I | ceph-mgr: 2017-07-11 15:02:51.538243 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:51.538332 I | ceph-mgr: 2017-07-11 15:02:51.538322 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:53.541074 I | ceph-mgr: 2017-07-11 15:02:53.541045 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:53.541147 I | ceph-mgr: 2017-07-11 15:02:53.541132 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:53.541379 I | ceph-mgr: 2017-07-11 15:02:53.541209 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:55.559408 I | ceph-mgr: 2017-07-11 15:02:55.559366 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:55.559483 I | ceph-mgr: 2017-07-11 15:02:55.559469 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:55.559726 I | ceph-mgr: 2017-07-11 15:02:55.559711 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:57.567421 I | ceph-mgr: 2017-07-11 15:02:57.567369 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:57.567516 I | ceph-mgr: 2017-07-11 15:02:57.567501 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:57.567792 I | ceph-mgr: 2017-07-11 15:02:57.567757 7f4cc3226700 0 mgr tick
- 2017-07-11 15:02:59.582463 I | ceph-mgr: 2017-07-11 15:02:59.582418 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:02:59.582533 I | ceph-mgr: 2017-07-11 15:02:59.582520 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:02:59.582783 I | ceph-mgr: 2017-07-11 15:02:59.582768 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:01.590011 I | ceph-mgr: 2017-07-11 15:03:01.587712 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:01.590073 I | ceph-mgr: 2017-07-11 15:03:01.587721 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:01.590088 I | ceph-mgr: 2017-07-11 15:03:01.587745 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:03.597118 I | ceph-mgr: 2017-07-11 15:03:03.597079 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:03.597204 I | ceph-mgr: 2017-07-11 15:03:03.597190 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:03.597278 I | ceph-mgr: 2017-07-11 15:03:03.597268 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:05.605381 I | ceph-mgr: 2017-07-11 15:03:05.605345 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:05.605451 I | ceph-mgr: 2017-07-11 15:03:05.605437 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:05.605522 I | ceph-mgr: 2017-07-11 15:03:05.605512 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:07.613219 I | ceph-mgr: 2017-07-11 15:03:07.613145 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:07.613473 I | ceph-mgr: 2017-07-11 15:03:07.613330 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:07.613738 I | ceph-mgr: 2017-07-11 15:03:07.613562 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:09.621195 I | ceph-mgr: 2017-07-11 15:03:09.618889 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:09.621269 I | ceph-mgr: 2017-07-11 15:03:09.618894 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:09.621286 I | ceph-mgr: 2017-07-11 15:03:09.618913 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:11.620454 I | ceph-mgr: 2017-07-11 15:03:11.620409 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:11.627335 I | ceph-mgr: 2017-07-11 15:03:11.620618 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:11.627574 I | ceph-mgr: 2017-07-11 15:03:11.627557 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:13.631152 I | ceph-mgr: 2017-07-11 15:03:13.631118 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:13.631228 I | ceph-mgr: 2017-07-11 15:03:13.631213 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:13.631458 I | ceph-mgr: 2017-07-11 15:03:13.631441 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:15.651150 I | ceph-mgr: 2017-07-11 15:03:15.651117 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:15.651230 I | ceph-mgr: 2017-07-11 15:03:15.651215 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:15.651462 I | ceph-mgr: 2017-07-11 15:03:15.651447 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:17.675113 I | ceph-mgr: 2017-07-11 15:03:17.675043 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:17.675196 I | ceph-mgr: 2017-07-11 15:03:17.675181 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:17.675438 I | ceph-mgr: 2017-07-11 15:03:17.675422 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:19.680412 I | ceph-mgr: 2017-07-11 15:03:19.679890 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:19.680592 I | ceph-mgr: 2017-07-11 15:03:19.680576 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:19.683789 I | ceph-mgr: 2017-07-11 15:03:19.683771 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:21.719511 I | ceph-mgr: 2017-07-11 15:03:21.703393 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:21.719676 I | ceph-mgr: 2017-07-11 15:03:21.703406 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:21.719805 I | ceph-mgr: 2017-07-11 15:03:21.703436 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:23.721632 I | ceph-mgr: 2017-07-11 15:03:23.721562 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:23.721889 I | ceph-mgr: 2017-07-11 15:03:23.721862 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:23.723194 I | ceph-mgr: 2017-07-11 15:03:23.723176 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:25.738593 I | ceph-mgr: 2017-07-11 15:03:25.738542 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:25.738701 I | ceph-mgr: 2017-07-11 15:03:25.738686 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:25.739167 I | ceph-mgr: 2017-07-11 15:03:25.739150 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:27.748275 I | ceph-mgr: 2017-07-11 15:03:27.748224 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:27.748354 I | ceph-mgr: 2017-07-11 15:03:27.748340 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:27.748594 I | ceph-mgr: 2017-07-11 15:03:27.748577 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:29.755799 I | ceph-mgr: 2017-07-11 15:03:29.754458 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:29.763807 I | ceph-mgr: 2017-07-11 15:03:29.754463 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:29.763906 I | ceph-mgr: 2017-07-11 15:03:29.754483 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:31.758879 I | ceph-mgr: 2017-07-11 15:03:31.758793 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:31.760388 I | ceph-mgr: 2017-07-11 15:03:31.758805 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:31.760742 I | ceph-mgr: 2017-07-11 15:03:31.760416 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:33.762830 I | ceph-mgr: 2017-07-11 15:03:33.762795 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:33.763006 I | ceph-mgr: 2017-07-11 15:03:33.762989 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:33.770852 I | ceph-mgr: 2017-07-11 15:03:33.770833 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:35.777071 I | ceph-mgr: 2017-07-11 15:03:35.776951 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:35.777168 I | ceph-mgr: 2017-07-11 15:03:35.777154 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:35.777383 I | ceph-mgr: 2017-07-11 15:03:35.777367 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:37.781429 I | ceph-mgr: 2017-07-11 15:03:37.781378 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:37.781515 I | ceph-mgr: 2017-07-11 15:03:37.781500 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:37.781792 I | ceph-mgr: 2017-07-11 15:03:37.781776 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:39.789185 I | ceph-mgr: 2017-07-11 15:03:39.789146 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:39.789264 I | ceph-mgr: 2017-07-11 15:03:39.789251 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:39.789483 I | ceph-mgr: 2017-07-11 15:03:39.789468 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:41.811360 I | ceph-mgr: 2017-07-11 15:03:41.811327 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:41.811440 I | ceph-mgr: 2017-07-11 15:03:41.811425 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:41.811669 I | ceph-mgr: 2017-07-11 15:03:41.811654 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:43.815083 I | ceph-mgr: 2017-07-11 15:03:43.815028 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:43.815182 I | ceph-mgr: 2017-07-11 15:03:43.815167 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:43.815503 I | ceph-mgr: 2017-07-11 15:03:43.815488 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:45.819005 I | ceph-mgr: 2017-07-11 15:03:45.818946 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:45.820733 I | ceph-mgr: 2017-07-11 15:03:45.820715 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:45.821098 I | ceph-mgr: 2017-07-11 15:03:45.821082 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:47.831059 I | ceph-mgr: 2017-07-11 15:03:47.830333 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:47.831103 I | ceph-mgr: 2017-07-11 15:03:47.831087 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:47.831214 I | ceph-mgr: 2017-07-11 15:03:47.831198 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:49.850686 I | ceph-mgr: 2017-07-11 15:03:49.850647 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:49.858129 I | ceph-mgr: 2017-07-11 15:03:49.858086 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:49.867820 I | ceph-mgr: 2017-07-11 15:03:49.867770 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:51.892526 I | ceph-mgr: 2017-07-11 15:03:51.892470 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:51.892615 I | ceph-mgr: 2017-07-11 15:03:51.892601 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:51.892862 I | ceph-mgr: 2017-07-11 15:03:51.892845 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:53.920003 I | ceph-mgr: 2017-07-11 15:03:53.917948 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:53.920217 I | ceph-mgr: 2017-07-11 15:03:53.917961 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:53.920317 I | ceph-mgr: 2017-07-11 15:03:53.918005 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:55.925160 I | ceph-mgr: 2017-07-11 15:03:55.925116 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:55.925316 I | ceph-mgr: 2017-07-11 15:03:55.925225 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:55.925552 I | ceph-mgr: 2017-07-11 15:03:55.925537 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:57.948568 I | ceph-mgr: 2017-07-11 15:03:57.946635 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:57.948671 I | ceph-mgr: 2017-07-11 15:03:57.948651 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:57.949013 I | ceph-mgr: 2017-07-11 15:03:57.948996 7f4cc3226700 0 mgr tick
- 2017-07-11 15:03:59.967715 I | ceph-mgr: 2017-07-11 15:03:59.967684 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:03:59.967785 I | ceph-mgr: 2017-07-11 15:03:59.967772 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:03:59.967991 I | ceph-mgr: 2017-07-11 15:03:59.967881 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:01.972674 I | ceph-mgr: 2017-07-11 15:04:01.972505 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:01.972754 I | ceph-mgr: 2017-07-11 15:04:01.972740 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:01.972980 I | ceph-mgr: 2017-07-11 15:04:01.972965 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:03.976753 I | ceph-mgr: 2017-07-11 15:04:03.976708 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:03.976836 I | ceph-mgr: 2017-07-11 15:04:03.976821 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:03.977086 I | ceph-mgr: 2017-07-11 15:04:03.977071 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:05.983607 I | ceph-mgr: 2017-07-11 15:04:05.983561 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:05.983690 I | ceph-mgr: 2017-07-11 15:04:05.983676 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:05.983916 I | ceph-mgr: 2017-07-11 15:04:05.983901 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:07.993215 I | ceph-mgr: 2017-07-11 15:04:07.993170 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:07.993294 I | ceph-mgr: 2017-07-11 15:04:07.993280 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:07.993540 I | ceph-mgr: 2017-07-11 15:04:07.993525 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:10.004713 I | ceph-mgr: 2017-07-11 15:04:10.003418 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:10.011210 I | ceph-mgr: 2017-07-11 15:04:10.003431 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:10.011244 I | ceph-mgr: 2017-07-11 15:04:10.003461 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:12.012835 I | ceph-mgr: 2017-07-11 15:04:12.011407 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:12.013041 I | ceph-mgr: 2017-07-11 15:04:12.011419 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:12.013068 I | ceph-mgr: 2017-07-11 15:04:12.011450 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:14.018959 I | ceph-mgr: 2017-07-11 15:04:14.018912 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:14.019036 I | ceph-mgr: 2017-07-11 15:04:14.019023 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:14.019300 I | ceph-mgr: 2017-07-11 15:04:14.019283 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:16.040614 I | ceph-mgr: 2017-07-11 15:04:16.040573 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:16.040683 I | ceph-mgr: 2017-07-11 15:04:16.040670 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:16.041127 I | ceph-mgr: 2017-07-11 15:04:16.041089 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:18.059442 I | ceph-mgr: 2017-07-11 15:04:18.059398 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:18.059609 I | ceph-mgr: 2017-07-11 15:04:18.059520 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:18.059879 I | ceph-mgr: 2017-07-11 15:04:18.059844 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:20.064023 I | ceph-mgr: 2017-07-11 15:04:20.063946 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:20.064122 I | ceph-mgr: 2017-07-11 15:04:20.064108 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:20.064385 I | ceph-mgr: 2017-07-11 15:04:20.064363 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:22.066241 I | ceph-mgr: 2017-07-11 15:04:22.066140 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:22.066320 I | ceph-mgr: 2017-07-11 15:04:22.066306 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:22.081929 I | ceph-mgr: 2017-07-11 15:04:22.081911 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:24.086431 I | ceph-mgr: 2017-07-11 15:04:24.086398 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:24.087931 I | ceph-mgr: 2017-07-11 15:04:24.086589 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:24.088296 I | ceph-mgr: 2017-07-11 15:04:24.088280 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:26.091976 I | ceph-mgr: 2017-07-11 15:04:26.091929 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:26.092058 I | ceph-mgr: 2017-07-11 15:04:26.092044 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:26.092308 I | ceph-mgr: 2017-07-11 15:04:26.092292 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:28.094409 I | ceph-mgr: 2017-07-11 15:04:28.094358 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:28.094504 I | ceph-mgr: 2017-07-11 15:04:28.094490 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:28.094745 I | ceph-mgr: 2017-07-11 15:04:28.094730 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:30.106426 I | ceph-mgr: 2017-07-11 15:04:30.106388 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:30.106496 I | ceph-mgr: 2017-07-11 15:04:30.106482 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:30.106663 I | ceph-mgr: 2017-07-11 15:04:30.106598 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:32.114346 I | ceph-mgr: 2017-07-11 15:04:32.114303 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:32.114425 I | ceph-mgr: 2017-07-11 15:04:32.114411 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:32.114655 I | ceph-mgr: 2017-07-11 15:04:32.114640 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:34.122698 I | ceph-mgr: 2017-07-11 15:04:34.122647 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:34.122915 I | ceph-mgr: 2017-07-11 15:04:34.122898 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:34.124265 I | ceph-mgr: 2017-07-11 15:04:34.124248 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:36.127991 I | ceph-mgr: 2017-07-11 15:04:36.127959 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:36.128062 I | ceph-mgr: 2017-07-11 15:04:36.128047 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:36.128419 I | ceph-mgr: 2017-07-11 15:04:36.128164 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:38.149198 I | ceph-mgr: 2017-07-11 15:04:38.147818 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:38.149367 I | ceph-mgr: 2017-07-11 15:04:38.147825 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:38.149497 I | ceph-mgr: 2017-07-11 15:04:38.147847 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:40.153789 I | ceph-mgr: 2017-07-11 15:04:40.153741 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:40.153900 I | ceph-mgr: 2017-07-11 15:04:40.153875 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:40.159401 I | ceph-mgr: 2017-07-11 15:04:40.159354 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:42.167171 I | ceph-mgr: 2017-07-11 15:04:42.167053 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:42.167262 I | ceph-mgr: 2017-07-11 15:04:42.167064 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:42.167278 I | ceph-mgr: 2017-07-11 15:04:42.167101 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:44.173361 I | ceph-mgr: 2017-07-11 15:04:44.171976 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:44.173450 I | ceph-mgr: 2017-07-11 15:04:44.171989 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:44.173468 I | ceph-mgr: 2017-07-11 15:04:44.172020 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:46.177321 I | ceph-mgr: 2017-07-11 15:04:46.176054 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:46.177383 I | ceph-mgr: 2017-07-11 15:04:46.176060 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:46.177398 I | ceph-mgr: 2017-07-11 15:04:46.176082 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:48.177956 I | ceph-mgr: 2017-07-11 15:04:48.177923 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:48.178032 I | ceph-mgr: 2017-07-11 15:04:48.178018 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:48.178105 I | ceph-mgr: 2017-07-11 15:04:48.178095 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:50.202685 I | ceph-mgr: 2017-07-11 15:04:50.200036 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:50.209761 I | ceph-mgr: 2017-07-11 15:04:50.209717 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:50.210878 I | ceph-mgr: 2017-07-11 15:04:50.210861 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:52.218727 I | ceph-mgr: 2017-07-11 15:04:52.218684 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:52.218911 I | ceph-mgr: 2017-07-11 15:04:52.218791 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:52.219328 I | ceph-mgr: 2017-07-11 15:04:52.219080 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:54.241630 I | ceph-mgr: 2017-07-11 15:04:54.238443 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:54.241690 I | ceph-mgr: 2017-07-11 15:04:54.238458 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:54.241705 I | ceph-mgr: 2017-07-11 15:04:54.238495 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:56.246815 I | ceph-mgr: 2017-07-11 15:04:56.246745 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:56.246897 I | ceph-mgr: 2017-07-11 15:04:56.246883 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:56.246976 I | ceph-mgr: 2017-07-11 15:04:56.246966 7f4cc3226700 0 mgr tick
- 2017-07-11 15:04:58.250601 I | ceph-mgr: 2017-07-11 15:04:58.249194 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:04:58.250662 I | ceph-mgr: 2017-07-11 15:04:58.249213 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:04:58.250677 I | ceph-mgr: 2017-07-11 15:04:58.249261 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:00.257789 I | ceph-mgr: 2017-07-11 15:05:00.255822 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:00.265513 I | ceph-mgr: 2017-07-11 15:05:00.259121 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:00.265647 I | ceph-mgr: 2017-07-11 15:05:00.265635 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:02.274278 I | ceph-mgr: 2017-07-11 15:05:02.274230 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:02.274358 I | ceph-mgr: 2017-07-11 15:05:02.274345 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:02.274435 I | ceph-mgr: 2017-07-11 15:05:02.274425 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:04.277289 I | ceph-mgr: 2017-07-11 15:05:04.277257 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:04.277378 I | ceph-mgr: 2017-07-11 15:05:04.277365 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:04.277605 I | ceph-mgr: 2017-07-11 15:05:04.277460 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:06.287283 I | ceph-mgr: 2017-07-11 15:05:06.287237 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:06.287397 I | ceph-mgr: 2017-07-11 15:05:06.287381 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:06.287704 I | ceph-mgr: 2017-07-11 15:05:06.287687 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:08.306085 I | ceph-mgr: 2017-07-11 15:05:08.306055 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:08.306121 I | ceph-mgr: 2017-07-11 15:05:08.306108 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:08.307665 I | ceph-mgr: 2017-07-11 15:05:08.306262 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:10.336964 I | ceph-mgr: 2017-07-11 15:05:10.336939 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:10.337042 I | ceph-mgr: 2017-07-11 15:05:10.337027 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:10.337278 I | ceph-mgr: 2017-07-11 15:05:10.337244 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:12.350098 I | ceph-mgr: 2017-07-11 15:05:12.349964 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:12.350188 I | ceph-mgr: 2017-07-11 15:05:12.350173 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:12.350547 I | ceph-mgr: 2017-07-11 15:05:12.350530 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:14.352643 I | ceph-mgr: 2017-07-11 15:05:14.352601 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:14.352728 I | ceph-mgr: 2017-07-11 15:05:14.352715 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:14.352955 I | ceph-mgr: 2017-07-11 15:05:14.352940 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:16.375477 I | ceph-mgr: 2017-07-11 15:05:16.375432 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:16.375645 I | ceph-mgr: 2017-07-11 15:05:16.375575 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:16.375883 I | ceph-mgr: 2017-07-11 15:05:16.375868 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:18.439044 I | ceph-mgr: 2017-07-11 15:05:18.439015 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:18.439260 I | ceph-mgr: 2017-07-11 15:05:18.439244 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:18.440186 I | ceph-mgr: 2017-07-11 15:05:18.440169 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:20.441993 I | ceph-mgr: 2017-07-11 15:05:20.441941 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:20.442206 I | ceph-mgr: 2017-07-11 15:05:20.442104 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:20.442378 I | ceph-mgr: 2017-07-11 15:05:20.442340 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:22.445577 I | ceph-mgr: 2017-07-11 15:05:22.445533 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:22.445668 I | ceph-mgr: 2017-07-11 15:05:22.445654 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:22.445901 I | ceph-mgr: 2017-07-11 15:05:22.445885 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:24.455022 I | ceph-mgr: 2017-07-11 15:05:24.454829 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:24.455104 I | ceph-mgr: 2017-07-11 15:05:24.455089 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:24.455332 I | ceph-mgr: 2017-07-11 15:05:24.455317 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:26.457146 I | ceph-mgr: 2017-07-11 15:05:26.457120 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:26.457219 I | ceph-mgr: 2017-07-11 15:05:26.457205 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:26.457426 I | ceph-mgr: 2017-07-11 15:05:26.457313 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:28.482432 I | ceph-mgr: 2017-07-11 15:05:28.482394 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:28.482549 I | ceph-mgr: 2017-07-11 15:05:28.482534 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:28.482839 I | ceph-mgr: 2017-07-11 15:05:28.482824 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:30.485679 I | ceph-mgr: 2017-07-11 15:05:30.485650 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:30.485818 I | ceph-mgr: 2017-07-11 15:05:30.485802 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:30.486086 I | ceph-mgr: 2017-07-11 15:05:30.486070 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:32.493995 I | ceph-mgr: 2017-07-11 15:05:32.493949 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:32.494110 I | ceph-mgr: 2017-07-11 15:05:32.494094 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:32.494343 I | ceph-mgr: 2017-07-11 15:05:32.494327 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:34.501132 I | ceph-mgr: 2017-07-11 15:05:34.501039 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:34.501214 I | ceph-mgr: 2017-07-11 15:05:34.501197 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:34.510772 I | ceph-mgr: 2017-07-11 15:05:34.510755 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:36.515767 I | ceph-mgr: 2017-07-11 15:05:36.515700 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:36.515977 I | ceph-mgr: 2017-07-11 15:05:36.515877 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:36.516377 I | ceph-mgr: 2017-07-11 15:05:36.516360 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:38.522768 I | ceph-mgr: 2017-07-11 15:05:38.522731 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:38.522956 I | ceph-mgr: 2017-07-11 15:05:38.522939 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:38.526019 I | ceph-mgr: 2017-07-11 15:05:38.525809 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:40.547488 I | ceph-mgr: 2017-07-11 15:05:40.547445 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:40.547523 I | ceph-mgr: 2017-07-11 15:05:40.547510 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:40.547652 I | ceph-mgr: 2017-07-11 15:05:40.547637 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:42.571075 I | ceph-mgr: 2017-07-11 15:05:42.571033 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:42.571160 I | ceph-mgr: 2017-07-11 15:05:42.571146 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:42.571393 I | ceph-mgr: 2017-07-11 15:05:42.571376 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:44.577096 I | ceph-mgr: 2017-07-11 15:05:44.577049 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:44.577173 I | ceph-mgr: 2017-07-11 15:05:44.577160 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:44.577441 I | ceph-mgr: 2017-07-11 15:05:44.577426 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:46.579163 I | ceph-mgr: 2017-07-11 15:05:46.579121 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:46.579247 I | ceph-mgr: 2017-07-11 15:05:46.579233 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:46.579484 I | ceph-mgr: 2017-07-11 15:05:46.579469 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:48.598476 I | ceph-mgr: 2017-07-11 15:05:48.598172 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:48.598666 I | ceph-mgr: 2017-07-11 15:05:48.598592 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:48.598909 I | ceph-mgr: 2017-07-11 15:05:48.598893 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:50.601175 I | ceph-mgr: 2017-07-11 15:05:50.601132 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:50.601272 I | ceph-mgr: 2017-07-11 15:05:50.601257 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:50.616916 I | ceph-mgr: 2017-07-11 15:05:50.616897 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:52.635243 I | ceph-mgr: 2017-07-11 15:05:52.618619 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:52.635314 I | ceph-mgr: 2017-07-11 15:05:52.618625 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:52.635330 I | ceph-mgr: 2017-07-11 15:05:52.618647 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:54.639786 I | ceph-mgr: 2017-07-11 15:05:54.639725 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:54.639855 I | ceph-mgr: 2017-07-11 15:05:54.639840 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:54.640086 I | ceph-mgr: 2017-07-11 15:05:54.640070 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:56.655551 I | ceph-mgr: 2017-07-11 15:05:56.655465 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:56.655661 I | ceph-mgr: 2017-07-11 15:05:56.655645 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:56.655914 I | ceph-mgr: 2017-07-11 15:05:56.655898 7f4cc3226700 0 mgr tick
- 2017-07-11 15:05:58.657683 I | ceph-mgr: 2017-07-11 15:05:58.657645 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:05:58.657760 I | ceph-mgr: 2017-07-11 15:05:58.657744 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:05:58.658028 I | ceph-mgr: 2017-07-11 15:05:58.657989 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:00.681240 I | ceph-mgr: 2017-07-11 15:06:00.681142 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:00.681301 I | ceph-mgr: 2017-07-11 15:06:00.681150 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:00.681315 I | ceph-mgr: 2017-07-11 15:06:00.681175 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:02.689669 I | ceph-mgr: 2017-07-11 15:06:02.689623 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:02.689747 I | ceph-mgr: 2017-07-11 15:06:02.689733 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:02.689824 I | ceph-mgr: 2017-07-11 15:06:02.689813 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:04.696447 I | ceph-mgr: 2017-07-11 15:06:04.696384 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:04.696641 I | ceph-mgr: 2017-07-11 15:06:04.696624 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:04.698754 I | ceph-mgr: 2017-07-11 15:06:04.696799 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:06.713823 I | ceph-mgr: 2017-07-11 15:06:06.713780 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:06.713919 I | ceph-mgr: 2017-07-11 15:06:06.713881 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:06.714198 I | ceph-mgr: 2017-07-11 15:06:06.714035 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:08.722480 I | ceph-mgr: 2017-07-11 15:06:08.722443 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:08.722563 I | ceph-mgr: 2017-07-11 15:06:08.722548 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:08.722795 I | ceph-mgr: 2017-07-11 15:06:08.722779 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:10.744731 I | ceph-mgr: 2017-07-11 15:06:10.744664 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:10.744806 I | ceph-mgr: 2017-07-11 15:06:10.744792 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:10.745068 I | ceph-mgr: 2017-07-11 15:06:10.745052 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:12.750198 I | ceph-mgr: 2017-07-11 15:06:12.750149 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:12.750293 I | ceph-mgr: 2017-07-11 15:06:12.750278 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:12.750812 I | ceph-mgr: 2017-07-11 15:06:12.750794 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:14.757186 I | ceph-mgr: 2017-07-11 15:06:14.757123 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:14.759256 I | ceph-mgr: 2017-07-11 15:06:14.759240 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:14.759588 I | ceph-mgr: 2017-07-11 15:06:14.759572 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:16.767881 I | ceph-mgr: 2017-07-11 15:06:16.767731 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:16.767957 I | ceph-mgr: 2017-07-11 15:06:16.767942 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:16.768193 I | ceph-mgr: 2017-07-11 15:06:16.768178 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:18.769906 I | ceph-mgr: 2017-07-11 15:06:18.769872 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:18.770071 I | ceph-mgr: 2017-07-11 15:06:18.770055 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:18.776618 I | ceph-mgr: 2017-07-11 15:06:18.776600 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:20.784450 I | ceph-mgr: 2017-07-11 15:06:20.782128 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:20.788653 I | ceph-mgr: 2017-07-11 15:06:20.788622 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:20.789119 I | ceph-mgr: 2017-07-11 15:06:20.789102 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:22.791740 I | ceph-mgr: 2017-07-11 15:06:22.791703 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:22.791847 I | ceph-mgr: 2017-07-11 15:06:22.791831 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:22.792150 I | ceph-mgr: 2017-07-11 15:06:22.792134 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:24.796792 I | ceph-mgr: 2017-07-11 15:06:24.796720 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:24.797040 I | ceph-mgr: 2017-07-11 15:06:24.796927 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:24.797257 I | ceph-mgr: 2017-07-11 15:06:24.797234 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:26.804900 I | ceph-mgr: 2017-07-11 15:06:26.804864 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:26.804988 I | ceph-mgr: 2017-07-11 15:06:26.804975 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:26.805418 I | ceph-mgr: 2017-07-11 15:06:26.805402 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:28.810223 I | ceph-mgr: 2017-07-11 15:06:28.810133 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:28.810455 I | ceph-mgr: 2017-07-11 15:06:28.810438 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:28.810659 I | ceph-mgr: 2017-07-11 15:06:28.810644 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:30.823740 I | ceph-mgr: 2017-07-11 15:06:30.823701 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:30.823813 I | ceph-mgr: 2017-07-11 15:06:30.823799 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:30.824061 I | ceph-mgr: 2017-07-11 15:06:30.824043 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:32.842348 I | ceph-mgr: 2017-07-11 15:06:32.842304 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:32.842435 I | ceph-mgr: 2017-07-11 15:06:32.842421 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:32.842662 I | ceph-mgr: 2017-07-11 15:06:32.842646 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:34.860577 I | ceph-mgr: 2017-07-11 15:06:34.860547 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:34.860650 I | ceph-mgr: 2017-07-11 15:06:34.860636 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:34.860848 I | ceph-mgr: 2017-07-11 15:06:34.860741 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:36.863087 I | ceph-mgr: 2017-07-11 15:06:36.863056 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:36.863640 I | ceph-mgr: 2017-07-11 15:06:36.863266 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:36.863819 I | ceph-mgr: 2017-07-11 15:06:36.863754 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:38.888068 I | ceph-mgr: 2017-07-11 15:06:38.886619 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:38.888132 I | ceph-mgr: 2017-07-11 15:06:38.886632 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:38.888148 I | ceph-mgr: 2017-07-11 15:06:38.886661 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:40.888089 I | ceph-mgr: 2017-07-11 15:06:40.888052 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:40.888168 I | ceph-mgr: 2017-07-11 15:06:40.888154 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:40.888239 I | ceph-mgr: 2017-07-11 15:06:40.888229 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:42.906216 I | ceph-mgr: 2017-07-11 15:06:42.906172 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:42.906310 I | ceph-mgr: 2017-07-11 15:06:42.906295 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:42.906549 I | ceph-mgr: 2017-07-11 15:06:42.906534 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:44.914740 I | ceph-mgr: 2017-07-11 15:06:44.914698 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:44.914850 I | ceph-mgr: 2017-07-11 15:06:44.914813 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:44.915100 I | ceph-mgr: 2017-07-11 15:06:44.915085 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:46.916566 I | ceph-mgr: 2017-07-11 15:06:46.916528 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:46.916640 I | ceph-mgr: 2017-07-11 15:06:46.916625 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:46.917044 I | ceph-mgr: 2017-07-11 15:06:46.917028 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:48.936873 I | ceph-mgr: 2017-07-11 15:06:48.936832 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:48.936949 I | ceph-mgr: 2017-07-11 15:06:48.936935 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:48.937194 I | ceph-mgr: 2017-07-11 15:06:48.937178 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:50.960435 I | ceph-mgr: 2017-07-11 15:06:50.960405 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:50.960509 I | ceph-mgr: 2017-07-11 15:06:50.960495 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:50.960744 I | ceph-mgr: 2017-07-11 15:06:50.960728 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:52.973174 I | ceph-mgr: 2017-07-11 15:06:52.971428 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:52.981184 I | ceph-mgr: 2017-07-11 15:06:52.981164 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:53.002054 I | ceph-mgr: 2017-07-11 15:06:53.000608 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:55.002925 I | ceph-mgr: 2017-07-11 15:06:55.002858 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:55.003000 I | ceph-mgr: 2017-07-11 15:06:55.002985 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:55.003225 I | ceph-mgr: 2017-07-11 15:06:55.003210 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:57.013093 I | ceph-mgr: 2017-07-11 15:06:57.012942 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:57.013174 I | ceph-mgr: 2017-07-11 15:06:57.013158 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:57.013426 I | ceph-mgr: 2017-07-11 15:06:57.013411 7f4cc3226700 0 mgr tick
- 2017-07-11 15:06:59.020912 I | ceph-mgr: 2017-07-11 15:06:59.019514 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:06:59.020985 I | ceph-mgr: 2017-07-11 15:06:59.019537 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:06:59.021002 I | ceph-mgr: 2017-07-11 15:06:59.019570 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:01.021650 I | ceph-mgr: 2017-07-11 15:07:01.021594 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:01.021874 I | ceph-mgr: 2017-07-11 15:07:01.021858 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:01.022254 I | ceph-mgr: 2017-07-11 15:07:01.022238 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:03.034987 I | ceph-mgr: 2017-07-11 15:07:03.034715 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:03.035076 I | ceph-mgr: 2017-07-11 15:07:03.035061 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:03.035341 I | ceph-mgr: 2017-07-11 15:07:03.035325 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:05.041221 I | ceph-mgr: 2017-07-11 15:07:05.041183 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:05.041427 I | ceph-mgr: 2017-07-11 15:07:05.041411 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:05.044958 I | ceph-mgr: 2017-07-11 15:07:05.044932 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:07.058588 I | ceph-mgr: 2017-07-11 15:07:07.058521 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:07.058827 I | ceph-mgr: 2017-07-11 15:07:07.058697 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:07.059253 I | ceph-mgr: 2017-07-11 15:07:07.059237 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:09.066013 I | ceph-mgr: 2017-07-11 15:07:09.065964 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:09.066103 I | ceph-mgr: 2017-07-11 15:07:09.066087 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:09.066536 I | ceph-mgr: 2017-07-11 15:07:09.066519 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:11.074186 I | ceph-mgr: 2017-07-11 15:07:11.074125 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:11.074361 I | ceph-mgr: 2017-07-11 15:07:11.074302 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:11.074590 I | ceph-mgr: 2017-07-11 15:07:11.074572 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:13.081689 I | ceph-mgr: 2017-07-11 15:07:13.081645 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:13.081760 I | ceph-mgr: 2017-07-11 15:07:13.081747 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:13.081996 I | ceph-mgr: 2017-07-11 15:07:13.081981 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:15.108812 I | ceph-mgr: 2017-07-11 15:07:15.108779 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:15.108882 I | ceph-mgr: 2017-07-11 15:07:15.108868 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:15.109096 I | ceph-mgr: 2017-07-11 15:07:15.108980 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:17.120371 I | ceph-mgr: 2017-07-11 15:07:17.120335 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:17.120440 I | ceph-mgr: 2017-07-11 15:07:17.120426 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:17.120712 I | ceph-mgr: 2017-07-11 15:07:17.120695 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:19.138360 I | ceph-mgr: 2017-07-11 15:07:19.138328 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:19.138437 I | ceph-mgr: 2017-07-11 15:07:19.138423 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:19.138760 I | ceph-mgr: 2017-07-11 15:07:19.138531 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:21.150812 I | ceph-mgr: 2017-07-11 15:07:21.150781 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:21.151001 I | ceph-mgr: 2017-07-11 15:07:21.150941 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:21.151252 I | ceph-mgr: 2017-07-11 15:07:21.151236 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:23.154026 I | ceph-mgr: 2017-07-11 15:07:23.153992 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:23.154113 I | ceph-mgr: 2017-07-11 15:07:23.154099 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:23.154342 I | ceph-mgr: 2017-07-11 15:07:23.154316 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:25.177477 I | ceph-mgr: 2017-07-11 15:07:25.177421 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:25.177749 I | ceph-mgr: 2017-07-11 15:07:25.177585 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:25.178040 I | ceph-mgr: 2017-07-11 15:07:25.178024 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:27.184263 I | ceph-mgr: 2017-07-11 15:07:27.184207 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:27.184343 I | ceph-mgr: 2017-07-11 15:07:27.184328 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:27.184568 I | ceph-mgr: 2017-07-11 15:07:27.184553 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:29.187867 I | ceph-mgr: 2017-07-11 15:07:29.187771 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:29.187943 I | ceph-mgr: 2017-07-11 15:07:29.187927 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:29.188385 I | ceph-mgr: 2017-07-11 15:07:29.188358 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:31.201407 I | ceph-mgr: 2017-07-11 15:07:31.201367 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:31.219954 I | ceph-mgr: 2017-07-11 15:07:31.202706 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:31.219990 I | ceph-mgr: 2017-07-11 15:07:31.218278 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:33.223936 I | ceph-mgr: 2017-07-11 15:07:33.222729 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:33.224113 I | ceph-mgr: 2017-07-11 15:07:33.222742 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:33.224146 I | ceph-mgr: 2017-07-11 15:07:33.222787 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:35.230814 I | ceph-mgr: 2017-07-11 15:07:35.230781 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:35.230889 I | ceph-mgr: 2017-07-11 15:07:35.230875 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:35.231104 I | ceph-mgr: 2017-07-11 15:07:35.230987 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:37.235495 I | ceph-mgr: 2017-07-11 15:07:37.235454 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:37.235565 I | ceph-mgr: 2017-07-11 15:07:37.235550 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:37.235799 I | ceph-mgr: 2017-07-11 15:07:37.235783 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:39.240017 I | ceph-mgr: 2017-07-11 15:07:39.239971 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:39.240094 I | ceph-mgr: 2017-07-11 15:07:39.240080 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:39.256957 I | ceph-mgr: 2017-07-11 15:07:39.240314 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:41.280799 I | ceph-mgr: 2017-07-11 15:07:41.264776 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:41.280862 I | ceph-mgr: 2017-07-11 15:07:41.264782 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:41.280882 I | ceph-mgr: 2017-07-11 15:07:41.264856 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:43.288775 I | ceph-mgr: 2017-07-11 15:07:43.288738 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:43.288868 I | ceph-mgr: 2017-07-11 15:07:43.288848 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:43.289036 I | ceph-mgr: 2017-07-11 15:07:43.289021 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:45.290573 I | ceph-mgr: 2017-07-11 15:07:45.290541 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:45.290667 I | ceph-mgr: 2017-07-11 15:07:45.290653 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:45.296848 I | ceph-mgr: 2017-07-11 15:07:45.296829 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:47.299865 I | ceph-mgr: 2017-07-11 15:07:47.299823 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:47.299947 I | ceph-mgr: 2017-07-11 15:07:47.299931 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:47.300185 I | ceph-mgr: 2017-07-11 15:07:47.300170 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:49.313437 I | ceph-mgr: 2017-07-11 15:07:49.313382 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:49.313522 I | ceph-mgr: 2017-07-11 15:07:49.313507 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:49.313764 I | ceph-mgr: 2017-07-11 15:07:49.313748 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:51.318733 I | ceph-mgr: 2017-07-11 15:07:51.318679 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:51.318769 I | ceph-mgr: 2017-07-11 15:07:51.318756 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:51.318881 I | ceph-mgr: 2017-07-11 15:07:51.318867 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:53.326166 I | ceph-mgr: 2017-07-11 15:07:53.324661 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:53.326384 I | ceph-mgr: 2017-07-11 15:07:53.324672 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:53.326483 I | ceph-mgr: 2017-07-11 15:07:53.324712 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:55.330880 I | ceph-mgr: 2017-07-11 15:07:55.330808 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:55.332873 I | ceph-mgr: 2017-07-11 15:07:55.332857 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:55.333158 I | ceph-mgr: 2017-07-11 15:07:55.333142 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:57.337397 I | ceph-mgr: 2017-07-11 15:07:57.335314 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:57.337475 I | ceph-mgr: 2017-07-11 15:07:57.337460 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:57.337715 I | ceph-mgr: 2017-07-11 15:07:57.337699 7f4cc3226700 0 mgr tick
- 2017-07-11 15:07:59.357724 I | ceph-mgr: 2017-07-11 15:07:59.357679 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:07:59.357813 I | ceph-mgr: 2017-07-11 15:07:59.357798 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:07:59.358063 I | ceph-mgr: 2017-07-11 15:07:59.358048 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:01.361403 I | ceph-mgr: 2017-07-11 15:08:01.361360 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:01.361475 I | ceph-mgr: 2017-07-11 15:08:01.361461 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:01.361724 I | ceph-mgr: 2017-07-11 15:08:01.361708 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:03.378733 I | ceph-mgr: 2017-07-11 15:08:03.378694 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:03.378819 I | ceph-mgr: 2017-07-11 15:08:03.378805 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:03.379053 I | ceph-mgr: 2017-07-11 15:08:03.379038 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:05.381148 I | ceph-mgr: 2017-07-11 15:08:05.381111 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:05.381230 I | ceph-mgr: 2017-07-11 15:08:05.381217 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:05.381460 I | ceph-mgr: 2017-07-11 15:08:05.381399 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:07.383044 I | ceph-mgr: 2017-07-11 15:08:07.382981 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:07.383121 I | ceph-mgr: 2017-07-11 15:08:07.383107 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:07.383353 I | ceph-mgr: 2017-07-11 15:08:07.383338 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:09.384992 I | ceph-mgr: 2017-07-11 15:08:09.384945 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:09.385030 I | ceph-mgr: 2017-07-11 15:08:09.385017 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:09.385143 I | ceph-mgr: 2017-07-11 15:08:09.385129 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:11.386901 I | ceph-mgr: 2017-07-11 15:08:11.386856 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:11.386975 I | ceph-mgr: 2017-07-11 15:08:11.386961 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:11.387243 I | ceph-mgr: 2017-07-11 15:08:11.387226 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:13.401308 I | ceph-mgr: 2017-07-11 15:08:13.401244 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:13.401379 I | ceph-mgr: 2017-07-11 15:08:13.401352 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:13.401545 I | ceph-mgr: 2017-07-11 15:08:13.401530 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:15.403247 I | ceph-mgr: 2017-07-11 15:08:15.403212 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:15.403325 I | ceph-mgr: 2017-07-11 15:08:15.403311 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:15.403571 I | ceph-mgr: 2017-07-11 15:08:15.403555 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:17.405456 I | ceph-mgr: 2017-07-11 15:08:17.405405 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:17.405541 I | ceph-mgr: 2017-07-11 15:08:17.405526 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:17.405800 I | ceph-mgr: 2017-07-11 15:08:17.405783 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:19.407758 I | ceph-mgr: 2017-07-11 15:08:19.407710 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:19.407834 I | ceph-mgr: 2017-07-11 15:08:19.407820 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:19.408083 I | ceph-mgr: 2017-07-11 15:08:19.408066 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:21.409888 I | ceph-mgr: 2017-07-11 15:08:21.409840 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:21.409986 I | ceph-mgr: 2017-07-11 15:08:21.409971 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:21.410249 I | ceph-mgr: 2017-07-11 15:08:21.410233 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:23.412146 I | ceph-mgr: 2017-07-11 15:08:23.412104 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:23.412226 I | ceph-mgr: 2017-07-11 15:08:23.412211 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:23.412462 I | ceph-mgr: 2017-07-11 15:08:23.412446 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:25.414271 I | ceph-mgr: 2017-07-11 15:08:25.414232 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:25.414357 I | ceph-mgr: 2017-07-11 15:08:25.414343 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:25.414585 I | ceph-mgr: 2017-07-11 15:08:25.414570 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:27.416350 I | ceph-mgr: 2017-07-11 15:08:27.416298 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:27.416429 I | ceph-mgr: 2017-07-11 15:08:27.416415 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:27.416683 I | ceph-mgr: 2017-07-11 15:08:27.416668 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:29.418497 I | ceph-mgr: 2017-07-11 15:08:29.418428 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:29.418661 I | ceph-mgr: 2017-07-11 15:08:29.418592 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:29.418936 I | ceph-mgr: 2017-07-11 15:08:29.418920 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:31.425329 I | ceph-mgr: 2017-07-11 15:08:31.425295 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:31.425403 I | ceph-mgr: 2017-07-11 15:08:31.425390 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:31.425584 I | ceph-mgr: 2017-07-11 15:08:31.425567 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:33.437352 I | ceph-mgr: 2017-07-11 15:08:33.437313 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:33.437432 I | ceph-mgr: 2017-07-11 15:08:33.437418 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:33.437684 I | ceph-mgr: 2017-07-11 15:08:33.437668 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:35.563069 I | ceph-mgr: 2017-07-11 15:08:35.563023 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:35.563146 I | ceph-mgr: 2017-07-11 15:08:35.563132 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:35.563364 I | ceph-mgr: 2017-07-11 15:08:35.563246 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:37.565222 I | ceph-mgr: 2017-07-11 15:08:37.565140 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:37.565348 I | ceph-mgr: 2017-07-11 15:08:37.565329 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:37.565638 I | ceph-mgr: 2017-07-11 15:08:37.565620 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:39.567758 I | ceph-mgr: 2017-07-11 15:08:39.567682 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:39.568074 I | ceph-mgr: 2017-07-11 15:08:39.568038 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:39.568313 I | ceph-mgr: 2017-07-11 15:08:39.568298 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:41.570085 I | ceph-mgr: 2017-07-11 15:08:41.570037 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:41.570169 I | ceph-mgr: 2017-07-11 15:08:41.570155 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:41.570421 I | ceph-mgr: 2017-07-11 15:08:41.570405 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:43.572352 I | ceph-mgr: 2017-07-11 15:08:43.572315 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:43.572390 I | ceph-mgr: 2017-07-11 15:08:43.572377 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:43.572504 I | ceph-mgr: 2017-07-11 15:08:43.572488 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:45.574326 I | ceph-mgr: 2017-07-11 15:08:45.574252 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:45.574602 I | ceph-mgr: 2017-07-11 15:08:45.574439 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:45.575075 I | ceph-mgr: 2017-07-11 15:08:45.575056 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:47.576948 I | ceph-mgr: 2017-07-11 15:08:47.576874 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:47.577045 I | ceph-mgr: 2017-07-11 15:08:47.577026 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:47.577675 I | ceph-mgr: 2017-07-11 15:08:47.577651 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:49.580164 I | ceph-mgr: 2017-07-11 15:08:49.580055 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:49.580281 I | ceph-mgr: 2017-07-11 15:08:49.580261 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:49.580939 I | ceph-mgr: 2017-07-11 15:08:49.580913 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:51.583480 I | ceph-mgr: 2017-07-11 15:08:51.583422 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:51.583576 I | ceph-mgr: 2017-07-11 15:08:51.583559 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:51.584103 I | ceph-mgr: 2017-07-11 15:08:51.584081 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:53.586364 I | ceph-mgr: 2017-07-11 15:08:53.586297 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:53.586467 I | ceph-mgr: 2017-07-11 15:08:53.586450 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:53.586724 I | ceph-mgr: 2017-07-11 15:08:53.586706 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:55.595372 I | ceph-mgr: 2017-07-11 15:08:55.592287 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:55.602008 I | ceph-mgr: 2017-07-11 15:08:55.601986 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:55.611665 I | ceph-mgr: 2017-07-11 15:08:55.611641 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:57.621458 I | ceph-mgr: 2017-07-11 15:08:57.621396 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:57.621561 I | ceph-mgr: 2017-07-11 15:08:57.621546 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:57.621814 I | ceph-mgr: 2017-07-11 15:08:57.621798 7f4cc3226700 0 mgr tick
- 2017-07-11 15:08:59.623720 I | ceph-mgr: 2017-07-11 15:08:59.623668 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:08:59.623805 I | ceph-mgr: 2017-07-11 15:08:59.623789 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:08:59.624070 I | ceph-mgr: 2017-07-11 15:08:59.624048 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:01.625971 I | ceph-mgr: 2017-07-11 15:09:01.625922 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:01.626055 I | ceph-mgr: 2017-07-11 15:09:01.626040 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:01.626318 I | ceph-mgr: 2017-07-11 15:09:01.626302 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:03.628071 I | ceph-mgr: 2017-07-11 15:09:03.628006 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:03.628330 I | ceph-mgr: 2017-07-11 15:09:03.628183 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:03.628554 I | ceph-mgr: 2017-07-11 15:09:03.628538 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:05.631750 I | ceph-mgr: 2017-07-11 15:09:05.631713 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:05.633196 I | ceph-mgr: 2017-07-11 15:09:05.633171 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:05.633596 I | ceph-mgr: 2017-07-11 15:09:05.633580 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:07.642906 I | ceph-mgr: 2017-07-11 15:09:07.640848 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:07.643383 I | ceph-mgr: 2017-07-11 15:09:07.640862 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:07.643429 I | ceph-mgr: 2017-07-11 15:09:07.640893 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:09.642356 I | ceph-mgr: 2017-07-11 15:09:09.642322 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:09.642425 I | ceph-mgr: 2017-07-11 15:09:09.642411 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:09.642651 I | ceph-mgr: 2017-07-11 15:09:09.642489 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:11.644209 I | ceph-mgr: 2017-07-11 15:09:11.644156 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:11.644249 I | ceph-mgr: 2017-07-11 15:09:11.644236 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:11.644400 I | ceph-mgr: 2017-07-11 15:09:11.644384 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:13.646249 I | ceph-mgr: 2017-07-11 15:09:13.646203 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:13.646327 I | ceph-mgr: 2017-07-11 15:09:13.646311 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:13.646597 I | ceph-mgr: 2017-07-11 15:09:13.646582 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:15.648390 I | ceph-mgr: 2017-07-11 15:09:15.648353 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:15.648479 I | ceph-mgr: 2017-07-11 15:09:15.648464 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:15.648706 I | ceph-mgr: 2017-07-11 15:09:15.648689 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:17.650640 I | ceph-mgr: 2017-07-11 15:09:17.650592 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:17.650680 I | ceph-mgr: 2017-07-11 15:09:17.650667 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:17.650802 I | ceph-mgr: 2017-07-11 15:09:17.650787 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:19.663547 I | ceph-mgr: 2017-07-11 15:09:19.663502 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:19.663633 I | ceph-mgr: 2017-07-11 15:09:19.663618 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:19.663897 I | ceph-mgr: 2017-07-11 15:09:19.663881 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:21.680910 I | ceph-mgr: 2017-07-11 15:09:21.680868 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:21.680946 I | ceph-mgr: 2017-07-11 15:09:21.680934 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:21.681061 I | ceph-mgr: 2017-07-11 15:09:21.681047 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:23.682872 I | ceph-mgr: 2017-07-11 15:09:23.682799 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:23.683145 I | ceph-mgr: 2017-07-11 15:09:23.682991 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:23.683570 I | ceph-mgr: 2017-07-11 15:09:23.683551 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:25.685376 I | ceph-mgr: 2017-07-11 15:09:25.685298 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:25.685651 I | ceph-mgr: 2017-07-11 15:09:25.685501 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:25.685947 I | ceph-mgr: 2017-07-11 15:09:25.685930 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:27.687722 I | ceph-mgr: 2017-07-11 15:09:27.687669 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:27.687846 I | ceph-mgr: 2017-07-11 15:09:27.687832 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:27.688100 I | ceph-mgr: 2017-07-11 15:09:27.688084 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:29.690004 I | ceph-mgr: 2017-07-11 15:09:29.689939 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:29.690080 I | ceph-mgr: 2017-07-11 15:09:29.690066 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:29.690336 I | ceph-mgr: 2017-07-11 15:09:29.690321 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:31.692047 I | ceph-mgr: 2017-07-11 15:09:31.691997 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:31.692125 I | ceph-mgr: 2017-07-11 15:09:31.692110 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:31.692376 I | ceph-mgr: 2017-07-11 15:09:31.692360 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:33.694504 I | ceph-mgr: 2017-07-11 15:09:33.694461 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:33.694610 I | ceph-mgr: 2017-07-11 15:09:33.694594 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:33.694905 I | ceph-mgr: 2017-07-11 15:09:33.694889 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:35.696676 I | ceph-mgr: 2017-07-11 15:09:35.696637 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:35.696719 I | ceph-mgr: 2017-07-11 15:09:35.696703 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:35.696819 I | ceph-mgr: 2017-07-11 15:09:35.696804 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:37.701369 I | ceph-mgr: 2017-07-11 15:09:37.698657 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:37.701441 I | ceph-mgr: 2017-07-11 15:09:37.698669 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:37.701463 I | ceph-mgr: 2017-07-11 15:09:37.698696 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:39.726929 I | ceph-mgr: 2017-07-11 15:09:39.707643 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:39.737252 I | ceph-mgr: 2017-07-11 15:09:39.707662 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:39.737292 I | ceph-mgr: 2017-07-11 15:09:39.707710 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:41.747952 I | ceph-mgr: 2017-07-11 15:09:41.747890 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:41.748031 I | ceph-mgr: 2017-07-11 15:09:41.748017 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:41.748309 I | ceph-mgr: 2017-07-11 15:09:41.748292 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:43.750235 I | ceph-mgr: 2017-07-11 15:09:43.750146 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:43.750329 I | ceph-mgr: 2017-07-11 15:09:43.750314 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:43.750621 I | ceph-mgr: 2017-07-11 15:09:43.750605 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:45.752476 I | ceph-mgr: 2017-07-11 15:09:45.752431 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:45.752521 I | ceph-mgr: 2017-07-11 15:09:45.752507 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:45.752636 I | ceph-mgr: 2017-07-11 15:09:45.752619 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:47.756804 I | ceph-mgr: 2017-07-11 15:09:47.756751 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:47.756913 I | ceph-mgr: 2017-07-11 15:09:47.756894 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:47.757478 I | ceph-mgr: 2017-07-11 15:09:47.757457 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:49.759693 I | ceph-mgr: 2017-07-11 15:09:49.759635 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:49.759789 I | ceph-mgr: 2017-07-11 15:09:49.759772 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:49.760255 I | ceph-mgr: 2017-07-11 15:09:49.760234 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:51.762311 I | ceph-mgr: 2017-07-11 15:09:51.762270 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:51.762477 I | ceph-mgr: 2017-07-11 15:09:51.762399 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:51.762881 I | ceph-mgr: 2017-07-11 15:09:51.762862 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:53.765037 I | ceph-mgr: 2017-07-11 15:09:53.764973 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:53.765134 I | ceph-mgr: 2017-07-11 15:09:53.765116 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:53.765656 I | ceph-mgr: 2017-07-11 15:09:53.765633 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:55.767975 I | ceph-mgr: 2017-07-11 15:09:55.767906 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:55.768143 I | ceph-mgr: 2017-07-11 15:09:55.768055 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:55.768397 I | ceph-mgr: 2017-07-11 15:09:55.768382 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:57.770309 I | ceph-mgr: 2017-07-11 15:09:57.770228 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:57.770598 I | ceph-mgr: 2017-07-11 15:09:57.770435 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:57.771104 I | ceph-mgr: 2017-07-11 15:09:57.771088 7f4cc3226700 0 mgr tick
- 2017-07-11 15:09:59.774116 I | ceph-mgr: 2017-07-11 15:09:59.772612 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:09:59.774132 I | ceph-mgr: 2017-07-11 15:09:59.772644 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:09:59.774135 I | ceph-mgr: 2017-07-11 15:09:59.772690 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:01.774095 I | ceph-mgr: 2017-07-11 15:10:01.774020 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:01.774297 I | ceph-mgr: 2017-07-11 15:10:01.774204 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:01.774548 I | ceph-mgr: 2017-07-11 15:10:01.774531 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:03.776416 I | ceph-mgr: 2017-07-11 15:10:03.776348 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:03.776675 I | ceph-mgr: 2017-07-11 15:10:03.776529 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:03.776924 I | ceph-mgr: 2017-07-11 15:10:03.776905 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:05.778740 I | ceph-mgr: 2017-07-11 15:10:05.778692 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:05.778785 I | ceph-mgr: 2017-07-11 15:10:05.778770 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:05.778931 I | ceph-mgr: 2017-07-11 15:10:05.778901 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:07.781190 I | ceph-mgr: 2017-07-11 15:10:07.781106 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:07.781293 I | ceph-mgr: 2017-07-11 15:10:07.781275 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:07.781906 I | ceph-mgr: 2017-07-11 15:10:07.781882 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:09.785868 I | ceph-mgr: 2017-07-11 15:10:09.785816 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:09.785960 I | ceph-mgr: 2017-07-11 15:10:09.785945 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:09.786236 I | ceph-mgr: 2017-07-11 15:10:09.786220 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:11.803399 I | ceph-mgr: 2017-07-11 15:10:11.803322 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:11.803666 I | ceph-mgr: 2017-07-11 15:10:11.803520 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:11.804093 I | ceph-mgr: 2017-07-11 15:10:11.804077 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:13.805587 I | ceph-mgr: 2017-07-11 15:10:13.805532 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:13.805632 I | ceph-mgr: 2017-07-11 15:10:13.805616 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:13.805791 I | ceph-mgr: 2017-07-11 15:10:13.805756 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:15.807711 I | ceph-mgr: 2017-07-11 15:10:15.807635 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:15.807985 I | ceph-mgr: 2017-07-11 15:10:15.807822 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:15.808437 I | ceph-mgr: 2017-07-11 15:10:15.808419 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:17.815865 I | ceph-mgr: 2017-07-11 15:10:17.815776 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:17.816158 I | ceph-mgr: 2017-07-11 15:10:17.815988 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:17.816692 I | ceph-mgr: 2017-07-11 15:10:17.816671 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:19.823574 I | ceph-mgr: 2017-07-11 15:10:19.823487 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:19.835530 I | ceph-mgr: 2017-07-11 15:10:19.835505 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:19.836092 I | ceph-mgr: 2017-07-11 15:10:19.836070 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:21.844717 I | ceph-mgr: 2017-07-11 15:10:21.844679 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:21.844795 I | ceph-mgr: 2017-07-11 15:10:21.844780 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:21.844869 I | ceph-mgr: 2017-07-11 15:10:21.844859 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:23.846534 I | ceph-mgr: 2017-07-11 15:10:23.846459 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:23.846744 I | ceph-mgr: 2017-07-11 15:10:23.846641 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:23.846982 I | ceph-mgr: 2017-07-11 15:10:23.846812 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:25.849984 I | ceph-mgr: 2017-07-11 15:10:25.848681 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:25.850051 I | ceph-mgr: 2017-07-11 15:10:25.848694 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:25.850066 I | ceph-mgr: 2017-07-11 15:10:25.848725 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:27.850061 I | ceph-mgr: 2017-07-11 15:10:27.849995 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:27.850104 I | ceph-mgr: 2017-07-11 15:10:27.850090 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:27.850252 I | ceph-mgr: 2017-07-11 15:10:27.850237 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:29.852441 I | ceph-mgr: 2017-07-11 15:10:29.852394 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:29.852516 I | ceph-mgr: 2017-07-11 15:10:29.852503 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:29.852759 I | ceph-mgr: 2017-07-11 15:10:29.852744 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:31.854658 I | ceph-mgr: 2017-07-11 15:10:31.854621 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:31.854734 I | ceph-mgr: 2017-07-11 15:10:31.854720 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:31.854984 I | ceph-mgr: 2017-07-11 15:10:31.854966 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:33.857335 I | ceph-mgr: 2017-07-11 15:10:33.857265 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:33.857573 I | ceph-mgr: 2017-07-11 15:10:33.857441 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:33.857988 I | ceph-mgr: 2017-07-11 15:10:33.857971 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:35.859662 I | ceph-mgr: 2017-07-11 15:10:35.859601 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:35.859753 I | ceph-mgr: 2017-07-11 15:10:35.859738 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:35.860228 I | ceph-mgr: 2017-07-11 15:10:35.860212 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:37.861909 I | ceph-mgr: 2017-07-11 15:10:37.861868 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:37.861995 I | ceph-mgr: 2017-07-11 15:10:37.861978 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:37.862231 I | ceph-mgr: 2017-07-11 15:10:37.862214 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:39.864325 I | ceph-mgr: 2017-07-11 15:10:39.864269 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:39.864410 I | ceph-mgr: 2017-07-11 15:10:39.864396 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:39.864666 I | ceph-mgr: 2017-07-11 15:10:39.864651 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:41.870771 I | ceph-mgr: 2017-07-11 15:10:41.870737 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:41.870844 I | ceph-mgr: 2017-07-11 15:10:41.870829 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:41.871095 I | ceph-mgr: 2017-07-11 15:10:41.871079 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:43.875444 I | ceph-mgr: 2017-07-11 15:10:43.875393 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:43.875524 I | ceph-mgr: 2017-07-11 15:10:43.875510 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:43.875784 I | ceph-mgr: 2017-07-11 15:10:43.875768 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:45.877608 I | ceph-mgr: 2017-07-11 15:10:45.877558 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:45.877684 I | ceph-mgr: 2017-07-11 15:10:45.877668 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:45.878043 I | ceph-mgr: 2017-07-11 15:10:45.878026 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:47.879697 I | ceph-mgr: 2017-07-11 15:10:47.879650 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:47.879735 I | ceph-mgr: 2017-07-11 15:10:47.879722 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:47.879843 I | ceph-mgr: 2017-07-11 15:10:47.879828 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:49.887428 I | ceph-mgr: 2017-07-11 15:10:49.887376 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:49.887515 I | ceph-mgr: 2017-07-11 15:10:49.887499 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:49.887779 I | ceph-mgr: 2017-07-11 15:10:49.887762 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:51.898282 I | ceph-mgr: 2017-07-11 15:10:51.896566 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:51.898501 I | ceph-mgr: 2017-07-11 15:10:51.896573 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:51.898601 I | ceph-mgr: 2017-07-11 15:10:51.896602 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:53.899715 I | ceph-mgr: 2017-07-11 15:10:53.898260 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:53.899935 I | ceph-mgr: 2017-07-11 15:10:53.898271 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:53.900035 I | ceph-mgr: 2017-07-11 15:10:53.898303 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:55.900666 I | ceph-mgr: 2017-07-11 15:10:55.900592 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:55.900914 I | ceph-mgr: 2017-07-11 15:10:55.900785 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:55.901299 I | ceph-mgr: 2017-07-11 15:10:55.901283 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:57.902838 I | ceph-mgr: 2017-07-11 15:10:57.902775 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:57.902923 I | ceph-mgr: 2017-07-11 15:10:57.902908 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:57.903385 I | ceph-mgr: 2017-07-11 15:10:57.903368 7f4cc3226700 0 mgr tick
- 2017-07-11 15:10:59.904896 I | ceph-mgr: 2017-07-11 15:10:59.904848 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:10:59.904980 I | ceph-mgr: 2017-07-11 15:10:59.904966 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:10:59.905220 I | ceph-mgr: 2017-07-11 15:10:59.905204 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:01.907023 I | ceph-mgr: 2017-07-11 15:11:01.906988 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:01.907059 I | ceph-mgr: 2017-07-11 15:11:01.907045 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:01.907184 I | ceph-mgr: 2017-07-11 15:11:01.907170 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:03.909194 I | ceph-mgr: 2017-07-11 15:11:03.909146 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:03.909236 I | ceph-mgr: 2017-07-11 15:11:03.909223 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:03.909366 I | ceph-mgr: 2017-07-11 15:11:03.909351 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:05.913293 I | ceph-mgr: 2017-07-11 15:11:05.913226 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:05.913558 I | ceph-mgr: 2017-07-11 15:11:05.913530 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:05.914423 I | ceph-mgr: 2017-07-11 15:11:05.914406 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:07.925677 I | ceph-mgr: 2017-07-11 15:11:07.925635 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:07.925768 I | ceph-mgr: 2017-07-11 15:11:07.925752 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:07.926010 I | ceph-mgr: 2017-07-11 15:11:07.925991 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:09.928054 I | ceph-mgr: 2017-07-11 15:11:09.928003 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:09.928138 I | ceph-mgr: 2017-07-11 15:11:09.928123 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:09.928413 I | ceph-mgr: 2017-07-11 15:11:09.928397 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:11.930318 I | ceph-mgr: 2017-07-11 15:11:11.930267 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:11.930404 I | ceph-mgr: 2017-07-11 15:11:11.930390 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:11.930660 I | ceph-mgr: 2017-07-11 15:11:11.930643 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:13.936619 I | ceph-mgr: 2017-07-11 15:11:13.936538 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:13.937932 I | ceph-mgr: 2017-07-11 15:11:13.937912 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:13.938667 I | ceph-mgr: 2017-07-11 15:11:13.938649 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:15.940272 I | ceph-mgr: 2017-07-11 15:11:15.940236 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:15.940345 I | ceph-mgr: 2017-07-11 15:11:15.940330 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:15.940571 I | ceph-mgr: 2017-07-11 15:11:15.940554 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:17.942197 I | ceph-mgr: 2017-07-11 15:11:17.942152 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:17.942289 I | ceph-mgr: 2017-07-11 15:11:17.942272 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:17.942558 I | ceph-mgr: 2017-07-11 15:11:17.942539 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:19.944565 I | ceph-mgr: 2017-07-11 15:11:19.944516 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:19.944643 I | ceph-mgr: 2017-07-11 15:11:19.944629 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:19.944871 I | ceph-mgr: 2017-07-11 15:11:19.944856 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:21.952264 I | ceph-mgr: 2017-07-11 15:11:21.952193 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:21.952447 I | ceph-mgr: 2017-07-11 15:11:21.952378 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:21.952699 I | ceph-mgr: 2017-07-11 15:11:21.952683 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:23.957611 I | ceph-mgr: 2017-07-11 15:11:23.954449 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:23.957689 I | ceph-mgr: 2017-07-11 15:11:23.957673 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:23.957821 I | ceph-mgr: 2017-07-11 15:11:23.957806 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:25.959659 I | ceph-mgr: 2017-07-11 15:11:25.959608 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:25.959754 I | ceph-mgr: 2017-07-11 15:11:25.959730 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:25.959984 I | ceph-mgr: 2017-07-11 15:11:25.959969 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:27.961834 I | ceph-mgr: 2017-07-11 15:11:27.961772 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:27.961927 I | ceph-mgr: 2017-07-11 15:11:27.961912 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:27.962251 I | ceph-mgr: 2017-07-11 15:11:27.962235 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:29.964001 I | ceph-mgr: 2017-07-11 15:11:29.963947 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:29.964061 I | ceph-mgr: 2017-07-11 15:11:29.964047 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:29.964231 I | ceph-mgr: 2017-07-11 15:11:29.964213 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:31.966217 I | ceph-mgr: 2017-07-11 15:11:31.966168 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:31.966307 I | ceph-mgr: 2017-07-11 15:11:31.966292 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:31.966778 I | ceph-mgr: 2017-07-11 15:11:31.966759 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:33.968524 I | ceph-mgr: 2017-07-11 15:11:33.968434 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:33.968564 I | ceph-mgr: 2017-07-11 15:11:33.968551 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:33.968725 I | ceph-mgr: 2017-07-11 15:11:33.968697 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:35.970422 I | ceph-mgr: 2017-07-11 15:11:35.970387 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:35.970517 I | ceph-mgr: 2017-07-11 15:11:35.970502 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:35.970769 I | ceph-mgr: 2017-07-11 15:11:35.970752 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:37.979197 I | ceph-mgr: 2017-07-11 15:11:37.975503 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:37.979265 I | ceph-mgr: 2017-07-11 15:11:37.975509 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:37.979281 I | ceph-mgr: 2017-07-11 15:11:37.975530 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:39.976964 I | ceph-mgr: 2017-07-11 15:11:39.976907 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:39.977003 I | ceph-mgr: 2017-07-11 15:11:39.976989 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:39.977050 I | ceph-mgr: 2017-07-11 15:11:39.977041 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:41.978496 I | ceph-mgr: 2017-07-11 15:11:41.978416 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:41.978604 I | ceph-mgr: 2017-07-11 15:11:41.978590 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:41.978682 I | ceph-mgr: 2017-07-11 15:11:41.978672 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:43.980843 I | ceph-mgr: 2017-07-11 15:11:43.980793 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:43.980882 I | ceph-mgr: 2017-07-11 15:11:43.980869 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:43.981078 I | ceph-mgr: 2017-07-11 15:11:43.981052 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:45.982982 I | ceph-mgr: 2017-07-11 15:11:45.982937 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:45.983057 I | ceph-mgr: 2017-07-11 15:11:45.983043 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:45.983513 I | ceph-mgr: 2017-07-11 15:11:45.983495 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:47.985052 I | ceph-mgr: 2017-07-11 15:11:47.985011 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:47.985143 I | ceph-mgr: 2017-07-11 15:11:47.985128 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:47.985369 I | ceph-mgr: 2017-07-11 15:11:47.985354 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:49.993051 I | ceph-mgr: 2017-07-11 15:11:49.992996 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:49.993158 I | ceph-mgr: 2017-07-11 15:11:49.993143 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:49.993438 I | ceph-mgr: 2017-07-11 15:11:49.993422 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:51.995221 I | ceph-mgr: 2017-07-11 15:11:51.995181 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:51.995301 I | ceph-mgr: 2017-07-11 15:11:51.995286 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:51.995556 I | ceph-mgr: 2017-07-11 15:11:51.995539 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:53.997459 I | ceph-mgr: 2017-07-11 15:11:53.997377 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:53.997533 I | ceph-mgr: 2017-07-11 15:11:53.997505 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:53.997830 I | ceph-mgr: 2017-07-11 15:11:53.997784 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:55.999732 I | ceph-mgr: 2017-07-11 15:11:55.999692 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:55.999836 I | ceph-mgr: 2017-07-11 15:11:55.999819 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:56.000062 I | ceph-mgr: 2017-07-11 15:11:56.000047 7f4cc3226700 0 mgr tick
- 2017-07-11 15:11:58.001951 I | ceph-mgr: 2017-07-11 15:11:58.001861 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:11:58.002190 I | ceph-mgr: 2017-07-11 15:11:58.002070 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:11:58.002572 I | ceph-mgr: 2017-07-11 15:11:58.002556 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:00.004620 I | ceph-mgr: 2017-07-11 15:12:00.004568 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:00.004658 I | ceph-mgr: 2017-07-11 15:12:00.004645 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:00.004826 I | ceph-mgr: 2017-07-11 15:12:00.004796 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:02.006772 I | ceph-mgr: 2017-07-11 15:12:02.006724 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:02.006852 I | ceph-mgr: 2017-07-11 15:12:02.006837 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:02.007116 I | ceph-mgr: 2017-07-11 15:12:02.007101 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:04.008946 I | ceph-mgr: 2017-07-11 15:12:04.008889 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:04.008984 I | ceph-mgr: 2017-07-11 15:12:04.008972 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:04.009131 I | ceph-mgr: 2017-07-11 15:12:04.009108 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:06.010938 I | ceph-mgr: 2017-07-11 15:12:06.010873 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:06.011127 I | ceph-mgr: 2017-07-11 15:12:06.011060 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:06.011512 I | ceph-mgr: 2017-07-11 15:12:06.011291 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:08.013353 I | ceph-mgr: 2017-07-11 15:12:08.013284 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:08.016770 I | ceph-mgr: 2017-07-11 15:12:08.016750 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:08.017201 I | ceph-mgr: 2017-07-11 15:12:08.017183 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:10.036180 I | ceph-mgr: 2017-07-11 15:12:10.036129 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:10.037382 I | ceph-mgr: 2017-07-11 15:12:10.036347 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:10.037644 I | ceph-mgr: 2017-07-11 15:12:10.037627 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:12.039298 I | ceph-mgr: 2017-07-11 15:12:12.039251 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:12.039372 I | ceph-mgr: 2017-07-11 15:12:12.039358 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:12.039627 I | ceph-mgr: 2017-07-11 15:12:12.039611 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:14.041501 I | ceph-mgr: 2017-07-11 15:12:14.041421 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:14.041587 I | ceph-mgr: 2017-07-11 15:12:14.041541 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:14.041751 I | ceph-mgr: 2017-07-11 15:12:14.041734 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:16.043696 I | ceph-mgr: 2017-07-11 15:12:16.043631 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:16.043939 I | ceph-mgr: 2017-07-11 15:12:16.043811 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:16.044351 I | ceph-mgr: 2017-07-11 15:12:16.044331 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:18.046140 I | ceph-mgr: 2017-07-11 15:12:18.046094 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:18.046231 I | ceph-mgr: 2017-07-11 15:12:18.046215 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:18.046481 I | ceph-mgr: 2017-07-11 15:12:18.046462 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:20.048511 I | ceph-mgr: 2017-07-11 15:12:20.048455 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:20.048607 I | ceph-mgr: 2017-07-11 15:12:20.048592 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:20.049110 I | ceph-mgr: 2017-07-11 15:12:20.049091 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:22.050715 I | ceph-mgr: 2017-07-11 15:12:22.050675 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:22.050794 I | ceph-mgr: 2017-07-11 15:12:22.050780 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:22.051043 I | ceph-mgr: 2017-07-11 15:12:22.051026 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:24.052813 I | ceph-mgr: 2017-07-11 15:12:24.052713 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:24.052902 I | ceph-mgr: 2017-07-11 15:12:24.052889 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:24.053153 I | ceph-mgr: 2017-07-11 15:12:24.053137 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:26.055143 I | ceph-mgr: 2017-07-11 15:12:26.055104 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:26.055232 I | ceph-mgr: 2017-07-11 15:12:26.055218 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:26.055674 I | ceph-mgr: 2017-07-11 15:12:26.055656 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:28.057436 I | ceph-mgr: 2017-07-11 15:12:28.057384 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:28.057516 I | ceph-mgr: 2017-07-11 15:12:28.057502 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:28.057758 I | ceph-mgr: 2017-07-11 15:12:28.057743 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:30.059810 I | ceph-mgr: 2017-07-11 15:12:30.059749 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:30.060129 I | ceph-mgr: 2017-07-11 15:12:30.060112 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:30.061183 I | ceph-mgr: 2017-07-11 15:12:30.061166 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:32.064974 I | ceph-mgr: 2017-07-11 15:12:32.063175 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:32.064996 I | ceph-mgr: 2017-07-11 15:12:32.063192 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:32.065001 I | ceph-mgr: 2017-07-11 15:12:32.063240 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:34.065007 I | ceph-mgr: 2017-07-11 15:12:34.064956 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:34.065094 I | ceph-mgr: 2017-07-11 15:12:34.065080 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:34.065173 I | ceph-mgr: 2017-07-11 15:12:34.065162 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:36.066992 I | ceph-mgr: 2017-07-11 15:12:36.066955 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:36.067078 I | ceph-mgr: 2017-07-11 15:12:36.067063 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:36.067316 I | ceph-mgr: 2017-07-11 15:12:36.067149 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:38.069364 I | ceph-mgr: 2017-07-11 15:12:38.069294 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:38.069631 I | ceph-mgr: 2017-07-11 15:12:38.069482 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:38.069894 I | ceph-mgr: 2017-07-11 15:12:38.069879 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:40.071910 I | ceph-mgr: 2017-07-11 15:12:40.071860 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:40.071989 I | ceph-mgr: 2017-07-11 15:12:40.071975 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:40.072246 I | ceph-mgr: 2017-07-11 15:12:40.072229 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:42.076550 I | ceph-mgr: 2017-07-11 15:12:42.075024 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:42.076612 I | ceph-mgr: 2017-07-11 15:12:42.075037 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:42.076628 I | ceph-mgr: 2017-07-11 15:12:42.075068 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:44.076627 I | ceph-mgr: 2017-07-11 15:12:44.076576 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:44.076706 I | ceph-mgr: 2017-07-11 15:12:44.076692 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:44.076781 I | ceph-mgr: 2017-07-11 15:12:44.076771 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:46.078494 I | ceph-mgr: 2017-07-11 15:12:46.078425 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:46.078766 I | ceph-mgr: 2017-07-11 15:12:46.078609 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:46.078869 I | ceph-mgr: 2017-07-11 15:12:46.078858 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:48.083292 I | ceph-mgr: 2017-07-11 15:12:48.083213 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:48.083472 I | ceph-mgr: 2017-07-11 15:12:48.083403 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:48.083718 I | ceph-mgr: 2017-07-11 15:12:48.083701 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:50.085917 I | ceph-mgr: 2017-07-11 15:12:50.085862 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:50.086002 I | ceph-mgr: 2017-07-11 15:12:50.085987 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:50.086271 I | ceph-mgr: 2017-07-11 15:12:50.086252 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:52.106165 I | ceph-mgr: 2017-07-11 15:12:52.090041 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:52.106217 I | ceph-mgr: 2017-07-11 15:12:52.090050 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:52.106232 I | ceph-mgr: 2017-07-11 15:12:52.090075 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:54.107477 I | ceph-mgr: 2017-07-11 15:12:54.107430 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:54.107558 I | ceph-mgr: 2017-07-11 15:12:54.107544 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:54.107795 I | ceph-mgr: 2017-07-11 15:12:54.107780 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:56.109835 I | ceph-mgr: 2017-07-11 15:12:56.109771 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:56.109918 I | ceph-mgr: 2017-07-11 15:12:56.109880 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:56.110030 I | ceph-mgr: 2017-07-11 15:12:56.110004 7f4cc3226700 0 mgr tick
- 2017-07-11 15:12:58.112155 I | ceph-mgr: 2017-07-11 15:12:58.112075 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:12:58.112366 I | ceph-mgr: 2017-07-11 15:12:58.112280 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:12:58.112757 I | ceph-mgr: 2017-07-11 15:12:58.112741 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:00.114558 I | ceph-mgr: 2017-07-11 15:13:00.114508 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:00.114599 I | ceph-mgr: 2017-07-11 15:13:00.114586 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:00.114719 I | ceph-mgr: 2017-07-11 15:13:00.114704 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:02.118347 I | ceph-mgr: 2017-07-11 15:13:02.116692 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:02.118425 I | ceph-mgr: 2017-07-11 15:13:02.116700 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:02.118442 I | ceph-mgr: 2017-07-11 15:13:02.116737 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:04.120049 I | ceph-mgr: 2017-07-11 15:13:04.118408 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:04.120065 I | ceph-mgr: 2017-07-11 15:13:04.118426 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:04.120068 I | ceph-mgr: 2017-07-11 15:13:04.118474 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:06.120192 I | ceph-mgr: 2017-07-11 15:13:06.120132 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:06.120435 I | ceph-mgr: 2017-07-11 15:13:06.120293 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:06.120608 I | ceph-mgr: 2017-07-11 15:13:06.120596 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:08.122416 I | ceph-mgr: 2017-07-11 15:13:08.122375 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:08.122497 I | ceph-mgr: 2017-07-11 15:13:08.122482 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:08.122738 I | ceph-mgr: 2017-07-11 15:13:08.122565 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:10.125079 I | ceph-mgr: 2017-07-11 15:13:10.125001 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:10.125308 I | ceph-mgr: 2017-07-11 15:13:10.125190 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:10.125867 I | ceph-mgr: 2017-07-11 15:13:10.125849 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:12.132540 I | ceph-mgr: 2017-07-11 15:13:12.132502 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:12.135134 I | ceph-mgr: 2017-07-11 15:13:12.135118 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:12.135453 I | ceph-mgr: 2017-07-11 15:13:12.135437 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:14.157478 I | ceph-mgr: 2017-07-11 15:13:14.157432 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:14.157699 I | ceph-mgr: 2017-07-11 15:13:14.157683 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:14.158223 I | ceph-mgr: 2017-07-11 15:13:14.158207 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:16.168755 I | ceph-mgr: 2017-07-11 15:13:16.168697 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:16.168863 I | ceph-mgr: 2017-07-11 15:13:16.168847 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:16.169094 I | ceph-mgr: 2017-07-11 15:13:16.169077 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:18.171365 I | ceph-mgr: 2017-07-11 15:13:18.171293 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:18.171484 I | ceph-mgr: 2017-07-11 15:13:18.171466 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:18.171772 I | ceph-mgr: 2017-07-11 15:13:18.171752 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:20.174383 I | ceph-mgr: 2017-07-11 15:13:20.174304 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:20.174611 I | ceph-mgr: 2017-07-11 15:13:20.174496 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:20.174874 I | ceph-mgr: 2017-07-11 15:13:20.174859 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:22.176869 I | ceph-mgr: 2017-07-11 15:13:22.176797 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:22.177097 I | ceph-mgr: 2017-07-11 15:13:22.176980 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:22.177376 I | ceph-mgr: 2017-07-11 15:13:22.177360 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:24.179497 I | ceph-mgr: 2017-07-11 15:13:24.179445 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:24.179539 I | ceph-mgr: 2017-07-11 15:13:24.179525 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:24.179686 I | ceph-mgr: 2017-07-11 15:13:24.179660 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:26.188110 I | ceph-mgr: 2017-07-11 15:13:26.188048 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:26.188212 I | ceph-mgr: 2017-07-11 15:13:26.188197 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:26.188525 I | ceph-mgr: 2017-07-11 15:13:26.188510 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:28.190548 I | ceph-mgr: 2017-07-11 15:13:28.190469 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:28.190764 I | ceph-mgr: 2017-07-11 15:13:28.190671 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:28.190983 I | ceph-mgr: 2017-07-11 15:13:28.190960 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:30.193138 I | ceph-mgr: 2017-07-11 15:13:30.193092 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:30.193207 I | ceph-mgr: 2017-07-11 15:13:30.193193 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:30.193442 I | ceph-mgr: 2017-07-11 15:13:30.193426 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:32.195421 I | ceph-mgr: 2017-07-11 15:13:32.195376 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:32.195462 I | ceph-mgr: 2017-07-11 15:13:32.195448 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:32.195584 I | ceph-mgr: 2017-07-11 15:13:32.195568 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:34.197681 I | ceph-mgr: 2017-07-11 15:13:34.197629 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:34.197768 I | ceph-mgr: 2017-07-11 15:13:34.197753 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:34.198217 I | ceph-mgr: 2017-07-11 15:13:34.198199 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:36.200228 I | ceph-mgr: 2017-07-11 15:13:36.200192 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:36.200316 I | ceph-mgr: 2017-07-11 15:13:36.200302 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:36.200657 I | ceph-mgr: 2017-07-11 15:13:36.200640 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:38.202512 I | ceph-mgr: 2017-07-11 15:13:38.202468 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:38.202565 I | ceph-mgr: 2017-07-11 15:13:38.202550 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:38.202679 I | ceph-mgr: 2017-07-11 15:13:38.202664 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:40.204679 I | ceph-mgr: 2017-07-11 15:13:40.204601 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:40.204959 I | ceph-mgr: 2017-07-11 15:13:40.204799 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:40.205446 I | ceph-mgr: 2017-07-11 15:13:40.205430 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:42.207265 I | ceph-mgr: 2017-07-11 15:13:42.207213 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:42.207338 I | ceph-mgr: 2017-07-11 15:13:42.207315 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:42.207475 I | ceph-mgr: 2017-07-11 15:13:42.207459 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:44.209455 I | ceph-mgr: 2017-07-11 15:13:44.209391 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:44.209546 I | ceph-mgr: 2017-07-11 15:13:44.209531 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:44.210045 I | ceph-mgr: 2017-07-11 15:13:44.210027 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:46.211975 I | ceph-mgr: 2017-07-11 15:13:46.211935 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:46.212066 I | ceph-mgr: 2017-07-11 15:13:46.212051 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:46.212315 I | ceph-mgr: 2017-07-11 15:13:46.212299 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:48.218925 I | ceph-mgr: 2017-07-11 15:13:48.218886 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:48.219423 I | ceph-mgr: 2017-07-11 15:13:48.219389 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:48.219646 I | ceph-mgr: 2017-07-11 15:13:48.219630 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:50.228729 I | ceph-mgr: 2017-07-11 15:13:50.228654 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:50.228980 I | ceph-mgr: 2017-07-11 15:13:50.228833 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:50.229227 I | ceph-mgr: 2017-07-11 15:13:50.229211 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:52.231186 I | ceph-mgr: 2017-07-11 15:13:52.231131 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:52.231236 I | ceph-mgr: 2017-07-11 15:13:52.231220 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:52.231408 I | ceph-mgr: 2017-07-11 15:13:52.231389 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:54.234120 I | ceph-mgr: 2017-07-11 15:13:54.234067 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:54.234171 I | ceph-mgr: 2017-07-11 15:13:54.234157 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:54.234323 I | ceph-mgr: 2017-07-11 15:13:54.234293 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:56.236480 I | ceph-mgr: 2017-07-11 15:13:56.236444 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:56.236552 I | ceph-mgr: 2017-07-11 15:13:56.236538 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:56.236780 I | ceph-mgr: 2017-07-11 15:13:56.236765 7f4cc3226700 0 mgr tick
- 2017-07-11 15:13:58.253380 I | ceph-mgr: 2017-07-11 15:13:58.243789 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:13:58.253464 I | ceph-mgr: 2017-07-11 15:13:58.253447 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:13:58.256539 I | ceph-mgr: 2017-07-11 15:13:58.256523 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:00.303113 I | ceph-mgr: 2017-07-11 15:14:00.303073 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:00.303193 I | ceph-mgr: 2017-07-11 15:14:00.303180 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:00.303421 I | ceph-mgr: 2017-07-11 15:14:00.303406 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:02.305177 I | ceph-mgr: 2017-07-11 15:14:02.305127 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:02.305265 I | ceph-mgr: 2017-07-11 15:14:02.305251 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:02.305521 I | ceph-mgr: 2017-07-11 15:14:02.305506 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:04.307532 I | ceph-mgr: 2017-07-11 15:14:04.307488 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:04.307617 I | ceph-mgr: 2017-07-11 15:14:04.307603 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:04.307870 I | ceph-mgr: 2017-07-11 15:14:04.307855 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:06.310167 I | ceph-mgr: 2017-07-11 15:14:06.310059 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:06.310207 I | ceph-mgr: 2017-07-11 15:14:06.310192 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:06.310464 I | ceph-mgr: 2017-07-11 15:14:06.310443 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:08.314374 I | ceph-mgr: 2017-07-11 15:14:08.314340 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:08.314447 I | ceph-mgr: 2017-07-11 15:14:08.314433 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:08.314678 I | ceph-mgr: 2017-07-11 15:14:08.314663 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:10.332111 I | ceph-mgr: 2017-07-11 15:14:10.332036 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:10.332347 I | ceph-mgr: 2017-07-11 15:14:10.332233 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:10.332567 I | ceph-mgr: 2017-07-11 15:14:10.332540 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:12.334304 I | ceph-mgr: 2017-07-11 15:14:12.334230 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:12.334545 I | ceph-mgr: 2017-07-11 15:14:12.334499 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:12.334902 I | ceph-mgr: 2017-07-11 15:14:12.334885 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:14.336742 I | ceph-mgr: 2017-07-11 15:14:14.336693 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:14.336814 I | ceph-mgr: 2017-07-11 15:14:14.336800 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:14.337055 I | ceph-mgr: 2017-07-11 15:14:14.337041 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:16.339045 I | ceph-mgr: 2017-07-11 15:14:16.338998 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:16.339120 I | ceph-mgr: 2017-07-11 15:14:16.339107 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:16.339366 I | ceph-mgr: 2017-07-11 15:14:16.339349 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:18.341339 I | ceph-mgr: 2017-07-11 15:14:18.341301 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:18.341414 I | ceph-mgr: 2017-07-11 15:14:18.341399 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:18.341830 I | ceph-mgr: 2017-07-11 15:14:18.341572 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:20.345097 I | ceph-mgr: 2017-07-11 15:14:20.345057 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:20.345272 I | ceph-mgr: 2017-07-11 15:14:20.345256 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:20.348139 I | ceph-mgr: 2017-07-11 15:14:20.348122 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:22.365647 I | ceph-mgr: 2017-07-11 15:14:22.365570 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:22.365890 I | ceph-mgr: 2017-07-11 15:14:22.365760 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:22.366373 I | ceph-mgr: 2017-07-11 15:14:22.366356 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:24.368367 I | ceph-mgr: 2017-07-11 15:14:24.368291 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:24.368468 I | ceph-mgr: 2017-07-11 15:14:24.368454 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:24.368713 I | ceph-mgr: 2017-07-11 15:14:24.368698 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:26.370781 I | ceph-mgr: 2017-07-11 15:14:26.370736 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:26.370857 I | ceph-mgr: 2017-07-11 15:14:26.370843 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:26.371095 I | ceph-mgr: 2017-07-11 15:14:26.371079 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:28.375128 I | ceph-mgr: 2017-07-11 15:14:28.375092 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:28.375278 I | ceph-mgr: 2017-07-11 15:14:28.375263 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:28.390653 I | ceph-mgr: 2017-07-11 15:14:28.390632 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:30.392456 I | ceph-mgr: 2017-07-11 15:14:30.392390 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:30.392529 I | ceph-mgr: 2017-07-11 15:14:30.392501 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:30.392762 I | ceph-mgr: 2017-07-11 15:14:30.392731 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:32.396259 I | ceph-mgr: 2017-07-11 15:14:32.394666 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:32.396476 I | ceph-mgr: 2017-07-11 15:14:32.394679 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:32.396515 I | ceph-mgr: 2017-07-11 15:14:32.394712 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:34.396332 I | ceph-mgr: 2017-07-11 15:14:34.396259 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:34.396588 I | ceph-mgr: 2017-07-11 15:14:34.396439 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:34.397034 I | ceph-mgr: 2017-07-11 15:14:34.397016 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:36.398947 I | ceph-mgr: 2017-07-11 15:14:36.398881 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:36.399164 I | ceph-mgr: 2017-07-11 15:14:36.399060 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:36.399563 I | ceph-mgr: 2017-07-11 15:14:36.399542 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:38.401888 I | ceph-mgr: 2017-07-11 15:14:38.401838 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:38.401995 I | ceph-mgr: 2017-07-11 15:14:38.401976 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:38.402543 I | ceph-mgr: 2017-07-11 15:14:38.402520 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:40.411720 I | ceph-mgr: 2017-07-11 15:14:40.411606 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:40.424747 I | ceph-mgr: 2017-07-11 15:14:40.420715 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:40.424782 I | ceph-mgr: 2017-07-11 15:14:40.420846 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:42.430256 I | ceph-mgr: 2017-07-11 15:14:42.428695 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:42.430467 I | ceph-mgr: 2017-07-11 15:14:42.428701 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:42.430494 I | ceph-mgr: 2017-07-11 15:14:42.428722 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:44.430294 I | ceph-mgr: 2017-07-11 15:14:44.430214 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:44.430366 I | ceph-mgr: 2017-07-11 15:14:44.430227 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:44.430602 I | ceph-mgr: 2017-07-11 15:14:44.430572 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:46.432475 I | ceph-mgr: 2017-07-11 15:14:46.432432 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:46.432558 I | ceph-mgr: 2017-07-11 15:14:46.432541 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:46.432806 I | ceph-mgr: 2017-07-11 15:14:46.432788 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:48.435200 I | ceph-mgr: 2017-07-11 15:14:48.435135 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:48.435271 I | ceph-mgr: 2017-07-11 15:14:48.435243 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:48.435511 I | ceph-mgr: 2017-07-11 15:14:48.435473 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:50.437522 I | ceph-mgr: 2017-07-11 15:14:50.437473 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:50.437604 I | ceph-mgr: 2017-07-11 15:14:50.437565 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:50.437742 I | ceph-mgr: 2017-07-11 15:14:50.437728 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:52.442296 I | ceph-mgr: 2017-07-11 15:14:52.440710 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:52.449498 I | ceph-mgr: 2017-07-11 15:14:52.440714 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:52.449532 I | ceph-mgr: 2017-07-11 15:14:52.440734 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:54.442254 I | ceph-mgr: 2017-07-11 15:14:54.442207 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:54.442327 I | ceph-mgr: 2017-07-11 15:14:54.442313 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:54.442569 I | ceph-mgr: 2017-07-11 15:14:54.442554 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:56.444584 I | ceph-mgr: 2017-07-11 15:14:56.444515 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:56.444785 I | ceph-mgr: 2017-07-11 15:14:56.444696 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:56.445011 I | ceph-mgr: 2017-07-11 15:14:56.444996 7f4cc3226700 0 mgr tick
- 2017-07-11 15:14:58.446840 I | ceph-mgr: 2017-07-11 15:14:58.446796 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:14:58.446926 I | ceph-mgr: 2017-07-11 15:14:58.446911 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:14:58.447142 I | ceph-mgr: 2017-07-11 15:14:58.447125 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:00.451743 I | ceph-mgr: 2017-07-11 15:15:00.451711 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:00.451820 I | ceph-mgr: 2017-07-11 15:15:00.451806 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:00.452228 I | ceph-mgr: 2017-07-11 15:15:00.452211 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:02.461952 I | ceph-mgr: 2017-07-11 15:15:02.461884 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:02.462033 I | ceph-mgr: 2017-07-11 15:15:02.462018 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:02.462268 I | ceph-mgr: 2017-07-11 15:15:02.462253 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:04.464015 I | ceph-mgr: 2017-07-11 15:15:04.463959 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:04.464109 I | ceph-mgr: 2017-07-11 15:15:04.464095 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:04.464329 I | ceph-mgr: 2017-07-11 15:15:04.464313 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:06.466341 I | ceph-mgr: 2017-07-11 15:15:06.466261 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:06.466419 I | ceph-mgr: 2017-07-11 15:15:06.466391 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:06.466640 I | ceph-mgr: 2017-07-11 15:15:06.466623 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:08.468892 I | ceph-mgr: 2017-07-11 15:15:08.468824 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:08.469150 I | ceph-mgr: 2017-07-11 15:15:08.469001 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:08.469588 I | ceph-mgr: 2017-07-11 15:15:08.469336 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:10.471836 I | ceph-mgr: 2017-07-11 15:15:10.471795 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:10.471936 I | ceph-mgr: 2017-07-11 15:15:10.471921 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:10.472245 I | ceph-mgr: 2017-07-11 15:15:10.472229 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:12.481395 I | ceph-mgr: 2017-07-11 15:15:12.479289 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:12.483315 I | ceph-mgr: 2017-07-11 15:15:12.481328 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:12.496290 I | ceph-mgr: 2017-07-11 15:15:12.484222 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:14.513762 I | ceph-mgr: 2017-07-11 15:15:14.513696 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:14.513876 I | ceph-mgr: 2017-07-11 15:15:14.513861 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:14.514120 I | ceph-mgr: 2017-07-11 15:15:14.514104 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:16.516141 I | ceph-mgr: 2017-07-11 15:15:16.516084 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:16.516186 I | ceph-mgr: 2017-07-11 15:15:16.516171 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:16.516322 I | ceph-mgr: 2017-07-11 15:15:16.516300 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:18.518582 I | ceph-mgr: 2017-07-11 15:15:18.518536 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:18.518761 I | ceph-mgr: 2017-07-11 15:15:18.518673 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:18.519268 I | ceph-mgr: 2017-07-11 15:15:18.519246 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:20.521786 I | ceph-mgr: 2017-07-11 15:15:20.521748 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:20.521863 I | ceph-mgr: 2017-07-11 15:15:20.521849 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:20.522083 I | ceph-mgr: 2017-07-11 15:15:20.522069 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:22.524096 I | ceph-mgr: 2017-07-11 15:15:22.524047 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:22.524181 I | ceph-mgr: 2017-07-11 15:15:22.524156 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:22.524442 I | ceph-mgr: 2017-07-11 15:15:22.524427 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:24.530556 I | ceph-mgr: 2017-07-11 15:15:24.530121 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:24.531029 I | ceph-mgr: 2017-07-11 15:15:24.531010 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:24.531304 I | ceph-mgr: 2017-07-11 15:15:24.531289 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:26.539237 I | ceph-mgr: 2017-07-11 15:15:26.539195 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:26.539313 I | ceph-mgr: 2017-07-11 15:15:26.539299 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:26.539540 I | ceph-mgr: 2017-07-11 15:15:26.539524 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:28.541317 I | ceph-mgr: 2017-07-11 15:15:28.541260 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:28.541424 I | ceph-mgr: 2017-07-11 15:15:28.541408 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:28.542027 I | ceph-mgr: 2017-07-11 15:15:28.542007 7f4cc3226700 0 mgr tick
- 2017-07-11 15:15:30.544191 I | ceph-mgr: 2017-07-11 15:15:30.544128 7f4cc3226700 0 mgr tick tick
- 2017-07-11 15:15:30.544263 I | ceph-mgr: 2017-07-11 15:15:30.544235 7f4cc3226700 1 mgr send_beacon active
- 2017-07-11 15:15:30.544482 I | ceph-mgr: 2017-07-11 15:15:30.544464 7f4cc3226700 0 mgr tick
- END logs from pod: rook-ceph-mgr0-2234418690-jkr5c
- BEGIN logs from pod: rook-ceph-mon0-3dkfv
- 2017-07-11 13:23:44.802327 I | cephmon: parsing mon endpoints:
- 2017-07-11 13:23:44.802509 W | cephmon: ignoring invalid monitor
- 2017-07-11 13:23:44.803365 I | cephmon: writing config file /var/lib/rook/rook/rook.config
- 2017-07-11 13:23:44.809189 I | cephmon: generated admin config in /var/lib/rook/rook
- 2017-07-11 13:23:44.809470 I | cephmon: writing config file /var/lib/rook/rook-ceph-mon0/rook.config
- 2017-07-11 13:23:44.809689 I | cephmon: initializing mon
- 2017-07-11 13:23:44.809730 I | proc: Running process ceph-mon with args: [--mkfs --name=mon.rook-ceph-mon0 --cluster=rook --mon-data=/var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0 --conf=/var/lib/rook/rook-ceph-mon0/rook.config --keyring=/var/lib/rook/rook-ceph-mon0/keyring]
- 2017-07-11 13:23:44.809811 I | exec: Running command: ceph-mon --mkfs --name=mon.rook-ceph-mon0 --cluster=rook --mon-data=/var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0 --conf=/var/lib/rook/rook-ceph-mon0/rook.config --keyring=/var/lib/rook/rook-ceph-mon0/keyring
- 2017-07-11 13:23:44.848147 I | mkfs-rook-ceph-mon0: ceph-mon: set fsid to 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:23:44.848437 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.848394 7f3cd89b5c40 0 set rocksdb option compression = kNoCompression
- 2017-07-11 13:23:44.848503 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.848487 7f3cd89b5c40 0 set rocksdb option write_buffer_size = 33554432
- 2017-07-11 13:23:44.848664 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.848600 7f3cd89b5c40 0 set rocksdb option compression = kNoCompression
- 2017-07-11 13:23:44.848729 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.848709 7f3cd89b5c40 0 set rocksdb option write_buffer_size = 33554432
- 2017-07-11 13:23:44.848924 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.848906 7f3cd89b5c40 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:23:44.848960 I | mkfs-rook-ceph-mon0:
- 2017-07-11 13:23:44.848994 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.848976 7f3cd89b5c40 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:23:44.849038 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849011 7f3cd89b5c40 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:23:44.849068 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849055 7f3cd89b5c40 4 rocksdb: DB SUMMARY
- 2017-07-11 13:23:44.849082 I | mkfs-rook-ceph-mon0:
- 2017-07-11 13:23:44.849147 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849128 7f3cd89b5c40 4 rocksdb: SST files in /var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0/store.db dir, Total Num: 0, files:
- 2017-07-11 13:23:44.849164 I | mkfs-rook-ceph-mon0:
- 2017-07-11 13:23:44.849208 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849192 7f3cd89b5c40 4 rocksdb: Write Ahead Log file in /var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0/store.db:
- 2017-07-11 13:23:44.849226 I | mkfs-rook-ceph-mon0:
- 2017-07-11 13:23:44.849254 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849240 7f3cd89b5c40 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:23:44.849297 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849284 7f3cd89b5c40 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:23:44.849323 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849312 7f3cd89b5c40 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:23:44.849364 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849351 7f3cd89b5c40 4 rocksdb: Options.env: 0x5601e2fc4dc0
- 2017-07-11 13:23:44.849393 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849380 7f3cd89b5c40 4 rocksdb: Options.info_log: 0x5601e4dc0720
- 2017-07-11 13:23:44.849437 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849409 7f3cd89b5c40 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:23:44.849473 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849460 7f3cd89b5c40 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:23:44.849515 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849489 7f3cd89b5c40 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:23:44.849542 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849530 7f3cd89b5c40 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:23:44.849568 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849557 7f3cd89b5c40 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:23:44.849610 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849598 7f3cd89b5c40 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:23:44.849636 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849625 7f3cd89b5c40 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:23:44.849676 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849663 7f3cd89b5c40 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:23:44.849702 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849691 7f3cd89b5c40 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:23:44.849741 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849716 7f3cd89b5c40 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:23:44.849769 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849756 7f3cd89b5c40 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:23:44.849794 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849783 7f3cd89b5c40 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:23:44.849835 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849822 7f3cd89b5c40 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:23:44.849861 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849850 7f3cd89b5c40 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:23:44.849916 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849902 7f3cd89b5c40 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:23:44.849944 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849932 7f3cd89b5c40 4 rocksdb: Options.wal_dir: /var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0/store.db
- 2017-07-11 13:23:44.849985 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.849959 7f3cd89b5c40 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:23:44.850016 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.850004 7f3cd89b5c40 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:23:44.850058 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.850032 7f3cd89b5c40 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:23:44.850113 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.850100 7f3cd89b5c40 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:23:44.850154 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.850142 7f3cd89b5c40 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:23:44.850181 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.850170 7f3cd89b5c40 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:23:44.850469 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.850454 7f3cd89b5c40 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:23:44.850497 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.850485 7f3cd89b5c40 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:23:44.850538 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.850525 7f3cd89b5c40 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:23:44.850565 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.850553 7f3cd89b5c40 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:23:44.850605 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.850579 7f3cd89b5c40 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:23:44.850632 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.850621 7f3cd89b5c40 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:23:44.850659 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.850646 7f3cd89b5c40 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:23:44.850702 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.850689 7f3cd89b5c40 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:23:44.850728 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.850717 7f3cd89b5c40 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:23:44.856648 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.856631 7f3cd89b5c40 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:23:44.856694 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.856681 7f3cd89b5c40 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:23:44.856723 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.856712 7f3cd89b5c40 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:23:44.856763 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.856751 7f3cd89b5c40 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:23:44.856790 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.856779 7f3cd89b5c40 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:23:44.856828 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.856805 7f3cd89b5c40 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:23:44.856856 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.856844 7f3cd89b5c40 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:23:44.856883 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.856872 7f3cd89b5c40 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:23:44.856924 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.856908 7f3cd89b5c40 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:23:44.856951 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.856940 7f3cd89b5c40 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:23:44.856990 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.856966 7f3cd89b5c40 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:23:44.857018 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857006 7f3cd89b5c40 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:23:44.857044 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857032 7f3cd89b5c40 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:23:44.857085 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857073 7f3cd89b5c40 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:23:44.857112 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857101 7f3cd89b5c40 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:23:44.857150 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857136 7f3cd89b5c40 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:23:44.857178 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857166 7f3cd89b5c40 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:23:44.857215 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857192 7f3cd89b5c40 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:23:44.857242 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857230 7f3cd89b5c40 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:23:44.857268 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857257 7f3cd89b5c40 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:23:44.857306 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857294 7f3cd89b5c40 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:23:44.857336 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857324 7f3cd89b5c40 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:23:44.857373 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857350 7f3cd89b5c40 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:23:44.857401 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857390 7f3cd89b5c40 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:23:44.857427 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857416 7f3cd89b5c40 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:23:44.857464 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857452 7f3cd89b5c40 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:23:44.857492 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857481 7f3cd89b5c40 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:23:44.857709 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:44.857572 7f3cd89b5c40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:192] Creating manifest 1
- 2017-07-11 13:23:44.857737 I | mkfs-rook-ceph-mon0:
- 2017-07-11 13:23:45.014802 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.014748 7f3cd89b5c40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001
- 2017-07-11 13:23:45.014883 I | mkfs-rook-ceph-mon0:
- 2017-07-11 13:23:45.015145 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.015119 7f3cd89b5c40 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:23:45.015180 I | mkfs-rook-ceph-mon0:
- 2017-07-11 13:23:45.015223 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.015206 7f3cd89b5c40 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:23:45.015266 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.015252 7f3cd89b5c40 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:23:45.015295 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.015283 7f3cd89b5c40 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:23:45.015336 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.015311 7f3cd89b5c40 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:23:45.015364 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.015352 7f3cd89b5c40 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:23:45.015405 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.015381 7f3cd89b5c40 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:23:45.015495 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.015450 7f3cd89b5c40 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5601e4be6150)
- 2017-07-11 13:23:45.015514 I | mkfs-rook-ceph-mon0: cache_index_and_filter_blocks: 0
- 2017-07-11 13:23:45.015527 I | mkfs-rook-ceph-mon0: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:23:45.015538 I | mkfs-rook-ceph-mon0: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:23:45.015553 I | mkfs-rook-ceph-mon0: index_type: 0
- 2017-07-11 13:23:45.015577 I | mkfs-rook-ceph-mon0: hash_index_allow_collision: 1
- 2017-07-11 13:23:45.015589 I | mkfs-rook-ceph-mon0: checksum: 1
- 2017-07-11 13:23:45.015600 I | mkfs-rook-ceph-mon0: no_block_cache: 0
- 2017-07-11 13:23:45.015611 I | mkfs-rook-ceph-mon0: block_cache: 0x5601e4c18850
- 2017-07-11 13:23:45.015623 I | mkfs-rook-ceph-mon0: block_cache_name: LRUCache
- 2017-07-11 13:23:45.015646 I | mkfs-rook-ceph-mon0: block_cache_options:
- 2017-07-11 13:23:45.015658 I | mkfs-rook-ceph-mon0: capacity : 107374182
- 2017-07-11 13:23:45.015669 I | mkfs-rook-ceph-mon0: num_shard_bits : 4
- 2017-07-11 13:23:45.015680 I | mkfs-rook-ceph-mon0: strict_capacity_limit : 0
- 2017-07-11 13:23:45.015691 I | mkfs-rook-ceph-mon0: high_pri_pool_ratio: 0.000
- 2017-07-11 13:23:45.015703 I | mkfs-rook-ceph-mon0: block_cache_compressed: (nil)
- 2017-07-11 13:23:45.015723 I | mkfs-rook-ceph-mon0: persistent_cache: (nil)
- 2017-07-11 13:23:45.015735 I | mkfs-rook-ceph-mon0: block_size: 4096
- 2017-07-11 13:23:45.015747 I | mkfs-rook-ceph-mon0: block_size_deviation: 10
- 2017-07-11 13:23:45.015757 I | mkfs-rook-ceph-mon0: block_restart_interval: 16
- 2017-07-11 13:23:45.015768 I | mkfs-rook-ceph-mon0: index_block_restart_interval: 1
- 2017-07-11 13:23:45.015779 I | mkfs-rook-ceph-mon0: filter_policy: nullptr
- 2017-07-11 13:23:45.015800 I | mkfs-rook-ceph-mon0: whole_key_filtering: 1
- 2017-07-11 13:23:45.015812 I | mkfs-rook-ceph-mon0: format_version: 2
- 2017-07-11 13:23:45.015823 I | mkfs-rook-ceph-mon0:
- 2017-07-11 13:23:45.015852 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.015837 7f3cd89b5c40 4 rocksdb: Options.write_buffer_size: 33554432
- 2017-07-11 13:23:45.015892 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.015879 7f3cd89b5c40 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:23:45.015920 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.015909 7f3cd89b5c40 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:23:45.015960 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.015936 7f3cd89b5c40 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:23:45.015987 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.015976 7f3cd89b5c40 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:23:45.016014 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016003 7f3cd89b5c40 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:23:45.016062 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016048 7f3cd89b5c40 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:23:45.016090 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016078 7f3cd89b5c40 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:23:45.016128 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016115 7f3cd89b5c40 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:23:45.016165 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016153 7f3cd89b5c40 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:23:45.016206 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016193 7f3cd89b5c40 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:23:45.016233 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016222 7f3cd89b5c40 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:23:45.016271 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016248 7f3cd89b5c40 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:23:45.016299 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016287 7f3cd89b5c40 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:23:45.016325 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016314 7f3cd89b5c40 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:23:45.016362 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016350 7f3cd89b5c40 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:23:45.016392 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016381 7f3cd89b5c40 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:23:45.016431 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016407 7f3cd89b5c40 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:23:45.016459 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016447 7f3cd89b5c40 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:23:45.016485 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016474 7f3cd89b5c40 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:23:45.016528 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016511 7f3cd89b5c40 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:23:45.016556 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016545 7f3cd89b5c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:23:45.016595 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016583 7f3cd89b5c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:23:45.016623 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016611 7f3cd89b5c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:23:45.016693 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016637 7f3cd89b5c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:23:45.016730 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016715 7f3cd89b5c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:23:45.016756 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016745 7f3cd89b5c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:23:45.016797 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016785 7f3cd89b5c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:23:45.016823 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016812 7f3cd89b5c40 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:23:45.016860 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016848 7f3cd89b5c40 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:23:45.016925 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016877 7f3cd89b5c40 4 rocksdb: Options.arena_block_size: 4194304
- 2017-07-11 13:23:45.016959 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.016944 7f3cd89b5c40 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:23:45.017018 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017003 7f3cd89b5c40 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:23:45.017047 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017035 7f3cd89b5c40 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:23:45.017086 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017062 7f3cd89b5c40 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:23:45.017116 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017103 7f3cd89b5c40 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:23:45.017156 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017132 7f3cd89b5c40 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:23:45.017185 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017172 7f3cd89b5c40 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:23:45.017211 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017200 7f3cd89b5c40 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:23:45.017248 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017235 7f3cd89b5c40 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:23:45.017275 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017264 7f3cd89b5c40 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:23:45.017315 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017291 7f3cd89b5c40 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:23:45.017343 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017331 7f3cd89b5c40 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:23:45.017370 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017358 7f3cd89b5c40 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:23:45.017409 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017396 7f3cd89b5c40 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:23:45.017435 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017424 7f3cd89b5c40 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:23:45.017478 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017450 7f3cd89b5c40 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:23:45.017507 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017495 7f3cd89b5c40 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:23:45.017533 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017522 7f3cd89b5c40 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:23:45.017572 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017560 7f3cd89b5c40 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:23:45.017602 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017590 7f3cd89b5c40 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:23:45.017640 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017628 7f3cd89b5c40 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:23:45.017666 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017655 7f3cd89b5c40 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:23:45.017703 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.017681 7f3cd89b5c40 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:23:45.018665 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.018460 7f3cd89b5c40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:23:45.018704 I | mkfs-rook-ceph-mon0:
- 2017-07-11 13:23:45.018727 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.018469 7f3cd89b5c40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 0
- 2017-07-11 13:23:45.018741 I | mkfs-rook-ceph-mon0:
- 2017-07-11 13:23:45.059164 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.059117 7f3cd89b5c40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x5601e4e06000
- 2017-07-11 13:23:45.138312 I | mkfs-rook-ceph-mon0: ceph-mon: created monfs at /var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0 for mon.rook-ceph-mon0
- 2017-07-11 13:23:45.138330 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.137994 7f3cd89b5c40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:217] Shutdown: canceling all background work
- 2017-07-11 13:23:45.138343 I | mkfs-rook-ceph-mon0: 2017-07-11 13:23:45.138138 7f3cd89b5c40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:343] Shutdown complete
- 2017-07-11 13:23:45.140251 I | cephmon: starting mon
- 2017-07-11 13:23:45.140316 I | cephmon: Config file /var/lib/rook/rook-ceph-mon0/rook.config:
- [global]
- enable experimental unrecoverable data corrupting features =
- fsid = 14d33745-7e28-4202-a25a-906da8bffbcf
- run dir = /var/lib/rook/rook-ceph-mon0
- mon initial members = rook-ceph-mon0
- log file = /dev/stdout
- mon cluster log file = /dev/stdout
- mon keyvaluedb = rocksdb
- debug default = 0
- debug rados = 0
- debug mon = 0
- debug osd = 0
- debug bluestore = 0
- debug filestore = 0
- debug journal = 0
- debug leveldb = 0
- filestore_omap_backend = rocksdb
- osd pg bits = 11
- osd pgp bits = 11
- osd pool default size = 1
- osd pool default min size = 1
- osd pool default pg num = 100
- osd pool default pgp num = 100
- osd objectstore = filestore
- rbd_default_features = 3
- fatal signal handlers = false
- [client.admin]
- keyring = /var/lib/rook/rook-ceph-mon0/keyring
- [mon.rook-ceph-mon0]
- name = rook-ceph-mon0
- mon addr = 10.233.76.3:6790
- 2017-07-11 13:23:45.140349 I | proc: Running process ceph-mon with args: [--foreground --name=mon.rook-ceph-mon0 --cluster=rook --mon-data=/var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0 --conf=/var/lib/rook/rook-ceph-mon0/rook.config --keyring=/var/lib/rook/rook-ceph-mon0/keyring]
- 2017-07-11 13:23:45.140369 I | exec: Running command: ceph-mon --foreground --name=mon.rook-ceph-mon0 --cluster=rook --mon-data=/var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0 --conf=/var/lib/rook/rook-ceph-mon0/rook.config --keyring=/var/lib/rook/rook-ceph-mon0/keyring
- 2017-07-11 13:23:45.163163 I | rook-ceph-mon0: 2017-07-11 13:23:45.163099 7f7c57784c40 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 32
- 2017-07-11 13:23:45.163391 I | rook-ceph-mon0: 2017-07-11 13:23:45.163349 7f7c57784c40 0 pidfile_write: ignore empty --pid-file
- 2017-07-11 13:23:45.180401 I | rook-ceph-mon0: 2017-07-11 13:23:45.180373 7f7c57784c40 0 load: jerasure load: lrc load: isa
- 2017-07-11 13:23:45.180588 I | rook-ceph-mon0: 2017-07-11 13:23:45.180566 7f7c57784c40 0 set rocksdb option compression = kNoCompression
- 2017-07-11 13:23:45.180668 I | rook-ceph-mon0: 2017-07-11 13:23:45.180654 7f7c57784c40 0 set rocksdb option write_buffer_size = 33554432
- 2017-07-11 13:23:45.180729 I | rook-ceph-mon0: 2017-07-11 13:23:45.180715 7f7c57784c40 0 set rocksdb option compression = kNoCompression
- 2017-07-11 13:23:45.180781 I | rook-ceph-mon0: 2017-07-11 13:23:45.180750 7f7c57784c40 0 set rocksdb option write_buffer_size = 33554432
- 2017-07-11 13:23:45.180903 I | rook-ceph-mon0: 2017-07-11 13:23:45.180887 7f7c57784c40 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:23:45.180931 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.180960 I | rook-ceph-mon0: 2017-07-11 13:23:45.180946 7f7c57784c40 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:23:45.180995 I | rook-ceph-mon0: 2017-07-11 13:23:45.180973 7f7c57784c40 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:23:45.181109 I | rook-ceph-mon0: 2017-07-11 13:23:45.181060 7f7c57784c40 4 rocksdb: DB SUMMARY
- 2017-07-11 13:23:45.181126 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.181447 I | rook-ceph-mon0: 2017-07-11 13:23:45.181426 7f7c57784c40 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:23:45.181465 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.181506 I | rook-ceph-mon0: 2017-07-11 13:23:45.181494 7f7c57784c40 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:23:45.181521 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.181571 I | rook-ceph-mon0: 2017-07-11 13:23:45.181540 7f7c57784c40 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes
- 2017-07-11 13:23:45.181585 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.181613 I | rook-ceph-mon0: 2017-07-11 13:23:45.181599 7f7c57784c40 4 rocksdb: SST files in /var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0/store.db dir, Total Num: 0, files:
- 2017-07-11 13:23:45.181626 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.181676 I | rook-ceph-mon0: 2017-07-11 13:23:45.181653 7f7c57784c40 4 rocksdb: Write Ahead Log file in /var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0/store.db: 000003.log size: 657 ;
- 2017-07-11 13:23:45.181690 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.181712 I | rook-ceph-mon0: 2017-07-11 13:23:45.181702 7f7c57784c40 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:23:45.181748 I | rook-ceph-mon0: 2017-07-11 13:23:45.181738 7f7c57784c40 4 rocksdb: Options.create_if_missing: 0
- 2017-07-11 13:23:45.181773 I | rook-ceph-mon0: 2017-07-11 13:23:45.181762 7f7c57784c40 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:23:45.181809 I | rook-ceph-mon0: 2017-07-11 13:23:45.181786 7f7c57784c40 4 rocksdb: Options.env: 0x55a625bcfdc0
- 2017-07-11 13:23:45.181833 I | rook-ceph-mon0: 2017-07-11 13:23:45.181823 7f7c57784c40 4 rocksdb: Options.info_log: 0x55a627718820
- 2017-07-11 13:23:45.181854 I | rook-ceph-mon0: 2017-07-11 13:23:45.181845 7f7c57784c40 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:23:45.181890 I | rook-ceph-mon0: 2017-07-11 13:23:45.181866 7f7c57784c40 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:23:45.181912 I | rook-ceph-mon0: 2017-07-11 13:23:45.181903 7f7c57784c40 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:23:45.181933 I | rook-ceph-mon0: 2017-07-11 13:23:45.181924 7f7c57784c40 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:23:45.181967 I | rook-ceph-mon0: 2017-07-11 13:23:45.181957 7f7c57784c40 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:23:45.182001 I | rook-ceph-mon0: 2017-07-11 13:23:45.181981 7f7c57784c40 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:23:45.182037 I | rook-ceph-mon0: 2017-07-11 13:23:45.182014 7f7c57784c40 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:23:45.182063 I | rook-ceph-mon0: 2017-07-11 13:23:45.182052 7f7c57784c40 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:23:45.182085 I | rook-ceph-mon0: 2017-07-11 13:23:45.182075 7f7c57784c40 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:23:45.182121 I | rook-ceph-mon0: 2017-07-11 13:23:45.182110 7f7c57784c40 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:23:45.182144 I | rook-ceph-mon0: 2017-07-11 13:23:45.182135 7f7c57784c40 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:23:45.182167 I | rook-ceph-mon0: 2017-07-11 13:23:45.182157 7f7c57784c40 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:23:45.182214 I | rook-ceph-mon0: 2017-07-11 13:23:45.182193 7f7c57784c40 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:23:45.182236 I | rook-ceph-mon0: 2017-07-11 13:23:45.182227 7f7c57784c40 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:23:45.182271 I | rook-ceph-mon0: 2017-07-11 13:23:45.182248 7f7c57784c40 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:23:45.182294 I | rook-ceph-mon0: 2017-07-11 13:23:45.182284 7f7c57784c40 4 rocksdb: Options.wal_dir: /var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0/store.db
- 2017-07-11 13:23:45.182319 I | rook-ceph-mon0: 2017-07-11 13:23:45.182307 7f7c57784c40 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:23:45.182354 I | rook-ceph-mon0: 2017-07-11 13:23:45.182344 7f7c57784c40 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:23:45.182376 I | rook-ceph-mon0: 2017-07-11 13:23:45.182368 7f7c57784c40 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:23:45.182397 I | rook-ceph-mon0: 2017-07-11 13:23:45.182389 7f7c57784c40 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:23:45.182430 I | rook-ceph-mon0: 2017-07-11 13:23:45.182420 7f7c57784c40 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:23:45.182452 I | rook-ceph-mon0: 2017-07-11 13:23:45.182443 7f7c57784c40 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:23:45.182740 I | rook-ceph-mon0: 2017-07-11 13:23:45.182725 7f7c57784c40 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:23:45.182797 I | rook-ceph-mon0: 2017-07-11 13:23:45.182766 7f7c57784c40 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:23:45.182825 I | rook-ceph-mon0: 2017-07-11 13:23:45.182814 7f7c57784c40 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:23:45.182848 I | rook-ceph-mon0: 2017-07-11 13:23:45.182839 7f7c57784c40 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:23:45.182884 I | rook-ceph-mon0: 2017-07-11 13:23:45.182874 7f7c57784c40 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:23:45.182907 I | rook-ceph-mon0: 2017-07-11 13:23:45.182898 7f7c57784c40 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:23:45.182929 I | rook-ceph-mon0: 2017-07-11 13:23:45.182919 7f7c57784c40 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:23:45.182966 I | rook-ceph-mon0: 2017-07-11 13:23:45.182955 7f7c57784c40 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:23:45.182988 I | rook-ceph-mon0: 2017-07-11 13:23:45.182979 7f7c57784c40 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:23:45.183028 I | rook-ceph-mon0: 2017-07-11 13:23:45.183004 7f7c57784c40 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:23:45.183052 I | rook-ceph-mon0: 2017-07-11 13:23:45.183042 7f7c57784c40 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:23:45.183084 I | rook-ceph-mon0: 2017-07-11 13:23:45.183064 7f7c57784c40 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:23:45.183120 I | rook-ceph-mon0: 2017-07-11 13:23:45.183110 7f7c57784c40 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:23:45.183144 I | rook-ceph-mon0: 2017-07-11 13:23:45.183134 7f7c57784c40 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:23:45.183166 I | rook-ceph-mon0: 2017-07-11 13:23:45.183157 7f7c57784c40 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:23:45.183204 I | rook-ceph-mon0: 2017-07-11 13:23:45.183193 7f7c57784c40 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:23:45.183227 I | rook-ceph-mon0: 2017-07-11 13:23:45.183217 7f7c57784c40 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:23:45.183263 I | rook-ceph-mon0: 2017-07-11 13:23:45.183239 7f7c57784c40 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:23:45.183289 I | rook-ceph-mon0: 2017-07-11 13:23:45.183277 7f7c57784c40 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:23:45.183314 I | rook-ceph-mon0: 2017-07-11 13:23:45.183304 7f7c57784c40 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:23:45.183376 I | rook-ceph-mon0: 2017-07-11 13:23:45.183365 7f7c57784c40 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:23:45.183401 I | rook-ceph-mon0: 2017-07-11 13:23:45.183391 7f7c57784c40 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:23:45.183439 I | rook-ceph-mon0: 2017-07-11 13:23:45.183428 7f7c57784c40 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:23:45.183463 I | rook-ceph-mon0: 2017-07-11 13:23:45.183453 7f7c57784c40 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:23:45.183512 I | rook-ceph-mon0: 2017-07-11 13:23:45.183499 7f7c57784c40 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:23:45.183538 I | rook-ceph-mon0: 2017-07-11 13:23:45.183528 7f7c57784c40 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:23:45.183577 I | rook-ceph-mon0: 2017-07-11 13:23:45.183552 7f7c57784c40 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:23:45.183608 I | rook-ceph-mon0: 2017-07-11 13:23:45.183597 7f7c57784c40 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:23:45.183632 I | rook-ceph-mon0: 2017-07-11 13:23:45.183622 7f7c57784c40 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:23:45.183673 I | rook-ceph-mon0: 2017-07-11 13:23:45.183662 7f7c57784c40 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:23:45.183697 I | rook-ceph-mon0: 2017-07-11 13:23:45.183687 7f7c57784c40 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:23:45.183735 I | rook-ceph-mon0: 2017-07-11 13:23:45.183724 7f7c57784c40 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:23:45.183760 I | rook-ceph-mon0: 2017-07-11 13:23:45.183750 7f7c57784c40 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:23:45.183784 I | rook-ceph-mon0: 2017-07-11 13:23:45.183774 7f7c57784c40 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:23:45.183821 I | rook-ceph-mon0: 2017-07-11 13:23:45.183810 7f7c57784c40 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:23:45.183848 I | rook-ceph-mon0: 2017-07-11 13:23:45.183838 7f7c57784c40 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:23:45.189851 I | rook-ceph-mon0: 2017-07-11 13:23:45.189824 7f7c57784c40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001
- 2017-07-11 13:23:45.189894 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.190171 I | rook-ceph-mon0: 2017-07-11 13:23:45.190150 7f7c57784c40 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:23:45.190223 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.190256 I | rook-ceph-mon0: 2017-07-11 13:23:45.190242 7f7c57784c40 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:23:45.190311 I | rook-ceph-mon0: 2017-07-11 13:23:45.190282 7f7c57784c40 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:23:45.190339 I | rook-ceph-mon0: 2017-07-11 13:23:45.190328 7f7c57784c40 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:23:45.190381 I | rook-ceph-mon0: 2017-07-11 13:23:45.190353 7f7c57784c40 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:23:45.190409 I | rook-ceph-mon0: 2017-07-11 13:23:45.190397 7f7c57784c40 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:23:45.190437 I | rook-ceph-mon0: 2017-07-11 13:23:45.190426 7f7c57784c40 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:23:45.190503 I | rook-ceph-mon0: 2017-07-11 13:23:45.190486 7f7c57784c40 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a627542140)
- 2017-07-11 13:23:45.190533 I | rook-ceph-mon0: cache_index_and_filter_blocks: 0
- 2017-07-11 13:23:45.190546 I | rook-ceph-mon0: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:23:45.190557 I | rook-ceph-mon0: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:23:45.190568 I | rook-ceph-mon0: index_type: 0
- 2017-07-11 13:23:45.190579 I | rook-ceph-mon0: hash_index_allow_collision: 1
- 2017-07-11 13:23:45.190590 I | rook-ceph-mon0: checksum: 1
- 2017-07-11 13:23:45.190613 I | rook-ceph-mon0: no_block_cache: 0
- 2017-07-11 13:23:45.190625 I | rook-ceph-mon0: block_cache: 0x55a627574930
- 2017-07-11 13:23:45.190636 I | rook-ceph-mon0: block_cache_name: LRUCache
- 2017-07-11 13:23:45.190648 I | rook-ceph-mon0: block_cache_options:
- 2017-07-11 13:23:45.190670 I | rook-ceph-mon0: capacity : 107374182
- 2017-07-11 13:23:45.190709 I | rook-ceph-mon0: num_shard_bits : 4
- 2017-07-11 13:23:45.190720 I | rook-ceph-mon0: strict_capacity_limit : 0
- 2017-07-11 13:23:45.190731 I | rook-ceph-mon0: high_pri_pool_ratio: 0.000
- 2017-07-11 13:23:45.190741 I | rook-ceph-mon0: block_cache_compressed: (nil)
- 2017-07-11 13:23:45.190752 I | rook-ceph-mon0: persistent_cache: (nil)
- 2017-07-11 13:23:45.190775 I | rook-ceph-mon0: block_size: 4096
- 2017-07-11 13:23:45.190787 I | rook-ceph-mon0: block_size_deviation: 10
- 2017-07-11 13:23:45.190798 I | rook-ceph-mon0: block_restart_interval: 16
- 2017-07-11 13:23:45.190809 I | rook-ceph-mon0: index_block_restart_interval: 1
- 2017-07-11 13:23:45.190820 I | rook-ceph-mon0: filter_policy: nullptr
- 2017-07-11 13:23:45.190831 I | rook-ceph-mon0: whole_key_filtering: 1
- 2017-07-11 13:23:45.190853 I | rook-ceph-mon0: format_version: 2
- 2017-07-11 13:23:45.190865 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.190890 I | rook-ceph-mon0: 2017-07-11 13:23:45.190878 7f7c57784c40 4 rocksdb: Options.write_buffer_size: 33554432
- 2017-07-11 13:23:45.190915 I | rook-ceph-mon0: 2017-07-11 13:23:45.190904 7f7c57784c40 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:23:45.190958 I | rook-ceph-mon0: 2017-07-11 13:23:45.190946 7f7c57784c40 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:23:45.190984 I | rook-ceph-mon0: 2017-07-11 13:23:45.190974 7f7c57784c40 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:23:45.191022 I | rook-ceph-mon0: 2017-07-11 13:23:45.191011 7f7c57784c40 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:23:45.191059 I | rook-ceph-mon0: 2017-07-11 13:23:45.191049 7f7c57784c40 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:23:45.191106 I | rook-ceph-mon0: 2017-07-11 13:23:45.191094 7f7c57784c40 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:23:45.191133 I | rook-ceph-mon0: 2017-07-11 13:23:45.191123 7f7c57784c40 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:23:45.191171 I | rook-ceph-mon0: 2017-07-11 13:23:45.191146 7f7c57784c40 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:23:45.191207 I | rook-ceph-mon0: 2017-07-11 13:23:45.191195 7f7c57784c40 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:23:45.191245 I | rook-ceph-mon0: 2017-07-11 13:23:45.191221 7f7c57784c40 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:23:45.191295 I | rook-ceph-mon0: 2017-07-11 13:23:45.191272 7f7c57784c40 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:23:45.191349 I | rook-ceph-mon0: 2017-07-11 13:23:45.191338 7f7c57784c40 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:23:45.191374 I | rook-ceph-mon0: 2017-07-11 13:23:45.191364 7f7c57784c40 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:23:45.191398 I | rook-ceph-mon0: 2017-07-11 13:23:45.191388 7f7c57784c40 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:23:45.191437 I | rook-ceph-mon0: 2017-07-11 13:23:45.191426 7f7c57784c40 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:23:45.191461 I | rook-ceph-mon0: 2017-07-11 13:23:45.191451 7f7c57784c40 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:23:45.191510 I | rook-ceph-mon0: 2017-07-11 13:23:45.191495 7f7c57784c40 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:23:45.191537 I | rook-ceph-mon0: 2017-07-11 13:23:45.191526 7f7c57784c40 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:23:45.191576 I | rook-ceph-mon0: 2017-07-11 13:23:45.191551 7f7c57784c40 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:23:45.191615 I | rook-ceph-mon0: 2017-07-11 13:23:45.191591 7f7c57784c40 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:23:45.191664 I | rook-ceph-mon0: 2017-07-11 13:23:45.191653 7f7c57784c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:23:45.191687 I | rook-ceph-mon0: 2017-07-11 13:23:45.191678 7f7c57784c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:23:45.191732 I | rook-ceph-mon0: 2017-07-11 13:23:45.191700 7f7c57784c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:23:45.191755 I | rook-ceph-mon0: 2017-07-11 13:23:45.191746 7f7c57784c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:23:45.191789 I | rook-ceph-mon0: 2017-07-11 13:23:45.191768 7f7c57784c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:23:45.191840 I | rook-ceph-mon0: 2017-07-11 13:23:45.191829 7f7c57784c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:23:45.191865 I | rook-ceph-mon0: 2017-07-11 13:23:45.191855 7f7c57784c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:23:45.191913 I | rook-ceph-mon0: 2017-07-11 13:23:45.191902 7f7c57784c40 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:23:45.191939 I | rook-ceph-mon0: 2017-07-11 13:23:45.191927 7f7c57784c40 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:23:45.191977 I | rook-ceph-mon0: 2017-07-11 13:23:45.191966 7f7c57784c40 4 rocksdb: Options.arena_block_size: 4194304
- 2017-07-11 13:23:45.192003 I | rook-ceph-mon0: 2017-07-11 13:23:45.191992 7f7c57784c40 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:23:45.192027 I | rook-ceph-mon0: 2017-07-11 13:23:45.192016 7f7c57784c40 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:23:45.192069 I | rook-ceph-mon0: 2017-07-11 13:23:45.192056 7f7c57784c40 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:23:45.192095 I | rook-ceph-mon0: 2017-07-11 13:23:45.192085 7f7c57784c40 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:23:45.192134 I | rook-ceph-mon0: 2017-07-11 13:23:45.192123 7f7c57784c40 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:23:45.192161 I | rook-ceph-mon0: 2017-07-11 13:23:45.192150 7f7c57784c40 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:23:45.192198 I | rook-ceph-mon0: 2017-07-11 13:23:45.192174 7f7c57784c40 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:23:45.192224 I | rook-ceph-mon0: 2017-07-11 13:23:45.192213 7f7c57784c40 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:23:45.192248 I | rook-ceph-mon0: 2017-07-11 13:23:45.192238 7f7c57784c40 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:23:45.192286 I | rook-ceph-mon0: 2017-07-11 13:23:45.192275 7f7c57784c40 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:23:45.192312 I | rook-ceph-mon0: 2017-07-11 13:23:45.192301 7f7c57784c40 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:23:45.192335 I | rook-ceph-mon0: 2017-07-11 13:23:45.192325 7f7c57784c40 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:23:45.192376 I | rook-ceph-mon0: 2017-07-11 13:23:45.192365 7f7c57784c40 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:23:45.192400 I | rook-ceph-mon0: 2017-07-11 13:23:45.192390 7f7c57784c40 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:23:45.192438 I | rook-ceph-mon0: 2017-07-11 13:23:45.192414 7f7c57784c40 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:23:45.192486 I | rook-ceph-mon0: 2017-07-11 13:23:45.192463 7f7c57784c40 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:23:45.192524 I | rook-ceph-mon0: 2017-07-11 13:23:45.192513 7f7c57784c40 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:23:45.192549 I | rook-ceph-mon0: 2017-07-11 13:23:45.192539 7f7c57784c40 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:23:45.192601 I | rook-ceph-mon0: 2017-07-11 13:23:45.192563 7f7c57784c40 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:23:45.192633 I | rook-ceph-mon0: 2017-07-11 13:23:45.192621 7f7c57784c40 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:23:45.192674 I | rook-ceph-mon0: 2017-07-11 13:23:45.192662 7f7c57784c40 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:23:45.192699 I | rook-ceph-mon0: 2017-07-11 13:23:45.192689 7f7c57784c40 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:23:45.192723 I | rook-ceph-mon0: 2017-07-11 13:23:45.192713 7f7c57784c40 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:23:45.199214 I | rook-ceph-mon0: 2017-07-11 13:23:45.193506 7f7c57784c40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:23:45.199264 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.199281 I | rook-ceph-mon0: 2017-07-11 13:23:45.193514 7f7c57784c40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 0
- 2017-07-11 13:23:45.199294 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.199307 I | rook-ceph-mon0: 2017-07-11 13:23:45.193571 7f7c57784c40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779425193566, "job": 1, "event": "recovery_started", "log_files": [3]}
- 2017-07-11 13:23:45.199337 I | rook-ceph-mon0: 2017-07-11 13:23:45.193574 7f7c57784c40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #3 mode 2
- 2017-07-11 13:23:45.216650 I | rook-ceph-mon0: 2017-07-11 13:23:45.216621 7f7c57784c40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779425216613, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1504, "table_properties": {"data_size": 669, "index_size": 28, "filter_size": 0, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 546, "raw_average_value_size": 109, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:23:45.216809 I | rook-ceph-mon0: 2017-07-11 13:23:45.216726 7f7c57784c40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 5
- 2017-07-11 13:23:45.216845 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.310710 I | rook-ceph-mon0: 2017-07-11 13:23:45.310661 7f7c57784c40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779425310655, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:23:45.358181 I | rook-ceph-mon0: 2017-07-11 13:23:45.358137 7f7c57784c40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55a627810000
- 2017-07-11 13:23:45.359033 I | rook-ceph-mon0: 2017-07-11 13:23:45.359008 7f7c57784c40 0 starting mon.rook-ceph-mon0 rank 0 at 10.233.76.3:6790/0 mon_data /var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:23:45.359247 I | rook-ceph-mon0: starting mon.rook-ceph-mon0 rank 0 at 10.233.76.3:6790/0 mon_data /var/lib/rook/rook-ceph-mon0/mon.rook-ceph-mon0 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:23:45.360155 I | rook-ceph-mon0: 2017-07-11 13:23:45.360136 7f7c57784c40 0 mon.rook-ceph-mon0@-1(probing) e0 my rank is now 0 (was -1)
- 2017-07-11 13:23:45.389703 I | rook-ceph-mon0: 2017-07-11 13:23:45.389478 7f7c57784c40 0 log_channel(cluster) log [INF] : mon.rook-ceph-mon0@0 won leader election with quorum 0
- 2017-07-11 13:23:45.452712 I | rook-ceph-mon0: 2017-07-11 13:23:45.452656 7f7c4754c700 1 mon.rook-ceph-mon0@0(leader).paxosservice(pgmap 0..0) refresh upgraded, format 1 -> 0
- 2017-07-11 13:23:45.468030 I | rook-ceph-mon0: 2017-07-11 13:23:45.467999 7f7c4754c700 1 mon.rook-ceph-mon0@0(leader).paxosservice(auth 0..0) refresh upgraded, format 2 -> 0
- 2017-07-11 13:23:45.483789 I | rook-ceph-mon0: 2017-07-11 13:23:45.483761 7f7c4754c700 0 log_channel(cluster) log [INF] : mon.rook-ceph-mon0@0 won leader election with quorum 0
- 2017-07-11 13:23:45.499193 I | rook-ceph-mon0: 2017-07-11 13:23:45.499157 7f7c4754c700 0 log_channel(cluster) log [INF] : monmap e1: 1 mons at {rook-ceph-mon0=10.233.76.3:6790/0}
- 2017-07-11 13:23:45.610032 I | rook-ceph-mon0: 2017-07-11 13:23:45.609974 7f7c4754c700 1 mon.rook-ceph-mon0@0(leader).paxosservice(auth 0..0) refresh upgraded, format 2 -> 0
- 2017-07-11 13:23:45.610319 I | rook-ceph-mon0: 2017-07-11 13:23:45.610303 7f7c4754c700 0 log_channel(cluster) log [INF] : pgmap 0 pgs: ; 0 bytes data, 0 kB used, 0 kB / 0 kB avail
- 2017-07-11 13:23:45.643146 I | rook-ceph-mon0: 2017-07-11 13:23:45.643094 7f7c4754c700 0 mon.rook-ceph-mon0@0(leader).mds e1 print_map
- 2017-07-11 13:23:45.643254 I | rook-ceph-mon0: e1
- 2017-07-11 13:23:45.643278 I | rook-ceph-mon0: enable_multiple, ever_enabled_multiple: 0,0
- 2017-07-11 13:23:45.643306 I | rook-ceph-mon0: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=file layout v2}
- 2017-07-11 13:23:45.643341 I | rook-ceph-mon0: legacy client fscid: -1
- 2017-07-11 13:23:45.643352 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.643363 I | rook-ceph-mon0: No filesystems configured
- 2017-07-11 13:23:45.643373 I | rook-ceph-mon0:
- 2017-07-11 13:23:45.673653 I | rook-ceph-mon0: 2017-07-11 13:23:45.673589 7f7c4754c700 0 mon.rook-ceph-mon0@0(leader).osd e1 crush map has features 288514051259236352, adjusting msgr requires
- 2017-07-11 13:23:45.673742 I | rook-ceph-mon0: 2017-07-11 13:23:45.673725 7f7c4754c700 0 mon.rook-ceph-mon0@0(leader).osd e1 crush map has features 288514051259236352, adjusting msgr requires
- 2017-07-11 13:23:45.673798 I | rook-ceph-mon0: 2017-07-11 13:23:45.673784 7f7c4754c700 0 mon.rook-ceph-mon0@0(leader).osd e1 crush map has features 1009089991638532096, adjusting msgr requires
- 2017-07-11 13:23:45.673830 I | rook-ceph-mon0: 2017-07-11 13:23:45.673818 7f7c4754c700 0 mon.rook-ceph-mon0@0(leader).osd e1 crush map has features 288514051259236352, adjusting msgr requires
- 2017-07-11 13:23:45.674046 I | rook-ceph-mon0: 2017-07-11 13:23:45.517236 mon.rook-ceph-mon0 unknown.0 - 0 : [INF] mkfs 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:23:45.674128 I | rook-ceph-mon0: 2017-07-11 13:23:45.674109 7f7c4754c700 1 mon.rook-ceph-mon0@0(leader).paxosservice(auth 1..1) refresh upgraded, format 0 -> 2
- 2017-07-11 13:23:45.688512 I | rook-ceph-mon0: 2017-07-11 13:23:45.688487 7f7c4754c700 0 log_channel(cluster) log [INF] : fsmap
- 2017-07-11 13:23:45.704381 I | rook-ceph-mon0: 2017-07-11 13:23:45.704317 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e1: 0 total, 0 up, 0 in
- 2017-07-11 13:23:45.705214 I | rook-ceph-mon0: 2017-07-11 13:23:45.705194 7f7c4754c700 0 log_channel(cluster) log [INF] : mgrmap e1: no daemons active
- 2017-07-11 13:23:45.767661 I | rook-ceph-mon0: 2017-07-11 13:23:45.389486 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1 : cluster [INF] mon.rook-ceph-mon0@0 won leader election with quorum 0
- 2017-07-11 13:23:46.870341 I | rook-ceph-mon0: 2017-07-11 13:23:45.483848 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2 : cluster [INF] mon.rook-ceph-mon0@0 won leader election with quorum 0
- 2017-07-11 13:23:46.870361 I | rook-ceph-mon0: 2017-07-11 13:23:45.499259 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 3 : cluster [INF] monmap e1: 1 mons at {rook-ceph-mon0=10.233.76.3:6790/0}
- 2017-07-11 13:23:46.870365 I | rook-ceph-mon0: 2017-07-11 13:23:45.610357 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 4 : cluster [INF] pgmap 0 pgs: ; 0 bytes data, 0 kB used, 0 kB / 0 kB avail
- 2017-07-11 13:23:46.870368 I | rook-ceph-mon0: 2017-07-11 13:23:45.688565 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 5 : cluster [INF] fsmap
- 2017-07-11 13:23:46.870407 I | rook-ceph-mon0: 2017-07-11 13:23:45.704448 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 6 : cluster [INF] osdmap e1: 0 total, 0 up, 0 in
- 2017-07-11 13:23:46.870411 I | rook-ceph-mon0: 2017-07-11 13:23:45.705260 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 7 : cluster [INF] mgrmap e1: no daemons active
- 2017-07-11 13:23:54.238403 I | rook-ceph-mon0: 2017-07-11 13:23:54.238300 7f7c4854e700 0 -- 10.233.76.3:6790/0 >> 10.233.99.4:6790/0 conn(0x55a627da4800 :6790 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 0 vs existing csq=1 existing_state=STATE_STANDBY
- 2017-07-11 13:23:54.238480 I | rook-ceph-mon0: 2017-07-11 13:23:54.238312 7f7c4854e700 0 -- 10.233.76.3:6790/0 >> 10.233.99.4:6790/0 conn(0x55a627da4800 :6790 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept peer reset, then tried to connect to us, replacing
- 2017-07-11 13:23:54.252789 I | rook-ceph-mon0: 2017-07-11 13:23:54.250573 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader).monmap v1 adding/updating rook-ceph-mon1 at 10.233.99.4:6790/0 to monitor cluster
- 2017-07-11 13:23:54.308835 I | rook-ceph-mon0: 2017-07-11 13:23:54.308799 7f7c4bd55700 0 log_channel(cluster) log [INF] : mon.rook-ceph-mon0 calling new monitor election
- 2017-07-11 13:23:56.200400 I | rook-ceph-mon0: 2017-07-11 13:23:56.200307 7f7c48d4f700 0 -- 10.233.76.3:6790/0 >> 10.233.99.4:6790/0 conn(0x55a627dde800 :6790 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 0 vs existing csq=1 existing_state=STATE_STANDBY
- 2017-07-11 13:23:56.200470 I | rook-ceph-mon0: 2017-07-11 13:23:56.200317 7f7c48d4f700 0 -- 10.233.76.3:6790/0 >> 10.233.99.4:6790/0 conn(0x55a627dde800 :6790 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept peer reset, then tried to connect to us, replacing
- 2017-07-11 13:23:57.584450 I | rook-ceph-mon0: 2017-07-11 13:23:57.584348 7f7c48d4f700 0 -- 10.233.76.3:6790/0 >> 10.233.124.3:6790/0 conn(0x55a627df8800 :6790 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 0 vs existing csq=1 existing_state=STATE_STANDBY
- 2017-07-11 13:23:57.584481 I | rook-ceph-mon0: 2017-07-11 13:23:57.584357 7f7c48d4f700 0 -- 10.233.76.3:6790/0 >> 10.233.124.3:6790/0 conn(0x55a627df8800 :6790 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept peer reset, then tried to connect to us, replacing
- 2017-07-11 13:23:59.508307 I | rook-ceph-mon0: 2017-07-11 13:23:59.508261 7f7c4bd55700 0 log_channel(cluster) log [INF] : mon.rook-ceph-mon0@0 won leader election with quorum 0,1
- 2017-07-11 13:23:59.552500 I | rook-ceph-mon0: 2017-07-11 13:23:59.552454 7f7c4bd55700 0 log_channel(cluster) log [INF] : HEALTH_ERR; no osds
- 2017-07-11 13:23:59.827014 I | rook-ceph-mon0: 2017-07-11 13:23:59.826980 7f7c4bd55700 0 log_channel(cluster) log [INF] : monmap e2: 2 mons at {rook-ceph-mon0=10.233.76.3:6790/0,rook-ceph-mon1=10.233.99.4:6790/0}
- 2017-07-11 13:23:59.827345 I | rook-ceph-mon0: 2017-07-11 13:23:59.827329 7f7c4bd55700 0 log_channel(cluster) log [INF] : fsmap
- 2017-07-11 13:23:59.827540 I | rook-ceph-mon0: 2017-07-11 13:23:59.827523 7f7c4bd55700 0 log_channel(cluster) log [INF] : osdmap e1: 0 total, 0 up, 0 in
- 2017-07-11 13:23:59.828224 I | rook-ceph-mon0: 2017-07-11 13:23:59.828206 7f7c4bd55700 0 log_channel(cluster) log [INF] : mgrmap e1: no daemons active
- 2017-07-11 13:23:59.828441 I | rook-ceph-mon0: 2017-07-11 13:23:59.828425 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader).monmap v2 adding/updating rook-ceph-mon2 at 10.233.124.3:6790/0 to monitor cluster
- 2017-07-11 13:24:00.108562 I | rook-ceph-mon0: 2017-07-11 13:24:00.108529 7f7c4bd55700 0 log_channel(cluster) log [INF] : mon.rook-ceph-mon0 calling new monitor election
- 2017-07-11 13:24:01.520974 I | rook-ceph-mon0: 2017-07-11 13:24:01.520878 7f7c4854e700 0 -- 10.233.76.3:6790/0 >> 10.233.124.3:6790/0 conn(0x55a627e44000 :6790 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 0 vs existing csq=1 existing_state=STATE_STANDBY
- 2017-07-11 13:24:01.521065 I | rook-ceph-mon0: 2017-07-11 13:24:01.520889 7f7c4854e700 0 -- 10.233.76.3:6790/0 >> 10.233.124.3:6790/0 conn(0x55a627e44000 :6790 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept peer reset, then tried to connect to us, replacing
- 2017-07-11 13:24:05.263795 I | rook-ceph-mon0: 2017-07-11 13:24:05.263758 7f7c4bd55700 0 log_channel(cluster) log [INF] : mon.rook-ceph-mon0@0 won leader election with quorum 0,1,2
- 2017-07-11 13:24:05.280372 I | rook-ceph-mon0: 2017-07-11 13:24:05.280337 7f7c4bd55700 0 log_channel(cluster) log [INF] : HEALTH_ERR; no osds
- 2017-07-11 13:24:05.448145 I | rook-ceph-mon0: 2017-07-11 13:24:05.448110 7f7c4bd55700 0 log_channel(cluster) log [INF] : monmap e3: 3 mons at {rook-ceph-mon0=10.233.76.3:6790/0,rook-ceph-mon1=10.233.99.4:6790/0,rook-ceph-mon2=10.233.124.3:6790/0}
- 2017-07-11 13:24:05.448448 I | rook-ceph-mon0: 2017-07-11 13:24:05.448431 7f7c4bd55700 0 log_channel(cluster) log [INF] : fsmap
- 2017-07-11 13:24:05.448706 I | rook-ceph-mon0: 2017-07-11 13:24:05.448685 7f7c4bd55700 0 log_channel(cluster) log [INF] : osdmap e1: 0 total, 0 up, 0 in
- 2017-07-11 13:24:05.449664 I | rook-ceph-mon0: 2017-07-11 13:24:05.449645 7f7c4bd55700 0 log_channel(cluster) log [INF] : mgrmap e1: no daemons active
- 2017-07-11 13:24:05.927128 I | rook-ceph-mon0: 2017-07-11 13:23:56.211454 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 1 : cluster [INF] mon.rook-ceph-mon1 calling new monitor election
- 2017-07-11 13:24:05.927252 I | rook-ceph-mon0: 2017-07-11 13:24:00.108593 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 15 : cluster [INF] mon.rook-ceph-mon0 calling new monitor election
- 2017-07-11 13:24:05.927298 I | rook-ceph-mon0: 2017-07-11 13:24:05.263887 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 16 : cluster [INF] mon.rook-ceph-mon0@0 won leader election with quorum 0,1,2
- 2017-07-11 13:24:05.927313 I | rook-ceph-mon0: 2017-07-11 13:24:05.280481 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 17 : cluster [INF] HEALTH_ERR; no osds
- 2017-07-11 13:24:06.057462 I | rook-ceph-mon0: 2017-07-11 13:24:06.057425 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:24:06.057593 I | rook-ceph-mon0: 2017-07-11 13:24:06.057575 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/368521061' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:24:07.011945 I | rook-ceph-mon0: 2017-07-11 13:24:07.011907 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"profile": "firefly", "prefix": "osd crush tunables", "format": "plain"} v 0) v1
- 2017-07-11 13:24:07.012024 I | rook-ceph-mon0: 2017-07-11 13:24:07.012005 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.99.0:0/3047177237' entity='client.admin' cmd=[{"profile": "firefly", "prefix": "osd crush tunables", "format": "plain"}]: dispatch
- 2017-07-11 13:24:07.075151 I | rook-ceph-mon0: 2017-07-11 13:24:00.170561 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 2 : cluster [INF] mon.rook-ceph-mon1 calling new monitor election
- 2017-07-11 13:24:07.075252 I | rook-ceph-mon0: 2017-07-11 13:24:01.517487 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 1 : cluster [INF] mon.rook-ceph-mon2 calling new monitor election
- 2017-07-11 13:24:07.075376 I | rook-ceph-mon0: 2017-07-11 13:24:05.448242 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 18 : cluster [INF] monmap e3: 3 mons at {rook-ceph-mon0=10.233.76.3:6790/0,rook-ceph-mon1=10.233.99.4:6790/0,rook-ceph-mon2=10.233.124.3:6790/0}
- 2017-07-11 13:24:07.075397 I | rook-ceph-mon0: 2017-07-11 13:24:05.448482 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 19 : cluster [INF] fsmap
- 2017-07-11 13:24:07.075426 I | rook-ceph-mon0: 2017-07-11 13:24:05.448744 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 20 : cluster [INF] osdmap e1: 0 total, 0 up, 0 in
- 2017-07-11 13:24:07.075525 I | rook-ceph-mon0: 2017-07-11 13:24:05.449703 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 21 : cluster [INF] mgrmap e1: no daemons active
- 2017-07-11 13:24:07.301990 I | rook-ceph-mon0: 2017-07-11 13:24:07.301501 7f7c4754c700 0 mon.rook-ceph-mon0@0(leader).osd e2 crush map has features 283675107524608, adjusting msgr requires
- 2017-07-11 13:24:07.302111 I | rook-ceph-mon0: 2017-07-11 13:24:07.302093 7f7c4754c700 0 mon.rook-ceph-mon0@0(leader).osd e2 crush map has features 283675107524608, adjusting msgr requires
- 2017-07-11 13:24:07.302244 I | rook-ceph-mon0: 2017-07-11 13:24:07.302228 7f7c4754c700 0 mon.rook-ceph-mon0@0(leader).osd e2 crush map has features 720859615486820352, adjusting msgr requires
- 2017-07-11 13:24:07.302302 I | rook-ceph-mon0: 2017-07-11 13:24:07.302264 7f7c4754c700 0 mon.rook-ceph-mon0@0(leader).osd e2 crush map has features 283675107524608, adjusting msgr requires
- 2017-07-11 13:24:07.302777 I | rook-ceph-mon0: 2017-07-11 13:24:07.302712 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.99.0:0/3047177237' entity='client.admin' cmd='[{"profile": "firefly", "prefix": "osd crush tunables", "format": "plain"}]': finished
- 2017-07-11 13:24:07.303025 I | rook-ceph-mon0: 2017-07-11 13:24:07.302951 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e2: 0 total, 0 up, 0 in
- 2017-07-11 13:24:08.197559 I | rook-ceph-mon0: 2017-07-11 13:24:07.012032 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 23 : audit [INF] from='client.? 10.233.99.0:0/3047177237' entity='client.admin' cmd=[{"profile": "firefly", "prefix": "osd crush tunables", "format": "plain"}]: dispatch
- 2017-07-11 13:24:08.197653 I | rook-ceph-mon0: 2017-07-11 13:24:07.302815 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 24 : audit [INF] from='client.? 10.233.99.0:0/3047177237' entity='client.admin' cmd='[{"profile": "firefly", "prefix": "osd crush tunables", "format": "plain"}]': finished
- 2017-07-11 13:24:08.197875 I | rook-ceph-mon0: 2017-07-11 13:24:07.303065 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 25 : cluster [INF] osdmap e2: 0 total, 0 up, 0 in
- 2017-07-11 13:24:08.339081 I | rook-ceph-mon0: 2017-07-11 13:24:08.339044 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd setcrushmap", "format": "json"} v 0) v1
- 2017-07-11 13:24:08.339317 I | rook-ceph-mon0: 2017-07-11 13:24:08.339277 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.4102 -' entity='client.admin' cmd=[{"prefix": "osd setcrushmap", "format": "json"}]: dispatch
- 2017-07-11 13:24:09.302071 I | rook-ceph-mon0: 2017-07-11 13:24:08.278326 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 3 : audit [INF] from='client.? 10.233.99.2:0/1924409' entity='client.admin' cmd=[{"prefix": "osd setcrushmap", "format": "json"}]: dispatch
- 2017-07-11 13:24:09.302172 I | rook-ceph-mon0: 2017-07-11 13:24:08.339350 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 26 : audit [INF] from='client.4102 -' entity='client.admin' cmd=[{"prefix": "osd setcrushmap", "format": "json"}]: dispatch
- 2017-07-11 13:24:09.590059 I | rook-ceph-mon0: 2017-07-11 13:24:09.589988 7f7c4754c700 0 mon.rook-ceph-mon0@0(leader).osd e3 crush map has features 2200130813952, adjusting msgr requires
- 2017-07-11 13:24:09.590247 I | rook-ceph-mon0: 2017-07-11 13:24:09.590159 7f7c4754c700 0 mon.rook-ceph-mon0@0(leader).osd e3 crush map has features 2200130813952, adjusting msgr requires
- 2017-07-11 13:24:09.590300 I | rook-ceph-mon0: 2017-07-11 13:24:09.590285 7f7c4754c700 0 mon.rook-ceph-mon0@0(leader).osd e3 crush map has features 720578140510109696, adjusting msgr requires
- 2017-07-11 13:24:09.590361 I | rook-ceph-mon0: 2017-07-11 13:24:09.590331 7f7c4754c700 0 mon.rook-ceph-mon0@0(leader).osd e3 crush map has features 2200130813952, adjusting msgr requires
- 2017-07-11 13:24:09.590861 I | rook-ceph-mon0: 2017-07-11 13:24:09.590786 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.4102 -' entity='client.admin' cmd='[{"prefix": "osd setcrushmap", "format": "json"}]': finished
- 2017-07-11 13:24:09.591209 I | rook-ceph-mon0: 2017-07-11 13:24:09.591135 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e3: 0 total, 0 up, 0 in
- 2017-07-11 13:24:10.657543 I | rook-ceph-mon0: 2017-07-11 13:24:09.590922 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 27 : audit [INF] from='client.4102 -' entity='client.admin' cmd='[{"prefix": "osd setcrushmap", "format": "json"}]': finished
- 2017-07-11 13:24:10.657858 I | rook-ceph-mon0: 2017-07-11 13:24:09.591245 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 28 : cluster [INF] osdmap e3: 0 total, 0 up, 0 in
- 2017-07-11 13:24:10.897894 I | rook-ceph-mon0: 2017-07-11 13:24:10.897810 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"entity": "mgr.rook-ceph-mgr0", "prefix": "auth get-or-create-key", "caps": ["mon", "allow *"], "format": "json"} v 0) v1
- 2017-07-11 13:24:10.897993 I | rook-ceph-mon0: 2017-07-11 13:24:10.897836 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.4103 -' entity='client.admin' cmd=[{"entity": "mgr.rook-ceph-mgr0", "prefix": "auth get-or-create-key", "caps": ["mon", "allow *"], "format": "json"}]: dispatch
- 2017-07-11 13:24:11.020292 I | rook-ceph-mon0: 2017-07-11 13:24:11.020185 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.4103 -' entity='client.admin' cmd='[{"entity": "mgr.rook-ceph-mgr0", "prefix": "auth get-or-create-key", "caps": ["mon", "allow *"], "format": "json"}]': finished
- 2017-07-11 13:24:11.824329 I | rook-ceph-mon0: 2017-07-11 13:24:10.844669 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 2 : audit [INF] from='client.? 10.233.99.0:0/1815105145' entity='client.admin' cmd=[{"entity": "mgr.rook-ceph-mgr0", "prefix": "auth get-or-create-key", "caps": ["mon", "allow *"], "format": "json"}]: dispatch
- 2017-07-11 13:24:11.824419 I | rook-ceph-mon0: 2017-07-11 13:24:10.897838 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 29 : audit [INF] from='client.4103 -' entity='client.admin' cmd=[{"entity": "mgr.rook-ceph-mgr0", "prefix": "auth get-or-create-key", "caps": ["mon", "allow *"], "format": "json"}]: dispatch
- 2017-07-11 13:24:11.824438 I | rook-ceph-mon0: 2017-07-11 13:24:11.020381 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 30 : audit [INF] from='client.4103 -' entity='client.admin' cmd='[{"entity": "mgr.rook-ceph-mgr0", "prefix": "auth get-or-create-key", "caps": ["mon", "allow *"], "format": "json"}]': finished
- 2017-07-11 13:24:13.364651 I | rook-ceph-mon0: 2017-07-11 13:24:13.364580 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"} v 0) v1
- 2017-07-11 13:24:13.364729 I | rook-ceph-mon0: 2017-07-11 13:24:13.364713 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.4105 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 13:24:13.703913 I | rook-ceph-mon0: 2017-07-11 13:24:13.703818 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.4105 -' entity='client.admin' cmd='[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]': finished
- 2017-07-11 13:24:13.924539 I | rook-ceph-mon0: 2017-07-11 13:24:13.364737 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 31 : audit [INF] from='client.4105 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 13:24:13.924584 I | rook-ceph-mon0: 2017-07-11 13:24:13.371310 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 4 : audit [INF] from='client.? 10.233.99.0:0/329149194' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 13:24:15.091670 I | rook-ceph-mon0: 2017-07-11 13:24:13.703951 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 32 : audit [INF] from='client.4105 -' entity='client.admin' cmd='[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]': finished
- 2017-07-11 13:24:18.403019 I | rook-ceph-mon0: 2017-07-11 13:24:18.018558 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 3 : cluster [WRN] message from mon.0 was stamped 0.073977s in the future, clocks not synchronized
- 2017-07-11 13:24:20.420055 I | rook-ceph-mon0: 2017-07-11 13:24:20.420020 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd create", "uuid": "87446daf-adb9-4330-b384-dc39dca0e7d4", "format": "json"} v 0) v1
- 2017-07-11 13:24:20.426124 I | rook-ceph-mon0: 2017-07-11 13:24:20.426101 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.4106 -' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "87446daf-adb9-4330-b384-dc39dca0e7d4", "format": "json"}]: dispatch
- 2017-07-11 13:24:20.459868 I | rook-ceph-mon0: 2017-07-11 13:24:20.459834 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd create", "uuid": "73875ada-81e5-484d-a5cb-4fd39d3ea97f", "format": "json"} v 0) v1
- 2017-07-11 13:24:20.459982 I | rook-ceph-mon0: 2017-07-11 13:24:20.459966 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.76.4:0/3208763407' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "73875ada-81e5-484d-a5cb-4fd39d3ea97f", "format": "json"}]: dispatch
- 2017-07-11 13:24:20.658893 I | rook-ceph-mon0: 2017-07-11 13:24:20.363489 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 4 : audit [INF] from='client.? 10.233.72.0:0/3023866456' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "87446daf-adb9-4330-b384-dc39dca0e7d4", "format": "json"}]: dispatch
- 2017-07-11 13:24:20.658987 I | rook-ceph-mon0: 2017-07-11 13:24:20.426137 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 33 : audit [INF] from='client.4106 -' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "87446daf-adb9-4330-b384-dc39dca0e7d4", "format": "json"}]: dispatch
- 2017-07-11 13:24:20.659024 I | rook-ceph-mon0: 2017-07-11 13:24:20.460061 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 34 : audit [INF] from='client.? 10.233.76.4:0/3208763407' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "73875ada-81e5-484d-a5cb-4fd39d3ea97f", "format": "json"}]: dispatch
- 2017-07-11 13:24:20.863211 I | rook-ceph-mon0: 2017-07-11 13:24:20.862018 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.4106 -' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "87446daf-adb9-4330-b384-dc39dca0e7d4", "format": "json"}]': finished
- 2017-07-11 13:24:20.863300 I | rook-ceph-mon0: 2017-07-11 13:24:20.862057 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.76.4:0/3208763407' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "73875ada-81e5-484d-a5cb-4fd39d3ea97f", "format": "json"}]': finished
- 2017-07-11 13:24:20.863318 I | rook-ceph-mon0: 2017-07-11 13:24:20.862082 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e4: 2 total, 0 up, 0 in
- 2017-07-11 13:24:21.060070 I | rook-ceph-mon0: 2017-07-11 13:24:21.059903 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd create", "uuid": "0623e5ff-56df-42b2-b682-76e1b77cba81", "format": "json"} v 0) v1
- 2017-07-11 13:24:21.060153 I | rook-ceph-mon0: 2017-07-11 13:24:21.059933 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.69.0:0/2353069969' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "0623e5ff-56df-42b2-b682-76e1b77cba81", "format": "json"}]: dispatch
- 2017-07-11 13:24:21.332306 I | rook-ceph-mon0: 2017-07-11 13:24:21.332266 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd create", "uuid": "cd112926-e214-4caa-9506-6797fb79af42", "format": "json"} v 0) v1
- 2017-07-11 13:24:21.332489 I | rook-ceph-mon0: 2017-07-11 13:24:21.332463 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.86.0:0/4247247533' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "cd112926-e214-4caa-9506-6797fb79af42", "format": "json"}]: dispatch
- 2017-07-11 13:24:21.409532 I | rook-ceph-mon0: 2017-07-11 13:24:21.409496 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon getmap", "format": "json"} v 0) v1
- 2017-07-11 13:24:21.412203 I | rook-ceph-mon0: 2017-07-11 13:24:21.412181 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.72.0:0/460789116' entity='client.admin' cmd=[{"prefix": "mon getmap", "format": "json"}]: dispatch
- 2017-07-11 13:24:21.846580 I | rook-ceph-mon0: 2017-07-11 13:24:21.846505 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd create", "uuid": "7fa3db3b-e42c-44ec-ac2c-d78a63760e1b", "format": "json"} v 0) v1
- 2017-07-11 13:24:21.846838 I | rook-ceph-mon0: 2017-07-11 13:24:21.846820 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.4112 -' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "7fa3db3b-e42c-44ec-ac2c-d78a63760e1b", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.013088 I | rook-ceph-mon0: 2017-07-11 13:24:20.862019 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 35 : audit [INF] from='client.4106 -' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "87446daf-adb9-4330-b384-dc39dca0e7d4", "format": "json"}]': finished
- 2017-07-11 13:24:22.013155 I | rook-ceph-mon0: 2017-07-11 13:24:20.862058 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 36 : audit [INF] from='client.? 10.233.76.4:0/3208763407' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "73875ada-81e5-484d-a5cb-4fd39d3ea97f", "format": "json"}]': finished
- 2017-07-11 13:24:22.013173 I | rook-ceph-mon0: 2017-07-11 13:24:21.059934 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 38 : audit [INF] from='client.? 10.233.69.0:0/2353069969' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "0623e5ff-56df-42b2-b682-76e1b77cba81", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.013189 I | rook-ceph-mon0: 2017-07-11 13:24:21.332571 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 39 : audit [INF] from='client.? 10.233.86.0:0/4247247533' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "cd112926-e214-4caa-9506-6797fb79af42", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.013223 I | rook-ceph-mon0: 2017-07-11 13:24:21.845081 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 5 : audit [INF] from='client.? 10.233.124.4:0/2258242595' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "7fa3db3b-e42c-44ec-ac2c-d78a63760e1b", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.014047 I | rook-ceph-mon0: 2017-07-11 13:24:20.862083 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 37 : cluster [INF] osdmap e4: 2 total, 0 up, 0 in
- 2017-07-11 13:24:22.307839 I | rook-ceph-mon0: 2017-07-11 13:24:22.307744 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.69.0:0/2353069969' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "0623e5ff-56df-42b2-b682-76e1b77cba81", "format": "json"}]': finished
- 2017-07-11 13:24:22.308197 I | rook-ceph-mon0: 2017-07-11 13:24:22.308179 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.86.0:0/4247247533' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "cd112926-e214-4caa-9506-6797fb79af42", "format": "json"}]': finished
- 2017-07-11 13:24:22.308423 I | rook-ceph-mon0: 2017-07-11 13:24:22.308407 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.4112 -' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "7fa3db3b-e42c-44ec-ac2c-d78a63760e1b", "format": "json"}]': finished
- 2017-07-11 13:24:22.309175 I | rook-ceph-mon0: 2017-07-11 13:24:22.309156 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e5: 5 total, 0 up, 0 in
- 2017-07-11 13:24:22.739017 I | rook-ceph-mon0: 2017-07-11 13:24:22.738946 7f7c4754c700 0 log_channel(cluster) log [INF] : mgrmap e2: rook-ceph-mgr0(active, starting)
- 2017-07-11 13:24:22.894952 I | rook-ceph-mon0: 2017-07-11 13:24:22.894916 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd create", "uuid": "9771b2a8-0591-4ce0-ba50-846d5c052724", "format": "json"} v 0) v1
- 2017-07-11 13:24:22.895175 I | rook-ceph-mon0: 2017-07-11 13:24:22.895086 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.4111 -' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "9771b2a8-0591-4ce0-ba50-846d5c052724", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.895538 I | rook-ceph-mon0: 2017-07-11 13:24:22.895521 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon getmap", "format": "json"} v 0) v1
- 2017-07-11 13:24:22.895607 I | rook-ceph-mon0: 2017-07-11 13:24:22.895593 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.4:0/3123968841' entity='client.admin' cmd=[{"prefix": "mon getmap", "format": "json"}]: dispatch
- 2017-07-11 13:24:23.170934 I | rook-ceph-mon0: 2017-07-11 13:24:21.846875 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 41 : audit [INF] from='client.4112 -' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "7fa3db3b-e42c-44ec-ac2c-d78a63760e1b", "format": "json"}]: dispatch
- 2017-07-11 13:24:23.172416 I | rook-ceph-mon0: 2017-07-11 13:24:22.307936 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 42 : audit [INF] from='client.? 10.233.69.0:0/2353069969' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "0623e5ff-56df-42b2-b682-76e1b77cba81", "format": "json"}]': finished
- 2017-07-11 13:24:23.172468 I | rook-ceph-mon0: 2017-07-11 13:24:22.308241 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 43 : audit [INF] from='client.? 10.233.86.0:0/4247247533' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "cd112926-e214-4caa-9506-6797fb79af42", "format": "json"}]': finished
- 2017-07-11 13:24:23.172553 I | rook-ceph-mon0: 2017-07-11 13:24:22.308455 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 44 : audit [INF] from='client.4112 -' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "7fa3db3b-e42c-44ec-ac2c-d78a63760e1b", "format": "json"}]': finished
- 2017-07-11 13:24:23.172585 I | rook-ceph-mon0: 2017-07-11 13:24:22.895280 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 47 : audit [INF] from='client.4111 -' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "9771b2a8-0591-4ce0-ba50-846d5c052724", "format": "json"}]: dispatch
- 2017-07-11 13:24:23.172599 I | rook-ceph-mon0: 2017-07-11 13:24:22.901821 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 6 : audit [INF] from='client.? 10.233.99.6:0/1526158553' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "9771b2a8-0591-4ce0-ba50-846d5c052724", "format": "json"}]: dispatch
- 2017-07-11 13:24:23.172614 I | rook-ceph-mon0: 2017-07-11 13:24:22.309218 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 45 : cluster [INF] osdmap e5: 5 total, 0 up, 0 in
- 2017-07-11 13:24:23.172627 I | rook-ceph-mon0: 2017-07-11 13:24:22.738947 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 46 : cluster [INF] mgrmap e2: rook-ceph-mgr0(active, starting)
- 2017-07-11 13:24:23.247018 I | rook-ceph-mon0: 2017-07-11 13:24:23.246982 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"entity": "osd.0", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"} v 0) v1
- 2017-07-11 13:24:23.247391 I | rook-ceph-mon0: 2017-07-11 13:24:23.247366 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.72.0:0/3883659066' entity='client.admin' cmd=[{"entity": "osd.0", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:23.376817 I | rook-ceph-mon0: 2017-07-11 13:24:23.376710 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.72.0:0/3883659066' entity='client.admin' cmd='[{"entity": "osd.0", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:23.446762 I | rook-ceph-mon0: 2017-07-11 13:24:23.446723 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"entity": "osd.1", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"} v 0) v1
- 2017-07-11 13:24:23.446890 I | rook-ceph-mon0: 2017-07-11 13:24:23.446874 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.4127 -' entity='client.admin' cmd=[{"entity": "osd.1", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:23.624526 I | rook-ceph-mon0: 2017-07-11 13:24:23.624354 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.4127 -' entity='client.admin' cmd='[{"entity": "osd.1", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:23.816792 I | rook-ceph-mon0: 2017-07-11 13:24:23.816753 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 0, "weight": 0.0946, "format": "json"} v 0) v1
- 2017-07-11 13:24:23.826349 I | rook-ceph-mon0: 2017-07-11 13:24:23.826307 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.72.0:0/3273515169' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 0, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:24.098202 I | rook-ceph-mon0: 2017-07-11 13:24:24.097954 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.4111 -' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "9771b2a8-0591-4ce0-ba50-846d5c052724", "format": "json"}]': finished
- 2017-07-11 13:24:24.098290 I | rook-ceph-mon0: 2017-07-11 13:24:24.098080 7f7c4754c700 0 mon.rook-ceph-mon0@0(leader).osd e6 create-or-move crush item name 'osd.0' initial_weight 0.0946 at location {root=default}
- 2017-07-11 13:24:24.098310 I | rook-ceph-mon0: 2017-07-11 13:24:24.098132 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e6: 6 total, 0 up, 0 in
- 2017-07-11 13:24:24.554461 I | rook-ceph-mon0: 2017-07-11 13:24:23.247532 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 49 : audit [INF] from='client.? 10.233.72.0:0/3883659066' entity='client.admin' cmd=[{"entity": "osd.0", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:24.554545 I | rook-ceph-mon0: 2017-07-11 13:24:23.373766 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 11 : audit [INF] from='client.? 10.233.76.0:0/1251607715' entity='client.admin' cmd=[{"entity": "osd.1", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:24.554563 I | rook-ceph-mon0: 2017-07-11 13:24:23.376712 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 50 : audit [INF] from='client.? 10.233.72.0:0/3883659066' entity='client.admin' cmd='[{"entity": "osd.0", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:24.554607 I | rook-ceph-mon0: 2017-07-11 13:24:23.447026 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 51 : audit [INF] from='client.4127 -' entity='client.admin' cmd=[{"entity": "osd.1", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:24.554628 I | rook-ceph-mon0: 2017-07-11 13:24:23.624355 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 52 : audit [INF] from='client.4127 -' entity='client.admin' cmd='[{"entity": "osd.1", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:24.554641 I | rook-ceph-mon0: 2017-07-11 13:24:23.826405 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 53 : audit [INF] from='client.? 10.233.72.0:0/3273515169' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 0, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:24.554653 I | rook-ceph-mon0: 2017-07-11 13:24:24.097956 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 54 : audit [INF] from='client.4111 -' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "9771b2a8-0591-4ce0-ba50-846d5c052724", "format": "json"}]': finished
- 2017-07-11 13:24:24.554963 I | rook-ceph-mon0: 2017-07-11 13:24:24.098133 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 55 : cluster [INF] osdmap e6: 6 total, 0 up, 0 in
- 2017-07-11 13:24:24.653479 I | rook-ceph-mon0: 2017-07-11 13:24:24.653438 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 1, "weight": 0.0946, "format": "json"} v 0) v1
- 2017-07-11 13:24:24.653754 I | rook-ceph-mon0: 2017-07-11 13:24:24.653713 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.4117 -' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 1, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:24.653994 I | rook-ceph-mon0: 2017-07-11 13:24:24.653966 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader).osd e6 create-or-move crush item name 'osd.1' initial_weight 0.0946 at location {root=default}
- 2017-07-11 13:24:25.063861 I | rook-ceph-mon0: 2017-07-11 13:24:25.063823 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"entity": "osd.3", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"} v 0) v1
- 2017-07-11 13:24:25.064216 I | rook-ceph-mon0: 2017-07-11 13:24:25.063970 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.4120 -' entity='client.admin' cmd=[{"entity": "osd.3", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:25.169094 I | rook-ceph-mon0: 2017-07-11 13:24:25.168890 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.4120 -' entity='client.admin' cmd='[{"entity": "osd.3", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:25.427459 I | rook-ceph-mon0: 2017-07-11 13:24:25.427334 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.72.0:0/3273515169' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 0, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:25.427740 I | rook-ceph-mon0: 2017-07-11 13:24:25.427725 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.4117 -' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 1, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:25.427996 I | rook-ceph-mon0: 2017-07-11 13:24:25.427981 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e7: 6 total, 0 up, 0 in
- 2017-07-11 13:24:25.752197 I | rook-ceph-mon0: 2017-07-11 13:24:25.752106 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 3, "weight": 0.0946, "format": "json"} v 0) v1
- 2017-07-11 13:24:25.752305 I | rook-ceph-mon0: 2017-07-11 13:24:25.752139 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.4129 -' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 3, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:25.752731 I | rook-ceph-mon0: 2017-07-11 13:24:25.752592 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader).osd e7 create-or-move crush item name 'osd.3' initial_weight 0.0946 at location {root=default}
- 2017-07-11 13:24:25.864108 I | rook-ceph-mon0: 2017-07-11 13:24:25.864077 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "id": 0, "weight":0.0946, "args": ["host=master-1", "root=default"]} v 0) v1
- 2017-07-11 13:24:25.864239 I | rook-ceph-mon0: 2017-07-11 13:24:25.864196 7f7c4bd55700 0 log_channel(audit) log [INF] : from='osd.0 10.233.72.0:6800/180' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0946, "args": ["host=master-1", "root=default"]}]: dispatch
- 2017-07-11 13:24:25.869162 I | rook-ceph-mon0: 2017-07-11 13:24:25.864428 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader).osd e7 create-or-move crush item name 'osd.0' initial_weight 0.0946 at location {host=master-1,root=default}
- 2017-07-11 13:24:25.896533 I | rook-ceph-mon0: 2017-07-11 13:24:25.896040 7f7c4754c700 0 log_channel(cluster) log [INF] : mgrmap e3: rook-ceph-mgr0(active)
- 2017-07-11 13:24:25.968545 I | rook-ceph-mon0: 2017-07-11 13:24:25.968231 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"entity": "osd.2", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"} v 0) v1
- 2017-07-11 13:24:25.968643 I | rook-ceph-mon0: 2017-07-11 13:24:25.968268 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.69.0:0/1725450048' entity='client.admin' cmd=[{"entity": "osd.2", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:26.095764 I | rook-ceph-mon0: 2017-07-11 13:24:24.414311 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 14 : audit [INF] from='client.? 10.233.76.0:0/3770583375' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 1, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:26.095834 I | rook-ceph-mon0: 2017-07-11 13:24:24.653786 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 56 : audit [INF] from='client.4117 -' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 1, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:26.095886 I | rook-ceph-mon0: 2017-07-11 13:24:24.854871 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 15 : audit [INF] from='client.? 10.233.86.0:0/2946127837' entity='client.admin' cmd=[{"entity": "osd.3", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:26.095902 I | rook-ceph-mon0: 2017-07-11 13:24:25.064304 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 57 : audit [INF] from='client.4120 -' entity='client.admin' cmd=[{"entity": "osd.3", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:26.095967 I | rook-ceph-mon0: 2017-07-11 13:24:25.168891 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 58 : audit [INF] from='client.4120 -' entity='client.admin' cmd='[{"entity": "osd.3", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:26.095988 I | rook-ceph-mon0: 2017-07-11 13:24:25.427547 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 59 : audit [INF] from='client.? 10.233.72.0:0/3273515169' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 0, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:26.096001 I | rook-ceph-mon0: 2017-07-11 13:24:25.427850 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 60 : audit [INF] from='client.4117 -' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 1, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:26.096014 I | rook-ceph-mon0: 2017-07-11 13:24:25.428027 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 61 : cluster [INF] osdmap e7: 6 total, 0 up, 0 in
- 2017-07-11 13:24:26.155490 I | rook-ceph-mon0: 2017-07-11 13:24:26.155429 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "id": 1, "weight":0.0946, "args": ["host=minion-0", "root=default"]} v 0) v1
- 2017-07-11 13:24:26.155751 I | rook-ceph-mon0: 2017-07-11 13:24:26.155734 7f7c4bd55700 0 log_channel(audit) log [INF] : from='osd.1 10.233.76.4:6800/178' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0946, "args": ["host=minion-0", "root=default"]}]: dispatch
- 2017-07-11 13:24:26.156005 I | rook-ceph-mon0: 2017-07-11 13:24:26.155983 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader).osd e7 create-or-move crush item name 'osd.1' initial_weight 0.0946 at location {host=minion-0,root=default}
- 2017-07-11 13:24:26.341025 I | rook-ceph-mon0: 2017-07-11 13:24:26.340947 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.69.0:0/1725450048' entity='client.admin' cmd='[{"entity": "osd.2", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:26.623173 I | rook-ceph-mon0: 2017-07-11 13:24:26.623117 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.4129 -' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 3, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:26.623543 I | rook-ceph-mon0: 2017-07-11 13:24:26.623527 7f7c4754c700 0 log_channel(audit) log [INF] : from='osd.0 10.233.72.0:6800/180' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0946, "args": ["host=master-1", "root=default"]}]': finished
- 2017-07-11 13:24:26.623708 I | rook-ceph-mon0: 2017-07-11 13:24:26.623692 7f7c4754c700 0 log_channel(audit) log [INF] : from='osd.1 10.233.76.4:6800/178' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0946, "args": ["host=minion-0", "root=default"]}]': finished
- 2017-07-11 13:24:26.623850 I | rook-ceph-mon0: 2017-07-11 13:24:26.623799 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e8: 6 total, 0 up, 0 in
- 2017-07-11 13:24:26.832287 I | rook-ceph-mon0: 2017-07-11 13:24:26.832247 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 2, "weight": 0.0946, "format": "json"} v 0) v1
- 2017-07-11 13:24:26.832533 I | rook-ceph-mon0: 2017-07-11 13:24:26.832415 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.69.0:0/1655086740' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 2, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:26.832756 I | rook-ceph-mon0: 2017-07-11 13:24:26.832736 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader).osd e8 create-or-move crush item name 'osd.2' initial_weight 0.0946 at location {root=default}
- 2017-07-11 13:24:26.969240 I | rook-ceph-mon0: 2017-07-11 13:24:26.969203 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"entity": "osd.4", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"} v 0) v1
- 2017-07-11 13:24:26.969315 I | rook-ceph-mon0: 2017-07-11 13:24:26.969293 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.0:0/354492821' entity='client.admin' cmd=[{"entity": "osd.4", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:27.150769 I | rook-ceph-mon0: 2017-07-11 13:24:27.150733 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "id": 3, "weight":0.0946, "args": ["host=master-2", "root=default"]} v 0) v1
- 2017-07-11 13:24:27.151007 I | rook-ceph-mon0: 2017-07-11 13:24:27.150990 7f7c4bd55700 0 log_channel(audit) log [INF] : from='osd.3 10.233.86.0:6800/178' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0946, "args": ["host=master-2", "root=default"]}]: dispatch
- 2017-07-11 13:24:27.151231 I | rook-ceph-mon0: 2017-07-11 13:24:27.151204 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader).osd e8 create-or-move crush item name 'osd.3' initial_weight 0.0946 at location {host=master-2,root=default}
- 2017-07-11 13:24:28.719571 I | rook-ceph-mon0: 2017-07-11 13:24:28.719163 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.0:0/354492821' entity='client.admin' cmd='[{"entity": "osd.4", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:29.041065 I | rook-ceph-mon0: 2017-07-11 13:24:25.686214 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 23 : audit [INF] from='client.? 10.233.86.0:0/4142784513' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 3, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:29.041147 I | rook-ceph-mon0: 2017-07-11 13:24:25.752141 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 62 : audit [INF] from='client.4129 -' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 3, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:29.041165 I | rook-ceph-mon0: 2017-07-11 13:24:25.864248 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 63 : audit [INF] from='osd.0 10.233.72.0:6800/180' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0946, "args": ["host=master-1", "root=default"]}]: dispatch
- 2017-07-11 13:24:29.041208 I | rook-ceph-mon0: 2017-07-11 13:24:25.968277 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 65 : audit [INF] from='client.? 10.233.69.0:0/1725450048' entity='client.admin' cmd=[{"entity": "osd.2", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:29.041223 I | rook-ceph-mon0: 2017-07-11 13:24:26.155792 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 66 : audit [INF] from='osd.1 10.233.76.4:6800/178' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0946, "args": ["host=minion-0", "root=default"]}]: dispatch
- 2017-07-11 13:24:29.041234 I | rook-ceph-mon0: 2017-07-11 13:24:26.340949 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 67 : audit [INF] from='client.? 10.233.69.0:0/1725450048' entity='client.admin' cmd='[{"entity": "osd.2", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:29.041246 I | rook-ceph-mon0: 2017-07-11 13:24:26.623119 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 68 : audit [INF] from='client.4129 -' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 3, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:29.041271 I | rook-ceph-mon0: 2017-07-11 13:24:26.623588 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 69 : audit [INF] from='osd.0 10.233.72.0:6800/180' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0946, "args": ["host=master-1", "root=default"]}]': finished
- 2017-07-11 13:24:29.041285 I | rook-ceph-mon0: 2017-07-11 13:24:26.623745 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 70 : audit [INF] from='osd.1 10.233.76.4:6800/178' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0946, "args": ["host=minion-0", "root=default"]}]': finished
- 2017-07-11 13:24:29.041298 I | rook-ceph-mon0: 2017-07-11 13:24:26.832567 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 72 : audit [INF] from='client.? 10.233.69.0:0/1655086740' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 2, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:29.041309 I | rook-ceph-mon0: 2017-07-11 13:24:26.969323 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 73 : audit [INF] from='client.? 10.233.124.0:0/354492821' entity='client.admin' cmd=[{"entity": "osd.4", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:29.042016 I | rook-ceph-mon0: 2017-07-11 13:24:25.896041 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 64 : cluster [INF] mgrmap e3: rook-ceph-mgr0(active)
- 2017-07-11 13:24:29.042060 I | rook-ceph-mon0: 2017-07-11 13:24:26.623871 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 71 : cluster [INF] osdmap e8: 6 total, 0 up, 0 in
- 2017-07-11 13:24:29.043358 I | rook-ceph-mon0: 2017-07-11 13:24:29.043337 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:24:29.044021 I | rook-ceph-mon0: 2017-07-11 13:24:29.043968 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.1 10.233.76.4:6800/178 boot
- 2017-07-11 13:24:29.044378 I | rook-ceph-mon0: 2017-07-11 13:24:29.044326 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.69.0:0/1655086740' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 2, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:29.044894 I | rook-ceph-mon0: 2017-07-11 13:24:29.044761 7f7c4754c700 0 log_channel(audit) log [INF] : from='osd.3 10.233.86.0:6800/178' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0946, "args": ["host=master-2", "root=default"]}]': finished
- 2017-07-11 13:24:29.045145 I | rook-ceph-mon0: 2017-07-11 13:24:29.045125 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e9: 6 total, 2 up, 2 in
- 2017-07-11 13:24:29.280414 I | rook-ceph-mon0: 2017-07-11 13:24:29.280374 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 4, "weight": 0.0946, "format": "json"} v 0) v1
- 2017-07-11 13:24:29.280664 I | rook-ceph-mon0: 2017-07-11 13:24:29.280546 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.0:0/3518883843' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 4, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:29.280911 I | rook-ceph-mon0: 2017-07-11 13:24:29.280889 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader).osd e9 create-or-move crush item name 'osd.4' initial_weight 0.0946 at location {root=default}
- 2017-07-11 13:24:29.567911 I | rook-ceph-mon0: 2017-07-11 13:24:29.567850 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "id": 2, "weight":0.0946, "args": ["host=master-0", "root=default"]} v 0) v1
- 2017-07-11 13:24:29.568125 I | rook-ceph-mon0: 2017-07-11 13:24:29.568036 7f7c4bd55700 0 log_channel(audit) log [INF] : from='osd.2 -' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0946, "args": ["host=master-0", "root=default"]}]: dispatch
- 2017-07-11 13:24:29.568421 I | rook-ceph-mon0: 2017-07-11 13:24:29.568398 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader).osd e9 create-or-move crush item name 'osd.2' initial_weight 0.0946 at location {host=master-0,root=default}
- 2017-07-11 13:24:30.373649 I | rook-ceph-mon0: 2017-07-11 13:24:27.151038 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 74 : audit [INF] from='osd.3 10.233.86.0:6800/178' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0946, "args": ["host=master-2", "root=default"]}]: dispatch
- 2017-07-11 13:24:30.373709 I | rook-ceph-mon0: 2017-07-11 13:24:28.719165 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 75 : audit [INF] from='client.? 10.233.124.0:0/354492821' entity='client.admin' cmd='[{"entity": "osd.4", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:30.373727 I | rook-ceph-mon0: 2017-07-11 13:24:29.044553 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 78 : audit [INF] from='client.? 10.233.69.0:0/1655086740' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 2, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:30.373742 I | rook-ceph-mon0: 2017-07-11 13:24:29.044957 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 79 : audit [INF] from='osd.3 10.233.86.0:6800/178' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0946, "args": ["host=master-2", "root=default"]}]': finished
- 2017-07-11 13:24:30.373771 I | rook-ceph-mon0: 2017-07-11 13:24:29.280696 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 81 : audit [INF] from='client.? 10.233.124.0:0/3518883843' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 4, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:30.373784 I | rook-ceph-mon0: 2017-07-11 13:24:29.504937 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 12 : audit [INF] from='osd.2 10.233.69.0:6800/178' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0946, "args": ["host=master-0", "root=default"]}]: dispatch
- 2017-07-11 13:24:30.373797 I | rook-ceph-mon0: 2017-07-11 13:24:29.568221 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 82 : audit [INF] from='osd.2 -' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0946, "args": ["host=master-0", "root=default"]}]: dispatch
- 2017-07-11 13:24:30.374049 I | rook-ceph-mon0: 2017-07-11 13:24:29.043632 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 76 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:24:30.374095 I | rook-ceph-mon0: 2017-07-11 13:24:29.044061 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 77 : cluster [INF] osd.1 10.233.76.4:6800/178 boot
- 2017-07-11 13:24:30.374125 I | rook-ceph-mon0: 2017-07-11 13:24:29.045183 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 80 : cluster [INF] osdmap e9: 6 total, 2 up, 2 in
- 2017-07-11 13:24:30.375158 I | rook-ceph-mon0: 2017-07-11 13:24:30.375139 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:24:30.375551 I | rook-ceph-mon0: 2017-07-11 13:24:30.375520 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.0:0/3518883843' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 4, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:30.375757 I | rook-ceph-mon0: 2017-07-11 13:24:30.375727 7f7c4754c700 0 log_channel(audit) log [INF] : from='osd.2 -' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0946, "args": ["host=master-0", "root=default"]}]': finished
- 2017-07-11 13:24:30.376051 I | rook-ceph-mon0: 2017-07-11 13:24:30.375991 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e10: 6 total, 3 up, 3 in
- 2017-07-11 13:24:30.980482 I | rook-ceph-mon0: 2017-07-11 13:24:30.980449 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e11: 6 total, 3 up, 3 in
- 2017-07-11 13:24:31.621506 I | rook-ceph-mon0: 2017-07-11 13:24:31.621459 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"entity": "osd.5", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"} v 0) v1
- 2017-07-11 13:24:31.621720 I | rook-ceph-mon0: 2017-07-11 13:24:31.621689 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.99.0:0/3135454564' entity='client.admin' cmd=[{"entity": "osd.5", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:31.622210 I | rook-ceph-mon0: 2017-07-11 13:24:31.622191 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "id": 4, "weight":0.0946, "args": ["host=minion-2", "root=default"]} v 0) v1
- 2017-07-11 13:24:31.622302 I | rook-ceph-mon0: 2017-07-11 13:24:31.622286 7f7c4bd55700 0 log_channel(audit) log [INF] : from='osd.4 -' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0946, "args": ["host=minion-2", "root=default"]}]: dispatch
- 2017-07-11 13:24:31.622714 I | rook-ceph-mon0: 2017-07-11 13:24:31.622652 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader).osd e11 create-or-move crush item name 'osd.4' initial_weight 0.0946 at location {host=minion-2,root=default}
- 2017-07-11 13:24:31.764376 I | rook-ceph-mon0: 2017-07-11 13:24:30.375600 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 84 : audit [INF] from='client.? 10.233.124.0:0/3518883843' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 4, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:31.764460 I | rook-ceph-mon0: 2017-07-11 13:24:30.375796 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 85 : audit [INF] from='osd.2 -' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0946, "args": ["host=master-0", "root=default"]}]': finished
- 2017-07-11 13:24:31.764795 I | rook-ceph-mon0: 2017-07-11 13:24:30.375331 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 83 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:24:31.764836 I | rook-ceph-mon0: 2017-07-11 13:24:30.376299 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 86 : cluster [INF] osdmap e10: 6 total, 3 up, 3 in
- 2017-07-11 13:24:31.764855 I | rook-ceph-mon0: 2017-07-11 13:24:30.980570 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 87 : cluster [INF] osdmap e11: 6 total, 3 up, 3 in
- 2017-07-11 13:24:31.918783 I | rook-ceph-mon0: 2017-07-11 13:24:31.918653 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.99.0:0/3135454564' entity='client.admin' cmd='[{"entity": "osd.5", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:32.203023 I | rook-ceph-mon0: 2017-07-11 13:24:32.202985 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:24:32.203412 I | rook-ceph-mon0: 2017-07-11 13:24:32.203392 7f7c4754c700 0 log_channel(audit) log [INF] : from='osd.4 -' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0946, "args": ["host=minion-2", "root=default"]}]': finished
- 2017-07-11 13:24:32.203730 I | rook-ceph-mon0: 2017-07-11 13:24:32.203713 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e12: 6 total, 4 up, 4 in
- 2017-07-11 13:24:32.686005 I | rook-ceph-mon0: 2017-07-11 13:24:32.685969 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e13: 6 total, 4 up, 4 in
- 2017-07-11 13:24:32.852975 I | rook-ceph-mon0: 2017-07-11 13:24:32.852747 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 5, "weight": 0.0946, "format": "json"} v 0) v1
- 2017-07-11 13:24:32.853064 I | rook-ceph-mon0: 2017-07-11 13:24:32.852785 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.99.0:0/4057176481' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 5, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:32.853090 I | rook-ceph-mon0: 2017-07-11 13:24:32.852867 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader).osd e13 create-or-move crush item name 'osd.5' initial_weight 0.0946 at location {root=default}
- 2017-07-11 13:24:32.946364 I | rook-ceph-mon0: 2017-07-11 13:24:31.439537 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 13 : audit [INF] from='osd.4 10.233.124.4:6800/178' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0946, "args": ["host=minion-2", "root=default"]}]: dispatch
- 2017-07-11 13:24:32.946605 I | rook-ceph-mon0: 2017-07-11 13:24:31.621753 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 88 : audit [INF] from='client.? 10.233.99.0:0/3135454564' entity='client.admin' cmd=[{"entity": "osd.5", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:32.946637 I | rook-ceph-mon0: 2017-07-11 13:24:31.622367 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 89 : audit [INF] from='osd.4 -' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0946, "args": ["host=minion-2", "root=default"]}]: dispatch
- 2017-07-11 13:24:32.946653 I | rook-ceph-mon0: 2017-07-11 13:24:31.918962 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 90 : audit [INF] from='client.? 10.233.99.0:0/3135454564' entity='client.admin' cmd='[{"entity": "osd.5", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:32.946665 I | rook-ceph-mon0: 2017-07-11 13:24:32.203458 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 92 : audit [INF] from='osd.4 -' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0946, "args": ["host=minion-2", "root=default"]}]': finished
- 2017-07-11 13:24:32.946723 I | rook-ceph-mon0: 2017-07-11 13:24:32.203129 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 91 : cluster [INF] osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:24:32.946784 I | rook-ceph-mon0: 2017-07-11 13:24:32.203799 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 93 : cluster [INF] osdmap e12: 6 total, 4 up, 4 in
- 2017-07-11 13:24:32.946802 I | rook-ceph-mon0: 2017-07-11 13:24:32.614491 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 14 : cluster [WRN] message from mon.0 was stamped 0.071119s in the future, clocks not synchronized
- 2017-07-11 13:24:32.946814 I | rook-ceph-mon0: 2017-07-11 13:24:32.686410 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 94 : cluster [INF] osdmap e13: 6 total, 4 up, 4 in
- 2017-07-11 13:24:33.848574 I | rook-ceph-mon0: 2017-07-11 13:24:33.848536 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.4 10.233.124.4:6800/178 boot
- 2017-07-11 13:24:33.849108 I | rook-ceph-mon0: 2017-07-11 13:24:33.849089 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.99.0:0/4057176481' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 5, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:33.849333 I | rook-ceph-mon0: 2017-07-11 13:24:33.849317 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e14: 6 total, 5 up, 5 in
- 2017-07-11 13:24:34.129316 I | rook-ceph-mon0: 2017-07-11 13:24:32.852788 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 95 : audit [INF] from='client.? 10.233.99.0:0/4057176481' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 5, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:34.129402 I | rook-ceph-mon0: 2017-07-11 13:24:33.849151 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 97 : audit [INF] from='client.? 10.233.99.0:0/4057176481' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 5, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:34.129458 I | rook-ceph-mon0: 2017-07-11 13:24:33.848800 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 96 : cluster [INF] osd.4 10.233.124.4:6800/178 boot
- 2017-07-11 13:24:34.129475 I | rook-ceph-mon0: 2017-07-11 13:24:33.849364 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 98 : cluster [INF] osdmap e14: 6 total, 5 up, 5 in
- 2017-07-11 13:24:35.506025 I | rook-ceph-mon0: 2017-07-11 13:24:35.505757 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "id": 5, "weight":0.0946, "args": ["host=minion-1", "root=default"]} v 0) v1
- 2017-07-11 13:24:35.506108 I | rook-ceph-mon0: 2017-07-11 13:24:35.505799 7f7c4bd55700 0 log_channel(audit) log [INF] : from='osd.5 -' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0946, "args": ["host=minion-1", "root=default"]}]: dispatch
- 2017-07-11 13:24:35.506127 I | rook-ceph-mon0: 2017-07-11 13:24:35.505893 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader).osd e14 create-or-move crush item name 'osd.5' initial_weight 0.0946 at location {host=minion-1,root=default}
- 2017-07-11 13:24:36.592524 I | rook-ceph-mon0: 2017-07-11 13:24:36.592488 7f7c4754c700 0 log_channel(audit) log [INF] : from='osd.5 -' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0946, "args": ["host=minion-1", "root=default"]}]': finished
- 2017-07-11 13:24:36.592905 I | rook-ceph-mon0: 2017-07-11 13:24:36.592886 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e15: 6 total, 5 up, 5 in
- 2017-07-11 13:24:36.840670 I | rook-ceph-mon0: 2017-07-11 13:24:35.461554 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 61 : audit [INF] from='osd.5 10.233.99.6:6800/179' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0946, "args": ["host=minion-1", "root=default"]}]: dispatch
- 2017-07-11 13:24:36.840773 I | rook-ceph-mon0: 2017-07-11 13:24:35.505800 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 99 : audit [INF] from='osd.5 -' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0946, "args": ["host=minion-1", "root=default"]}]: dispatch
- 2017-07-11 13:24:37.007563 I | rook-ceph-mon0: 2017-07-11 13:24:37.002555 7f7c4dd59700 1 heartbeat_map reset_timeout 'cpu_tp thread cpu_tp' had timed out after 0
- 2017-07-11 13:24:37.266174 I | rook-ceph-mon0: 2017-07-11 13:24:37.266115 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.5 10.233.99.6:6800/179 boot
- 2017-07-11 13:24:37.266611 I | rook-ceph-mon0: 2017-07-11 13:24:37.266592 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e16: 6 total, 6 up, 6 in
- 2017-07-11 13:24:37.977625 I | rook-ceph-mon0: 2017-07-11 13:24:36.592631 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 100 : audit [INF] from='osd.5 -' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0946, "args": ["host=minion-1", "root=default"]}]': finished
- 2017-07-11 13:24:37.978009 I | rook-ceph-mon0: 2017-07-11 13:24:36.592944 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 101 : cluster [INF] osdmap e15: 6 total, 5 up, 5 in
- 2017-07-11 13:24:37.978040 I | rook-ceph-mon0: 2017-07-11 13:24:37.266277 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 102 : cluster [INF] osd.5 10.233.99.6:6800/179 boot
- 2017-07-11 13:24:37.978070 I | rook-ceph-mon0: 2017-07-11 13:24:37.266651 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 103 : cluster [INF] osdmap e16: 6 total, 6 up, 6 in
- 2017-07-11 13:24:41.556049 I | rook-ceph-mon0: 2017-07-11 13:24:41.555975 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e17: 6 total, 6 up, 6 in
- 2017-07-11 13:24:42.629863 I | rook-ceph-mon0: 2017-07-11 13:24:41.556133 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 104 : cluster [INF] osdmap e17: 6 total, 6 up, 6 in
- 2017-07-11 13:24:45.359953 I | rook-ceph-mon0: 2017-07-11 13:24:45.359815 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4799 MB, avail 94388 MB
- 2017-07-11 13:24:51.131841 I | rook-ceph-mon0: 2017-07-11 13:24:51.131755 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.1 10.233.76.4:6800/178
- 2017-07-11 13:24:54.139295 I | rook-ceph-mon0: 2017-07-11 13:24:54.139222 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.3 10.233.86.0:6800/178
- 2017-07-11 13:24:56.560009 I | rook-ceph-mon0: 2017-07-11 13:24:56.559833 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.2 10.233.69.0:6800/178
- 2017-07-11 13:24:56.560095 I | rook-ceph-mon0: 2017-07-11 13:24:56.559927 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.2 10.233.69.0:6800/178
- 2017-07-11 13:24:57.522589 I | rook-ceph-mon0: 2017-07-11 13:24:57.521633 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.4 10.233.124.4:6800/178
- 2017-07-11 13:24:57.558281 I | rook-ceph-mon0: 2017-07-11 13:24:57.548575 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.4 10.233.124.4:6800/178
- 2017-07-11 13:24:57.558600 I | rook-ceph-mon0: 2017-07-11 13:24:57.558547 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.4 10.233.124.4:6800/178
- 2017-07-11 13:24:58.732638 I | rook-ceph-mon0: 2017-07-11 13:24:58.732603 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:24:58.732807 I | rook-ceph-mon0: 2017-07-11 13:24:58.732791 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/584162379' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:24:59.524343 I | rook-ceph-mon0: 2017-07-11 13:24:59.524290 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:24:59.524820 I | rook-ceph-mon0: 2017-07-11 13:24:59.524804 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:24:59.525168 I | rook-ceph-mon0: 2017-07-11 13:24:59.525153 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:25:05.280589 I | rook-ceph-mon0: 2017-07-11 13:25:05.280502 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_WARN; 614 pgs peering; 6 requests are blocked > 32 sec; 6 osds have slow requests; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:25:06.005779 I | rook-ceph-mon0: 2017-07-11 13:25:05.280508 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 116 : cluster [INF] HEALTH_WARN; 614 pgs peering; 6 requests are blocked > 32 sec; 6 osds have slow requests; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:25:07.123288 I | rook-ceph-mon0: 2017-07-11 13:24:59.141639 osd.1 osd.1 10.233.76.4:6800/178 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.086934 secs
- 2017-07-11 13:25:07.123381 I | rook-ceph-mon0: 2017-07-11 13:24:59.141653 osd.1 osd.1 10.233.76.4:6800/178 2 : cluster [WRN] slow request 30.086934 seconds old, received at 2017-07-11 13:24:29.054610: osd_pg_create(e9 0.1:2 0.4:2 0.8:2 0.c:2 0.11:2 0.12:2 0.13:2 0.16:2 0.1a:2 0.1b:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.2b:2 0.33:2 0.34:2 0.36:2 0.37:2 0.38:2 0.39:2 0.3c:2 0.40:2 0.41:2 0.43:2 0.4b:2 0.4d:2 0.4e:2 0.52:2 0.57:2 0.5a:2 0.5f:2 0.62:2 0.67:2 0.6d:2 0.74:2 0.75:2 0.80:2 0.81:2 0.84:2 0.86:2 0.87:2 0.8c:2 0.8d:2 0.8f:2 0.92:2 0.93:2 0.96:2 0.99:2 0.9a:2 0.9b:2 0.9c:2 0.a4:2 0.a9:2 0.aa:2 0.ae:2 0.af:2 0.b1:2 0.b2:2 0.b7:2 0.b9:2 0.be:2 0.c1:2 0.c7:2 0.c9:2 0.cf:2 0.db:2 0.df:2 0.e6:2 0.f0:2 0.f1:2 0.f2:2 0.f3:2 0.f5:2 0.f6:2 0.fa:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.106:2 0.109:2 0.10b:2 0.10d:2 0.113:2 0.114:2 0.115:2 0.11a:2 0.121:2 0.124:2 0.125:2 0.12b:2 0.130:2 0.136:2 0.137:2 0.139:2 0.13a:2 0.13b:2 0.13c:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14b:2 0.14d:2 0.155:2 0.156:2 0.158:2 0.159:2 0.15b:2 0.15d:2 0.161:2 0.164:2 0.165:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.178:2 0.17d:2 0.184:2 0.187:2 0.18c:2 0.18e:2 0.18f:2 0.190:2 0.191:2 0.193:2 0.197:2 0.199:2 0.19a:2 0.19b:2 0.19d:2 0.1a1:2 0.1a2:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b2:2 0.1b3:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1c9:2 0.1d1:2 0.1d3:2 0.1d9:2 0.1da:2 0.1dd:2 0.1e0:2 0.1e3:2 0.1e5:2 0.1e7:2 0.1e8:2 0.1ea:2 0.1ee:2 0.1f1:2 0.1f2:2 0.1f3:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fb:2 0.1fc:2 0.1fd:2 0.1ff:2 0.202:2 0.208:2 0.209:2 0.20c:2 0.210:2 0.213:2 0.215:2 0.219:2 0.21b:2 0.220:2 0.221:2 0.225:2 0.229:2 0.22e:2 0.230:2 0.233:2 0.234:2 0.236:2 0.238:2 0.240:2 0.241:2 0.244:2 0.245:2 0.24b:2 0.24f:2 0.256:2 0.257:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.268:2 0.26c:2 0.26f:2 0.274:2 0.275:2 0.278:2 0.27b:2 0.27c:2 0.27d:2 0.27e:2 0.281:2 0.284:2 0.287:2 0.288:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.293:2 0.29b:2 0.29c:2 0.29f:2 0.2a2:2 0.2a3:2 0.2a5:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ad:2 0.2b0:2 0.2b6:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2bd:2 0.2c0:2 0.2c3:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2cf:2 0.2d4:2 0.2d6:2 0.2d8:2 0.2da:2 0.2dc:2 0.2e6:2 0.2e8:2 0.2f2:2 0.2f4:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2fd:2 0.2ff:2 0.301:2 0.302:2 0.303:2 0.305:2 0.307:2 0.30b:2 0.30d:2 0.30f:2 0.311:2 0.314:2 0.315:2 0.318:2 0.319:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.336:2 0.339:2 0.33a:2 0.33d:2 0.347:2 0.348:2 0.34a:2 0.34e:2 0.34f:2 0.350:2 0.353:2 0.357:2 0.35b:2 0.35d:2 0.35e:2 0.35f:2 0.361:2 0.366:2 0.368:2 0.369:2 0.36f:2 0.370:2 0.371:2 0.375:2 0.376:2 0.37c:2 0.37e:2 0.380:2 0.384:2 0.387:2 0.38a:2 0.38e:2 0.390:2 0.392:2 0.395:2 0.39a:2 0.39b:2 0.39c:2 0.39d:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b3:2 0.3b4:2 0.3b5:2 0.3ba:2 0.3c1:2 0.3c3:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cc:2 0.3cd:2 0.3d1:2 0.3d2:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3da:2 0.3db:2 0.3dc:2 0.3dd:2 0.3df:2 0.3e0:2 0.3e2:2 0.3e3:2 0.3e5:2 0.3e7:2 0.3ea:2 0.3ec:2 0.3f0:2 0.3f1:2 0.3f4:2 0.3f8:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:07.123419 I | rook-ceph-mon0: 2017-07-11 13:24:59.815551 osd.0 osd.0 10.233.72.0:6800/180 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.826397 secs
- 2017-07-11 13:25:07.123438 I | rook-ceph-mon0: 2017-07-11 13:24:59.815574 osd.0 osd.0 10.233.72.0:6800/180 2 : cluster [WRN] slow request 30.826397 seconds old, received at 2017-07-11 13:24:28.989049: osd_pg_create(e9 0.6:2 0.7:2 0.9:2 0.b:2 0.10:2 0.14:2 0.18:2 0.19:2 0.27:2 0.28:2 0.29:2 0.2c:2 0.31:2 0.3b:2 0.3d:2 0.42:2 0.44:2 0.46:2 0.49:2 0.50:2 0.53:2 0.55:2 0.59:2 0.5b:2 0.5d:2 0.5e:2 0.61:2 0.63:2 0.64:2 0.65:2 0.66:2 0.69:2 0.6b:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.82:2 0.83:2 0.90:2 0.9d:2 0.9f:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.a7:2 0.a8:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.ba:2 0.bb:2 0.bd:2 0.bf:2 0.c6:2 0.cd:2 0.d0:2 0.d3:2 0.d4:2 0.d6:2 0.d7:2 0.da:2 0.dd:2 0.e1:2 0.e3:2 0.e4:2 0.e5:2 0.e7:2 0.e8:2 0.e9:2 0.ed:2 0.ee:2 0.f4:2 0.f8:2 0.fc:2 0.fd:2 0.10c:2 0.10e:2 0.110:2 0.116:2 0.117:2 0.118:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.128:2 0.12a:2 0.12c:2 0.12f:2 0.132:2 0.135:2 0.140:2 0.141:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.160:2 0.163:2 0.166:2 0.16a:2 0.170:2 0.179:2 0.17b:2 0.17c:2 0.17e:2 0.17f:2 0.180:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.192:2 0.194:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b0:2 0.1b1:2 0.1b4:2 0.1b7:2 0.1b8:2 0.1b9:2 0.1ba:2 0.1be:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1ce:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1de:2 0.1e1:2 0.1e2:2 0.1e4:2 0.1e6:2 0.1eb:2 0.1ed:2 0.1f5:2 0.1f7:2 0.1f8:2 0.1fe:2 0.200:2 0.204:2 0.206:2 0.207:2 0.20a:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.214:2 0.216:2 0.21c:2 0.21e:2 0.227:2 0.228:2 0.22a:2 0.22b:2 0.22c:2 0.22d:2 0.231:2 0.23c:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.250:2 0.252:2 0.255:2 0.25b:2 0.25e:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26d:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.277:2 0.279:2 0.27f:2 0.282:2 0.286:2 0.28c:2 0.28f:2 0.292:2 0.294:2 0.295:2 0.296:2 0.298:2 0.299:2 0.29d:2 0.2a1:2 0.2a4:2 0.2ab:2 0.2ae:2 0.2b2:2 0.2b3:2 0.2b4:2 0.2b5:2 0.2bb:2 0.2bc:2 0.2be:2 0.2c1:2 0.2c4:2 0.2c5:2 0.2cb:2 0.2cd:2 0.2ce:2 0.2d2:2 0.2d3:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e7:2 0.2ee:2 0.2ef:2 0.2f0:2 0.2f6:2 0.2fa:2 0.2fb:2 0.304:2 0.306:2 0.309:2 0.30c:2 0.310:2 0.312:2 0.316:2 0.317:2 0.31a:2 0.31d:2 0.31e:2 0.31f:2 0.323:2 0.324:2 0.328:2 0.32b:2 0.32d:2 0.331:2 0.332:2 0.338:2 0.33b:2 0.33e:2 0.340:2 0.343:2 0.346:2 0.349:2 0.34d:2 0.351:2 0.352:2 0.355:2 0.356:2 0.358:2 0.35c:2 0.362:2 0.363:2 0.36b:2 0.372:2 0.373:2 0.374:2 0.377:2 0.378:2 0.37b:2 0.381:2 0.382:2 0.385:2 0.386:2 0.389:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.396:2 0.399:2 0.3a5:2 0.3a6:2 0.3a7:2 0.3a9:2 0.3ac:2 0.3af:2 0.3b6:2 0.3b7:2 0.3b8:2 0.3b9:2 0.3bc:2 0.3bd:2 0.3be:2 0.3c0:2 0.3c2:2 0.3c7:2 0.3ce:2 0.3cf:2 0.3d4:2 0.3d7:2 0.3d8:2 0.3de:2 0.3e6:2 0.3eb:2 0.3ed:2 0.3ee:2 0.3ef:2 0.3f3:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2) currently started
- 2017-07-11 13:25:08.292632 I | rook-ceph-mon0: 2017-07-11 13:25:01.102920 osd.3 osd.3 10.233.86.0:6800/178 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.754338 secs
- 2017-07-11 13:25:08.292972 I | rook-ceph-mon0: 2017-07-11 13:25:01.102935 osd.3 osd.3 10.233.86.0:6800/178 2 : cluster [WRN] slow request 30.754338 seconds old, received at 2017-07-11 13:24:30.348500: osd_pg_create(e10 0.7:2 0.a:2 0.12:2 0.13:2 0.15:2 0.18:2 0.1b:2 0.1f:2 0.22:2 0.23:2 0.24:2 0.2c:2 0.30:2 0.33:2 0.34:2 0.3d:2 0.3e:2 0.42:2 0.45:2 0.4a:2 0.4c:2 0.50:2 0.51:2 0.54:2 0.57:2 0.58:2 0.59:2 0.66:2 0.67:2 0.68:2 0.6a:2 0.6b:2 0.6c:2 0.6f:2 0.71:2 0.7c:2 0.82:2 0.85:2 0.89:2 0.90:2 0.95:2 0.9e:2 0.9f:2 0.a3:2 0.aa:2 0.af:2 0.b3:2 0.b7:2 0.ba:2 0.bd:2 0.c0:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e0:2 0.e2:2 0.e5:2 0.e9:2 0.ea:2 0.ed:2 0.ef:2 0.f7:2 0.fc:2 0.fd:2 0.fe:2 0.ff:2 0.106:2 0.107:2 0.108:2 0.10a:2 0.10c:2 0.10d:2 0.10e:2 0.10f:2 0.110:2 0.11a:2 0.123:2 0.127:2 0.128:2 0.130:2 0.132:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.143:2 0.152:2 0.153:2 0.156:2 0.15c:2 0.15f:2 0.162:2 0.163:2 0.16f:2 0.173:2 0.176:2 0.177:2 0.17e:2 0.181:2 0.187:2 0.188:2 0.18b:2 0.18c:2 0.191:2 0.192:2 0.194:2 0.195:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b0:2 0.1b1:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c2:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1dc:2 0.1de:2 0.1df:2 0.1e2:2 0.1e3:2 0.1ec:2 0.1f3:2 0.1fb:2 0.1fe:2 0.201:2 0.204:2 0.205:2 0.20a:2 0.213:2 0.21c:2 0.21e:2 0.221:2 0.224:2 0.229:2 0.232:2 0.235:2 0.237:2 0.238:2 0.23a:2 0.23f:2 0.242:2 0.245:2 0.24b:2 0.250:2 0.256:2 0.257:2 0.25e:2 0.264:2 0.267:2 0.268:2 0.26a:2 0.278:2 0.27e:2 0.280:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.29e:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ae:2 0.2b0:2 0.2c1:2 0.2c8:2 0.2cb:2 0.2d5:2 0.2d6:2 0.2da:2 0.2db:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ea:2 0.2ec:2 0.2ef:2 0.2f0:2 0.2f2:2 0.2f4:2 0.2f9:2 0.2fb:2 0.305:2 0.306:2 0.308:2 0.309:2 0.30a:2 0.30c:2 0.310:2 0.314:2 0.319:2 0.31d:2 0.322:2 0.327:2 0.329:2 0.331:2 0.334:2 0.335:2 0.337:2 0.33e:2 0.340:2 0.344:2 0.348:2 0.349:2 0.34a:2 0.34c:2 0.350:2 0.354:2 0.355:2 0.357:2 0.359:2 0.35a:2 0.35e:2 0.365:2 0.367:2 0.369:2 0.36a:2 0.36e:2 0.37d:2 0.382:2 0.389:2 0.38c:2 0.38f:2 0.390:2 0.394:2 0.398:2 0.399:2 0.39a:2 0.3a0:2 0.3a7:2 0.3af:2 0.3b0:2 0.3b7:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c5:2 0.3c6:2 0.3cf:2 0.3d2:2 0.3d4:2 0.3d5:2 0.3db:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3e5:2 0.3e7:2 0.3f0:2 0.3f6:2 0.3f9:2) currently started
- 2017-07-11 13:25:09.533744 I | rook-ceph-mon0: 2017-07-11 13:25:09.533701 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:25:09.533935 I | rook-ceph-mon0: 2017-07-11 13:25:09.533849 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1008053147' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:25:11.403199 I | rook-ceph-mon0: 2017-07-11 13:25:02.581395 osd.2 osd.2 10.233.69.0:6800/178 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.293208 secs
- 2017-07-11 13:25:11.403291 I | rook-ceph-mon0: 2017-07-11 13:25:02.581413 osd.2 osd.2 10.233.69.0:6800/178 2 : cluster [WRN] slow request 30.293208 seconds old, received at 2017-07-11 13:24:32.288034: osd_pg_create(e12 0.5:2 0.7:2 0.9:2 0.12:2 0.13:2 0.14:2 0.15:2 0.16:2 0.17:2 0.1b:2 0.21:2 0.27:2 0.29:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.39:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5b:2 0.5f:2 0.60:2 0.63:2 0.6e:2 0.72:2 0.7a:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.95:2 0.98:2 0.9a:2 0.9d:2 0.9e:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.b8:2 0.ba:2 0.c0:2 0.c2:2 0.c5:2 0.cb:2 0.ce:2 0.d2:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.fe:2 0.100:2 0.106:2 0.107:2 0.10c:2 0.10d:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.127:2 0.128:2 0.12c:2 0.12f:2 0.131:2 0.133:2 0.134:2 0.141:2 0.142:2 0.14b:2 0.14d:2 0.159:2 0.15a:2 0.15c:2 0.160:2 0.161:2 0.166:2 0.169:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.17f:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1db:2 0.1e1:2 0.1e4:2 0.1e9:2 0.1ee:2 0.1f2:2 0.1f3:2 0.1f6:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.21d:2 0.21f:2 0.223:2 0.224:2 0.228:2 0.229:2 0.22b:2 0.22e:2 0.233:2 0.235:2 0.237:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.251:2 0.252:2 0.253:2 0.254:2 0.25c:2 0.265:2 0.267:2 0.269:2 0.26b:2 0.26c:2 0.26d:2 0.276:2 0.278:2 0.279:2 0.27b:2 0.27f:2 0.280:2 0.284:2 0.286:2 0.288:2 0.290:2 0.298:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b3:2 0.2b8:2 0.2b9:2 0.2bf:2 0.2c8:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2df:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ea:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30b:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32d:2 0.32f:2 0.330:2 0.334:2 0.336:2 0.33a:2 0.344:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.359:2 0.363:2 0.364:2 0.366:2 0.369:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b0:2 0.3b2:2 0.3b3:2 0.3b5:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3ed:2 0.3f4:2) currently started
- 2017-07-11 13:25:12.536129 I | rook-ceph-mon0: 2017-07-11 13:25:04.442289 osd.4 osd.4 10.233.124.4:6800/178 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.644850 secs
- 2017-07-11 13:25:12.536399 I | rook-ceph-mon0: 2017-07-11 13:25:04.442463 osd.4 osd.4 10.233.124.4:6800/178 2 : cluster [WRN] slow request 30.644850 seconds old, received at 2017-07-11 13:24:33.797300: osd_pg_create(e14 0.0:2 0.14:2 0.17:2 0.23:2 0.29:2 0.2d:2 0.37:2 0.39:2 0.3d:2 0.40:2 0.41:2 0.42:2 0.45:2 0.46:2 0.48:2 0.4a:2 0.55:2 0.5a:2 0.5c:2 0.62:2 0.65:2 0.66:2 0.68:2 0.6d:2 0.78:2 0.83:2 0.88:2 0.95:2 0.9c:2 0.a1:2 0.b0:2 0.b5:2 0.b8:2 0.bc:2 0.bd:2 0.c0:2 0.c1:2 0.c8:2 0.cb:2 0.e6:2 0.e7:2 0.f0:2 0.fe:2 0.100:2 0.101:2 0.10a:2 0.10d:2 0.10f:2 0.114:2 0.128:2 0.12a:2 0.12f:2 0.134:2 0.138:2 0.143:2 0.148:2 0.149:2 0.14c:2 0.14f:2 0.160:2 0.162:2 0.163:2 0.164:2 0.169:2 0.16b:2 0.17f:2 0.182:2 0.185:2 0.18f:2 0.190:2 0.19b:2 0.1a5:2 0.1b6:2 0.1bc:2 0.1c7:2 0.1d8:2 0.1d9:2 0.1db:2 0.1dd:2 0.1e4:2 0.1ee:2 0.1f0:2 0.1f6:2 0.1f7:2 0.204:2 0.208:2 0.210:2 0.217:2 0.219:2 0.21d:2 0.226:2 0.229:2 0.22a:2 0.22b:2 0.230:2 0.235:2 0.237:2 0.23a:2 0.23b:2 0.241:2 0.243:2 0.24d:2 0.25b:2 0.25e:2 0.261:2 0.265:2 0.267:2 0.26c:2 0.27b:2 0.27d:2 0.27f:2 0.283:2 0.284:2 0.288:2 0.28e:2 0.29e:2 0.2a6:2 0.2ae:2 0.2b1:2 0.2b4:2 0.2b6:2 0.2bb:2 0.2bf:2 0.2c0:2 0.2c3:2 0.2c5:2 0.2c6:2 0.2cd:2 0.2cf:2 0.2d5:2 0.2d8:2 0.2df:2 0.2e0:2 0.2e9:2 0.2ea:2 0.2f9:2 0.303:2 0.309:2 0.30a:2 0.30b:2 0.30d:2 0.312:2 0.325:2 0.32b:2 0.32c:2 0.32d:2 0.333:2 0.334:2 0.335:2 0.339:2 0.33a:2 0.342:2 0.359:2 0.362:2 0.368:2 0.36f:2 0.37a:2 0.384:2 0.38f:2 0.3a2:2 0.3a8:2 0.3a9:2 0.3b1:2 0.3b4:2 0.3b5:2 0.3be:2 0.3c5:2 0.3d1:2 0.3d5:2 0.3da:2 0.3e0:2 0.3e9:2 0.3eb:2 0.3ed:2 0.3ef:2 0.3f6:2 0.3f7:2 0.3f9:2 0.3fc:2) currently started
- 2017-07-11 13:25:16.558631 I | rook-ceph-mon0: 2017-07-11 13:25:08.359890 osd.5 osd.5 10.233.99.6:6800/179 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.964326 secs
- 2017-07-11 13:25:16.558928 I | rook-ceph-mon0: 2017-07-11 13:25:08.359905 osd.5 osd.5 10.233.99.6:6800/179 2 : cluster [WRN] slow request 30.964326 seconds old, received at 2017-07-11 13:24:37.395485: osd_pg_create(e16 0.0:2 0.2:2 0.f:2 0.13:2 0.22:2 0.23:2 0.25:2 0.26:2 0.2a:2 0.39:2 0.41:2 0.4d:2 0.50:2 0.5b:2 0.60:2 0.66:2 0.70:2 0.72:2 0.76:2 0.77:2 0.7e:2 0.7f:2 0.88:2 0.89:2 0.8c:2 0.91:2 0.97:2 0.a1:2 0.a7:2 0.a8:2 0.ac:2 0.b9:2 0.c1:2 0.c3:2 0.c9:2 0.ca:2 0.cd:2 0.d2:2 0.d5:2 0.de:2 0.e1:2 0.e2:2 0.e8:2 0.ec:2 0.ed:2 0.f0:2 0.fc:2 0.103:2 0.10d:2 0.10e:2 0.115:2 0.11b:2 0.125:2 0.127:2 0.129:2 0.131:2 0.133:2 0.134:2 0.135:2 0.138:2 0.13d:2 0.143:2 0.146:2 0.148:2 0.14b:2 0.154:2 0.157:2 0.159:2 0.15a:2 0.16c:2 0.175:2 0.176:2 0.177:2 0.17b:2 0.184:2 0.187:2 0.18d:2 0.190:2 0.191:2 0.195:2 0.198:2 0.19a:2 0.1a0:2 0.1a7:2 0.1a8:2 0.1ab:2 0.1b5:2 0.1b6:2 0.1bf:2 0.1c4:2 0.1d2:2 0.1d7:2 0.1d8:2 0.1e3:2 0.1f0:2 0.1f8:2 0.1fd:2 0.1fe:2 0.202:2 0.203:2 0.20a:2 0.219:2 0.21f:2 0.228:2 0.22a:2 0.239:2 0.23d:2 0.24e:2 0.24f:2 0.251:2 0.267:2 0.26a:2 0.274:2 0.278:2 0.27a:2 0.28b:2 0.28e:2 0.294:2 0.298:2 0.29e:2 0.2a6:2 0.2b3:2 0.2b6:2 0.2ba:2 0.2c6:2 0.2c8:2 0.2ca:2 0.2d5:2 0.2d8:2 0.2dd:2 0.2e0:2 0.2ed:2 0.2f4:2 0.2f8:2 0.2ff:2 0.311:2 0.314:2 0.315:2 0.316:2 0.31f:2 0.322:2 0.326:2 0.32a:2 0.335:2 0.33c:2 0.343:2 0.34b:2 0.35a:2 0.35e:2 0.363:2 0.369:2 0.36f:2 0.37f:2 0.384:2 0.386:2 0.39a:2 0.39c:2 0.3a7:2 0.3ac:2 0.3ae:2 0.3b0:2 0.3ba:2 0.3d2:2 0.3d6:2 0.3dd:2 0.3e3:2 0.3ea:2 0.3f1:2 0.3f5:2 0.3fc:2 0.3fe:2) currently started
- 2017-07-11 13:25:20.613726 I | rook-ceph-mon0: 2017-07-11 13:25:20.610715 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.0 failed (root=default,host=master-1) (5 reporters from different host after 22.086509 >= grace 20.000000)
- 2017-07-11 13:25:20.613827 I | rook-ceph-mon0: 2017-07-11 13:25:20.610762 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.2 failed (root=default,host=master-0) (2 reporters from different host after 22.085972 >= grace 20.000000)
- 2017-07-11 13:25:20.613908 I | rook-ceph-mon0: 2017-07-11 13:25:20.610782 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.3 failed (root=default,host=master-2) (3 reporters from different host after 22.085702 >= grace 20.000000)
- 2017-07-11 13:25:20.942439 I | rook-ceph-mon0: 2017-07-11 13:25:20.942179 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e18: 6 total, 3 up, 6 in
- 2017-07-11 13:25:21.715773 I | rook-ceph-mon0: 2017-07-11 13:25:20.610722 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 118 : cluster [INF] osd.0 failed (root=default,host=master-1) (5 reporters from different host after 22.086509 >= grace 20.000000)
- 2017-07-11 13:25:21.715949 I | rook-ceph-mon0: 2017-07-11 13:25:20.610763 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 119 : cluster [INF] osd.2 failed (root=default,host=master-0) (2 reporters from different host after 22.085972 >= grace 20.000000)
- 2017-07-11 13:25:21.716019 I | rook-ceph-mon0: 2017-07-11 13:25:20.610783 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 120 : cluster [INF] osd.3 failed (root=default,host=master-2) (3 reporters from different host after 22.085702 >= grace 20.000000)
- 2017-07-11 13:25:21.716038 I | rook-ceph-mon0: 2017-07-11 13:25:20.942180 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 121 : cluster [INF] osdmap e18: 6 total, 3 up, 6 in
- 2017-07-11 13:25:22.186870 I | rook-ceph-mon0: 2017-07-11 13:25:22.186716 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.4 10.233.124.4:6800/178 reported immediately failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:25:22.186962 I | rook-ceph-mon0: 2017-07-11 13:25:22.186746 7f7c4bd55700 0 log_channel(cluster) log [INF] : osd.4 failed (root=default,host=minion-2) (connection refused reported by osd.5)
- 2017-07-11 13:25:22.187303 I | rook-ceph-mon0: 2017-07-11 13:25:22.187225 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.4 10.233.124.4:6800/178 reported immediately failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:25:22.208607 I | rook-ceph-mon0: 2017-07-11 13:25:22.208491 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.4 10.233.124.4:6800/178 reported immediately failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:25:22.209009 I | rook-ceph-mon0: 2017-07-11 13:25:22.208924 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.4 10.233.124.4:6800/178 reported immediately failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:25:22.613549 I | rook-ceph-mon0: 2017-07-11 13:25:22.613476 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.4 10.233.124.4:6800/178 reported immediately failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:25:22.613918 I | rook-ceph-mon0: 2017-07-11 13:25:22.613878 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.4 10.233.124.4:6800/178 reported immediately failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:25:23.340174 I | rook-ceph-mon0: 2017-07-11 13:25:22.186747 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 123 : cluster [INF] osd.4 failed (root=default,host=minion-2) (connection refused reported by osd.5)
- 2017-07-11 13:25:23.792705 I | rook-ceph-mon0: 2017-07-11 13:25:23.792656 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e19: 6 total, 2 up, 6 in
- 2017-07-11 13:25:24.949693 I | rook-ceph-mon0: 2017-07-11 13:25:23.792859 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 129 : cluster [INF] osdmap e19: 6 total, 2 up, 6 in
- 2017-07-11 13:25:26.342213 I | rook-ceph-mon0: 2017-07-11 13:25:24.354685 osd.5 osd.5 10.233.99.6:6800/179 3 : cluster [ERR] map e17 had wrong cluster addr (10.233.99.6:6801/179 != my 10.233.99.0:6801/179)
- 2017-07-11 13:25:31.055512 I | rook-ceph-mon0: 2017-07-11 13:25:31.055475 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:25:31.055581 I | rook-ceph-mon0: 2017-07-11 13:25:31.055566 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2343449121' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:25:32.202611 I | rook-ceph-mon0: 2017-07-11 13:25:21.991262 osd.4 osd.4 10.233.124.4:6800/178 3 : cluster [ERR] map e16 had wrong cluster addr (10.233.124.4:6801/178 != my 10.233.124.0:6801/178)
- 2017-07-11 13:25:32.202696 I | rook-ceph-mon0: 2017-07-11 13:25:22.446168 osd.4 osd.4 10.233.124.4:6800/178 4 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 45.667737 secs
- 2017-07-11 13:25:32.202721 I | rook-ceph-mon0: 2017-07-11 13:25:22.446172 osd.4 osd.4 10.233.124.4:6800/178 5 : cluster [WRN] slow request 45.667737 seconds old, received at 2017-07-11 13:24:36.778345: osd_pg_create(e15 0.10:2 0.13:2 0.1d:2 0.24:2 0.4d:2 0.5b:2 0.6c:2 0.77:2 0.7e:2 0.90:2 0.9e:2 0.ac:2 0.b7:2 0.cd:2 0.ce:2 0.d1:2 0.ed:2 0.f2:2 0.116:2 0.11b:2 0.129:2 0.12e:2 0.133:2 0.13d:2 0.13e:2 0.142:2 0.146:2 0.15e:2 0.176:2 0.187:2 0.1c4:2 0.1dc:2 0.1e8:2 0.203:2 0.23e:2 0.251:2 0.254:2 0.274:2 0.28b:2 0.2b0:2 0.2b3:2 0.2c8:2 0.2f4:2 0.311:2 0.326:2 0.33f:2 0.343:2 0.344:2 0.35e:2 0.36c:2 0.379:2 0.395:2 0.39c:2 0.3a7:2 0.3b0:2 0.3c3:2 0.3e3:2) currently wait for new map
- 2017-07-11 13:25:32.202767 I | rook-ceph-mon0: 2017-07-11 13:25:22.446234 osd.4 osd.4 10.233.124.4:6800/178 6 : cluster [WRN] slow request 40.751310 seconds old, received at 2017-07-11 13:24:41.694773: osd_pg_create(e17 0.10:2 0.14:2 0.17:2 0.1d:2 0.24:2 0.29:2 0.2d:2 0.37:2 0.3d:2 0.40:2 0.42:2 0.45:2 0.46:2 0.48:2 0.4a:2 0.55:2 0.5a:2 0.5c:2 0.62:2 0.65:2 0.68:2 0.6c:2 0.6d:2 0.78:2 0.83:2 0.90:2 0.95:2 0.9c:2 0.9e:2 0.b0:2 0.b5:2 0.b7:2 0.b8:2 0.bc:2 0.bd:2 0.c0:2 0.c8:2 0.cb:2 0.ce:2 0.d1:2 0.e6:2 0.e7:2 0.f2:2 0.fe:2 0.100:2 0.101:2 0.10a:2 0.10f:2 0.114:2 0.116:2 0.128:2 0.12a:2 0.12e:2 0.12f:2 0.13e:2 0.142:2 0.149:2 0.14c:2 0.14f:2 0.15e:2 0.160:2 0.162:2 0.163:2 0.164:2 0.169:2 0.16b:2 0.17f:2 0.182:2 0.185:2 0.18f:2 0.19b:2 0.1a5:2 0.1bc:2 0.1c7:2 0.1d9:2 0.1db:2 0.1dc:2 0.1dd:2 0.1e4:2 0.1e8:2 0.1ee:2 0.1f6:2 0.1f7:2 0.204:2 0.208:2 0.210:2 0.217:2 0.21d:2 0.226:2 0.229:2 0.22b:2 0.230:2 0.235:2 0.237:2 0.23a:2 0.23b:2 0.23e:2 0.241:2 0.243:2 0.24d:2 0.254:2 0.25b:2 0.25e:2 0.261:2 0.265:2 0.26c:2 0.27b:2 0.27d:2 0.27f:2 0.283:2 0.284:2 0.288:2 0.2ae:2 0.2b0:2 0.2b1:2 0.2b4:2 0.2bb:2 0.2bf:2 0.2c0:2 0.2c3:2 0.2c5:2 0.2cd:2 0.2cf:2 0.2df:2 0.2e9:2 0.2ea:2 0.2f9:2 0.303:2 0.309:2 0.30a:2 0.30b:2 0.30d:2 0.312:2 0.325:2 0.32b:2 0.32c:2 0.32d:2 0.333:2 0.334:2 0.339:2 0.33a:2 0.33f:2 0.342:2 0.344:2 0.359:2 0.362:2 0.368:2 0.36c:2 0.379:2 0.37a:2 0.38f:2 0.395:2 0.3a2:2 0.3a8:2 0.3a9:2 0.3b1:2 0.3b4:2 0.3b5:2 0.3be:2 0.3c3:2 0.3c5:2 0.3d1:2 0.3d5:2 0.3da:2 0.3e0:2 0.3e9:2 0.3eb:2 0.3ed:2 0.3ef:2 0.3f6:2 0.3f7:2 0.3f9:2) currently wait for new map
- 2017-07-11 13:25:36.197670 I | rook-ceph-mon0: 2017-07-11 13:25:29.820925 osd.0 osd.0 10.233.72.0:6800/180 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.831826 secs
- 2017-07-11 13:25:36.197774 I | rook-ceph-mon0: 2017-07-11 13:25:29.820936 osd.0 osd.0 10.233.72.0:6800/180 4 : cluster [WRN] slow request 60.831826 seconds old, received at 2017-07-11 13:24:28.989049: osd_pg_create(e9 0.6:2 0.7:2 0.9:2 0.b:2 0.10:2 0.14:2 0.18:2 0.19:2 0.27:2 0.28:2 0.29:2 0.2c:2 0.31:2 0.3b:2 0.3d:2 0.42:2 0.44:2 0.46:2 0.49:2 0.50:2 0.53:2 0.55:2 0.59:2 0.5b:2 0.5d:2 0.5e:2 0.61:2 0.63:2 0.64:2 0.65:2 0.66:2 0.69:2 0.6b:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.82:2 0.83:2 0.90:2 0.9d:2 0.9f:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.a7:2 0.a8:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.ba:2 0.bb:2 0.bd:2 0.bf:2 0.c6:2 0.cd:2 0.d0:2 0.d3:2 0.d4:2 0.d6:2 0.d7:2 0.da:2 0.dd:2 0.e1:2 0.e3:2 0.e4:2 0.e5:2 0.e7:2 0.e8:2 0.e9:2 0.ed:2 0.ee:2 0.f4:2 0.f8:2 0.fc:2 0.fd:2 0.10c:2 0.10e:2 0.110:2 0.116:2 0.117:2 0.118:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.128:2 0.12a:2 0.12c:2 0.12f:2 0.132:2 0.135:2 0.140:2 0.141:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.160:2 0.163:2 0.166:2 0.16a:2 0.170:2 0.179:2 0.17b:2 0.17c:2 0.17e:2 0.17f:2 0.180:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.192:2 0.194:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b0:2 0.1b1:2 0.1b4:2 0.1b7:2 0.1b8:2 0.1b9:2 0.1ba:2 0.1be:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1ce:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1de:2 0.1e1:2 0.1e2:2 0.1e4:2 0.1e6:2 0.1eb:2 0.1ed:2 0.1f5:2 0.1f7:2 0.1f8:2 0.1fe:2 0.200:2 0.204:2 0.206:2 0.207:2 0.20a:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.214:2 0.216:2 0.21c:2 0.21e:2 0.227:2 0.228:2 0.22a:2 0.22b:2 0.22c:2 0.22d:2 0.231:2 0.23c:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.250:2 0.252:2 0.255:2 0.25b:2 0.25e:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26d:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.277:2 0.279:2 0.27f:2 0.282:2 0.286:2 0.28c:2 0.28f:2 0.292:2 0.294:2 0.295:2 0.296:2 0.298:2 0.299:2 0.29d:2 0.2a1:2 0.2a4:2 0.2ab:2 0.2ae:2 0.2b2:2 0.2b3:2 0.2b4:2 0.2b5:2 0.2bb:2 0.2bc:2 0.2be:2 0.2c1:2 0.2c4:2 0.2c5:2 0.2cb:2 0.2cd:2 0.2ce:2 0.2d2:2 0.2d3:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e7:2 0.2ee:2 0.2ef:2 0.2f0:2 0.2f6:2 0.2fa:2 0.2fb:2 0.304:2 0.306:2 0.309:2 0.30c:2 0.310:2 0.312:2 0.316:2 0.317:2 0.31a:2 0.31d:2 0.31e:2 0.31f:2 0.323:2 0.324:2 0.328:2 0.32b:2 0.32d:2 0.331:2 0.332:2 0.338:2 0.33b:2 0.33e:2 0.340:2 0.343:2 0.346:2 0.349:2 0.34d:2 0.351:2 0.352:2 0.355:2 0.356:2 0.358:2 0.35c:2 0.362:2 0.363:2 0.36b:2 0.372:2 0.373:2 0.374:2 0.377:2 0.378:2 0.37b:2 0.381:2 0.382:2 0.385:2 0.386:2 0.389:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.396:2 0.399:2 0.3a5:2 0.3a6:2 0.3a7:2 0.3a9:2 0.3ac:2 0.3af:2 0.3b6:2 0.3b7:2 0.3b8:2 0.3b9:2 0.3bc:2 0.3bd:2 0.3be:2 0.3c0:2 0.3c2:2 0.3c7:2 0.3ce:2 0.3cf:2 0.3d4:2 0.3d7:2 0.3d8:2 0.3de:2 0.3e6:2 0.3eb:2 0.3ed:2 0.3ee:2 0.3ef:2 0.3f3:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2) currently started
- 2017-07-11 13:25:36.197912 I | rook-ceph-mon0: 2017-07-11 13:25:32.821643 osd.0 osd.0 10.233.72.0:6800/180 5 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 62.492130 secs
- 2017-07-11 13:25:36.197951 I | rook-ceph-mon0: 2017-07-11 13:25:32.821648 osd.0 osd.0 10.233.72.0:6800/180 6 : cluster [WRN] slow request 62.492130 seconds old, received at 2017-07-11 13:24:30.329295: osd_pg_create(e10 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.197982 I | rook-ceph-mon0: 2017-07-11 13:25:32.821663 osd.0 osd.0 10.233.72.0:6800/180 7 : cluster [WRN] slow request 61.883204 seconds old, received at 2017-07-11 13:24:30.938221: osd_pg_create(e11 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.198005 I | rook-ceph-mon0: 2017-07-11 13:25:32.821665 osd.0 osd.0 10.233.72.0:6800/180 8 : cluster [WRN] slow request 60.602348 seconds old, received at 2017-07-11 13:24:32.219078: osd_pg_create(e12 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.198104 I | rook-ceph-mon0: 2017-07-11 13:25:32.821668 osd.0 osd.0 10.233.72.0:6800/180 9 : cluster [WRN] slow request 60.120760 seconds old, received at 2017-07-11 13:24:32.700666: osd_pg_create(e13 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.198124 I | rook-ceph-mon0: 2017-07-11 13:25:32.821670 osd.0 osd.0 10.233.72.0:6800/180 10 : cluster [WRN] slow request 59.026349 seconds old, received at 2017-07-11 13:24:33.795077: osd_pg_create(e14 0.6:2 0.b:2 0.f:2 0.26:2 0.28:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f4:2 0.f8:2 0.112:2 0.117:2 0.119:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.154:2 0.16a:2 0.170:2 0.179:2 0.183:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f8:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24e:2 0.25f:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e5:2 0.2ee:2 0.2f3:2 0.2fa:2 0.304:2 0.316:2 0.317:2 0.31e:2 0.31f:2 0.320:2 0.324:2 0.328:2 0.332:2 0.343:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3e6:2 0.3f3:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.198138 I | rook-ceph-mon0: 2017-07-11 13:25:33.077046 osd.0 osd.0 10.233.72.0:6800/180 11 : cluster [WRN] map e19 wrongly marked me down at e18
- 2017-07-11 13:25:36.198149 I | rook-ceph-mon0: 2017-07-11 13:25:33.821853 osd.0 osd.0 10.233.72.0:6800/180 12 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 63.492492 secs
- 2017-07-11 13:25:36.198204 I | rook-ceph-mon0: 2017-07-11 13:25:33.821865 osd.0 osd.0 10.233.72.0:6800/180 13 : cluster [WRN] slow request 63.492492 seconds old, received at 2017-07-11 13:24:30.329295: osd_pg_create(e10 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.198221 I | rook-ceph-mon0: 2017-07-11 13:25:33.821871 osd.0 osd.0 10.233.72.0:6800/180 14 : cluster [WRN] slow request 62.883566 seconds old, received at 2017-07-11 13:24:30.938221: osd_pg_create(e11 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.198258 I | rook-ceph-mon0: 2017-07-11 13:25:33.821880 osd.0 osd.0 10.233.72.0:6800/180 15 : cluster [WRN] slow request 61.602710 seconds old, received at 2017-07-11 13:24:32.219078: osd_pg_create(e12 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.198284 I | rook-ceph-mon0: 2017-07-11 13:25:33.821885 osd.0 osd.0 10.233.72.0:6800/180 16 : cluster [WRN] slow request 61.121121 seconds old, received at 2017-07-11 13:24:32.700666: osd_pg_create(e13 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.198300 I | rook-ceph-mon0: 2017-07-11 13:25:33.821891 osd.0 osd.0 10.233.72.0:6800/180 17 : cluster [WRN] slow request 60.026710 seconds old, received at 2017-07-11 13:24:33.795077: osd_pg_create(e14 0.6:2 0.b:2 0.f:2 0.26:2 0.28:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f4:2 0.f8:2 0.112:2 0.117:2 0.119:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.154:2 0.16a:2 0.170:2 0.179:2 0.183:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f8:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24e:2 0.25f:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e5:2 0.2ee:2 0.2f3:2 0.2fa:2 0.304:2 0.316:2 0.317:2 0.31e:2 0.31f:2 0.320:2 0.324:2 0.328:2 0.332:2 0.343:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3e6:2 0.3f3:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.198320 I | rook-ceph-mon0: 2017-07-11 13:25:34.822145 osd.0 osd.0 10.233.72.0:6800/180 18 : cluster [WRN] 8 slow requests, 3 included below; oldest blocked for > 64.492734 secs
- 2017-07-11 13:25:36.198352 I | rook-ceph-mon0: 2017-07-11 13:25:34.822151 osd.0 osd.0 10.233.72.0:6800/180 19 : cluster [WRN] slow request 58.219143 seconds old, received at 2017-07-11 13:24:36.602887: osd_pg_create(e15 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.7f:2 0.8b:2 0.a1:2 0.a2:2 0.a6:2 0.a7:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.125:2 0.135:2 0.147:2 0.150:2 0.151:2 0.15a:2 0.16a:2 0.170:2 0.171:2 0.175:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.190:2 0.196:2 0.19c:2 0.1a0:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.21f:2 0.227:2 0.228:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.239:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.32a:2 0.332:2 0.338:2 0.346:2 0.34b:2 0.34d:2 0.35a:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39a:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:36.198368 I | rook-ceph-mon0: 2017-07-11 13:25:34.822159 osd.0 osd.0 10.233.72.0:6800/180 20 : cluster [WRN] slow request 57.546311 seconds old, received at 2017-07-11 13:24:37.275719: osd_pg_create(e16 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:36.198386 I | rook-ceph-mon0: 2017-07-11 13:25:34.822164 osd.0 osd.0 10.233.72.0:6800/180 21 : cluster [WRN] slow request 53.261450 seconds old, received at 2017-07-11 13:24:41.560579: osd_pg_create(e17 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:37.486550 I | rook-ceph-mon0: 2017-07-11 13:25:29.147192 osd.1 osd.1 10.233.76.4:6800/178 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.092556 secs
- 2017-07-11 13:25:37.486660 I | rook-ceph-mon0: 2017-07-11 13:25:29.147198 osd.1 osd.1 10.233.76.4:6800/178 4 : cluster [WRN] slow request 60.092556 seconds old, received at 2017-07-11 13:24:29.054610: osd_pg_create(e9 0.1:2 0.4:2 0.8:2 0.c:2 0.11:2 0.12:2 0.13:2 0.16:2 0.1a:2 0.1b:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.2b:2 0.33:2 0.34:2 0.36:2 0.37:2 0.38:2 0.39:2 0.3c:2 0.40:2 0.41:2 0.43:2 0.4b:2 0.4d:2 0.4e:2 0.52:2 0.57:2 0.5a:2 0.5f:2 0.62:2 0.67:2 0.6d:2 0.74:2 0.75:2 0.80:2 0.81:2 0.84:2 0.86:2 0.87:2 0.8c:2 0.8d:2 0.8f:2 0.92:2 0.93:2 0.96:2 0.99:2 0.9a:2 0.9b:2 0.9c:2 0.a4:2 0.a9:2 0.aa:2 0.ae:2 0.af:2 0.b1:2 0.b2:2 0.b7:2 0.b9:2 0.be:2 0.c1:2 0.c7:2 0.c9:2 0.cf:2 0.db:2 0.df:2 0.e6:2 0.f0:2 0.f1:2 0.f2:2 0.f3:2 0.f5:2 0.f6:2 0.fa:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.106:2 0.109:2 0.10b:2 0.10d:2 0.113:2 0.114:2 0.115:2 0.11a:2 0.121:2 0.124:2 0.125:2 0.12b:2 0.130:2 0.136:2 0.137:2 0.139:2 0.13a:2 0.13b:2 0.13c:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14b:2 0.14d:2 0.155:2 0.156:2 0.158:2 0.159:2 0.15b:2 0.15d:2 0.161:2 0.164:2 0.165:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.178:2 0.17d:2 0.184:2 0.187:2 0.18c:2 0.18e:2 0.18f:2 0.190:2 0.191:2 0.193:2 0.197:2 0.199:2 0.19a:2 0.19b:2 0.19d:2 0.1a1:2 0.1a2:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b2:2 0.1b3:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1c9:2 0.1d1:2 0.1d3:2 0.1d9:2 0.1da:2 0.1dd:2 0.1e0:2 0.1e3:2 0.1e5:2 0.1e7:2 0.1e8:2 0.1ea:2 0.1ee:2 0.1f1:2 0.1f2:2 0.1f3:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fb:2 0.1fc:2 0.1fd:2 0.1ff:2 0.202:2 0.208:2 0.209:2 0.20c:2 0.210:2 0.213:2 0.215:2 0.219:2 0.21b:2 0.220:2 0.221:2 0.225:2 0.229:2 0.22e:2 0.230:2 0.233:2 0.234:2 0.236:2 0.238:2 0.240:2 0.241:2 0.244:2 0.245:2 0.24b:2 0.24f:2 0.256:2 0.257:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.268:2 0.26c:2 0.26f:2 0.274:2 0.275:2 0.278:2 0.27b:2 0.27c:2 0.27d:2 0.27e:2 0.281:2 0.284:2 0.287:2 0.288:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.293:2 0.29b:2 0.29c:2 0.29f:2 0.2a2:2 0.2a3:2 0.2a5:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ad:2 0.2b0:2 0.2b6:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2bd:2 0.2c0:2 0.2c3:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2cf:2 0.2d4:2 0.2d6:2 0.2d8:2 0.2da:2 0.2dc:2 0.2e6:2 0.2e8:2 0.2f2:2 0.2f4:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2fd:2 0.2ff:2 0.301:2 0.302:2 0.303:2 0.305:2 0.307:2 0.30b:2 0.30d:2 0.30f:2 0.311:2 0.314:2 0.315:2 0.318:2 0.319:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.336:2 0.339:2 0.33a:2 0.33d:2 0.347:2 0.348:2 0.34a:2 0.34e:2 0.34f:2 0.350:2 0.353:2 0.357:2 0.35b:2 0.35d:2 0.35e:2 0.35f:2 0.361:2 0.366:2 0.368:2 0.369:2 0.36f:2 0.370:2 0.371:2 0.375:2 0.376:2 0.37c:2 0.37e:2 0.380:2 0.384:2 0.387:2 0.38a:2 0.38e:2 0.390:2 0.392:2 0.395:2 0.39a:2 0.39b:2 0.39c:2 0.39d:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b3:2 0.3b4:2 0.3b5:2 0.3ba:2 0.3c1:2 0.3c3:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cc:2 0.3cd:2 0.3d1:2 0.3d2:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3da:2 0.3db:2 0.3dc:2 0.3dd:2 0.3df:2 0.3e0:2 0.3e2:2 0.3e3:2 0.3e5:2 0.3e7:2 0.3ea:2 0.3ec:2 0.3f0:2 0.3f1:2 0.3f4:2 0.3f8:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:37.486799 I | rook-ceph-mon0: 2017-07-11 13:25:33.108430 osd.3 osd.3 10.233.86.0:6800/178 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 56.563008 secs
- 2017-07-11 13:25:37.486846 I | rook-ceph-mon0: 2017-07-11 13:25:33.108435 osd.3 osd.3 10.233.86.0:6800/178 4 : cluster [WRN] slow request 56.563008 seconds old, received at 2017-07-11 13:24:36.545354: osd_pg_create(e15 0.a:2 0.d:2 0.18:2 0.1f:2 0.23:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.72:2 0.7c:2 0.88:2 0.89:2 0.8d:2 0.91:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.b9:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e2:2 0.e9:2 0.ea:2 0.ef:2 0.fc:2 0.ff:2 0.108:2 0.10e:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.127:2 0.12d:2 0.130:2 0.131:2 0.132:2 0.136:2 0.138:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.154:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.184:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.195:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1d7:2 0.1de:2 0.1df:2 0.1e2:2 0.1e3:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1f8:2 0.1fb:2 0.202:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.24e:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.278:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.298:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2ed:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.2ff:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.314:2 0.316:2 0.319:2 0.31d:2 0.31f:2 0.329:2 0.331:2 0.335:2 0.337:2 0.33b:2 0.33c:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.369:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3ba:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3d2:2 0.3d6:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2 0.3f1:2) currently started
- 2017-07-11 13:25:40.233598 I | rook-ceph-mon0: 2017-07-11 13:25:32.591136 osd.2 osd.2 10.233.69.0:6800/178 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.303083 secs
- 2017-07-11 13:25:40.233692 I | rook-ceph-mon0: 2017-07-11 13:25:32.591150 osd.2 osd.2 10.233.69.0:6800/178 4 : cluster [WRN] slow request 60.303083 seconds old, received at 2017-07-11 13:24:32.288034: osd_pg_create(e12 0.5:2 0.7:2 0.9:2 0.12:2 0.13:2 0.14:2 0.15:2 0.16:2 0.17:2 0.1b:2 0.21:2 0.27:2 0.29:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.39:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5b:2 0.5f:2 0.60:2 0.63:2 0.6e:2 0.72:2 0.7a:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.95:2 0.98:2 0.9a:2 0.9d:2 0.9e:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.b8:2 0.ba:2 0.c0:2 0.c2:2 0.c5:2 0.cb:2 0.ce:2 0.d2:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.fe:2 0.100:2 0.106:2 0.107:2 0.10c:2 0.10d:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.127:2 0.128:2 0.12c:2 0.12f:2 0.131:2 0.133:2 0.134:2 0.141:2 0.142:2 0.14b:2 0.14d:2 0.159:2 0.15a:2 0.15c:2 0.160:2 0.161:2 0.166:2 0.169:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.17f:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1db:2 0.1e1:2 0.1e4:2 0.1e9:2 0.1ee:2 0.1f2:2 0.1f3:2 0.1f6:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.21d:2 0.21f:2 0.223:2 0.224:2 0.228:2 0.229:2 0.22b:2 0.22e:2 0.233:2 0.235:2 0.237:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.251:2 0.252:2 0.253:2 0.254:2 0.25c:2 0.265:2 0.267:2 0.269:2 0.26b:2 0.26c:2 0.26d:2 0.276:2 0.278:2 0.279:2 0.27b:2 0.27f:2 0.280:2 0.284:2 0.286:2 0.288:2 0.290:2 0.298:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b3:2 0.2b8:2 0.2b9:2 0.2bf:2 0.2c8:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2df:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ea:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30b:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32d:2 0.32f:2 0.330:2 0.334:2 0.336:2 0.33a:2 0.344:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.359:2 0.363:2 0.364:2 0.366:2 0.369:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b0:2 0.3b2:2 0.3b3:2 0.3b5:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3ed:2 0.3f4:2) currently started
- 2017-07-11 13:25:40.233732 I | rook-ceph-mon0: 2017-07-11 13:25:38.595704 osd.2 osd.2 10.233.69.0:6800/178 5 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 65.997406 secs
- 2017-07-11 13:25:40.233760 I | rook-ceph-mon0: 2017-07-11 13:25:38.595710 osd.2 osd.2 10.233.69.0:6800/178 6 : cluster [WRN] slow request 65.997406 seconds old, received at 2017-07-11 13:24:32.598200: osd_pg_create(e13 0.5:2 0.7:2 0.9:2 0.12:2 0.13:2 0.14:2 0.15:2 0.16:2 0.17:2 0.1b:2 0.21:2 0.27:2 0.29:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.39:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5b:2 0.5f:2 0.60:2 0.63:2 0.6e:2 0.72:2 0.7a:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.95:2 0.98:2 0.9a:2 0.9d:2 0.9e:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.b8:2 0.ba:2 0.c0:2 0.c2:2 0.c5:2 0.cb:2 0.ce:2 0.d2:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.fe:2 0.100:2 0.106:2 0.107:2 0.10c:2 0.10d:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.127:2 0.128:2 0.12c:2 0.12f:2 0.131:2 0.133:2 0.134:2 0.141:2 0.142:2 0.14b:2 0.14d:2 0.159:2 0.15a:2 0.15c:2 0.160:2 0.161:2 0.166:2 0.169:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.17f:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1db:2 0.1e1:2 0.1e4:2 0.1e9:2 0.1ee:2 0.1f2:2 0.1f3:2 0.1f6:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.21d:2 0.21f:2 0.223:2 0.224:2 0.228:2 0.229:2 0.22b:2 0.22e:2 0.233:2 0.235:2 0.237:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.251:2 0.252:2 0.253:2 0.254:2 0.25c:2 0.265:2 0.267:2 0.269:2 0.26b:2 0.26c:2 0.26d:2 0.276:2 0.278:2 0.279:2 0.27b:2 0.27f:2 0.280:2 0.284:2 0.286:2 0.288:2 0.290:2 0.298:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b3:2 0.2b8:2 0.2b9:2 0.2bf:2 0.2c8:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2df:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ea:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30b:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32d:2 0.32f:2 0.330:2 0.334:2 0.336:2 0.33a:2 0.344:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.359:2 0.363:2 0.364:2 0.366:2 0.369:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b0:2 0.3b2:2 0.3b3:2 0.3b5:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3ed:2 0.3f4:2) currently wait for new map
- 2017-07-11 13:25:40.233778 I | rook-ceph-mon0: 2017-07-11 13:25:38.595723 osd.2 osd.2 10.233.69.0:6800/178 7 : cluster [WRN] slow request 64.714804 seconds old, received at 2017-07-11 13:24:33.880802: osd_pg_create(e14 0.5:2 0.7:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.72:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.9a:2 0.9d:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.c2:2 0.c5:2 0.d8:2 0.e0:2 0.e5:2 0.eb:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.127:2 0.12c:2 0.131:2 0.133:2 0.141:2 0.14d:2 0.159:2 0.15c:2 0.161:2 0.166:2 0.16f:2 0.17a:2 0.17b:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.198:2 0.199:2 0.1b7:2 0.1c2:2 0.1c9:2 0.1ce:2 0.1d2:2 0.1da:2 0.1e1:2 0.1f2:2 0.1f3:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.213:2 0.218:2 0.21a:2 0.21f:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26b:2 0.26d:2 0.278:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2cb:2 0.2ce:2 0.2d3:2 0.2d7:2 0.2da:2 0.2db:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f6:2 0.2fd:2 0.306:2 0.30e:2 0.31b:2 0.32f:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.356:2 0.363:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2) currently wait for new map
- 2017-07-11 13:25:41.691045 I | rook-ceph-mon0: 2017-07-11 13:25:41.691008 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e20: 6 total, 1 up, 6 in
- 2017-07-11 13:25:41.882386 I | rook-ceph-mon0: 2017-07-11 13:25:41.880504 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:25:41.887937 I | rook-ceph-mon0: 2017-07-11 13:25:41.887917 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/392738425' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:25:42.874903 I | rook-ceph-mon0: 2017-07-11 13:25:37.449548 osd.4 osd.4 10.233.124.4:6800/178 7 : cluster [WRN] 2 slow requests, 1 included below; oldest blocked for > 60.671172 secs
- 2017-07-11 13:25:42.874922 I | rook-ceph-mon0: 2017-07-11 13:25:37.449554 osd.4 osd.4 10.233.124.4:6800/178 8 : cluster [WRN] slow request 60.671172 seconds old, received at 2017-07-11 13:24:36.778345: osd_pg_create(e15 0.10:2 0.13:2 0.1d:2 0.24:2 0.4d:2 0.5b:2 0.6c:2 0.77:2 0.7e:2 0.90:2 0.9e:2 0.ac:2 0.b7:2 0.cd:2 0.ce:2 0.d1:2 0.ed:2 0.f2:2 0.116:2 0.11b:2 0.129:2 0.12e:2 0.133:2 0.13d:2 0.13e:2 0.142:2 0.146:2 0.15e:2 0.176:2 0.187:2 0.1c4:2 0.1dc:2 0.1e8:2 0.203:2 0.23e:2 0.251:2 0.254:2 0.274:2 0.28b:2 0.2b0:2 0.2b3:2 0.2c8:2 0.2f4:2 0.311:2 0.326:2 0.33f:2 0.343:2 0.344:2 0.35e:2 0.36c:2 0.379:2 0.395:2 0.39c:2 0.3a7:2 0.3b0:2 0.3c3:2 0.3e3:2) currently wait for new map
- 2017-07-11 13:25:42.874926 I | rook-ceph-mon0: 2017-07-11 13:25:41.691126 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 131 : cluster [INF] osdmap e20: 6 total, 1 up, 6 in
- 2017-07-11 13:25:43.184205 I | rook-ceph-mon0: 2017-07-11 13:25:43.184118 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.5 10.233.99.6:6800/179 boot
- 2017-07-11 13:25:43.184606 I | rook-ceph-mon0: 2017-07-11 13:25:43.184587 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.4 10.233.124.4:6800/178 boot
- 2017-07-11 13:25:43.184890 I | rook-ceph-mon0: 2017-07-11 13:25:43.184868 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e21: 6 total, 3 up, 6 in
- 2017-07-11 13:25:43.610317 I | rook-ceph-mon0: 2017-07-11 13:25:43.610264 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e22: 6 total, 3 up, 6 in
- 2017-07-11 13:25:44.434442 I | rook-ceph-mon0: 2017-07-11 13:25:43.184296 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 133 : cluster [INF] osd.5 10.233.99.6:6800/179 boot
- 2017-07-11 13:25:44.434581 I | rook-ceph-mon0: 2017-07-11 13:25:43.184645 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 134 : cluster [INF] osd.4 10.233.124.4:6800/178 boot
- 2017-07-11 13:25:44.434640 I | rook-ceph-mon0: 2017-07-11 13:25:43.184928 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 135 : cluster [INF] osdmap e21: 6 total, 3 up, 6 in
- 2017-07-11 13:25:44.434658 I | rook-ceph-mon0: 2017-07-11 13:25:43.610372 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 136 : cluster [INF] osdmap e22: 6 total, 3 up, 6 in
- 2017-07-11 13:25:44.826276 I | rook-ceph-mon0: 2017-07-11 13:25:44.824112 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e23: 6 total, 3 up, 6 in
- 2017-07-11 13:25:45.360284 I | rook-ceph-mon0: 2017-07-11 13:25:45.360040 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4803 MB, avail 94383 MB
- 2017-07-11 13:25:46.302902 I | rook-ceph-mon0: 2017-07-11 13:25:44.690576 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 113 : audit [INF] from='client.? 10.233.124.5:0/4091151238' entity='client.admin' cmd=[{"prefix": "auth get-key", "entity": "client.admin", "format": "json"}]: dispatch
- 2017-07-11 13:25:46.302998 I | rook-ceph-mon0: 2017-07-11 13:25:44.824113 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 137 : cluster [INF] osdmap e23: 6 total, 3 up, 6 in
- 2017-07-11 13:25:46.304230 I | rook-ceph-mon0: 2017-07-11 13:25:46.304127 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:25:46.304794 I | rook-ceph-mon0: 2017-07-11 13:25:46.304778 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e24: 6 total, 4 up, 6 in
- 2017-07-11 13:25:47.487959 I | rook-ceph-mon0: 2017-07-11 13:25:36.822488 osd.0 osd.0 10.233.72.0:6800/180 22 : cluster [WRN] 8 slow requests, 1 included below; oldest blocked for > 66.493134 secs
- 2017-07-11 13:25:47.488978 I | rook-ceph-mon0: 2017-07-11 13:25:36.822497 osd.0 osd.0 10.233.72.0:6800/180 23 : cluster [WRN] slow request 60.219543 seconds old, received at 2017-07-11 13:24:36.602887: osd_pg_create(e15 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.7f:2 0.8b:2 0.a1:2 0.a2:2 0.a6:2 0.a7:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.125:2 0.135:2 0.147:2 0.150:2 0.151:2 0.15a:2 0.16a:2 0.170:2 0.171:2 0.175:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.190:2 0.196:2 0.19c:2 0.1a0:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.21f:2 0.227:2 0.228:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.239:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.32a:2 0.332:2 0.338:2 0.346:2 0.34b:2 0.34d:2 0.35a:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39a:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:47.489019 I | rook-ceph-mon0: 2017-07-11 13:25:37.109010 osd.3 osd.3 10.233.86.0:6800/178 5 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.563637 secs
- 2017-07-11 13:25:47.489055 I | rook-ceph-mon0: 2017-07-11 13:25:37.109016 osd.3 osd.3 10.233.86.0:6800/178 6 : cluster [WRN] slow request 60.563637 seconds old, received at 2017-07-11 13:24:36.545354: osd_pg_create(e15 0.a:2 0.d:2 0.18:2 0.1f:2 0.23:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.72:2 0.7c:2 0.88:2 0.89:2 0.8d:2 0.91:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.b9:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e2:2 0.e9:2 0.ea:2 0.ef:2 0.fc:2 0.ff:2 0.108:2 0.10e:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.127:2 0.12d:2 0.130:2 0.131:2 0.132:2 0.136:2 0.138:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.154:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.184:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.195:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1d7:2 0.1de:2 0.1df:2 0.1e2:2 0.1e3:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1f8:2 0.1fb:2 0.202:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.24e:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.278:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.298:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2ed:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.2ff:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.314:2 0.316:2 0.319:2 0.31d:2 0.31f:2 0.329:2 0.331:2 0.335:2 0.337:2 0.33b:2 0.33c:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.369:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3ba:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3d2:2 0.3d6:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2 0.3f1:2) currently started
- 2017-07-11 13:25:47.489072 I | rook-ceph-mon0: 2017-07-11 13:25:37.822707 osd.0 osd.0 10.233.72.0:6800/180 24 : cluster [WRN] 8 slow requests, 1 included below; oldest blocked for > 67.493358 secs
- 2017-07-11 13:25:47.489087 I | rook-ceph-mon0: 2017-07-11 13:25:37.822725 osd.0 osd.0 10.233.72.0:6800/180 25 : cluster [WRN] slow request 60.546935 seconds old, received at 2017-07-11 13:24:37.275719: osd_pg_create(e16 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:47.489106 I | rook-ceph-mon0: 2017-07-11 13:25:41.823480 osd.0 osd.0 10.233.72.0:6800/180 26 : cluster [WRN] 8 slow requests, 1 included below; oldest blocked for > 71.494159 secs
- 2017-07-11 13:25:47.489137 I | rook-ceph-mon0: 2017-07-11 13:25:41.823485 osd.0 osd.0 10.233.72.0:6800/180 27 : cluster [WRN] slow request 60.262875 seconds old, received at 2017-07-11 13:24:41.560579: osd_pg_create(e17 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:47.489158 I | rook-ceph-mon0: 2017-07-11 13:25:42.116011 osd.3 osd.3 10.233.86.0:6800/178 7 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 64.892901 secs
- 2017-07-11 13:25:47.489171 I | rook-ceph-mon0: 2017-07-11 13:25:42.116021 osd.3 osd.3 10.233.86.0:6800/178 8 : cluster [WRN] slow request 64.892901 seconds old, received at 2017-07-11 13:24:37.222959: osd_pg_create(e16 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:47.489191 I | rook-ceph-mon0: 2017-07-11 13:25:42.116031 osd.3 osd.3 10.233.86.0:6800/178 9 : cluster [WRN] slow request 60.607081 seconds old, received at 2017-07-11 13:24:41.508779: osd_pg_create(e17 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:47.489221 I | rook-ceph-mon0: 2017-07-11 13:25:43.116354 osd.3 osd.3 10.233.86.0:6800/178 10 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 65.893370 secs
- 2017-07-11 13:25:47.489237 I | rook-ceph-mon0: 2017-07-11 13:25:43.116360 osd.3 osd.3 10.233.86.0:6800/178 11 : cluster [WRN] slow request 65.893370 seconds old, received at 2017-07-11 13:24:37.222959: osd_pg_create(e16 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:47.489255 I | rook-ceph-mon0: 2017-07-11 13:25:43.116363 osd.3 osd.3 10.233.86.0:6800/178 12 : cluster [WRN] slow request 61.607550 seconds old, received at 2017-07-11 13:24:41.508779: osd_pg_create(e17 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:47.489270 I | rook-ceph-mon0: 2017-07-11 13:25:44.152154 osd.1 osd.1 10.233.76.4:6800/178 5 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 73.772555 secs
- 2017-07-11 13:25:47.489300 I | rook-ceph-mon0: 2017-07-11 13:25:44.152167 osd.1 osd.1 10.233.76.4:6800/178 6 : cluster [WRN] slow request 73.772555 seconds old, received at 2017-07-11 13:24:30.379551: osd_pg_create(e10 0.3:2 0.9:2 0.2a:2 0.2d:2 0.35:2 0.60:2 0.63:2 0.6e:2 0.76:2 0.7a:2 0.7d:2 0.8a:2 0.ab:2 0.b6:2 0.bc:2 0.ca:2 0.ce:2 0.d2:2 0.eb:2 0.11f:2 0.133:2 0.13e:2 0.141:2 0.148:2 0.14c:2 0.14e:2 0.166:2 0.167:2 0.180:2 0.198:2 0.19e:2 0.1a5:2 0.1a6:2 0.1b6:2 0.1bc:2 0.1d8:2 0.1ef:2 0.21a:2 0.222:2 0.223:2 0.226:2 0.24a:2 0.25c:2 0.25d:2 0.29a:2 0.2a0:2 0.2a6:2 0.2af:2 0.2b1:2 0.2b3:2 0.2c6:2 0.2f6:2 0.300:2 0.325:2 0.32c:2 0.330:2 0.33c:2 0.342:2 0.34b:2 0.363:2 0.36c:2 0.378:2 0.379:2 0.37f:2 0.388:2 0.396:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3e8:2 0.3eb:2) currently wait for new map
- 2017-07-11 13:25:47.489313 I | rook-ceph-mon0: 2017-07-11 13:25:44.491846 osd.3 osd.3 10.233.86.0:6800/178 13 : cluster [WRN] map e18 wrongly marked me down at e18
- 2017-07-11 13:25:47.489325 I | rook-ceph-mon0: 2017-07-11 13:25:45.152387 osd.1 osd.1 10.233.76.4:6800/178 7 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 74.772758 secs
- 2017-07-11 13:25:47.489337 I | rook-ceph-mon0: 2017-07-11 13:25:45.152616 osd.1 osd.1 10.233.76.4:6800/178 8 : cluster [WRN] slow request 74.772758 seconds old, received at 2017-07-11 13:24:30.379551: osd_pg_create(e10 0.3:2 0.9:2 0.2a:2 0.2d:2 0.35:2 0.60:2 0.63:2 0.6e:2 0.76:2 0.7a:2 0.7d:2 0.8a:2 0.ab:2 0.b6:2 0.bc:2 0.ca:2 0.ce:2 0.d2:2 0.eb:2 0.11f:2 0.133:2 0.13e:2 0.141:2 0.148:2 0.14c:2 0.14e:2 0.166:2 0.167:2 0.180:2 0.198:2 0.19e:2 0.1a5:2 0.1a6:2 0.1b6:2 0.1bc:2 0.1d8:2 0.1ef:2 0.21a:2 0.222:2 0.223:2 0.226:2 0.24a:2 0.25c:2 0.25d:2 0.29a:2 0.2a0:2 0.2a6:2 0.2af:2 0.2b1:2 0.2b3:2 0.2c6:2 0.2f6:2 0.300:2 0.325:2 0.32c:2 0.330:2 0.33c:2 0.342:2 0.34b:2 0.363:2 0.36c:2 0.378:2 0.379:2 0.37f:2 0.388:2 0.396:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3e8:2 0.3eb:2) currently wait for new map
- 2017-07-11 13:25:47.489370 I | rook-ceph-mon0: 2017-07-11 13:25:45.152638 osd.1 osd.1 10.233.76.4:6800/178 9 : cluster [WRN] slow request 74.168544 seconds old, received at 2017-07-11 13:24:30.983765: osd_pg_create(e11 0.1:2 0.3:2 0.4:2 0.8:2 0.9:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2a:2 0.2b:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.39:2 0.3c:2 0.40:2 0.41:2 0.43:2 0.4b:2 0.4d:2 0.4e:2 0.52:2 0.5a:2 0.5f:2 0.60:2 0.62:2 0.63:2 0.6d:2 0.6e:2 0.75:2 0.76:2 0.7a:2 0.7d:2 0.80:2 0.81:2 0.87:2 0.8a:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.9a:2 0.9b:2 0.9c:2 0.a9:2 0.ab:2 0.b1:2 0.b2:2 0.b6:2 0.bc:2 0.be:2 0.c9:2 0.ca:2 0.ce:2 0.cf:2 0.d2:2 0.db:2 0.df:2 0.e6:2 0.eb:2 0.f1:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.133:2 0.139:2 0.13b:2 0.13e:2 0.141:2 0.144:2 0.145:2 0.148:2 0.14a:2 0.14b:2 0.14c:2 0.14d:2 0.14e:2 0.155:2 0.158:2 0.159:2 0.15d:2 0.164:2 0.165:2 0.166:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.180:2 0.18e:2 0.18f:2 0.193:2 0.198:2 0.199:2 0.19a:2 0.19b:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d3:2 0.1d8:2 0.1d9:2 0.1dd:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f9:2 0.1fa:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21a:2 0.21b:2 0.220:2 0.222:2 0.223:2 0.225:2 0.226:2 0.230:2 0.233:2 0.234:2 0.236:2 0.240:2 0.241:2 0.244:2 0.24a:2 0.24f:2 0.258:2 0.25a:2 0.25c:2 0.25d:2 0.262:2 0.266:2 0.26c:2 0.274:2 0.275:2 0.27d:2 0.281:2 0.288:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.2a0:2 0.2a3:2 0.2a5:2 0.2a6:2 0.2ad:2 0.2af:2 0.2b1:2 0.2b3:2 0.2ba:2 0.2bd:2 0.2c3:2 0.2c6:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cf:2 0.2d8:2 0.2f6:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.303:2 0.307:2 0.30d:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.325:2 0.32a:2 0.32c:2 0.32e:2 0.330:2 0.336:2 0.339:2 0.33c:2 0.33d:2 0.342:2 0.347:2 0.34b:2 0.34e:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.363:2 0.36c:2 0.370:2 0.375:2 0.376:2 0.378:2 0.379:2 0.37c:2 0.37f:2 0.380:2 0.384:2 0.387:2 0.388:2 0.38a:2 0.38e:2 0.392:2 0.396:2 0.39b:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c3:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cc:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3e0:2 0.3e3:2 0.3e8:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f4:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:25:47.489640 I | rook-ceph-mon0: 2017-07-11 13:25:46.304297 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 138 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:25:47.489669 I | rook-ceph-mon0: 2017-07-11 13:25:46.304832 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 139 : cluster [INF] osdmap e24: 6 total, 4 up, 6 in
- 2017-07-11 13:25:47.816115 I | rook-ceph-mon0: 2017-07-11 13:25:47.816074 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e25: 6 total, 4 up, 6 in
- 2017-07-11 13:25:49.019874 I | rook-ceph-mon0: 2017-07-11 13:25:47.816193 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 140 : cluster [INF] osdmap e25: 6 total, 4 up, 6 in
- 2017-07-11 13:25:49.415066 I | rook-ceph-mon0: 2017-07-11 13:25:49.415029 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:25:49.415673 I | rook-ceph-mon0: 2017-07-11 13:25:49.415656 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e26: 6 total, 5 up, 6 in
- 2017-07-11 13:25:50.489590 I | rook-ceph-mon0: 2017-07-11 13:25:39.596040 osd.2 osd.2 10.233.69.0:6800/178 8 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 62.798606 secs
- 2017-07-11 13:25:50.489693 I | rook-ceph-mon0: 2017-07-11 13:25:39.596070 osd.2 osd.2 10.233.69.0:6800/178 9 : cluster [WRN] slow request 62.798606 seconds old, received at 2017-07-11 13:24:36.797317: osd_pg_create(e15 0.5:2 0.7:2 0.9:2 0.f:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.70:2 0.7a:2 0.7d:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.92:2 0.94:2 0.97:2 0.98:2 0.9a:2 0.9d:2 0.a5:2 0.a8:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.ba:2 0.c2:2 0.c5:2 0.c9:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.12c:2 0.134:2 0.141:2 0.143:2 0.14b:2 0.14d:2 0.15c:2 0.161:2 0.166:2 0.16c:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19a:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b5:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1e1:2 0.1e9:2 0.1f2:2 0.1f3:2 0.1fd:2 0.1fe:2 0.1ff:2 0.200:2 0.201:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.248:2 0.24a:2 0.24b:2 0.24f:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26a:2 0.26b:2 0.26d:2 0.276:2 0.279:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2f8:2 0.2fd:2 0.306:2 0.30e:2 0.313:2 0.315:2 0.31b:2 0.322:2 0.327:2 0.32f:2 0.330:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.386:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d4:2 0.3d8:2 0.3db:2 0.3dd:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:50.489831 I | rook-ceph-mon0: 2017-07-11 13:25:40.596214 osd.2 osd.2 10.233.69.0:6800/178 10 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 63.798877 secs
- 2017-07-11 13:25:50.489858 I | rook-ceph-mon0: 2017-07-11 13:25:40.596220 osd.2 osd.2 10.233.69.0:6800/178 11 : cluster [WRN] slow request 63.798877 seconds old, received at 2017-07-11 13:24:36.797317: osd_pg_create(e15 0.5:2 0.7:2 0.9:2 0.f:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.70:2 0.7a:2 0.7d:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.92:2 0.94:2 0.97:2 0.98:2 0.9a:2 0.9d:2 0.a5:2 0.a8:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.ba:2 0.c2:2 0.c5:2 0.c9:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.12c:2 0.134:2 0.141:2 0.143:2 0.14b:2 0.14d:2 0.15c:2 0.161:2 0.166:2 0.16c:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19a:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b5:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1e1:2 0.1e9:2 0.1f2:2 0.1f3:2 0.1fd:2 0.1fe:2 0.1ff:2 0.200:2 0.201:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.248:2 0.24a:2 0.24b:2 0.24f:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26a:2 0.26b:2 0.26d:2 0.276:2 0.279:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2f8:2 0.2fd:2 0.306:2 0.30e:2 0.313:2 0.315:2 0.31b:2 0.322:2 0.327:2 0.32f:2 0.330:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.386:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d4:2 0.3d8:2 0.3db:2 0.3dd:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:50.489890 I | rook-ceph-mon0: 2017-07-11 13:25:49.415298 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 141 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:25:50.489905 I | rook-ceph-mon0: 2017-07-11 13:25:49.415718 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 142 : cluster [INF] osdmap e26: 6 total, 5 up, 6 in
- 2017-07-11 13:25:50.802097 I | rook-ceph-mon0: 2017-07-11 13:25:50.802065 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e27: 6 total, 5 up, 6 in
- 2017-07-11 13:25:51.904371 I | rook-ceph-mon0: 2017-07-11 13:25:42.450433 osd.4 osd.4 10.233.124.4:6800/178 9 : cluster [WRN] 2 slow requests, 1 included below; oldest blocked for > 65.672029 secs
- 2017-07-11 13:25:51.904457 I | rook-ceph-mon0: 2017-07-11 13:25:42.450446 osd.4 osd.4 10.233.124.4:6800/178 10 : cluster [WRN] slow request 60.755602 seconds old, received at 2017-07-11 13:24:41.694773: osd_pg_create(e17 0.10:2 0.14:2 0.17:2 0.1d:2 0.24:2 0.29:2 0.2d:2 0.37:2 0.3d:2 0.40:2 0.42:2 0.45:2 0.46:2 0.48:2 0.4a:2 0.55:2 0.5a:2 0.5c:2 0.62:2 0.65:2 0.68:2 0.6c:2 0.6d:2 0.78:2 0.83:2 0.90:2 0.95:2 0.9c:2 0.9e:2 0.b0:2 0.b5:2 0.b7:2 0.b8:2 0.bc:2 0.bd:2 0.c0:2 0.c8:2 0.cb:2 0.ce:2 0.d1:2 0.e6:2 0.e7:2 0.f2:2 0.fe:2 0.100:2 0.101:2 0.10a:2 0.10f:2 0.114:2 0.116:2 0.128:2 0.12a:2 0.12e:2 0.12f:2 0.13e:2 0.142:2 0.149:2 0.14c:2 0.14f:2 0.15e:2 0.160:2 0.162:2 0.163:2 0.164:2 0.169:2 0.16b:2 0.17f:2 0.182:2 0.185:2 0.18f:2 0.19b:2 0.1a5:2 0.1bc:2 0.1c7:2 0.1d9:2 0.1db:2 0.1dc:2 0.1dd:2 0.1e4:2 0.1e8:2 0.1ee:2 0.1f6:2 0.1f7:2 0.204:2 0.208:2 0.210:2 0.217:2 0.21d:2 0.226:2 0.229:2 0.22b:2 0.230:2 0.235:2 0.237:2 0.23a:2 0.23b:2 0.23e:2 0.241:2 0.243:2 0.24d:2 0.254:2 0.25b:2 0.25e:2 0.261:2 0.265:2 0.26c:2 0.27b:2 0.27d:2 0.27f:2 0.283:2 0.284:2 0.288:2 0.2ae:2 0.2b0:2 0.2b1:2 0.2b4:2 0.2bb:2 0.2bf:2 0.2c0:2 0.2c3:2 0.2c5:2 0.2cd:2 0.2cf:2 0.2df:2 0.2e9:2 0.2ea:2 0.2f9:2 0.303:2 0.309:2 0.30a:2 0.30b:2 0.30d:2 0.312:2 0.325:2 0.32b:2 0.32c:2 0.32d:2 0.333:2 0.334:2 0.339:2 0.33a:2 0.33f:2 0.342:2 0.344:2 0.359:2 0.362:2 0.368:2 0.36c:2 0.379:2 0.37a:2 0.38f:2 0.395:2 0.3a2:2 0.3a8:2 0.3a9:2 0.3b1:2 0.3b4:2 0.3b5:2 0.3be:2 0.3c3:2 0.3c5:2 0.3d1:2 0.3d5:2 0.3da:2 0.3e0:2 0.3e9:2 0.3eb:2 0.3ed:2 0.3ef:2 0.3f6:2 0.3f7:2 0.3f9:2) currently wait for new map
- 2017-07-11 13:25:51.904501 I | rook-ceph-mon0: 2017-07-11 13:25:50.802127 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 143 : cluster [INF] osdmap e27: 6 total, 5 up, 6 in
- 2017-07-11 13:25:52.276265 I | rook-ceph-mon0: 2017-07-11 13:25:52.276230 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e28: 6 total, 5 up, 6 in
- 2017-07-11 13:25:53.287806 I | rook-ceph-mon0: 2017-07-11 13:25:52.276339 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 144 : cluster [INF] osdmap e28: 6 total, 5 up, 6 in
- 2017-07-11 13:25:53.484168 I | rook-ceph-mon0: 2017-07-11 13:25:53.484136 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e29: 6 total, 5 up, 6 in
- 2017-07-11 13:25:54.731693 I | rook-ceph-mon0: 2017-07-11 13:25:54.731658 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:25:54.732294 I | rook-ceph-mon0: 2017-07-11 13:25:54.732278 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e30: 6 total, 6 up, 6 in
- 2017-07-11 13:25:55.061750 I | rook-ceph-mon0: 2017-07-11 13:25:53.484257 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 145 : cluster [INF] osdmap e29: 6 total, 5 up, 6 in
- 2017-07-11 13:25:56.232443 I | rook-ceph-mon0: 2017-07-11 13:25:56.232387 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e31: 6 total, 6 up, 6 in
- 2017-07-11 13:25:56.593802 I | rook-ceph-mon0: 2017-07-11 13:25:54.731782 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 146 : cluster [INF] osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:25:56.593926 I | rook-ceph-mon0: 2017-07-11 13:25:54.732341 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 147 : cluster [INF] osdmap e30: 6 total, 6 up, 6 in
- 2017-07-11 13:25:57.505234 I | rook-ceph-mon0: 2017-07-11 13:25:57.505199 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e32: 6 total, 6 up, 6 in
- 2017-07-11 13:25:57.837021 I | rook-ceph-mon0: 2017-07-11 13:25:46.152882 osd.1 osd.1 10.233.76.4:6800/178 10 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 73.939919 secs
- 2017-07-11 13:25:57.837045 I | rook-ceph-mon0: 2017-07-11 13:25:46.152889 osd.1 osd.1 10.233.76.4:6800/178 11 : cluster [WRN] slow request 73.939919 seconds old, received at 2017-07-11 13:24:32.212896: osd_pg_create(e12 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:57.837050 I | rook-ceph-mon0: 2017-07-11 13:25:47.153164 osd.1 osd.1 10.233.76.4:6800/178 12 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 74.940232 secs
- 2017-07-11 13:25:57.837059 I | rook-ceph-mon0: 2017-07-11 13:25:47.153170 osd.1 osd.1 10.233.76.4:6800/178 13 : cluster [WRN] slow request 74.940232 seconds old, received at 2017-07-11 13:24:32.212896: osd_pg_create(e12 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:57.837064 I | rook-ceph-mon0: 2017-07-11 13:25:56.232388 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 148 : cluster [INF] osdmap e31: 6 total, 6 up, 6 in
- 2017-07-11 13:25:57.837067 I | rook-ceph-mon0: 2017-07-11 13:25:57.505311 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 149 : cluster [INF] osdmap e32: 6 total, 6 up, 6 in
- 2017-07-11 13:25:58.721884 I | rook-ceph-mon0: 2017-07-11 13:25:58.721848 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e33: 6 total, 6 up, 6 in
- 2017-07-11 13:25:59.119486 I | rook-ceph-mon0: 2017-07-11 13:25:58.721953 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 150 : cluster [INF] osdmap e33: 6 total, 6 up, 6 in
- 2017-07-11 13:26:00.125135 I | rook-ceph-mon0: 2017-07-11 13:26:00.125104 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e34: 6 total, 6 up, 6 in
- 2017-07-11 13:26:00.392867 I | rook-ceph-mon0: 2017-07-11 13:25:52.187081 osd.2 osd.2 10.233.69.0:6800/178 12 : cluster [WRN] map e18 wrongly marked me down at e18
- 2017-07-11 13:26:00.392950 I | rook-ceph-mon0: 2017-07-11 13:25:52.604404 osd.2 osd.2 10.233.69.0:6800/178 13 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 70.890580 secs
- 2017-07-11 13:26:00.392971 I | rook-ceph-mon0: 2017-07-11 13:25:52.604411 osd.2 osd.2 10.233.69.0:6800/178 14 : cluster [WRN] slow request 70.890580 seconds old, received at 2017-07-11 13:24:41.713752: osd_pg_create(e17 0.5:2 0.7:2 0.9:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.7a:2 0.7d:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.92:2 0.94:2 0.98:2 0.9a:2 0.9d:2 0.a5:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.ba:2 0.c2:2 0.c5:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.12c:2 0.141:2 0.14d:2 0.15c:2 0.161:2 0.166:2 0.16f:2 0.178:2 0.17a:2 0.180:2 0.189:2 0.18c:2 0.197:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1da:2 0.1e1:2 0.1e9:2 0.1f2:2 0.1f3:2 0.1ff:2 0.200:2 0.201:2 0.213:2 0.218:2 0.21a:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.248:2 0.24a:2 0.24b:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26b:2 0.26d:2 0.276:2 0.279:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b8:2 0.2b9:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d7:2 0.2da:2 0.2db:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32f:2 0.330:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2) currently wait for new map
- 2017-07-11 13:26:01.452429 I | rook-ceph-mon0: 2017-07-11 13:26:01.452351 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e35: 6 total, 6 up, 6 in
- 2017-07-11 13:26:01.642671 I | rook-ceph-mon0: 2017-07-11 13:26:00.125232 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 151 : cluster [INF] osdmap e34: 6 total, 6 up, 6 in
- 2017-07-11 13:26:02.568090 I | rook-ceph-mon0: 2017-07-11 13:26:02.568031 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e36: 6 total, 6 up, 6 in
- 2017-07-11 13:26:02.743558 I | rook-ceph-mon0: 2017-07-11 13:26:01.452352 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 152 : cluster [INF] osdmap e35: 6 total, 6 up, 6 in
- 2017-07-11 13:26:02.743642 I | rook-ceph-mon0: 2017-07-11 13:26:02.568175 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 153 : cluster [INF] osdmap e36: 6 total, 6 up, 6 in
- 2017-07-11 13:26:03.679140 I | rook-ceph-mon0: 2017-07-11 13:26:03.679087 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:26:03.679221 I | rook-ceph-mon0: 2017-07-11 13:26:03.679202 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1900486919' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:26:03.831968 I | rook-ceph-mon0: 2017-07-11 13:26:03.831912 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e37: 6 total, 6 up, 6 in
- 2017-07-11 13:26:04.966306 I | rook-ceph-mon0: 2017-07-11 13:26:04.966215 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e38: 6 total, 6 up, 6 in
- 2017-07-11 13:26:05.267098 I | rook-ceph-mon0: 2017-07-11 13:26:03.831913 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 155 : cluster [INF] osdmap e37: 6 total, 6 up, 6 in
- 2017-07-11 13:26:05.267389 I | rook-ceph-mon0: 2017-07-11 13:26:04.966217 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 156 : cluster [INF] osdmap e38: 6 total, 6 up, 6 in
- 2017-07-11 13:26:05.280833 I | rook-ceph-mon0: 2017-07-11 13:26:05.280667 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_WARN; 750 pgs peering; 4 requests are blocked > 32 sec; 1 osds have slow requests; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:26:06.295848 I | rook-ceph-mon0: 2017-07-11 13:26:06.295799 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e39: 6 total, 6 up, 6 in
- 2017-07-11 13:26:07.070250 I | rook-ceph-mon0: 2017-07-11 13:26:03.158303 osd.1 osd.1 10.233.76.4:6800/178 14 : cluster [WRN] 3 slow requests, 2 included below; oldest blocked for > 90.945374 secs
- 2017-07-11 13:26:07.070444 I | rook-ceph-mon0: 2017-07-11 13:26:03.158308 osd.1 osd.1 10.233.76.4:6800/178 15 : cluster [WRN] slow request 30.315376 seconds old, received at 2017-07-11 13:25:32.842895: pg_notify((query:13 sent:13 0.10a( empty local-lis/les=0/0 n=0 ec=2/2 lis/c 0/0 les/c/f 0/0/0 12/12/12))=([2,11] intervals=) epoch 13) currently wait for new map
- 2017-07-11 13:26:07.070488 I | rook-ceph-mon0: 2017-07-11 13:26:03.158311 osd.1 osd.1 10.233.76.4:6800/178 16 : cluster [WRN] slow request 30.095310 seconds old, received at 2017-07-11 13:25:33.062960: pg_notify((query:13 sent:13 0.187( empty local-lis/les=0/0 n=0 ec=2/2 lis/c 0/0 les/c/f 0/0/0 12/12/12))=([2,11] intervals=) epoch 15) currently wait for new map
- 2017-07-11 13:26:07.070514 I | rook-ceph-mon0: 2017-07-11 13:26:05.280675 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 157 : cluster [INF] HEALTH_WARN; 750 pgs peering; 4 requests are blocked > 32 sec; 1 osds have slow requests; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:26:07.583355 I | rook-ceph-mon0: 2017-07-11 13:26:07.583319 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e40: 6 total, 6 up, 6 in
- 2017-07-11 13:26:07.822306 I | rook-ceph-mon0: 2017-07-11 13:26:07.822225 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.0 10.233.72.0:6800/180
- 2017-07-11 13:26:08.279395 I | rook-ceph-mon0: 2017-07-11 13:26:06.296015 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 158 : cluster [INF] osdmap e39: 6 total, 6 up, 6 in
- 2017-07-11 13:26:08.279626 I | rook-ceph-mon0: 2017-07-11 13:26:07.583646 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 159 : cluster [INF] osdmap e40: 6 total, 6 up, 6 in
- 2017-07-11 13:26:08.815632 I | rook-ceph-mon0: 2017-07-11 13:26:08.812099 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e41: 6 total, 6 up, 6 in
- 2017-07-11 13:26:09.825790 I | rook-ceph-mon0: 2017-07-11 13:26:08.812100 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 161 : cluster [INF] osdmap e41: 6 total, 6 up, 6 in
- 2017-07-11 13:26:10.140157 I | rook-ceph-mon0: 2017-07-11 13:26:10.140125 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e42: 6 total, 6 up, 6 in
- 2017-07-11 13:26:11.231566 I | rook-ceph-mon0: 2017-07-11 13:26:10.140233 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 162 : cluster [INF] osdmap e42: 6 total, 6 up, 6 in
- 2017-07-11 13:26:11.581215 I | rook-ceph-mon0: 2017-07-11 13:26:11.581172 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e43: 6 total, 6 up, 6 in
- 2017-07-11 13:26:12.648531 I | rook-ceph-mon0: 2017-07-11 13:26:11.581302 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 163 : cluster [INF] osdmap e43: 6 total, 6 up, 6 in
- 2017-07-11 13:26:12.836278 I | rook-ceph-mon0: 2017-07-11 13:26:12.836247 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e44: 6 total, 6 up, 6 in
- 2017-07-11 13:26:14.053284 I | rook-ceph-mon0: 2017-07-11 13:26:12.836360 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 164 : cluster [INF] osdmap e44: 6 total, 6 up, 6 in
- 2017-07-11 13:26:14.259835 I | rook-ceph-mon0: 2017-07-11 13:26:14.259800 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e45: 6 total, 6 up, 6 in
- 2017-07-11 13:26:14.557066 I | rook-ceph-mon0: 2017-07-11 13:26:14.557026 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:26:14.557206 I | rook-ceph-mon0: 2017-07-11 13:26:14.557191 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1917552483' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:26:15.425901 I | rook-ceph-mon0: 2017-07-11 13:26:14.259921 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 165 : cluster [INF] osdmap e45: 6 total, 6 up, 6 in
- 2017-07-11 13:26:15.869543 I | rook-ceph-mon0: 2017-07-11 13:26:15.869502 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e46: 6 total, 6 up, 6 in
- 2017-07-11 13:26:15.987382 I | rook-ceph-mon0: 2017-07-11 13:26:15.987348 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:26:15.987767 I | rook-ceph-mon0: 2017-07-11 13:26:15.987751 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:26:16.939250 I | rook-ceph-mon0: 2017-07-11 13:26:07.159298 osd.1 osd.1 10.233.76.4:6800/178 17 : cluster [WRN] 9 slow requests, 5 included below; oldest blocked for > 94.465619 secs
- 2017-07-11 13:26:16.939451 I | rook-ceph-mon0: 2017-07-11 13:26:07.159317 osd.1 osd.1 10.233.76.4:6800/178 18 : cluster [WRN] slow request 94.465619 seconds old, received at 2017-07-11 13:24:32.693479: osd_pg_create(e13 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:16.939505 I | rook-ceph-mon0: 2017-07-11 13:26:07.159321 osd.1 osd.1 10.233.76.4:6800/178 19 : cluster [WRN] slow request 93.307052 seconds old, received at 2017-07-11 13:24:33.852047: osd_pg_create(e14 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.35:2 0.36:2 0.38:2 0.4d:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.76:2 0.80:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a9:2 0.b1:2 0.b2:2 0.b9:2 0.be:2 0.c9:2 0.ca:2 0.cf:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.209:2 0.215:2 0.21b:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.274:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2ed:2 0.2f7:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cd:2 0.3d3:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:16.939541 I | rook-ceph-mon0: 2017-07-11 13:26:07.159324 osd.1 osd.1 10.233.76.4:6800/178 20 : cluster [WRN] slow request 90.557336 seconds old, received at 2017-07-11 13:24:36.601763: osd_pg_create(e15 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.26:2 0.2a:2 0.35:2 0.36:2 0.38:2 0.41:2 0.4e:2 0.4f:2 0.50:2 0.52:2 0.60:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.c3:2 0.ca:2 0.cf:2 0.d2:2 0.db:2 0.df:2 0.e8:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.115:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.157:2 0.158:2 0.159:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.177:2 0.17d:2 0.18d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ab:2 0.1ae:2 0.1af:2 0.1b6:2 0.1bb:2 0.1bd:2 0.1bf:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.23d:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28e:2 0.291:2 0.294:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2a6:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2dd:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.363:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ac:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ea:2 0.3ec:2 0.3f5:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:16.939568 I | rook-ceph-mon0: 2017-07-11 13:26:07.159327 osd.1 osd.1 10.233.76.4:6800/178 21 : cluster [WRN] slow request 89.889977 seconds old, received at 2017-07-11 13:24:37.269122: osd_pg_create(e16 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:16.939588 I | rook-ceph-mon0: 2017-07-11 13:26:07.159329 osd.1 osd.1 10.233.76.4:6800/178 22 : cluster [WRN] slow request 85.594176 seconds old, received at 2017-07-11 13:24:41.564923: osd_pg_create(e17 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:16.939625 I | rook-ceph-mon0: 2017-07-11 13:26:08.159690 osd.1 osd.1 10.233.76.4:6800/178 23 : cluster [WRN] 9 slow requests, 5 included below; oldest blocked for > 95.466107 secs
- 2017-07-11 13:26:16.939642 I | rook-ceph-mon0: 2017-07-11 13:26:08.159695 osd.1 osd.1 10.233.76.4:6800/178 24 : cluster [WRN] slow request 95.466107 seconds old, received at 2017-07-11 13:24:32.693479: osd_pg_create(e13 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:16.939660 I | rook-ceph-mon0: 2017-07-11 13:26:08.159700 osd.1 osd.1 10.233.76.4:6800/178 25 : cluster [WRN] slow request 94.307540 seconds old, received at 2017-07-11 13:24:33.852047: osd_pg_create(e14 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.35:2 0.36:2 0.38:2 0.4d:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.76:2 0.80:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a9:2 0.b1:2 0.b2:2 0.b9:2 0.be:2 0.c9:2 0.ca:2 0.cf:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.209:2 0.215:2 0.21b:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.274:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2ed:2 0.2f7:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cd:2 0.3d3:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:16.939679 I | rook-ceph-mon0: 2017-07-11 13:26:08.159703 osd.1 osd.1 10.233.76.4:6800/178 26 : cluster [WRN] slow request 91.557823 seconds old, received at 2017-07-11 13:24:36.601763: osd_pg_create(e15 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.26:2 0.2a:2 0.35:2 0.36:2 0.38:2 0.41:2 0.4e:2 0.4f:2 0.50:2 0.52:2 0.60:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.c3:2 0.ca:2 0.cf:2 0.d2:2 0.db:2 0.df:2 0.e8:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.115:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.157:2 0.158:2 0.159:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.177:2 0.17d:2 0.18d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ab:2 0.1ae:2 0.1af:2 0.1b6:2 0.1bb:2 0.1bd:2 0.1bf:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.23d:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28e:2 0.291:2 0.294:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2a6:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2dd:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.363:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ac:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ea:2 0.3ec:2 0.3f5:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:16.939707 I | rook-ceph-mon0: 2017-07-11 13:26:08.159713 osd.1 osd.1 10.233.76.4:6800/178 27 : cluster [WRN] slow request 90.890464 seconds old, received at 2017-07-11 13:24:37.269122: osd_pg_create(e16 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:16.939734 I | rook-ceph-mon0: 2017-07-11 13:26:08.159722 osd.1 osd.1 10.233.76.4:6800/178 28 : cluster [WRN] slow request 86.594663 seconds old, received at 2017-07-11 13:24:41.564923: osd_pg_create(e17 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:16.939748 I | rook-ceph-mon0: 2017-07-11 13:26:12.160449 osd.1 osd.1 10.233.76.4:6800/178 29 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.466879 secs
- 2017-07-11 13:26:16.939761 I | rook-ceph-mon0: 2017-07-11 13:26:12.160455 osd.1 osd.1 10.233.76.4:6800/178 30 : cluster [WRN] slow request 30.466879 seconds old, received at 2017-07-11 13:25:41.693498: osd_pg_create(e20 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20) currently started
- 2017-07-11 13:26:16.939794 I | rook-ceph-mon0: 2017-07-11 13:26:14.161571 osd.1 osd.1 10.233.76.4:6800/178 31 : cluster [WRN] 2 slow requests, 1 included below; oldest blocked for > 32.468001 secs
- 2017-07-11 13:26:16.939809 I | rook-ceph-mon0: 2017-07-11 13:26:14.161591 osd.1 osd.1 10.233.76.4:6800/178 32 : cluster [WRN] slow request 30.543300 seconds old, received at 2017-07-11 13:25:43.618199: osd_pg_create(e22 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22) currently wait for new map
- 2017-07-11 13:26:16.939822 I | rook-ceph-mon0: 2017-07-11 13:26:15.161812 osd.1 osd.1 10.233.76.4:6800/178 33 : cluster [WRN] 3 slow requests, 1 included below; oldest blocked for > 33.468212 secs
- 2017-07-11 13:26:16.939840 I | rook-ceph-mon0: 2017-07-11 13:26:15.161819 osd.1 osd.1 10.233.76.4:6800/178 34 : cluster [WRN] slow request 30.327390 seconds old, received at 2017-07-11 13:25:44.834321: osd_pg_create(e23 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23) currently wait for new map
- 2017-07-11 13:26:16.939868 I | rook-ceph-mon0: 2017-07-11 13:26:15.869629 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 167 : cluster [INF] osdmap e46: 6 total, 6 up, 6 in
- 2017-07-11 13:26:17.194548 I | rook-ceph-mon0: 2017-07-11 13:26:17.194509 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e47: 6 total, 6 up, 6 in
- 2017-07-11 13:26:18.359468 I | rook-ceph-mon0: 2017-07-11 13:26:18.359386 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e48: 6 total, 6 up, 6 in
- 2017-07-11 13:26:18.596160 I | rook-ceph-mon0: 2017-07-11 13:26:17.194839 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 170 : cluster [INF] osdmap e47: 6 total, 6 up, 6 in
- 2017-07-11 13:26:18.622991 I | rook-ceph-mon0: 2017-07-11 13:26:18.622852 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.2 10.233.69.0:6800/178
- 2017-07-11 13:26:18.623084 I | rook-ceph-mon0: 2017-07-11 13:26:18.622920 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.2 10.233.69.0:6800/178
- 2017-07-11 13:26:20.094311 I | rook-ceph-mon0: 2017-07-11 13:26:18.359917 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 171 : cluster [INF] osdmap e48: 6 total, 6 up, 6 in
- 2017-07-11 13:26:20.095790 I | rook-ceph-mon0: 2017-07-11 13:26:20.095764 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e49: 6 total, 6 up, 6 in
- 2017-07-11 13:26:20.180026 I | rook-ceph-mon0: 2017-07-11 13:26:20.179951 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.3 10.233.86.0:6800/178
- 2017-07-11 13:26:21.344255 I | rook-ceph-mon0: 2017-07-11 13:26:20.095975 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 174 : cluster [INF] osdmap e49: 6 total, 6 up, 6 in
- 2017-07-11 13:26:21.595225 I | rook-ceph-mon0: 2017-07-11 13:26:21.595156 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e50: 6 total, 6 up, 6 in
- 2017-07-11 13:26:22.727573 I | rook-ceph-mon0: 2017-07-11 13:26:21.595157 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 176 : cluster [INF] osdmap e50: 6 total, 6 up, 6 in
- 2017-07-11 13:26:22.933073 I | rook-ceph-mon0: 2017-07-11 13:26:22.933041 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e51: 6 total, 6 up, 6 in
- 2017-07-11 13:26:23.538270 I | rook-ceph-mon0: 2017-07-11 13:26:23.538236 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.4 10.233.124.4:6800/178
- 2017-07-11 13:26:23.538695 I | rook-ceph-mon0: 2017-07-11 13:26:23.538680 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.4 10.233.124.4:6800/178
- 2017-07-11 13:26:24.164940 I | rook-ceph-mon0: 2017-07-11 13:26:22.933159 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 177 : cluster [INF] osdmap e51: 6 total, 6 up, 6 in
- 2017-07-11 13:26:24.607012 I | rook-ceph-mon0: 2017-07-11 13:26:24.606979 7f7c4754c700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.3 10.233.86.0:6800/178
- 2017-07-11 13:26:24.607450 I | rook-ceph-mon0: 2017-07-11 13:26:24.607431 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e52: 6 total, 6 up, 6 in
- 2017-07-11 13:26:24.984758 I | rook-ceph-mon0: 2017-07-11 13:26:24.984665 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e53: 6 total, 6 up, 6 in
- 2017-07-11 13:26:25.646142 I | rook-ceph-mon0: 2017-07-11 13:26:24.544978 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 17 : cluster [WRN] message from mon.0 was stamped 0.061434s in the future, clocks not synchronized
- 2017-07-11 13:26:25.646237 I | rook-ceph-mon0: 2017-07-11 13:26:24.607488 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 181 : cluster [INF] osdmap e52: 6 total, 6 up, 6 in
- 2017-07-11 13:26:25.646270 I | rook-ceph-mon0: 2017-07-11 13:26:24.984666 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 182 : cluster [INF] osdmap e53: 6 total, 6 up, 6 in
- 2017-07-11 13:26:26.252063 I | rook-ceph-mon0: 2017-07-11 13:26:26.249528 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e54: 6 total, 6 up, 6 in
- 2017-07-11 13:26:27.008365 I | rook-ceph-mon0: 2017-07-11 13:26:17.162225 osd.1 osd.1 10.233.76.4:6800/178 35 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 35.468642 secs
- 2017-07-11 13:26:27.008552 I | rook-ceph-mon0: 2017-07-11 13:26:17.162232 osd.1 osd.1 10.233.76.4:6800/178 36 : cluster [WRN] slow request 30.848726 seconds old, received at 2017-07-11 13:25:46.313414: osd_pg_create(e24 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24) currently wait for new map
- 2017-07-11 13:26:27.008580 I | rook-ceph-mon0: 2017-07-11 13:26:20.829370 osd.0 osd.0 10.233.72.0:6800/180 28 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.071046 secs
- 2017-07-11 13:26:27.008613 I | rook-ceph-mon0: 2017-07-11 13:26:20.829376 osd.0 osd.0 10.233.72.0:6800/180 29 : cluster [WRN] slow request 30.071046 seconds old, received at 2017-07-11 13:25:50.758281: osd_pg_create(e27 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27) currently started
- 2017-07-11 13:26:27.008633 I | rook-ceph-mon0: 2017-07-11 13:26:22.829661 osd.0 osd.0 10.233.72.0:6800/180 30 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.543594 secs
- 2017-07-11 13:26:27.008692 I | rook-ceph-mon0: 2017-07-11 13:26:22.829679 osd.0 osd.0 10.233.72.0:6800/180 31 : cluster [WRN] slow request 30.543594 seconds old, received at 2017-07-11 13:25:52.286024: osd_pg_create(e28 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28) currently started
- 2017-07-11 13:26:27.008710 I | rook-ceph-mon0: 2017-07-11 13:26:24.830147 osd.0 osd.0 10.233.72.0:6800/180 32 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.142821 secs
- 2017-07-11 13:26:27.008726 I | rook-ceph-mon0: 2017-07-11 13:26:24.830158 osd.0 osd.0 10.233.72.0:6800/180 33 : cluster [WRN] slow request 30.142821 seconds old, received at 2017-07-11 13:25:54.687199: osd_pg_create(e30 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30) currently started
- 2017-07-11 13:26:27.008740 I | rook-ceph-mon0: 2017-07-11 13:26:26.249529 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 183 : cluster [INF] osdmap e54: 6 total, 6 up, 6 in
- 2017-07-11 13:26:27.537031 I | rook-ceph-mon0: 2017-07-11 13:26:27.534841 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e55: 6 total, 6 up, 6 in
- 2017-07-11 13:26:28.690963 I | rook-ceph-mon0: 2017-07-11 13:26:27.534845 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 184 : cluster [INF] osdmap e55: 6 total, 6 up, 6 in
- 2017-07-11 13:26:28.974792 I | rook-ceph-mon0: 2017-07-11 13:26:28.974760 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e56: 6 total, 6 up, 6 in
- 2017-07-11 13:26:30.157491 I | rook-ceph-mon0: 2017-07-11 13:26:28.974868 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 185 : cluster [INF] osdmap e56: 6 total, 6 up, 6 in
- 2017-07-11 13:26:30.479592 I | rook-ceph-mon0: 2017-07-11 13:26:30.479526 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e57: 6 total, 6 up, 6 in
- 2017-07-11 13:26:31.969546 I | rook-ceph-mon0: 2017-07-11 13:26:30.479527 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 186 : cluster [INF] osdmap e57: 6 total, 6 up, 6 in
- 2017-07-11 13:26:31.970355 I | rook-ceph-mon0: 2017-07-11 13:26:31.970336 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e58: 6 total, 6 up, 6 in
- 2017-07-11 13:26:33.077853 I | rook-ceph-mon0: 2017-07-11 13:26:31.970396 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 187 : cluster [INF] osdmap e58: 6 total, 6 up, 6 in
- 2017-07-11 13:26:33.376898 I | rook-ceph-mon0: 2017-07-11 13:26:33.376717 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e59: 6 total, 6 up, 6 in
- 2017-07-11 13:26:33.756338 I | rook-ceph-mon0: 2017-07-11 13:26:33.756252 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:26:34.449589 I | rook-ceph-mon0: 2017-07-11 13:26:33.376719 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 188 : cluster [INF] osdmap e59: 6 total, 6 up, 6 in
- 2017-07-11 13:26:34.782526 I | rook-ceph-mon0: 2017-07-11 13:26:34.780389 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e60: 6 total, 6 up, 6 in
- 2017-07-11 13:26:35.875611 I | rook-ceph-mon0: 2017-07-11 13:26:34.780390 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 190 : cluster [INF] osdmap e60: 6 total, 6 up, 6 in
- 2017-07-11 13:26:36.093673 I | rook-ceph-mon0: 2017-07-11 13:26:36.091119 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e61: 6 total, 6 up, 6 in
- 2017-07-11 13:26:36.298915 I | rook-ceph-mon0: 2017-07-11 13:26:36.298878 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:26:36.299127 I | rook-ceph-mon0: 2017-07-11 13:26:36.299025 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/69120278' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:26:37.247423 I | rook-ceph-mon0: 2017-07-11 13:26:26.830562 osd.0 osd.0 10.233.72.0:6800/180 34 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.597081 secs
- 2017-07-11 13:26:37.247603 I | rook-ceph-mon0: 2017-07-11 13:26:26.830569 osd.0 osd.0 10.233.72.0:6800/180 35 : cluster [WRN] slow request 30.597081 seconds old, received at 2017-07-11 13:25:56.233433: osd_pg_create(e31 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31) currently started
- 2017-07-11 13:26:37.247676 I | rook-ceph-mon0: 2017-07-11 13:26:27.830893 osd.0 osd.0 10.233.72.0:6800/180 36 : cluster [WRN] 2 slow requests, 1 included below; oldest blocked for > 31.597350 secs
- 2017-07-11 13:26:37.247695 I | rook-ceph-mon0: 2017-07-11 13:26:27.830902 osd.0 osd.0 10.233.72.0:6800/180 37 : cluster [WRN] slow request 30.309489 seconds old, received at 2017-07-11 13:25:57.521293: osd_pg_create(e32 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32) currently wait for new map
- 2017-07-11 13:26:37.247715 I | rook-ceph-mon0: 2017-07-11 13:26:28.831009 osd.0 osd.0 10.233.72.0:6800/180 38 : cluster [WRN] 3 slow requests, 1 included below; oldest blocked for > 32.597519 secs
- 2017-07-11 13:26:37.247821 I | rook-ceph-mon0: 2017-07-11 13:26:28.831014 osd.0 osd.0 10.233.72.0:6800/180 39 : cluster [WRN] slow request 30.100007 seconds old, received at 2017-07-11 13:25:58.730944: osd_pg_create(e33 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33) currently wait for new map
- 2017-07-11 13:26:37.247839 I | rook-ceph-mon0: 2017-07-11 13:26:30.831460 osd.0 osd.0 10.233.72.0:6800/180 40 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 34.597969 secs
- 2017-07-11 13:26:37.247856 I | rook-ceph-mon0: 2017-07-11 13:26:30.831466 osd.0 osd.0 10.233.72.0:6800/180 41 : cluster [WRN] slow request 30.753834 seconds old, received at 2017-07-11 13:26:00.077568: osd_pg_create(e34 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:37.247870 I | rook-ceph-mon0: 2017-07-11 13:26:31.831824 osd.0 osd.0 10.233.72.0:6800/180 42 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 34.310429 secs
- 2017-07-11 13:26:37.247933 I | rook-ceph-mon0: 2017-07-11 13:26:31.831833 osd.0 osd.0 10.233.72.0:6800/180 43 : cluster [WRN] slow request 30.375894 seconds old, received at 2017-07-11 13:26:01.455829: osd_pg_create(e35 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:37.247951 I | rook-ceph-mon0: 2017-07-11 13:26:32.832209 osd.0 osd.0 10.233.72.0:6800/180 44 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 34.101149 secs
- 2017-07-11 13:26:37.247979 I | rook-ceph-mon0: 2017-07-11 13:26:32.832221 osd.0 osd.0 10.233.72.0:6800/180 45 : cluster [WRN] slow request 30.254009 seconds old, received at 2017-07-11 13:26:02.578084: osd_pg_create(e36 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:37.248002 I | rook-ceph-mon0: 2017-07-11 13:26:33.832455 osd.0 osd.0 10.233.72.0:6800/180 46 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 33.754838 secs
- 2017-07-11 13:26:37.248016 I | rook-ceph-mon0: 2017-07-11 13:26:33.832460 osd.0 osd.0 10.233.72.0:6800/180 47 : cluster [WRN] slow request 30.052972 seconds old, received at 2017-07-11 13:26:03.779434: osd_pg_create(e37 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:37.248029 I | rook-ceph-mon0: 2017-07-11 13:26:36.091120 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 191 : cluster [INF] osdmap e61: 6 total, 6 up, 6 in
- 2017-07-11 13:26:37.593962 I | rook-ceph-mon0: 2017-07-11 13:26:37.593636 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e62: 6 total, 6 up, 6 in
- 2017-07-11 13:26:38.748291 I | rook-ceph-mon0: 2017-07-11 13:26:38.748126 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e63: 6 total, 6 up, 6 in
- 2017-07-11 13:26:38.913167 I | rook-ceph-mon0: 2017-07-11 13:26:37.593638 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 193 : cluster [INF] osdmap e62: 6 total, 6 up, 6 in
- 2017-07-11 13:26:39.827659 I | rook-ceph-mon0: 2017-07-11 13:26:39.827592 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e64: 6 total, 6 up, 6 in
- 2017-07-11 13:26:40.047846 I | rook-ceph-mon0: 2017-07-11 13:26:38.748128 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 194 : cluster [INF] osdmap e63: 6 total, 6 up, 6 in
- 2017-07-11 13:26:40.047952 I | rook-ceph-mon0: 2017-07-11 13:26:39.827594 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 195 : cluster [INF] osdmap e64: 6 total, 6 up, 6 in
- 2017-07-11 13:26:40.946192 I | rook-ceph-mon0: 2017-07-11 13:26:40.946119 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e65: 6 total, 6 up, 6 in
- 2017-07-11 13:26:42.016223 I | rook-ceph-mon0: 2017-07-11 13:26:40.946120 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 196 : cluster [INF] osdmap e65: 6 total, 6 up, 6 in
- 2017-07-11 13:26:42.222661 I | rook-ceph-mon0: 2017-07-11 13:26:42.221961 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e66: 6 total, 6 up, 6 in
- 2017-07-11 13:26:42.843327 I | rook-ceph-mon0: 2017-07-11 13:26:42.843246 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.0 10.233.72.0:6800/180
- 2017-07-11 13:26:43.311803 I | rook-ceph-mon0: 2017-07-11 13:26:42.221963 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 197 : cluster [INF] osdmap e66: 6 total, 6 up, 6 in
- 2017-07-11 13:26:43.554396 I | rook-ceph-mon0: 2017-07-11 13:26:43.554322 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e67: 6 total, 6 up, 6 in
- 2017-07-11 13:26:44.561513 I | rook-ceph-mon0: 2017-07-11 13:26:44.559613 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e68: 6 total, 6 up, 6 in
- 2017-07-11 13:26:44.734401 I | rook-ceph-mon0: 2017-07-11 13:26:43.554323 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 199 : cluster [INF] osdmap e67: 6 total, 6 up, 6 in
- 2017-07-11 13:26:45.360498 I | rook-ceph-mon0: 2017-07-11 13:26:45.360233 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4808 MB, avail 94379 MB
- 2017-07-11 13:26:45.527971 I | rook-ceph-mon0: 2017-07-11 13:26:45.527753 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.4 10.233.124.4:6800/178
- 2017-07-11 13:26:45.714694 I | rook-ceph-mon0: 2017-07-11 13:26:45.713967 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e69: 6 total, 6 up, 6 in
- 2017-07-11 13:26:45.807318 I | rook-ceph-mon0: 2017-07-11 13:26:45.805586 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.0 failed (root=default,host=master-1) (4 reporters from different host after 26.267545 >= grace 23.937452)
- 2017-07-11 13:26:45.807590 I | rook-ceph-mon0: 2017-07-11 13:26:45.805619 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.3 failed (root=default,host=master-2) (4 reporters from different host after 26.267504 >= grace 23.712746)
- 2017-07-11 13:26:45.913919 I | rook-ceph-mon0: 2017-07-11 13:26:44.559618 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 200 : cluster [INF] osdmap e68: 6 total, 6 up, 6 in
- 2017-07-11 13:26:45.914254 I | rook-ceph-mon0: 2017-07-11 13:26:45.713969 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 202 : cluster [INF] osdmap e69: 6 total, 6 up, 6 in
- 2017-07-11 13:26:46.134660 I | rook-ceph-mon0: 2017-07-11 13:26:46.134528 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e70: 6 total, 4 up, 6 in
- 2017-07-11 13:26:47.143854 I | rook-ceph-mon0: 2017-07-11 13:26:38.835307 osd.0 osd.0 10.233.72.0:6800/180 48 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.076084 secs
- 2017-07-11 13:26:47.144193 I | rook-ceph-mon0: 2017-07-11 13:26:38.835318 osd.0 osd.0 10.233.72.0:6800/180 49 : cluster [WRN] slow request 30.076084 seconds old, received at 2017-07-11 13:26:08.759104: osd_pg_create(e41 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:47.144335 I | rook-ceph-mon0: 2017-07-11 13:26:43.166749 osd.1 osd.1 10.233.76.4:6800/178 37 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 55.346405 secs
- 2017-07-11 13:26:47.144423 I | rook-ceph-mon0: 2017-07-11 13:26:43.166758 osd.1 osd.1 10.233.76.4:6800/178 38 : cluster [WRN] slow request 55.346405 seconds old, received at 2017-07-11 13:25:47.820229: osd_pg_create(e25 0.3:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25) currently started
- 2017-07-11 13:26:47.144448 I | rook-ceph-mon0: 2017-07-11 13:26:45.805588 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 203 : cluster [INF] osd.0 failed (root=default,host=master-1) (4 reporters from different host after 26.267545 >= grace 23.937452)
- 2017-07-11 13:26:47.144463 I | rook-ceph-mon0: 2017-07-11 13:26:45.805620 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 204 : cluster [INF] osd.3 failed (root=default,host=master-2) (4 reporters from different host after 26.267504 >= grace 23.712746)
- 2017-07-11 13:26:47.144518 I | rook-ceph-mon0: 2017-07-11 13:26:46.134972 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 205 : cluster [INF] osdmap e70: 6 total, 4 up, 6 in
- 2017-07-11 13:26:47.543835 I | rook-ceph-mon0: 2017-07-11 13:26:47.543801 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:26:47.544272 I | rook-ceph-mon0: 2017-07-11 13:26:47.544255 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e71: 6 total, 5 up, 6 in
- 2017-07-11 13:26:48.627604 I | rook-ceph-mon0: 2017-07-11 13:26:46.043420 osd.3 osd.3 10.233.86.0:6800/178 14 : cluster [WRN] map e70 wrongly marked me down at e70
- 2017-07-11 13:26:48.628059 I | rook-ceph-mon0: 2017-07-11 13:26:47.543925 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 206 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:26:48.628097 I | rook-ceph-mon0: 2017-07-11 13:26:47.544312 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 207 : cluster [INF] osdmap e71: 6 total, 5 up, 6 in
- 2017-07-11 13:26:48.832937 I | rook-ceph-mon0: 2017-07-11 13:26:48.832903 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:26:48.833347 I | rook-ceph-mon0: 2017-07-11 13:26:48.833330 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e72: 6 total, 6 up, 6 in
- 2017-07-11 13:26:49.936983 I | rook-ceph-mon0: 2017-07-11 13:26:48.833016 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 208 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:26:49.937285 I | rook-ceph-mon0: 2017-07-11 13:26:48.833386 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 209 : cluster [INF] osdmap e72: 6 total, 6 up, 6 in
- 2017-07-11 13:26:50.173013 I | rook-ceph-mon0: 2017-07-11 13:26:50.172986 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e73: 6 total, 6 up, 6 in
- 2017-07-11 13:26:51.322266 I | rook-ceph-mon0: 2017-07-11 13:26:50.173078 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 210 : cluster [INF] osdmap e73: 6 total, 6 up, 6 in
- 2017-07-11 13:26:51.878691 I | rook-ceph-mon0: 2017-07-11 13:26:51.878650 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e74: 6 total, 6 up, 6 in
- 2017-07-11 13:26:52.980971 I | rook-ceph-mon0: 2017-07-11 13:26:51.878798 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 211 : cluster [INF] osdmap e74: 6 total, 6 up, 6 in
- 2017-07-11 13:26:53.234117 I | rook-ceph-mon0: 2017-07-11 13:26:53.234084 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e75: 6 total, 6 up, 6 in
- 2017-07-11 13:26:54.323118 I | rook-ceph-mon0: 2017-07-11 13:26:54.323050 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e76: 6 total, 6 up, 6 in
- 2017-07-11 13:26:54.495920 I | rook-ceph-mon0: 2017-07-11 13:26:53.234203 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 212 : cluster [INF] osdmap e75: 6 total, 6 up, 6 in
- 2017-07-11 13:26:55.490367 I | rook-ceph-mon0: 2017-07-11 13:26:55.490332 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e77: 6 total, 6 up, 6 in
- 2017-07-11 13:26:55.646327 I | rook-ceph-mon0: 2017-07-11 13:26:54.323052 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 213 : cluster [INF] osdmap e76: 6 total, 6 up, 6 in
- 2017-07-11 13:26:55.646538 I | rook-ceph-mon0: 2017-07-11 13:26:55.490453 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 214 : cluster [INF] osdmap e77: 6 total, 6 up, 6 in
- 2017-07-11 13:26:57.058107 I | rook-ceph-mon0: 2017-07-11 13:26:46.164978 osd.0 osd.0 10.233.72.0:6800/180 50 : cluster [WRN] map e70 wrongly marked me down at e70
- 2017-07-11 13:26:57.058214 I | rook-ceph-mon0: 2017-07-11 13:26:48.170150 osd.1 osd.1 10.233.76.4:6800/178 39 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.349894 secs
- 2017-07-11 13:26:57.058274 I | rook-ceph-mon0: 2017-07-11 13:26:48.170157 osd.1 osd.1 10.233.76.4:6800/178 40 : cluster [WRN] slow request 60.349894 seconds old, received at 2017-07-11 13:25:47.820229: osd_pg_create(e25 0.3:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25) currently started
- 2017-07-11 13:26:57.058297 I | rook-ceph-mon0: 2017-07-11 13:26:51.170943 osd.1 osd.1 10.233.76.4:6800/178 41 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 63.350666 secs
- 2017-07-11 13:26:57.058314 I | rook-ceph-mon0: 2017-07-11 13:26:51.170947 osd.1 osd.1 10.233.76.4:6800/178 42 : cluster [WRN] slow request 30.189307 seconds old, received at 2017-07-11 13:26:20.981588: pg_notify((query:21 sent:36 0.4a4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.058332 I | rook-ceph-mon0: 2017-07-11 13:26:51.170951 osd.1 osd.1 10.233.76.4:6800/178 43 : cluster [WRN] slow request 30.189245 seconds old, received at 2017-07-11 13:26:20.981650: pg_notify((query:21 sent:36 0.4a6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.058355 I | rook-ceph-mon0: 2017-07-11 13:26:51.170954 osd.1 osd.1 10.233.76.4:6800/178 44 : cluster [WRN] slow request 30.189811 seconds old, received at 2017-07-11 13:26:20.981085: pg_notify((query:21 sent:36 0.427( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.058368 I | rook-ceph-mon0: 2017-07-11 13:26:51.170956 osd.1 osd.1 10.233.76.4:6800/178 45 : cluster [WRN] slow request 30.189572 seconds old, received at 2017-07-11 13:26:20.981323: pg_notify((query:21 sent:36 0.434( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.058381 I | rook-ceph-mon0: 2017-07-11 13:26:51.170958 osd.1 osd.1 10.233.76.4:6800/178 46 : cluster [WRN] slow request 30.189524 seconds old, received at 2017-07-11 13:26:20.981372: pg_notify((query:21 sent:36 0.437( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.058397 I | rook-ceph-mon0: 2017-07-11 13:26:52.171148 osd.1 osd.1 10.233.76.4:6800/178 47 : cluster [WRN] 8 slow requests, 2 included below; oldest blocked for > 64.350875 secs
- 2017-07-11 13:26:57.058423 I | rook-ceph-mon0: 2017-07-11 13:26:52.171151 osd.1 osd.1 10.233.76.4:6800/178 48 : cluster [WRN] slow request 31.189582 seconds old, received at 2017-07-11 13:26:20.981522: pg_notify((query:21 sent:36 0.46a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.058438 I | rook-ceph-mon0: 2017-07-11 13:26:52.171154 osd.1 osd.1 10.233.76.4:6800/178 49 : cluster [WRN] slow request 31.189544 seconds old, received at 2017-07-11 13:26:20.981560: pg_notify((query:21 sent:36 0.474( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.058450 I | rook-ceph-mon0: 2017-07-11 13:26:55.179725 osd.1 osd.1 10.233.76.4:6800/178 50 : cluster [WRN] 9 slow requests, 1 included below; oldest blocked for > 67.359467 secs
- 2017-07-11 13:26:57.058463 I | rook-ceph-mon0: 2017-07-11 13:26:55.179746 osd.1 osd.1 10.233.76.4:6800/178 51 : cluster [WRN] slow request 30.092543 seconds old, received at 2017-07-11 13:26:25.087153: pg_notify((query:25 sent:53 0.4b2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:00.632446 I | rook-ceph-mon0: 2017-07-11 13:27:00.630734 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e78: 6 total, 6 up, 6 in
- 2017-07-11 13:27:01.891614 I | rook-ceph-mon0: 2017-07-11 13:27:00.630736 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 215 : cluster [INF] osdmap e78: 6 total, 6 up, 6 in
- 2017-07-11 13:27:02.106213 I | rook-ceph-mon0: 2017-07-11 13:27:02.106169 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e79: 6 total, 6 up, 6 in
- 2017-07-11 13:27:03.458882 I | rook-ceph-mon0: 2017-07-11 13:27:02.106320 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 216 : cluster [INF] osdmap e79: 6 total, 6 up, 6 in
- 2017-07-11 13:27:04.828499 I | rook-ceph-mon0: 2017-07-11 13:27:04.826721 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e80: 6 total, 6 up, 6 in
- 2017-07-11 13:27:05.281109 I | rook-ceph-mon0: 2017-07-11 13:27:05.281018 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_WARN; 275 pgs peering; 39 requests are blocked > 32 sec; 1 osds have slow requests; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:27:05.977739 I | rook-ceph-mon0: 2017-07-11 13:27:04.826723 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 217 : cluster [INF] osdmap e80: 6 total, 6 up, 6 in
- 2017-07-11 13:27:05.977997 I | rook-ceph-mon0: 2017-07-11 13:27:05.281025 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 218 : cluster [INF] HEALTH_WARN; 275 pgs peering; 39 requests are blocked > 32 sec; 1 osds have slow requests; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:27:06.200472 I | rook-ceph-mon0: 2017-07-11 13:27:06.198787 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e81: 6 total, 6 up, 6 in
- 2017-07-11 13:27:07.159249 I | rook-ceph-mon0: 2017-07-11 13:26:57.180313 osd.1 osd.1 10.233.76.4:6800/178 52 : cluster [WRN] 11 slow requests, 2 included below; oldest blocked for > 69.360050 secs
- 2017-07-11 13:27:07.159392 I | rook-ceph-mon0: 2017-07-11 13:26:57.180319 osd.1 osd.1 10.233.76.4:6800/178 53 : cluster [WRN] slow request 30.599795 seconds old, received at 2017-07-11 13:26:26.580485: pg_notify((query:25 sent:53 0.4d9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:07.159414 I | rook-ceph-mon0: 2017-07-11 13:26:57.180322 osd.1 osd.1 10.233.76.4:6800/178 54 : cluster [WRN] slow request 30.045284 seconds old, received at 2017-07-11 13:26:27.134996: pg_notify((query:25 sent:54 0.4dd( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 54) currently wait for new map
- 2017-07-11 13:27:07.159442 I | rook-ceph-mon0: 2017-07-11 13:26:58.180539 osd.1 osd.1 10.233.76.4:6800/178 55 : cluster [WRN] 13 slow requests, 2 included below; oldest blocked for > 70.360263 secs
- 2017-07-11 13:27:07.159458 I | rook-ceph-mon0: 2017-07-11 13:26:58.180543 osd.1 osd.1 10.233.76.4:6800/178 56 : cluster [WRN] slow request 30.704741 seconds old, received at 2017-07-11 13:26:27.475751: pg_notify((query:25 sent:53 0.4e3( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:07.159476 I | rook-ceph-mon0: 2017-07-11 13:26:58.180545 osd.1 osd.1 10.233.76.4:6800/178 57 : cluster [WRN] slow request 30.305323 seconds old, received at 2017-07-11 13:26:27.875170: pg_notify((query:25 sent:55 0.4e6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:07.159488 I | rook-ceph-mon0: 2017-07-11 13:26:59.186774 osd.1 osd.1 10.233.76.4:6800/178 58 : cluster [WRN] 14 slow requests, 1 included below; oldest blocked for > 71.366516 secs
- 2017-07-11 13:27:07.159501 I | rook-ceph-mon0: 2017-07-11 13:26:59.186778 osd.1 osd.1 10.233.76.4:6800/178 59 : cluster [WRN] slow request 30.888978 seconds old, received at 2017-07-11 13:26:28.297767: pg_notify((query:25 sent:55 0.4ec( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:07.159528 I | rook-ceph-mon0: 2017-07-11 13:27:00.187024 osd.1 osd.1 10.233.76.4:6800/178 60 : cluster [WRN] 23 slow requests, 5 included below; oldest blocked for > 72.366735 secs
- 2017-07-11 13:27:07.159542 I | rook-ceph-mon0: 2017-07-11 13:27:00.187028 osd.1 osd.1 10.233.76.4:6800/178 61 : cluster [WRN] slow request 30.168011 seconds old, received at 2017-07-11 13:26:30.018953: pg_notify((query:21 sent:42 0.486( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.159555 I | rook-ceph-mon0: 2017-07-11 13:27:00.187045 osd.1 osd.1 10.233.76.4:6800/178 62 : cluster [WRN] slow request 30.167945 seconds old, received at 2017-07-11 13:26:30.019019: pg_notify((query:21 sent:42 0.49d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.159570 I | rook-ceph-mon0: 2017-07-11 13:27:00.187053 osd.1 osd.1 10.233.76.4:6800/178 63 : cluster [WRN] slow request 30.167925 seconds old, received at 2017-07-11 13:26:30.019039: pg_notify((query:21 sent:42 0.4a5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.159582 I | rook-ceph-mon0: 2017-07-11 13:27:00.187055 osd.1 osd.1 10.233.76.4:6800/178 64 : cluster [WRN] slow request 30.874083 seconds old, received at 2017-07-11 13:26:29.312882: pg_notify((query:25 sent:56 0.4f7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.159616 I | rook-ceph-mon0: 2017-07-11 13:27:00.187057 osd.1 osd.1 10.233.76.4:6800/178 65 : cluster [WRN] slow request 30.485377 seconds old, received at 2017-07-11 13:26:29.701587: pg_notify((query:25 sent:56 0.4fb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.159628 I | rook-ceph-mon0: 2017-07-11 13:27:01.187328 osd.1 osd.1 10.233.76.4:6800/178 66 : cluster [WRN] 25 slow requests, 5 included below; oldest blocked for > 40.206130 secs
- 2017-07-11 13:27:07.159647 I | rook-ceph-mon0: 2017-07-11 13:27:01.187340 osd.1 osd.1 10.233.76.4:6800/178 67 : cluster [WRN] slow request 71.768138 seconds old, received at 2017-07-11 13:25:49.419076: osd_pg_create(e26 0.3:2 0.35:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26) currently started
- 2017-07-11 13:27:07.159730 I | rook-ceph-mon0: 2017-07-11 13:27:01.187362 osd.1 osd.1 10.233.76.4:6800/178 68 : cluster [WRN] slow request 31.168161 seconds old, received at 2017-07-11 13:26:30.019054: pg_notify((query:25 sent:42 0.4b0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.159746 I | rook-ceph-mon0: 2017-07-11 13:27:01.187364 osd.1 osd.1 10.233.76.4:6800/178 69 : cluster [WRN] slow request 30.388593 seconds old, received at 2017-07-11 13:26:30.798622: pg_notify((query:25 sent:57 0.503( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 57) currently wait for new map
- 2017-07-11 13:27:07.159772 I | rook-ceph-mon0: 2017-07-11 13:27:01.187366 osd.1 osd.1 10.233.76.4:6800/178 70 : cluster [WRN] slow request 30.412681 seconds old, received at 2017-07-11 13:26:30.774533: pg_notify((query:25 sent:56 0.502( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.159785 I | rook-ceph-mon0: 2017-07-11 13:27:01.187368 osd.1 osd.1 10.233.76.4:6800/178 71 : cluster [WRN] slow request 31.168146 seconds old, received at 2017-07-11 13:26:30.019069: pg_notify((query:25 sent:42 0.4bb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.159797 I | rook-ceph-mon0: 2017-07-11 13:27:02.187617 osd.1 osd.1 10.233.76.4:6800/178 72 : cluster [WRN] 26 slow requests, 4 included below; oldest blocked for > 41.206484 secs
- 2017-07-11 13:27:07.159817 I | rook-ceph-mon0: 2017-07-11 13:27:02.187642 osd.1 osd.1 10.233.76.4:6800/178 73 : cluster [WRN] slow request 72.768492 seconds old, received at 2017-07-11 13:25:49.419076: osd_pg_create(e26 0.3:2 0.35:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26) currently started
- 2017-07-11 13:27:07.159832 I | rook-ceph-mon0: 2017-07-11 13:27:02.187646 osd.1 osd.1 10.233.76.4:6800/178 74 : cluster [WRN] slow request 30.529653 seconds old, received at 2017-07-11 13:26:31.657915: pg_notify((query:25 sent:56 0.509( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.159860 I | rook-ceph-mon0: 2017-07-11 13:27:02.187648 osd.1 osd.1 10.233.76.4:6800/178 75 : cluster [WRN] slow request 32.168482 seconds old, received at 2017-07-11 13:26:30.019086: pg_notify((query:25 sent:42 0.4e0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.159872 I | rook-ceph-mon0: 2017-07-11 13:27:02.187650 osd.1 osd.1 10.233.76.4:6800/178 76 : cluster [WRN] slow request 32.168466 seconds old, received at 2017-07-11 13:26:30.019102: pg_notify((query:25 sent:42 0.4f5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.159884 I | rook-ceph-mon0: 2017-07-11 13:27:03.187912 osd.1 osd.1 10.233.76.4:6800/178 77 : cluster [WRN] 28 slow requests, 2 included below; oldest blocked for > 42.206789 secs
- 2017-07-11 13:27:07.159899 I | rook-ceph-mon0: 2017-07-11 13:27:03.187916 osd.1 osd.1 10.233.76.4:6800/178 78 : cluster [WRN] slow request 30.530131 seconds old, received at 2017-07-11 13:26:32.657742: pg_notify((query:25 sent:58 0.514( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 58) currently wait for new map
- 2017-07-11 13:27:07.160270 I | rook-ceph-mon0: 2017-07-11 13:27:03.187933 osd.1 osd.1 10.233.76.4:6800/178 79 : cluster [WRN] slow request 30.689602 seconds old, received at 2017-07-11 13:26:32.498272: pg_notify((query:25 sent:56 0.513( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.160307 I | rook-ceph-mon0: 2017-07-11 13:27:04.188110 osd.1 osd.1 10.233.76.4:6800/178 80 : cluster [WRN] 30 slow requests, 2 included below; oldest blocked for > 43.206991 secs
- 2017-07-11 13:27:07.160319 I | rook-ceph-mon0: 2017-07-11 13:27:04.188114 osd.1 osd.1 10.233.76.4:6800/178 81 : cluster [WRN] slow request 30.485611 seconds old, received at 2017-07-11 13:26:33.702464: pg_notify((query:25 sent:56 0.51c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.160332 I | rook-ceph-mon0: 2017-07-11 13:27:04.188118 osd.1 osd.1 10.233.76.4:6800/178 82 : cluster [WRN] slow request 30.210146 seconds old, received at 2017-07-11 13:26:33.977929: pg_notify((query:25 sent:56 0.51e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.160359 I | rook-ceph-mon0: 2017-07-11 13:27:05.189246 osd.1 osd.1 10.233.76.4:6800/178 83 : cluster [WRN] 46 slow requests, 5 included below; oldest blocked for > 44.207349 secs
- 2017-07-11 13:27:07.160379 I | rook-ceph-mon0: 2017-07-11 13:27:05.189258 osd.1 osd.1 10.233.76.4:6800/178 84 : cluster [WRN] slow request 74.382946 seconds old, received at 2017-07-11 13:25:50.805488: osd_pg_create(e27 0.3:2 0.35:2 0.4f:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27) currently wait for new map
- 2017-07-11 13:27:07.160403 I | rook-ceph-mon0: 2017-07-11 13:27:05.189274 osd.1 osd.1 10.233.76.4:6800/178 85 : cluster [WRN] slow request 72.908815 seconds old, received at 2017-07-11 13:25:52.279618: osd_pg_create(e28 0.3:2 0.35:2 0.4f:2 0.a0:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:07.160438 I | rook-ceph-mon0: 2017-07-11 13:27:05.189279 osd.1 osd.1 10.233.76.4:6800/178 86 : cluster [WRN] slow request 71.700793 seconds old, received at 2017-07-11 13:25:53.487640: osd_pg_create(e29 0.3:2 0.35:2 0.4f:2 0.a0:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:07.160461 I | rook-ceph-mon0: 2017-07-11 13:27:05.189283 osd.1 osd.1 10.233.76.4:6800/178 87 : cluster [WRN] slow request 70.447050 seconds old, received at 2017-07-11 13:25:54.741384: osd_pg_create(e30 0.3:2 0.35:2 0.4f:2 0.a0:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30) currently wait for new map
- 2017-07-11 13:27:07.160492 I | rook-ceph-mon0: 2017-07-11 13:27:05.189303 osd.1 osd.1 10.233.76.4:6800/178 88 : cluster [WRN] slow request 68.952185 seconds old, received at 2017-07-11 13:25:56.236248: osd_pg_create(e31 0.3:2 0.35:2 0.4f:2 0.a0:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31) currently wait for new map
- 2017-07-11 13:27:07.160573 I | rook-ceph-mon0: 2017-07-11 13:27:06.198791 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 219 : cluster [INF] osdmap e81: 6 total, 6 up, 6 in
- 2017-07-11 13:27:07.395842 I | rook-ceph-mon0: 2017-07-11 13:27:07.395745 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e82: 6 total, 6 up, 6 in
- 2017-07-11 13:27:08.582488 I | rook-ceph-mon0: 2017-07-11 13:27:08.580587 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e83: 6 total, 6 up, 6 in
- 2017-07-11 13:27:08.771617 I | rook-ceph-mon0: 2017-07-11 13:27:07.395746 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 220 : cluster [INF] osdmap e82: 6 total, 6 up, 6 in
- 2017-07-11 13:27:08.895977 I | rook-ceph-mon0: 2017-07-11 13:27:08.895918 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:27:08.974700 I | rook-ceph-mon0: 2017-07-11 13:27:08.974664 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:27:08.974949 I | rook-ceph-mon0: 2017-07-11 13:27:08.974894 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1405692923' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:27:09.604023 I | rook-ceph-mon0: 2017-07-11 13:27:09.603989 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.2 10.233.69.0:6800/178
- 2017-07-11 13:27:09.847050 I | rook-ceph-mon0: 2017-07-11 13:27:09.847014 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.0 10.233.72.0:6800/180
- 2017-07-11 13:27:09.937603 I | rook-ceph-mon0: 2017-07-11 13:27:08.580589 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 221 : cluster [INF] osdmap e83: 6 total, 6 up, 6 in
- 2017-07-11 13:27:10.539309 I | rook-ceph-mon0: 2017-07-11 13:27:10.539271 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.4 10.233.124.4:6800/178
- 2017-07-11 13:27:10.539759 I | rook-ceph-mon0: 2017-07-11 13:27:10.539742 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.4 10.233.124.4:6800/178
- 2017-07-11 13:27:10.899957 I | rook-ceph-mon0: 2017-07-11 13:27:10.898346 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e84: 6 total, 6 up, 6 in
- 2017-07-11 13:27:11.118481 I | rook-ceph-mon0: 2017-07-11 13:27:10.898348 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 228 : cluster [INF] osdmap e84: 6 total, 6 up, 6 in
- 2017-07-11 13:27:12.222225 I | rook-ceph-mon0: 2017-07-11 13:27:12.222196 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.3 10.233.86.0:6800/178
- 2017-07-11 13:27:13.913920 I | rook-ceph-mon0: 2017-07-11 13:27:13.913806 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:27:15.111503 I | rook-ceph-mon0: 2017-07-11 13:27:15.111444 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e85: 6 total, 6 up, 6 in
- 2017-07-11 13:27:15.811213 I | rook-ceph-mon0: 2017-07-11 13:27:15.810077 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.2 failed (root=default,host=master-0) (4 reporters from different host after 30.282725 >= grace 24.445681)
- 2017-07-11 13:27:15.961910 I | rook-ceph-mon0: 2017-07-11 13:27:15.961866 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e86: 6 total, 5 up, 6 in
- 2017-07-11 13:27:16.594791 I | rook-ceph-mon0: 2017-07-11 13:27:15.111446 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 231 : cluster [INF] osdmap e85: 6 total, 6 up, 6 in
- 2017-07-11 13:27:16.594885 I | rook-ceph-mon0: 2017-07-11 13:27:15.810084 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 232 : cluster [INF] osd.2 failed (root=default,host=master-0) (4 reporters from different host after 30.282725 >= grace 24.445681)
- 2017-07-11 13:27:16.594904 I | rook-ceph-mon0: 2017-07-11 13:27:15.962202 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 233 : cluster [INF] osdmap e86: 6 total, 5 up, 6 in
- 2017-07-11 13:27:17.820692 I | rook-ceph-mon0: 2017-07-11 13:27:06.189526 osd.1 osd.1 10.233.76.4:6800/178 89 : cluster [WRN] 47 slow requests, 5 included below; oldest blocked for > 45.208403 secs
- 2017-07-11 13:27:17.820787 I | rook-ceph-mon0: 2017-07-11 13:27:06.189533 osd.1 osd.1 10.233.76.4:6800/178 90 : cluster [WRN] slow request 75.384000 seconds old, received at 2017-07-11 13:25:50.805488: osd_pg_create(e27 0.3:2 0.35:2 0.4f:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27) currently wait for new map
- 2017-07-11 13:27:17.820839 I | rook-ceph-mon0: 2017-07-11 13:27:06.189548 osd.1 osd.1 10.233.76.4:6800/178 91 : cluster [WRN] slow request 73.909869 seconds old, received at 2017-07-11 13:25:52.279618: osd_pg_create(e28 0.3:2 0.35:2 0.4f:2 0.a0:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:17.820861 I | rook-ceph-mon0: 2017-07-11 13:27:06.189552 osd.1 osd.1 10.233.76.4:6800/178 92 : cluster [WRN] slow request 72.701847 seconds old, received at 2017-07-11 13:25:53.487640: osd_pg_create(e29 0.3:2 0.35:2 0.4f:2 0.a0:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:17.820931 I | rook-ceph-mon0: 2017-07-11 13:27:06.189557 osd.1 osd.1 10.233.76.4:6800/178 93 : cluster [WRN] slow request 71.448104 seconds old, received at 2017-07-11 13:25:54.741384: osd_pg_create(e30 0.3:2 0.35:2 0.4f:2 0.a0:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30) currently wait for new map
- 2017-07-11 13:27:17.820956 I | rook-ceph-mon0: 2017-07-11 13:27:06.189568 osd.1 osd.1 10.233.76.4:6800/178 94 : cluster [WRN] slow request 69.953239 seconds old, received at 2017-07-11 13:25:56.236248: osd_pg_create(e31 0.3:2 0.35:2 0.4f:2 0.a0:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31) currently wait for new map
- 2017-07-11 13:27:17.821000 I | rook-ceph-mon0: 2017-07-11 13:27:07.190167 osd.1 osd.1 10.233.76.4:6800/178 95 : cluster [WRN] 49 slow requests, 5 included below; oldest blocked for > 46.208604 secs
- 2017-07-11 13:27:17.821019 I | rook-ceph-mon0: 2017-07-11 13:27:07.190188 osd.1 osd.1 10.233.76.4:6800/178 96 : cluster [WRN] slow request 69.675377 seconds old, received at 2017-07-11 13:25:57.514311: osd_pg_create(e32 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32) currently wait for new map
- 2017-07-11 13:27:17.821052 I | rook-ceph-mon0: 2017-07-11 13:27:07.190210 osd.1 osd.1 10.233.76.4:6800/178 97 : cluster [WRN] slow request 68.464259 seconds old, received at 2017-07-11 13:25:58.725429: osd_pg_create(e33 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33) currently wait for new map
- 2017-07-11 13:27:17.821091 I | rook-ceph-mon0: 2017-07-11 13:27:07.190214 osd.1 osd.1 10.233.76.4:6800/178 98 : cluster [WRN] slow request 67.060533 seconds old, received at 2017-07-11 13:26:00.129155: osd_pg_create(e34 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.821184 I | rook-ceph-mon0: 2017-07-11 13:27:07.190219 osd.1 osd.1 10.233.76.4:6800/178 99 : cluster [WRN] slow request 65.733720 seconds old, received at 2017-07-11 13:26:01.455968: osd_pg_create(e35 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.821211 I | rook-ceph-mon0: 2017-07-11 13:27:07.190228 osd.1 osd.1 10.233.76.4:6800/178 100 : cluster [WRN] slow request 64.613660 seconds old, received at 2017-07-11 13:26:02.576028: osd_pg_create(e36 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.821255 I | rook-ceph-mon0: 2017-07-11 13:27:08.190465 osd.1 osd.1 10.233.76.4:6800/178 101 : cluster [WRN] 49 slow requests, 5 included below; oldest blocked for > 47.209318 secs
- 2017-07-11 13:27:17.821272 I | rook-ceph-mon0: 2017-07-11 13:27:08.190474 osd.1 osd.1 10.233.76.4:6800/178 102 : cluster [WRN] slow request 70.676092 seconds old, received at 2017-07-11 13:25:57.514311: osd_pg_create(e32 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32) currently wait for new map
- 2017-07-11 13:27:17.821317 I | rook-ceph-mon0: 2017-07-11 13:27:08.190487 osd.1 osd.1 10.233.76.4:6800/178 103 : cluster [WRN] slow request 69.464974 seconds old, received at 2017-07-11 13:25:58.725429: osd_pg_create(e33 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33) currently wait for new map
- 2017-07-11 13:27:17.821344 I | rook-ceph-mon0: 2017-07-11 13:27:08.190500 osd.1 osd.1 10.233.76.4:6800/178 104 : cluster [WRN] slow request 68.061248 seconds old, received at 2017-07-11 13:26:00.129155: osd_pg_create(e34 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.821690 I | rook-ceph-mon0: 2017-07-11 13:27:08.190507 osd.1 osd.1 10.233.76.4:6800/178 105 : cluster [WRN] slow request 66.734434 seconds old, received at 2017-07-11 13:26:01.455968: osd_pg_create(e35 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.821732 I | rook-ceph-mon0: 2017-07-11 13:27:08.190514 osd.1 osd.1 10.233.76.4:6800/178 106 : cluster [WRN] slow request 65.614374 seconds old, received at 2017-07-11 13:26:02.576028: osd_pg_create(e36 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.822210 I | rook-ceph-mon0: 2017-07-11 13:27:09.191044 osd.1 osd.1 10.233.76.4:6800/178 107 : cluster [WRN] 50 slow requests, 5 included below; oldest blocked for > 48.209584 secs
- 2017-07-11 13:27:17.822229 I | rook-ceph-mon0: 2017-07-11 13:27:09.191054 osd.1 osd.1 10.233.76.4:6800/178 108 : cluster [WRN] slow request 65.354982 seconds old, received at 2017-07-11 13:26:03.835686: osd_pg_create(e37 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.822273 I | rook-ceph-mon0: 2017-07-11 13:27:09.191060 osd.1 osd.1 10.233.76.4:6800/178 109 : cluster [WRN] slow request 64.220425 seconds old, received at 2017-07-11 13:26:04.970243: osd_pg_create(e38 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.822301 I | rook-ceph-mon0: 2017-07-11 13:27:09.191065 osd.1 osd.1 10.233.76.4:6800/178 110 : cluster [WRN] slow request 62.891164 seconds old, received at 2017-07-11 13:26:06.299505: osd_pg_create(e39 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.822324 I | rook-ceph-mon0: 2017-07-11 13:27:09.191073 osd.1 osd.1 10.233.76.4:6800/178 111 : cluster [WRN] slow request 61.603405 seconds old, received at 2017-07-11 13:26:07.587264: osd_pg_create(e40 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.822367 I | rook-ceph-mon0: 2017-07-11 13:27:09.191076 osd.1 osd.1 10.233.76.4:6800/178 112 : cluster [WRN] slow request 60.374950 seconds old, received at 2017-07-11 13:26:08.815718: osd_pg_create(e41 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.822382 I | rook-ceph-mon0: 2017-07-11 13:27:10.191362 osd.1 osd.1 10.233.76.4:6800/178 113 : cluster [WRN] 52 slow requests, 5 included below; oldest blocked for > 49.210222 secs
- 2017-07-11 13:27:17.822395 I | rook-ceph-mon0: 2017-07-11 13:27:10.191371 osd.1 osd.1 10.233.76.4:6800/178 114 : cluster [WRN] slow request 30.880335 seconds old, received at 2017-07-11 13:26:39.310971: pg_notify((query:25 sent:63 0.557( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 63) currently wait for new map
- 2017-07-11 13:27:17.822444 I | rook-ceph-mon0: 2017-07-11 13:27:10.191375 osd.1 osd.1 10.233.76.4:6800/178 115 : cluster [WRN] slow request 66.355620 seconds old, received at 2017-07-11 13:26:03.835686: osd_pg_create(e37 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.822556 I | rook-ceph-mon0: 2017-07-11 13:27:10.191380 osd.1 osd.1 10.233.76.4:6800/178 116 : cluster [WRN] slow request 65.221063 seconds old, received at 2017-07-11 13:26:04.970243: osd_pg_create(e38 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.822688 I | rook-ceph-mon0: 2017-07-11 13:27:10.191390 osd.1 osd.1 10.233.76.4:6800/178 117 : cluster [WRN] slow request 63.891801 seconds old, received at 2017-07-11 13:26:06.299505: osd_pg_create(e39 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.822712 I | rook-ceph-mon0: 2017-07-11 13:27:10.191394 osd.1 osd.1 10.233.76.4:6800/178 118 : cluster [WRN] slow request 62.604043 seconds old, received at 2017-07-11 13:26:07.587264: osd_pg_create(e40 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.822730 I | rook-ceph-mon0: 2017-07-11 13:27:11.191742 osd.1 osd.1 10.233.76.4:6800/178 119 : cluster [WRN] 54 slow requests, 5 included below; oldest blocked for > 50.210483 secs
- 2017-07-11 13:27:17.828721 I | rook-ceph-mon0: 2017-07-11 13:27:11.191745 osd.1 osd.1 10.233.76.4:6800/178 120 : cluster [WRN] slow request 30.132634 seconds old, received at 2017-07-11 13:26:41.058933: pg_notify((query:25 sent:61 0.560( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:17.828730 I | rook-ceph-mon0: 2017-07-11 13:27:11.191748 osd.1 osd.1 10.233.76.4:6800/178 121 : cluster [WRN] slow request 30.185198 seconds old, received at 2017-07-11 13:26:41.006369: pg_notify((query:25 sent:61 0.55c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:17.828742 I | rook-ceph-mon0: 2017-07-11 13:27:11.191753 osd.1 osd.1 10.233.76.4:6800/178 122 : cluster [WRN] slow request 62.375849 seconds old, received at 2017-07-11 13:26:08.815718: osd_pg_create(e41 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.828754 I | rook-ceph-mon0: 2017-07-11 13:27:11.191762 osd.1 osd.1 10.233.76.4:6800/178 123 : cluster [WRN] slow request 61.048090 seconds old, received at 2017-07-11 13:26:10.143477: osd_pg_create(e42 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.828767 I | rook-ceph-mon0: 2017-07-11 13:27:11.191776 osd.1 osd.1 10.233.76.4:6800/178 124 : cluster [WRN] slow request 59.606180 seconds old, received at 2017-07-11 13:26:11.585387: osd_pg_create(e43 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.828771 I | rook-ceph-mon0: 2017-07-11 13:27:12.192024 osd.1 osd.1 10.233.76.4:6800/178 125 : cluster [WRN] 55 slow requests, 5 included below; oldest blocked for > 51.210888 secs
- 2017-07-11 13:27:17.828775 I | rook-ceph-mon0: 2017-07-11 13:27:12.192028 osd.1 osd.1 10.233.76.4:6800/178 126 : cluster [WRN] slow request 30.737071 seconds old, received at 2017-07-11 13:26:41.454902: pg_notify((query:25 sent:61 0.568( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:17.828790 I | rook-ceph-mon0: 2017-07-11 13:27:12.192036 osd.1 osd.1 10.233.76.4:6800/178 127 : cluster [WRN] slow request 62.048496 seconds old, received at 2017-07-11 13:26:10.143477: osd_pg_create(e42 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.828804 I | rook-ceph-mon0: 2017-07-11 13:27:12.192047 osd.1 osd.1 10.233.76.4:6800/178 128 : cluster [WRN] slow request 60.606586 seconds old, received at 2017-07-11 13:26:11.585387: osd_pg_create(e43 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.828841 I | rook-ceph-mon0: 2017-07-11 13:27:12.192050 osd.1 osd.1 10.233.76.4:6800/178 129 : cluster [WRN] slow request 36.833041 seconds old, received at 2017-07-11 13:26:35.358932: pg_notify((query:25 sent:60 0.52b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:17.828844 I | rook-ceph-mon0: 2017-07-11 13:27:12.192052 osd.1 osd.1 10.233.76.4:6800/178 130 : cluster [WRN] slow request 35.974373 seconds old, received at 2017-07-11 13:26:36.217600: pg_notify((query:25 sent:60 0.539( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:17.828848 I | rook-ceph-mon0: 2017-07-11 13:27:13.192251 osd.1 osd.1 10.233.76.4:6800/178 131 : cluster [WRN] 55 slow requests, 3 included below; oldest blocked for > 52.211112 secs
- 2017-07-11 13:27:17.828851 I | rook-ceph-mon0: 2017-07-11 13:27:13.192255 osd.1 osd.1 10.233.76.4:6800/178 132 : cluster [WRN] slow request 36.549638 seconds old, received at 2017-07-11 13:26:36.642558: pg_notify((query:25 sent:61 0.53d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:17.828854 I | rook-ceph-mon0: 2017-07-11 13:27:13.192257 osd.1 osd.1 10.233.76.4:6800/178 133 : cluster [WRN] slow request 34.772839 seconds old, received at 2017-07-11 13:26:38.419357: pg_notify((query:25 sent:62 0.551( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 62) currently wait for new map
- 2017-07-11 13:27:17.828857 I | rook-ceph-mon0: 2017-07-11 13:27:13.192259 osd.1 osd.1 10.233.76.4:6800/178 134 : cluster [WRN] slow request 33.301633 seconds old, received at 2017-07-11 13:26:39.890564: pg_notify((query:25 sent:61 0.558( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:19.292332 I | rook-ceph-mon0: 2017-07-11 13:27:19.292265 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:27:19.293116 I | rook-ceph-mon0: 2017-07-11 13:27:19.293098 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e87: 6 total, 6 up, 6 in
- 2017-07-11 13:27:20.420320 I | rook-ceph-mon0: 2017-07-11 13:27:20.420286 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 13:27:20.420513 I | rook-ceph-mon0: 2017-07-11 13:27:20.420431 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/254904098' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 13:27:20.586793 I | rook-ceph-mon0: 2017-07-11 13:27:16.663305 osd.2 osd.2 10.233.69.0:6800/178 15 : cluster [WRN] map e86 wrongly marked me down at e86
- 2017-07-11 13:27:20.587146 I | rook-ceph-mon0: 2017-07-11 13:27:19.292801 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 234 : cluster [INF] osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:27:20.587186 I | rook-ceph-mon0: 2017-07-11 13:27:19.293185 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 235 : cluster [INF] osdmap e87: 6 total, 6 up, 6 in
- 2017-07-11 13:27:20.855412 I | rook-ceph-mon0: 2017-07-11 13:27:20.855376 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e88: 6 total, 6 up, 6 in
- 2017-07-11 13:27:22.002039 I | rook-ceph-mon0: 2017-07-11 13:27:20.855499 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 237 : cluster [INF] osdmap e88: 6 total, 6 up, 6 in
- 2017-07-11 13:27:26.627523 I | rook-ceph-mon0: 2017-07-11 13:27:21.198479 osd.1 osd.1 10.233.76.4:6800/178 135 : cluster [WRN] 51 slow requests, 5 included below; oldest blocked for > 60.217363 secs
- 2017-07-11 13:27:26.628514 I | rook-ceph-mon0: 2017-07-11 13:27:21.198486 osd.1 osd.1 10.233.76.4:6800/178 136 : cluster [WRN] slow request 60.216860 seconds old, received at 2017-07-11 13:26:20.981588: pg_notify((query:21 sent:36 0.4a4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.628553 I | rook-ceph-mon0: 2017-07-11 13:27:21.198491 osd.1 osd.1 10.233.76.4:6800/178 137 : cluster [WRN] slow request 60.216797 seconds old, received at 2017-07-11 13:26:20.981650: pg_notify((query:21 sent:36 0.4a6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.628569 I | rook-ceph-mon0: 2017-07-11 13:27:21.198493 osd.1 osd.1 10.233.76.4:6800/178 138 : cluster [WRN] slow request 60.217363 seconds old, received at 2017-07-11 13:26:20.981085: pg_notify((query:21 sent:36 0.427( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.628598 I | rook-ceph-mon0: 2017-07-11 13:27:21.198495 osd.1 osd.1 10.233.76.4:6800/178 139 : cluster [WRN] slow request 60.217124 seconds old, received at 2017-07-11 13:26:20.981323: pg_notify((query:21 sent:36 0.434( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.628622 I | rook-ceph-mon0: 2017-07-11 13:27:21.198497 osd.1 osd.1 10.233.76.4:6800/178 140 : cluster [WRN] slow request 60.217076 seconds old, received at 2017-07-11 13:26:20.981372: pg_notify((query:21 sent:36 0.437( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.628634 I | rook-ceph-mon0: 2017-07-11 13:27:22.198684 osd.1 osd.1 10.233.76.4:6800/178 141 : cluster [WRN] 51 slow requests, 2 included below; oldest blocked for > 61.217571 secs
- 2017-07-11 13:27:26.628762 I | rook-ceph-mon0: 2017-07-11 13:27:22.198688 osd.1 osd.1 10.233.76.4:6800/178 142 : cluster [WRN] slow request 61.217133 seconds old, received at 2017-07-11 13:26:20.981522: pg_notify((query:21 sent:36 0.46a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.628777 I | rook-ceph-mon0: 2017-07-11 13:27:22.198704 osd.1 osd.1 10.233.76.4:6800/178 143 : cluster [WRN] slow request 61.217096 seconds old, received at 2017-07-11 13:26:20.981560: pg_notify((query:21 sent:36 0.474( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.628790 I | rook-ceph-mon0: 2017-07-11 13:27:25.199148 osd.1 osd.1 10.233.76.4:6800/178 144 : cluster [WRN] 51 slow requests, 1 included below; oldest blocked for > 64.218040 secs
- 2017-07-11 13:27:26.628802 I | rook-ceph-mon0: 2017-07-11 13:27:25.199152 osd.1 osd.1 10.233.76.4:6800/178 145 : cluster [WRN] slow request 60.111971 seconds old, received at 2017-07-11 13:26:25.087153: pg_notify((query:25 sent:53 0.4b2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:32.461183 I | rook-ceph-mon0: 2017-07-11 13:27:32.459642 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e89: 6 total, 6 up, 6 in
- 2017-07-11 13:27:33.549356 I | rook-ceph-mon0: 2017-07-11 13:27:32.459644 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 238 : cluster [INF] osdmap e89: 6 total, 6 up, 6 in
- 2017-07-11 13:27:34.985182 I | rook-ceph-mon0: 2017-07-11 13:27:34.984952 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e90: 6 total, 6 up, 6 in
- 2017-07-11 13:27:35.859414 I | rook-ceph-mon0: 2017-07-11 13:27:35.858255 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.3 failed (root=default,host=master-2) (4 reporters from different host after 26.962517 >= grace 24.549064)
- 2017-07-11 13:27:36.137940 I | rook-ceph-mon0: 2017-07-11 13:27:36.137907 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e91: 6 total, 5 up, 6 in
- 2017-07-11 13:27:36.303223 I | rook-ceph-mon0: 2017-07-11 13:27:34.984953 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 239 : cluster [INF] osdmap e90: 6 total, 6 up, 6 in
- 2017-07-11 13:27:37.223161 I | rook-ceph-mon0: 2017-07-11 13:27:37.223129 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e92: 6 total, 5 up, 6 in
- 2017-07-11 13:27:37.459758 I | rook-ceph-mon0: 2017-07-11 13:27:27.199539 osd.1 osd.1 10.233.76.4:6800/178 146 : cluster [WRN] 51 slow requests, 2 included below; oldest blocked for > 66.218430 secs
- 2017-07-11 13:27:37.459853 I | rook-ceph-mon0: 2017-07-11 13:27:27.199556 osd.1 osd.1 10.233.76.4:6800/178 147 : cluster [WRN] slow request 60.619029 seconds old, received at 2017-07-11 13:26:26.580485: pg_notify((query:25 sent:53 0.4d9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:37.459872 I | rook-ceph-mon0: 2017-07-11 13:27:27.199559 osd.1 osd.1 10.233.76.4:6800/178 148 : cluster [WRN] slow request 60.064519 seconds old, received at 2017-07-11 13:26:27.134996: pg_notify((query:25 sent:54 0.4dd( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 54) currently wait for new map
- 2017-07-11 13:27:37.459916 I | rook-ceph-mon0: 2017-07-11 13:27:28.200194 osd.1 osd.1 10.233.76.4:6800/178 149 : cluster [WRN] 51 slow requests, 2 included below; oldest blocked for > 67.219084 secs
- 2017-07-11 13:27:37.459931 I | rook-ceph-mon0: 2017-07-11 13:27:28.200212 osd.1 osd.1 10.233.76.4:6800/178 150 : cluster [WRN] slow request 60.724418 seconds old, received at 2017-07-11 13:26:27.475751: pg_notify((query:25 sent:53 0.4e3( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:37.459942 I | rook-ceph-mon0: 2017-07-11 13:27:28.200216 osd.1 osd.1 10.233.76.4:6800/178 151 : cluster [WRN] slow request 60.324999 seconds old, received at 2017-07-11 13:26:27.875170: pg_notify((query:25 sent:55 0.4e6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:37.459952 I | rook-ceph-mon0: 2017-07-11 13:27:29.200370 osd.1 osd.1 10.233.76.4:6800/178 152 : cluster [WRN] 51 slow requests, 1 included below; oldest blocked for > 68.219263 secs
- 2017-07-11 13:27:37.459981 I | rook-ceph-mon0: 2017-07-11 13:27:29.200374 osd.1 osd.1 10.233.76.4:6800/178 153 : cluster [WRN] slow request 60.902580 seconds old, received at 2017-07-11 13:26:28.297767: pg_notify((query:25 sent:55 0.4ec( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:37.459994 I | rook-ceph-mon0: 2017-07-11 13:27:30.204516 osd.1 osd.1 10.233.76.4:6800/178 154 : cluster [WRN] 51 slow requests, 5 included below; oldest blocked for > 69.223400 secs
- 2017-07-11 13:27:37.460004 I | rook-ceph-mon0: 2017-07-11 13:27:30.204520 osd.1 osd.1 10.233.76.4:6800/178 155 : cluster [WRN] slow request 60.185531 seconds old, received at 2017-07-11 13:26:30.018953: pg_notify((query:21 sent:42 0.486( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.460014 I | rook-ceph-mon0: 2017-07-11 13:27:30.204523 osd.1 osd.1 10.233.76.4:6800/178 156 : cluster [WRN] slow request 60.185465 seconds old, received at 2017-07-11 13:26:30.019019: pg_notify((query:21 sent:42 0.49d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.460024 I | rook-ceph-mon0: 2017-07-11 13:27:30.204525 osd.1 osd.1 10.233.76.4:6800/178 157 : cluster [WRN] slow request 60.185445 seconds old, received at 2017-07-11 13:26:30.019039: pg_notify((query:21 sent:42 0.4a5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.460034 I | rook-ceph-mon0: 2017-07-11 13:27:30.204528 osd.1 osd.1 10.233.76.4:6800/178 158 : cluster [WRN] slow request 60.891603 seconds old, received at 2017-07-11 13:26:29.312882: pg_notify((query:25 sent:56 0.4f7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.460182 I | rook-ceph-mon0: 2017-07-11 13:27:30.204530 osd.1 osd.1 10.233.76.4:6800/178 159 : cluster [WRN] slow request 60.502898 seconds old, received at 2017-07-11 13:26:29.701587: pg_notify((query:25 sent:56 0.4fb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.460201 I | rook-ceph-mon0: 2017-07-11 13:27:31.204809 osd.1 osd.1 10.233.76.4:6800/178 160 : cluster [WRN] 51 slow requests, 5 included below; oldest blocked for > 70.223681 secs
- 2017-07-11 13:27:37.460213 I | rook-ceph-mon0: 2017-07-11 13:27:31.204814 osd.1 osd.1 10.233.76.4:6800/178 161 : cluster [WRN] slow request 61.185711 seconds old, received at 2017-07-11 13:26:30.019054: pg_notify((query:25 sent:42 0.4b0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.460239 I | rook-ceph-mon0: 2017-07-11 13:27:31.204816 osd.1 osd.1 10.233.76.4:6800/178 162 : cluster [WRN] slow request 60.406144 seconds old, received at 2017-07-11 13:26:30.798622: pg_notify((query:25 sent:57 0.503( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 57) currently wait for new map
- 2017-07-11 13:27:37.460256 I | rook-ceph-mon0: 2017-07-11 13:27:31.204819 osd.1 osd.1 10.233.76.4:6800/178 163 : cluster [WRN] slow request 60.430232 seconds old, received at 2017-07-11 13:26:30.774533: pg_notify((query:25 sent:56 0.502( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.460269 I | rook-ceph-mon0: 2017-07-11 13:27:31.204821 osd.1 osd.1 10.233.76.4:6800/178 164 : cluster [WRN] slow request 61.185696 seconds old, received at 2017-07-11 13:26:30.019069: pg_notify((query:25 sent:42 0.4bb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.460281 I | rook-ceph-mon0: 2017-07-11 13:27:31.204824 osd.1 osd.1 10.233.76.4:6800/178 165 : cluster [WRN] slow request 61.185679 seconds old, received at 2017-07-11 13:26:30.019086: pg_notify((query:25 sent:42 0.4e0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.460293 I | rook-ceph-mon0: 2017-07-11 13:27:32.208023 osd.1 osd.1 10.233.76.4:6800/178 166 : cluster [WRN] 50 slow requests, 2 included below; oldest blocked for > 71.226891 secs
- 2017-07-11 13:27:37.460318 I | rook-ceph-mon0: 2017-07-11 13:27:32.208028 osd.1 osd.1 10.233.76.4:6800/178 167 : cluster [WRN] slow request 60.550061 seconds old, received at 2017-07-11 13:26:31.657915: pg_notify((query:25 sent:56 0.509( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.460330 I | rook-ceph-mon0: 2017-07-11 13:27:32.208032 osd.1 osd.1 10.233.76.4:6800/178 168 : cluster [WRN] slow request 62.188873 seconds old, received at 2017-07-11 13:26:30.019102: pg_notify((query:25 sent:42 0.4f5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.460341 I | rook-ceph-mon0: 2017-07-11 13:27:33.209659 osd.1 osd.1 10.233.76.4:6800/178 169 : cluster [WRN] 50 slow requests, 2 included below; oldest blocked for > 72.228549 secs
- 2017-07-11 13:27:37.460353 I | rook-ceph-mon0: 2017-07-11 13:27:33.209663 osd.1 osd.1 10.233.76.4:6800/178 170 : cluster [WRN] slow request 60.551891 seconds old, received at 2017-07-11 13:26:32.657742: pg_notify((query:25 sent:58 0.514( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 58) currently wait for new map
- 2017-07-11 13:27:37.460364 I | rook-ceph-mon0: 2017-07-11 13:27:33.209666 osd.1 osd.1 10.233.76.4:6800/178 171 : cluster [WRN] slow request 60.711361 seconds old, received at 2017-07-11 13:26:32.498272: pg_notify((query:25 sent:56 0.513( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.460389 I | rook-ceph-mon0: 2017-07-11 13:27:34.211396 osd.1 osd.1 10.233.76.4:6800/178 172 : cluster [WRN] 65 slow requests, 5 included below; oldest blocked for > 69.124192 secs
- 2017-07-11 13:27:37.460416 I | rook-ceph-mon0: 2017-07-11 13:27:34.211401 osd.1 osd.1 10.233.76.4:6800/178 173 : cluster [WRN] slow request 43.169587 seconds old, received at 2017-07-11 13:26:51.041759: pg_notify((query:26 sent:72 0.5bc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 72) currently wait for new map
- 2017-07-11 13:27:37.460427 I | rook-ceph-mon0: 2017-07-11 13:27:34.211403 osd.1 osd.1 10.233.76.4:6800/178 174 : cluster [WRN] slow request 50.483405 seconds old, received at 2017-07-11 13:26:43.727940: pg_notify((query:26 sent:67 0.580( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:37.460443 I | rook-ceph-mon0: 2017-07-11 13:27:34.211405 osd.1 osd.1 10.233.76.4:6800/178 175 : cluster [WRN] slow request 39.432352 seconds old, received at 2017-07-11 13:26:54.778993: pg_notify((query:26 sent:76 0.5eb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:37.460478 I | rook-ceph-mon0: 2017-07-11 13:27:34.211408 osd.1 osd.1 10.233.76.4:6800/178 176 : cluster [WRN] slow request 50.472048 seconds old, received at 2017-07-11 13:26:43.739297: pg_notify((query:26 sent:67 0.581( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:37.460490 I | rook-ceph-mon0: 2017-07-11 13:27:34.211410 osd.1 osd.1 10.233.76.4:6800/178 177 : cluster [WRN] slow request 38.991231 seconds old, received at 2017-07-11 13:26:55.220115: pg_notify((query:26 sent:76 0.5f2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:37.460501 I | rook-ceph-mon0: 2017-07-11 13:27:35.211614 osd.1 osd.1 10.233.76.4:6800/178 178 : cluster [WRN] 66 slow requests, 5 included below; oldest blocked for > 70.124410 secs
- 2017-07-11 13:27:37.460512 I | rook-ceph-mon0: 2017-07-11 13:27:35.211618 osd.1 osd.1 10.233.76.4:6800/178 179 : cluster [WRN] slow request 50.962313 seconds old, received at 2017-07-11 13:26:44.249250: pg_notify((query:26 sent:67 0.584( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:37.460523 I | rook-ceph-mon0: 2017-07-11 13:27:35.211621 osd.1 osd.1 10.233.76.4:6800/178 180 : cluster [WRN] slow request 36.391198 seconds old, received at 2017-07-11 13:26:58.820365: pg_notify((query:26 sent:77 0.60e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:37.460534 I | rook-ceph-mon0: 2017-07-11 13:27:35.211624 osd.1 osd.1 10.233.76.4:6800/178 181 : cluster [WRN] slow request 49.607724 seconds old, received at 2017-07-11 13:26:45.603838: pg_notify((query:26 sent:68 0.595( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:37.460557 I | rook-ceph-mon0: 2017-07-11 13:27:35.211626 osd.1 osd.1 10.233.76.4:6800/178 182 : cluster [WRN] slow request 35.996271 seconds old, received at 2017-07-11 13:26:59.215292: pg_notify((query:26 sent:77 0.610( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:37.460570 I | rook-ceph-mon0: 2017-07-11 13:27:35.211628 osd.1 osd.1 10.233.76.4:6800/178 183 : cluster [WRN] slow request 43.225311 seconds old, received at 2017-07-11 13:26:51.986252: pg_notify((query:26 sent:73 0.5cb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 73) currently wait for new map
- 2017-07-11 13:27:37.460582 I | rook-ceph-mon0: 2017-07-11 13:27:35.858263 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 240 : cluster [INF] osd.3 failed (root=default,host=master-2) (4 reporters from different host after 26.962517 >= grace 24.549064)
- 2017-07-11 13:27:37.460593 I | rook-ceph-mon0: 2017-07-11 13:27:36.138047 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 241 : cluster [INF] osdmap e91: 6 total, 5 up, 6 in
- 2017-07-11 13:27:37.460604 I | rook-ceph-mon0: 2017-07-11 13:27:37.223230 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 242 : cluster [INF] osdmap e92: 6 total, 5 up, 6 in
- 2017-07-11 13:27:38.378391 I | rook-ceph-mon0: 2017-07-11 13:27:38.378355 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e93: 6 total, 5 up, 6 in
- 2017-07-11 13:27:39.527787 I | rook-ceph-mon0: 2017-07-11 13:27:38.378426 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 243 : cluster [INF] osdmap e93: 6 total, 5 up, 6 in
- 2017-07-11 13:27:39.753934 I | rook-ceph-mon0: 2017-07-11 13:27:39.753900 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e94: 6 total, 5 up, 6 in
- 2017-07-11 13:27:40.936284 I | rook-ceph-mon0: 2017-07-11 13:27:39.754027 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 244 : cluster [INF] osdmap e94: 6 total, 5 up, 6 in
- 2017-07-11 13:27:41.198685 I | rook-ceph-mon0: 2017-07-11 13:27:41.198637 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:27:41.199143 I | rook-ceph-mon0: 2017-07-11 13:27:41.199127 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e95: 6 total, 6 up, 6 in
- 2017-07-11 13:27:41.345740 I | rook-ceph-mon0: 2017-07-11 13:27:41.345704 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:27:41.345819 I | rook-ceph-mon0: 2017-07-11 13:27:41.345803 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2683123656' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:27:42.316413 I | rook-ceph-mon0: 2017-07-11 13:27:41.198794 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 245 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:27:42.316510 I | rook-ceph-mon0: 2017-07-11 13:27:41.199181 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 246 : cluster [INF] osdmap e95: 6 total, 6 up, 6 in
- 2017-07-11 13:27:42.675857 I | rook-ceph-mon0: 2017-07-11 13:27:42.675818 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e96: 6 total, 6 up, 6 in
- 2017-07-11 13:27:42.793536 I | rook-ceph-mon0: 2017-07-11 13:27:42.793450 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.0 10.233.72.0:6800/180
- 2017-07-11 13:27:42.955957 I | rook-ceph-mon0: 2017-07-11 13:27:42.955871 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:27:43.725849 I | rook-ceph-mon0: 2017-07-11 13:27:42.676001 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 248 : cluster [INF] osdmap e96: 6 total, 6 up, 6 in
- 2017-07-11 13:27:43.930525 I | rook-ceph-mon0: 2017-07-11 13:27:43.930487 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e97: 6 total, 6 up, 6 in
- 2017-07-11 13:27:45.047878 I | rook-ceph-mon0: 2017-07-11 13:27:43.930594 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 251 : cluster [INF] osdmap e97: 6 total, 6 up, 6 in
- 2017-07-11 13:27:45.268584 I | rook-ceph-mon0: 2017-07-11 13:27:45.268469 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e98: 6 total, 6 up, 6 in
- 2017-07-11 13:27:45.360828 I | rook-ceph-mon0: 2017-07-11 13:27:45.360546 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4812 MB, avail 94374 MB
- 2017-07-11 13:27:45.979704 I | rook-ceph-mon0: 2017-07-11 13:27:45.978352 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.0 failed (root=default,host=master-1) (3 reporters from different host after 33.064678 >= grace 24.401318)
- 2017-07-11 13:27:46.220809 I | rook-ceph-mon0: 2017-07-11 13:27:46.220773 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e99: 6 total, 5 up, 6 in
- 2017-07-11 13:27:46.446759 I | rook-ceph-mon0: 2017-07-11 13:27:36.211828 osd.1 osd.1 10.233.76.4:6800/178 184 : cluster [WRN] 71 slow requests, 5 included below; oldest blocked for > 71.124614 secs
- 2017-07-11 13:27:46.447017 I | rook-ceph-mon0: 2017-07-11 13:27:36.211833 osd.1 osd.1 10.233.76.4:6800/178 185 : cluster [WRN] slow request 30.721337 seconds old, received at 2017-07-11 13:27:05.490431: pg_notify((query:30 sent:78 0.5e2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.5f4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.447052 I | rook-ceph-mon0: 2017-07-11 13:27:36.211837 osd.1 osd.1 10.233.76.4:6800/178 186 : cluster [WRN] slow request 35.307991 seconds old, received at 2017-07-11 13:27:00.903776: pg_notify((query:26 sent:78 0.61e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.447067 I | rook-ceph-mon0: 2017-07-11 13:27:36.211839 osd.1 osd.1 10.233.76.4:6800/178 187 : cluster [WRN] slow request 30.644354 seconds old, received at 2017-07-11 13:27:05.567414: pg_notify((query:31 sent:78 0.430( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.447097 I | rook-ceph-mon0: 2017-07-11 13:27:36.211841 osd.1 osd.1 10.233.76.4:6800/178 188 : cluster [WRN] slow request 30.027417 seconds old, received at 2017-07-11 13:27:06.184351: pg_notify((query:31 sent:78 0.45f( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.46d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.447115 I | rook-ceph-mon0: 2017-07-11 13:27:36.211844 osd.1 osd.1 10.233.76.4:6800/178 189 : cluster [WRN] slow request 30.011214 seconds old, received at 2017-07-11 13:27:06.200553: pg_notify((query:31 sent:78 0.41d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.421( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.422( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.447129 I | rook-ceph-mon0: 2017-07-11 13:27:37.212020 osd.1 osd.1 10.233.76.4:6800/178 190 : cluster [WRN] 73 slow requests, 5 included below; oldest blocked for > 72.124801 secs
- 2017-07-11 13:27:46.447142 I | rook-ceph-mon0: 2017-07-11 13:27:37.212024 osd.1 osd.1 10.233.76.4:6800/178 191 : cluster [WRN] slow request 30.831535 seconds old, received at 2017-07-11 13:27:06.380420: pg_notify((query:33 sent:81 0.489( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.49b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.4ad( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 81) currently wait for new map
- 2017-07-11 13:27:46.447203 I | rook-ceph-mon0: 2017-07-11 13:27:37.212027 osd.1 osd.1 10.233.76.4:6800/178 192 : cluster [WRN] slow request 30.022916 seconds old, received at 2017-07-11 13:27:07.189039: pg_notify((query:33 sent:81 0.4bc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.4c0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.4c1( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 81) currently wait for new map
- 2017-07-11 13:27:46.447220 I | rook-ceph-mon0: 2017-07-11 13:27:37.212030 osd.1 osd.1 10.233.76.4:6800/178 193 : cluster [WRN] slow request 33.423069 seconds old, received at 2017-07-11 13:27:03.788885: pg_notify((query:26 sent:79 0.63e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 79) currently wait for new map
- 2017-07-11 13:27:46.447248 I | rook-ceph-mon0: 2017-07-11 13:27:37.212032 osd.1 osd.1 10.233.76.4:6800/178 194 : cluster [WRN] slow request 43.439708 seconds old, received at 2017-07-11 13:26:53.772246: pg_notify((query:26 sent:75 0.5df( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 75) currently wait for new map
- 2017-07-11 13:27:46.447261 I | rook-ceph-mon0: 2017-07-11 13:27:37.212046 osd.1 osd.1 10.233.76.4:6800/178 195 : cluster [WRN] slow request 42.610629 seconds old, received at 2017-07-11 13:26:54.601325: pg_notify((query:26 sent:76 0.5e8( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:46.447274 I | rook-ceph-mon0: 2017-07-11 13:27:38.229288 osd.1 osd.1 10.233.76.4:6800/178 196 : cluster [WRN] 76 slow requests, 5 included below; oldest blocked for > 73.125544 secs
- 2017-07-11 13:27:46.447287 I | rook-ceph-mon0: 2017-07-11 13:27:38.229300 osd.1 osd.1 10.233.76.4:6800/178 197 : cluster [WRN] slow request 30.467090 seconds old, received at 2017-07-11 13:27:07.745608: pg_notify((query:33 sent:82 0.4e4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.4e7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.4fe( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.506( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.447301 I | rook-ceph-mon0: 2017-07-11 13:27:38.229304 osd.1 osd.1 10.233.76.4:6800/178 198 : cluster [WRN] slow request 30.466970 seconds old, received at 2017-07-11 13:27:07.745728: pg_notify((query:33 sent:82 0.592( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.447327 I | rook-ceph-mon0: 2017-07-11 13:27:38.229307 osd.1 osd.1 10.233.76.4:6800/178 199 : cluster [WRN] slow request 62.853766 seconds old, received at 2017-07-11 13:26:35.358932: pg_notify((query:25 sent:60 0.52b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:46.447349 I | rook-ceph-mon0: 2017-07-11 13:27:38.229319 osd.1 osd.1 10.233.76.4:6800/178 200 : cluster [WRN] slow request 85.373497 seconds old, received at 2017-07-11 13:26:12.839201: osd_pg_create(e44 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:46.447367 I | rook-ceph-mon0: 2017-07-11 13:27:38.229323 osd.1 osd.1 10.233.76.4:6800/178 201 : cluster [WRN] slow request 42.086802 seconds old, received at 2017-07-11 13:26:56.125895: pg_notify((query:26 sent:77 0.5fa( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:46.447380 I | rook-ceph-mon0: 2017-07-11 13:27:39.229559 osd.1 osd.1 10.233.76.4:6800/178 202 : cluster [WRN] 86 slow requests, 5 included below; oldest blocked for > 74.142341 secs
- 2017-07-11 13:27:46.447454 I | rook-ceph-mon0: 2017-07-11 13:27:39.229564 osd.1 osd.1 10.233.76.4:6800/178 203 : cluster [WRN] slow request 30.990371 seconds old, received at 2017-07-11 13:27:08.239123: pg_notify((query:33 sent:82 0.599( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.59d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5a2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5b1( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5b7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5b8( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.447471 I | rook-ceph-mon0: 2017-07-11 13:27:39.229569 osd.1 osd.1 10.233.76.4:6800/178 204 : cluster [WRN] slow request 30.916765 seconds old, received at 2017-07-11 13:27:08.312729: pg_notify((query:33 sent:82 0.658( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.447483 I | rook-ceph-mon0: 2017-07-11 13:27:39.229573 osd.1 osd.1 10.233.76.4:6800/178 205 : cluster [WRN] slow request 30.951168 seconds old, received at 2017-07-11 13:27:08.278327: pg_notify((query:33 sent:82 0.646( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.447522 I | rook-ceph-mon0: 2017-07-11 13:27:39.229590 osd.1 osd.1 10.233.76.4:6800/178 206 : cluster [WRN] slow request 30.905708 seconds old, received at 2017-07-11 13:27:08.323786: pg_notify((query:33 sent:82 0.660( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.447538 I | rook-ceph-mon0: 2017-07-11 13:27:39.229592 osd.1 osd.1 10.233.76.4:6800/178 207 : cluster [WRN] slow request 30.903106 seconds old, received at 2017-07-11 13:27:08.326388: pg_notify((query:33 sent:82 0.663( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.447550 I | rook-ceph-mon0: 2017-07-11 13:27:40.229798 osd.1 osd.1 10.233.76.4:6800/178 208 : cluster [WRN] 86 slow requests, 5 included below; oldest blocked for > 75.142592 secs
- 2017-07-11 13:27:46.447562 I | rook-ceph-mon0: 2017-07-11 13:27:40.229802 osd.1 osd.1 10.233.76.4:6800/178 209 : cluster [WRN] slow request 60.918775 seconds old, received at 2017-07-11 13:26:39.310971: pg_notify((query:25 sent:63 0.557( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 63) currently wait for new map
- 2017-07-11 13:27:46.447573 I | rook-ceph-mon0: 2017-07-11 13:27:40.229805 osd.1 osd.1 10.233.76.4:6800/178 210 : cluster [WRN] slow request 31.923477 seconds old, received at 2017-07-11 13:27:08.306268: pg_notify((query:33 sent:80 0.659( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 80) currently wait for new map
- 2017-07-11 13:27:46.447598 I | rook-ceph-mon0: 2017-07-11 13:27:40.229807 osd.1 osd.1 10.233.76.4:6800/178 211 : cluster [WRN] slow request 31.894077 seconds old, received at 2017-07-11 13:27:08.335668: pg_notify((query:33 sent:80 0.66d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 80) currently wait for new map
- 2017-07-11 13:27:46.447618 I | rook-ceph-mon0: 2017-07-11 13:27:40.229822 osd.1 osd.1 10.233.76.4:6800/178 212 : cluster [WRN] slow request 87.390545 seconds old, received at 2017-07-11 13:26:12.839201: osd_pg_create(e44 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:46.447637 I | rook-ceph-mon0: 2017-07-11 13:27:40.229826 osd.1 osd.1 10.233.76.4:6800/178 213 : cluster [WRN] slow request 56.953126 seconds old, received at 2017-07-11 13:26:43.276620: pg_notify((query:26 sent:61 0.572( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.447690 I | rook-ceph-mon0: 2017-07-11 13:27:41.230168 osd.1 osd.1 10.233.76.4:6800/178 214 : cluster [WRN] 88 slow requests, 5 included below; oldest blocked for > 76.142899 secs
- 2017-07-11 13:27:46.447704 I | rook-ceph-mon0: 2017-07-11 13:27:41.230173 osd.1 osd.1 10.233.76.4:6800/178 215 : cluster [WRN] slow request 60.171119 seconds old, received at 2017-07-11 13:26:41.058933: pg_notify((query:25 sent:61 0.560( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.447716 I | rook-ceph-mon0: 2017-07-11 13:27:41.230175 osd.1 osd.1 10.233.76.4:6800/178 216 : cluster [WRN] slow request 60.223683 seconds old, received at 2017-07-11 13:26:41.006369: pg_notify((query:25 sent:61 0.55c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.447728 I | rook-ceph-mon0: 2017-07-11 13:27:41.230180 osd.1 osd.1 10.233.76.4:6800/178 217 : cluster [WRN] slow request 30.592509 seconds old, received at 2017-07-11 13:27:10.637543: pg_notify((query:33 sent:83 0.69b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:46.447796 I | rook-ceph-mon0: 2017-07-11 13:27:41.230192 osd.1 osd.1 10.233.76.4:6800/178 218 : cluster [WRN] slow request 33.468466 seconds old, received at 2017-07-11 13:27:07.761587: pg_notify((query:33 sent:82 0.546( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.55a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.569( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.447812 I | rook-ceph-mon0: 2017-07-11 13:27:41.230195 osd.1 osd.1 10.233.76.4:6800/178 219 : cluster [WRN] slow request 56.124997 seconds old, received at 2017-07-11 13:26:45.105055: pg_notify((query:26 sent:68 0.58a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:46.447824 I | rook-ceph-mon0: 2017-07-11 13:27:42.230491 osd.1 osd.1 10.233.76.4:6800/178 220 : cluster [WRN] 92 slow requests, 5 included below; oldest blocked for > 77.143283 secs
- 2017-07-11 13:27:46.447835 I | rook-ceph-mon0: 2017-07-11 13:27:42.230496 osd.1 osd.1 10.233.76.4:6800/178 221 : cluster [WRN] slow request 60.775534 seconds old, received at 2017-07-11 13:26:41.454902: pg_notify((query:25 sent:61 0.568( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.447859 I | rook-ceph-mon0: 2017-07-11 13:27:42.230500 osd.1 osd.1 10.233.76.4:6800/178 222 : cluster [WRN] slow request 30.955004 seconds old, received at 2017-07-11 13:27:11.275432: pg_notify((query:33 sent:84 0.6a9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.447872 I | rook-ceph-mon0: 2017-07-11 13:27:42.230502 osd.1 osd.1 10.233.76.4:6800/178 223 : cluster [WRN] slow request 30.597711 seconds old, received at 2017-07-11 13:27:11.632725: pg_notify((query:33 sent:84 0.6af( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.447883 I | rook-ceph-mon0: 2017-07-11 13:27:42.230505 osd.1 osd.1 10.233.76.4:6800/178 224 : cluster [WRN] slow request 30.588758 seconds old, received at 2017-07-11 13:27:11.641678: pg_notify((query:33 sent:84 0.6b0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.447894 I | rook-ceph-mon0: 2017-07-11 13:27:42.230508 osd.1 osd.1 10.233.76.4:6800/178 225 : cluster [WRN] slow request 30.092767 seconds old, received at 2017-07-11 13:27:12.137669: pg_notify((query:33 sent:84 0.6b2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.447905 I | rook-ceph-mon0: 2017-07-11 13:27:43.230779 osd.1 osd.1 10.233.76.4:6800/178 226 : cluster [WRN] 93 slow requests, 5 included below; oldest blocked for > 78.143573 secs
- 2017-07-11 13:27:46.447941 I | rook-ceph-mon0: 2017-07-11 13:27:43.230784 osd.1 osd.1 10.233.76.4:6800/178 227 : cluster [WRN] slow request 30.365027 seconds old, received at 2017-07-11 13:27:12.865700: pg_notify((query:33 sent:84 0.6c5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.447953 I | rook-ceph-mon0: 2017-07-11 13:27:43.230787 osd.1 osd.1 10.233.76.4:6800/178 228 : cluster [WRN] slow request 34.456532 seconds old, received at 2017-07-11 13:27:08.774195: pg_notify((query:33 sent:80 0.67d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 80) currently wait for new map
- 2017-07-11 13:27:46.447975 I | rook-ceph-mon0: 2017-07-11 13:27:43.230789 osd.1 osd.1 10.233.76.4:6800/178 229 : cluster [WRN] slow request 67.013127 seconds old, received at 2017-07-11 13:26:36.217600: pg_notify((query:25 sent:60 0.539( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:46.447986 I | rook-ceph-mon0: 2017-07-11 13:27:43.230800 osd.1 osd.1 10.233.76.4:6800/178 230 : cluster [WRN] slow request 59.951200 seconds old, received at 2017-07-11 13:26:43.279526: pg_notify((query:26 sent:66 0.577( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 66) currently wait for new map
- 2017-07-11 13:27:46.447996 I | rook-ceph-mon0: 2017-07-11 13:27:43.230802 osd.1 osd.1 10.233.76.4:6800/178 231 : cluster [WRN] slow request 46.111899 seconds old, received at 2017-07-11 13:26:57.118827: pg_notify((query:26 sent:77 0.601( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:46.448019 I | rook-ceph-mon0: 2017-07-11 13:27:44.230992 osd.1 osd.1 10.233.76.4:6800/178 232 : cluster [WRN] 96 slow requests, 5 included below; oldest blocked for > 79.143791 secs
- 2017-07-11 13:27:46.448030 I | rook-ceph-mon0: 2017-07-11 13:27:44.230997 osd.1 osd.1 10.233.76.4:6800/178 233 : cluster [WRN] slow request 60.503004 seconds old, received at 2017-07-11 13:26:43.727940: pg_notify((query:26 sent:67 0.580( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:46.448040 I | rook-ceph-mon0: 2017-07-11 13:27:44.231000 osd.1 osd.1 10.233.76.4:6800/178 234 : cluster [WRN] slow request 30.193221 seconds old, received at 2017-07-11 13:27:14.037724: pg_notify((query:33 sent:84 0.6e4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.448050 I | rook-ceph-mon0: 2017-07-11 13:27:44.231004 osd.1 osd.1 10.233.76.4:6800/178 235 : cluster [WRN] slow request 60.491647 seconds old, received at 2017-07-11 13:26:43.739297: pg_notify((query:26 sent:67 0.581( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:46.448060 I | rook-ceph-mon0: 2017-07-11 13:27:44.231007 osd.1 osd.1 10.233.76.4:6800/178 236 : cluster [WRN] slow request 30.184016 seconds old, received at 2017-07-11 13:27:14.046928: pg_notify((query:33 sent:84 0.6dc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.448070 I | rook-ceph-mon0: 2017-07-11 13:27:44.231009 osd.1 osd.1 10.233.76.4:6800/178 237 : cluster [WRN] slow request 60.954325 seconds old, received at 2017-07-11 13:26:43.276620: pg_notify((query:26 sent:61 0.572( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.448091 I | rook-ceph-mon0: 2017-07-11 13:27:45.231175 osd.1 osd.1 10.233.76.4:6800/178 238 : cluster [WRN] 102 slow requests, 5 included below; oldest blocked for > 80.143968 secs
- 2017-07-11 13:27:46.448104 I | rook-ceph-mon0: 2017-07-11 13:27:45.231179 osd.1 osd.1 10.233.76.4:6800/178 239 : cluster [WRN] slow request 30.669061 seconds old, received at 2017-07-11 13:27:14.562060: pg_notify((query:33 sent:84 0.6eb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.448115 I | rook-ceph-mon0: 2017-07-11 13:27:45.231184 osd.1 osd.1 10.233.76.4:6800/178 240 : cluster [WRN] slow request 60.981872 seconds old, received at 2017-07-11 13:26:44.249250: pg_notify((query:26 sent:67 0.584( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:46.448125 I | rook-ceph-mon0: 2017-07-11 13:27:45.231186 osd.1 osd.1 10.233.76.4:6800/178 241 : cluster [WRN] slow request 30.579540 seconds old, received at 2017-07-11 13:27:14.651582: pg_notify((query:33 sent:84 0.6f4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.448135 I | rook-ceph-mon0: 2017-07-11 13:27:45.231188 osd.1 osd.1 10.233.76.4:6800/178 242 : cluster [WRN] slow request 30.579626 seconds old, received at 2017-07-11 13:27:14.651495: pg_notify((query:33 sent:83 0.6fb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:46.448145 I | rook-ceph-mon0: 2017-07-11 13:27:45.231190 osd.1 osd.1 10.233.76.4:6800/178 243 : cluster [WRN] slow request 30.150142 seconds old, received at 2017-07-11 13:27:15.080979: pg_notify((query:33 sent:83 0.704( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:46.448166 I | rook-ceph-mon0: 2017-07-11 13:27:45.268744 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 252 : cluster [INF] osdmap e98: 6 total, 6 up, 6 in
- 2017-07-11 13:27:46.448178 I | rook-ceph-mon0: 2017-07-11 13:27:45.978362 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 253 : cluster [INF] osd.0 failed (root=default,host=master-1) (3 reporters from different host after 33.064678 >= grace 24.401318)
- 2017-07-11 13:27:46.448189 I | rook-ceph-mon0: 2017-07-11 13:27:46.220901 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 254 : cluster [INF] osdmap e99: 6 total, 5 up, 6 in
- 2017-07-11 13:27:47.621503 I | rook-ceph-mon0: 2017-07-11 13:27:37.573529 osd.3 osd.3 10.233.86.0:6800/178 15 : cluster [WRN] map e92 wrongly marked me down at e91
- 2017-07-11 13:27:47.874748 I | rook-ceph-mon0: 2017-07-11 13:27:47.874591 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e100: 6 total, 5 up, 6 in
- 2017-07-11 13:27:49.088457 I | rook-ceph-mon0: 2017-07-11 13:27:47.874831 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 255 : cluster [INF] osdmap e100: 6 total, 5 up, 6 in
- 2017-07-11 13:27:49.481633 I | rook-ceph-mon0: 2017-07-11 13:27:49.481504 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e101: 6 total, 5 up, 6 in
- 2017-07-11 13:27:50.821542 I | rook-ceph-mon0: 2017-07-11 13:27:49.481726 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 256 : cluster [INF] osdmap e101: 6 total, 5 up, 6 in
- 2017-07-11 13:27:51.023739 I | rook-ceph-mon0: 2017-07-11 13:27:51.023706 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e102: 6 total, 5 up, 6 in
- 2017-07-11 13:27:51.496011 I | rook-ceph-mon0: 2017-07-11 13:27:51.495974 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e103: 6 total, 5 up, 6 in
- 2017-07-11 13:27:52.192014 I | rook-ceph-mon0: 2017-07-11 13:27:51.023882 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 257 : cluster [INF] osdmap e102: 6 total, 5 up, 6 in
- 2017-07-11 13:27:52.201134 I | rook-ceph-mon0: 2017-07-11 13:27:51.496114 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 258 : cluster [INF] osdmap e103: 6 total, 5 up, 6 in
- 2017-07-11 13:27:52.671517 I | rook-ceph-mon0: 2017-07-11 13:27:52.669895 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e104: 6 total, 5 up, 6 in
- 2017-07-11 13:27:53.498922 I | rook-ceph-mon0: 2017-07-11 13:27:52.669897 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 259 : cluster [INF] osdmap e104: 6 total, 5 up, 6 in
- 2017-07-11 13:27:53.931851 I | rook-ceph-mon0: 2017-07-11 13:27:53.915598 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:27:53.931936 I | rook-ceph-mon0: 2017-07-11 13:27:53.915687 7f7c4754c700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.4 10.233.124.4:6800/178
- 2017-07-11 13:27:53.952064 I | rook-ceph-mon0: 2017-07-11 13:27:53.952036 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e105: 6 total, 6 up, 6 in
- 2017-07-11 13:27:54.999571 I | rook-ceph-mon0: 2017-07-11 13:27:53.915602 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 260 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:27:54.999951 I | rook-ceph-mon0: 2017-07-11 13:27:53.952139 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 262 : cluster [INF] osdmap e105: 6 total, 6 up, 6 in
- 2017-07-11 13:27:55.359098 I | rook-ceph-mon0: 2017-07-11 13:27:55.359066 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e106: 6 total, 6 up, 6 in
- 2017-07-11 13:27:56.473099 I | rook-ceph-mon0: 2017-07-11 13:27:56.470837 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e107: 6 total, 6 up, 6 in
- 2017-07-11 13:27:56.721804 I | rook-ceph-mon0: 2017-07-11 13:27:46.231376 osd.1 osd.1 10.233.76.4:6800/178 244 : cluster [WRN] 105 slow requests, 5 included below; oldest blocked for > 81.144176 secs
- 2017-07-11 13:27:56.721887 I | rook-ceph-mon0: 2017-07-11 13:27:46.231380 osd.1 osd.1 10.233.76.4:6800/178 245 : cluster [WRN] slow request 60.627491 seconds old, received at 2017-07-11 13:26:45.603838: pg_notify((query:26 sent:68 0.595( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:56.721905 I | rook-ceph-mon0: 2017-07-11 13:27:46.231384 osd.1 osd.1 10.233.76.4:6800/178 246 : cluster [WRN] slow request 30.655197 seconds old, received at 2017-07-11 13:27:15.576133: pg_notify((query:33 sent:85 0.710( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 85) currently wait for new map
- 2017-07-11 13:27:56.721917 I | rook-ceph-mon0: 2017-07-11 13:27:46.231386 osd.1 osd.1 10.233.76.4:6800/178 247 : cluster [WRN] slow request 30.282693 seconds old, received at 2017-07-11 13:27:15.948637: pg_notify((query:33 sent:85 0.718( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 85) currently wait for new map
- 2017-07-11 13:27:56.721946 I | rook-ceph-mon0: 2017-07-11 13:27:46.231389 osd.1 osd.1 10.233.76.4:6800/178 248 : cluster [WRN] slow request 31.116766 seconds old, received at 2017-07-11 13:27:15.114563: pg_notify((query:33 sent:83 0.707( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:56.721966 I | rook-ceph-mon0: 2017-07-11 13:27:46.231391 osd.1 osd.1 10.233.76.4:6800/178 249 : cluster [WRN] slow request 31.665693 seconds old, received at 2017-07-11 13:27:14.565637: pg_notify((query:33 sent:84 0.6ec( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:56.721979 I | rook-ceph-mon0: 2017-07-11 13:27:47.231623 osd.1 osd.1 10.233.76.4:6800/178 250 : cluster [WRN] 98 slow requests, 5 included below; oldest blocked for > 82.144421 secs
- 2017-07-11 13:27:56.721992 I | rook-ceph-mon0: 2017-07-11 13:27:47.231627 osd.1 osd.1 10.233.76.4:6800/178 251 : cluster [WRN] slow request 62.126519 seconds old, received at 2017-07-11 13:26:45.105055: pg_notify((query:26 sent:68 0.58a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:56.722004 I | rook-ceph-mon0: 2017-07-11 13:27:47.231630 osd.1 osd.1 10.233.76.4:6800/178 252 : cluster [WRN] slow request 63.952048 seconds old, received at 2017-07-11 13:26:43.279526: pg_notify((query:26 sent:66 0.577( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 66) currently wait for new map
- 2017-07-11 13:27:56.722030 I | rook-ceph-mon0: 2017-07-11 13:27:47.231632 osd.1 osd.1 10.233.76.4:6800/178 253 : cluster [WRN] slow request 31.698025 seconds old, received at 2017-07-11 13:27:15.533549: pg_notify((query:33 sent:85 0.70d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 85) currently wait for new map
- 2017-07-11 13:27:56.722042 I | rook-ceph-mon0: 2017-07-11 13:27:47.231635 osd.1 osd.1 10.233.76.4:6800/178 254 : cluster [WRN] slow request 73.529111 seconds old, received at 2017-07-11 13:26:33.702464: pg_notify((query:25 sent:56 0.51c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:56.722054 I | rook-ceph-mon0: 2017-07-11 13:27:47.231638 osd.1 osd.1 10.233.76.4:6800/178 255 : cluster [WRN] slow request 62.639275 seconds old, received at 2017-07-11 13:26:44.592300: pg_notify((query:26 sent:67 0.585( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:56.722066 I | rook-ceph-mon0: 2017-07-11 13:27:48.232898 osd.1 osd.1 10.233.76.4:6800/178 256 : cluster [WRN] 91 slow requests, 5 included below; oldest blocked for > 96.647456 secs
- 2017-07-11 13:27:56.722078 I | rook-ceph-mon0: 2017-07-11 13:27:48.232904 osd.1 osd.1 10.233.76.4:6800/178 257 : cluster [WRN] slow request 63.640544 seconds old, received at 2017-07-11 13:26:44.592300: pg_notify((query:26 sent:67 0.585( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:56.722101 I | rook-ceph-mon0: 2017-07-11 13:27:48.232907 osd.1 osd.1 10.233.76.4:6800/178 258 : cluster [WRN] slow request 40.013111 seconds old, received at 2017-07-11 13:27:08.219733: pg_notify((query:33 sent:82 0.5d4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:56.722116 I | rook-ceph-mon0: 2017-07-11 13:27:48.232909 osd.1 osd.1 10.233.76.4:6800/178 259 : cluster [WRN] slow request 71.590286 seconds old, received at 2017-07-11 13:26:36.642558: pg_notify((query:25 sent:61 0.53d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:56.722129 I | rook-ceph-mon0: 2017-07-11 13:27:48.232911 osd.1 osd.1 10.233.76.4:6800/178 260 : cluster [WRN] slow request 43.246956 seconds old, received at 2017-07-11 13:27:04.985887: pg_notify((query:30 sent:78 0.5f9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:30 sent:78 0.608( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.60a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:56.722143 I | rook-ceph-mon0: 2017-07-11 13:27:48.232914 osd.1 osd.1 10.233.76.4:6800/178 261 : cluster [WRN] slow request 37.072739 seconds old, received at 2017-07-11 13:27:11.160105: pg_notify((query:33 sent:84 0.69c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:56.722157 I | rook-ceph-mon0: 2017-07-11 13:27:49.233130 osd.1 osd.1 10.233.76.4:6800/178 262 : cluster [WRN] 92 slow requests, 5 included below; oldest blocked for > 97.647688 secs
- 2017-07-11 13:27:56.722206 I | rook-ceph-mon0: 2017-07-11 13:27:49.233135 osd.1 osd.1 10.233.76.4:6800/178 263 : cluster [WRN] slow request 30.033977 seconds old, received at 2017-07-11 13:27:19.199097: pg_notify((query:33 sent:86 0.735( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:56.722221 I | rook-ceph-mon0: 2017-07-11 13:27:49.233137 osd.1 osd.1 10.233.76.4:6800/178 264 : cluster [WRN] slow request 70.813718 seconds old, received at 2017-07-11 13:26:38.419357: pg_notify((query:25 sent:62 0.551( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 62) currently wait for new map
- 2017-07-11 13:27:56.722232 I | rook-ceph-mon0: 2017-07-11 13:27:49.233140 osd.1 osd.1 10.233.76.4:6800/178 265 : cluster [WRN] slow request 60.350007 seconds old, received at 2017-07-11 13:26:48.883068: pg_notify((query:26 sent:70 0.5ab( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 70) currently wait for new map
- 2017-07-11 13:27:56.722242 I | rook-ceph-mon0: 2017-07-11 13:27:49.233142 osd.1 osd.1 10.233.76.4:6800/178 266 : cluster [WRN] slow request 51.699534 seconds old, received at 2017-07-11 13:26:57.533540: pg_notify((query:26 sent:77 0.605( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:56.722264 I | rook-ceph-mon0: 2017-07-11 13:27:49.233146 osd.1 osd.1 10.233.76.4:6800/178 267 : cluster [WRN] slow request 75.255146 seconds old, received at 2017-07-11 13:26:33.977929: pg_notify((query:25 sent:56 0.51e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:56.722276 I | rook-ceph-mon0: 2017-07-11 13:27:50.233371 osd.1 osd.1 10.233.76.4:6800/178 268 : cluster [WRN] 93 slow requests, 5 included below; oldest blocked for > 98.647930 secs
- 2017-07-11 13:27:56.722287 I | rook-ceph-mon0: 2017-07-11 13:27:50.233377 osd.1 osd.1 10.233.76.4:6800/178 269 : cluster [WRN] slow request 30.401485 seconds old, received at 2017-07-11 13:27:19.831832: pg_notify((query:33 sent:86 0.73a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:56.722316 I | rook-ceph-mon0: 2017-07-11 13:27:50.233379 osd.1 osd.1 10.233.76.4:6800/178 270 : cluster [WRN] slow request 61.350249 seconds old, received at 2017-07-11 13:26:48.883068: pg_notify((query:26 sent:70 0.5ab( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 70) currently wait for new map
- 2017-07-11 13:27:56.722351 I | rook-ceph-mon0: 2017-07-11 13:27:50.233382 osd.1 osd.1 10.233.76.4:6800/178 271 : cluster [WRN] slow request 66.953742 seconds old, received at 2017-07-11 13:26:43.279575: pg_notify((query:26 sent:66 0.57a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 66) currently wait for new map
- 2017-07-11 13:27:56.722363 I | rook-ceph-mon0: 2017-07-11 13:27:50.233384 osd.1 osd.1 10.233.76.4:6800/178 272 : cluster [WRN] slow request 42.012912 seconds old, received at 2017-07-11 13:27:08.220405: pg_notify((query:33 sent:82 0.634( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:56.722374 I | rook-ceph-mon0: 2017-07-11 13:27:50.233386 osd.1 osd.1 10.233.76.4:6800/178 273 : cluster [WRN] slow request 70.342753 seconds old, received at 2017-07-11 13:26:39.890564: pg_notify((query:25 sent:61 0.558( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:56.722384 I | rook-ceph-mon0: 2017-07-11 13:27:51.242252 osd.1 osd.1 10.233.76.4:6800/178 274 : cluster [WRN] 104 slow requests, 5 included below; oldest blocked for > 99.656573 secs
- 2017-07-11 13:27:56.722394 I | rook-ceph-mon0: 2017-07-11 13:27:51.242257 osd.1 osd.1 10.233.76.4:6800/178 275 : cluster [WRN] slow request 60.200202 seconds old, received at 2017-07-11 13:26:51.041759: pg_notify((query:26 sent:72 0.5bc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 72) currently wait for new map
- 2017-07-11 13:27:56.722411 I | rook-ceph-mon0: 2017-07-11 13:27:51.242266 osd.1 osd.1 10.233.76.4:6800/178 276 : cluster [WRN] slow request 96.978876 seconds old, received at 2017-07-11 13:26:14.263085: osd_pg_create(e45 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.722445 I | rook-ceph-mon0: 2017-07-11 13:27:51.242273 osd.1 osd.1 10.233.76.4:6800/178 277 : cluster [WRN] slow request 95.369145 seconds old, received at 2017-07-11 13:26:15.872816: osd_pg_create(e46 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.722505 I | rook-ceph-mon0: 2017-07-11 13:27:51.242278 osd.1 osd.1 10.233.76.4:6800/178 278 : cluster [WRN] slow request 94.044219 seconds old, received at 2017-07-11 13:26:17.197741: osd_pg_create(e47 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.722527 I | rook-ceph-mon0: 2017-07-11 13:27:51.242283 osd.1 osd.1 10.233.76.4:6800/178 279 : cluster [WRN] slow request 92.879030 seconds old, received at 2017-07-11 13:26:18.362931: osd_pg_create(e48 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.722543 I | rook-ceph-mon0: 2017-07-11 13:27:51.845944 osd.0 osd.0 10.233.72.0:6800/180 51 : cluster [WRN] map e103 wrongly marked me down at e99
- 2017-07-11 13:27:56.722554 I | rook-ceph-mon0: 2017-07-11 13:27:52.242645 osd.1 osd.1 10.233.76.4:6800/178 280 : cluster [WRN] 87 slow requests, 5 included below; oldest blocked for > 75.599868 secs
- 2017-07-11 13:27:56.722581 I | rook-ceph-mon0: 2017-07-11 13:27:52.242657 osd.1 osd.1 10.233.76.4:6800/178 281 : cluster [WRN] slow request 95.044685 seconds old, received at 2017-07-11 13:26:17.197741: osd_pg_create(e47 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently started
- 2017-07-11 13:27:56.722621 I | rook-ceph-mon0: 2017-07-11 13:27:52.242662 osd.1 osd.1 10.233.76.4:6800/178 282 : cluster [WRN] slow request 93.879496 seconds old, received at 2017-07-11 13:26:18.362931: osd_pg_create(e48 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.722656 I | rook-ceph-mon0: 2017-07-11 13:27:52.242667 osd.1 osd.1 10.233.76.4:6800/178 283 : cluster [WRN] slow request 92.142505 seconds old, received at 2017-07-11 13:26:20.099922: osd_pg_create(e49 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.722676 I | rook-ceph-mon0: 2017-07-11 13:27:52.242672 osd.1 osd.1 10.233.76.4:6800/178 284 : cluster [WRN] slow request 90.643368 seconds old, received at 2017-07-11 13:26:21.599058: osd_pg_create(e50 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.722694 I | rook-ceph-mon0: 2017-07-11 13:27:52.242687 osd.1 osd.1 10.233.76.4:6800/178 285 : cluster [WRN] slow request 89.306341 seconds old, received at 2017-07-11 13:26:22.936086: osd_pg_create(e51 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.722707 I | rook-ceph-mon0: 2017-07-11 13:27:53.242971 osd.1 osd.1 10.233.76.4:6800/178 286 : cluster [WRN] 85 slow requests, 5 included below; oldest blocked for > 76.600234 secs
- 2017-07-11 13:27:56.722730 I | rook-ceph-mon0: 2017-07-11 13:27:53.242975 osd.1 osd.1 10.233.76.4:6800/178 287 : cluster [WRN] slow request 30.644460 seconds old, received at 2017-07-11 13:27:22.598333: pg_notify((query:33 sent:88 0.754( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 88) currently wait for new map
- 2017-07-11 13:27:56.722743 I | rook-ceph-mon0: 2017-07-11 13:27:53.242978 osd.1 osd.1 10.233.76.4:6800/178 288 : cluster [WRN] slow request 89.851805 seconds old, received at 2017-07-11 13:26:23.390988: osd pg remove(epoch 50; pg0.4d; ) currently wait for new map
- 2017-07-11 13:27:56.722758 I | rook-ceph-mon0: 2017-07-11 13:27:53.242982 osd.1 osd.1 10.233.76.4:6800/178 289 : cluster [WRN] slow request 90.306707 seconds old, received at 2017-07-11 13:26:22.936086: osd_pg_create(e51 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently started
- 2017-07-11 13:27:56.722777 I | rook-ceph-mon0: 2017-07-11 13:27:53.242986 osd.1 osd.1 10.233.76.4:6800/178 290 : cluster [WRN] slow request 88.629480 seconds old, received at 2017-07-11 13:26:24.613312: osd_pg_create(e52 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.722804 I | rook-ceph-mon0: 2017-07-11 13:27:53.242989 osd.1 osd.1 10.233.76.4:6800/178 291 : cluster [WRN] slow request 88.254915 seconds old, received at 2017-07-11 13:26:24.987877: osd_pg_create(e53 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.722818 I | rook-ceph-mon0: 2017-07-11 13:27:54.248265 osd.1 osd.1 10.233.76.4:6800/178 292 : cluster [WRN] 77 slow requests, 5 included below; oldest blocked for > 77.605662 secs
- 2017-07-11 13:27:56.722829 I | rook-ceph-mon0: 2017-07-11 13:27:54.248269 osd.1 osd.1 10.233.76.4:6800/178 293 : cluster [WRN] slow request 62.261968 seconds old, received at 2017-07-11 13:26:51.986252: pg_notify((query:26 sent:73 0.5cb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 73) currently wait for new map
- 2017-07-11 13:27:56.722838 I | rook-ceph-mon0: 2017-07-11 13:27:54.248273 osd.1 osd.1 10.233.76.4:6800/178 294 : cluster [WRN] slow request 60.475974 seconds old, received at 2017-07-11 13:26:53.772246: pg_notify((query:26 sent:75 0.5df( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 75) currently wait for new map
- 2017-07-11 13:27:56.722850 I | rook-ceph-mon0: 2017-07-11 13:27:54.248277 osd.1 osd.1 10.233.76.4:6800/178 295 : cluster [WRN] slow request 33.326644 seconds old, received at 2017-07-11 13:27:20.921576: pg_notify((query:33 sent:86 0.743( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:56.722909 I | rook-ceph-mon0: 2017-07-11 13:27:54.248279 osd.1 osd.1 10.233.76.4:6800/178 296 : cluster [WRN] slow request 32.118362 seconds old, received at 2017-07-11 13:27:22.129859: pg_notify((query:33 sent:86 0.751( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:56.722922 I | rook-ceph-mon0: 2017-07-11 13:27:54.248282 osd.1 osd.1 10.233.76.4:6800/178 297 : cluster [WRN] slow request 33.820998 seconds old, received at 2017-07-11 13:27:20.427222: pg_notify((query:33 sent:87 0.741( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 87) currently wait for new map
- 2017-07-11 13:27:56.722948 I | rook-ceph-mon0: 2017-07-11 13:27:55.248442 osd.1 osd.1 10.233.76.4:6800/178 298 : cluster [WRN] 59 slow requests, 5 included below; oldest blocked for > 64.206642 secs
- 2017-07-11 13:27:56.722960 I | rook-ceph-mon0: 2017-07-11 13:27:55.248447 osd.1 osd.1 10.233.76.4:6800/178 299 : cluster [WRN] slow request 60.469408 seconds old, received at 2017-07-11 13:26:54.778993: pg_notify((query:26 sent:76 0.5eb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:56.722970 I | rook-ceph-mon0: 2017-07-11 13:27:55.248450 osd.1 osd.1 10.233.76.4:6800/178 300 : cluster [WRN] slow request 60.028286 seconds old, received at 2017-07-11 13:26:55.220115: pg_notify((query:26 sent:76 0.5f2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:56.722980 I | rook-ceph-mon0: 2017-07-11 13:27:55.248454 osd.1 osd.1 10.233.76.4:6800/178 301 : cluster [WRN] slow request 60.647076 seconds old, received at 2017-07-11 13:26:54.601325: pg_notify((query:26 sent:76 0.5e8( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:56.722990 I | rook-ceph-mon0: 2017-07-11 13:27:55.248457 osd.1 osd.1 10.233.76.4:6800/178 302 : cluster [WRN] slow request 33.915342 seconds old, received at 2017-07-11 13:27:21.333059: pg_notify((query:33 sent:88 0.74a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 88) currently wait for new map
- 2017-07-11 13:27:56.723022 I | rook-ceph-mon0: 2017-07-11 13:27:55.248459 osd.1 osd.1 10.233.76.4:6800/178 303 : cluster [WRN] slow request 41.837203 seconds old, received at 2017-07-11 13:27:13.411198: pg_notify((query:33 sent:84 0.6cd( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:56.723035 I | rook-ceph-mon0: 2017-07-11 13:27:55.359173 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 263 : cluster [INF] osdmap e106: 6 total, 6 up, 6 in
- 2017-07-11 13:27:57.081807 I | rook-ceph-mon0: 2017-07-11 13:27:57.081773 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e108: 6 total, 6 up, 6 in
- 2017-07-11 13:27:57.893355 I | rook-ceph-mon0: 2017-07-11 13:27:57.891364 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e109: 6 total, 6 up, 6 in
- 2017-07-11 13:27:58.349523 I | rook-ceph-mon0: 2017-07-11 13:27:56.470839 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 264 : cluster [INF] osdmap e107: 6 total, 6 up, 6 in
- 2017-07-11 13:27:58.359259 I | rook-ceph-mon0: 2017-07-11 13:27:57.081894 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 265 : cluster [INF] osdmap e108: 6 total, 6 up, 6 in
- 2017-07-11 13:27:59.202885 I | rook-ceph-mon0: 2017-07-11 13:27:59.197101 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e110: 6 total, 6 up, 6 in
- 2017-07-11 13:27:59.220044 I | rook-ceph-mon0: 2017-07-11 13:27:59.219984 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.3 10.233.86.0:6800/178
- 2017-07-11 13:27:59.550064 I | rook-ceph-mon0: 2017-07-11 13:27:57.891366 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 266 : cluster [INF] osdmap e109: 6 total, 6 up, 6 in
- 2017-07-11 13:27:59.550150 I | rook-ceph-mon0: 2017-07-11 13:27:59.197103 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 267 : cluster [INF] osdmap e110: 6 total, 6 up, 6 in
- 2017-07-11 13:28:01.375131 I | rook-ceph-mon0: 2017-07-11 13:28:01.375066 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e111: 6 total, 6 up, 6 in
- 2017-07-11 13:28:01.767013 I | rook-ceph-mon0: 2017-07-11 13:28:01.766980 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e112: 6 total, 6 up, 6 in
- 2017-07-11 13:28:02.444243 I | rook-ceph-mon0: 2017-07-11 13:28:01.375068 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 269 : cluster [INF] osdmap e111: 6 total, 6 up, 6 in
- 2017-07-11 13:28:02.444422 I | rook-ceph-mon0: 2017-07-11 13:28:01.767503 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 270 : cluster [INF] osdmap e112: 6 total, 6 up, 6 in
- 2017-07-11 13:28:03.046351 I | rook-ceph-mon0: 2017-07-11 13:28:03.045807 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e113: 6 total, 6 up, 6 in
- 2017-07-11 13:28:03.046802 I | rook-ceph-mon0: 2017-07-11 13:28:03.046564 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:28:03.046837 I | rook-ceph-mon0: 2017-07-11 13:28:03.046587 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3526710914' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:28:04.087314 I | rook-ceph-mon0: 2017-07-11 13:28:03.045809 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 271 : cluster [INF] osdmap e113: 6 total, 6 up, 6 in
- 2017-07-11 13:28:04.374331 I | rook-ceph-mon0: 2017-07-11 13:28:04.370171 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e114: 6 total, 6 up, 6 in
- 2017-07-11 13:28:04.617589 I | rook-ceph-mon0: 2017-07-11 13:28:04.617499 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.2 10.233.69.0:6800/178
- 2017-07-11 13:28:05.281349 I | rook-ceph-mon0: 2017-07-11 13:28:05.281228 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_WARN; 178 pgs peering; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:28:05.600337 I | rook-ceph-mon0: 2017-07-11 13:28:04.370173 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 273 : cluster [INF] osdmap e114: 6 total, 6 up, 6 in
- 2017-07-11 13:28:05.600537 I | rook-ceph-mon0: 2017-07-11 13:28:05.281233 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 275 : cluster [INF] HEALTH_WARN; 178 pgs peering; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:28:05.806017 I | rook-ceph-mon0: 2017-07-11 13:28:05.804573 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e115: 6 total, 6 up, 6 in
- 2017-07-11 13:28:06.082277 I | rook-ceph-mon0: 2017-07-11 13:28:06.082198 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:28:06.908726 I | rook-ceph-mon0: 2017-07-11 13:28:06.907329 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e116: 6 total, 6 up, 6 in
- 2017-07-11 13:28:07.287172 I | rook-ceph-mon0: 2017-07-11 13:27:56.248965 osd.1 osd.1 10.233.76.4:6800/178 304 : cluster [WRN] 51 slow requests, 5 included below; oldest blocked for > 48.503111 secs
- 2017-07-11 13:28:07.287269 I | rook-ceph-mon0: 2017-07-11 13:27:56.248970 osd.1 osd.1 10.233.76.4:6800/178 305 : cluster [WRN] slow request 48.009182 seconds old, received at 2017-07-11 13:27:08.239537: osd pg remove(epoch 82; pg0.336; ) currently wait for new map
- 2017-07-11 13:28:07.287305 I | rook-ceph-mon0: 2017-07-11 13:27:56.248972 osd.1 osd.1 10.233.76.4:6800/178 306 : cluster [WRN] slow request 47.970436 seconds old, received at 2017-07-11 13:27:08.278283: osd pg remove(epoch 82; pg0.2e6; ) currently wait for new map
- 2017-07-11 13:28:07.287319 I | rook-ceph-mon0: 2017-07-11 13:27:56.248975 osd.1 osd.1 10.233.76.4:6800/178 307 : cluster [WRN] slow request 48.009160 seconds old, received at 2017-07-11 13:27:08.239559: osd pg remove(epoch 82; pg0.199; ) currently wait for new map
- 2017-07-11 13:28:07.287338 I | rook-ceph-mon0: 2017-07-11 13:27:56.248977 osd.1 osd.1 10.233.76.4:6800/178 308 : cluster [WRN] slow request 47.970427 seconds old, received at 2017-07-11 13:27:08.278291: osd pg remove(epoch 82; pg0.3b3; ) currently wait for new map
- 2017-07-11 13:28:07.287350 I | rook-ceph-mon0: 2017-07-11 13:27:56.248980 osd.1 osd.1 10.233.76.4:6800/178 309 : cluster [WRN] slow request 48.009044 seconds old, received at 2017-07-11 13:27:08.239674: osd pg remove(epoch 82; pg0.197; ) currently wait for new map
- 2017-07-11 13:28:07.287362 I | rook-ceph-mon0: 2017-07-11 13:27:57.249520 osd.1 osd.1 10.233.76.4:6800/178 310 : cluster [WRN] 28 slow requests, 2 included below; oldest blocked for > 46.611937 secs
- 2017-07-11 13:28:07.287387 I | rook-ceph-mon0: 2017-07-11 13:27:57.249525 osd.1 osd.1 10.233.76.4:6800/178 311 : cluster [WRN] slow request 30.617720 seconds old, received at 2017-07-11 13:27:26.631760: pg_notify((query:33 sent:86 0.775( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:28:07.287409 I | rook-ceph-mon0: 2017-07-11 13:27:57.249528 osd.1 osd.1 10.233.76.4:6800/178 312 : cluster [WRN] slow request 30.041037 seconds old, received at 2017-07-11 13:27:27.208443: pg_notify((query:33 sent:86 0.77d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:28:07.287422 I | rook-ceph-mon0: 2017-07-11 13:28:05.804575 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 276 : cluster [INF] osdmap e115: 6 total, 6 up, 6 in
- 2017-07-11 13:28:07.511982 I | rook-ceph-mon0: 2017-07-11 13:28:07.511903 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.4 10.233.124.4:6800/178
- 2017-07-11 13:28:08.157144 I | rook-ceph-mon0: 2017-07-11 13:28:08.157070 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e117: 6 total, 6 up, 6 in
- 2017-07-11 13:28:08.740499 I | rook-ceph-mon0: 2017-07-11 13:28:06.907330 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 278 : cluster [INF] osdmap e116: 6 total, 6 up, 6 in
- 2017-07-11 13:28:08.740520 I | rook-ceph-mon0: 2017-07-11 13:28:08.157071 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 280 : cluster [INF] osdmap e117: 6 total, 6 up, 6 in
- 2017-07-11 13:28:09.530194 I | rook-ceph-mon0: 2017-07-11 13:28:09.528675 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e118: 6 total, 6 up, 6 in
- 2017-07-11 13:28:09.925487 I | rook-ceph-mon0: 2017-07-11 13:28:09.528677 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 281 : cluster [INF] osdmap e118: 6 total, 6 up, 6 in
- 2017-07-11 13:28:10.774441 I | rook-ceph-mon0: 2017-07-11 13:28:10.772921 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e119: 6 total, 6 up, 6 in
- 2017-07-11 13:28:11.783923 I | rook-ceph-mon0: 2017-07-11 13:28:10.772923 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 282 : cluster [INF] osdmap e119: 6 total, 6 up, 6 in
- 2017-07-11 13:28:12.745498 I | rook-ceph-mon0: 2017-07-11 13:28:12.744036 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e120: 6 total, 6 up, 6 in
- 2017-07-11 13:28:12.814811 I | rook-ceph-mon0: 2017-07-11 13:28:12.803891 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.0 10.233.72.0:6800/180
- 2017-07-11 13:28:14.008058 I | rook-ceph-mon0: 2017-07-11 13:28:12.744037 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 283 : cluster [INF] osdmap e120: 6 total, 6 up, 6 in
- 2017-07-11 13:28:14.372864 I | rook-ceph-mon0: 2017-07-11 13:28:14.371324 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e121: 6 total, 6 up, 6 in
- 2017-07-11 13:28:15.255923 I | rook-ceph-mon0: 2017-07-11 13:28:14.371326 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 285 : cluster [INF] osdmap e121: 6 total, 6 up, 6 in
- 2017-07-11 13:28:15.651047 I | rook-ceph-mon0: 2017-07-11 13:28:15.650064 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e122: 6 total, 6 up, 6 in
- 2017-07-11 13:28:15.683665 I | rook-ceph-mon0: 2017-07-11 13:28:15.683596 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.2 10.233.69.0:6800/178
- 2017-07-11 13:28:16.326793 I | rook-ceph-mon0: 2017-07-11 13:28:16.326705 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.3 10.233.86.0:6800/178
- 2017-07-11 13:28:16.642234 I | rook-ceph-mon0: 2017-07-11 13:28:15.650065 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 286 : cluster [INF] osdmap e122: 6 total, 6 up, 6 in
- 2017-07-11 13:28:17.031959 I | rook-ceph-mon0: 2017-07-11 13:28:17.031561 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e123: 6 total, 6 up, 6 in
- 2017-07-11 13:28:17.241054 I | rook-ceph-mon0: 2017-07-11 13:28:17.239538 7f7c4754c700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.5 10.233.99.6:6800/179
- 2017-07-11 13:28:17.241240 I | rook-ceph-mon0: 2017-07-11 13:28:17.239568 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e124: 6 total, 6 up, 6 in
- 2017-07-11 13:28:18.116337 I | rook-ceph-mon0: 2017-07-11 13:28:17.031562 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 289 : cluster [INF] osdmap e123: 6 total, 6 up, 6 in
- 2017-07-11 13:28:18.116539 I | rook-ceph-mon0: 2017-07-11 13:28:17.239569 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 291 : cluster [INF] osdmap e124: 6 total, 6 up, 6 in
- 2017-07-11 13:28:19.655470 I | rook-ceph-mon0: 2017-07-11 13:28:19.653994 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e125: 6 total, 6 up, 6 in
- 2017-07-11 13:28:20.258966 I | rook-ceph-mon0: 2017-07-11 13:28:20.258898 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.1 10.233.76.4:6800/178
- 2017-07-11 13:28:20.259240 I | rook-ceph-mon0: 2017-07-11 13:28:20.259194 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.1 10.233.76.4:6800/178
- 2017-07-11 13:28:20.260008 I | rook-ceph-mon0: 2017-07-11 13:28:20.259955 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.1 10.233.76.4:6800/178
- 2017-07-11 13:28:20.917030 I | rook-ceph-mon0: 2017-07-11 13:28:20.915295 7f7c4754c700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.4 10.233.124.4:6800/178
- 2017-07-11 13:28:20.917133 I | rook-ceph-mon0: 2017-07-11 13:28:20.915333 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e126: 6 total, 6 up, 6 in
- 2017-07-11 13:28:21.120759 I | rook-ceph-mon0: 2017-07-11 13:28:19.653996 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 292 : cluster [INF] osdmap e125: 6 total, 6 up, 6 in
- 2017-07-11 13:28:22.287410 I | rook-ceph-mon0: 2017-07-11 13:28:20.915334 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 297 : cluster [INF] osdmap e126: 6 total, 6 up, 6 in
- 2017-07-11 13:28:24.707094 I | rook-ceph-mon0: 2017-07-11 13:28:24.707015 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:28:24.707232 I | rook-ceph-mon0: 2017-07-11 13:28:24.707162 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3447968946' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:28:35.490044 I | rook-ceph-mon0: 2017-07-11 13:28:35.490007 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:28:35.490234 I | rook-ceph-mon0: 2017-07-11 13:28:35.490149 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/59600994' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:28:45.360996 I | rook-ceph-mon0: 2017-07-11 13:28:45.360810 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4806 MB, avail 94380 MB
- 2017-07-11 13:28:46.410077 I | rook-ceph-mon0: 2017-07-11 13:28:46.408067 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.0 failed (root=default,host=master-1) (5 reporters from different host after 27.149230 >= grace 25.430099)
- 2017-07-11 13:28:46.410176 I | rook-ceph-mon0: 2017-07-11 13:28:46.408118 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.2 failed (root=default,host=master-0) (5 reporters from different host after 27.148959 >= grace 25.137665)
- 2017-07-11 13:28:46.410194 I | rook-ceph-mon0: 2017-07-11 13:28:46.408137 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.3 failed (root=default,host=master-2) (5 reporters from different host after 27.148717 >= grace 24.383721)
- 2017-07-11 13:28:46.611819 I | rook-ceph-mon0: 2017-07-11 13:28:46.611779 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e127: 6 total, 3 up, 6 in
- 2017-07-11 13:28:46.783324 I | rook-ceph-mon0: 2017-07-11 13:28:46.408075 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 300 : cluster [INF] osd.0 failed (root=default,host=master-1) (5 reporters from different host after 27.149230 >= grace 25.430099)
- 2017-07-11 13:28:46.783422 I | rook-ceph-mon0: 2017-07-11 13:28:46.408119 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 301 : cluster [INF] osd.2 failed (root=default,host=master-0) (5 reporters from different host after 27.148959 >= grace 25.137665)
- 2017-07-11 13:28:46.783440 I | rook-ceph-mon0: 2017-07-11 13:28:46.408138 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 302 : cluster [INF] osd.3 failed (root=default,host=master-2) (5 reporters from different host after 27.148717 >= grace 24.383721)
- 2017-07-11 13:28:48.125835 I | rook-ceph-mon0: 2017-07-11 13:28:46.611904 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 303 : cluster [INF] osdmap e127: 6 total, 3 up, 6 in
- 2017-07-11 13:28:48.125921 I | rook-ceph-mon0: 2017-07-11 13:28:46.811742 osd.3 osd.3 10.233.86.0:6800/178 16 : cluster [WRN] map e127 wrongly marked me down at e127
- 2017-07-11 13:28:48.346379 I | rook-ceph-mon0: 2017-07-11 13:28:48.346341 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:28:48.346672 I | rook-ceph-mon0: 2017-07-11 13:28:48.346658 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e128: 6 total, 4 up, 6 in
- 2017-07-11 13:28:48.725254 I | rook-ceph-mon0: 2017-07-11 13:28:48.725221 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e129: 6 total, 4 up, 6 in
- 2017-07-11 13:28:49.466957 I | rook-ceph-mon0: 2017-07-11 13:28:48.346465 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 304 : cluster [INF] osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:28:49.467059 I | rook-ceph-mon0: 2017-07-11 13:28:48.346713 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 305 : cluster [INF] osdmap e128: 6 total, 4 up, 6 in
- 2017-07-11 13:28:49.467095 I | rook-ceph-mon0: 2017-07-11 13:28:48.725338 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 306 : cluster [INF] osdmap e129: 6 total, 4 up, 6 in
- 2017-07-11 13:28:49.970103 I | rook-ceph-mon0: 2017-07-11 13:28:49.970070 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:28:49.970383 I | rook-ceph-mon0: 2017-07-11 13:28:49.970369 7f7c4754c700 0 log_channel(cluster) log [INF] : osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:28:49.970561 I | rook-ceph-mon0: 2017-07-11 13:28:49.970546 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e130: 6 total, 6 up, 6 in
- 2017-07-11 13:28:50.347998 I | rook-ceph-mon0: 2017-07-11 13:28:50.347965 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e131: 6 total, 6 up, 6 in
- 2017-07-11 13:28:50.742678 I | rook-ceph-mon0: 2017-07-11 13:28:46.720300 osd.2 osd.2 10.233.69.0:6800/178 16 : cluster [WRN] map e127 wrongly marked me down at e127
- 2017-07-11 13:28:50.742771 I | rook-ceph-mon0: 2017-07-11 13:28:49.970181 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 307 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:28:50.742789 I | rook-ceph-mon0: 2017-07-11 13:28:49.970424 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 308 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:28:50.742818 I | rook-ceph-mon0: 2017-07-11 13:28:49.970609 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 309 : cluster [INF] osdmap e130: 6 total, 6 up, 6 in
- 2017-07-11 13:28:50.742844 I | rook-ceph-mon0: 2017-07-11 13:28:50.348085 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 310 : cluster [INF] osdmap e131: 6 total, 6 up, 6 in
- 2017-07-11 13:28:56.522447 I | rook-ceph-mon0: 2017-07-11 13:28:46.711677 osd.0 osd.0 10.233.72.0:6800/180 52 : cluster [WRN] map e127 wrongly marked me down at e127
- 2017-07-11 13:28:57.106054 I | rook-ceph-mon0: 2017-07-11 13:28:57.106016 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:28:57.106286 I | rook-ceph-mon0: 2017-07-11 13:28:57.106245 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/383789314' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:29:05.281320 I | rook-ceph-mon0: 2017-07-11 13:29:05.281259 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.057379s > max 0.05s
- 2017-07-11 13:29:05.281641 I | rook-ceph-mon0: 2017-07-11 13:29:05.281592 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_WARN; clock skew detected on mon.rook-ceph-mon2; too many PGs per OSD (341 > max 300); Monitor clock skew detected
- 2017-07-11 13:29:05.554895 I | rook-ceph-mon0: 2017-07-11 13:29:05.281261 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 312 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.057379s > max 0.05s
- 2017-07-11 13:29:05.554999 I | rook-ceph-mon0: 2017-07-11 13:29:05.281595 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 313 : cluster [INF] HEALTH_WARN; clock skew detected on mon.rook-ceph-mon2; too many PGs per OSD (341 > max 300); Monitor clock skew detected
- 2017-07-11 13:29:07.912654 I | rook-ceph-mon0: 2017-07-11 13:29:07.912616 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:29:07.912852 I | rook-ceph-mon0: 2017-07-11 13:29:07.912766 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4001387126' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:29:09.269996 I | rook-ceph-mon0: 2017-07-11 13:29:09.269952 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.1 10.233.76.4:6800/178
- 2017-07-11 13:29:11.593245 I | rook-ceph-mon0: 2017-07-11 13:29:11.592977 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.4 10.233.124.4:6800/178
- 2017-07-11 13:29:11.593322 I | rook-ceph-mon0: 2017-07-11 13:29:11.593054 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.4 10.233.124.4:6800/178
- 2017-07-11 13:29:11.593339 I | rook-ceph-mon0: 2017-07-11 13:29:11.593135 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.4 10.233.124.4:6800/178
- 2017-07-11 13:29:13.241821 I | rook-ceph-mon0: 2017-07-11 13:29:13.241747 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.3 10.233.86.0:6800/178
- 2017-07-11 13:29:13.242053 I | rook-ceph-mon0: 2017-07-11 13:29:13.242001 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.3 10.233.86.0:6800/178
- 2017-07-11 13:29:13.825360 I | rook-ceph-mon0: 2017-07-11 13:29:13.825279 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.2 10.233.69.0:6800/178 reported failed by osd.0 10.233.72.0:6800/180
- 2017-07-11 13:29:13.825689 I | rook-ceph-mon0: 2017-07-11 13:29:13.825638 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.0 10.233.72.0:6800/180
- 2017-07-11 13:29:14.271045 I | rook-ceph-mon0: 2017-07-11 13:29:14.270972 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.1 10.233.76.4:6800/178
- 2017-07-11 13:29:14.271373 I | rook-ceph-mon0: 2017-07-11 13:29:14.271324 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.1 10.233.76.4:6800/178
- 2017-07-11 13:29:17.636855 I | rook-ceph-mon0: 2017-07-11 13:29:17.636721 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.0 10.233.72.0:6800/180 reported failed by osd.2 10.233.69.0:6800/178
- 2017-07-11 13:29:17.636951 I | rook-ceph-mon0: 2017-07-11 13:29:17.636794 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.3 10.233.86.0:6800/178 reported failed by osd.2 10.233.69.0:6800/178
- 2017-07-11 13:29:18.693461 I | rook-ceph-mon0: 2017-07-11 13:29:18.693422 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:29:18.693531 I | rook-ceph-mon0: 2017-07-11 13:29:18.693515 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3650203766' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:29:29.637798 I | rook-ceph-mon0: 2017-07-11 13:29:29.637725 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.5 10.233.99.6:6800/179 reported failed by osd.2 10.233.69.0:6800/178
- 2017-07-11 13:29:29.885790 I | rook-ceph-mon0: 2017-07-11 13:29:29.885692 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.5 10.233.99.6:6800/179 reported failed by osd.0 10.233.72.0:6800/180
- 2017-07-11 13:29:30.235041 I | rook-ceph-mon0: 2017-07-11 13:29:30.234966 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.5 10.233.99.6:6800/179 reported failed by osd.3 10.233.86.0:6800/178
- 2017-07-11 13:29:32.275854 I | rook-ceph-mon0: 2017-07-11 13:29:32.275778 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.5 10.233.99.6:6800/179 reported failed by osd.1 10.233.76.4:6800/178
- 2017-07-11 13:29:35.283070 I | rook-ceph-mon0: 2017-07-11 13:29:35.282977 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0567242s > max 0.05s
- 2017-07-11 13:29:35.571616 I | rook-ceph-mon0: 2017-07-11 13:29:35.282978 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 332 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0567242s > max 0.05s
- 2017-07-11 13:29:36.442541 I | rook-ceph-mon0: 2017-07-11 13:29:36.441475 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.5 failed (root=default,host=minion-1) (4 reporters from different host after 24.165733 >= grace 22.318605)
- 2017-07-11 13:29:36.551589 I | rook-ceph-mon0: 2017-07-11 13:29:36.551522 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e132: 6 total, 5 up, 6 in
- 2017-07-11 13:29:36.783387 I | rook-ceph-mon0: 2017-07-11 13:29:36.441482 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 333 : cluster [INF] osd.5 failed (root=default,host=minion-1) (4 reporters from different host after 24.165733 >= grace 22.318605)
- 2017-07-11 13:29:36.783615 I | rook-ceph-mon0: 2017-07-11 13:29:36.551524 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 334 : cluster [INF] osdmap e132: 6 total, 5 up, 6 in
- 2017-07-11 13:29:39.242455 I | rook-ceph-mon0: 2017-07-11 13:29:39.242372 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.4 10.233.124.4:6800/178 reported failed by osd.3 10.233.86.0:6800/178
- 2017-07-11 13:29:39.902915 I | rook-ceph-mon0: 2017-07-11 13:29:39.902836 7f7c4bd55700 0 log_channel(cluster) log [DBG] : osd.4 10.233.124.4:6800/178 reported failed by osd.0 10.233.72.0:6800/180
- 2017-07-11 13:29:41.457521 I | rook-ceph-mon0: 2017-07-11 13:29:41.457264 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.0 failed (root=default,host=master-1) (4 reporters from different host after 26.826850 >= grace 25.513242)
- 2017-07-11 13:29:41.457624 I | rook-ceph-mon0: 2017-07-11 13:29:41.457310 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.2 failed (root=default,host=master-0) (4 reporters from different host after 27.632048 >= grace 25.128155)
- 2017-07-11 13:29:41.457659 I | rook-ceph-mon0: 2017-07-11 13:29:41.457326 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.3 failed (root=default,host=master-2) (4 reporters from different host after 26.826716 >= grace 24.377216)
- 2017-07-11 13:29:41.695212 I | rook-ceph-mon0: 2017-07-11 13:29:41.695149 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e133: 6 total, 2 up, 6 in
- 2017-07-11 13:29:42.106429 I | rook-ceph-mon0: 2017-07-11 13:29:41.457270 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 337 : cluster [INF] osd.0 failed (root=default,host=master-1) (4 reporters from different host after 26.826850 >= grace 25.513242)
- 2017-07-11 13:29:42.106448 I | rook-ceph-mon0: 2017-07-11 13:29:41.457311 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 338 : cluster [INF] osd.2 failed (root=default,host=master-0) (4 reporters from different host after 27.632048 >= grace 25.128155)
- 2017-07-11 13:29:42.106454 I | rook-ceph-mon0: 2017-07-11 13:29:41.457327 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 339 : cluster [INF] osd.3 failed (root=default,host=master-2) (4 reporters from different host after 26.826716 >= grace 24.377216)
- 2017-07-11 13:29:42.106458 I | rook-ceph-mon0: 2017-07-11 13:29:41.695300 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 340 : cluster [INF] osdmap e133: 6 total, 2 up, 6 in
- 2017-07-11 13:29:45.361298 I | rook-ceph-mon0: 2017-07-11 13:29:45.361235 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4806 MB, avail 94380 MB
- 2017-07-11 13:29:46.507949 I | rook-ceph-mon0: 2017-07-11 13:29:46.507890 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.4 failed (root=default,host=minion-2) (2 reporters from different host after 26.605152 >= grace 24.528981)
- 2017-07-11 13:29:46.835345 I | rook-ceph-mon0: 2017-07-11 13:29:46.835296 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e134: 6 total, 1 up, 6 in
- 2017-07-11 13:29:47.041767 I | rook-ceph-mon0: 2017-07-11 13:29:41.780816 osd.0 osd.0 10.233.72.0:6800/180 53 : cluster [WRN] map e133 wrongly marked me down at e133
- 2017-07-11 13:29:47.041855 I | rook-ceph-mon0: 2017-07-11 13:29:46.508018 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 341 : cluster [INF] osd.4 failed (root=default,host=minion-2) (2 reporters from different host after 26.605152 >= grace 24.528981)
- 2017-07-11 13:29:47.041874 I | rook-ceph-mon0: 2017-07-11 13:29:46.835426 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 342 : cluster [INF] osdmap e134: 6 total, 1 up, 6 in
- 2017-07-11 13:29:48.297388 I | rook-ceph-mon0: 2017-07-11 13:29:41.699497 osd.3 osd.3 10.233.86.0:6800/178 17 : cluster [WRN] map e133 wrongly marked me down at e133
- 2017-07-11 13:29:49.786697 I | rook-ceph-mon0: 2017-07-11 13:29:41.877104 osd.2 osd.2 10.233.69.0:6800/178 17 : cluster [WRN] map e133 wrongly marked me down at e133
- 2017-07-11 13:29:51.757492 I | rook-ceph-mon0: 2017-07-11 13:29:51.757443 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e135: 6 total, 1 up, 6 in
- 2017-07-11 13:29:52.876434 I | rook-ceph-mon0: 2017-07-11 13:29:51.757576 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 343 : cluster [INF] osdmap e135: 6 total, 1 up, 6 in
- 2017-07-11 13:30:05.281909 I | rook-ceph-mon0: 2017-07-11 13:30:05.281799 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_WARN; clock skew detected on mon.rook-ceph-mon2; 5 hosts (5 osds) down; 5 osds down; 1696 pgs stale; too many PGs per OSD (341 > max 300); Monitor clock skew detected
- 2017-07-11 13:30:05.525492 I | rook-ceph-mon0: 2017-07-11 13:30:05.281807 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 344 : cluster [INF] HEALTH_WARN; clock skew detected on mon.rook-ceph-mon2; 5 hosts (5 osds) down; 5 osds down; 1696 pgs stale; too many PGs per OSD (341 > max 300); Monitor clock skew detected
- 2017-07-11 13:30:34.440475 I | rook-ceph-mon0: 2017-07-11 13:30:34.440437 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:30:34.440667 I | rook-ceph-mon0: 2017-07-11 13:30:34.440580 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3305635734' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:30:45.364588 I | rook-ceph-mon0: 2017-07-11 13:30:45.364525 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4806 MB, avail 94380 MB
- 2017-07-11 13:30:49.329070 I | rook-ceph-mon0: 2017-07-11 13:30:48.081252 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 32 : cluster [WRN] message from mon.0 was stamped 0.051486s in the future, clocks not synchronized
- 2017-07-11 13:31:05.282081 I | rook-ceph-mon0: 2017-07-11 13:31:05.281991 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_WARN; 5 hosts (5 osds) down; 5 osds down; 1696 pgs stale; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:31:05.490741 I | rook-ceph-mon0: 2017-07-11 13:31:05.281997 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 346 : cluster [INF] HEALTH_WARN; 5 hosts (5 osds) down; 5 osds down; 1696 pgs stale; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:31:17.607144 I | rook-ceph-mon0: 2017-07-11 13:31:17.607104 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:31:17.607366 I | rook-ceph-mon0: 2017-07-11 13:31:17.607261 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3395898594' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:31:45.365433 I | rook-ceph-mon0: 2017-07-11 13:31:45.365268 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4806 MB, avail 94380 MB
- 2017-07-11 13:32:01.462874 I | rook-ceph-mon0: 2017-07-11 13:32:01.462828 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:32:01.463088 I | rook-ceph-mon0: 2017-07-11 13:32:01.462984 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/431372942' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:32:23.083667 I | rook-ceph-mon0: 2017-07-11 13:32:23.083628 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:32:23.083736 I | rook-ceph-mon0: 2017-07-11 13:32:23.083721 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4188070488' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:32:33.912873 I | rook-ceph-mon0: 2017-07-11 13:32:33.912832 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:32:33.913121 I | rook-ceph-mon0: 2017-07-11 13:32:33.913105 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4274355419' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:32:45.528076 I | rook-ceph-mon0: 2017-07-11 13:32:45.527956 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4806 MB, avail 94380 MB
- 2017-07-11 13:32:55.676492 I | rook-ceph-mon0: 2017-07-11 13:32:55.676452 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:32:55.676707 I | rook-ceph-mon0: 2017-07-11 13:32:55.676604 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1284693869' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:32:56.886705 I | rook-ceph-mon0: 2017-07-11 13:32:56.886666 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #9. Immutable memtables: 0.
- 2017-07-11 13:32:56.886790 I | rook-ceph-mon0:
- 2017-07-11 13:32:56.887021 I | rook-ceph-mon0: 2017-07-11 13:32:56.886999 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 3] Syncing log #6
- 2017-07-11 13:32:56.933895 I | rook-ceph-mon0: 2017-07-11 13:32:56.933855 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:32:56.886977) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:32:56.934001 I | rook-ceph-mon0: 2017-07-11 13:32:56.933985 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 3] Flushing memtable with next log file: 9
- 2017-07-11 13:32:56.934019 I | rook-ceph-mon0:
- 2017-07-11 13:32:56.934083 I | rook-ceph-mon0: 2017-07-11 13:32:56.934067 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779976934062, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 4654, "num_deletes": 259, "memory_usage": 16415560}
- 2017-07-11 13:32:56.934130 I | rook-ceph-mon0: 2017-07-11 13:32:56.934102 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 3] Level-0 flush table #10: started
- 2017-07-11 13:32:57.092989 I | rook-ceph-mon0: 2017-07-11 13:32:57.092941 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977092932, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 10, "file_size": 13526011, "table_properties": {"data_size": 13496319, "index_size": 28872, "filter_size": 0, "raw_key_size": 28639, "raw_average_key_size": 18, "raw_value_size": 13454665, "raw_average_value_size": 8542, "num_data_blocks": 922, "num_entries": 1575, "filter_policy_name": "", "kDeletedKeys": "259", "kMergeOperands": "0"}}
- 2017-07-11 13:32:57.093082 I | rook-ceph-mon0: 2017-07-11 13:32:57.093064 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 3] Level-0 flush table #10: 13526011 bytes OK
- 2017-07-11 13:32:57.135828 I | rook-ceph-mon0: 2017-07-11 13:32:57.135783 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.118712) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #10 started
- 2017-07-11 13:32:57.135930 I | rook-ceph-mon0: 2017-07-11 13:32:57.135914 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.135718) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #10: memtable #1 done
- 2017-07-11 13:32:57.135982 I | rook-ceph-mon0: 2017-07-11 13:32:57.135949 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.135742) EVENT_LOG_v1 {"time_micros": 1499779977135735, "job": 3, "event": "flush_finished", "lsm_state": [2, 0, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:32:57.136014 I | rook-ceph-mon0: 2017-07-11 13:32:57.136000 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.135759) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[2 0 0 0 0 0 0] max score 0.50
- 2017-07-11 13:32:57.136029 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.136077 I | rook-ceph-mon0: 2017-07-11 13:32:57.136064 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 3] Try to delete WAL files size 16292769, prev total WAL file size 16297078, number of live WAL files 2.
- 2017-07-11 13:32:57.136092 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.141580 I | rook-ceph-mon0: 2017-07-11 13:32:57.138220 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:32:57.141907 I | rook-ceph-mon0: 2017-07-11 13:32:57.141885 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 13:32:57.141977 I | rook-ceph-mon0: 2017-07-11 13:32:57.141946 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 13:32:57.142001 I | rook-ceph-mon0: ** DB Stats **
- 2017-07-11 13:32:57.142032 I | rook-ceph-mon0: Uptime(secs): 552.0 total, 552.0 interval
- 2017-07-11 13:32:57.142046 I | rook-ceph-mon0: Cumulative writes: 1291 writes, 4657 keys, 1291 commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.03 MB/s
- 2017-07-11 13:32:57.142057 I | rook-ceph-mon0: Cumulative WAL: 1291 writes, 1291 syncs, 1.00 writes per sync, written: 0.02 GB, 0.03 MB/s
- 2017-07-11 13:32:57.142068 I | rook-ceph-mon0: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:32:57.142080 I | rook-ceph-mon0: Interval writes: 1291 writes, 4657 keys, 1291 commit groups, 1.0 writes per commit group, ingest: 15.54 MB, 0.03 MB/s
- 2017-07-11 13:32:57.142107 I | rook-ceph-mon0: Interval WAL: 1291 writes, 1291 syncs, 1.00 writes per sync, written: 0.02 MB, 0.03 MB/s
- 2017-07-11 13:32:57.142118 I | rook-ceph-mon0: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:32:57.142129 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.142140 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 13:32:57.142152 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:32:57.142175 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:32:57.142189 I | rook-ceph-mon0: L0 2/2 12.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.7 0 2 0.101 0 0
- 2017-07-11 13:32:57.142201 I | rook-ceph-mon0: Sum 2/2 12.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.7 0 2 0.101 0 0
- 2017-07-11 13:32:57.142213 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.7 0 2 0.101 0 0
- 2017-07-11 13:32:57.142224 I | rook-ceph-mon0: Uptime(secs): 552.0 total, 552.0 interval
- 2017-07-11 13:32:57.142235 I | rook-ceph-mon0: Flush(GB): cumulative 0.013, interval 0.013
- 2017-07-11 13:32:57.142258 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:32:57.142270 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:32:57.142281 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:32:57.142292 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:32:57.142303 I | rook-ceph-mon0: Cumulative compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.2 seconds
- 2017-07-11 13:32:57.142314 I | rook-ceph-mon0: Interval compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.2 seconds
- 2017-07-11 13:32:57.142338 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:32:57.142350 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.142363 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:32:57.142374 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.142385 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 13:32:57.142396 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:32:57.142426 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:32:57.142439 I | rook-ceph-mon0: L0 2/2 12.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.7 0 2 0.101 0 0
- 2017-07-11 13:32:57.142450 I | rook-ceph-mon0: Sum 2/2 12.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.7 0 2 0.101 0 0
- 2017-07-11 13:32:57.142461 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 13:32:57.142472 I | rook-ceph-mon0: Uptime(secs): 552.0 total, 552.0 interval
- 2017-07-11 13:32:57.142498 I | rook-ceph-mon0: Flush(GB): cumulative 0.013, interval 0.000
- 2017-07-11 13:32:57.142510 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:32:57.142522 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:32:57.142533 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:32:57.142544 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:32:57.142567 I | rook-ceph-mon0: Cumulative compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.2 seconds
- 2017-07-11 13:32:57.142581 I | rook-ceph-mon0: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 13:32:57.142593 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:32:57.142604 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.142615 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:32:57.142626 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.142680 I | rook-ceph-mon0: 2017-07-11 13:32:57.142664 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.142655) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:32:57.142695 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.142741 I | rook-ceph-mon0: 2017-07-11 13:32:57.142724 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 4] Compacting 2@0 files to L1, score -1.00
- 2017-07-11 13:32:57.142771 I | rook-ceph-mon0: 2017-07-11 13:32:57.142759 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 3 Base level 0, inputs: [10(12MB) 4(1504B)]
- 2017-07-11 13:32:57.142783 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.142835 I | rook-ceph-mon0: 2017-07-11 13:32:57.142823 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977142813, "job": 4, "event": "compaction_started", "files_L0": [10, 4], "score": -1, "input_data_size": 13527515}
- 2017-07-11 13:32:57.324579 I | rook-ceph-mon0: 2017-07-11 13:32:57.324525 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 4] Generated table #11: 1318 keys, 13522687 bytes
- 2017-07-11 13:32:57.324764 I | rook-ceph-mon0: 2017-07-11 13:32:57.324683 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977324673, "cf_name": "default", "job": 4, "event": "table_file_creation", "file_number": 11, "file_size": 13522687, "table_properties": {"data_size": 13493001, "index_size": 28867, "filter_size": 0, "raw_key_size": 23809, "raw_average_key_size": 18, "raw_value_size": 13454723, "raw_average_value_size": 10208, "num_data_blocks": 922, "num_entries": 1318, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:32:57.387387 I | rook-ceph-mon0: 2017-07-11 13:32:57.387336 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 4] Compacted 2@0 files to L1 => 13522687 bytes
- 2017-07-11 13:32:57.453534 I | rook-ceph-mon0: 2017-07-11 13:32:57.453483 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.453392) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 55.3 rd, 55.3 wr, level 1, files in(2, 0) out(1) MB in(12.9, 0.0) out(12.9), read-write-amplify(2.0) write-amplify(1.0) OK, records in: 1580, records dropped: 262
- 2017-07-11 13:32:57.453620 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.453658 I | rook-ceph-mon0: 2017-07-11 13:32:57.453640 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.453420) EVENT_LOG_v1 {"time_micros": 1499779977453409, "job": 4, "event": "compaction_finished", "compaction_time_micros": 244461, "output_level": 1, "num_output_files": 1, "total_output_size": 13522687, "num_input_records": 1580, "num_output_records": 1318, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:32:57.455344 I | rook-ceph-mon0: 2017-07-11 13:32:57.455327 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977455324, "job": 4, "event": "table_file_deletion", "file_number": 10}
- 2017-07-11 13:32:57.455494 I | rook-ceph-mon0: 2017-07-11 13:32:57.455478 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977455439, "job": 4, "event": "table_file_deletion", "file_number": 4}
- 2017-07-11 13:32:57.455835 I | rook-ceph-mon0: 2017-07-11 13:32:57.455754 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #12. Immutable memtables: 0.
- 2017-07-11 13:32:57.455880 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.455897 I | rook-ceph-mon0: 2017-07-11 13:32:57.455792 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 5] Syncing log #9
- 2017-07-11 13:32:57.482639 I | rook-ceph-mon0: 2017-07-11 13:32:57.482310 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.455787) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:32:57.482716 I | rook-ceph-mon0: 2017-07-11 13:32:57.482328 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 5] Flushing memtable with next log file: 12
- 2017-07-11 13:32:57.482733 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.482746 I | rook-ceph-mon0: 2017-07-11 13:32:57.482341 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977482335, "job": 5, "event": "flush_started", "num_memtables": 1, "num_entries": 6, "num_deletes": 0, "memory_usage": 10760}
- 2017-07-11 13:32:57.482757 I | rook-ceph-mon0: 2017-07-11 13:32:57.482345 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 5] Level-0 flush table #13: started
- 2017-07-11 13:32:57.518833 I | rook-ceph-mon0: 2017-07-11 13:32:57.518756 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977518746, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 13, "file_size": 9452, "table_properties": {"data_size": 8563, "index_size": 81, "filter_size": 0, "raw_key_size": 141, "raw_average_key_size": 23, "raw_value_size": 8383, "raw_average_value_size": 1397, "num_data_blocks": 3, "num_entries": 6, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:32:57.518912 I | rook-ceph-mon0: 2017-07-11 13:32:57.518767 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 5] Level-0 flush table #13: 9452 bytes OK
- 2017-07-11 13:32:57.563629 I | rook-ceph-mon0: 2017-07-11 13:32:57.563457 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.546202) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #13 started
- 2017-07-11 13:32:57.563749 I | rook-ceph-mon0: 2017-07-11 13:32:57.563467 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.563400) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #13: memtable #1 done
- 2017-07-11 13:32:57.563937 I | rook-ceph-mon0: 2017-07-11 13:32:57.563469 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.563423) EVENT_LOG_v1 {"time_micros": 1499779977563417, "job": 5, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:32:57.563977 I | rook-ceph-mon0: 2017-07-11 13:32:57.563470 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.563440) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:32:57.563992 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.564005 I | rook-ceph-mon0: 2017-07-11 13:32:57.563477 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 5] Try to delete WAL files size 8520, prev total WAL file size 8520, number of live WAL files 2.
- 2017-07-11 13:32:57.564017 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.564030 I | rook-ceph-mon0: 2017-07-11 13:32:57.563715 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:32:57.564093 I | rook-ceph-mon0: 2017-07-11 13:32:57.564076 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.564069) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:32:57.564108 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.564156 I | rook-ceph-mon0: 2017-07-11 13:32:57.564141 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 6] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:32:57.564186 I | rook-ceph-mon0: 2017-07-11 13:32:57.564174 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 5 Base level 0, inputs: [13(9452B)], [11(12MB)]
- 2017-07-11 13:32:57.564214 I | rook-ceph-mon0:
- 2017-07-11 13:32:57.564282 I | rook-ceph-mon0: 2017-07-11 13:32:57.564240 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977564230, "job": 6, "event": "compaction_started", "files_L0": [13], "files_L1": [11], "score": -1, "input_data_size": 13532139}
- 2017-07-11 13:32:58.368387 I | rook-ceph-mon0: 2017-07-11 13:32:58.368335 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 6] Generated table #14: 1320 keys, 13531170 bytes
- 2017-07-11 13:32:58.368576 I | rook-ceph-mon0: 2017-07-11 13:32:58.368492 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779978368481, "cf_name": "default", "job": 6, "event": "table_file_creation", "file_number": 14, "file_size": 13531170, "table_properties": {"data_size": 13501422, "index_size": 28929, "filter_size": 0, "raw_key_size": 23845, "raw_average_key_size": 18, "raw_value_size": 13463074, "raw_average_value_size": 10199, "num_data_blocks": 924, "num_entries": 1320, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:32:58.399512 I | rook-ceph-mon0: 2017-07-11 13:32:58.399463 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 6] Compacted 1@0 + 1@1 files to L1 => 13531170 bytes
- 2017-07-11 13:32:58.416854 I | rook-ceph-mon0: 2017-07-11 13:32:58.416823 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:32:58.416754) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 16.2 rd, 16.2 wr, level 1, files in(1, 1) out(1) MB in(0.0, 12.9) out(12.9), read-write-amplify(2863.2) write-amplify(1431.6) OK, records in: 1324, records dropped: 4
- 2017-07-11 13:32:58.416912 I | rook-ceph-mon0:
- 2017-07-11 13:32:58.416948 I | rook-ceph-mon0: 2017-07-11 13:32:58.416931 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:32:58.416777) EVENT_LOG_v1 {"time_micros": 1499779978416766, "job": 6, "event": "compaction_finished", "compaction_time_micros": 835140, "output_level": 1, "num_output_files": 1, "total_output_size": 13531170, "num_input_records": 1324, "num_output_records": 1320, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:32:58.417228 I | rook-ceph-mon0: 2017-07-11 13:32:58.417212 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779978417209, "job": 6, "event": "table_file_deletion", "file_number": 13}
- 2017-07-11 13:32:58.418912 I | rook-ceph-mon0: 2017-07-11 13:32:58.418897 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779978418895, "job": 6, "event": "table_file_deletion", "file_number": 11}
- 2017-07-11 13:33:06.417512 I | rook-ceph-mon0: 2017-07-11 13:33:06.417473 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:33:06.417579 I | rook-ceph-mon0: 2017-07-11 13:33:06.417564 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1742075595' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:33:28.002217 I | rook-ceph-mon0: 2017-07-11 13:33:28.002179 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:33:28.002477 I | rook-ceph-mon0: 2017-07-11 13:33:28.002457 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1548235316' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:33:45.528237 I | rook-ceph-mon0: 2017-07-11 13:33:45.528171 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4819 MB, avail 94367 MB
- 2017-07-11 13:34:22.358274 I | rook-ceph-mon0: 2017-07-11 13:34:22.358224 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:34:22.358509 I | rook-ceph-mon0: 2017-07-11 13:34:22.358391 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1964125903' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:34:33.140275 I | rook-ceph-mon0: 2017-07-11 13:34:33.140237 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:34:33.140509 I | rook-ceph-mon0: 2017-07-11 13:34:33.140394 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/366386953' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:34:43.936884 I | rook-ceph-mon0: 2017-07-11 13:34:43.936845 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:34:43.936950 I | rook-ceph-mon0: 2017-07-11 13:34:43.936935 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2502484550' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:34:45.531692 I | rook-ceph-mon0: 2017-07-11 13:34:45.531503 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4819 MB, avail 94367 MB
- 2017-07-11 13:34:54.964607 I | rook-ceph-mon0: 2017-07-11 13:34:54.964554 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:34:54.964831 I | rook-ceph-mon0: 2017-07-11 13:34:54.964800 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/466921409' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:35:05.283353 I | rook-ceph-mon0: 2017-07-11 13:35:05.283257 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_ERR; 5 hosts (5 osds) down; 5 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:35:05.787399 I | rook-ceph-mon0: 2017-07-11 13:35:05.787360 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:35:05.787613 I | rook-ceph-mon0: 2017-07-11 13:35:05.787578 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2658319461' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:35:06.207868 I | rook-ceph-mon0: 2017-07-11 13:35:05.283265 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 358 : cluster [INF] HEALTH_ERR; 5 hosts (5 osds) down; 5 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:35:27.431881 I | rook-ceph-mon0: 2017-07-11 13:35:27.431840 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:35:27.432120 I | rook-ceph-mon0: 2017-07-11 13:35:27.432079 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3739263249' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:35:45.532000 I | rook-ceph-mon0: 2017-07-11 13:35:45.531834 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4820 MB, avail 94367 MB
- 2017-07-11 13:36:05.365877 I | rook-ceph-mon0: 2017-07-11 13:36:05.365799 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0732848s > max 0.05s
- 2017-07-11 13:36:06.372619 I | rook-ceph-mon0: 2017-07-11 13:36:05.365801 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 361 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0732848s > max 0.05s
- 2017-07-11 13:36:10.999326 I | rook-ceph-mon0: 2017-07-11 13:36:10.999290 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:36:10.999507 I | rook-ceph-mon0: 2017-07-11 13:36:10.999426 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1642801349' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:36:21.868246 I | rook-ceph-mon0: 2017-07-11 13:36:21.868209 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:36:21.868466 I | rook-ceph-mon0: 2017-07-11 13:36:21.868434 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3016384792' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:36:32.607492 I | rook-ceph-mon0: 2017-07-11 13:36:32.607451 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:36:32.607708 I | rook-ceph-mon0: 2017-07-11 13:36:32.607611 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/959007867' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:36:43.497248 I | rook-ceph-mon0: 2017-07-11 13:36:43.497145 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:36:43.497418 I | rook-ceph-mon0: 2017-07-11 13:36:43.497167 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2970688965' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:36:45.532506 I | rook-ceph-mon0: 2017-07-11 13:36:45.532227 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4820 MB, avail 94367 MB
- 2017-07-11 13:36:54.477582 I | rook-ceph-mon0: 2017-07-11 13:36:54.477525 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:36:54.477663 I | rook-ceph-mon0: 2017-07-11 13:36:54.477648 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/661228871' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:37:05.268854 I | rook-ceph-mon0: 2017-07-11 13:37:05.268816 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:37:05.269088 I | rook-ceph-mon0: 2017-07-11 13:37:05.269051 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1396627244' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:37:05.429842 I | rook-ceph-mon0: 2017-07-11 13:37:05.429808 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0727043s > max 0.05s
- 2017-07-11 13:37:06.702968 I | rook-ceph-mon0: 2017-07-11 13:37:05.429926 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 368 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0727043s > max 0.05s
- 2017-07-11 13:37:35.457112 I | rook-ceph-mon0: 2017-07-11 13:37:35.457038 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0729757s > max 0.05s
- 2017-07-11 13:37:35.761993 I | rook-ceph-mon0: 2017-07-11 13:37:35.457039 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 369 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0729757s > max 0.05s
- 2017-07-11 13:37:37.613051 I | rook-ceph-mon0: 2017-07-11 13:37:37.612966 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:37:37.613070 I | rook-ceph-mon0: 2017-07-11 13:37:37.612987 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2875150255' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:37:45.532609 I | rook-ceph-mon0: 2017-07-11 13:37:45.532446 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4820 MB, avail 94367 MB
- 2017-07-11 13:37:48.487510 I | rook-ceph-mon0: 2017-07-11 13:37:48.487453 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:37:48.487730 I | rook-ceph-mon0: 2017-07-11 13:37:48.487614 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/280447374' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:37:59.349358 I | rook-ceph-mon0: 2017-07-11 13:37:59.349317 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:37:59.349586 I | rook-ceph-mon0: 2017-07-11 13:37:59.349568 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1948523541' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:37:59.811378 I | rook-ceph-mon0: 2017-07-11 13:37:59.809636 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #15. Immutable memtables: 0.
- 2017-07-11 13:37:59.811468 I | rook-ceph-mon0:
- 2017-07-11 13:37:59.811508 I | rook-ceph-mon0: 2017-07-11 13:37:59.811307 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 7] Syncing log #12
- 2017-07-11 13:37:59.837479 I | rook-ceph-mon0: 2017-07-11 13:37:59.834780 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:37:59.811300) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:37:59.837559 I | rook-ceph-mon0: 2017-07-11 13:37:59.834796 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 7] Flushing memtable with next log file: 15
- 2017-07-11 13:37:59.837576 I | rook-ceph-mon0:
- 2017-07-11 13:37:59.837609 I | rook-ceph-mon0: 2017-07-11 13:37:59.834809 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780279834803, "job": 7, "event": "flush_started", "num_memtables": 1, "num_entries": 1404, "num_deletes": 251, "memory_usage": 2516672}
- 2017-07-11 13:37:59.837623 I | rook-ceph-mon0: 2017-07-11 13:37:59.834812 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 7] Level-0 flush table #16: started
- 2017-07-11 13:37:59.896493 I | rook-ceph-mon0: 2017-07-11 13:37:59.883288 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780279883279, "cf_name": "default", "job": 7, "event": "table_file_creation", "file_number": 16, "file_size": 2482014, "table_properties": {"data_size": 2470167, "index_size": 11029, "filter_size": 0, "raw_key_size": 11435, "raw_average_key_size": 17, "raw_value_size": 2453634, "raw_average_value_size": 3763, "num_data_blocks": 365, "num_entries": 652, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:37:59.913463 I | rook-ceph-mon0: 2017-07-11 13:37:59.905555 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 7] Level-0 flush table #16: 2482014 bytes OK
- 2017-07-11 13:37:59.980953 I | rook-ceph-mon0: 2017-07-11 13:37:59.967428 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:37:59.933436) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #16 started
- 2017-07-11 13:37:59.981007 I | rook-ceph-mon0: 2017-07-11 13:37:59.980985 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:37:59.967372) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #16: memtable #1 done
- 2017-07-11 13:37:59.981028 I | rook-ceph-mon0: 2017-07-11 13:37:59.981014 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:37:59.967395) EVENT_LOG_v1 {"time_micros": 1499780279967389, "job": 7, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:37:59.981631 I | rook-ceph-mon0: 2017-07-11 13:37:59.981609 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:37:59.967412) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:37:59.981640 I | rook-ceph-mon0:
- 2017-07-11 13:37:59.981670 I | rook-ceph-mon0: 2017-07-11 13:37:59.981656 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 7] Try to delete WAL files size 2488151, prev total WAL file size 2488151, number of live WAL files 2.
- 2017-07-11 13:37:59.981680 I | rook-ceph-mon0:
- 2017-07-11 13:37:59.995289 I | rook-ceph-mon0: 2017-07-11 13:37:59.982146 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:37:59.995324 I | rook-ceph-mon0: 2017-07-11 13:37:59.982189 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:37:59.982184) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 13:37:59.995328 I | rook-ceph-mon0:
- 2017-07-11 13:37:59.995332 I | rook-ceph-mon0: 2017-07-11 13:37:59.982195 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 8] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:37:59.995335 I | rook-ceph-mon0: 2017-07-11 13:37:59.982201 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 7 Base level 0, inputs: [16(2423KB)], [14(12MB)]
- 2017-07-11 13:37:59.995337 I | rook-ceph-mon0:
- 2017-07-11 13:37:59.995340 I | rook-ceph-mon0: 2017-07-11 13:37:59.982214 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780279982205, "job": 8, "event": "compaction_started", "files_L0": [16], "files_L1": [14], "score": -1, "input_data_size": 16013184}
- 2017-07-11 13:38:00.188763 I | rook-ceph-mon0: 2017-07-11 13:38:00.188710 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 8] Generated table #17: 1463 keys, 11099111 bytes
- 2017-07-11 13:38:00.188971 I | rook-ceph-mon0: 2017-07-11 13:38:00.188865 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780280188855, "cf_name": "default", "job": 8, "event": "table_file_creation", "file_number": 17, "file_size": 11099111, "table_properties": {"data_size": 11065010, "index_size": 33282, "filter_size": 0, "raw_key_size": 26777, "raw_average_key_size": 18, "raw_value_size": 11021574, "raw_average_value_size": 7533, "num_data_blocks": 1059, "num_entries": 1463, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:38:00.229071 I | rook-ceph-mon0: 2017-07-11 13:38:00.228979 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 8] Compacted 1@0 + 1@1 files to L1 => 11099111 bytes
- 2017-07-11 13:38:00.245197 I | rook-ceph-mon0: 2017-07-11 13:38:00.245118 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.245034) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 64.9 rd, 45.0 wr, level 1, files in(1, 1) out(1) MB in(2.4, 12.9) out(10.6), read-write-amplify(10.9) write-amplify(4.5) OK, records in: 1972, records dropped: 509
- 2017-07-11 13:38:00.245268 I | rook-ceph-mon0:
- 2017-07-11 13:38:00.245320 I | rook-ceph-mon0: 2017-07-11 13:38:00.245301 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.245060) EVENT_LOG_v1 {"time_micros": 1499780280245051, "job": 8, "event": "compaction_finished", "compaction_time_micros": 246740, "output_level": 1, "num_output_files": 1, "total_output_size": 11099111, "num_input_records": 1972, "num_output_records": 1463, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:38:00.245934 I | rook-ceph-mon0: 2017-07-11 13:38:00.245919 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780280245915, "job": 8, "event": "table_file_deletion", "file_number": 16}
- 2017-07-11 13:38:00.247545 I | rook-ceph-mon0: 2017-07-11 13:38:00.247530 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780280247527, "job": 8, "event": "table_file_deletion", "file_number": 14}
- 2017-07-11 13:38:05.284063 I | rook-ceph-mon0: 2017-07-11 13:38:05.284008 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_ERR; clock skew detected on mon.rook-ceph-mon2; 5 hosts (5 osds) down; 5 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (341 > max 300); Monitor clock skew detected
- 2017-07-11 13:38:05.436421 I | rook-ceph-mon0: 2017-07-11 13:38:05.284151 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 373 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon2; 5 hosts (5 osds) down; 5 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (341 > max 300); Monitor clock skew detected
- 2017-07-11 13:38:35.465493 I | rook-ceph-mon0: 2017-07-11 13:38:35.465412 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0726208s > max 0.05s
- 2017-07-11 13:38:35.623436 I | rook-ceph-mon0: 2017-07-11 13:38:35.465413 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 374 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0726208s > max 0.05s
- 2017-07-11 13:38:42.094996 I | rook-ceph-mon0: 2017-07-11 13:38:42.094920 7f7c4bd55700 0 log_channel(cluster) log [WRN] : message from mon.1 was stamped 0.050966s in the future, clocks not synchronized
- 2017-07-11 13:38:43.000595 I | rook-ceph-mon0: 2017-07-11 13:38:43.000558 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:38:43.000845 I | rook-ceph-mon0: 2017-07-11 13:38:43.000828 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/722894578' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:38:43.272096 I | rook-ceph-mon0: 2017-07-11 13:38:42.094921 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 375 : cluster [WRN] message from mon.1 was stamped 0.050966s in the future, clocks not synchronized
- 2017-07-11 13:38:45.533232 I | rook-ceph-mon0: 2017-07-11 13:38:45.533066 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:38:48.471674 I | rook-ceph-mon0: 2017-07-11 13:38:48.471604 7f7c4bd55700 0 log_channel(cluster) log [WRN] : message from mon.1 was stamped 0.052154s in the future, clocks not synchronized
- 2017-07-11 13:38:49.282142 I | rook-ceph-mon0: 2017-07-11 13:38:48.471605 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 377 : cluster [WRN] message from mon.1 was stamped 0.052154s in the future, clocks not synchronized
- 2017-07-11 13:39:15.535818 I | rook-ceph-mon0: 2017-07-11 13:39:15.535780 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:39:15.536040 I | rook-ceph-mon0: 2017-07-11 13:39:15.536008 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1808698860' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:39:18.303127 I | rook-ceph-mon0: 2017-07-11 13:39:18.303059 7f7c4bd55700 0 log_channel(cluster) log [WRN] : message from mon.1 was stamped 0.054269s in the future, clocks not synchronized
- 2017-07-11 13:39:19.528182 I | rook-ceph-mon0: 2017-07-11 13:39:18.303060 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 379 : cluster [WRN] message from mon.1 was stamped 0.054269s in the future, clocks not synchronized
- 2017-07-11 13:39:36.776726 I | rook-ceph-mon0: 2017-07-11 13:39:36.776463 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.5 out (down for 600.225244)
- 2017-07-11 13:39:36.929149 I | rook-ceph-mon0: 2017-07-11 13:39:36.927600 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e136: 6 total, 1 up, 5 in
- 2017-07-11 13:39:37.836609 I | rook-ceph-mon0: 2017-07-11 13:39:36.776470 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 380 : cluster [INF] osd.5 out (down for 600.225244)
- 2017-07-11 13:39:37.836887 I | rook-ceph-mon0: 2017-07-11 13:39:36.927602 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 381 : cluster [INF] osdmap e136: 6 total, 1 up, 5 in
- 2017-07-11 13:39:45.533489 I | rook-ceph-mon0: 2017-07-11 13:39:45.533308 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:39:46.849781 I | rook-ceph-mon0: 2017-07-11 13:39:46.849504 7f7c4e55a700 0 log_channel(cluster) log [INF] : osd.0 out (down for 605.155937)
- 2017-07-11 13:39:46.946265 I | rook-ceph-mon0: 2017-07-11 13:39:46.944480 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e137: 6 total, 1 up, 4 in
- 2017-07-11 13:39:47.609638 I | rook-ceph-mon0: 2017-07-11 13:39:46.849512 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 382 : cluster [INF] osd.0 out (down for 605.155937)
- 2017-07-11 13:39:47.609656 I | rook-ceph-mon0: 2017-07-11 13:39:46.944482 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 383 : cluster [INF] osdmap e137: 6 total, 1 up, 4 in
- 2017-07-11 13:39:48.069356 I | rook-ceph-mon0: 2017-07-11 13:39:48.069315 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:39:48.069533 I | rook-ceph-mon0: 2017-07-11 13:39:48.069456 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/290163359' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:39:58.962308 I | rook-ceph-mon0: 2017-07-11 13:39:58.962269 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:39:58.962377 I | rook-ceph-mon0: 2017-07-11 13:39:58.962362 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3607922906' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:40:05.285055 I | rook-ceph-mon0: 2017-07-11 13:40:05.284962 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_ERR; clock skew detected on mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 13:40:05.472390 I | rook-ceph-mon0: 2017-07-11 13:40:05.472327 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0644023s > max 0.05s
- 2017-07-11 13:40:05.732843 I | rook-ceph-mon0: 2017-07-11 13:40:05.284971 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 386 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 13:40:05.733062 I | rook-ceph-mon0: 2017-07-11 13:40:05.472329 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 387 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0644023s > max 0.05s
- 2017-07-11 13:40:20.997133 I | rook-ceph-mon0: 2017-07-11 13:40:20.996844 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:40:20.997328 I | rook-ceph-mon0: 2017-07-11 13:40:20.997242 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2445352787' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:40:31.857988 I | rook-ceph-mon0: 2017-07-11 13:40:31.857944 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:40:31.858198 I | rook-ceph-mon0: 2017-07-11 13:40:31.858100 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3421988791' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:40:42.788783 I | rook-ceph-mon0: 2017-07-11 13:40:42.788745 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:40:42.788993 I | rook-ceph-mon0: 2017-07-11 13:40:42.788892 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/103044394' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:40:45.533780 I | rook-ceph-mon0: 2017-07-11 13:40:45.533620 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:41:04.448198 I | rook-ceph-mon0: 2017-07-11 13:41:04.448160 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:41:04.448419 I | rook-ceph-mon0: 2017-07-11 13:41:04.448306 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3007439426' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:41:15.329668 I | rook-ceph-mon0: 2017-07-11 13:41:15.329605 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:41:15.329865 I | rook-ceph-mon0: 2017-07-11 13:41:15.329778 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1118212092' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:41:22.120949 I | rook-ceph-mon0: 2017-07-11 13:41:22.120857 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #18. Immutable memtables: 0.
- 2017-07-11 13:41:22.121040 I | rook-ceph-mon0:
- 2017-07-11 13:41:22.121135 I | rook-ceph-mon0: 2017-07-11 13:41:22.120896 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 9] Syncing log #15
- 2017-07-11 13:41:22.138295 I | rook-ceph-mon0: 2017-07-11 13:41:22.136505 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.120890) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:41:22.138363 I | rook-ceph-mon0: 2017-07-11 13:41:22.136514 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 9] Flushing memtable with next log file: 18
- 2017-07-11 13:41:22.138517 I | rook-ceph-mon0:
- 2017-07-11 13:41:22.138546 I | rook-ceph-mon0: 2017-07-11 13:41:22.136523 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482136519, "job": 9, "event": "flush_started", "num_memtables": 1, "num_entries": 1073, "num_deletes": 252, "memory_usage": 1931752}
- 2017-07-11 13:41:22.138565 I | rook-ceph-mon0: 2017-07-11 13:41:22.136526 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 9] Level-0 flush table #19: started
- 2017-07-11 13:41:22.144081 I | rook-ceph-mon0: 2017-07-11 13:41:22.144034 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482144024, "cf_name": "default", "job": 9, "event": "table_file_creation", "file_number": 19, "file_size": 1285232, "table_properties": {"data_size": 1279694, "index_size": 4723, "filter_size": 0, "raw_key_size": 8322, "raw_average_key_size": 18, "raw_value_size": 1270283, "raw_average_value_size": 2835, "num_data_blocks": 160, "num_entries": 448, "filter_policy_name": "", "kDeletedKeys": "252", "kMergeOperands": "0"}}
- 2017-07-11 13:41:22.144262 I | rook-ceph-mon0: 2017-07-11 13:41:22.144177 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 9] Level-0 flush table #19: 1285232 bytes OK
- 2017-07-11 13:41:22.179689 I | rook-ceph-mon0: 2017-07-11 13:41:22.179643 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.159235) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #19 started
- 2017-07-11 13:41:22.179790 I | rook-ceph-mon0: 2017-07-11 13:41:22.179774 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.179593) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #19: memtable #1 done
- 2017-07-11 13:41:22.179917 I | rook-ceph-mon0: 2017-07-11 13:41:22.179875 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.179615) EVENT_LOG_v1 {"time_micros": 1499780482179609, "job": 9, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:41:22.179953 I | rook-ceph-mon0: 2017-07-11 13:41:22.179938 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.179631) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:41:22.179967 I | rook-ceph-mon0:
- 2017-07-11 13:41:22.180011 I | rook-ceph-mon0: 2017-07-11 13:41:22.179998 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 9] Try to delete WAL files size 1910012, prev total WAL file size 1910012, number of live WAL files 2.
- 2017-07-11 13:41:22.180033 I | rook-ceph-mon0:
- 2017-07-11 13:41:22.184693 I | rook-ceph-mon0: 2017-07-11 13:41:22.180641 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:41:22.184748 I | rook-ceph-mon0: 2017-07-11 13:41:22.180676 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.180671) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:41:22.184766 I | rook-ceph-mon0:
- 2017-07-11 13:41:22.184779 I | rook-ceph-mon0: 2017-07-11 13:41:22.180681 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 10] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:41:22.184806 I | rook-ceph-mon0: 2017-07-11 13:41:22.180685 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 9 Base level 0, inputs: [19(1255KB)], [17(10MB)]
- 2017-07-11 13:41:22.184821 I | rook-ceph-mon0:
- 2017-07-11 13:41:22.184833 I | rook-ceph-mon0: 2017-07-11 13:41:22.180700 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482180692, "job": 10, "event": "compaction_started", "files_L0": [19], "files_L1": [17], "score": -1, "input_data_size": 12384343}
- 2017-07-11 13:41:22.299800 I | rook-ceph-mon0: 2017-07-11 13:41:22.299747 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 10] Generated table #20: 1492 keys, 11476504 bytes
- 2017-07-11 13:41:22.299989 I | rook-ceph-mon0: 2017-07-11 13:41:22.299906 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482299895, "cf_name": "default", "job": 10, "event": "table_file_creation", "file_number": 20, "file_size": 11476504, "table_properties": {"data_size": 11442543, "index_size": 33142, "filter_size": 0, "raw_key_size": 27054, "raw_average_key_size": 18, "raw_value_size": 11398889, "raw_average_value_size": 7640, "num_data_blocks": 1061, "num_entries": 1492, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:41:22.331506 I | rook-ceph-mon0: 2017-07-11 13:41:22.331446 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 10] Compacted 1@0 + 1@1 files to L1 => 11476504 bytes
- 2017-07-11 13:41:22.393678 I | rook-ceph-mon0: 2017-07-11 13:41:22.393619 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.393518) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 82.2 rd, 76.1 wr, level 1, files in(1, 1) out(1) MB in(1.2, 10.6) out(10.9), read-write-amplify(18.6) write-amplify(8.9) OK, records in: 1911, records dropped: 419
- 2017-07-11 13:41:22.393763 I | rook-ceph-mon0:
- 2017-07-11 13:41:22.393800 I | rook-ceph-mon0: 2017-07-11 13:41:22.393783 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.393565) EVENT_LOG_v1 {"time_micros": 1499780482393553, "job": 10, "event": "compaction_finished", "compaction_time_micros": 150721, "output_level": 1, "num_output_files": 1, "total_output_size": 11476504, "num_input_records": 1911, "num_output_records": 1492, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:41:22.394198 I | rook-ceph-mon0: 2017-07-11 13:41:22.394182 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482394179, "job": 10, "event": "table_file_deletion", "file_number": 19}
- 2017-07-11 13:41:22.395784 I | rook-ceph-mon0: 2017-07-11 13:41:22.395769 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482395767, "job": 10, "event": "table_file_deletion", "file_number": 17}
- 2017-07-11 13:41:22.395869 I | rook-ceph-mon0: 2017-07-11 13:41:22.395839 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:41:23.375200 I | rook-ceph-mon0: 2017-07-11 13:41:23.375121 7f7c4bd55700 0 log_channel(cluster) log [WRN] : message from mon.1 was stamped 0.059033s in the future, clocks not synchronized
- 2017-07-11 13:41:24.883158 I | rook-ceph-mon0: 2017-07-11 13:41:23.375125 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 393 : cluster [WRN] message from mon.1 was stamped 0.059033s in the future, clocks not synchronized
- 2017-07-11 13:41:26.128036 I | rook-ceph-mon0: 2017-07-11 13:41:26.127998 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:41:26.128107 I | rook-ceph-mon0: 2017-07-11 13:41:26.128091 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1198451109' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:41:30.368166 I | rook-ceph-mon0: 2017-07-11 13:41:29.150060 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 54 : cluster [WRN] message from mon.0 was stamped 0.054591s in the future, clocks not synchronized
- 2017-07-11 13:41:45.534402 I | rook-ceph-mon0: 2017-07-11 13:41:45.534238 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 13:41:47.820075 I | rook-ceph-mon0: 2017-07-11 13:41:47.820030 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:41:47.820269 I | rook-ceph-mon0: 2017-07-11 13:41:47.820182 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1310755458' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:42:05.479774 I | rook-ceph-mon0: 2017-07-11 13:42:05.479706 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0654724s > max 0.05s
- 2017-07-11 13:42:06.523628 I | rook-ceph-mon0: 2017-07-11 13:42:05.479708 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 396 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0654724s > max 0.05s
- 2017-07-11 13:42:42.159593 I | rook-ceph-mon0: 2017-07-11 13:42:42.159555 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:42:42.159808 I | rook-ceph-mon0: 2017-07-11 13:42:42.159704 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/494330276' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:42:45.534597 I | rook-ceph-mon0: 2017-07-11 13:42:45.534443 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 13:42:52.980208 I | rook-ceph-mon0: 2017-07-11 13:42:52.980169 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:42:52.980403 I | rook-ceph-mon0: 2017-07-11 13:42:52.980318 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3910625649' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:43:03.863740 I | rook-ceph-mon0: 2017-07-11 13:43:03.863674 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:43:03.863956 I | rook-ceph-mon0: 2017-07-11 13:43:03.863852 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4103857658' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:43:14.640898 I | rook-ceph-mon0: 2017-07-11 13:43:14.640856 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:43:14.641169 I | rook-ceph-mon0: 2017-07-11 13:43:14.641151 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/260292149' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:43:36.469712 I | rook-ceph-mon0: 2017-07-11 13:43:36.469675 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:43:36.469785 I | rook-ceph-mon0: 2017-07-11 13:43:36.469771 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/137038353' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:43:45.534973 I | rook-ceph-mon0: 2017-07-11 13:43:45.534808 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 13:44:09.060462 I | rook-ceph-mon0: 2017-07-11 13:44:09.060416 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:44:09.060532 I | rook-ceph-mon0: 2017-07-11 13:44:09.060515 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2169103781' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:44:35.488640 I | rook-ceph-mon0: 2017-07-11 13:44:35.488574 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0657463s > max 0.05s
- 2017-07-11 13:44:35.678675 I | rook-ceph-mon0: 2017-07-11 13:44:35.488576 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 403 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0657463s > max 0.05s
- 2017-07-11 13:44:42.080575 I | rook-ceph-mon0: 2017-07-11 13:44:42.080461 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #21. Immutable memtables: 0.
- 2017-07-11 13:44:42.080682 I | rook-ceph-mon0:
- 2017-07-11 13:44:42.080718 I | rook-ceph-mon0: 2017-07-11 13:44:42.080502 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 11] Syncing log #18
- 2017-07-11 13:44:42.096337 I | rook-ceph-mon0: 2017-07-11 13:44:42.095169 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.080496) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:44:42.096388 I | rook-ceph-mon0: 2017-07-11 13:44:42.095181 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 11] Flushing memtable with next log file: 21
- 2017-07-11 13:44:42.096405 I | rook-ceph-mon0:
- 2017-07-11 13:44:42.096418 I | rook-ceph-mon0: 2017-07-11 13:44:42.095192 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682095187, "job": 11, "event": "flush_started", "num_memtables": 1, "num_entries": 1034, "num_deletes": 251, "memory_usage": 1853080}
- 2017-07-11 13:44:42.096429 I | rook-ceph-mon0: 2017-07-11 13:44:42.095194 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 11] Level-0 flush table #22: started
- 2017-07-11 13:44:42.143770 I | rook-ceph-mon0: 2017-07-11 13:44:42.143722 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682143711, "cf_name": "default", "job": 11, "event": "table_file_creation", "file_number": 22, "file_size": 1827283, "table_properties": {"data_size": 1819048, "index_size": 7420, "filter_size": 0, "raw_key_size": 9280, "raw_average_key_size": 17, "raw_value_size": 1806683, "raw_average_value_size": 3434, "num_data_blocks": 247, "num_entries": 526, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:44:42.143883 I | rook-ceph-mon0: 2017-07-11 13:44:42.143865 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 11] Level-0 flush table #22: 1827283 bytes OK
- 2017-07-11 13:44:42.191793 I | rook-ceph-mon0: 2017-07-11 13:44:42.191752 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.159157) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #22 started
- 2017-07-11 13:44:42.191884 I | rook-ceph-mon0: 2017-07-11 13:44:42.191868 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.191701) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #22: memtable #1 done
- 2017-07-11 13:44:42.191956 I | rook-ceph-mon0: 2017-07-11 13:44:42.191929 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.191719) EVENT_LOG_v1 {"time_micros": 1499780682191714, "job": 11, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:44:42.191985 I | rook-ceph-mon0: 2017-07-11 13:44:42.191973 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.191734) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:44:42.192015 I | rook-ceph-mon0:
- 2017-07-11 13:44:42.192047 I | rook-ceph-mon0: 2017-07-11 13:44:42.192035 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 11] Try to delete WAL files size 1831038, prev total WAL file size 1831038, number of live WAL files 2.
- 2017-07-11 13:44:42.192061 I | rook-ceph-mon0:
- 2017-07-11 13:44:42.196342 I | rook-ceph-mon0: 2017-07-11 13:44:42.192572 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:44:42.196413 I | rook-ceph-mon0: 2017-07-11 13:44:42.192716 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 13:44:42.196432 I | rook-ceph-mon0: 2017-07-11 13:44:42.192720 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 13:44:42.196462 I | rook-ceph-mon0: ** DB Stats **
- 2017-07-11 13:44:42.196476 I | rook-ceph-mon0: Uptime(secs): 1257.0 total, 705.1 interval
- 2017-07-11 13:44:42.196488 I | rook-ceph-mon0: Cumulative writes: 2160 writes, 8171 keys, 2160 commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.02 MB/s
- 2017-07-11 13:44:42.196500 I | rook-ceph-mon0: Cumulative WAL: 2160 writes, 2160 syncs, 1.00 writes per sync, written: 0.02 GB, 0.02 MB/s
- 2017-07-11 13:44:42.196512 I | rook-ceph-mon0: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:44:42.196536 I | rook-ceph-mon0: Interval writes: 869 writes, 3514 keys, 869 commit groups, 1.0 writes per commit group, ingest: 5.94 MB, 0.01 MB/s
- 2017-07-11 13:44:42.196548 I | rook-ceph-mon0: Interval WAL: 869 writes, 869 syncs, 1.00 writes per sync, written: 0.01 MB, 0.01 MB/s
- 2017-07-11 13:44:42.196559 I | rook-ceph-mon0: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:44:42.196570 I | rook-ceph-mon0:
- 2017-07-11 13:44:42.196581 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 13:44:42.196592 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:44:42.196620 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:44:42.196637 I | rook-ceph-mon0: L0 1/1 1.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 40.4 0 6 0.075 0 0
- 2017-07-11 13:44:42.196649 I | rook-ceph-mon0: L1 1/1 10.94 MB 0.0 0.1 0.0 0.0 0.0 0.0 0.0 2.9 35.8 32.0 1 4 0.369 6787 1194
- 2017-07-11 13:44:42.196660 I | rook-ceph-mon0: Sum 2/2 12.69 MB 0.0 0.1 0.0 0.0 0.1 0.0 0.0 3.6 27.4 34.0 2 10 0.193 6787 1194
- 2017-07-11 13:44:42.196683 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.1 0.0 0.0 0.1 0.0 0.0 9.9 30.6 30.5 2 8 0.216 6787 1194
- 2017-07-11 13:44:42.196696 I | rook-ceph-mon0: Uptime(secs): 1257.0 total, 1257.0 interval
- 2017-07-11 13:44:42.196707 I | rook-ceph-mon0: Flush(GB): cumulative 0.018, interval 0.005
- 2017-07-11 13:44:42.196718 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:44:42.196729 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:44:42.196740 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:44:42.196763 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:44:42.196776 I | rook-ceph-mon0: Cumulative compaction: 0.06 GB write, 0.05 MB/s write, 0.05 GB read, 0.04 MB/s read, 1.9 seconds
- 2017-07-11 13:44:42.196787 I | rook-ceph-mon0: Interval compaction: 0.05 GB write, 0.04 MB/s write, 0.05 GB read, 0.04 MB/s read, 1.7 seconds
- 2017-07-11 13:44:42.196798 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:44:42.196809 I | rook-ceph-mon0:
- 2017-07-11 13:44:42.196820 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:44:42.196861 I | rook-ceph-mon0:
- 2017-07-11 13:44:42.196873 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 13:44:42.196884 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:44:42.196917 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:44:42.196932 I | rook-ceph-mon0: L0 1/1 1.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 40.4 0 6 0.075 0 0
- 2017-07-11 13:44:42.196944 I | rook-ceph-mon0: L1 1/1 10.94 MB 0.0 0.1 0.0 0.0 0.0 0.0 0.0 2.9 35.8 32.0 1 4 0.369 6787 1194
- 2017-07-11 13:44:42.196954 I | rook-ceph-mon0: Sum 2/2 12.69 MB 0.0 0.1 0.0 0.0 0.1 0.0 0.0 3.6 27.4 34.0 2 10 0.193 6787 1194
- 2017-07-11 13:44:42.196964 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 13:44:42.196975 I | rook-ceph-mon0: Uptime(secs): 1257.0 total, 1257.0 interval
- 2017-07-11 13:44:42.196996 I | rook-ceph-mon0: Flush(GB): cumulative 0.018, interval 0.000
- 2017-07-11 13:44:42.197008 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:44:42.197018 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:44:42.197028 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:44:42.197038 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:44:42.197048 I | rook-ceph-mon0: Cumulative compaction: 0.06 GB write, 0.05 MB/s write, 0.05 GB read, 0.04 MB/s read, 1.9 seconds
- 2017-07-11 13:44:42.197069 I | rook-ceph-mon0: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 13:44:42.197082 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:44:42.197092 I | rook-ceph-mon0:
- 2017-07-11 13:44:42.197103 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:44:42.197113 I | rook-ceph-mon0:
- 2017-07-11 13:44:42.197124 I | rook-ceph-mon0: 2017-07-11 13:44:42.192738 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.192732) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 13:44:42.197145 I | rook-ceph-mon0:
- 2017-07-11 13:44:42.197156 I | rook-ceph-mon0: 2017-07-11 13:44:42.192742 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 12] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:44:42.197167 I | rook-ceph-mon0: 2017-07-11 13:44:42.192745 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 11 Base level 0, inputs: [22(1784KB)], [20(10MB)]
- 2017-07-11 13:44:42.197177 I | rook-ceph-mon0:
- 2017-07-11 13:44:42.197188 I | rook-ceph-mon0: 2017-07-11 13:44:42.192755 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682192748, "job": 12, "event": "compaction_started", "files_L0": [22], "files_L1": [20], "score": -1, "input_data_size": 13303787}
- 2017-07-11 13:44:42.347430 I | rook-ceph-mon0: 2017-07-11 13:44:42.347380 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 12] Generated table #23: 1509 keys, 10417154 bytes
- 2017-07-11 13:44:42.347617 I | rook-ceph-mon0: 2017-07-11 13:44:42.347533 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682347523, "cf_name": "default", "job": 12, "event": "table_file_creation", "file_number": 23, "file_size": 10417154, "table_properties": {"data_size": 10381913, "index_size": 34422, "filter_size": 0, "raw_key_size": 27615, "raw_average_key_size": 18, "raw_value_size": 10337044, "raw_average_value_size": 6850, "num_data_blocks": 1095, "num_entries": 1509, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:44:42.380082 I | rook-ceph-mon0: 2017-07-11 13:44:42.380027 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 12] Compacted 1@0 + 1@1 files to L1 => 10417154 bytes
- 2017-07-11 13:44:42.431654 I | rook-ceph-mon0: 2017-07-11 13:44:42.431601 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.431523) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 71.0 rd, 55.6 wr, level 1, files in(1, 1) out(1) MB in(1.7, 10.9) out(9.9), read-write-amplify(13.0) write-amplify(5.7) OK, records in: 2018, records dropped: 509
- 2017-07-11 13:44:42.431743 I | rook-ceph-mon0:
- 2017-07-11 13:44:42.431779 I | rook-ceph-mon0: 2017-07-11 13:44:42.431763 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.431553) EVENT_LOG_v1 {"time_micros": 1499780682431543, "job": 12, "event": "compaction_finished", "compaction_time_micros": 187248, "output_level": 1, "num_output_files": 1, "total_output_size": 10417154, "num_input_records": 2018, "num_output_records": 1509, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:44:42.432289 I | rook-ceph-mon0: 2017-07-11 13:44:42.432273 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682432269, "job": 12, "event": "table_file_deletion", "file_number": 22}
- 2017-07-11 13:44:42.433796 I | rook-ceph-mon0: 2017-07-11 13:44:42.433781 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682433779, "job": 12, "event": "table_file_deletion", "file_number": 20}
- 2017-07-11 13:44:45.535339 I | rook-ceph-mon0: 2017-07-11 13:44:45.535148 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:45:03.420577 I | rook-ceph-mon0: 2017-07-11 13:45:03.420536 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:45:03.420799 I | rook-ceph-mon0: 2017-07-11 13:45:03.420687 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/31585629' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:45:25.381669 I | rook-ceph-mon0: 2017-07-11 13:45:25.381630 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:45:25.381903 I | rook-ceph-mon0: 2017-07-11 13:45:25.381829 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1345977348' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:45:36.231533 I | rook-ceph-mon0: 2017-07-11 13:45:36.231492 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:45:36.231752 I | rook-ceph-mon0: 2017-07-11 13:45:36.231721 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1474641049' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:45:45.535587 I | rook-ceph-mon0: 2017-07-11 13:45:45.535446 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:45:47.125162 I | rook-ceph-mon0: 2017-07-11 13:45:47.125115 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:45:47.125231 I | rook-ceph-mon0: 2017-07-11 13:45:47.125214 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2926558885' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:46:08.857734 I | rook-ceph-mon0: 2017-07-11 13:46:08.857695 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:46:08.857956 I | rook-ceph-mon0: 2017-07-11 13:46:08.857843 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3197122430' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:46:19.821188 I | rook-ceph-mon0: 2017-07-11 13:46:19.821152 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:46:19.821429 I | rook-ceph-mon0: 2017-07-11 13:46:19.821301 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1107579321' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:46:30.675695 I | rook-ceph-mon0: 2017-07-11 13:46:30.675656 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:46:30.675763 I | rook-ceph-mon0: 2017-07-11 13:46:30.675748 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2394947328' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:46:41.504343 I | rook-ceph-mon0: 2017-07-11 13:46:41.504305 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:46:41.504530 I | rook-ceph-mon0: 2017-07-11 13:46:41.504515 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3243689302' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:46:45.536121 I | rook-ceph-mon0: 2017-07-11 13:46:45.535957 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:47:25.149276 I | rook-ceph-mon0: 2017-07-11 13:47:25.149233 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:47:25.149506 I | rook-ceph-mon0: 2017-07-11 13:47:25.149475 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/272306275' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:47:35.496799 I | rook-ceph-mon0: 2017-07-11 13:47:35.496733 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0652957s > max 0.05s
- 2017-07-11 13:47:35.687229 I | rook-ceph-mon0: 2017-07-11 13:47:35.496735 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 413 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0652957s > max 0.05s
- 2017-07-11 13:47:35.971652 I | rook-ceph-mon0: 2017-07-11 13:47:35.971611 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:47:35.971954 I | rook-ceph-mon0: 2017-07-11 13:47:35.971899 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2105959696' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:47:45.536673 I | rook-ceph-mon0: 2017-07-11 13:47:45.536508 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:47:57.979994 I | rook-ceph-mon0: 2017-07-11 13:47:57.979948 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:47:57.980079 I | rook-ceph-mon0: 2017-07-11 13:47:57.980047 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2687775843' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:48:41.482581 I | rook-ceph-mon0: 2017-07-11 13:48:41.482533 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:48:41.482821 I | rook-ceph-mon0: 2017-07-11 13:48:41.482693 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1303550846' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:48:45.536912 I | rook-ceph-mon0: 2017-07-11 13:48:45.536748 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:49:25.040256 I | rook-ceph-mon0: 2017-07-11 13:49:25.040216 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:49:25.040473 I | rook-ceph-mon0: 2017-07-11 13:49:25.040443 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4168252809' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:49:45.550209 I | rook-ceph-mon0: 2017-07-11 13:49:45.549942 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:49:47.422059 I | rook-ceph-mon0: 2017-07-11 13:49:47.421889 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #24. Immutable memtables: 0.
- 2017-07-11 13:49:47.422146 I | rook-ceph-mon0:
- 2017-07-11 13:49:47.422165 I | rook-ceph-mon0: 2017-07-11 13:49:47.421918 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 13] Syncing log #21
- 2017-07-11 13:49:47.454638 I | rook-ceph-mon0: 2017-07-11 13:49:47.452381 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.421912) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:49:47.454721 I | rook-ceph-mon0: 2017-07-11 13:49:47.452394 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 13] Flushing memtable with next log file: 24
- 2017-07-11 13:49:47.454739 I | rook-ceph-mon0:
- 2017-07-11 13:49:47.454770 I | rook-ceph-mon0: 2017-07-11 13:49:47.452404 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780987452400, "job": 13, "event": "flush_started", "num_memtables": 1, "num_entries": 1393, "num_deletes": 250, "memory_usage": 2704304}
- 2017-07-11 13:49:47.454806 I | rook-ceph-mon0: 2017-07-11 13:49:47.452407 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 13] Level-0 flush table #25: started
- 2017-07-11 13:49:47.562506 I | rook-ceph-mon0: 2017-07-11 13:49:47.562435 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780987562425, "cf_name": "default", "job": 13, "event": "table_file_creation", "file_number": 25, "file_size": 1718604, "table_properties": {"data_size": 1711192, "index_size": 6597, "filter_size": 0, "raw_key_size": 9382, "raw_average_key_size": 18, "raw_value_size": 1699702, "raw_average_value_size": 3385, "num_data_blocks": 218, "num_entries": 502, "filter_policy_name": "", "kDeletedKeys": "250", "kMergeOperands": "0"}}
- 2017-07-11 13:49:47.562709 I | rook-ceph-mon0: 2017-07-11 13:49:47.562613 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 13] Level-0 flush table #25: 1718604 bytes OK
- 2017-07-11 13:49:47.568328 I | rook-ceph-mon0: 2017-07-11 13:49:47.568288 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.579304) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #25 started
- 2017-07-11 13:49:47.568420 I | rook-ceph-mon0: 2017-07-11 13:49:47.568405 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.568233) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #25: memtable #1 done
- 2017-07-11 13:49:47.568453 I | rook-ceph-mon0: 2017-07-11 13:49:47.568439 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.568253) EVENT_LOG_v1 {"time_micros": 1499780987568247, "job": 13, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:49:47.568506 I | rook-ceph-mon0: 2017-07-11 13:49:47.568492 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.568269) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:49:47.568521 I | rook-ceph-mon0:
- 2017-07-11 13:49:47.568577 I | rook-ceph-mon0: 2017-07-11 13:49:47.568564 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 13] Try to delete WAL files size 2676284, prev total WAL file size 2676284, number of live WAL files 2.
- 2017-07-11 13:49:47.568590 I | rook-ceph-mon0:
- 2017-07-11 13:49:47.569571 I | rook-ceph-mon0: 2017-07-11 13:49:47.569196 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:49:47.569610 I | rook-ceph-mon0: 2017-07-11 13:49:47.569230 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.569224) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:49:47.569627 I | rook-ceph-mon0:
- 2017-07-11 13:49:47.569639 I | rook-ceph-mon0: 2017-07-11 13:49:47.569234 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 14] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:49:47.569651 I | rook-ceph-mon0: 2017-07-11 13:49:47.569239 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 13 Base level 0, inputs: [25(1678KB)], [23(10173KB)]
- 2017-07-11 13:49:47.569678 I | rook-ceph-mon0:
- 2017-07-11 13:49:47.569691 I | rook-ceph-mon0: 2017-07-11 13:49:47.569249 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780987569241, "job": 14, "event": "compaction_started", "files_L0": [25], "files_L1": [23], "score": -1, "input_data_size": 12135758}
- 2017-07-11 13:49:47.738649 I | rook-ceph-mon0: 2017-07-11 13:49:47.738585 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 14] Generated table #26: 1649 keys, 11446161 bytes
- 2017-07-11 13:49:47.738840 I | rook-ceph-mon0: 2017-07-11 13:49:47.738750 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780987738740, "cf_name": "default", "job": 14, "event": "table_file_creation", "file_number": 26, "file_size": 11446161, "table_properties": {"data_size": 11407445, "index_size": 37897, "filter_size": 0, "raw_key_size": 30065, "raw_average_key_size": 18, "raw_value_size": 11358285, "raw_average_value_size": 6887, "num_data_blocks": 1208, "num_entries": 1649, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:49:47.802549 I | rook-ceph-mon0: 2017-07-11 13:49:47.802466 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 14] Compacted 1@0 + 1@1 files to L1 => 11446161 bytes
- 2017-07-11 13:49:47.832739 I | rook-ceph-mon0: 2017-07-11 13:49:47.832698 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.832622) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 52.0 rd, 49.1 wr, level 1, files in(1, 1) out(1) MB in(1.6, 9.9) out(10.9), read-write-amplify(13.7) write-amplify(6.7) OK, records in: 2011, records dropped: 362
- 2017-07-11 13:49:47.832803 I | rook-ceph-mon0:
- 2017-07-11 13:49:47.832841 I | rook-ceph-mon0: 2017-07-11 13:49:47.832823 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.832648) EVENT_LOG_v1 {"time_micros": 1499780987832638, "job": 14, "event": "compaction_finished", "compaction_time_micros": 233187, "output_level": 1, "num_output_files": 1, "total_output_size": 11446161, "num_input_records": 2011, "num_output_records": 1649, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:49:47.833288 I | rook-ceph-mon0: 2017-07-11 13:49:47.833271 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780987833267, "job": 14, "event": "table_file_deletion", "file_number": 25}
- 2017-07-11 13:49:47.834649 I | rook-ceph-mon0: 2017-07-11 13:49:47.834632 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780987834630, "job": 14, "event": "table_file_deletion", "file_number": 23}
- 2017-07-11 13:49:47.834719 I | rook-ceph-mon0: 2017-07-11 13:49:47.834705 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:50:08.956439 I | rook-ceph-mon0: 2017-07-11 13:50:08.956401 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:50:08.956663 I | rook-ceph-mon0: 2017-07-11 13:50:08.956629 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1635773468' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:50:41.832711 I | rook-ceph-mon0: 2017-07-11 13:50:41.832672 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:50:41.832924 I | rook-ceph-mon0: 2017-07-11 13:50:41.832824 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2968560228' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:50:45.550365 I | rook-ceph-mon0: 2017-07-11 13:50:45.550206 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 13:50:52.672655 I | rook-ceph-mon0: 2017-07-11 13:50:52.672619 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:50:52.672745 I | rook-ceph-mon0: 2017-07-11 13:50:52.672727 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1803834073' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:51:05.507152 I | rook-ceph-mon0: 2017-07-11 13:51:05.507071 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0662768s > max 0.05s
- 2017-07-11 13:51:05.507564 I | rook-ceph-mon0: 2017-07-11 13:51:05.507490 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.0569526s > max 0.05s
- 2017-07-11 13:51:06.352220 I | rook-ceph-mon0: 2017-07-11 13:51:05.507072 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 421 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0662768s > max 0.05s
- 2017-07-11 13:51:06.352238 I | rook-ceph-mon0: 2017-07-11 13:51:05.507492 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 422 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.0569526s > max 0.05s
- 2017-07-11 13:51:36.491969 I | rook-ceph-mon0: 2017-07-11 13:51:36.491931 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:51:36.492182 I | rook-ceph-mon0: 2017-07-11 13:51:36.492080 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/778889670' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:51:43.385438 I | rook-ceph-mon0: 2017-07-11 13:51:43.385324 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #27. Immutable memtables: 0.
- 2017-07-11 13:51:43.385559 I | rook-ceph-mon0:
- 2017-07-11 13:51:43.385634 I | rook-ceph-mon0: 2017-07-11 13:51:43.385371 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 15] Syncing log #24
- 2017-07-11 13:51:43.405206 I | rook-ceph-mon0: 2017-07-11 13:51:43.403563 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.385365) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:51:43.405283 I | rook-ceph-mon0: 2017-07-11 13:51:43.403579 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 15] Flushing memtable with next log file: 27
- 2017-07-11 13:51:43.405301 I | rook-ceph-mon0:
- 2017-07-11 13:51:43.405314 I | rook-ceph-mon0: 2017-07-11 13:51:43.403591 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103403586, "job": 15, "event": "flush_started", "num_memtables": 1, "num_entries": 692, "num_deletes": 251, "memory_usage": 1050152}
- 2017-07-11 13:51:43.405326 I | rook-ceph-mon0: 2017-07-11 13:51:43.403597 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 15] Level-0 flush table #28: started
- 2017-07-11 13:51:43.511099 I | rook-ceph-mon0: 2017-07-11 13:51:43.511056 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103511045, "cf_name": "default", "job": 15, "event": "table_file_creation", "file_number": 28, "file_size": 1032781, "table_properties": {"data_size": 1027701, "index_size": 4265, "filter_size": 0, "raw_key_size": 7221, "raw_average_key_size": 17, "raw_value_size": 1019190, "raw_average_value_size": 2498, "num_data_blocks": 140, "num_entries": 408, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:51:43.511219 I | rook-ceph-mon0: 2017-07-11 13:51:43.511202 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 15] Level-0 flush table #28: 1032781 bytes OK
- 2017-07-11 13:51:43.621790 I | rook-ceph-mon0: 2017-07-11 13:51:43.621739 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.601702) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #28 started
- 2017-07-11 13:51:43.621896 I | rook-ceph-mon0: 2017-07-11 13:51:43.621880 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.621678) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #28: memtable #1 done
- 2017-07-11 13:51:43.622017 I | rook-ceph-mon0: 2017-07-11 13:51:43.621975 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.621703) EVENT_LOG_v1 {"time_micros": 1499781103621697, "job": 15, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:51:43.622054 I | rook-ceph-mon0: 2017-07-11 13:51:43.622038 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.621721) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:51:43.622068 I | rook-ceph-mon0:
- 2017-07-11 13:51:43.622116 I | rook-ceph-mon0: 2017-07-11 13:51:43.622102 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 15] Try to delete WAL files size 1034197, prev total WAL file size 1034197, number of live WAL files 2.
- 2017-07-11 13:51:43.622132 I | rook-ceph-mon0:
- 2017-07-11 13:51:43.622953 I | rook-ceph-mon0: 2017-07-11 13:51:43.622514 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:51:43.622991 I | rook-ceph-mon0: 2017-07-11 13:51:43.622550 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.622544) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 13:51:43.623008 I | rook-ceph-mon0:
- 2017-07-11 13:51:43.623021 I | rook-ceph-mon0: 2017-07-11 13:51:43.622554 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 16] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:51:43.623032 I | rook-ceph-mon0: 2017-07-11 13:51:43.622559 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 15 Base level 0, inputs: [28(1008KB)], [26(10MB)]
- 2017-07-11 13:51:43.623059 I | rook-ceph-mon0:
- 2017-07-11 13:51:43.623073 I | rook-ceph-mon0: 2017-07-11 13:51:43.622571 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103622562, "job": 16, "event": "compaction_started", "files_L0": [28], "files_L1": [26], "score": -1, "input_data_size": 12478942}
- 2017-07-11 13:51:43.733088 I | rook-ceph-mon0: 2017-07-11 13:51:43.733038 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 16] Generated table #29: 1548 keys, 10839622 bytes
- 2017-07-11 13:51:43.733197 I | rook-ceph-mon0: 2017-07-11 13:51:43.733177 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103733167, "cf_name": "default", "job": 16, "event": "table_file_creation", "file_number": 29, "file_size": 10839622, "table_properties": {"data_size": 10803995, "index_size": 34808, "filter_size": 0, "raw_key_size": 28567, "raw_average_key_size": 18, "raw_value_size": 10758251, "raw_average_value_size": 6949, "num_data_blocks": 1097, "num_entries": 1548, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:51:43.767808 I | rook-ceph-mon0: 2017-07-11 13:51:43.767762 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 16] Compacted 1@0 + 1@1 files to L1 => 10839622 bytes
- 2017-07-11 13:51:43.795597 I | rook-ceph-mon0: 2017-07-11 13:51:43.795561 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.795487) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 86.0 rd, 74.7 wr, level 1, files in(1, 1) out(1) MB in(1.0, 10.9) out(10.3), read-write-amplify(22.6) write-amplify(10.5) OK, records in: 2057, records dropped: 509
- 2017-07-11 13:51:43.795661 I | rook-ceph-mon0:
- 2017-07-11 13:51:43.795697 I | rook-ceph-mon0: 2017-07-11 13:51:43.795680 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.795510) EVENT_LOG_v1 {"time_micros": 1499781103795501, "job": 16, "event": "compaction_finished", "compaction_time_micros": 145171, "output_level": 1, "num_output_files": 1, "total_output_size": 10839622, "num_input_records": 2057, "num_output_records": 1548, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:51:43.796138 I | rook-ceph-mon0: 2017-07-11 13:51:43.796122 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103796117, "job": 16, "event": "table_file_deletion", "file_number": 28}
- 2017-07-11 13:51:43.797605 I | rook-ceph-mon0: 2017-07-11 13:51:43.797580 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103797578, "job": 16, "event": "table_file_deletion", "file_number": 26}
- 2017-07-11 13:51:45.550645 I | rook-ceph-mon0: 2017-07-11 13:51:45.550474 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94369 MB
- 2017-07-11 13:51:48.623017 I | rook-ceph-mon0: 2017-07-11 13:51:48.622939 7f7c4bd55700 0 log_channel(cluster) log [WRN] : message from mon.1 was stamped 0.084083s in the future, clocks not synchronized
- 2017-07-11 13:51:50.013443 I | rook-ceph-mon0: 2017-07-11 13:51:48.622941 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 424 : cluster [WRN] message from mon.1 was stamped 0.084083s in the future, clocks not synchronized
- 2017-07-11 13:52:05.320180 I | rook-ceph-mon0: 2017-07-11 13:52:05.320091 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 13:52:05.516530 I | rook-ceph-mon0: 2017-07-11 13:52:05.320100 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 425 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 13:52:09.139711 I | rook-ceph-mon0: 2017-07-11 13:52:09.139670 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:52:09.139908 I | rook-ceph-mon0: 2017-07-11 13:52:09.139821 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2837975239' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:52:30.967757 I | rook-ceph-mon0: 2017-07-11 13:52:30.967718 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:52:30.967827 I | rook-ceph-mon0: 2017-07-11 13:52:30.967811 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/907626781' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:52:45.550922 I | rook-ceph-mon0: 2017-07-11 13:52:45.550782 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94369 MB
- 2017-07-11 13:52:52.825302 I | rook-ceph-mon0: 2017-07-11 13:52:52.822846 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:52:52.786739 I | rook-ceph-mon0: 2017-07-11 13:52:52.786698 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4023988508' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:53:03.729588 I | rook-ceph-mon0: 2017-07-11 13:53:03.729552 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:53:03.729789 I | rook-ceph-mon0: 2017-07-11 13:53:03.729694 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3338999801' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:53:45.551338 I | rook-ceph-mon0: 2017-07-11 13:53:45.551171 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94369 MB
- 2017-07-11 13:54:09.251240 I | rook-ceph-mon0: 2017-07-11 13:54:09.251190 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:54:09.251480 I | rook-ceph-mon0: 2017-07-11 13:54:09.251445 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1985166415' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:54:31.031321 I | rook-ceph-mon0: 2017-07-11 13:54:31.031282 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:54:31.031572 I | rook-ceph-mon0: 2017-07-11 13:54:31.031434 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/826053341' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:54:42.187610 I | rook-ceph-mon0: 2017-07-11 13:54:42.187534 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:54:42.187793 I | rook-ceph-mon0: 2017-07-11 13:54:42.187711 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3286772841' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:54:45.551583 I | rook-ceph-mon0: 2017-07-11 13:54:45.551421 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94369 MB
- 2017-07-11 13:54:53.022832 I | rook-ceph-mon0: 2017-07-11 13:54:53.022793 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:54:53.023020 I | rook-ceph-mon0: 2017-07-11 13:54:53.022930 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1616927413' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:55:05.508623 I | rook-ceph-mon0: 2017-07-11 13:55:05.508558 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0663925s > max 0.05s
- 2017-07-11 13:55:05.512501 I | rook-ceph-mon0: 2017-07-11 13:55:05.512426 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.0852258s > max 0.05s
- 2017-07-11 13:55:06.748252 I | rook-ceph-mon0: 2017-07-11 13:55:05.508559 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 434 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0663925s > max 0.05s
- 2017-07-11 13:55:06.748365 I | rook-ceph-mon0: 2017-07-11 13:55:05.512428 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 435 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.0852258s > max 0.05s
- 2017-07-11 13:55:45.551845 I | rook-ceph-mon0: 2017-07-11 13:55:45.551686 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94369 MB
- 2017-07-11 13:55:59.094022 I | rook-ceph-mon0: 2017-07-11 13:55:59.093974 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:55:59.094241 I | rook-ceph-mon0: 2017-07-11 13:55:59.094135 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3483609300' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:56:10.053418 I | rook-ceph-mon0: 2017-07-11 13:56:10.053379 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:56:10.053662 I | rook-ceph-mon0: 2017-07-11 13:56:10.053620 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/385013473' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:56:31.923697 I | rook-ceph-mon0: 2017-07-11 13:56:31.923658 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:56:31.923935 I | rook-ceph-mon0: 2017-07-11 13:56:31.923802 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4276192509' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:56:42.958198 I | rook-ceph-mon0: 2017-07-11 13:56:42.958159 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:56:42.958415 I | rook-ceph-mon0: 2017-07-11 13:56:42.958384 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3544416620' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:56:45.552069 I | rook-ceph-mon0: 2017-07-11 13:56:45.551931 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94369 MB
- 2017-07-11 13:56:53.918818 I | rook-ceph-mon0: 2017-07-11 13:56:53.918771 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:56:53.919027 I | rook-ceph-mon0: 2017-07-11 13:56:53.918920 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/140833343' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:57:15.749103 I | rook-ceph-mon0: 2017-07-11 13:57:15.749033 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:57:15.749328 I | rook-ceph-mon0: 2017-07-11 13:57:15.749300 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1721231280' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:57:26.658211 I | rook-ceph-mon0: 2017-07-11 13:57:26.658132 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:57:26.658443 I | rook-ceph-mon0: 2017-07-11 13:57:26.658411 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2059546278' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:57:37.607583 I | rook-ceph-mon0: 2017-07-11 13:57:37.607544 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:57:37.607805 I | rook-ceph-mon0: 2017-07-11 13:57:37.607693 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2452453595' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:57:45.561629 I | rook-ceph-mon0: 2017-07-11 13:57:45.561502 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 13:57:48.622025 I | rook-ceph-mon0: 2017-07-11 13:57:48.621988 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:57:48.622236 I | rook-ceph-mon0: 2017-07-11 13:57:48.622137 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1685711639' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:58:12.486251 I | rook-ceph-mon0: 2017-07-11 13:58:12.486147 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #30. Immutable memtables: 0.
- 2017-07-11 13:58:12.486405 I | rook-ceph-mon0:
- 2017-07-11 13:58:12.486463 I | rook-ceph-mon0: 2017-07-11 13:58:12.486186 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 17] Syncing log #27
- 2017-07-11 13:58:12.502535 I | rook-ceph-mon0: 2017-07-11 13:58:12.501051 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.486181) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:58:12.502589 I | rook-ceph-mon0: 2017-07-11 13:58:12.501060 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 17] Flushing memtable with next log file: 30
- 2017-07-11 13:58:12.502606 I | rook-ceph-mon0:
- 2017-07-11 13:58:12.502619 I | rook-ceph-mon0: 2017-07-11 13:58:12.501073 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781492501068, "job": 17, "event": "flush_started", "num_memtables": 1, "num_entries": 1726, "num_deletes": 251, "memory_usage": 3510520}
- 2017-07-11 13:58:12.502647 I | rook-ceph-mon0: 2017-07-11 13:58:12.501075 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 17] Level-0 flush table #31: started
- 2017-07-11 13:58:12.597060 I | rook-ceph-mon0: 2017-07-11 13:58:12.596998 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781492596976, "cf_name": "default", "job": 17, "event": "table_file_creation", "file_number": 31, "file_size": 2237920, "table_properties": {"data_size": 2228572, "index_size": 8530, "filter_size": 0, "raw_key_size": 10717, "raw_average_key_size": 18, "raw_value_size": 2214723, "raw_average_value_size": 3851, "num_data_blocks": 281, "num_entries": 575, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:58:12.597169 I | rook-ceph-mon0: 2017-07-11 13:58:12.597152 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 17] Level-0 flush table #31: 2237920 bytes OK
- 2017-07-11 13:58:12.644154 I | rook-ceph-mon0: 2017-07-11 13:58:12.644113 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.626617) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #31 started
- 2017-07-11 13:58:12.644304 I | rook-ceph-mon0: 2017-07-11 13:58:12.644283 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.644067) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #31: memtable #1 done
- 2017-07-11 13:58:12.644368 I | rook-ceph-mon0: 2017-07-11 13:58:12.644353 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.644086) EVENT_LOG_v1 {"time_micros": 1499781492644080, "job": 17, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:58:12.644398 I | rook-ceph-mon0: 2017-07-11 13:58:12.644385 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.644101) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:58:12.644428 I | rook-ceph-mon0:
- 2017-07-11 13:58:12.644460 I | rook-ceph-mon0: 2017-07-11 13:58:12.644447 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 17] Try to delete WAL files size 3476392, prev total WAL file size 3476392, number of live WAL files 2.
- 2017-07-11 13:58:12.644498 I | rook-ceph-mon0:
- 2017-07-11 13:58:12.646516 I | rook-ceph-mon0: 2017-07-11 13:58:12.645217 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:58:12.646578 I | rook-ceph-mon0: 2017-07-11 13:58:12.645355 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 13:58:12.646596 I | rook-ceph-mon0: 2017-07-11 13:58:12.645362 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 13:58:12.646610 I | rook-ceph-mon0: ** DB Stats **
- 2017-07-11 13:58:12.646649 I | rook-ceph-mon0: Uptime(secs): 2067.5 total, 810.5 interval
- 2017-07-11 13:58:12.646663 I | rook-ceph-mon0: Cumulative writes: 3128 writes, 11K keys, 3128 commit groups, 1.0 writes per commit group, ingest: 0.03 GB, 0.01 MB/s
- 2017-07-11 13:58:12.646674 I | rook-ceph-mon0: Cumulative WAL: 3128 writes, 3128 syncs, 1.00 writes per sync, written: 0.03 GB, 0.01 MB/s
- 2017-07-11 13:58:12.646686 I | rook-ceph-mon0: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:58:12.646711 I | rook-ceph-mon0: Interval writes: 968 writes, 3811 keys, 968 commit groups, 1.0 writes per commit group, ingest: 6.85 MB, 0.01 MB/s
- 2017-07-11 13:58:12.646724 I | rook-ceph-mon0: Interval WAL: 968 writes, 968 syncs, 1.00 writes per sync, written: 0.01 MB, 0.01 MB/s
- 2017-07-11 13:58:12.646736 I | rook-ceph-mon0: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:58:12.646747 I | rook-ceph-mon0:
- 2017-07-11 13:58:12.646758 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 13:58:12.646769 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:58:12.646794 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:58:12.646807 I | rook-ceph-mon0: L0 1/1 2.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 25.5 1 9 0.100 0 0
- 2017-07-11 13:58:12.646819 I | rook-ceph-mon0: L1 1/1 10.34 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 3.8 43.6 38.4 2 7 0.292 12K 2574
- 2017-07-11 13:58:12.646830 I | rook-ceph-mon0: Sum 2/2 12.47 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 4.4 30.2 34.5 3 16 0.184 12K 2574
- 2017-07-11 13:58:12.646843 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 7.6 35.6 35.4 1 6 0.169 6086 1380
- 2017-07-11 13:58:12.646867 I | rook-ceph-mon0: Uptime(secs): 2067.5 total, 2067.5 interval
- 2017-07-11 13:58:12.646880 I | rook-ceph-mon0: Flush(GB): cumulative 0.022, interval 0.005
- 2017-07-11 13:58:12.646891 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:58:12.646902 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:58:12.646913 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:58:12.646924 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:58:12.646947 I | rook-ceph-mon0: Cumulative compaction: 0.10 GB write, 0.05 MB/s write, 0.09 GB read, 0.04 MB/s read, 2.9 seconds
- 2017-07-11 13:58:12.646960 I | rook-ceph-mon0: Interval compaction: 0.04 GB write, 0.02 MB/s write, 0.04 GB read, 0.02 MB/s read, 1.0 seconds
- 2017-07-11 13:58:12.646971 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:58:12.646983 I | rook-ceph-mon0:
- 2017-07-11 13:58:12.646994 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:58:12.647019 I | rook-ceph-mon0:
- 2017-07-11 13:58:12.647033 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 13:58:12.647045 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:58:12.647056 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:58:12.647067 I | rook-ceph-mon0: L0 1/1 2.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 25.5 1 9 0.100 0 0
- 2017-07-11 13:58:12.647079 I | rook-ceph-mon0: L1 1/1 10.34 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 3.8 43.6 38.4 2 7 0.292 12K 2574
- 2017-07-11 13:58:12.647102 I | rook-ceph-mon0: Sum 2/2 12.47 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 4.4 30.2 34.5 3 16 0.184 12K 2574
- 2017-07-11 13:58:12.647120 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 13:58:12.647131 I | rook-ceph-mon0: Uptime(secs): 2067.5 total, 2067.5 interval
- 2017-07-11 13:58:12.647142 I | rook-ceph-mon0: Flush(GB): cumulative 0.022, interval 0.000
- 2017-07-11 13:58:12.647153 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:58:12.647176 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:58:12.647188 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:58:12.647199 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:58:12.647210 I | rook-ceph-mon0: Cumulative compaction: 0.10 GB write, 0.05 MB/s write, 0.09 GB read, 0.04 MB/s read, 2.9 seconds
- 2017-07-11 13:58:12.647221 I | rook-ceph-mon0: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 13:58:12.647233 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:58:12.647257 I | rook-ceph-mon0:
- 2017-07-11 13:58:12.647269 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:58:12.647280 I | rook-ceph-mon0:
- 2017-07-11 13:58:12.647291 I | rook-ceph-mon0: 2017-07-11 13:58:12.645378 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.645373) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:58:12.647302 I | rook-ceph-mon0:
- 2017-07-11 13:58:12.647316 I | rook-ceph-mon0: 2017-07-11 13:58:12.645382 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 18] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:58:12.647343 I | rook-ceph-mon0: 2017-07-11 13:58:12.645386 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 17 Base level 0, inputs: [31(2185KB)], [29(10MB)]
- 2017-07-11 13:58:12.647354 I | rook-ceph-mon0:
- 2017-07-11 13:58:12.647365 I | rook-ceph-mon0: 2017-07-11 13:58:12.645396 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781492645388, "job": 18, "event": "compaction_started", "files_L0": [31], "files_L1": [29], "score": -1, "input_data_size": 13077542}
- 2017-07-11 13:58:12.784986 I | rook-ceph-mon0: 2017-07-11 13:58:12.784936 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 18] Generated table #32: 1801 keys, 12652491 bytes
- 2017-07-11 13:58:12.785177 I | rook-ceph-mon0: 2017-07-11 13:58:12.785087 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781492785077, "cf_name": "default", "job": 18, "event": "table_file_creation", "file_number": 32, "file_size": 12652491, "table_properties": {"data_size": 12610128, "index_size": 41544, "filter_size": 0, "raw_key_size": 33108, "raw_average_key_size": 18, "raw_value_size": 12556278, "raw_average_value_size": 6971, "num_data_blocks": 1313, "num_entries": 1801, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:58:12.847549 I | rook-ceph-mon0: 2017-07-11 13:58:12.847495 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 18] Compacted 1@0 + 1@1 files to L1 => 12652491 bytes
- 2017-07-11 13:58:12.863347 I | rook-ceph-mon0: 2017-07-11 13:58:12.863309 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.863237) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 64.7 rd, 62.6 wr, level 1, files in(1, 1) out(1) MB in(2.1, 10.3) out(12.1), read-write-amplify(11.5) write-amplify(5.7) OK, records in: 2123, records dropped: 322
- 2017-07-11 13:58:12.863405 I | rook-ceph-mon0:
- 2017-07-11 13:58:12.863440 I | rook-ceph-mon0: 2017-07-11 13:58:12.863424 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.863259) EVENT_LOG_v1 {"time_micros": 1499781492863250, "job": 18, "event": "compaction_finished", "compaction_time_micros": 202076, "output_level": 1, "num_output_files": 1, "total_output_size": 12652491, "num_input_records": 2123, "num_output_records": 1801, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:58:12.863988 I | rook-ceph-mon0: 2017-07-11 13:58:12.863973 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781492863970, "job": 18, "event": "table_file_deletion", "file_number": 31}
- 2017-07-11 13:58:12.865384 I | rook-ceph-mon0: 2017-07-11 13:58:12.865370 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781492865367, "job": 18, "event": "table_file_deletion", "file_number": 29}
- 2017-07-11 13:58:12.865452 I | rook-ceph-mon0: 2017-07-11 13:58:12.865437 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:58:21.791681 I | rook-ceph-mon0: 2017-07-11 13:58:21.791645 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:58:21.791917 I | rook-ceph-mon0: 2017-07-11 13:58:21.791884 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/243691609' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:58:32.720581 I | rook-ceph-mon0: 2017-07-11 13:58:32.720543 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:58:32.720814 I | rook-ceph-mon0: 2017-07-11 13:58:32.720785 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3455180572' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:58:42.060565 I | rook-ceph-mon0: 2017-07-11 13:58:42.060497 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #33. Immutable memtables: 0.
- 2017-07-11 13:58:42.060582 I | rook-ceph-mon0:
- 2017-07-11 13:58:42.060586 I | rook-ceph-mon0: 2017-07-11 13:58:42.060526 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 19] Syncing log #30
- 2017-07-11 13:58:42.076503 I | rook-ceph-mon0: 2017-07-11 13:58:42.075868 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.060521) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:58:42.076516 I | rook-ceph-mon0: 2017-07-11 13:58:42.075878 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 19] Flushing memtable with next log file: 33
- 2017-07-11 13:58:42.076519 I | rook-ceph-mon0:
- 2017-07-11 13:58:42.076523 I | rook-ceph-mon0: 2017-07-11 13:58:42.075888 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522075883, "job": 19, "event": "flush_started", "num_memtables": 1, "num_entries": 362, "num_deletes": 251, "memory_usage": 266240}
- 2017-07-11 13:58:42.076526 I | rook-ceph-mon0: 2017-07-11 13:58:42.075890 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 19] Level-0 flush table #34: started
- 2017-07-11 13:58:42.107779 I | rook-ceph-mon0: 2017-07-11 13:58:42.107707 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522107696, "cf_name": "default", "job": 19, "event": "table_file_creation", "file_number": 34, "file_size": 257113, "table_properties": {"data_size": 255198, "index_size": 1101, "filter_size": 0, "raw_key_size": 5155, "raw_average_key_size": 17, "raw_value_size": 250502, "raw_average_value_size": 849, "num_data_blocks": 36, "num_entries": 295, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:58:42.107799 I | rook-ceph-mon0: 2017-07-11 13:58:42.107718 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 19] Level-0 flush table #34: 257113 bytes OK
- 2017-07-11 13:58:42.158669 I | rook-ceph-mon0: 2017-07-11 13:58:42.155795 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.122939) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #34 started
- 2017-07-11 13:58:42.158749 I | rook-ceph-mon0: 2017-07-11 13:58:42.155802 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.155750) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #34: memtable #1 done
- 2017-07-11 13:58:42.158774 I | rook-ceph-mon0: 2017-07-11 13:58:42.155804 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.155769) EVENT_LOG_v1 {"time_micros": 1499781522155763, "job": 19, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:58:42.158803 I | rook-ceph-mon0: 2017-07-11 13:58:42.155805 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.155784) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:58:42.158819 I | rook-ceph-mon0:
- 2017-07-11 13:58:42.158831 I | rook-ceph-mon0: 2017-07-11 13:58:42.155810 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 19] Try to delete WAL files size 256347, prev total WAL file size 256347, number of live WAL files 2.
- 2017-07-11 13:58:42.158852 I | rook-ceph-mon0:
- 2017-07-11 13:58:42.158877 I | rook-ceph-mon0: 2017-07-11 13:58:42.155943 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:58:42.158890 I | rook-ceph-mon0: 2017-07-11 13:58:42.155975 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.155969) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 13:58:42.158901 I | rook-ceph-mon0:
- 2017-07-11 13:58:42.158913 I | rook-ceph-mon0: 2017-07-11 13:58:42.155979 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 20] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:58:42.158925 I | rook-ceph-mon0: 2017-07-11 13:58:42.155984 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 19 Base level 0, inputs: [34(251KB)], [32(12MB)]
- 2017-07-11 13:58:42.158935 I | rook-ceph-mon0:
- 2017-07-11 13:58:42.158959 I | rook-ceph-mon0: 2017-07-11 13:58:42.155993 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522155986, "job": 20, "event": "compaction_started", "files_L0": [34], "files_L1": [32], "score": -1, "input_data_size": 12909604}
- 2017-07-11 13:58:42.390800 I | rook-ceph-mon0: 2017-07-11 13:58:42.390747 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 20] Generated table #35: 1587 keys, 11020217 bytes
- 2017-07-11 13:58:42.391026 I | rook-ceph-mon0: 2017-07-11 13:58:42.390903 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522390893, "cf_name": "default", "job": 20, "event": "table_file_creation", "file_number": 35, "file_size": 11020217, "table_properties": {"data_size": 10984185, "index_size": 35213, "filter_size": 0, "raw_key_size": 29534, "raw_average_key_size": 18, "raw_value_size": 10937545, "raw_average_value_size": 6891, "num_data_blocks": 1099, "num_entries": 1587, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:58:42.485248 I | rook-ceph-mon0: 2017-07-11 13:58:42.485196 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 20] Compacted 1@0 + 1@1 files to L1 => 11020217 bytes
- 2017-07-11 13:58:42.548855 I | rook-ceph-mon0: 2017-07-11 13:58:42.548808 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.548726) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 39.2 rd, 33.5 wr, level 1, files in(1, 1) out(1) MB in(0.2, 12.1) out(10.5), read-write-amplify(93.1) write-amplify(42.9) OK, records in: 2096, records dropped: 509
- 2017-07-11 13:58:42.548942 I | rook-ceph-mon0:
- 2017-07-11 13:58:42.549004 I | rook-ceph-mon0: 2017-07-11 13:58:42.548962 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.548754) EVENT_LOG_v1 {"time_micros": 1499781522548745, "job": 20, "event": "compaction_finished", "compaction_time_micros": 329177, "output_level": 1, "num_output_files": 1, "total_output_size": 11020217, "num_input_records": 2096, "num_output_records": 1587, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:58:42.549262 I | rook-ceph-mon0: 2017-07-11 13:58:42.549247 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522549244, "job": 20, "event": "table_file_deletion", "file_number": 34}
- 2017-07-11 13:58:42.551524 I | rook-ceph-mon0: 2017-07-11 13:58:42.551507 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522551503, "job": 20, "event": "table_file_deletion", "file_number": 32}
- 2017-07-11 13:58:43.612452 I | rook-ceph-mon0: 2017-07-11 13:58:43.612415 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:58:43.612656 I | rook-ceph-mon0: 2017-07-11 13:58:43.612581 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/161293055' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:58:45.561912 I | rook-ceph-mon0: 2017-07-11 13:58:45.561744 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 13:59:05.842445 I | rook-ceph-mon0: 2017-07-11 13:59:05.842399 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:59:05.842687 I | rook-ceph-mon0: 2017-07-11 13:59:05.842670 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/921434838' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:59:16.760622 I | rook-ceph-mon0: 2017-07-11 13:59:16.760584 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:59:16.760857 I | rook-ceph-mon0: 2017-07-11 13:59:16.760827 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2260819532' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:59:35.513825 I | rook-ceph-mon0: 2017-07-11 13:59:35.513790 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0762522s > max 0.05s
- 2017-07-11 13:59:35.518865 I | rook-ceph-mon0: 2017-07-11 13:59:35.518841 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.112485s > max 0.05s
- 2017-07-11 13:59:35.736779 I | rook-ceph-mon0: 2017-07-11 13:59:35.513856 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 450 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0762522s > max 0.05s
- 2017-07-11 13:59:35.736901 I | rook-ceph-mon0: 2017-07-11 13:59:35.518886 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 451 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.112485s > max 0.05s
- 2017-07-11 13:59:38.610689 I | rook-ceph-mon0: 2017-07-11 13:59:38.610651 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:59:38.611577 I | rook-ceph-mon0: 2017-07-11 13:59:38.611055 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1844877036' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:59:45.562294 I | rook-ceph-mon0: 2017-07-11 13:59:45.562228 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 14:00:00.000462 I | rook-ceph-mon0: 2017-07-11 14:00:00.000368 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:00:00.295573 I | rook-ceph-mon0: 2017-07-11 14:00:00.000377 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 453 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:00:08.048127 I | rook-ceph-mon0: 2017-07-11 14:00:08.048086 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:00:08.048321 I | rook-ceph-mon0: 2017-07-11 14:00:08.048237 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1495818739' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:00:11.629083 I | rook-ceph-mon0: 2017-07-11 14:00:11.629043 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:00:11.629335 I | rook-ceph-mon0: 2017-07-11 14:00:11.629195 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2435320587' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:00:44.391528 I | rook-ceph-mon0: 2017-07-11 14:00:44.391490 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:00:44.391753 I | rook-ceph-mon0: 2017-07-11 14:00:44.391639 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4290474187' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:00:45.562903 I | rook-ceph-mon0: 2017-07-11 14:00:45.562750 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 14:01:06.307549 I | rook-ceph-mon0: 2017-07-11 14:01:06.307508 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:01:06.307617 I | rook-ceph-mon0: 2017-07-11 14:01:06.307601 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/212236582' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:01:16.767575 I | rook-ceph-mon0: 2017-07-11 14:01:16.767536 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:01:16.767813 I | rook-ceph-mon0: 2017-07-11 14:01:16.767692 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1517113134' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:01:45.563353 I | rook-ceph-mon0: 2017-07-11 14:01:45.563186 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 14:01:50.504139 I | rook-ceph-mon0: 2017-07-11 14:01:50.504100 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:01:50.504206 I | rook-ceph-mon0: 2017-07-11 14:01:50.504191 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1017678233' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:02:12.380216 I | rook-ceph-mon0: 2017-07-11 14:02:12.380169 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:02:12.380287 I | rook-ceph-mon0: 2017-07-11 14:02:12.380271 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2626095315' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:02:23.304028 I | rook-ceph-mon0: 2017-07-11 14:02:23.303949 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:02:23.304124 I | rook-ceph-mon0: 2017-07-11 14:02:23.303970 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1762333870' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:02:34.245181 I | rook-ceph-mon0: 2017-07-11 14:02:34.245121 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:02:34.245421 I | rook-ceph-mon0: 2017-07-11 14:02:34.245305 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4264287526' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:02:45.145069 I | rook-ceph-mon0: 2017-07-11 14:02:45.145029 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:02:45.145266 I | rook-ceph-mon0: 2017-07-11 14:02:45.145179 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4155315363' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:02:45.572335 I | rook-ceph-mon0: 2017-07-11 14:02:45.572175 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 14:02:56.120177 I | rook-ceph-mon0: 2017-07-11 14:02:56.120137 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:02:56.120389 I | rook-ceph-mon0: 2017-07-11 14:02:56.120289 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2416968138' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:03:40.005454 I | rook-ceph-mon0: 2017-07-11 14:03:40.005415 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:03:40.005668 I | rook-ceph-mon0: 2017-07-11 14:03:40.005565 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2218828700' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:03:45.572530 I | rook-ceph-mon0: 2017-07-11 14:03:45.572395 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 14:03:51.109983 I | rook-ceph-mon0: 2017-07-11 14:03:51.109936 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:03:51.110054 I | rook-ceph-mon0: 2017-07-11 14:03:51.110037 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1780834448' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:04:35.520439 I | rook-ceph-mon0: 2017-07-11 14:04:35.520398 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.077392s > max 0.05s
- 2017-07-11 14:04:35.520835 I | rook-ceph-mon0: 2017-07-11 14:04:35.520819 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.141366s > max 0.05s
- 2017-07-11 14:04:35.536433 I | rook-ceph-mon0: 2017-07-11 14:04:35.536399 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:04:35.536543 I | rook-ceph-mon0: 2017-07-11 14:04:35.536528 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3923039863' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:04:35.777014 I | rook-ceph-mon0: 2017-07-11 14:04:35.520533 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 467 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.077392s > max 0.05s
- 2017-07-11 14:04:35.777121 I | rook-ceph-mon0: 2017-07-11 14:04:35.520874 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 468 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.141366s > max 0.05s
- 2017-07-11 14:04:45.572773 I | rook-ceph-mon0: 2017-07-11 14:04:45.572594 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 14:04:46.584319 I | rook-ceph-mon0: 2017-07-11 14:04:46.584269 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:04:46.584537 I | rook-ceph-mon0: 2017-07-11 14:04:46.584423 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4280762459' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:04:57.532954 I | rook-ceph-mon0: 2017-07-11 14:04:57.532916 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:04:57.533167 I | rook-ceph-mon0: 2017-07-11 14:04:57.533074 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/734911855' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:05:08.529941 I | rook-ceph-mon0: 2017-07-11 14:05:08.529902 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:05:08.530169 I | rook-ceph-mon0: 2017-07-11 14:05:08.530127 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3628802119' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:05:18.243597 I | rook-ceph-mon0: 2017-07-11 14:05:18.243559 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:05:18.243808 I | rook-ceph-mon0: 2017-07-11 14:05:18.243706 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2634217029' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:05:20.472410 I | rook-ceph-mon0: 2017-07-11 14:05:20.472369 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"} v 0) v1
- 2017-07-11 14:05:20.472623 I | rook-ceph-mon0: 2017-07-11 14:05:20.472519 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.4559 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:05:20.913437 I | rook-ceph-mon0: 2017-07-11 14:05:20.397690 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 101 : audit [INF] from='client.? 10.233.99.0:0/695457415' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:05:20.913528 I | rook-ceph-mon0: 2017-07-11 14:05:20.472654 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 474 : audit [INF] from='client.4559 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:05:30.443520 I | rook-ceph-mon0: 2017-07-11 14:05:30.443480 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:05:30.443714 I | rook-ceph-mon0: 2017-07-11 14:05:30.443622 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1877647602' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:05:30.994987 I | rook-ceph-mon0: 2017-07-11 14:05:30.994889 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #36. Immutable memtables: 0.
- 2017-07-11 14:05:30.995116 I | rook-ceph-mon0:
- 2017-07-11 14:05:30.995319 I | rook-ceph-mon0: 2017-07-11 14:05:30.994930 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 21] Syncing log #33
- 2017-07-11 14:05:31.014626 I | rook-ceph-mon0: 2017-07-11 14:05:31.011599 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:05:30.994925) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:05:31.014711 I | rook-ceph-mon0: 2017-07-11 14:05:31.011615 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 21] Flushing memtable with next log file: 36
- 2017-07-11 14:05:31.014730 I | rook-ceph-mon0:
- 2017-07-11 14:05:31.014745 I | rook-ceph-mon0: 2017-07-11 14:05:31.011629 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931011623, "job": 21, "event": "flush_started", "num_memtables": 1, "num_entries": 1854, "num_deletes": 251, "memory_usage": 3859800}
- 2017-07-11 14:05:31.014757 I | rook-ceph-mon0: 2017-07-11 14:05:31.011631 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 21] Level-0 flush table #37: started
- 2017-07-11 14:05:31.073406 I | rook-ceph-mon0: 2017-07-11 14:05:31.073354 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931073343, "cf_name": "default", "job": 21, "event": "table_file_creation", "file_number": 37, "file_size": 3814701, "table_properties": {"data_size": 3798004, "index_size": 15879, "filter_size": 0, "raw_key_size": 15057, "raw_average_key_size": 18, "raw_value_size": 3775761, "raw_average_value_size": 4672, "num_data_blocks": 506, "num_entries": 808, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:05:31.073525 I | rook-ceph-mon0: 2017-07-11 14:05:31.073506 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 21] Level-0 flush table #37: 3814701 bytes OK
- 2017-07-11 14:05:31.152066 I | rook-ceph-mon0: 2017-07-11 14:05:31.152020 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.123103) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #37 started
- 2017-07-11 14:05:31.152352 I | rook-ceph-mon0: 2017-07-11 14:05:31.152333 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.151960) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #37: memtable #1 done
- 2017-07-11 14:05:31.152408 I | rook-ceph-mon0: 2017-07-11 14:05:31.152393 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.151985) EVENT_LOG_v1 {"time_micros": 1499781931151978, "job": 21, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:05:31.152440 I | rook-ceph-mon0: 2017-07-11 14:05:31.152427 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.152002) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:05:31.152470 I | rook-ceph-mon0:
- 2017-07-11 14:05:31.152504 I | rook-ceph-mon0: 2017-07-11 14:05:31.152491 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 21] Try to delete WAL files size 3823446, prev total WAL file size 3823446, number of live WAL files 2.
- 2017-07-11 14:05:31.152518 I | rook-ceph-mon0:
- 2017-07-11 14:05:31.154534 I | rook-ceph-mon0: 2017-07-11 14:05:31.153640 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:05:31.154592 I | rook-ceph-mon0: 2017-07-11 14:05:31.153683 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.153677) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:05:31.154611 I | rook-ceph-mon0:
- 2017-07-11 14:05:31.154624 I | rook-ceph-mon0: 2017-07-11 14:05:31.153689 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 22] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:05:31.154652 I | rook-ceph-mon0: 2017-07-11 14:05:31.153694 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 21 Base level 0, inputs: [37(3725KB)], [35(10MB)]
- 2017-07-11 14:05:31.154666 I | rook-ceph-mon0:
- 2017-07-11 14:05:31.154678 I | rook-ceph-mon0: 2017-07-11 14:05:31.153705 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931153697, "job": 22, "event": "compaction_started", "files_L0": [37], "files_L1": [35], "score": -1, "input_data_size": 14834918}
- 2017-07-11 14:05:31.452083 I | rook-ceph-mon0: 2017-07-11 14:05:31.452031 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 22] Generated table #38: 1886 keys, 12960721 bytes
- 2017-07-11 14:05:31.452149 I | rook-ceph-mon0: 2017-07-11 14:05:31.452131 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931452120, "cf_name": "default", "job": 22, "event": "table_file_creation", "file_number": 38, "file_size": 12960721, "table_properties": {"data_size": 12916296, "index_size": 43606, "filter_size": 0, "raw_key_size": 35370, "raw_average_key_size": 18, "raw_value_size": 12859624, "raw_average_value_size": 6818, "num_data_blocks": 1353, "num_entries": 1886, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:05:31.501148 I | rook-ceph-mon0: 2017-07-11 14:05:31.501099 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 22] Compacted 1@0 + 1@1 files to L1 => 12960721 bytes
- 2017-07-11 14:05:31.615625 I | rook-ceph-mon0: 2017-07-11 14:05:31.615582 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:05:31.615692 I | rook-ceph-mon0: 2017-07-11 14:05:31.615677 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3649452449' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:05:31.620674 I | rook-ceph-mon0: 2017-07-11 14:05:31.620643 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.620576) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 42.7 rd, 37.3 wr, level 1, files in(1, 1) out(1) MB in(3.6, 10.5) out(12.4), read-write-amplify(7.3) write-amplify(3.4) OK, records in: 2395, records dropped: 509
- 2017-07-11 14:05:31.620691 I | rook-ceph-mon0:
- 2017-07-11 14:05:31.620722 I | rook-ceph-mon0: 2017-07-11 14:05:31.620705 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.620593) EVENT_LOG_v1 {"time_micros": 1499781931620585, "job": 22, "event": "compaction_finished", "compaction_time_micros": 347371, "output_level": 1, "num_output_files": 1, "total_output_size": 12960721, "num_input_records": 2395, "num_output_records": 1886, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:05:31.621586 I | rook-ceph-mon0: 2017-07-11 14:05:31.621567 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931621564, "job": 22, "event": "table_file_deletion", "file_number": 37}
- 2017-07-11 14:05:31.623045 I | rook-ceph-mon0: 2017-07-11 14:05:31.623029 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931623026, "job": 22, "event": "table_file_deletion", "file_number": 35}
- 2017-07-11 14:05:41.372080 I | rook-ceph-mon0: 2017-07-11 14:05:41.372041 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:05:41.372148 I | rook-ceph-mon0: 2017-07-11 14:05:41.372133 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3737187887' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:05:45.573013 I | rook-ceph-mon0: 2017-07-11 14:05:45.572841 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4820 MB, avail 94366 MB
- 2017-07-11 14:05:52.432275 I | rook-ceph-mon0: 2017-07-11 14:05:52.432230 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:05:52.432490 I | rook-ceph-mon0: 2017-07-11 14:05:52.432387 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/958150779' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:06:04.937139 I | rook-ceph-mon0: 2017-07-11 14:06:04.937101 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:06:04.937371 I | rook-ceph-mon0: 2017-07-11 14:06:04.937330 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/203414200' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:06:14.428135 I | rook-ceph-mon0: 2017-07-11 14:06:14.428091 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:06:14.428203 I | rook-ceph-mon0: 2017-07-11 14:06:14.428188 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/815757470' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:06:15.940838 I | rook-ceph-mon0: 2017-07-11 14:06:15.940798 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:06:15.941052 I | rook-ceph-mon0: 2017-07-11 14:06:15.940950 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/684891685' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:06:36.244947 I | rook-ceph-mon0: 2017-07-11 14:06:36.244910 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:06:36.245158 I | rook-ceph-mon0: 2017-07-11 14:06:36.245056 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/482790556' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:06:37.713034 I | rook-ceph-mon0: 2017-07-11 14:06:37.712912 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #39. Immutable memtables: 0.
- 2017-07-11 14:06:37.713124 I | rook-ceph-mon0:
- 2017-07-11 14:06:37.713143 I | rook-ceph-mon0: 2017-07-11 14:06:37.712941 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 23] Syncing log #36
- 2017-07-11 14:06:37.736989 I | rook-ceph-mon0: 2017-07-11 14:06:37.735826 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:06:37.712936) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:06:37.737065 I | rook-ceph-mon0: 2017-07-11 14:06:37.735838 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 23] Flushing memtable with next log file: 39
- 2017-07-11 14:06:37.737085 I | rook-ceph-mon0:
- 2017-07-11 14:06:37.737099 I | rook-ceph-mon0: 2017-07-11 14:06:37.735849 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781997735844, "job": 23, "event": "flush_started", "num_memtables": 1, "num_entries": 546, "num_deletes": 250, "memory_usage": 738568}
- 2017-07-11 14:06:37.737111 I | rook-ceph-mon0: 2017-07-11 14:06:37.735851 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 23] Level-0 flush table #40: started
- 2017-07-11 14:06:37.794926 I | rook-ceph-mon0: 2017-07-11 14:06:37.794875 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781997794865, "cf_name": "default", "job": 23, "event": "table_file_creation", "file_number": 40, "file_size": 553676, "table_properties": {"data_size": 550883, "index_size": 1979, "filter_size": 0, "raw_key_size": 6579, "raw_average_key_size": 19, "raw_value_size": 544999, "raw_average_value_size": 1636, "num_data_blocks": 65, "num_entries": 333, "filter_policy_name": "", "kDeletedKeys": "250", "kMergeOperands": "0"}}
- 2017-07-11 14:06:37.795037 I | rook-ceph-mon0: 2017-07-11 14:06:37.795020 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 23] Level-0 flush table #40: 553676 bytes OK
- 2017-07-11 14:06:37.854186 I | rook-ceph-mon0: 2017-07-11 14:06:37.854146 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:06:37.824659) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #40 started
- 2017-07-11 14:06:37.854287 I | rook-ceph-mon0: 2017-07-11 14:06:37.854270 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:06:37.854105) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #40: memtable #1 done
- 2017-07-11 14:06:37.854406 I | rook-ceph-mon0: 2017-07-11 14:06:37.854367 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:06:37.854119) EVENT_LOG_v1 {"time_micros": 1499781997854114, "job": 23, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:06:37.854461 I | rook-ceph-mon0: 2017-07-11 14:06:37.854430 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:06:37.854135) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:06:37.854476 I | rook-ceph-mon0:
- 2017-07-11 14:06:37.854507 I | rook-ceph-mon0: 2017-07-11 14:06:37.854495 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 23] Try to delete WAL files size 725906, prev total WAL file size 725906, number of live WAL files 2.
- 2017-07-11 14:06:37.854542 I | rook-ceph-mon0:
- 2017-07-11 14:06:37.856012 I | rook-ceph-mon0: 2017-07-11 14:06:37.854862 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:06:37.856073 I | rook-ceph-mon0: 2017-07-11 14:06:37.854896 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:06:37.854890) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:06:37.856091 I | rook-ceph-mon0:
- 2017-07-11 14:06:37.856103 I | rook-ceph-mon0: 2017-07-11 14:06:37.854900 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 24] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:06:37.856130 I | rook-ceph-mon0: 2017-07-11 14:06:37.854905 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 23 Base level 0, inputs: [40(540KB)], [38(12MB)]
- 2017-07-11 14:06:37.856143 I | rook-ceph-mon0:
- 2017-07-11 14:06:37.856155 I | rook-ceph-mon0: 2017-07-11 14:06:37.854915 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781997854907, "job": 24, "event": "compaction_started", "files_L0": [40], "files_L1": [38], "score": -1, "input_data_size": 13514397}
- 2017-07-11 14:06:37.931377 I | rook-ceph-mon0: 2017-07-11 14:06:37.931203 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:06:37.931468 I | rook-ceph-mon0: 2017-07-11 14:06:37.931226 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3643503602' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:06:37.969910 I | rook-ceph-mon0: 2017-07-11 14:06:37.969861 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 24] Generated table #41: 1738 keys, 12036285 bytes
- 2017-07-11 14:06:37.970093 I | rook-ceph-mon0: 2017-07-11 14:06:37.970012 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781997970003, "cf_name": "default", "job": 24, "event": "table_file_creation", "file_number": 41, "file_size": 12036285, "table_properties": {"data_size": 11997175, "index_size": 38291, "filter_size": 0, "raw_key_size": 32282, "raw_average_key_size": 18, "raw_value_size": 11946327, "raw_average_value_size": 6873, "num_data_blocks": 1194, "num_entries": 1738, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:06:38.134668 I | rook-ceph-mon0: 2017-07-11 14:06:38.134615 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 24] Compacted 1@0 + 1@1 files to L1 => 12036285 bytes
- 2017-07-11 14:06:38.188318 I | rook-ceph-mon0: 2017-07-11 14:06:38.188275 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.188199) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 48.3 rd, 43.0 wr, level 1, files in(1, 1) out(1) MB in(0.5, 12.4) out(11.5), read-write-amplify(46.1) write-amplify(21.7) OK, records in: 2219, records dropped: 481
- 2017-07-11 14:06:38.188403 I | rook-ceph-mon0:
- 2017-07-11 14:06:38.188459 I | rook-ceph-mon0: 2017-07-11 14:06:38.188424 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.188217) EVENT_LOG_v1 {"time_micros": 1499781998188209, "job": 24, "event": "compaction_finished", "compaction_time_micros": 279674, "output_level": 1, "num_output_files": 1, "total_output_size": 12036285, "num_input_records": 2219, "num_output_records": 1738, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:06:38.188818 I | rook-ceph-mon0: 2017-07-11 14:06:38.188802 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998188800, "job": 24, "event": "table_file_deletion", "file_number": 40}
- 2017-07-11 14:06:38.190591 I | rook-ceph-mon0: 2017-07-11 14:06:38.190575 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998190572, "job": 24, "event": "table_file_deletion", "file_number": 38}
- 2017-07-11 14:06:38.190971 I | rook-ceph-mon0: 2017-07-11 14:06:38.190848 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #42. Immutable memtables: 0.
- 2017-07-11 14:06:38.191019 I | rook-ceph-mon0:
- 2017-07-11 14:06:38.191036 I | rook-ceph-mon0: 2017-07-11 14:06:38.190922 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 25] Syncing log #39
- 2017-07-11 14:06:38.217086 I | rook-ceph-mon0: 2017-07-11 14:06:38.216751 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.190916) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:06:38.217167 I | rook-ceph-mon0: 2017-07-11 14:06:38.216769 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 25] Flushing memtable with next log file: 42
- 2017-07-11 14:06:38.217274 I | rook-ceph-mon0:
- 2017-07-11 14:06:38.217317 I | rook-ceph-mon0: 2017-07-11 14:06:38.216781 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998216776, "job": 25, "event": "flush_started", "num_memtables": 1, "num_entries": 3, "num_deletes": 0, "memory_usage": 8712}
- 2017-07-11 14:06:38.217333 I | rook-ceph-mon0: 2017-07-11 14:06:38.216783 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 25] Level-0 flush table #43: started
- 2017-07-11 14:06:38.233120 I | rook-ceph-mon0: 2017-07-11 14:06:38.233050 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998233040, "cf_name": "default", "job": 25, "event": "table_file_creation", "file_number": 43, "file_size": 7502, "table_properties": {"data_size": 6640, "index_size": 55, "filter_size": 0, "raw_key_size": 78, "raw_average_key_size": 26, "raw_value_size": 6526, "raw_average_value_size": 2175, "num_data_blocks": 2, "num_entries": 3, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:06:38.233194 I | rook-ceph-mon0: 2017-07-11 14:06:38.233062 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 25] Level-0 flush table #43: 7502 bytes OK
- 2017-07-11 14:06:38.264929 I | rook-ceph-mon0: 2017-07-11 14:06:38.264754 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.247256) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #43 started
- 2017-07-11 14:06:38.265009 I | rook-ceph-mon0: 2017-07-11 14:06:38.264760 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.264714) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #43: memtable #1 done
- 2017-07-11 14:06:38.265027 I | rook-ceph-mon0: 2017-07-11 14:06:38.264761 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.264728) EVENT_LOG_v1 {"time_micros": 1499781998264723, "job": 25, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:06:38.265060 I | rook-ceph-mon0: 2017-07-11 14:06:38.264763 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.264743) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:06:38.265075 I | rook-ceph-mon0:
- 2017-07-11 14:06:38.265087 I | rook-ceph-mon0: 2017-07-11 14:06:38.264770 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 25] Try to delete WAL files size 6602, prev total WAL file size 6602, number of live WAL files 2.
- 2017-07-11 14:06:38.265099 I | rook-ceph-mon0:
- 2017-07-11 14:06:38.265110 I | rook-ceph-mon0: 2017-07-11 14:06:38.264886 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:06:38.265170 I | rook-ceph-mon0: 2017-07-11 14:06:38.265154 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.265148) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:06:38.265186 I | rook-ceph-mon0:
- 2017-07-11 14:06:38.265231 I | rook-ceph-mon0: 2017-07-11 14:06:38.265216 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 26] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:06:38.265273 I | rook-ceph-mon0: 2017-07-11 14:06:38.265249 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 25 Base level 0, inputs: [43(7502B)], [41(11MB)]
- 2017-07-11 14:06:38.265301 I | rook-ceph-mon0:
- 2017-07-11 14:06:38.265336 I | rook-ceph-mon0: 2017-07-11 14:06:38.265324 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998265316, "job": 26, "event": "compaction_started", "files_L0": [43], "files_L1": [41], "score": -1, "input_data_size": 12043787}
- 2017-07-11 14:06:38.467931 I | rook-ceph-mon0: 2017-07-11 14:06:38.467878 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 26] Generated table #44: 1739 keys, 12042864 bytes
- 2017-07-11 14:06:38.468129 I | rook-ceph-mon0: 2017-07-11 14:06:38.468049 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998468039, "cf_name": "default", "job": 26, "event": "table_file_creation", "file_number": 44, "file_size": 12042864, "table_properties": {"data_size": 12003722, "index_size": 38323, "filter_size": 0, "raw_key_size": 32302, "raw_average_key_size": 18, "raw_value_size": 11952837, "raw_average_value_size": 6873, "num_data_blocks": 1195, "num_entries": 1739, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:06:38.542194 I | rook-ceph-mon0: 2017-07-11 14:06:38.542139 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 26] Compacted 1@0 + 1@1 files to L1 => 12042864 bytes
- 2017-07-11 14:06:38.571769 I | rook-ceph-mon0: 2017-07-11 14:06:38.571738 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.571653) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 43.5 rd, 43.5 wr, level 1, files in(1, 1) out(1) MB in(0.0, 11.5) out(11.5), read-write-amplify(3210.7) write-amplify(1605.3) OK, records in: 1741, records dropped: 2
- 2017-07-11 14:06:38.571825 I | rook-ceph-mon0:
- 2017-07-11 14:06:38.571862 I | rook-ceph-mon0: 2017-07-11 14:06:38.571844 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.571675) EVENT_LOG_v1 {"time_micros": 1499781998571666, "job": 26, "event": "compaction_finished", "compaction_time_micros": 276763, "output_level": 1, "num_output_files": 1, "total_output_size": 12042864, "num_input_records": 1741, "num_output_records": 1739, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:06:38.572024 I | rook-ceph-mon0: 2017-07-11 14:06:38.572010 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998572007, "job": 26, "event": "table_file_deletion", "file_number": 43}
- 2017-07-11 14:06:38.573676 I | rook-ceph-mon0: 2017-07-11 14:06:38.573662 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998573660, "job": 26, "event": "table_file_deletion", "file_number": 41}
- 2017-07-11 14:06:45.573232 I | rook-ceph-mon0: 2017-07-11 14:06:45.573062 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4819 MB, avail 94367 MB
- 2017-07-11 14:07:09.492907 I | rook-ceph-mon0: 2017-07-11 14:07:09.492866 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:07:09.493173 I | rook-ceph-mon0: 2017-07-11 14:07:09.493101 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3225260353' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:07:33.052636 I | rook-ceph-mon0: 2017-07-11 14:07:33.052596 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:07:33.052835 I | rook-ceph-mon0: 2017-07-11 14:07:33.052746 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/319451914' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:07:45.573514 I | rook-ceph-mon0: 2017-07-11 14:07:45.573354 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4819 MB, avail 94367 MB
- 2017-07-11 14:07:53.588746 I | rook-ceph-mon0: 2017-07-11 14:07:53.588703 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:07:53.588959 I | rook-ceph-mon0: 2017-07-11 14:07:53.588858 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3183834935' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:07:55.244816 I | rook-ceph-mon0: 2017-07-11 14:07:55.244779 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:07:55.244906 I | rook-ceph-mon0: 2017-07-11 14:07:55.244865 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2261929392' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:08:26.578255 I | rook-ceph-mon0: 2017-07-11 14:08:26.578215 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:08:26.578466 I | rook-ceph-mon0: 2017-07-11 14:08:26.578363 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3143276350' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:08:28.456550 I | rook-ceph-mon0: 2017-07-11 14:08:28.456512 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:08:28.456618 I | rook-ceph-mon0: 2017-07-11 14:08:28.456603 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3595583942' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:08:37.578511 I | rook-ceph-mon0: 2017-07-11 14:08:37.578473 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:08:37.578732 I | rook-ceph-mon0: 2017-07-11 14:08:37.578621 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/210961205' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:08:39.289231 I | rook-ceph-mon0: 2017-07-11 14:08:39.289192 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:08:39.289442 I | rook-ceph-mon0: 2017-07-11 14:08:39.289342 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3395415090' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:08:45.573717 I | rook-ceph-mon0: 2017-07-11 14:08:45.573585 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4819 MB, avail 94367 MB
- 2017-07-11 14:08:48.607596 I | rook-ceph-mon0: 2017-07-11 14:08:48.607558 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:08:48.607663 I | rook-ceph-mon0: 2017-07-11 14:08:48.607648 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2742926626' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:08:50.318741 I | rook-ceph-mon0: 2017-07-11 14:08:50.318684 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:08:50.318960 I | rook-ceph-mon0: 2017-07-11 14:08:50.318854 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1527178157' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:08:59.492994 I | rook-ceph-mon0: 2017-07-11 14:08:59.492955 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:08:59.493206 I | rook-ceph-mon0: 2017-07-11 14:08:59.493104 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3383059296' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:09:01.267553 I | rook-ceph-mon0: 2017-07-11 14:09:01.267507 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:09:01.267776 I | rook-ceph-mon0: 2017-07-11 14:09:01.267745 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/64265081' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:09:35.522346 I | rook-ceph-mon0: 2017-07-11 14:09:35.522280 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0783901s > max 0.05s
- 2017-07-11 14:09:35.531097 I | rook-ceph-mon0: 2017-07-11 14:09:35.531015 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.107634s > max 0.05s
- 2017-07-11 14:09:36.143339 I | rook-ceph-mon0: 2017-07-11 14:09:35.522281 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 496 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0783901s > max 0.05s
- 2017-07-11 14:09:36.143443 I | rook-ceph-mon0: 2017-07-11 14:09:35.531016 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 497 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.107634s > max 0.05s
- 2017-07-11 14:09:45.109811 I | rook-ceph-mon0: 2017-07-11 14:09:45.109772 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:09:45.110005 I | rook-ceph-mon0: 2017-07-11 14:09:45.109919 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/100676700' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:09:45.574530 I | rook-ceph-mon0: 2017-07-11 14:09:45.574370 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4819 MB, avail 94367 MB
- 2017-07-11 14:09:54.692807 I | rook-ceph-mon0: 2017-07-11 14:09:54.692750 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:09:54.693039 I | rook-ceph-mon0: 2017-07-11 14:09:54.692926 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2843426088' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:10:18.098120 I | rook-ceph-mon0: 2017-07-11 14:10:18.098081 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:10:18.098333 I | rook-ceph-mon0: 2017-07-11 14:10:18.098238 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3400505445' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:10:40.233404 I | rook-ceph-mon0: 2017-07-11 14:10:40.233366 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:10:40.233598 I | rook-ceph-mon0: 2017-07-11 14:10:40.233512 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2371720378' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:10:45.574793 I | rook-ceph-mon0: 2017-07-11 14:10:45.574627 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4820 MB, avail 94367 MB
- 2017-07-11 14:10:49.884199 I | rook-ceph-mon0: 2017-07-11 14:10:49.884118 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:10:49.884553 I | rook-ceph-mon0: 2017-07-11 14:10:49.884534 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2746266823' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:10:51.233829 I | rook-ceph-mon0: 2017-07-11 14:10:51.233790 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:10:51.234106 I | rook-ceph-mon0: 2017-07-11 14:10:51.234051 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2269588836' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:11:11.815923 I | rook-ceph-mon0: 2017-07-11 14:11:11.815885 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:11:11.816160 I | rook-ceph-mon0: 2017-07-11 14:11:11.816144 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/584405822' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:11:24.741549 I | rook-ceph-mon0: 2017-07-11 14:11:24.741510 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:11:24.741761 I | rook-ceph-mon0: 2017-07-11 14:11:24.741661 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2096677065' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:11:33.927462 I | rook-ceph-mon0: 2017-07-11 14:11:33.927425 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:11:33.927723 I | rook-ceph-mon0: 2017-07-11 14:11:33.927569 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1226821768' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:11:36.866797 I | rook-ceph-mon0: 2017-07-11 14:11:36.866710 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #45. Immutable memtables: 0.
- 2017-07-11 14:11:36.866878 I | rook-ceph-mon0:
- 2017-07-11 14:11:36.866899 I | rook-ceph-mon0: 2017-07-11 14:11:36.866749 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 27] Syncing log #42
- 2017-07-11 14:11:36.904809 I | rook-ceph-mon0: 2017-07-11 14:11:36.902840 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:11:36.866744) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:11:36.904898 I | rook-ceph-mon0: 2017-07-11 14:11:36.902849 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 27] Flushing memtable with next log file: 45
- 2017-07-11 14:11:36.904915 I | rook-ceph-mon0:
- 2017-07-11 14:11:36.904946 I | rook-ceph-mon0: 2017-07-11 14:11:36.902862 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782296902857, "job": 27, "event": "flush_started", "num_memtables": 1, "num_entries": 1594, "num_deletes": 251, "memory_usage": 3327280}
- 2017-07-11 14:11:36.904959 I | rook-ceph-mon0: 2017-07-11 14:11:36.902866 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 27] Level-0 flush table #46: started
- 2017-07-11 14:11:37.039406 I | rook-ceph-mon0: 2017-07-11 14:11:37.039354 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782297039343, "cf_name": "default", "job": 27, "event": "table_file_creation", "file_number": 46, "file_size": 3287836, "table_properties": {"data_size": 3274049, "index_size": 12969, "filter_size": 0, "raw_key_size": 13445, "raw_average_key_size": 18, "raw_value_size": 3255001, "raw_average_value_size": 4495, "num_data_blocks": 414, "num_entries": 724, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:11:37.039601 I | rook-ceph-mon0: 2017-07-11 14:11:37.039501 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 27] Level-0 flush table #46: 3287836 bytes OK
- 2017-07-11 14:11:37.086625 I | rook-ceph-mon0: 2017-07-11 14:11:37.086582 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.055969) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #46 started
- 2017-07-11 14:11:37.086720 I | rook-ceph-mon0: 2017-07-11 14:11:37.086704 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.086525) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #46: memtable #1 done
- 2017-07-11 14:11:37.086765 I | rook-ceph-mon0: 2017-07-11 14:11:37.086739 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.086547) EVENT_LOG_v1 {"time_micros": 1499782297086540, "job": 27, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:11:37.086793 I | rook-ceph-mon0: 2017-07-11 14:11:37.086780 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.086563) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:11:37.086807 I | rook-ceph-mon0:
- 2017-07-11 14:11:37.086927 I | rook-ceph-mon0: 2017-07-11 14:11:37.086913 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 27] Try to delete WAL files size 3295116, prev total WAL file size 3295116, number of live WAL files 2.
- 2017-07-11 14:11:37.086957 I | rook-ceph-mon0:
- 2017-07-11 14:11:37.091047 I | rook-ceph-mon0: 2017-07-11 14:11:37.087701 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:11:37.091119 I | rook-ceph-mon0: 2017-07-11 14:11:37.087864 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:11:37.091142 I | rook-ceph-mon0: 2017-07-11 14:11:37.087867 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:11:37.091183 I | rook-ceph-mon0: ** DB Stats **
- 2017-07-11 14:11:37.091197 I | rook-ceph-mon0: Uptime(secs): 2871.9 total, 804.4 interval
- 2017-07-11 14:11:37.091208 I | rook-ceph-mon0: Cumulative writes: 4168 writes, 16K keys, 4168 commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.01 MB/s
- 2017-07-11 14:11:37.091219 I | rook-ceph-mon0: Cumulative WAL: 4168 writes, 4168 syncs, 1.00 writes per sync, written: 0.04 GB, 0.01 MB/s
- 2017-07-11 14:11:37.091231 I | rook-ceph-mon0: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:11:37.091242 I | rook-ceph-mon0: Interval writes: 1040 writes, 4359 keys, 1040 commit groups, 1.0 writes per commit group, ingest: 7.73 MB, 0.01 MB/s
- 2017-07-11 14:11:37.091266 I | rook-ceph-mon0: Interval WAL: 1040 writes, 1040 syncs, 1.00 writes per sync, written: 0.01 MB, 0.01 MB/s
- 2017-07-11 14:11:37.091289 I | rook-ceph-mon0: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:11:37.091301 I | rook-ceph-mon0:
- 2017-07-11 14:11:37.091312 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 14:11:37.091336 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:11:37.091349 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:11:37.091365 I | rook-ceph-mon0: L0 1/1 3.14 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 22.9 1 14 0.095 0 0
- 2017-07-11 14:11:37.091378 I | rook-ceph-mon0: L1 1/1 11.48 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 5.0 43.8 39.2 3 12 0.290 23K 4397
- 2017-07-11 14:11:37.091389 I | rook-ceph-mon0: Sum 2/2 14.62 MB 0.0 0.1 0.0 0.1 0.2 0.0 0.0 5.5 31.7 34.7 5 26 0.185 23K 4397
- 2017-07-11 14:11:37.091413 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 8.7 33.9 35.1 2 10 0.187 10K 1823
- 2017-07-11 14:11:37.091425 I | rook-ceph-mon0: Uptime(secs): 2871.9 total, 2871.9 interval
- 2017-07-11 14:11:37.091437 I | rook-ceph-mon0: Flush(GB): cumulative 0.030, interval 0.007
- 2017-07-11 14:11:37.091448 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:11:37.091459 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:11:37.091470 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:11:37.091492 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:11:37.091505 I | rook-ceph-mon0: Cumulative compaction: 0.16 GB write, 0.06 MB/s write, 0.15 GB read, 0.05 MB/s read, 4.8 seconds
- 2017-07-11 14:11:37.091516 I | rook-ceph-mon0: Interval compaction: 0.06 GB write, 0.02 MB/s write, 0.06 GB read, 0.02 MB/s read, 1.9 seconds
- 2017-07-11 14:11:37.091528 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:11:37.091540 I | rook-ceph-mon0:
- 2017-07-11 14:11:37.091551 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:11:37.091578 I | rook-ceph-mon0:
- 2017-07-11 14:11:37.091589 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 14:11:37.091600 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:11:37.091611 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:11:37.091622 I | rook-ceph-mon0: L0 1/1 3.14 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 22.9 1 14 0.095 0 0
- 2017-07-11 14:11:37.091644 I | rook-ceph-mon0: L1 1/1 11.48 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 5.0 43.8 39.2 3 12 0.290 23K 4397
- 2017-07-11 14:11:37.091657 I | rook-ceph-mon0: Sum 2/2 14.62 MB 0.0 0.1 0.0 0.1 0.2 0.0 0.0 5.5 31.7 34.7 5 26 0.185 23K 4397
- 2017-07-11 14:11:37.091668 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:11:37.091679 I | rook-ceph-mon0: Uptime(secs): 2871.9 total, 2871.9 interval
- 2017-07-11 14:11:37.091690 I | rook-ceph-mon0: Flush(GB): cumulative 0.030, interval 0.000
- 2017-07-11 14:11:37.091701 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:11:37.091725 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:11:37.091737 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:11:37.091748 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:11:37.091759 I | rook-ceph-mon0: Cumulative compaction: 0.16 GB write, 0.06 MB/s write, 0.15 GB read, 0.05 MB/s read, 4.8 seconds
- 2017-07-11 14:11:37.091770 I | rook-ceph-mon0: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:11:37.091782 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:11:37.091805 I | rook-ceph-mon0:
- 2017-07-11 14:11:37.091817 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:11:37.091828 I | rook-ceph-mon0:
- 2017-07-11 14:11:37.091839 I | rook-ceph-mon0: 2017-07-11 14:11:37.087884 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.087878) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:11:37.091850 I | rook-ceph-mon0:
- 2017-07-11 14:11:37.091861 I | rook-ceph-mon0: 2017-07-11 14:11:37.087888 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 28] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:11:37.091888 I | rook-ceph-mon0: 2017-07-11 14:11:37.087892 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 27 Base level 0, inputs: [46(3210KB)], [44(11MB)]
- 2017-07-11 14:11:37.100326 I | rook-ceph-mon0:
- 2017-07-11 14:11:37.100456 I | rook-ceph-mon0: 2017-07-11 14:11:37.087902 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782297087895, "job": 28, "event": "compaction_started", "files_L0": [46], "files_L1": [44], "score": -1, "input_data_size": 15330700}
- 2017-07-11 14:11:37.212515 I | rook-ceph-mon0: 2017-07-11 14:11:37.212463 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 28] Generated table #47: 1954 keys, 13445280 bytes
- 2017-07-11 14:11:37.212841 I | rook-ceph-mon0: 2017-07-11 14:11:37.212822 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782297212812, "cf_name": "default", "job": 28, "event": "table_file_creation", "file_number": 47, "file_size": 13445280, "table_properties": {"data_size": 13400696, "index_size": 43765, "filter_size": 0, "raw_key_size": 36526, "raw_average_key_size": 18, "raw_value_size": 13342997, "raw_average_value_size": 6828, "num_data_blocks": 1356, "num_entries": 1954, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:11:37.290401 I | rook-ceph-mon0: 2017-07-11 14:11:37.290347 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 28] Compacted 1@0 + 1@1 files to L1 => 13445280 bytes
- 2017-07-11 14:11:37.376413 I | rook-ceph-mon0: 2017-07-11 14:11:37.376363 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.376137) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 75.7 rd, 66.4 wr, level 1, files in(1, 1) out(1) MB in(3.1, 11.5) out(12.8), read-write-amplify(8.8) write-amplify(4.1) OK, records in: 2463, records dropped: 509
- 2017-07-11 14:11:37.376488 I | rook-ceph-mon0:
- 2017-07-11 14:11:37.376525 I | rook-ceph-mon0: 2017-07-11 14:11:37.376508 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.376301) EVENT_LOG_v1 {"time_micros": 1499782297376291, "job": 28, "event": "compaction_finished", "compaction_time_micros": 202421, "output_level": 1, "num_output_files": 1, "total_output_size": 13445280, "num_input_records": 2463, "num_output_records": 1954, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:11:37.377165 I | rook-ceph-mon0: 2017-07-11 14:11:37.377149 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782297377146, "job": 28, "event": "table_file_deletion", "file_number": 46}
- 2017-07-11 14:11:37.378698 I | rook-ceph-mon0: 2017-07-11 14:11:37.378683 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782297378680, "job": 28, "event": "table_file_deletion", "file_number": 44}
- 2017-07-11 14:11:45.574945 I | rook-ceph-mon0: 2017-07-11 14:11:45.574881 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4821 MB, avail 94365 MB
- 2017-07-11 14:11:47.006785 I | rook-ceph-mon0: 2017-07-11 14:11:47.006747 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:11:47.006982 I | rook-ceph-mon0: 2017-07-11 14:11:47.006895 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3974605442' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:11:56.037534 I | rook-ceph-mon0: 2017-07-11 14:11:56.037487 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:11:56.037771 I | rook-ceph-mon0: 2017-07-11 14:11:56.037752 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3657555996' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:11:57.991138 I | rook-ceph-mon0: 2017-07-11 14:11:57.991083 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:11:57.991336 I | rook-ceph-mon0: 2017-07-11 14:11:57.991247 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/208547037' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:12:19.930709 I | rook-ceph-mon0: 2017-07-11 14:12:19.930665 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:12:19.930935 I | rook-ceph-mon0: 2017-07-11 14:12:19.930904 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3968276138' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:12:29.130659 I | rook-ceph-mon0: 2017-07-11 14:12:29.130618 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:12:29.130883 I | rook-ceph-mon0: 2017-07-11 14:12:29.130848 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2465262222' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:12:42.076434 I | rook-ceph-mon0: 2017-07-11 14:12:42.076396 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:12:42.076607 I | rook-ceph-mon0: 2017-07-11 14:12:42.076534 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/859744920' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:12:45.575522 I | rook-ceph-mon0: 2017-07-11 14:12:45.575365 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4821 MB, avail 94365 MB
- 2017-07-11 14:12:51.220049 I | rook-ceph-mon0: 2017-07-11 14:12:51.220011 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:12:51.220221 I | rook-ceph-mon0: 2017-07-11 14:12:51.220147 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3471721495' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:12:53.173594 I | rook-ceph-mon0: 2017-07-11 14:12:53.173556 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:12:53.173812 I | rook-ceph-mon0: 2017-07-11 14:12:53.173781 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/531180605' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:13:04.065513 I | rook-ceph-mon0: 2017-07-11 14:13:04.065474 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:13:04.065701 I | rook-ceph-mon0: 2017-07-11 14:13:04.065616 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4188249592' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:13:13.397023 I | rook-ceph-mon0: 2017-07-11 14:13:13.396984 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:13:13.397237 I | rook-ceph-mon0: 2017-07-11 14:13:13.397132 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/16771700' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:13:15.033509 I | rook-ceph-mon0: 2017-07-11 14:13:15.033470 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:13:15.033706 I | rook-ceph-mon0: 2017-07-11 14:13:15.033620 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/809561855' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:13:24.372389 I | rook-ceph-mon0: 2017-07-11 14:13:24.372350 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:13:24.372543 I | rook-ceph-mon0: 2017-07-11 14:13:24.372518 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3926812839' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:13:26.027902 I | rook-ceph-mon0: 2017-07-11 14:13:26.027863 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:13:26.028112 I | rook-ceph-mon0: 2017-07-11 14:13:26.028009 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/960361836' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:13:28.898196 I | rook-ceph-mon0: 2017-07-11 14:13:28.898157 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:13:28.898417 I | rook-ceph-mon0: 2017-07-11 14:13:28.898399 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2592576656' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:13:45.575695 I | rook-ceph-mon0: 2017-07-11 14:13:45.575560 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4821 MB, avail 94365 MB
- 2017-07-11 14:13:48.347478 I | rook-ceph-mon0: 2017-07-11 14:13:48.347439 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:13:48.347681 I | rook-ceph-mon0: 2017-07-11 14:13:48.347594 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3111750557' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:14:08.469753 I | rook-ceph-mon0: 2017-07-11 14:14:08.469707 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:14:08.469824 I | rook-ceph-mon0: 2017-07-11 14:14:08.469807 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/548354475' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:14:10.344698 I | rook-ceph-mon0: 2017-07-11 14:14:10.344658 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:14:10.344914 I | rook-ceph-mon0: 2017-07-11 14:14:10.344883 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4220970717' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:14:19.458206 I | rook-ceph-mon0: 2017-07-11 14:14:19.458167 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:14:19.458436 I | rook-ceph-mon0: 2017-07-11 14:14:19.458406 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/994076831' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:14:21.319425 I | rook-ceph-mon0: 2017-07-11 14:14:21.319387 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:14:21.319535 I | rook-ceph-mon0: 2017-07-11 14:14:21.319520 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3623332395' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:14:23.803612 I | rook-ceph-mon0: 2017-07-11 14:14:23.803574 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:14:23.803826 I | rook-ceph-mon0: 2017-07-11 14:14:23.803722 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3260179852' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:14:27.065106 I | rook-ceph-mon0: 2017-07-11 14:14:27.065048 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:14:27.065182 I | rook-ceph-mon0: 2017-07-11 14:14:27.065168 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3870886415' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:14:30.534259 I | rook-ceph-mon0: 2017-07-11 14:14:30.534219 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:14:30.534471 I | rook-ceph-mon0: 2017-07-11 14:14:30.534369 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/17321022' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:14:32.415838 I | rook-ceph-mon0: 2017-07-11 14:14:32.415799 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:14:32.416034 I | rook-ceph-mon0: 2017-07-11 14:14:32.415948 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2821677103' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:14:35.532553 I | rook-ceph-mon0: 2017-07-11 14:14:35.532514 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0690982s > max 0.05s
- 2017-07-11 14:14:35.539399 I | rook-ceph-mon0: 2017-07-11 14:14:35.539375 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.127837s > max 0.05s
- 2017-07-11 14:14:35.662107 I | rook-ceph-mon0: 2017-07-11 14:14:35.532643 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 530 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0690982s > max 0.05s
- 2017-07-11 14:14:35.662201 I | rook-ceph-mon0: 2017-07-11 14:14:35.539479 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 531 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.127837s > max 0.05s
- 2017-07-11 14:14:37.714330 I | rook-ceph-mon0: 2017-07-11 14:14:37.714292 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:14:37.714525 I | rook-ceph-mon0: 2017-07-11 14:14:37.714440 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2073743625' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:14:43.403536 I | rook-ceph-mon0: 2017-07-11 14:14:43.403214 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:14:43.403736 I | rook-ceph-mon0: 2017-07-11 14:14:43.403650 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2363872016' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:14:45.576004 I | rook-ceph-mon0: 2017-07-11 14:14:45.575844 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4821 MB, avail 94365 MB
- 2017-07-11 14:14:52.499168 I | rook-ceph-mon0: 2017-07-11 14:14:52.499128 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:14:52.499381 I | rook-ceph-mon0: 2017-07-11 14:14:52.499284 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3566172365' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:15:02.878868 I | rook-ceph-mon0: 2017-07-11 14:15:02.878780 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #48. Immutable memtables: 0.
- 2017-07-11 14:15:02.879023 I | rook-ceph-mon0:
- 2017-07-11 14:15:02.879060 I | rook-ceph-mon0: 2017-07-11 14:15:02.878810 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 29] Syncing log #45
- 2017-07-11 14:15:02.906728 I | rook-ceph-mon0: 2017-07-11 14:15:02.904435 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:15:02.878805) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:15:02.906817 I | rook-ceph-mon0: 2017-07-11 14:15:02.904450 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 29] Flushing memtable with next log file: 48
- 2017-07-11 14:15:02.906835 I | rook-ceph-mon0:
- 2017-07-11 14:15:02.906869 I | rook-ceph-mon0: 2017-07-11 14:15:02.904461 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782502904456, "job": 29, "event": "flush_started", "num_memtables": 1, "num_entries": 1213, "num_deletes": 252, "memory_usage": 2385656}
- 2017-07-11 14:15:02.906892 I | rook-ceph-mon0: 2017-07-11 14:15:02.904463 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 29] Level-0 flush table #49: started
- 2017-07-11 14:15:03.015177 I | rook-ceph-mon0: 2017-07-11 14:15:03.015130 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782503015118, "cf_name": "default", "job": 29, "event": "table_file_creation", "file_number": 49, "file_size": 1724021, "table_properties": {"data_size": 1717164, "index_size": 6042, "filter_size": 0, "raw_key_size": 9566, "raw_average_key_size": 19, "raw_value_size": 1706109, "raw_average_value_size": 3432, "num_data_blocks": 198, "num_entries": 497, "filter_policy_name": "", "kDeletedKeys": "252", "kMergeOperands": "0"}}
- 2017-07-11 14:15:03.015288 I | rook-ceph-mon0: 2017-07-11 14:15:03.015270 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 29] Level-0 flush table #49: 1724021 bytes OK
- 2017-07-11 14:15:03.063444 I | rook-ceph-mon0: 2017-07-11 14:15:03.063400 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.034313) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #49 started
- 2017-07-11 14:15:03.063539 I | rook-ceph-mon0: 2017-07-11 14:15:03.063524 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.063330) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #49: memtable #1 done
- 2017-07-11 14:15:03.063569 I | rook-ceph-mon0: 2017-07-11 14:15:03.063556 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.063363) EVENT_LOG_v1 {"time_micros": 1499782503063358, "job": 29, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:15:03.063612 I | rook-ceph-mon0: 2017-07-11 14:15:03.063599 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.063379) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:15:03.063626 I | rook-ceph-mon0:
- 2017-07-11 14:15:03.063654 I | rook-ceph-mon0: 2017-07-11 14:15:03.063643 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 29] Try to delete WAL files size 2361083, prev total WAL file size 2361083, number of live WAL files 2.
- 2017-07-11 14:15:03.063679 I | rook-ceph-mon0:
- 2017-07-11 14:15:03.068020 I | rook-ceph-mon0: 2017-07-11 14:15:03.064337 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:15:03.068088 I | rook-ceph-mon0: 2017-07-11 14:15:03.064375 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.064370) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:15:03.068106 I | rook-ceph-mon0:
- 2017-07-11 14:15:03.068146 I | rook-ceph-mon0: 2017-07-11 14:15:03.064380 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 30] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:15:03.068158 I | rook-ceph-mon0: 2017-07-11 14:15:03.064384 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 29 Base level 0, inputs: [49(1683KB)], [47(12MB)]
- 2017-07-11 14:15:03.068169 I | rook-ceph-mon0:
- 2017-07-11 14:15:03.068180 I | rook-ceph-mon0: 2017-07-11 14:15:03.064394 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782503064386, "job": 30, "event": "compaction_started", "files_L0": [49], "files_L1": [47], "score": -1, "input_data_size": 15169301}
- 2017-07-11 14:15:03.188693 I | rook-ceph-mon0: 2017-07-11 14:15:03.188641 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 30] Generated table #50: 2036 keys, 14138661 bytes
- 2017-07-11 14:15:03.188818 I | rook-ceph-mon0: 2017-07-11 14:15:03.188798 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782503188788, "cf_name": "default", "job": 30, "event": "table_file_creation", "file_number": 50, "file_size": 14138661, "table_properties": {"data_size": 14092985, "index_size": 44857, "filter_size": 0, "raw_key_size": 37745, "raw_average_key_size": 18, "raw_value_size": 14033490, "raw_average_value_size": 6892, "num_data_blocks": 1397, "num_entries": 2036, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:15:03.238095 I | rook-ceph-mon0: 2017-07-11 14:15:03.238050 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 30] Compacted 1@0 + 1@1 files to L1 => 14138661 bytes
- 2017-07-11 14:15:03.272610 I | rook-ceph-mon0: 2017-07-11 14:15:03.272559 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.272471) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 87.4 rd, 81.4 wr, level 1, files in(1, 1) out(1) MB in(1.6, 12.8) out(13.5), read-write-amplify(17.0) write-amplify(8.2) OK, records in: 2451, records dropped: 415
- 2017-07-11 14:15:03.272694 I | rook-ceph-mon0:
- 2017-07-11 14:15:03.272730 I | rook-ceph-mon0: 2017-07-11 14:15:03.272714 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.272498) EVENT_LOG_v1 {"time_micros": 1499782503272488, "job": 30, "event": "compaction_finished", "compaction_time_micros": 173636, "output_level": 1, "num_output_files": 1, "total_output_size": 14138661, "num_input_records": 2451, "num_output_records": 2036, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:15:03.273211 I | rook-ceph-mon0: 2017-07-11 14:15:03.273195 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782503273192, "job": 30, "event": "table_file_deletion", "file_number": 49}
- 2017-07-11 14:15:03.276664 I | rook-ceph-mon0: 2017-07-11 14:15:03.276646 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782503276644, "job": 30, "event": "table_file_deletion", "file_number": 47}
- 2017-07-11 14:15:03.276743 I | rook-ceph-mon0: 2017-07-11 14:15:03.276727 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:15:03.596641 I | rook-ceph-mon0: 2017-07-11 14:15:03.596471 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:15:03.596707 I | rook-ceph-mon0: 2017-07-11 14:15:03.596494 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/827868310' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:15:15.212460 I | rook-ceph-mon0: 2017-07-11 14:15:15.212411 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:15:15.212679 I | rook-ceph-mon0: 2017-07-11 14:15:15.212571 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1675618004' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:15:28.692016 I | rook-ceph-mon0: 2017-07-11 14:15:28.691975 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:15:28.697713 I | rook-ceph-mon0: 2017-07-11 14:15:28.694693 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2876014877' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:15:37.338631 I | rook-ceph-mon0: 2017-07-11 14:15:37.338594 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:15:37.338827 I | rook-ceph-mon0: 2017-07-11 14:15:37.338740 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/60319512' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:15:39.712683 I | rook-ceph-mon0: 2017-07-11 14:15:39.712639 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:15:39.712897 I | rook-ceph-mon0: 2017-07-11 14:15:39.712862 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/565662107' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:15:45.576254 I | rook-ceph-mon0: 2017-07-11 14:15:45.576091 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4822 MB, avail 94365 MB
- 2017-07-11 14:15:48.450653 I | rook-ceph-mon0: 2017-07-11 14:15:48.450614 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:15:48.450886 I | rook-ceph-mon0: 2017-07-11 14:15:48.450764 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1057535437' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:15:53.119856 I | rook-ceph-mon0: 2017-07-11 14:15:53.119809 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:15:53.120053 I | rook-ceph-mon0: 2017-07-11 14:15:53.119966 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1904388462' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:15:54.436288 I | rook-ceph-mon0: 2017-07-11 14:15:54.436246 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:15:54.436549 I | rook-ceph-mon0: 2017-07-11 14:15:54.436532 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1560953951' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:15:54.938572 I | rook-ceph-mon0: 2017-07-11 14:15:54.938534 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:15:54.938803 I | rook-ceph-mon0: 2017-07-11 14:15:54.938675 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3050672030' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:15:56.899730 I | rook-ceph-mon0: 2017-07-11 14:15:56.899690 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:15:56.899953 I | rook-ceph-mon0: 2017-07-11 14:15:56.899912 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4119705956' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:15:58.191087 I | rook-ceph-mon0: 2017-07-11 14:15:58.191050 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:15:58.191304 I | rook-ceph-mon0: 2017-07-11 14:15:58.191195 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3012773366' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:15:59.020367 I | rook-ceph-mon0: 2017-07-11 14:15:59.020330 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:15:59.020564 I | rook-ceph-mon0: 2017-07-11 14:15:59.020477 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1410531269' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:15:59.411483 I | rook-ceph-mon0: 2017-07-11 14:15:59.411446 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:15:59.411687 I | rook-ceph-mon0: 2017-07-11 14:15:59.411669 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3870197273' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:01.941057 I | rook-ceph-mon0: 2017-07-11 14:16:01.941019 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:16:01.941480 I | rook-ceph-mon0: 2017-07-11 14:16:01.941459 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2958995727' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:16:02.716895 I | rook-ceph-mon0: 2017-07-11 14:16:02.716856 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:02.717110 I | rook-ceph-mon0: 2017-07-11 14:16:02.717006 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/887972956' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:04.310735 I | rook-ceph-mon0: 2017-07-11 14:16:04.310699 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:04.310947 I | rook-ceph-mon0: 2017-07-11 14:16:04.310848 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2395065276' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:04.792011 I | rook-ceph-mon0: 2017-07-11 14:16:04.791971 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:04.792204 I | rook-ceph-mon0: 2017-07-11 14:16:04.792120 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/74431839' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:05.369888 I | rook-ceph-mon0: 2017-07-11 14:16:05.369849 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:16:05.370081 I | rook-ceph-mon0: 2017-07-11 14:16:05.369993 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1717233976' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:16:06.634447 I | rook-ceph-mon0: 2017-07-11 14:16:06.634410 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:16:06.634674 I | rook-ceph-mon0: 2017-07-11 14:16:06.634658 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/93696304' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:16:09.187358 I | rook-ceph-mon0: 2017-07-11 14:16:09.187322 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:09.187423 I | rook-ceph-mon0: 2017-07-11 14:16:09.187408 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/19714218' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:10.003311 I | rook-ceph-mon0: 2017-07-11 14:16:10.003252 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:16:10.003469 I | rook-ceph-mon0: 2017-07-11 14:16:10.003426 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/87089531' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:16:10.455258 I | rook-ceph-mon0: 2017-07-11 14:16:10.455220 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:10.455417 I | rook-ceph-mon0: 2017-07-11 14:16:10.455401 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2743892161' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:11.151032 I | rook-ceph-mon0: 2017-07-11 14:16:11.150993 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:16:11.151192 I | rook-ceph-mon0: 2017-07-11 14:16:11.151176 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2199404134' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:16:12.945260 I | rook-ceph-mon0: 2017-07-11 14:16:12.945223 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:16:12.945829 I | rook-ceph-mon0: 2017-07-11 14:16:12.945367 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2772714915' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:16:14.174638 I | rook-ceph-mon0: 2017-07-11 14:16:14.174599 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:14.174882 I | rook-ceph-mon0: 2017-07-11 14:16:14.174864 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3961093368' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:15.875797 I | rook-ceph-mon0: 2017-07-11 14:16:15.875758 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:15.876015 I | rook-ceph-mon0: 2017-07-11 14:16:15.875936 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2627185124' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:19.204948 I | rook-ceph-mon0: 2017-07-11 14:16:19.198626 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:19.205035 I | rook-ceph-mon0: 2017-07-11 14:16:19.198647 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1424285951' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:20.076732 I | rook-ceph-mon0: 2017-07-11 14:16:20.076693 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:16:20.076928 I | rook-ceph-mon0: 2017-07-11 14:16:20.076843 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/783697226' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:16:21.796708 I | rook-ceph-mon0: 2017-07-11 14:16:21.796668 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:16:21.796929 I | rook-ceph-mon0: 2017-07-11 14:16:21.796897 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3932654387' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:16:22.790701 I | rook-ceph-mon0: 2017-07-11 14:16:22.790667 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:22.790912 I | rook-ceph-mon0: 2017-07-11 14:16:22.790807 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/363009030' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:24.004684 I | rook-ceph-mon0: 2017-07-11 14:16:24.004640 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:16:24.004896 I | rook-ceph-mon0: 2017-07-11 14:16:24.004810 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2486366715' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:16:25.796071 I | rook-ceph-mon0: 2017-07-11 14:16:25.796032 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:25.796298 I | rook-ceph-mon0: 2017-07-11 14:16:25.796181 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2084367986' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:29.463700 I | rook-ceph-mon0: 2017-07-11 14:16:29.463663 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:29.463895 I | rook-ceph-mon0: 2017-07-11 14:16:29.463809 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2559750583' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:30.367390 I | rook-ceph-mon0: 2017-07-11 14:16:30.367340 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:30.367583 I | rook-ceph-mon0: 2017-07-11 14:16:30.367498 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/743126693' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:33.090302 I | rook-ceph-mon0: 2017-07-11 14:16:33.090263 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:16:33.090378 I | rook-ceph-mon0: 2017-07-11 14:16:33.090358 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2353880362' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:16:34.899008 I | rook-ceph-mon0: 2017-07-11 14:16:34.898916 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:16:34.899088 I | rook-ceph-mon0: 2017-07-11 14:16:34.899061 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/843972477' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:16:39.778385 I | rook-ceph-mon0: 2017-07-11 14:16:39.778347 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:16:39.778571 I | rook-ceph-mon0: 2017-07-11 14:16:39.778486 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/7102475' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:16:41.175692 I | rook-ceph-mon0: 2017-07-11 14:16:41.175652 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:16:41.175907 I | rook-ceph-mon0: 2017-07-11 14:16:41.175876 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3159910953' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:16:44.067545 I | rook-ceph-mon0: 2017-07-11 14:16:44.067505 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:16:44.067718 I | rook-ceph-mon0: 2017-07-11 14:16:44.067645 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/576023949' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:16:45.140310 I | rook-ceph-mon0: 2017-07-11 14:16:45.140271 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:45.140515 I | rook-ceph-mon0: 2017-07-11 14:16:45.140429 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1637120191' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:45.576620 I | rook-ceph-mon0: 2017-07-11 14:16:45.576390 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4822 MB, avail 94364 MB
- 2017-07-11 14:16:46.004188 I | rook-ceph-mon0: 2017-07-11 14:16:46.004148 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:16:46.004398 I | rook-ceph-mon0: 2017-07-11 14:16:46.004313 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1175928430' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:16:46.223473 I | rook-ceph-mon0: 2017-07-11 14:16:46.223433 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:16:46.223598 I | rook-ceph-mon0: 2017-07-11 14:16:46.223582 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2670382932' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:16:47.654320 I | rook-ceph-mon0: 2017-07-11 14:16:47.654229 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #51. Immutable memtables: 0.
- 2017-07-11 14:16:47.654414 I | rook-ceph-mon0:
- 2017-07-11 14:16:47.654454 I | rook-ceph-mon0: 2017-07-11 14:16:47.654272 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 31] Syncing log #48
- 2017-07-11 14:16:47.672688 I | rook-ceph-mon0: 2017-07-11 14:16:47.670521 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:16:47.654267) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:16:47.672737 I | rook-ceph-mon0: 2017-07-11 14:16:47.670530 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 31] Flushing memtable with next log file: 51
- 2017-07-11 14:16:47.672755 I | rook-ceph-mon0:
- 2017-07-11 14:16:47.672768 I | rook-ceph-mon0: 2017-07-11 14:16:47.670538 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782607670534, "job": 31, "event": "flush_started", "num_memtables": 1, "num_entries": 984, "num_deletes": 251, "memory_usage": 1970488}
- 2017-07-11 14:16:47.672780 I | rook-ceph-mon0: 2017-07-11 14:16:47.670540 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 31] Level-0 flush table #52: started
- 2017-07-11 14:16:47.748594 I | rook-ceph-mon0: 2017-07-11 14:16:47.748521 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782607748510, "cf_name": "default", "job": 31, "event": "table_file_creation", "file_number": 52, "file_size": 1945599, "table_properties": {"data_size": 1938092, "index_size": 6692, "filter_size": 0, "raw_key_size": 9557, "raw_average_key_size": 18, "raw_value_size": 1926293, "raw_average_value_size": 3711, "num_data_blocks": 216, "num_entries": 519, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:16:47.748707 I | rook-ceph-mon0: 2017-07-11 14:16:47.748688 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 31] Level-0 flush table #52: 1945599 bytes OK
- 2017-07-11 14:16:47.784762 I | rook-ceph-mon0: 2017-07-11 14:16:47.784725 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:16:47.764455) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #52 started
- 2017-07-11 14:16:47.784862 I | rook-ceph-mon0: 2017-07-11 14:16:47.784824 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:16:47.784575) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #52: memtable #1 done
- 2017-07-11 14:16:47.785839 I | rook-ceph-mon0: 2017-07-11 14:16:47.784989 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:16:47.784698) EVENT_LOG_v1 {"time_micros": 1499782607784692, "job": 31, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:16:47.785904 I | rook-ceph-mon0: 2017-07-11 14:16:47.785871 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:16:47.784714) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:16:47.785922 I | rook-ceph-mon0:
- 2017-07-11 14:16:47.785981 I | rook-ceph-mon0: 2017-07-11 14:16:47.785955 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 31] Try to delete WAL files size 1949111, prev total WAL file size 1949111, number of live WAL files 2.
- 2017-07-11 14:16:47.786007 I | rook-ceph-mon0:
- 2017-07-11 14:16:47.787305 I | rook-ceph-mon0: 2017-07-11 14:16:47.786489 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:16:47.787362 I | rook-ceph-mon0: 2017-07-11 14:16:47.786537 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:16:47.786531) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:16:47.787379 I | rook-ceph-mon0:
- 2017-07-11 14:16:47.787392 I | rook-ceph-mon0: 2017-07-11 14:16:47.786542 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 32] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:16:47.787404 I | rook-ceph-mon0: 2017-07-11 14:16:47.786549 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 31 Base level 0, inputs: [52(1899KB)], [50(13MB)]
- 2017-07-11 14:16:47.787436 I | rook-ceph-mon0:
- 2017-07-11 14:16:47.787448 I | rook-ceph-mon0: 2017-07-11 14:16:47.786559 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782607786551, "job": 32, "event": "compaction_started", "files_L0": [52], "files_L1": [50], "score": -1, "input_data_size": 16084260}
- 2017-07-11 14:16:48.002261 I | rook-ceph-mon0: 2017-07-11 14:16:48.002209 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 32] Generated table #53: 2046 keys, 14155879 bytes
- 2017-07-11 14:16:48.002387 I | rook-ceph-mon0: 2017-07-11 14:16:48.002366 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782608002357, "cf_name": "default", "job": 32, "event": "table_file_creation", "file_number": 53, "file_size": 14155879, "table_properties": {"data_size": 14111065, "index_size": 43995, "filter_size": 0, "raw_key_size": 38081, "raw_average_key_size": 18, "raw_value_size": 14051983, "raw_average_value_size": 6868, "num_data_blocks": 1361, "num_entries": 2046, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:16:48.048124 I | rook-ceph-mon0: 2017-07-11 14:16:48.048076 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 32] Compacted 1@0 + 1@1 files to L1 => 14155879 bytes
- 2017-07-11 14:16:48.063754 I | rook-ceph-mon0: 2017-07-11 14:16:48.063713 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:16:48.063635) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 61.5 rd, 54.1 wr, level 1, files in(1, 1) out(1) MB in(1.9, 13.5) out(13.5), read-write-amplify(15.5) write-amplify(7.3) OK, records in: 2555, records dropped: 509
- 2017-07-11 14:16:48.063810 I | rook-ceph-mon0:
- 2017-07-11 14:16:48.063846 I | rook-ceph-mon0: 2017-07-11 14:16:48.063829 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:16:48.063656) EVENT_LOG_v1 {"time_micros": 1499782608063647, "job": 32, "event": "compaction_finished", "compaction_time_micros": 261495, "output_level": 1, "num_output_files": 1, "total_output_size": 14155879, "num_input_records": 2555, "num_output_records": 2046, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:16:48.064309 I | rook-ceph-mon0: 2017-07-11 14:16:48.064286 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782608064284, "job": 32, "event": "table_file_deletion", "file_number": 52}
- 2017-07-11 14:16:48.066092 I | rook-ceph-mon0: 2017-07-11 14:16:48.066077 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782608066075, "job": 32, "event": "table_file_deletion", "file_number": 50}
- 2017-07-11 14:16:50.372325 I | rook-ceph-mon0: 2017-07-11 14:16:50.372288 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:50.372571 I | rook-ceph-mon0: 2017-07-11 14:16:50.372549 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1764085931' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:55.014985 I | rook-ceph-mon0: 2017-07-11 14:16:55.014947 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:55.015052 I | rook-ceph-mon0: 2017-07-11 14:16:55.015037 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1240329530' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:55.029065 I | rook-ceph-mon0: 2017-07-11 14:16:55.029045 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:16:55.029127 I | rook-ceph-mon0: 2017-07-11 14:16:55.029112 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4257833029' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:16:56.101889 I | rook-ceph-mon0: 2017-07-11 14:16:56.101845 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:16:56.102107 I | rook-ceph-mon0: 2017-07-11 14:16:56.102079 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/91018375' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:16:57.078048 I | rook-ceph-mon0: 2017-07-11 14:16:57.078010 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:57.078291 I | rook-ceph-mon0: 2017-07-11 14:16:57.078175 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2051941506' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:58.609358 I | rook-ceph-mon0: 2017-07-11 14:16:58.609305 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:58.609572 I | rook-ceph-mon0: 2017-07-11 14:16:58.609480 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/267646136' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:59.953286 I | rook-ceph-mon0: 2017-07-11 14:16:59.953247 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:59.953554 I | rook-ceph-mon0: 2017-07-11 14:16:59.953537 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/649396185' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:00.880165 I | rook-ceph-mon0: 2017-07-11 14:17:00.880126 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:17:00.880387 I | rook-ceph-mon0: 2017-07-11 14:17:00.880356 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/672723051' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:17:04.105845 I | rook-ceph-mon0: 2017-07-11 14:17:04.105806 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:04.106056 I | rook-ceph-mon0: 2017-07-11 14:17:04.105955 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3728987264' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:06.031455 I | rook-ceph-mon0: 2017-07-11 14:17:06.031417 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:17:06.031665 I | rook-ceph-mon0: 2017-07-11 14:17:06.031567 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/240312914' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:17:06.159842 I | rook-ceph-mon0: 2017-07-11 14:17:06.159803 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:17:06.160089 I | rook-ceph-mon0: 2017-07-11 14:17:06.160004 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/816503008' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:17:09.019338 I | rook-ceph-mon0: 2017-07-11 14:17:09.019297 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:09.022631 I | rook-ceph-mon0: 2017-07-11 14:17:09.022611 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3765077749' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:09.946025 I | rook-ceph-mon0: 2017-07-11 14:17:09.945987 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:09.946347 I | rook-ceph-mon0: 2017-07-11 14:17:09.946330 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/459308294' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:10.856361 I | rook-ceph-mon0: 2017-07-11 14:17:10.856321 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:17:10.856617 I | rook-ceph-mon0: 2017-07-11 14:17:10.856585 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3121198454' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:17:13.390824 I | rook-ceph-mon0: 2017-07-11 14:17:13.390787 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:13.391037 I | rook-ceph-mon0: 2017-07-11 14:17:13.390934 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3824108343' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:14.290278 I | rook-ceph-mon0: 2017-07-11 14:17:14.290239 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:17:14.290466 I | rook-ceph-mon0: 2017-07-11 14:17:14.290385 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1477103684' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:17:15.924585 I | rook-ceph-mon0: 2017-07-11 14:17:15.924549 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:17:15.924824 I | rook-ceph-mon0: 2017-07-11 14:17:15.924784 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2222273544' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:17:17.068833 I | rook-ceph-mon0: 2017-07-11 14:17:17.068796 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:17:17.069059 I | rook-ceph-mon0: 2017-07-11 14:17:17.068942 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1256037538' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:17:21.856393 I | rook-ceph-mon0: 2017-07-11 14:17:21.856350 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:21.856641 I | rook-ceph-mon0: 2017-07-11 14:17:21.856537 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3373564487' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:23.342472 I | rook-ceph-mon0: 2017-07-11 14:17:23.342406 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:23.342775 I | rook-ceph-mon0: 2017-07-11 14:17:23.342741 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/656709703' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:24.283242 I | rook-ceph-mon0: 2017-07-11 14:17:24.283187 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:17:24.283437 I | rook-ceph-mon0: 2017-07-11 14:17:24.283351 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3670631202' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:17:25.830303 I | rook-ceph-mon0: 2017-07-11 14:17:25.830265 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:17:25.830563 I | rook-ceph-mon0: 2017-07-11 14:17:25.830545 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2871674757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:17:28.190808 I | rook-ceph-mon0: 2017-07-11 14:17:28.190769 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:28.190878 I | rook-ceph-mon0: 2017-07-11 14:17:28.190862 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4178607070' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:29.124535 I | rook-ceph-mon0: 2017-07-11 14:17:29.124491 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:17:29.127591 I | rook-ceph-mon0: 2017-07-11 14:17:29.124641 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1714697971' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:17:29.628813 I | rook-ceph-mon0: 2017-07-11 14:17:29.628773 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:29.628882 I | rook-ceph-mon0: 2017-07-11 14:17:29.628867 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3898834916' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:30.501931 I | rook-ceph-mon0: 2017-07-11 14:17:30.501893 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:17:30.502177 I | rook-ceph-mon0: 2017-07-11 14:17:30.502090 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1398946723' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:17:30.527826 I | rook-ceph-mon0: 2017-07-11 14:17:30.527806 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:17:30.527906 I | rook-ceph-mon0: 2017-07-11 14:17:30.527892 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2480745306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:17:31.525215 I | rook-ceph-mon0: 2017-07-11 14:17:31.525178 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:31.525461 I | rook-ceph-mon0: 2017-07-11 14:17:31.525407 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3300754928' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:33.118070 I | rook-ceph-mon0: 2017-07-11 14:17:33.118033 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:33.118268 I | rook-ceph-mon0: 2017-07-11 14:17:33.118185 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2954505700' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:34.449753 I | rook-ceph-mon0: 2017-07-11 14:17:34.449714 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:34.449946 I | rook-ceph-mon0: 2017-07-11 14:17:34.449861 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4007197897' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:36.384301 I | rook-ceph-mon0: 2017-07-11 14:17:36.384261 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:36.384517 I | rook-ceph-mon0: 2017-07-11 14:17:36.384486 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3980830835' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:38.510414 I | rook-ceph-mon0: 2017-07-11 14:17:38.510376 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:38.510673 I | rook-ceph-mon0: 2017-07-11 14:17:38.510545 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/814008215' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:38.964720 I | rook-ceph-mon0: 2017-07-11 14:17:38.964682 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:17:38.964947 I | rook-ceph-mon0: 2017-07-11 14:17:38.964931 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1707205388' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:17:39.411755 I | rook-ceph-mon0: 2017-07-11 14:17:39.411717 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:17:39.411982 I | rook-ceph-mon0: 2017-07-11 14:17:39.411950 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3084907546' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:17:41.594655 I | rook-ceph-mon0: 2017-07-11 14:17:41.594597 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:17:41.594887 I | rook-ceph-mon0: 2017-07-11 14:17:41.594783 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2058928471' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:17:42.973840 I | rook-ceph-mon0: 2017-07-11 14:17:42.973802 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:42.974035 I | rook-ceph-mon0: 2017-07-11 14:17:42.973949 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/288428101' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:43.874615 I | rook-ceph-mon0: 2017-07-11 14:17:43.874577 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:17:43.874811 I | rook-ceph-mon0: 2017-07-11 14:17:43.874724 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/192753823' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:17:45.577728 I | rook-ceph-mon0: 2017-07-11 14:17:45.577545 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4822 MB, avail 94364 MB
- 2017-07-11 14:17:46.285675 I | rook-ceph-mon0: 2017-07-11 14:17:46.285636 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:46.285872 I | rook-ceph-mon0: 2017-07-11 14:17:46.285786 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1463082103' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:48.352028 I | rook-ceph-mon0: 2017-07-11 14:17:48.351980 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:48.352109 I | rook-ceph-mon0: 2017-07-11 14:17:48.352080 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2668818949' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:50.242991 I | rook-ceph-mon0: 2017-07-11 14:17:50.242952 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:17:50.243183 I | rook-ceph-mon0: 2017-07-11 14:17:50.243100 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/782289147' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:17:51.188566 I | rook-ceph-mon0: 2017-07-11 14:17:51.188524 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:51.188635 I | rook-ceph-mon0: 2017-07-11 14:17:51.188619 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/585119557' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:52.602682 I | rook-ceph-mon0: 2017-07-11 14:17:52.602637 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:17:52.602879 I | rook-ceph-mon0: 2017-07-11 14:17:52.602792 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1606404952' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:17:55.541378 I | rook-ceph-mon0: 2017-07-11 14:17:55.541337 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:17:55.541636 I | rook-ceph-mon0: 2017-07-11 14:17:55.541618 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/771468525' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:17:56.423978 I | rook-ceph-mon0: 2017-07-11 14:17:56.423942 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:56.424188 I | rook-ceph-mon0: 2017-07-11 14:17:56.424093 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1990053878' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:00.141022 I | rook-ceph-mon0: 2017-07-11 14:18:00.140985 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:18:00.141268 I | rook-ceph-mon0: 2017-07-11 14:18:00.141215 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2055352270' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:18:02.720378 I | rook-ceph-mon0: 2017-07-11 14:18:02.720330 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:02.720526 I | rook-ceph-mon0: 2017-07-11 14:18:02.720511 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2113503512' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:03.704869 I | rook-ceph-mon0: 2017-07-11 14:18:03.704830 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:18:03.705110 I | rook-ceph-mon0: 2017-07-11 14:18:03.704981 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/306759558' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:18:04.099149 I | rook-ceph-mon0: 2017-07-11 14:18:04.099108 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:04.099363 I | rook-ceph-mon0: 2017-07-11 14:18:04.099263 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/797334025' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:09.062806 I | rook-ceph-mon0: 2017-07-11 14:18:09.062757 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:09.062992 I | rook-ceph-mon0: 2017-07-11 14:18:09.062912 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/290735704' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:09.914967 I | rook-ceph-mon0: 2017-07-11 14:18:09.914931 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:18:09.915128 I | rook-ceph-mon0: 2017-07-11 14:18:09.915060 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/691863317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:18:13.150583 I | rook-ceph-mon0: 2017-07-11 14:18:13.150546 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:13.150826 I | rook-ceph-mon0: 2017-07-11 14:18:13.150723 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3597224090' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:14.167856 I | rook-ceph-mon0: 2017-07-11 14:18:14.167816 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:14.168123 I | rook-ceph-mon0: 2017-07-11 14:18:14.167968 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2596967560' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:15.059520 I | rook-ceph-mon0: 2017-07-11 14:18:15.059483 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:18:15.059749 I | rook-ceph-mon0: 2017-07-11 14:18:15.059732 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1860890786' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:18:20.117495 I | rook-ceph-mon0: 2017-07-11 14:18:20.117453 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:18:20.117730 I | rook-ceph-mon0: 2017-07-11 14:18:20.117712 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1200532976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:18:21.092345 I | rook-ceph-mon0: 2017-07-11 14:18:21.092305 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:21.092556 I | rook-ceph-mon0: 2017-07-11 14:18:21.092457 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1325554282' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:22.528133 I | rook-ceph-mon0: 2017-07-11 14:18:22.528093 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:22.528204 I | rook-ceph-mon0: 2017-07-11 14:18:22.528188 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2319173399' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:23.037719 I | rook-ceph-mon0: 2017-07-11 14:18:23.037681 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:23.037829 I | rook-ceph-mon0: 2017-07-11 14:18:23.037814 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2364955026' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:23.541388 I | rook-ceph-mon0: 2017-07-11 14:18:23.541348 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:18:23.541632 I | rook-ceph-mon0: 2017-07-11 14:18:23.541589 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1926811139' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:18:24.022076 I | rook-ceph-mon0: 2017-07-11 14:18:24.022036 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:18:24.022288 I | rook-ceph-mon0: 2017-07-11 14:18:24.022189 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/783609287' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:18:25.724966 I | rook-ceph-mon0: 2017-07-11 14:18:25.724924 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:18:25.725223 I | rook-ceph-mon0: 2017-07-11 14:18:25.725181 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1961127607' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:18:27.947688 I | rook-ceph-mon0: 2017-07-11 14:18:27.947646 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:27.947882 I | rook-ceph-mon0: 2017-07-11 14:18:27.947797 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2059964236' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:28.395756 I | rook-ceph-mon0: 2017-07-11 14:18:28.395715 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:18:28.395946 I | rook-ceph-mon0: 2017-07-11 14:18:28.395863 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3518166594' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:18:28.880425 I | rook-ceph-mon0: 2017-07-11 14:18:28.880387 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:28.880630 I | rook-ceph-mon0: 2017-07-11 14:18:28.880545 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1316910161' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:32.322930 I | rook-ceph-mon0: 2017-07-11 14:18:32.322892 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:32.323178 I | rook-ceph-mon0: 2017-07-11 14:18:32.323042 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3361756783' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:33.259873 I | rook-ceph-mon0: 2017-07-11 14:18:33.259836 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:18:33.260069 I | rook-ceph-mon0: 2017-07-11 14:18:33.259981 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/470231187' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:18:34.917218 I | rook-ceph-mon0: 2017-07-11 14:18:34.917181 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:18:34.917428 I | rook-ceph-mon0: 2017-07-11 14:18:34.917327 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3741923061' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:18:37.274520 I | rook-ceph-mon0: 2017-07-11 14:18:37.274390 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:37.274607 I | rook-ceph-mon0: 2017-07-11 14:18:37.274413 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2013768792' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:39.613486 I | rook-ceph-mon0: 2017-07-11 14:18:39.613204 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:18:39.613523 I | rook-ceph-mon0: 2017-07-11 14:18:39.613228 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/767366045' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:18:40.530747 I | rook-ceph-mon0: 2017-07-11 14:18:40.530710 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:40.530928 I | rook-ceph-mon0: 2017-07-11 14:18:40.530847 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1723047826' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:42.192440 I | rook-ceph-mon0: 2017-07-11 14:18:42.192402 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:42.192682 I | rook-ceph-mon0: 2017-07-11 14:18:42.192665 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1213409530' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:42.636245 I | rook-ceph-mon0: 2017-07-11 14:18:42.636206 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:42.636312 I | rook-ceph-mon0: 2017-07-11 14:18:42.636297 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1457321315' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:45.578133 I | rook-ceph-mon0: 2017-07-11 14:18:45.577974 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4822 MB, avail 94364 MB
- 2017-07-11 14:18:47.579170 I | rook-ceph-mon0: 2017-07-11 14:18:47.579126 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:47.579363 I | rook-ceph-mon0: 2017-07-11 14:18:47.579278 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/643613259' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:50.605721 I | rook-ceph-mon0: 2017-07-11 14:18:50.605682 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:50.605996 I | rook-ceph-mon0: 2017-07-11 14:18:50.605964 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3022499335' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:52.079983 I | rook-ceph-mon0: 2017-07-11 14:18:52.079927 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:52.080297 I | rook-ceph-mon0: 2017-07-11 14:18:52.080274 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1749621573' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:53.439177 I | rook-ceph-mon0: 2017-07-11 14:18:53.439136 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:53.439396 I | rook-ceph-mon0: 2017-07-11 14:18:53.439289 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4015666492' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:57.002807 I | rook-ceph-mon0: 2017-07-11 14:18:57.002736 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:57.003036 I | rook-ceph-mon0: 2017-07-11 14:18:57.002999 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/877930761' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:57.238077 I | rook-ceph-mon0: 2017-07-11 14:18:57.238038 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:18:57.238201 I | rook-ceph-mon0: 2017-07-11 14:18:57.238185 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1135623838' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:18:57.454882 I | rook-ceph-mon0: 2017-07-11 14:18:57.454845 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:57.455075 I | rook-ceph-mon0: 2017-07-11 14:18:57.454990 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3619161084' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:57.914609 I | rook-ceph-mon0: 2017-07-11 14:18:57.914570 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:18:57.914674 I | rook-ceph-mon0: 2017-07-11 14:18:57.914659 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1976599879' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:18:58.813380 I | rook-ceph-mon0: 2017-07-11 14:18:58.813343 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:18:58.813572 I | rook-ceph-mon0: 2017-07-11 14:18:58.813488 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/211169955' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:19:07.310697 I | rook-ceph-mon0: 2017-07-11 14:19:07.310658 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:07.310936 I | rook-ceph-mon0: 2017-07-11 14:19:07.310805 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3397364540' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:07.771372 I | rook-ceph-mon0: 2017-07-11 14:19:07.771333 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:19:07.771630 I | rook-ceph-mon0: 2017-07-11 14:19:07.771566 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1960613316' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:19:08.239501 I | rook-ceph-mon0: 2017-07-11 14:19:08.239463 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:08.239691 I | rook-ceph-mon0: 2017-07-11 14:19:08.239606 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1791358940' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:08.306514 I | rook-ceph-mon0: 2017-07-11 14:19:08.306471 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:19:08.306704 I | rook-ceph-mon0: 2017-07-11 14:19:08.306621 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2119063947' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:19:09.309728 I | rook-ceph-mon0: 2017-07-11 14:19:09.309688 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:19:09.309951 I | rook-ceph-mon0: 2017-07-11 14:19:09.309919 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2474010525' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:19:09.929056 I | rook-ceph-mon0: 2017-07-11 14:19:09.928860 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:19:09.929079 I | rook-ceph-mon0: 2017-07-11 14:19:09.928884 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2469055754' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:19:12.316414 I | rook-ceph-mon0: 2017-07-11 14:19:12.316377 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:12.316607 I | rook-ceph-mon0: 2017-07-11 14:19:12.316520 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4274890523' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:16.783483 I | rook-ceph-mon0: 2017-07-11 14:19:16.783445 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:16.783709 I | rook-ceph-mon0: 2017-07-11 14:19:16.783599 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1865928280' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:17.229427 I | rook-ceph-mon0: 2017-07-11 14:19:17.229387 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:17.229556 I | rook-ceph-mon0: 2017-07-11 14:19:17.229540 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1187892575' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:19.228039 I | rook-ceph-mon0: 2017-07-11 14:19:19.227999 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:19:19.228261 I | rook-ceph-mon0: 2017-07-11 14:19:19.228231 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2301136688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:19:19.266018 I | rook-ceph-mon0: 2017-07-11 14:19:19.265980 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:19:19.266134 I | rook-ceph-mon0: 2017-07-11 14:19:19.266118 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1996136428' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:19:20.222440 I | rook-ceph-mon0: 2017-07-11 14:19:20.222401 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:20.222510 I | rook-ceph-mon0: 2017-07-11 14:19:20.222494 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/852345314' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:22.637737 I | rook-ceph-mon0: 2017-07-11 14:19:22.637687 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:19:22.637945 I | rook-ceph-mon0: 2017-07-11 14:19:22.637928 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2025671347' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:19:24.050748 I | rook-ceph-mon0: 2017-07-11 14:19:24.050706 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:19:24.051027 I | rook-ceph-mon0: 2017-07-11 14:19:24.051002 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2029147344' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:19:28.941215 I | rook-ceph-mon0: 2017-07-11 14:19:28.941176 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:19:28.941436 I | rook-ceph-mon0: 2017-07-11 14:19:28.941404 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2211280342' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:19:31.524476 I | rook-ceph-mon0: 2017-07-11 14:19:31.524433 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:31.524712 I | rook-ceph-mon0: 2017-07-11 14:19:31.524680 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3405085816' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:32.145760 I | rook-ceph-mon0: 2017-07-11 14:19:32.145721 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:19:32.146036 I | rook-ceph-mon0: 2017-07-11 14:19:32.145985 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2687022480' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:19:33.938163 I | rook-ceph-mon0: 2017-07-11 14:19:33.938119 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:19:33.938405 I | rook-ceph-mon0: 2017-07-11 14:19:33.938344 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1774999337' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:19:35.543024 I | rook-ceph-mon0: 2017-07-11 14:19:35.542985 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.156382s > max 0.05s
- 2017-07-11 14:19:35.551904 I | rook-ceph-mon0: 2017-07-11 14:19:35.551879 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0675102s > max 0.05s
- 2017-07-11 14:19:36.383337 I | rook-ceph-mon0: 2017-07-11 14:19:35.543148 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 675 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.156382s > max 0.05s
- 2017-07-11 14:19:36.383426 I | rook-ceph-mon0: 2017-07-11 14:19:35.551965 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 676 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0675102s > max 0.05s
- 2017-07-11 14:19:36.508263 I | rook-ceph-mon0: 2017-07-11 14:19:36.508221 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:36.508388 I | rook-ceph-mon0: 2017-07-11 14:19:36.508372 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2490522398' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:36.968177 I | rook-ceph-mon0: 2017-07-11 14:19:36.968138 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:36.968369 I | rook-ceph-mon0: 2017-07-11 14:19:36.968285 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3008788750' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:37.878540 I | rook-ceph-mon0: 2017-07-11 14:19:37.878502 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:37.878736 I | rook-ceph-mon0: 2017-07-11 14:19:37.878649 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2659079487' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:41.364166 I | rook-ceph-mon0: 2017-07-11 14:19:41.364119 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:41.364400 I | rook-ceph-mon0: 2017-07-11 14:19:41.364315 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/62923384' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:43.172017 I | rook-ceph-mon0: 2017-07-11 14:19:43.171979 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:19:43.172089 I | rook-ceph-mon0: 2017-07-11 14:19:43.172070 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2038805962' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:19:43.866739 I | rook-ceph-mon0: 2017-07-11 14:19:43.866696 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:19:43.866998 I | rook-ceph-mon0: 2017-07-11 14:19:43.866981 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1130062236' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:19:44.738480 I | rook-ceph-mon0: 2017-07-11 14:19:44.738443 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:44.738669 I | rook-ceph-mon0: 2017-07-11 14:19:44.738586 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/187792161' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:45.578362 I | rook-ceph-mon0: 2017-07-11 14:19:45.578210 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4822 MB, avail 94364 MB
- 2017-07-11 14:19:46.321567 I | rook-ceph-mon0: 2017-07-11 14:19:46.321529 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:46.321760 I | rook-ceph-mon0: 2017-07-11 14:19:46.321678 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2208891955' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:48.313841 I | rook-ceph-mon0: 2017-07-11 14:19:48.313778 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:48.314057 I | rook-ceph-mon0: 2017-07-11 14:19:48.313955 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3134258617' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:56.200934 I | rook-ceph-mon0: 2017-07-11 14:19:56.200890 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:56.201179 I | rook-ceph-mon0: 2017-07-11 14:19:56.201052 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2864410945' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:56.648891 I | rook-ceph-mon0: 2017-07-11 14:19:56.648850 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:56.649089 I | rook-ceph-mon0: 2017-07-11 14:19:56.649002 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4232589183' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:57.086065 I | rook-ceph-mon0: 2017-07-11 14:19:57.086027 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:19:57.086256 I | rook-ceph-mon0: 2017-07-11 14:19:57.086171 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2816576544' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:20:03.007479 I | rook-ceph-mon0: 2017-07-11 14:20:03.007380 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #54. Immutable memtables: 0.
- 2017-07-11 14:20:03.007585 I | rook-ceph-mon0:
- 2017-07-11 14:20:03.007669 I | rook-ceph-mon0: 2017-07-11 14:20:03.007422 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 33] Syncing log #51
- 2017-07-11 14:20:03.023185 I | rook-ceph-mon0: 2017-07-11 14:20:03.022361 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.007417) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:20:03.023236 I | rook-ceph-mon0: 2017-07-11 14:20:03.022375 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 33] Flushing memtable with next log file: 54
- 2017-07-11 14:20:03.023252 I | rook-ceph-mon0:
- 2017-07-11 14:20:03.023265 I | rook-ceph-mon0: 2017-07-11 14:20:03.022386 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803022381, "job": 33, "event": "flush_started", "num_memtables": 1, "num_entries": 2062, "num_deletes": 251, "memory_usage": 5104672}
- 2017-07-11 14:20:03.023277 I | rook-ceph-mon0: 2017-07-11 14:20:03.022388 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 33] Level-0 flush table #55: started
- 2017-07-11 14:20:03.070945 I | rook-ceph-mon0: 2017-07-11 14:20:03.070896 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803070887, "cf_name": "default", "job": 33, "event": "table_file_creation", "file_number": 55, "file_size": 5047328, "table_properties": {"data_size": 5030022, "index_size": 16486, "filter_size": 0, "raw_key_size": 16822, "raw_average_key_size": 18, "raw_value_size": 5006021, "raw_average_value_size": 5489, "num_data_blocks": 521, "num_entries": 912, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:20:03.071056 I | rook-ceph-mon0: 2017-07-11 14:20:03.071038 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 33] Level-0 flush table #55: 5047328 bytes OK
- 2017-07-11 14:20:03.100888 I | rook-ceph-mon0: 2017-07-11 14:20:03.100851 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.085947) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #55 started
- 2017-07-11 14:20:03.100974 I | rook-ceph-mon0: 2017-07-11 14:20:03.100958 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.100801) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #55: memtable #1 done
- 2017-07-11 14:20:03.101026 I | rook-ceph-mon0: 2017-07-11 14:20:03.101011 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.100818) EVENT_LOG_v1 {"time_micros": 1499782803100812, "job": 33, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:20:03.101057 I | rook-ceph-mon0: 2017-07-11 14:20:03.101044 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.100833) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:20:03.101089 I | rook-ceph-mon0:
- 2017-07-11 14:20:03.101123 I | rook-ceph-mon0: 2017-07-11 14:20:03.101110 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 33] Try to delete WAL files size 5057542, prev total WAL file size 5057542, number of live WAL files 2.
- 2017-07-11 14:20:03.101137 I | rook-ceph-mon0:
- 2017-07-11 14:20:03.103194 I | rook-ceph-mon0: 2017-07-11 14:20:03.102041 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:20:03.103261 I | rook-ceph-mon0: 2017-07-11 14:20:03.102080 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.102075) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:20:03.103283 I | rook-ceph-mon0:
- 2017-07-11 14:20:03.103311 I | rook-ceph-mon0: 2017-07-11 14:20:03.102086 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 34] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:20:03.103326 I | rook-ceph-mon0: 2017-07-11 14:20:03.102091 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 33 Base level 0, inputs: [55(4929KB)], [53(13MB)]
- 2017-07-11 14:20:03.103337 I | rook-ceph-mon0:
- 2017-07-11 14:20:03.103349 I | rook-ceph-mon0: 2017-07-11 14:20:03.102108 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803102093, "job": 34, "event": "compaction_started", "files_L0": [55], "files_L1": [53], "score": -1, "input_data_size": 19203207}
- 2017-07-11 14:20:03.307032 I | rook-ceph-mon0: 2017-07-11 14:20:03.306982 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 34] Generated table #56: 2449 keys, 17169862 bytes
- 2017-07-11 14:20:03.307095 I | rook-ceph-mon0: 2017-07-11 14:20:03.307079 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803307069, "cf_name": "default", "job": 34, "event": "table_file_creation", "file_number": 56, "file_size": 17169862, "table_properties": {"data_size": 17116089, "index_size": 52954, "filter_size": 0, "raw_key_size": 45682, "raw_average_key_size": 18, "raw_value_size": 17045211, "raw_average_value_size": 6960, "num_data_blocks": 1631, "num_entries": 2449, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:20:03.337377 I | rook-ceph-mon0: 2017-07-11 14:20:03.337324 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 34] Compacted 1@0 + 1@1 files to L1 => 17169862 bytes
- 2017-07-11 14:20:03.352278 I | rook-ceph-mon0: 2017-07-11 14:20:03.352245 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.352168) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 81.6 rd, 73.0 wr, level 1, files in(1, 1) out(1) MB in(4.8, 13.5) out(16.4), read-write-amplify(7.2) write-amplify(3.4) OK, records in: 2958, records dropped: 509
- 2017-07-11 14:20:03.352289 I | rook-ceph-mon0:
- 2017-07-11 14:20:03.352319 I | rook-ceph-mon0: 2017-07-11 14:20:03.352302 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.352188) EVENT_LOG_v1 {"time_micros": 1499782803352179, "job": 34, "event": "compaction_finished", "compaction_time_micros": 235192, "output_level": 1, "num_output_files": 1, "total_output_size": 17169862, "num_input_records": 2958, "num_output_records": 2449, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:20:03.353056 I | rook-ceph-mon0: 2017-07-11 14:20:03.353040 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803353038, "job": 34, "event": "table_file_deletion", "file_number": 55}
- 2017-07-11 14:20:03.354759 I | rook-ceph-mon0: 2017-07-11 14:20:03.354738 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803354736, "job": 34, "event": "table_file_deletion", "file_number": 53}
- 2017-07-11 14:20:03.863488 I | rook-ceph-mon0: 2017-07-11 14:20:03.863449 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:20:03.863705 I | rook-ceph-mon0: 2017-07-11 14:20:03.863673 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4161696238' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:20:05.451543 I | rook-ceph-mon0: 2017-07-11 14:20:05.451506 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:20:05.451768 I | rook-ceph-mon0: 2017-07-11 14:20:05.451648 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4151189840' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:20:06.963749 I | rook-ceph-mon0: 2017-07-11 14:20:06.963712 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:20:06.963934 I | rook-ceph-mon0: 2017-07-11 14:20:06.963852 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1023198735' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:20:08.317594 I | rook-ceph-mon0: 2017-07-11 14:20:08.317558 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:20:08.318101 I | rook-ceph-mon0: 2017-07-11 14:20:08.318083 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/637831148' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:20:11.419602 I | rook-ceph-mon0: 2017-07-11 14:20:11.419557 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:20:11.419842 I | rook-ceph-mon0: 2017-07-11 14:20:11.419800 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2756161377' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:20:11.853003 I | rook-ceph-mon0: 2017-07-11 14:20:11.852958 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:20:11.853222 I | rook-ceph-mon0: 2017-07-11 14:20:11.853112 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2293980710' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:20:12.371472 I | rook-ceph-mon0: 2017-07-11 14:20:12.371431 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:20:12.371754 I | rook-ceph-mon0: 2017-07-11 14:20:12.371734 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3292463489' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:20:13.367246 I | rook-ceph-mon0: 2017-07-11 14:20:13.367206 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:20:13.367316 I | rook-ceph-mon0: 2017-07-11 14:20:13.367301 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2674252972' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:20:14.334707 I | rook-ceph-mon0: 2017-07-11 14:20:14.334668 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:20:14.334891 I | rook-ceph-mon0: 2017-07-11 14:20:14.334809 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1072341240' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:20:15.954808 I | rook-ceph-mon0: 2017-07-11 14:20:15.954770 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:20:15.954988 I | rook-ceph-mon0: 2017-07-11 14:20:15.954917 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1442774226' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:20:16.438255 I | rook-ceph-mon0: 2017-07-11 14:20:16.438220 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:20:16.438376 I | rook-ceph-mon0: 2017-07-11 14:20:16.438362 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1131853412' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:20:17.313615 I | rook-ceph-mon0: 2017-07-11 14:20:17.313566 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:20:17.313814 I | rook-ceph-mon0: 2017-07-11 14:20:17.313735 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2992794363' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:20:45.578608 I | rook-ceph-mon0: 2017-07-11 14:20:45.578452 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94361 MB
- 2017-07-11 14:21:08.075857 I | rook-ceph-mon0: 2017-07-11 14:21:08.075766 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #57. Immutable memtables: 0.
- 2017-07-11 14:21:08.075949 I | rook-ceph-mon0:
- 2017-07-11 14:21:08.075966 I | rook-ceph-mon0: 2017-07-11 14:21:08.075793 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 35] Syncing log #54
- 2017-07-11 14:21:08.093359 I | rook-ceph-mon0: 2017-07-11 14:21:08.091911 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.075787) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:21:08.093424 I | rook-ceph-mon0: 2017-07-11 14:21:08.091920 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 35] Flushing memtable with next log file: 57
- 2017-07-11 14:21:08.093441 I | rook-ceph-mon0:
- 2017-07-11 14:21:08.093453 I | rook-ceph-mon0: 2017-07-11 14:21:08.091930 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868091926, "job": 35, "event": "flush_started", "num_memtables": 1, "num_entries": 884, "num_deletes": 500, "memory_usage": 1037152}
- 2017-07-11 14:21:08.093483 I | rook-ceph-mon0: 2017-07-11 14:21:08.091933 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 35] Level-0 flush table #58: started
- 2017-07-11 14:21:08.139812 I | rook-ceph-mon0: 2017-07-11 14:21:08.139765 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868139754, "cf_name": "default", "job": 35, "event": "table_file_creation", "file_number": 58, "file_size": 1015686, "table_properties": {"data_size": 1011254, "index_size": 3618, "filter_size": 0, "raw_key_size": 11735, "raw_average_key_size": 18, "raw_value_size": 1000274, "raw_average_value_size": 1558, "num_data_blocks": 117, "num_entries": 642, "filter_policy_name": "", "kDeletedKeys": "500", "kMergeOperands": "0"}}
- 2017-07-11 14:21:08.139923 I | rook-ceph-mon0: 2017-07-11 14:21:08.139905 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 35] Level-0 flush table #58: 1015686 bytes OK
- 2017-07-11 14:21:08.178627 I | rook-ceph-mon0: 2017-07-11 14:21:08.178584 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.154794) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #58 started
- 2017-07-11 14:21:08.178727 I | rook-ceph-mon0: 2017-07-11 14:21:08.178710 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.178533) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #58: memtable #1 done
- 2017-07-11 14:21:08.178844 I | rook-ceph-mon0: 2017-07-11 14:21:08.178802 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.178554) EVENT_LOG_v1 {"time_micros": 1499782868178548, "job": 35, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:21:08.178879 I | rook-ceph-mon0: 2017-07-11 14:21:08.178865 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.178572) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:21:08.178893 I | rook-ceph-mon0:
- 2017-07-11 14:21:08.178939 I | rook-ceph-mon0: 2017-07-11 14:21:08.178925 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 35] Try to delete WAL files size 1016740, prev total WAL file size 1016740, number of live WAL files 2.
- 2017-07-11 14:21:08.178955 I | rook-ceph-mon0:
- 2017-07-11 14:21:08.182019 I | rook-ceph-mon0: 2017-07-11 14:21:08.179330 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:21:08.182066 I | rook-ceph-mon0: 2017-07-11 14:21:08.179364 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.179358) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:21:08.182179 I | rook-ceph-mon0:
- 2017-07-11 14:21:08.182196 I | rook-ceph-mon0: 2017-07-11 14:21:08.179369 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 36] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:21:08.182209 I | rook-ceph-mon0: 2017-07-11 14:21:08.179373 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 35 Base level 0, inputs: [58(991KB)], [56(16MB)]
- 2017-07-11 14:21:08.182239 I | rook-ceph-mon0:
- 2017-07-11 14:21:08.182251 I | rook-ceph-mon0: 2017-07-11 14:21:08.179384 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868179376, "job": 36, "event": "compaction_started", "files_L0": [58], "files_L1": [56], "score": -1, "input_data_size": 18185548}
- 2017-07-11 14:21:08.344850 I | rook-ceph-mon0: 2017-07-11 14:21:08.344796 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 36] Generated table #59: 2084 keys, 13687367 bytes
- 2017-07-11 14:21:08.345034 I | rook-ceph-mon0: 2017-07-11 14:21:08.344952 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868344942, "cf_name": "default", "job": 36, "event": "table_file_creation", "file_number": 59, "file_size": 13687367, "table_properties": {"data_size": 13640148, "index_size": 46400, "filter_size": 0, "raw_key_size": 39165, "raw_average_key_size": 18, "raw_value_size": 13578597, "raw_average_value_size": 6515, "num_data_blocks": 1436, "num_entries": 2084, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:21:08.406487 I | rook-ceph-mon0: 2017-07-11 14:21:08.406440 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 36] Compacted 1@0 + 1@1 files to L1 => 13687367 bytes
- 2017-07-11 14:21:08.498392 I | rook-ceph-mon0: 2017-07-11 14:21:08.498343 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.498268) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 80.1 rd, 60.3 wr, level 1, files in(1, 1) out(1) MB in(1.0, 16.4) out(13.1), read-write-amplify(31.4) write-amplify(13.5) OK, records in: 3091, records dropped: 1007
- 2017-07-11 14:21:08.498485 I | rook-ceph-mon0:
- 2017-07-11 14:21:08.498549 I | rook-ceph-mon0: 2017-07-11 14:21:08.498505 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.498285) EVENT_LOG_v1 {"time_micros": 1499782868498278, "job": 36, "event": "compaction_finished", "compaction_time_micros": 227034, "output_level": 1, "num_output_files": 1, "total_output_size": 13687367, "num_input_records": 3091, "num_output_records": 2084, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:21:08.498979 I | rook-ceph-mon0: 2017-07-11 14:21:08.498963 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868498960, "job": 36, "event": "table_file_deletion", "file_number": 58}
- 2017-07-11 14:21:08.501102 I | rook-ceph-mon0: 2017-07-11 14:21:08.501081 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868501079, "job": 36, "event": "table_file_deletion", "file_number": 56}
- 2017-07-11 14:21:08.501448 I | rook-ceph-mon0: 2017-07-11 14:21:08.501359 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #60. Immutable memtables: 0.
- 2017-07-11 14:21:08.501486 I | rook-ceph-mon0:
- 2017-07-11 14:21:08.501502 I | rook-ceph-mon0: 2017-07-11 14:21:08.501394 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 37] Syncing log #57
- 2017-07-11 14:21:08.517590 I | rook-ceph-mon0: 2017-07-11 14:21:08.517296 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.501389) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:21:08.517648 I | rook-ceph-mon0: 2017-07-11 14:21:08.517308 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 37] Flushing memtable with next log file: 60
- 2017-07-11 14:21:08.517665 I | rook-ceph-mon0:
- 2017-07-11 14:21:08.517678 I | rook-ceph-mon0: 2017-07-11 14:21:08.517316 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868517313, "job": 37, "event": "flush_started", "num_memtables": 1, "num_entries": 3, "num_deletes": 0, "memory_usage": 8712}
- 2017-07-11 14:21:08.517690 I | rook-ceph-mon0: 2017-07-11 14:21:08.517319 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 37] Level-0 flush table #61: started
- 2017-07-11 14:21:08.533478 I | rook-ceph-mon0: 2017-07-11 14:21:08.533408 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868533400, "cf_name": "default", "job": 37, "event": "table_file_creation", "file_number": 61, "file_size": 7502, "table_properties": {"data_size": 6640, "index_size": 55, "filter_size": 0, "raw_key_size": 78, "raw_average_key_size": 26, "raw_value_size": 6526, "raw_average_value_size": 2175, "num_data_blocks": 2, "num_entries": 3, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:21:08.533557 I | rook-ceph-mon0: 2017-07-11 14:21:08.533418 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 37] Level-0 flush table #61: 7502 bytes OK
- 2017-07-11 14:21:08.564446 I | rook-ceph-mon0: 2017-07-11 14:21:08.564286 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.548032) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #61 started
- 2017-07-11 14:21:08.564557 I | rook-ceph-mon0: 2017-07-11 14:21:08.564294 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.564242) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #61: memtable #1 done
- 2017-07-11 14:21:08.564576 I | rook-ceph-mon0: 2017-07-11 14:21:08.564295 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.564260) EVENT_LOG_v1 {"time_micros": 1499782868564254, "job": 37, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:21:08.564607 I | rook-ceph-mon0: 2017-07-11 14:21:08.564297 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.564274) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:21:08.564623 I | rook-ceph-mon0:
- 2017-07-11 14:21:08.564636 I | rook-ceph-mon0: 2017-07-11 14:21:08.564302 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 37] Try to delete WAL files size 6602, prev total WAL file size 6602, number of live WAL files 2.
- 2017-07-11 14:21:08.564647 I | rook-ceph-mon0:
- 2017-07-11 14:21:08.564661 I | rook-ceph-mon0: 2017-07-11 14:21:08.564538 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:21:21.999677 I | rook-ceph-mon0: 2017-07-11 14:21:21.999640 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:21:21.999763 I | rook-ceph-mon0: 2017-07-11 14:21:21.999746 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2988869852' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:21:25.723333 I | rook-ceph-mon0: 2017-07-11 14:21:25.723296 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:21:25.723616 I | rook-ceph-mon0: 2017-07-11 14:21:25.723530 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3031159965' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:21:28.173975 I | rook-ceph-mon0: 2017-07-11 14:21:28.173793 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:21:28.174060 I | rook-ceph-mon0: 2017-07-11 14:21:28.173812 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2452905562' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:21:28.689288 I | rook-ceph-mon0: 2017-07-11 14:21:28.689246 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:28.689511 I | rook-ceph-mon0: 2017-07-11 14:21:28.689475 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3766328754' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:29.654790 I | rook-ceph-mon0: 2017-07-11 14:21:29.654743 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:21:29.655012 I | rook-ceph-mon0: 2017-07-11 14:21:29.654979 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3574570673' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:21:31.101293 I | rook-ceph-mon0: 2017-07-11 14:21:31.101237 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:31.101407 I | rook-ceph-mon0: 2017-07-11 14:21:31.101384 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/223249490' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:33.368305 I | rook-ceph-mon0: 2017-07-11 14:21:33.368268 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:21:33.368517 I | rook-ceph-mon0: 2017-07-11 14:21:33.368487 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1650893854' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:21:34.309202 I | rook-ceph-mon0: 2017-07-11 14:21:34.309162 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:34.309387 I | rook-ceph-mon0: 2017-07-11 14:21:34.309304 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1568641824' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:34.740068 I | rook-ceph-mon0: 2017-07-11 14:21:34.740027 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:34.740244 I | rook-ceph-mon0: 2017-07-11 14:21:34.740161 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3172161514' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:37.664133 I | rook-ceph-mon0: 2017-07-11 14:21:37.664095 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:21:37.672219 I | rook-ceph-mon0: 2017-07-11 14:21:37.672190 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3122391749' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:21:38.633010 I | rook-ceph-mon0: 2017-07-11 14:21:38.632973 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:38.633211 I | rook-ceph-mon0: 2017-07-11 14:21:38.633129 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2375257146' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:39.073339 I | rook-ceph-mon0: 2017-07-11 14:21:39.073302 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:39.073409 I | rook-ceph-mon0: 2017-07-11 14:21:39.073393 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2732952765' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:39.551753 I | rook-ceph-mon0: 2017-07-11 14:21:39.551715 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:39.551878 I | rook-ceph-mon0: 2017-07-11 14:21:39.551862 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1329708465' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:39.990040 I | rook-ceph-mon0: 2017-07-11 14:21:39.990002 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:21:39.990164 I | rook-ceph-mon0: 2017-07-11 14:21:39.990148 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1858099708' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:21:41.442566 I | rook-ceph-mon0: 2017-07-11 14:21:41.442527 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:21:41.442792 I | rook-ceph-mon0: 2017-07-11 14:21:41.442758 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2113680955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:21:42.339250 I | rook-ceph-mon0: 2017-07-11 14:21:42.339212 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:42.339498 I | rook-ceph-mon0: 2017-07-11 14:21:42.339361 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4256634718' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:44.164970 I | rook-ceph-mon0: 2017-07-11 14:21:44.164897 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:21:44.165185 I | rook-ceph-mon0: 2017-07-11 14:21:44.165082 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/359874689' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:21:44.213539 I | rook-ceph-mon0: 2017-07-11 14:21:44.213504 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:44.213650 I | rook-ceph-mon0: 2017-07-11 14:21:44.213635 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/72344325' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:45.579148 I | rook-ceph-mon0: 2017-07-11 14:21:45.578811 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4822 MB, avail 94365 MB
- 2017-07-11 14:21:46.233480 I | rook-ceph-mon0: 2017-07-11 14:21:46.233440 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:46.233696 I | rook-ceph-mon0: 2017-07-11 14:21:46.233590 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/553434393' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:46.746302 I | rook-ceph-mon0: 2017-07-11 14:21:46.746226 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:21:46.746545 I | rook-ceph-mon0: 2017-07-11 14:21:46.746517 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4235027833' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:21:47.236646 I | rook-ceph-mon0: 2017-07-11 14:21:47.236607 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:47.236838 I | rook-ceph-mon0: 2017-07-11 14:21:47.236753 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1757219371' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:47.683589 I | rook-ceph-mon0: 2017-07-11 14:21:47.683539 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:21:47.683700 I | rook-ceph-mon0: 2017-07-11 14:21:47.683685 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2282177501' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:21:48.139367 I | rook-ceph-mon0: 2017-07-11 14:21:48.139329 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:48.139550 I | rook-ceph-mon0: 2017-07-11 14:21:48.139535 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/766041294' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:49.162333 I | rook-ceph-mon0: 2017-07-11 14:21:49.162294 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:21:49.162403 I | rook-ceph-mon0: 2017-07-11 14:21:49.162388 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3462941119' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:21:51.054720 I | rook-ceph-mon0: 2017-07-11 14:21:51.054683 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:51.054915 I | rook-ceph-mon0: 2017-07-11 14:21:51.054823 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/769119128' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:51.511288 I | rook-ceph-mon0: 2017-07-11 14:21:51.511250 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:21:51.511530 I | rook-ceph-mon0: 2017-07-11 14:21:51.511512 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1209892881' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:21:52.004190 I | rook-ceph-mon0: 2017-07-11 14:21:52.004152 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:52.007484 I | rook-ceph-mon0: 2017-07-11 14:21:52.004378 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2746379768' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:54.598277 I | rook-ceph-mon0: 2017-07-11 14:21:54.598240 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:54.598595 I | rook-ceph-mon0: 2017-07-11 14:21:54.598558 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1155737163' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:54.987749 I | rook-ceph-mon0: 2017-07-11 14:21:54.987708 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:54.987938 I | rook-ceph-mon0: 2017-07-11 14:21:54.987849 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4080218249' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:55.617592 I | rook-ceph-mon0: 2017-07-11 14:21:55.617556 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:21:55.617820 I | rook-ceph-mon0: 2017-07-11 14:21:55.617698 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/302742678' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:21:57.873684 I | rook-ceph-mon0: 2017-07-11 14:21:57.873645 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:21:57.873881 I | rook-ceph-mon0: 2017-07-11 14:21:57.873794 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2320036824' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:21:59.143095 I | rook-ceph-mon0: 2017-07-11 14:21:59.142949 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:59.143221 I | rook-ceph-mon0: 2017-07-11 14:21:59.143149 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/344659851' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:00.405414 I | rook-ceph-mon0: 2017-07-11 14:22:00.405375 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:00.405653 I | rook-ceph-mon0: 2017-07-11 14:22:00.405543 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2149449339' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:04.123840 I | rook-ceph-mon0: 2017-07-11 14:22:04.123800 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:04.124031 I | rook-ceph-mon0: 2017-07-11 14:22:04.123946 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2075316314' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:04.587003 I | rook-ceph-mon0: 2017-07-11 14:22:04.586963 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:04.587231 I | rook-ceph-mon0: 2017-07-11 14:22:04.587201 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3997732531' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:06.413320 I | rook-ceph-mon0: 2017-07-11 14:22:06.413287 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:22:06.413467 I | rook-ceph-mon0: 2017-07-11 14:22:06.413450 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3410473065' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:22:06.604259 I | rook-ceph-mon0: 2017-07-11 14:22:06.604207 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:06.604400 I | rook-ceph-mon0: 2017-07-11 14:22:06.604384 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1168663709' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:08.844229 I | rook-ceph-mon0: 2017-07-11 14:22:08.844189 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:22:08.844427 I | rook-ceph-mon0: 2017-07-11 14:22:08.844340 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/16733148' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:22:10.328663 I | rook-ceph-mon0: 2017-07-11 14:22:10.328615 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:10.329041 I | rook-ceph-mon0: 2017-07-11 14:22:10.329017 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2432443987' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:11.866926 I | rook-ceph-mon0: 2017-07-11 14:22:11.866877 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:11.867123 I | rook-ceph-mon0: 2017-07-11 14:22:11.867044 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3958098090' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:15.452957 I | rook-ceph-mon0: 2017-07-11 14:22:15.452897 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:15.453168 I | rook-ceph-mon0: 2017-07-11 14:22:15.453068 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/459569806' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:15.928151 I | rook-ceph-mon0: 2017-07-11 14:22:15.928112 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:15.928634 I | rook-ceph-mon0: 2017-07-11 14:22:15.928597 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4141524405' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:16.477853 I | rook-ceph-mon0: 2017-07-11 14:22:16.477812 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:16.478066 I | rook-ceph-mon0: 2017-07-11 14:22:16.477966 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2817369674' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:17.403590 I | rook-ceph-mon0: 2017-07-11 14:22:17.403555 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:22:17.403786 I | rook-ceph-mon0: 2017-07-11 14:22:17.403701 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2971442126' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:22:17.426019 I | rook-ceph-mon0: 2017-07-11 14:22:17.425997 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:17.426119 I | rook-ceph-mon0: 2017-07-11 14:22:17.426104 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2045962124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:18.350617 I | rook-ceph-mon0: 2017-07-11 14:22:18.350578 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:18.350809 I | rook-ceph-mon0: 2017-07-11 14:22:18.350718 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/955453696' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:18.799138 I | rook-ceph-mon0: 2017-07-11 14:22:18.799098 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:18.799285 I | rook-ceph-mon0: 2017-07-11 14:22:18.799269 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/951116828' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:19.741603 I | rook-ceph-mon0: 2017-07-11 14:22:19.741562 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:19.741819 I | rook-ceph-mon0: 2017-07-11 14:22:19.741718 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/288818009' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:19.818036 I | rook-ceph-mon0: 2017-07-11 14:22:19.818000 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:22:19.818229 I | rook-ceph-mon0: 2017-07-11 14:22:19.818145 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/153808570' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:22:22.255519 I | rook-ceph-mon0: 2017-07-11 14:22:22.255479 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:22.255588 I | rook-ceph-mon0: 2017-07-11 14:22:22.255572 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2859908343' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:22.784242 I | rook-ceph-mon0: 2017-07-11 14:22:22.784203 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:22.784460 I | rook-ceph-mon0: 2017-07-11 14:22:22.784349 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3425371484' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:23.704513 I | rook-ceph-mon0: 2017-07-11 14:22:23.704479 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:23.704773 I | rook-ceph-mon0: 2017-07-11 14:22:23.704619 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/216343510' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:26.656520 I | rook-ceph-mon0: 2017-07-11 14:22:26.656470 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:26.656732 I | rook-ceph-mon0: 2017-07-11 14:22:26.656648 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2166390024' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:27.160475 I | rook-ceph-mon0: 2017-07-11 14:22:27.160436 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:27.160644 I | rook-ceph-mon0: 2017-07-11 14:22:27.160628 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2115662711' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:30.644740 I | rook-ceph-mon0: 2017-07-11 14:22:30.644700 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:30.644953 I | rook-ceph-mon0: 2017-07-11 14:22:30.644849 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2378976465' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:33.925178 I | rook-ceph-mon0: 2017-07-11 14:22:33.925141 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:33.925390 I | rook-ceph-mon0: 2017-07-11 14:22:33.925280 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2663133864' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:35.504550 I | rook-ceph-mon0: 2017-07-11 14:22:35.504511 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:35.504812 I | rook-ceph-mon0: 2017-07-11 14:22:35.504796 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1668001082' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:37.834770 I | rook-ceph-mon0: 2017-07-11 14:22:37.834729 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:37.834996 I | rook-ceph-mon0: 2017-07-11 14:22:37.834881 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/578206303' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:39.461187 I | rook-ceph-mon0: 2017-07-11 14:22:39.461148 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:22:39.461381 I | rook-ceph-mon0: 2017-07-11 14:22:39.461296 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/62137563' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:22:41.574169 I | rook-ceph-mon0: 2017-07-11 14:22:41.574130 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:41.574410 I | rook-ceph-mon0: 2017-07-11 14:22:41.574278 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2596106863' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:41.844179 I | rook-ceph-mon0: 2017-07-11 14:22:41.844139 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:22:41.844379 I | rook-ceph-mon0: 2017-07-11 14:22:41.844293 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1385906476' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:22:43.446731 I | rook-ceph-mon0: 2017-07-11 14:22:43.446690 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:43.446936 I | rook-ceph-mon0: 2017-07-11 14:22:43.446840 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3114143865' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:45.579415 I | rook-ceph-mon0: 2017-07-11 14:22:45.579146 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4822 MB, avail 94365 MB
- 2017-07-11 14:22:45.695079 I | rook-ceph-mon0: 2017-07-11 14:22:45.695042 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:45.695354 I | rook-ceph-mon0: 2017-07-11 14:22:45.695337 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/737836151' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:47.124282 I | rook-ceph-mon0: 2017-07-11 14:22:47.124244 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:47.124474 I | rook-ceph-mon0: 2017-07-11 14:22:47.124386 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/379136044' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:49.358968 I | rook-ceph-mon0: 2017-07-11 14:22:49.358879 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:49.359047 I | rook-ceph-mon0: 2017-07-11 14:22:49.359031 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1919481993' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:50.956771 I | rook-ceph-mon0: 2017-07-11 14:22:50.956728 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:50.956836 I | rook-ceph-mon0: 2017-07-11 14:22:50.956822 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/631712461' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:52.384340 I | rook-ceph-mon0: 2017-07-11 14:22:52.384301 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:52.384412 I | rook-ceph-mon0: 2017-07-11 14:22:52.384397 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1349036502' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:52.859587 I | rook-ceph-mon0: 2017-07-11 14:22:52.859549 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:22:52.859742 I | rook-ceph-mon0: 2017-07-11 14:22:52.859726 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/898495513' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:22:54.010721 I | rook-ceph-mon0: 2017-07-11 14:22:54.010677 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:54.010791 I | rook-ceph-mon0: 2017-07-11 14:22:54.010775 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2240840541' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:54.593367 I | rook-ceph-mon0: 2017-07-11 14:22:54.593319 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:54.593595 I | rook-ceph-mon0: 2017-07-11 14:22:54.593577 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2566511909' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:55.010600 I | rook-ceph-mon0: 2017-07-11 14:22:55.010559 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:55.010786 I | rook-ceph-mon0: 2017-07-11 14:22:55.010703 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2392355609' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:55.583160 I | rook-ceph-mon0: 2017-07-11 14:22:55.583122 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:55.583390 I | rook-ceph-mon0: 2017-07-11 14:22:55.583269 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3392113823' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:57.498180 I | rook-ceph-mon0: 2017-07-11 14:22:57.498141 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:57.498385 I | rook-ceph-mon0: 2017-07-11 14:22:57.498294 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/514466047' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:59.367664 I | rook-ceph-mon0: 2017-07-11 14:22:59.367624 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:59.367742 I | rook-ceph-mon0: 2017-07-11 14:22:59.367726 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2981705413' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:23:02.479128 I | rook-ceph-mon0: 2017-07-11 14:23:02.479085 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:23:02.479215 I | rook-ceph-mon0: 2017-07-11 14:23:02.479176 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/135001753' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:23:03.013015 I | rook-ceph-mon0: 2017-07-11 14:23:03.012976 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:23:03.013256 I | rook-ceph-mon0: 2017-07-11 14:23:03.013121 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/910542108' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:23:03.506349 I | rook-ceph-mon0: 2017-07-11 14:23:03.506311 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:23:03.506496 I | rook-ceph-mon0: 2017-07-11 14:23:03.506480 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/621593634' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:23:05.692258 I | rook-ceph-mon0: 2017-07-11 14:23:05.691920 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:05.692599 I | rook-ceph-mon0: 2017-07-11 14:23:05.692370 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2405149523' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:07.097510 I | rook-ceph-mon0: 2017-07-11 14:23:07.097460 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:23:07.097669 I | rook-ceph-mon0: 2017-07-11 14:23:07.097654 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/628954090' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:23:08.638568 I | rook-ceph-mon0: 2017-07-11 14:23:08.638530 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:23:08.638778 I | rook-ceph-mon0: 2017-07-11 14:23:08.638760 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3374499153' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:23:11.704829 I | rook-ceph-mon0: 2017-07-11 14:23:11.704789 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:23:11.705040 I | rook-ceph-mon0: 2017-07-11 14:23:11.704940 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2214388643' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:23:12.626204 I | rook-ceph-mon0: 2017-07-11 14:23:12.626151 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:23:12.626277 I | rook-ceph-mon0: 2017-07-11 14:23:12.626262 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2463279416' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:23:14.067695 I | rook-ceph-mon0: 2017-07-11 14:23:14.067657 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:14.067912 I | rook-ceph-mon0: 2017-07-11 14:23:14.067878 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/456994899' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:14.512693 I | rook-ceph-mon0: 2017-07-11 14:23:14.512644 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:23:14.512937 I | rook-ceph-mon0: 2017-07-11 14:23:14.512907 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1333463007' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:23:28.187909 I | rook-ceph-mon0: 2017-07-11 14:23:28.187812 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #62. Immutable memtables: 0.
- 2017-07-11 14:23:28.188039 I | rook-ceph-mon0:
- 2017-07-11 14:23:28.188116 I | rook-ceph-mon0: 2017-07-11 14:23:28.187860 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 38] Syncing log #60
- 2017-07-11 14:23:28.208105 I | rook-ceph-mon0: 2017-07-11 14:23:28.205204 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.187854) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:23:28.208157 I | rook-ceph-mon0: 2017-07-11 14:23:28.205215 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 38] Flushing memtable with next log file: 62
- 2017-07-11 14:23:28.208173 I | rook-ceph-mon0:
- 2017-07-11 14:23:28.208197 I | rook-ceph-mon0: 2017-07-11 14:23:28.205224 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008205220, "job": 38, "event": "flush_started", "num_memtables": 1, "num_entries": 1422, "num_deletes": 251, "memory_usage": 3282136}
- 2017-07-11 14:23:28.208226 I | rook-ceph-mon0: 2017-07-11 14:23:28.205226 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 38] Level-0 flush table #63: started
- 2017-07-11 14:23:28.251805 I | rook-ceph-mon0: 2017-07-11 14:23:28.251759 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008251749, "cf_name": "default", "job": 38, "event": "table_file_creation", "file_number": 63, "file_size": 2832397, "table_properties": {"data_size": 2822942, "index_size": 8637, "filter_size": 0, "raw_key_size": 11757, "raw_average_key_size": 19, "raw_value_size": 2808467, "raw_average_value_size": 4559, "num_data_blocks": 278, "num_entries": 616, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:23:28.251903 I | rook-ceph-mon0: 2017-07-11 14:23:28.251886 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 38] Level-0 flush table #63: 2832397 bytes OK
- 2017-07-11 14:23:28.282880 I | rook-ceph-mon0: 2017-07-11 14:23:28.282845 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.266006) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #63 started
- 2017-07-11 14:23:28.282970 I | rook-ceph-mon0: 2017-07-11 14:23:28.282955 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.282799) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #63: memtable #1 done
- 2017-07-11 14:23:28.283021 I | rook-ceph-mon0: 2017-07-11 14:23:28.282989 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.282815) EVENT_LOG_v1 {"time_micros": 1499783008282810, "job": 38, "event": "flush_finished", "lsm_state": [2, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:23:28.283062 I | rook-ceph-mon0: 2017-07-11 14:23:28.283038 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.282829) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[2 1 0 0 0 0 0] max score 0.50
- 2017-07-11 14:23:28.283100 I | rook-ceph-mon0:
- 2017-07-11 14:23:28.283130 I | rook-ceph-mon0: 2017-07-11 14:23:28.283118 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 38] Try to delete WAL files size 3253562, prev total WAL file size 3253562, number of live WAL files 2.
- 2017-07-11 14:23:28.283142 I | rook-ceph-mon0:
- 2017-07-11 14:23:28.284012 I | rook-ceph-mon0: 2017-07-11 14:23:28.283802 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:23:28.284074 I | rook-ceph-mon0: 2017-07-11 14:23:28.283936 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:23:28.284092 I | rook-ceph-mon0: 2017-07-11 14:23:28.283940 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:23:28.284107 I | rook-ceph-mon0: ** DB Stats **
- 2017-07-11 14:23:28.284137 I | rook-ceph-mon0: Uptime(secs): 3583.1 total, 711.2 interval
- 2017-07-11 14:23:28.284149 I | rook-ceph-mon0: Cumulative writes: 5614 writes, 22K keys, 5614 commit groups, 1.0 writes per commit group, ingest: 0.05 GB, 0.01 MB/s
- 2017-07-11 14:23:28.284160 I | rook-ceph-mon0: Cumulative WAL: 5614 writes, 5614 syncs, 1.00 writes per sync, written: 0.05 GB, 0.01 MB/s
- 2017-07-11 14:23:28.284173 I | rook-ceph-mon0: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:23:28.284184 I | rook-ceph-mon0: Interval writes: 1446 writes, 6568 keys, 1446 commit groups, 1.0 writes per commit group, ingest: 13.01 MB, 0.02 MB/s
- 2017-07-11 14:23:28.284208 I | rook-ceph-mon0: Interval WAL: 1446 writes, 1446 syncs, 1.00 writes per sync, written: 0.01 MB, 0.02 MB/s
- 2017-07-11 14:23:28.284221 I | rook-ceph-mon0: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:23:28.284232 I | rook-ceph-mon0:
- 2017-07-11 14:23:28.284243 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 14:23:28.284254 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:23:28.284266 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:23:28.284290 I | rook-ceph-mon0: L0 2/2 2.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 24.0 2 20 0.089 0 0
- 2017-07-11 14:23:28.284308 I | rook-ceph-mon0: L1 1/1 13.05 MB 0.0 0.2 0.0 0.2 0.2 0.0 0.0 5.2 50.8 44.9 5 17 0.269 36K 7346
- 2017-07-11 14:23:28.284320 I | rook-ceph-mon0: Sum 3/3 15.76 MB 0.0 0.2 0.0 0.2 0.2 0.1 0.0 5.8 36.6 39.1 6 37 0.172 36K 7346
- 2017-07-11 14:23:28.284336 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 6.8 51.9 52.7 2 11 0.140 13K 2949
- 2017-07-11 14:23:28.284348 I | rook-ceph-mon0: Uptime(secs): 3583.1 total, 3583.1 interval
- 2017-07-11 14:23:28.284373 I | rook-ceph-mon0: Flush(GB): cumulative 0.042, interval 0.012
- 2017-07-11 14:23:28.284386 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:23:28.284397 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:23:28.284459 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:23:28.284474 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:23:28.284485 I | rook-ceph-mon0: Cumulative compaction: 0.24 GB write, 0.07 MB/s write, 0.23 GB read, 0.06 MB/s read, 6.4 seconds
- 2017-07-11 14:23:28.284497 I | rook-ceph-mon0: Interval compaction: 0.08 GB write, 0.02 MB/s write, 0.08 GB read, 0.02 MB/s read, 1.5 seconds
- 2017-07-11 14:23:28.284509 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:23:28.284615 I | rook-ceph-mon0:
- 2017-07-11 14:23:28.284634 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:23:28.284648 I | rook-ceph-mon0:
- 2017-07-11 14:23:28.284659 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 14:23:28.284684 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:23:28.284698 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:23:28.284709 I | rook-ceph-mon0: L0 2/2 2.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 24.0 2 20 0.089 0 0
- 2017-07-11 14:23:28.284721 I | rook-ceph-mon0: L1 1/1 13.05 MB 0.0 0.2 0.0 0.2 0.2 0.0 0.0 5.2 50.8 44.9 5 17 0.269 36K 7346
- 2017-07-11 14:23:28.284766 I | rook-ceph-mon0: Sum 3/3 15.76 MB 0.0 0.2 0.0 0.2 0.2 0.1 0.0 5.8 36.6 39.1 6 37 0.172 36K 7346
- 2017-07-11 14:23:28.284781 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:23:28.284804 I | rook-ceph-mon0: Uptime(secs): 3583.1 total, 3583.1 interval
- 2017-07-11 14:23:28.284814 I | rook-ceph-mon0: Flush(GB): cumulative 0.042, interval 0.000
- 2017-07-11 14:23:28.285072 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:23:28.285098 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:23:28.285111 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:23:28.285122 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:23:28.285157 I | rook-ceph-mon0: Cumulative compaction: 0.24 GB write, 0.07 MB/s write, 0.23 GB read, 0.06 MB/s read, 6.4 seconds
- 2017-07-11 14:23:28.285170 I | rook-ceph-mon0: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:23:28.285246 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:23:28.285262 I | rook-ceph-mon0:
- 2017-07-11 14:23:28.285272 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:23:28.285281 I | rook-ceph-mon0:
- 2017-07-11 14:23:28.285291 I | rook-ceph-mon0: 2017-07-11 14:23:28.283956 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.283951) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:23:28.285301 I | rook-ceph-mon0:
- 2017-07-11 14:23:28.285322 I | rook-ceph-mon0: 2017-07-11 14:23:28.283960 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 39] Compacting 2@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:23:28.285334 I | rook-ceph-mon0: 2017-07-11 14:23:28.284410 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 38 Base level 0, inputs: [63(2766KB) 61(7502B)], [59(13MB)]
- 2017-07-11 14:23:28.285346 I | rook-ceph-mon0:
- 2017-07-11 14:23:28.285400 I | rook-ceph-mon0: 2017-07-11 14:23:28.284425 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008284416, "job": 39, "event": "compaction_started", "files_L0": [63, 61], "files_L1": [59], "score": -1, "input_data_size": 16527266}
- 2017-07-11 14:23:28.613645 I | rook-ceph-mon0: 2017-07-11 14:23:28.613594 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 39] Generated table #64: 2255 keys, 15285179 bytes
- 2017-07-11 14:23:28.613711 I | rook-ceph-mon0: 2017-07-11 14:23:28.613692 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008613682, "cf_name": "default", "job": 39, "event": "table_file_creation", "file_number": 64, "file_size": 15285179, "table_properties": {"data_size": 15235295, "index_size": 49065, "filter_size": 0, "raw_key_size": 41975, "raw_average_key_size": 18, "raw_value_size": 15169638, "raw_average_value_size": 6727, "num_data_blocks": 1526, "num_entries": 2255, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:23:28.707102 I | rook-ceph-mon0: 2017-07-11 14:23:28.707050 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 39] Compacted 2@0 + 1@1 files to L1 => 15285179 bytes
- 2017-07-11 14:23:28.754149 I | rook-ceph-mon0: 2017-07-11 14:23:28.754093 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.753940) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 39.1 rd, 36.2 wr, level 1, files in(2, 1) out(1) MB in(2.7, 13.1) out(14.6), read-write-amplify(11.2) write-amplify(5.4) OK, records in: 2703, records dropped: 448
- 2017-07-11 14:23:28.754166 I | rook-ceph-mon0:
- 2017-07-11 14:23:28.754197 I | rook-ceph-mon0: 2017-07-11 14:23:28.754181 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.753982) EVENT_LOG_v1 {"time_micros": 1499783008753966, "job": 39, "event": "compaction_finished", "compaction_time_micros": 422601, "output_level": 1, "num_output_files": 1, "total_output_size": 15285179, "num_input_records": 2703, "num_output_records": 2255, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:23:28.754752 I | rook-ceph-mon0: 2017-07-11 14:23:28.754694 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008754689, "job": 39, "event": "table_file_deletion", "file_number": 63}
- 2017-07-11 14:23:28.754927 I | rook-ceph-mon0: 2017-07-11 14:23:28.754914 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008754912, "job": 39, "event": "table_file_deletion", "file_number": 61}
- 2017-07-11 14:23:28.756632 I | rook-ceph-mon0: 2017-07-11 14:23:28.756617 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008756615, "job": 39, "event": "table_file_deletion", "file_number": 59}
- 2017-07-11 14:23:28.756700 I | rook-ceph-mon0: 2017-07-11 14:23:28.756686 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:23:38.549775 I | rook-ceph-mon0: 2017-07-11 14:23:38.549724 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:23:38.550028 I | rook-ceph-mon0: 2017-07-11 14:23:38.550011 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3594989117' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:23:45.579698 I | rook-ceph-mon0: 2017-07-11 14:23:45.579450 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4823 MB, avail 94363 MB
- 2017-07-11 14:23:45.679152 I | rook-ceph-mon0: 2017-07-11 14:23:45.679113 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:23:45.679220 I | rook-ceph-mon0: 2017-07-11 14:23:45.679205 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/181322028' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:23:48.922709 I | rook-ceph-mon0: 2017-07-11 14:23:48.922671 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:23:48.922794 I | rook-ceph-mon0: 2017-07-11 14:23:48.922780 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3660103237' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:23:49.410749 I | rook-ceph-mon0: 2017-07-11 14:23:49.410710 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:23:49.410945 I | rook-ceph-mon0: 2017-07-11 14:23:49.410859 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/613479896' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:23:49.576984 I | rook-ceph-mon0: 2017-07-11 14:23:49.576945 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:23:49.577181 I | rook-ceph-mon0: 2017-07-11 14:23:49.577081 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/665817145' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:23:49.804161 I | rook-ceph-mon0: 2017-07-11 14:23:49.804122 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:23:49.804377 I | rook-ceph-mon0: 2017-07-11 14:23:49.804283 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3765517504' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:23:51.643885 I | rook-ceph-mon0: 2017-07-11 14:23:51.643846 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:51.643953 I | rook-ceph-mon0: 2017-07-11 14:23:51.643938 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3961163799' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:53.236777 I | rook-ceph-mon0: 2017-07-11 14:23:53.236724 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:23:53.237016 I | rook-ceph-mon0: 2017-07-11 14:23:53.236996 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2973845935' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:23:54.673827 I | rook-ceph-mon0: 2017-07-11 14:23:54.673789 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:23:54.674053 I | rook-ceph-mon0: 2017-07-11 14:23:54.674017 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3867331727' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:23:55.728061 I | rook-ceph-mon0: 2017-07-11 14:23:55.728023 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:55.728132 I | rook-ceph-mon0: 2017-07-11 14:23:55.728116 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2064870366' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:56.222378 I | rook-ceph-mon0: 2017-07-11 14:23:56.222340 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:56.222575 I | rook-ceph-mon0: 2017-07-11 14:23:56.222487 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3153053772' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:56.797369 I | rook-ceph-mon0: 2017-07-11 14:23:56.797222 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:23:56.797458 I | rook-ceph-mon0: 2017-07-11 14:23:56.797244 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2379578292' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:23:57.613495 I | rook-ceph-mon0: 2017-07-11 14:23:57.613274 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:23:57.613562 I | rook-ceph-mon0: 2017-07-11 14:23:57.613294 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2715774278' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:00.051173 I | rook-ceph-mon0: 2017-07-11 14:24:00.051085 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #65. Immutable memtables: 0.
- 2017-07-11 14:24:00.051255 I | rook-ceph-mon0:
- 2017-07-11 14:24:00.051302 I | rook-ceph-mon0: 2017-07-11 14:24:00.051113 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 40] Syncing log #62
- 2017-07-11 14:24:00.081553 I | rook-ceph-mon0: 2017-07-11 14:24:00.080565 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.051107) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:24:00.081618 I | rook-ceph-mon0: 2017-07-11 14:24:00.080573 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 40] Flushing memtable with next log file: 65
- 2017-07-11 14:24:00.081636 I | rook-ceph-mon0:
- 2017-07-11 14:24:00.081813 I | rook-ceph-mon0: 2017-07-11 14:24:00.080583 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040080579, "job": 40, "event": "flush_started", "num_memtables": 1, "num_entries": 460, "num_deletes": 251, "memory_usage": 576952}
- 2017-07-11 14:24:00.081827 I | rook-ceph-mon0: 2017-07-11 14:24:00.080585 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 40] Level-0 flush table #66: started
- 2017-07-11 14:24:00.127745 I | rook-ceph-mon0: 2017-07-11 14:24:00.127699 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040127688, "cf_name": "default", "job": 40, "event": "table_file_creation", "file_number": 66, "file_size": 565374, "table_properties": {"data_size": 562644, "index_size": 1916, "filter_size": 0, "raw_key_size": 6081, "raw_average_key_size": 18, "raw_value_size": 556845, "raw_average_value_size": 1677, "num_data_blocks": 62, "num_entries": 332, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:24:00.127852 I | rook-ceph-mon0: 2017-07-11 14:24:00.127835 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 40] Level-0 flush table #66: 565374 bytes OK
- 2017-07-11 14:24:00.159567 I | rook-ceph-mon0: 2017-07-11 14:24:00.159302 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.143853) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #66 started
- 2017-07-11 14:24:00.159758 I | rook-ceph-mon0: 2017-07-11 14:24:00.159308 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.159260) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #66: memtable #1 done
- 2017-07-11 14:24:00.162741 I | rook-ceph-mon0: 2017-07-11 14:24:00.159310 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.159275) EVENT_LOG_v1 {"time_micros": 1499783040159270, "job": 40, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:24:00.162761 I | rook-ceph-mon0: 2017-07-11 14:24:00.159311 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.159290) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:24:00.162791 I | rook-ceph-mon0:
- 2017-07-11 14:24:00.162804 I | rook-ceph-mon0: 2017-07-11 14:24:00.159317 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 40] Try to delete WAL files size 565481, prev total WAL file size 565481, number of live WAL files 2.
- 2017-07-11 14:24:00.162816 I | rook-ceph-mon0:
- 2017-07-11 14:24:00.162830 I | rook-ceph-mon0: 2017-07-11 14:24:00.159529 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:24:00.162855 I | rook-ceph-mon0: 2017-07-11 14:24:00.159652 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.159647) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:24:00.162869 I | rook-ceph-mon0:
- 2017-07-11 14:24:00.162880 I | rook-ceph-mon0: 2017-07-11 14:24:00.159658 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 41] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:24:00.162892 I | rook-ceph-mon0: 2017-07-11 14:24:00.159663 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 40 Base level 0, inputs: [66(552KB)], [64(14MB)]
- 2017-07-11 14:24:00.162909 I | rook-ceph-mon0:
- 2017-07-11 14:24:00.162934 I | rook-ceph-mon0: 2017-07-11 14:24:00.159673 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040159665, "job": 41, "event": "compaction_started", "files_L0": [66], "files_L1": [64], "score": -1, "input_data_size": 15850553}
- 2017-07-11 14:24:00.396644 I | rook-ceph-mon0: 2017-07-11 14:24:00.396591 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 41] Generated table #67: 2078 keys, 13675290 bytes
- 2017-07-11 14:24:00.396838 I | rook-ceph-mon0: 2017-07-11 14:24:00.396747 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040396737, "cf_name": "default", "job": 41, "event": "table_file_creation", "file_number": 67, "file_size": 13675290, "table_properties": {"data_size": 13631173, "index_size": 43298, "filter_size": 0, "raw_key_size": 38835, "raw_average_key_size": 18, "raw_value_size": 13571904, "raw_average_value_size": 6531, "num_data_blocks": 1337, "num_entries": 2078, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:24:00.415049 I | rook-ceph-mon0: 2017-07-11 14:24:00.414819 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:00.415125 I | rook-ceph-mon0: 2017-07-11 14:24:00.414840 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/269473400' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:00.427633 I | rook-ceph-mon0: 2017-07-11 14:24:00.427594 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 41] Compacted 1@0 + 1@1 files to L1 => 13675290 bytes
- 2017-07-11 14:24:00.444113 I | rook-ceph-mon0: 2017-07-11 14:24:00.444064 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.443973) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 59.2 rd, 51.0 wr, level 1, files in(1, 1) out(1) MB in(0.5, 14.6) out(13.0), read-write-amplify(52.2) write-amplify(24.2) OK, records in: 2587, records dropped: 509
- 2017-07-11 14:24:00.444191 I | rook-ceph-mon0:
- 2017-07-11 14:24:00.444246 I | rook-ceph-mon0: 2017-07-11 14:24:00.444211 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.443998) EVENT_LOG_v1 {"time_micros": 1499783040443989, "job": 41, "event": "compaction_finished", "compaction_time_micros": 267904, "output_level": 1, "num_output_files": 1, "total_output_size": 13675290, "num_input_records": 2587, "num_output_records": 2078, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:24:00.444554 I | rook-ceph-mon0: 2017-07-11 14:24:00.444539 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040444535, "job": 41, "event": "table_file_deletion", "file_number": 66}
- 2017-07-11 14:24:00.447287 I | rook-ceph-mon0: 2017-07-11 14:24:00.447267 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040447261, "job": 41, "event": "table_file_deletion", "file_number": 64}
- 2017-07-11 14:24:00.918373 I | rook-ceph-mon0: 2017-07-11 14:24:00.918332 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:00.918588 I | rook-ceph-mon0: 2017-07-11 14:24:00.918484 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/574223771' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:24:02.542370 I | rook-ceph-mon0: 2017-07-11 14:24:02.542330 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:02.542612 I | rook-ceph-mon0: 2017-07-11 14:24:02.542577 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2419936043' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:04.031530 I | rook-ceph-mon0: 2017-07-11 14:24:04.031491 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:04.031743 I | rook-ceph-mon0: 2017-07-11 14:24:04.031641 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/664682054' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:04.481203 I | rook-ceph-mon0: 2017-07-11 14:24:04.481164 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:04.481395 I | rook-ceph-mon0: 2017-07-11 14:24:04.481309 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2402848814' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:06.614856 I | rook-ceph-mon0: 2017-07-11 14:24:06.614811 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:06.615081 I | rook-ceph-mon0: 2017-07-11 14:24:06.615049 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/55367237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:08.042296 I | rook-ceph-mon0: 2017-07-11 14:24:08.042256 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:08.042494 I | rook-ceph-mon0: 2017-07-11 14:24:08.042408 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3144149855' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:08.935099 I | rook-ceph-mon0: 2017-07-11 14:24:08.935065 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:08.935281 I | rook-ceph-mon0: 2017-07-11 14:24:08.935199 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1543375577' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:24:10.438098 I | rook-ceph-mon0: 2017-07-11 14:24:10.438059 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:10.438325 I | rook-ceph-mon0: 2017-07-11 14:24:10.438202 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2566808401' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:11.344818 I | rook-ceph-mon0: 2017-07-11 14:24:11.344783 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:11.345008 I | rook-ceph-mon0: 2017-07-11 14:24:11.344922 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1382078502' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:11.685194 I | rook-ceph-mon0: 2017-07-11 14:24:11.685155 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:24:11.685263 I | rook-ceph-mon0: 2017-07-11 14:24:11.685247 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2890683218' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:24:11.798379 I | rook-ceph-mon0: 2017-07-11 14:24:11.798331 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:11.798472 I | rook-ceph-mon0: 2017-07-11 14:24:11.798456 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/228692422' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:12.327000 I | rook-ceph-mon0: 2017-07-11 14:24:12.326953 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:12.327178 I | rook-ceph-mon0: 2017-07-11 14:24:12.327163 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1622331737' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:16.141211 I | rook-ceph-mon0: 2017-07-11 14:24:16.141169 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:16.141415 I | rook-ceph-mon0: 2017-07-11 14:24:16.141322 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2386435478' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:16.647629 I | rook-ceph-mon0: 2017-07-11 14:24:16.647589 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:16.647843 I | rook-ceph-mon0: 2017-07-11 14:24:16.647739 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/38149443' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:20.355840 I | rook-ceph-mon0: 2017-07-11 14:24:20.355802 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:20.356058 I | rook-ceph-mon0: 2017-07-11 14:24:20.356029 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/849472889' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:21.267271 I | rook-ceph-mon0: 2017-07-11 14:24:21.267230 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:21.279581 I | rook-ceph-mon0: 2017-07-11 14:24:21.279539 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1762960910' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:24:24.350940 I | rook-ceph-mon0: 2017-07-11 14:24:24.350904 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:24.351167 I | rook-ceph-mon0: 2017-07-11 14:24:24.351134 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4237115382' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:26.993284 I | rook-ceph-mon0: 2017-07-11 14:24:26.993246 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:26.993513 I | rook-ceph-mon0: 2017-07-11 14:24:26.993467 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2986574812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:28.406894 I | rook-ceph-mon0: 2017-07-11 14:24:28.406855 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:28.407136 I | rook-ceph-mon0: 2017-07-11 14:24:28.407093 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/351268444' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:28.840107 I | rook-ceph-mon0: 2017-07-11 14:24:28.840067 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:28.840174 I | rook-ceph-mon0: 2017-07-11 14:24:28.840158 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3327208615' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:29.840384 I | rook-ceph-mon0: 2017-07-11 14:24:29.840344 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:29.840574 I | rook-ceph-mon0: 2017-07-11 14:24:29.840489 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2703442269' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:30.402430 I | rook-ceph-mon0: 2017-07-11 14:24:30.402367 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:24:30.402655 I | rook-ceph-mon0: 2017-07-11 14:24:30.402542 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3788099080' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:24:31.865946 I | rook-ceph-mon0: 2017-07-11 14:24:31.865909 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:31.866015 I | rook-ceph-mon0: 2017-07-11 14:24:31.865999 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/704060739' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:34.679568 I | rook-ceph-mon0: 2017-07-11 14:24:34.679530 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:34.679805 I | rook-ceph-mon0: 2017-07-11 14:24:34.679787 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2375333565' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:35.562677 I | rook-ceph-mon0: 2017-07-11 14:24:35.562643 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0706579s > max 0.05s
- 2017-07-11 14:24:35.578861 I | rook-ceph-mon0: 2017-07-11 14:24:35.578839 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.137923s > max 0.05s
- 2017-07-11 14:24:35.701851 I | rook-ceph-mon0: 2017-07-11 14:24:35.701812 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:35.702028 I | rook-ceph-mon0: 2017-07-11 14:24:35.701948 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/887164709' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:36.722953 I | rook-ceph-mon0: 2017-07-11 14:24:35.562760 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 823 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0706579s > max 0.05s
- 2017-07-11 14:24:36.723042 I | rook-ceph-mon0: 2017-07-11 14:24:35.578916 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 824 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.137923s > max 0.05s
- 2017-07-11 14:24:40.336816 I | rook-ceph-mon0: 2017-07-11 14:24:40.336767 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:40.337008 I | rook-ceph-mon0: 2017-07-11 14:24:40.336924 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/845144579' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:41.455173 I | rook-ceph-mon0: 2017-07-11 14:24:41.455136 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:24:41.455240 I | rook-ceph-mon0: 2017-07-11 14:24:41.455225 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4055655324' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:24:44.162443 I | rook-ceph-mon0: 2017-07-11 14:24:44.162134 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:44.162659 I | rook-ceph-mon0: 2017-07-11 14:24:44.162628 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2843550957' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:44.679068 I | rook-ceph-mon0: 2017-07-11 14:24:44.679025 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:44.679191 I | rook-ceph-mon0: 2017-07-11 14:24:44.679176 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3329440712' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:24:44.801626 I | rook-ceph-mon0: 2017-07-11 14:24:44.801590 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:24:44.801845 I | rook-ceph-mon0: 2017-07-11 14:24:44.801808 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3444928251' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:24:45.579895 I | rook-ceph-mon0: 2017-07-11 14:24:45.579721 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4822 MB, avail 94364 MB
- 2017-07-11 14:24:52.469934 I | rook-ceph-mon0: 2017-07-11 14:24:52.469895 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:24:52.470059 I | rook-ceph-mon0: 2017-07-11 14:24:52.470043 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3278888253' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:24:52.701658 I | rook-ceph-mon0: 2017-07-11 14:24:52.701619 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:52.701890 I | rook-ceph-mon0: 2017-07-11 14:24:52.701770 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4063045899' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:55.945678 I | rook-ceph-mon0: 2017-07-11 14:24:55.945638 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:24:55.945749 I | rook-ceph-mon0: 2017-07-11 14:24:55.945730 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3271781642' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:24:56.347605 I | rook-ceph-mon0: 2017-07-11 14:24:56.347567 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:56.347792 I | rook-ceph-mon0: 2017-07-11 14:24:56.347709 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1694829202' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:00.963618 I | rook-ceph-mon0: 2017-07-11 14:25:00.963567 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:00.963718 I | rook-ceph-mon0: 2017-07-11 14:25:00.963702 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2195319853' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:01.933525 I | rook-ceph-mon0: 2017-07-11 14:25:01.933486 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:01.933722 I | rook-ceph-mon0: 2017-07-11 14:25:01.933637 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3990121824' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:02.827770 I | rook-ceph-mon0: 2017-07-11 14:25:02.827727 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:02.827999 I | rook-ceph-mon0: 2017-07-11 14:25:02.827970 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/55438697' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:03.639014 I | rook-ceph-mon0: 2017-07-11 14:25:03.638977 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:25:03.639191 I | rook-ceph-mon0: 2017-07-11 14:25:03.639113 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2473270434' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:25:04.238482 I | rook-ceph-mon0: 2017-07-11 14:25:04.238440 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:04.238608 I | rook-ceph-mon0: 2017-07-11 14:25:04.238592 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4186876341' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:04.691957 I | rook-ceph-mon0: 2017-07-11 14:25:04.691920 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:04.692177 I | rook-ceph-mon0: 2017-07-11 14:25:04.692071 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1031897894' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:05.767147 I | rook-ceph-mon0: 2017-07-11 14:25:05.767109 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:05.767366 I | rook-ceph-mon0: 2017-07-11 14:25:05.767259 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/951688217' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:06.725250 I | rook-ceph-mon0: 2017-07-11 14:25:06.725211 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:06.725453 I | rook-ceph-mon0: 2017-07-11 14:25:06.725357 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1399856285' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:07.193494 I | rook-ceph-mon0: 2017-07-11 14:25:07.193454 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:07.193732 I | rook-ceph-mon0: 2017-07-11 14:25:07.193604 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1008886825' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:08.101017 I | rook-ceph-mon0: 2017-07-11 14:25:08.100979 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:08.101265 I | rook-ceph-mon0: 2017-07-11 14:25:08.101248 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2703429932' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:08.589641 I | rook-ceph-mon0: 2017-07-11 14:25:08.589601 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:08.589833 I | rook-ceph-mon0: 2017-07-11 14:25:08.589749 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3916982015' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:09.618772 I | rook-ceph-mon0: 2017-07-11 14:25:09.618734 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:09.618986 I | rook-ceph-mon0: 2017-07-11 14:25:09.618951 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2384477951' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:11.432260 I | rook-ceph-mon0: 2017-07-11 14:25:11.432224 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:11.432477 I | rook-ceph-mon0: 2017-07-11 14:25:11.432369 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/540654082' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:13.655104 I | rook-ceph-mon0: 2017-07-11 14:25:13.655065 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:13.655328 I | rook-ceph-mon0: 2017-07-11 14:25:13.655289 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3904315497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:15.755394 I | rook-ceph-mon0: 2017-07-11 14:25:15.755357 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:15.755621 I | rook-ceph-mon0: 2017-07-11 14:25:15.755504 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2676442867' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:16.653878 I | rook-ceph-mon0: 2017-07-11 14:25:16.653837 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:16.653991 I | rook-ceph-mon0: 2017-07-11 14:25:16.653974 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2914453818' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:18.115218 I | rook-ceph-mon0: 2017-07-11 14:25:18.115179 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:18.115449 I | rook-ceph-mon0: 2017-07-11 14:25:18.115430 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2017993746' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:18.205460 I | rook-ceph-mon0: 2017-07-11 14:25:18.205424 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:25:18.205575 I | rook-ceph-mon0: 2017-07-11 14:25:18.205561 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/60712217' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:25:22.135926 I | rook-ceph-mon0: 2017-07-11 14:25:22.135888 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:22.135998 I | rook-ceph-mon0: 2017-07-11 14:25:22.135983 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/64815244' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:23.091089 I | rook-ceph-mon0: 2017-07-11 14:25:23.091049 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:23.091329 I | rook-ceph-mon0: 2017-07-11 14:25:23.091279 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3900240881' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:23.539002 I | rook-ceph-mon0: 2017-07-11 14:25:23.538964 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:23.539194 I | rook-ceph-mon0: 2017-07-11 14:25:23.539109 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3052610615' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:24.027915 I | rook-ceph-mon0: 2017-07-11 14:25:24.027877 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:24.028137 I | rook-ceph-mon0: 2017-07-11 14:25:24.028098 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2416437487' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:27.135162 I | rook-ceph-mon0: 2017-07-11 14:25:27.135123 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:27.135379 I | rook-ceph-mon0: 2017-07-11 14:25:27.135275 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2550085868' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:28.042913 I | rook-ceph-mon0: 2017-07-11 14:25:28.042875 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:28.043108 I | rook-ceph-mon0: 2017-07-11 14:25:28.043021 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3061329010' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:28.513966 I | rook-ceph-mon0: 2017-07-11 14:25:28.513929 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:28.514155 I | rook-ceph-mon0: 2017-07-11 14:25:28.514072 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1829908430' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:28.990308 I | rook-ceph-mon0: 2017-07-11 14:25:28.990269 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:28.990545 I | rook-ceph-mon0: 2017-07-11 14:25:28.990417 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1183387101' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:29.246432 I | rook-ceph-mon0: 2017-07-11 14:25:29.246398 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:25:29.246497 I | rook-ceph-mon0: 2017-07-11 14:25:29.246482 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2170267391' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:25:32.479703 I | rook-ceph-mon0: 2017-07-11 14:25:32.479665 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:32.479950 I | rook-ceph-mon0: 2017-07-11 14:25:32.479890 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3712350174' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:32.943468 I | rook-ceph-mon0: 2017-07-11 14:25:32.943431 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:32.943666 I | rook-ceph-mon0: 2017-07-11 14:25:32.943582 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/28152408' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:35.590197 I | rook-ceph-mon0: 2017-07-11 14:25:35.590159 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:35.590411 I | rook-ceph-mon0: 2017-07-11 14:25:35.590308 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3330654726' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:38.200313 I | rook-ceph-mon0: 2017-07-11 14:25:38.200277 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:38.200553 I | rook-ceph-mon0: 2017-07-11 14:25:38.200534 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1569867530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:39.109576 I | rook-ceph-mon0: 2017-07-11 14:25:39.109536 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:39.109791 I | rook-ceph-mon0: 2017-07-11 14:25:39.109688 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3367383972' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:40.162621 I | rook-ceph-mon0: 2017-07-11 14:25:40.162583 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:25:40.162813 I | rook-ceph-mon0: 2017-07-11 14:25:40.162721 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4166764646' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:25:40.477290 I | rook-ceph-mon0: 2017-07-11 14:25:40.477252 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:40.477435 I | rook-ceph-mon0: 2017-07-11 14:25:40.477420 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/438858015' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:40.938475 I | rook-ceph-mon0: 2017-07-11 14:25:40.938437 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:40.938666 I | rook-ceph-mon0: 2017-07-11 14:25:40.938583 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/180058479' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:41.863404 I | rook-ceph-mon0: 2017-07-11 14:25:41.863364 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:41.863625 I | rook-ceph-mon0: 2017-07-11 14:25:41.863585 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3006796494' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:42.800785 I | rook-ceph-mon0: 2017-07-11 14:25:42.800725 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:42.800851 I | rook-ceph-mon0: 2017-07-11 14:25:42.800837 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3685755013' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:44.735232 I | rook-ceph-mon0: 2017-07-11 14:25:44.735193 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:44.735456 I | rook-ceph-mon0: 2017-07-11 14:25:44.735416 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/872389252' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:45.580159 I | rook-ceph-mon0: 2017-07-11 14:25:45.579974 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4822 MB, avail 94364 MB
- 2017-07-11 14:25:47.229258 I | rook-ceph-mon0: 2017-07-11 14:25:47.229217 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:47.229457 I | rook-ceph-mon0: 2017-07-11 14:25:47.229369 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/742168912' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:47.682413 I | rook-ceph-mon0: 2017-07-11 14:25:47.682374 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:47.682608 I | rook-ceph-mon0: 2017-07-11 14:25:47.682523 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1193802933' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:48.593397 I | rook-ceph-mon0: 2017-07-11 14:25:48.593361 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:48.593586 I | rook-ceph-mon0: 2017-07-11 14:25:48.593494 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1556400380' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:51.000674 I | rook-ceph-mon0: 2017-07-11 14:25:51.000636 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:51.000890 I | rook-ceph-mon0: 2017-07-11 14:25:51.000786 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/985448661' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:51.445036 I | rook-ceph-mon0: 2017-07-11 14:25:51.444999 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:51.445202 I | rook-ceph-mon0: 2017-07-11 14:25:51.445186 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2411043641' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:52.378897 I | rook-ceph-mon0: 2017-07-11 14:25:52.378850 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:52.378966 I | rook-ceph-mon0: 2017-07-11 14:25:52.378950 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/504631907' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:57.334514 I | rook-ceph-mon0: 2017-07-11 14:25:57.334474 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:57.334731 I | rook-ceph-mon0: 2017-07-11 14:25:57.334625 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2767134840' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:58.233067 I | rook-ceph-mon0: 2017-07-11 14:25:58.233028 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:58.233282 I | rook-ceph-mon0: 2017-07-11 14:25:58.233178 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3408546495' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:58.740026 I | rook-ceph-mon0: 2017-07-11 14:25:58.739987 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:58.740250 I | rook-ceph-mon0: 2017-07-11 14:25:58.740216 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/567953744' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:59.221316 I | rook-ceph-mon0: 2017-07-11 14:25:59.221278 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:25:59.221579 I | rook-ceph-mon0: 2017-07-11 14:25:59.221561 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4181097307' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:25:59.653511 I | rook-ceph-mon0: 2017-07-11 14:25:59.653471 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:59.653682 I | rook-ceph-mon0: 2017-07-11 14:25:59.653612 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1275545181' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:00.208053 I | rook-ceph-mon0: 2017-07-11 14:26:00.208016 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:00.208269 I | rook-ceph-mon0: 2017-07-11 14:26:00.208189 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3908661254' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:02.177688 I | rook-ceph-mon0: 2017-07-11 14:26:02.177654 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:02.177883 I | rook-ceph-mon0: 2017-07-11 14:26:02.177796 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/505635118' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:02.491791 I | rook-ceph-mon0: 2017-07-11 14:26:02.491742 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:26:02.491862 I | rook-ceph-mon0: 2017-07-11 14:26:02.491847 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/729735073' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:26:03.114809 I | rook-ceph-mon0: 2017-07-11 14:26:03.114770 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:03.115022 I | rook-ceph-mon0: 2017-07-11 14:26:03.114916 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/297749235' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:03.581679 I | rook-ceph-mon0: 2017-07-11 14:26:03.581634 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:03.581795 I | rook-ceph-mon0: 2017-07-11 14:26:03.581780 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/607262623' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:04.021531 I | rook-ceph-mon0: 2017-07-11 14:26:04.021493 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:04.022220 I | rook-ceph-mon0: 2017-07-11 14:26:04.021638 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2356450095' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:07.813419 I | rook-ceph-mon0: 2017-07-11 14:26:07.813242 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:07.813520 I | rook-ceph-mon0: 2017-07-11 14:26:07.813262 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4232341776' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:10.100797 I | rook-ceph-mon0: 2017-07-11 14:26:10.100760 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:10.100999 I | rook-ceph-mon0: 2017-07-11 14:26:10.100915 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1998585503' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:10.260238 I | rook-ceph-mon0: 2017-07-11 14:26:10.260200 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:26:10.260381 I | rook-ceph-mon0: 2017-07-11 14:26:10.260366 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2302581622' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:26:10.665470 I | rook-ceph-mon0: 2017-07-11 14:26:10.665432 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:10.665669 I | rook-ceph-mon0: 2017-07-11 14:26:10.665581 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2775207235' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:13.505472 I | rook-ceph-mon0: 2017-07-11 14:26:13.505437 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:26:13.505666 I | rook-ceph-mon0: 2017-07-11 14:26:13.505578 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/127920583' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:26:14.875002 I | rook-ceph-mon0: 2017-07-11 14:26:14.874952 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:14.875194 I | rook-ceph-mon0: 2017-07-11 14:26:14.875107 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2881939408' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:15.316709 I | rook-ceph-mon0: 2017-07-11 14:26:15.316671 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:15.316856 I | rook-ceph-mon0: 2017-07-11 14:26:15.316839 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2870135876' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:18.492197 I | rook-ceph-mon0: 2017-07-11 14:26:18.492157 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:18.492410 I | rook-ceph-mon0: 2017-07-11 14:26:18.492307 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1896150003' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:18.953834 I | rook-ceph-mon0: 2017-07-11 14:26:18.953796 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:18.954019 I | rook-ceph-mon0: 2017-07-11 14:26:18.953937 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3792110664' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:19.404593 I | rook-ceph-mon0: 2017-07-11 14:26:19.404556 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:19.404662 I | rook-ceph-mon0: 2017-07-11 14:26:19.404646 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3432441433' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:19.846897 I | rook-ceph-mon0: 2017-07-11 14:26:19.846859 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:19.847074 I | rook-ceph-mon0: 2017-07-11 14:26:19.846994 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3894439198' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:21.310558 I | rook-ceph-mon0: 2017-07-11 14:26:21.310520 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:21.310770 I | rook-ceph-mon0: 2017-07-11 14:26:21.310664 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2493079067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:21.514110 I | rook-ceph-mon0: 2017-07-11 14:26:21.514062 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:26:21.514259 I | rook-ceph-mon0: 2017-07-11 14:26:21.514243 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/967564962' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:26:22.243431 I | rook-ceph-mon0: 2017-07-11 14:26:22.243392 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:22.243500 I | rook-ceph-mon0: 2017-07-11 14:26:22.243484 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/432650553' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:22.726503 I | rook-ceph-mon0: 2017-07-11 14:26:22.726463 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:22.726720 I | rook-ceph-mon0: 2017-07-11 14:26:22.726617 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3900227180' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:25.223095 I | rook-ceph-mon0: 2017-07-11 14:26:25.222823 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:25.223310 I | rook-ceph-mon0: 2017-07-11 14:26:25.223279 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3019070235' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:26.302632 I | rook-ceph-mon0: 2017-07-11 14:26:26.302591 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:26.302827 I | rook-ceph-mon0: 2017-07-11 14:26:26.302742 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1389203195' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:30.290059 I | rook-ceph-mon0: 2017-07-11 14:26:30.290020 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:30.290299 I | rook-ceph-mon0: 2017-07-11 14:26:30.290179 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1441011423' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:32.662383 I | rook-ceph-mon0: 2017-07-11 14:26:32.662343 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:26:32.662607 I | rook-ceph-mon0: 2017-07-11 14:26:32.662575 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3721970582' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:26:34.130733 I | rook-ceph-mon0: 2017-07-11 14:26:34.130694 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:34.130960 I | rook-ceph-mon0: 2017-07-11 14:26:34.130852 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3211503820' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:35.545457 I | rook-ceph-mon0: 2017-07-11 14:26:35.545418 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:26:35.545669 I | rook-ceph-mon0: 2017-07-11 14:26:35.545569 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2744342060' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:26:35.639705 I | rook-ceph-mon0: 2017-07-11 14:26:35.639669 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:35.639828 I | rook-ceph-mon0: 2017-07-11 14:26:35.639813 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3498626018' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:38.524059 I | rook-ceph-mon0: 2017-07-11 14:26:38.524015 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:38.524266 I | rook-ceph-mon0: 2017-07-11 14:26:38.524168 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/432259867' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:38.988926 I | rook-ceph-mon0: 2017-07-11 14:26:38.988877 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:38.989186 I | rook-ceph-mon0: 2017-07-11 14:26:38.989044 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1017435658' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:39.427404 I | rook-ceph-mon0: 2017-07-11 14:26:39.427366 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:39.427470 I | rook-ceph-mon0: 2017-07-11 14:26:39.427454 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/564451553' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:39.931053 I | rook-ceph-mon0: 2017-07-11 14:26:39.931015 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:39.931250 I | rook-ceph-mon0: 2017-07-11 14:26:39.931165 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2336618239' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:42.851659 I | rook-ceph-mon0: 2017-07-11 14:26:42.851610 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:42.851903 I | rook-ceph-mon0: 2017-07-11 14:26:42.851765 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3100878529' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:44.721035 I | rook-ceph-mon0: 2017-07-11 14:26:44.720999 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:44.721296 I | rook-ceph-mon0: 2017-07-11 14:26:44.721281 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/969060329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:45.580387 I | rook-ceph-mon0: 2017-07-11 14:26:45.580230 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4822 MB, avail 94364 MB
- 2017-07-11 14:26:46.570974 I | rook-ceph-mon0: 2017-07-11 14:26:46.570936 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:26:46.571060 I | rook-ceph-mon0: 2017-07-11 14:26:46.571035 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/535452703' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:26:47.368099 I | rook-ceph-mon0: 2017-07-11 14:26:47.368063 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:47.368299 I | rook-ceph-mon0: 2017-07-11 14:26:47.368283 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1508797949' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:48.273783 I | rook-ceph-mon0: 2017-07-11 14:26:48.273745 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:48.274037 I | rook-ceph-mon0: 2017-07-11 14:26:48.274015 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2254756760' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:49.147855 I | rook-ceph-mon0: 2017-07-11 14:26:49.147811 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:49.148344 I | rook-ceph-mon0: 2017-07-11 14:26:49.148325 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3397361623' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:49.996616 I | rook-ceph-mon0: 2017-07-11 14:26:49.996579 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:49.999090 I | rook-ceph-mon0: 2017-07-11 14:26:49.999061 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/111292908' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:50.438008 I | rook-ceph-mon0: 2017-07-11 14:26:50.437973 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:50.438109 I | rook-ceph-mon0: 2017-07-11 14:26:50.438095 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1331429988' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:53.244604 I | rook-ceph-mon0: 2017-07-11 14:26:53.244554 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:53.244785 I | rook-ceph-mon0: 2017-07-11 14:26:53.244706 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2039880795' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:54.149822 I | rook-ceph-mon0: 2017-07-11 14:26:54.149780 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:54.149906 I | rook-ceph-mon0: 2017-07-11 14:26:54.149882 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3694069976' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:55.574548 I | rook-ceph-mon0: 2017-07-11 14:26:55.574494 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:55.574734 I | rook-ceph-mon0: 2017-07-11 14:26:55.574652 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3869535375' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:58.167521 I | rook-ceph-mon0: 2017-07-11 14:26:58.167438 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #68. Immutable memtables: 0.
- 2017-07-11 14:26:58.167639 I | rook-ceph-mon0:
- 2017-07-11 14:26:58.167691 I | rook-ceph-mon0: 2017-07-11 14:26:58.167464 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 42] Syncing log #65
- 2017-07-11 14:26:58.196257 I | rook-ceph-mon0: 2017-07-11 14:26:58.194749 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.167459) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:26:58.196303 I | rook-ceph-mon0: 2017-07-11 14:26:58.194770 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 42] Flushing memtable with next log file: 68
- 2017-07-11 14:26:58.196318 I | rook-ceph-mon0:
- 2017-07-11 14:26:58.196331 I | rook-ceph-mon0: 2017-07-11 14:26:58.194779 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218194775, "job": 42, "event": "flush_started", "num_memtables": 1, "num_entries": 2169, "num_deletes": 500, "memory_usage": 4764328}
- 2017-07-11 14:26:58.196341 I | rook-ceph-mon0: 2017-07-11 14:26:58.194781 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 42] Level-0 flush table #69: started
- 2017-07-11 14:26:58.361058 I | rook-ceph-mon0: 2017-07-11 14:26:58.361000 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218360988, "cf_name": "default", "job": 42, "event": "table_file_creation", "file_number": 69, "file_size": 4702775, "table_properties": {"data_size": 4686679, "index_size": 15277, "filter_size": 0, "raw_key_size": 20609, "raw_average_key_size": 18, "raw_value_size": 4660985, "raw_average_value_size": 4199, "num_data_blocks": 484, "num_entries": 1110, "filter_policy_name": "", "kDeletedKeys": "500", "kMergeOperands": "0"}}
- 2017-07-11 14:26:58.361240 I | rook-ceph-mon0: 2017-07-11 14:26:58.361158 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 42] Level-0 flush table #69: 4702775 bytes OK
- 2017-07-11 14:26:58.431821 I | rook-ceph-mon0: 2017-07-11 14:26:58.431753 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.399489) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #69 started
- 2017-07-11 14:26:58.431902 I | rook-ceph-mon0: 2017-07-11 14:26:58.431877 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.431691) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #69: memtable #1 done
- 2017-07-11 14:26:58.431948 I | rook-ceph-mon0: 2017-07-11 14:26:58.431934 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.431715) EVENT_LOG_v1 {"time_micros": 1499783218431706, "job": 42, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:26:58.431975 I | rook-ceph-mon0: 2017-07-11 14:26:58.431964 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.431737) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:26:58.431988 I | rook-ceph-mon0:
- 2017-07-11 14:26:58.432029 I | rook-ceph-mon0: 2017-07-11 14:26:58.432017 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 42] Try to delete WAL files size 4711920, prev total WAL file size 4711920, number of live WAL files 2.
- 2017-07-11 14:26:58.432042 I | rook-ceph-mon0:
- 2017-07-11 14:26:58.439499 I | rook-ceph-mon0: 2017-07-11 14:26:58.432874 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:26:58.439670 I | rook-ceph-mon0: 2017-07-11 14:26:58.432923 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.432917) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:26:58.439691 I | rook-ceph-mon0:
- 2017-07-11 14:26:58.439704 I | rook-ceph-mon0: 2017-07-11 14:26:58.432928 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 43] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:26:58.439730 I | rook-ceph-mon0: 2017-07-11 14:26:58.432932 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 42 Base level 0, inputs: [69(4592KB)], [67(13MB)]
- 2017-07-11 14:26:58.439742 I | rook-ceph-mon0:
- 2017-07-11 14:26:58.439753 I | rook-ceph-mon0: 2017-07-11 14:26:58.432941 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218432935, "job": 43, "event": "compaction_started", "files_L0": [69], "files_L1": [67], "score": -1, "input_data_size": 18378065}
- 2017-07-11 14:26:58.572817 I | rook-ceph-mon0: 2017-07-11 14:26:58.572736 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 43] Generated table #70: 2181 keys, 15523420 bytes
- 2017-07-11 14:26:58.572880 I | rook-ceph-mon0: 2017-07-11 14:26:58.572863 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218572853, "cf_name": "default", "job": 43, "event": "table_file_creation", "file_number": 70, "file_size": 15523420, "table_properties": {"data_size": 15472724, "index_size": 49877, "filter_size": 0, "raw_key_size": 40760, "raw_average_key_size": 18, "raw_value_size": 15407597, "raw_average_value_size": 7064, "num_data_blocks": 1555, "num_entries": 2181, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:26:58.609189 I | rook-ceph-mon0: 2017-07-11 14:26:58.609150 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 43] Compacted 1@0 + 1@1 files to L1 => 15523420 bytes
- 2017-07-11 14:26:58.635541 I | rook-ceph-mon0: 2017-07-11 14:26:58.635510 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.635454) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 104.3 rd, 88.1 wr, level 1, files in(1, 1) out(1) MB in(4.5, 13.0) out(14.8), read-write-amplify(7.2) write-amplify(3.3) OK, records in: 3188, records dropped: 1007
- 2017-07-11 14:26:58.635550 I | rook-ceph-mon0:
- 2017-07-11 14:26:58.635579 I | rook-ceph-mon0: 2017-07-11 14:26:58.635563 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.635471) EVENT_LOG_v1 {"time_micros": 1499783218635464, "job": 43, "event": "compaction_finished", "compaction_time_micros": 176195, "output_level": 1, "num_output_files": 1, "total_output_size": 15523420, "num_input_records": 3188, "num_output_records": 2181, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:26:58.636344 I | rook-ceph-mon0: 2017-07-11 14:26:58.636330 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218636327, "job": 43, "event": "table_file_deletion", "file_number": 69}
- 2017-07-11 14:26:58.637904 I | rook-ceph-mon0: 2017-07-11 14:26:58.637890 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218637888, "job": 43, "event": "table_file_deletion", "file_number": 67}
- 2017-07-11 14:26:58.637969 I | rook-ceph-mon0: 2017-07-11 14:26:58.637955 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:27:00.653691 I | rook-ceph-mon0: 2017-07-11 14:27:00.653650 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:00.653932 I | rook-ceph-mon0: 2017-07-11 14:27:00.653807 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/590072062' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:02.062381 I | rook-ceph-mon0: 2017-07-11 14:27:02.062341 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:02.062623 I | rook-ceph-mon0: 2017-07-11 14:27:02.062582 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1074297936' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:04.407350 I | rook-ceph-mon0: 2017-07-11 14:27:04.407305 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:04.407412 I | rook-ceph-mon0: 2017-07-11 14:27:04.407399 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2088595228' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:05.088522 I | rook-ceph-mon0: 2017-07-11 14:27:05.088482 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:05.088603 I | rook-ceph-mon0: 2017-07-11 14:27:05.088587 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3870956887' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:06.100532 I | rook-ceph-mon0: 2017-07-11 14:27:06.100491 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:27:06.100600 I | rook-ceph-mon0: 2017-07-11 14:27:06.100584 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3450149256' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:27:06.154998 I | rook-ceph-mon0: 2017-07-11 14:27:06.154961 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:06.155063 I | rook-ceph-mon0: 2017-07-11 14:27:06.155048 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/746126908' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:07.571411 I | rook-ceph-mon0: 2017-07-11 14:27:07.571372 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:07.571648 I | rook-ceph-mon0: 2017-07-11 14:27:07.571611 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1475635350' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:09.290664 I | rook-ceph-mon0: 2017-07-11 14:27:09.290625 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:09.290906 I | rook-ceph-mon0: 2017-07-11 14:27:09.290875 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2295445133' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:10.100436 I | rook-ceph-mon0: 2017-07-11 14:27:10.100389 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:10.100630 I | rook-ceph-mon0: 2017-07-11 14:27:10.100544 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1905115298' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:11.058356 I | rook-ceph-mon0: 2017-07-11 14:27:11.058318 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:11.058570 I | rook-ceph-mon0: 2017-07-11 14:27:11.058541 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2168406186' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:12.849419 I | rook-ceph-mon0: 2017-07-11 14:27:12.849334 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #71. Immutable memtables: 0.
- 2017-07-11 14:27:12.849513 I | rook-ceph-mon0:
- 2017-07-11 14:27:12.849550 I | rook-ceph-mon0: 2017-07-11 14:27:12.849372 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 44] Syncing log #68
- 2017-07-11 14:27:12.865615 I | rook-ceph-mon0: 2017-07-11 14:27:12.864832 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:27:12.849365) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:27:12.865665 I | rook-ceph-mon0: 2017-07-11 14:27:12.864843 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 44] Flushing memtable with next log file: 71
- 2017-07-11 14:27:12.865683 I | rook-ceph-mon0:
- 2017-07-11 14:27:12.865695 I | rook-ceph-mon0: 2017-07-11 14:27:12.864853 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783232864849, "job": 44, "event": "flush_started", "num_memtables": 1, "num_entries": 396, "num_deletes": 251, "memory_usage": 425216}
- 2017-07-11 14:27:12.865712 I | rook-ceph-mon0: 2017-07-11 14:27:12.864855 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 44] Level-0 flush table #72: started
- 2017-07-11 14:27:12.886923 I | rook-ceph-mon0: 2017-07-11 14:27:12.886898 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:12.887015 I | rook-ceph-mon0: 2017-07-11 14:27:12.886999 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3339786680' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:12.912387 I | rook-ceph-mon0: 2017-07-11 14:27:12.912331 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783232912322, "cf_name": "default", "job": 44, "event": "table_file_creation", "file_number": 72, "file_size": 415056, "table_properties": {"data_size": 412936, "index_size": 1306, "filter_size": 0, "raw_key_size": 5691, "raw_average_key_size": 18, "raw_value_size": 407865, "raw_average_value_size": 1315, "num_data_blocks": 42, "num_entries": 310, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:27:12.912437 I | rook-ceph-mon0: 2017-07-11 14:27:12.912341 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 44] Level-0 flush table #72: 415056 bytes OK
- 2017-07-11 14:27:13.009871 I | rook-ceph-mon0: 2017-07-11 14:27:13.006879 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:27:12.943592) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #72 started
- 2017-07-11 14:27:13.009954 I | rook-ceph-mon0: 2017-07-11 14:27:13.006887 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.006827) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #72: memtable #1 done
- 2017-07-11 14:27:13.009972 I | rook-ceph-mon0: 2017-07-11 14:27:13.006889 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.006850) EVENT_LOG_v1 {"time_micros": 1499783233006844, "job": 44, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:27:13.010001 I | rook-ceph-mon0: 2017-07-11 14:27:13.006890 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.006867) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:27:13.010016 I | rook-ceph-mon0:
- 2017-07-11 14:27:13.010028 I | rook-ceph-mon0: 2017-07-11 14:27:13.006896 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 44] Try to delete WAL files size 414742, prev total WAL file size 414742, number of live WAL files 2.
- 2017-07-11 14:27:13.010039 I | rook-ceph-mon0:
- 2017-07-11 14:27:13.010051 I | rook-ceph-mon0: 2017-07-11 14:27:13.007056 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:27:13.010078 I | rook-ceph-mon0: 2017-07-11 14:27:13.007087 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.007081) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:27:13.010092 I | rook-ceph-mon0:
- 2017-07-11 14:27:13.010114 I | rook-ceph-mon0: 2017-07-11 14:27:13.007092 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 45] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:27:13.010127 I | rook-ceph-mon0: 2017-07-11 14:27:13.007097 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 44 Base level 0, inputs: [72(405KB)], [70(14MB)]
- 2017-07-11 14:27:13.010138 I | rook-ceph-mon0:
- 2017-07-11 14:27:13.010165 I | rook-ceph-mon0: 2017-07-11 14:27:13.007106 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233007099, "job": 45, "event": "compaction_started", "files_L0": [72], "files_L1": [70], "score": -1, "input_data_size": 15938476}
- 2017-07-11 14:27:13.101003 I | rook-ceph-mon0: 2017-07-11 14:27:13.100950 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 45] Generated table #73: 1982 keys, 13390993 bytes
- 2017-07-11 14:27:13.101193 I | rook-ceph-mon0: 2017-07-11 14:27:13.101108 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233101098, "cf_name": "default", "job": 45, "event": "table_file_creation", "file_number": 73, "file_size": 13390993, "table_properties": {"data_size": 13346695, "index_size": 43479, "filter_size": 0, "raw_key_size": 37230, "raw_average_key_size": 18, "raw_value_size": 13288690, "raw_average_value_size": 6704, "num_data_blocks": 1346, "num_entries": 1982, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:27:13.138085 I | rook-ceph-mon0: 2017-07-11 14:27:13.134660 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 45] Compacted 1@0 + 1@1 files to L1 => 13390993 bytes
- 2017-07-11 14:27:13.164040 I | rook-ceph-mon0: 2017-07-11 14:27:13.164006 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.163917) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 125.0 rd, 105.0 wr, level 1, files in(1, 1) out(1) MB in(0.4, 14.8) out(12.8), read-write-amplify(70.7) write-amplify(32.3) OK, records in: 2491, records dropped: 509
- 2017-07-11 14:27:13.164117 I | rook-ceph-mon0:
- 2017-07-11 14:27:13.164182 I | rook-ceph-mon0: 2017-07-11 14:27:13.164136 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.163944) EVENT_LOG_v1 {"time_micros": 1499783233163934, "job": 45, "event": "compaction_finished", "compaction_time_micros": 127529, "output_level": 1, "num_output_files": 1, "total_output_size": 13390993, "num_input_records": 2491, "num_output_records": 1982, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:27:13.164449 I | rook-ceph-mon0: 2017-07-11 14:27:13.164435 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233164432, "job": 45, "event": "table_file_deletion", "file_number": 72}
- 2017-07-11 14:27:13.166368 I | rook-ceph-mon0: 2017-07-11 14:27:13.166353 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233166350, "job": 45, "event": "table_file_deletion", "file_number": 70}
- 2017-07-11 14:27:13.429151 I | rook-ceph-mon0: 2017-07-11 14:27:13.429116 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:13.429353 I | rook-ceph-mon0: 2017-07-11 14:27:13.429273 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/631165174' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:13.871936 I | rook-ceph-mon0: 2017-07-11 14:27:13.871897 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:13.872193 I | rook-ceph-mon0: 2017-07-11 14:27:13.872030 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3120428257' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:16.310566 I | rook-ceph-mon0: 2017-07-11 14:27:16.310517 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:16.310788 I | rook-ceph-mon0: 2017-07-11 14:27:16.310686 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4290539788' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:16.777612 I | rook-ceph-mon0: 2017-07-11 14:27:16.777574 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:16.777839 I | rook-ceph-mon0: 2017-07-11 14:27:16.777730 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/542745679' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:17.226013 I | rook-ceph-mon0: 2017-07-11 14:27:17.225964 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:17.226173 I | rook-ceph-mon0: 2017-07-11 14:27:17.226158 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2037107020' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:18.560329 I | rook-ceph-mon0: 2017-07-11 14:27:18.560290 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:18.560600 I | rook-ceph-mon0: 2017-07-11 14:27:18.560581 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2567788887' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:19.468720 I | rook-ceph-mon0: 2017-07-11 14:27:19.468681 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:19.468947 I | rook-ceph-mon0: 2017-07-11 14:27:19.468841 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/82347839' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:20.120960 I | rook-ceph-mon0: 2017-07-11 14:27:20.120921 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:27:20.121186 I | rook-ceph-mon0: 2017-07-11 14:27:20.121072 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2218959653' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:27:20.324156 I | rook-ceph-mon0: 2017-07-11 14:27:20.324125 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:20.324275 I | rook-ceph-mon0: 2017-07-11 14:27:20.324261 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3796387091' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:27.607161 I | rook-ceph-mon0: 2017-07-11 14:27:27.607112 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:27.607427 I | rook-ceph-mon0: 2017-07-11 14:27:27.607409 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1252182310' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:28.510001 I | rook-ceph-mon0: 2017-07-11 14:27:28.509964 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:28.510255 I | rook-ceph-mon0: 2017-07-11 14:27:28.510236 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2689095746' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:28.934203 I | rook-ceph-mon0: 2017-07-11 14:27:28.934147 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:28.934387 I | rook-ceph-mon0: 2017-07-11 14:27:28.934310 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1606189408' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:29.365041 I | rook-ceph-mon0: 2017-07-11 14:27:29.365003 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:29.365260 I | rook-ceph-mon0: 2017-07-11 14:27:29.365223 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2564873702' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:31.098319 I | rook-ceph-mon0: 2017-07-11 14:27:31.098282 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:27:31.098562 I | rook-ceph-mon0: 2017-07-11 14:27:31.098545 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3480453759' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:27:32.694225 I | rook-ceph-mon0: 2017-07-11 14:27:32.694164 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:32.694290 I | rook-ceph-mon0: 2017-07-11 14:27:32.694273 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3589742285' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:34.831815 I | rook-ceph-mon0: 2017-07-11 14:27:34.831776 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:34.832047 I | rook-ceph-mon0: 2017-07-11 14:27:34.831923 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4259300872' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:35.857455 I | rook-ceph-mon0: 2017-07-11 14:27:35.857417 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:35.857650 I | rook-ceph-mon0: 2017-07-11 14:27:35.857562 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2889137385' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:36.699884 I | rook-ceph-mon0: 2017-07-11 14:27:36.699848 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:36.700105 I | rook-ceph-mon0: 2017-07-11 14:27:36.699994 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4201692660' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:38.468285 I | rook-ceph-mon0: 2017-07-11 14:27:38.468246 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:38.468503 I | rook-ceph-mon0: 2017-07-11 14:27:38.468393 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3751824971' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:38.927331 I | rook-ceph-mon0: 2017-07-11 14:27:38.927291 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:38.927551 I | rook-ceph-mon0: 2017-07-11 14:27:38.927515 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/395950963' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:39.386736 I | rook-ceph-mon0: 2017-07-11 14:27:39.386700 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:27:39.386947 I | rook-ceph-mon0: 2017-07-11 14:27:39.386842 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/989610776' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:27:39.806630 I | rook-ceph-mon0: 2017-07-11 14:27:39.806593 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:39.806825 I | rook-ceph-mon0: 2017-07-11 14:27:39.806739 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/685451279' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:40.188288 I | rook-ceph-mon0: 2017-07-11 14:27:40.188251 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:40.188417 I | rook-ceph-mon0: 2017-07-11 14:27:40.188401 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3137896469' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:41.134246 I | rook-ceph-mon0: 2017-07-11 14:27:41.134212 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:41.134427 I | rook-ceph-mon0: 2017-07-11 14:27:41.134348 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/552829018' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:42.173297 I | rook-ceph-mon0: 2017-07-11 14:27:42.173260 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:27:42.173364 I | rook-ceph-mon0: 2017-07-11 14:27:42.173349 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/859111219' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:27:42.954071 I | rook-ceph-mon0: 2017-07-11 14:27:42.954036 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:42.954263 I | rook-ceph-mon0: 2017-07-11 14:27:42.954178 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/551931049' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:43.855913 I | rook-ceph-mon0: 2017-07-11 14:27:43.855875 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:43.856107 I | rook-ceph-mon0: 2017-07-11 14:27:43.856022 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/813510141' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:45.580620 I | rook-ceph-mon0: 2017-07-11 14:27:45.580469 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4822 MB, avail 94364 MB
- 2017-07-11 14:27:45.970275 I | rook-ceph-mon0: 2017-07-11 14:27:45.970238 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:45.970399 I | rook-ceph-mon0: 2017-07-11 14:27:45.970384 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/162013225' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:47.288670 I | rook-ceph-mon0: 2017-07-11 14:27:47.288633 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:47.288898 I | rook-ceph-mon0: 2017-07-11 14:27:47.288778 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3488422565' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:47.737572 I | rook-ceph-mon0: 2017-07-11 14:27:47.737534 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:47.737767 I | rook-ceph-mon0: 2017-07-11 14:27:47.737682 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4062392888' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:50.079923 I | rook-ceph-mon0: 2017-07-11 14:27:50.079883 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:50.080148 I | rook-ceph-mon0: 2017-07-11 14:27:50.080116 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2124638444' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:50.413994 I | rook-ceph-mon0: 2017-07-11 14:27:50.413933 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:27:50.414205 I | rook-ceph-mon0: 2017-07-11 14:27:50.414125 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3182959144' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:27:50.511057 I | rook-ceph-mon0: 2017-07-11 14:27:50.511020 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:50.511177 I | rook-ceph-mon0: 2017-07-11 14:27:50.511161 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2780986012' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:52.553850 I | rook-ceph-mon0: 2017-07-11 14:27:52.553813 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:52.554063 I | rook-ceph-mon0: 2017-07-11 14:27:52.553960 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2879744834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:53.135868 I | rook-ceph-mon0: 2017-07-11 14:27:53.135822 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:27:53.136105 I | rook-ceph-mon0: 2017-07-11 14:27:53.136002 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2755251358' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:27:54.527023 I | rook-ceph-mon0: 2017-07-11 14:27:54.526983 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:54.527249 I | rook-ceph-mon0: 2017-07-11 14:27:54.527133 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3200157949' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:55.009590 I | rook-ceph-mon0: 2017-07-11 14:27:55.009553 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:55.009656 I | rook-ceph-mon0: 2017-07-11 14:27:55.009641 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3423942624' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:59.398176 I | rook-ceph-mon0: 2017-07-11 14:27:59.398136 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:59.398386 I | rook-ceph-mon0: 2017-07-11 14:27:59.398286 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2152793884' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:59.910443 I | rook-ceph-mon0: 2017-07-11 14:27:59.910202 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:59.910531 I | rook-ceph-mon0: 2017-07-11 14:27:59.910223 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2565713005' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:01.449855 I | rook-ceph-mon0: 2017-07-11 14:28:01.449743 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:28:01.450502 I | rook-ceph-mon0: 2017-07-11 14:28:01.450163 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/40300991' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:28:02.874513 I | rook-ceph-mon0: 2017-07-11 14:28:02.874478 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:02.874589 I | rook-ceph-mon0: 2017-07-11 14:28:02.874570 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/100418373' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:04.706439 I | rook-ceph-mon0: 2017-07-11 14:28:04.706399 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:04.706663 I | rook-ceph-mon0: 2017-07-11 14:28:04.706549 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2046979593' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:05.667263 I | rook-ceph-mon0: 2017-07-11 14:28:05.667226 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:05.667328 I | rook-ceph-mon0: 2017-07-11 14:28:05.667313 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2251242701' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:12.647410 I | rook-ceph-mon0: 2017-07-11 14:28:12.647371 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:28:12.647638 I | rook-ceph-mon0: 2017-07-11 14:28:12.647603 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1440657027' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:28:15.322446 I | rook-ceph-mon0: 2017-07-11 14:28:15.322407 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:28:15.322641 I | rook-ceph-mon0: 2017-07-11 14:28:15.322554 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2182864028' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:28:15.431884 I | rook-ceph-mon0: 2017-07-11 14:28:15.431842 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:15.432100 I | rook-ceph-mon0: 2017-07-11 14:28:15.432067 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3081988951' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:19.050947 I | rook-ceph-mon0: 2017-07-11 14:28:19.050907 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:19.051163 I | rook-ceph-mon0: 2017-07-11 14:28:19.051060 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2173085530' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:22.103311 I | rook-ceph-mon0: 2017-07-11 14:28:22.103272 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:22.103530 I | rook-ceph-mon0: 2017-07-11 14:28:22.103424 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/623955123' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:24.008245 I | rook-ceph-mon0: 2017-07-11 14:28:24.008207 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:24.008467 I | rook-ceph-mon0: 2017-07-11 14:28:24.008372 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/739643809' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:24.423042 I | rook-ceph-mon0: 2017-07-11 14:28:24.422998 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:24.423165 I | rook-ceph-mon0: 2017-07-11 14:28:24.423150 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2917208268' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:25.025426 I | rook-ceph-mon0: 2017-07-11 14:28:25.025390 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:28:25.025722 I | rook-ceph-mon0: 2017-07-11 14:28:25.025698 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2144769348' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:28:26.633715 I | rook-ceph-mon0: 2017-07-11 14:28:26.633667 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:28:26.633938 I | rook-ceph-mon0: 2017-07-11 14:28:26.633834 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4021851615' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:28:29.377030 I | rook-ceph-mon0: 2017-07-11 14:28:29.376993 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:29.377238 I | rook-ceph-mon0: 2017-07-11 14:28:29.377208 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1914760639' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:31.106377 I | rook-ceph-mon0: 2017-07-11 14:28:31.106339 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:28:31.106604 I | rook-ceph-mon0: 2017-07-11 14:28:31.106559 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/135566437' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:28:34.300709 I | rook-ceph-mon0: 2017-07-11 14:28:34.300647 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:34.300975 I | rook-ceph-mon0: 2017-07-11 14:28:34.300955 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/916321278' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:35.037919 I | rook-ceph-mon0: 2017-07-11 14:28:35.037882 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:28:35.038162 I | rook-ceph-mon0: 2017-07-11 14:28:35.038122 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/373282102' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:28:37.309145 I | rook-ceph-mon0: 2017-07-11 14:28:37.309110 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:37.309336 I | rook-ceph-mon0: 2017-07-11 14:28:37.309254 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3089308482' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:37.614986 I | rook-ceph-mon0: 2017-07-11 14:28:37.614938 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:28:37.615248 I | rook-ceph-mon0: 2017-07-11 14:28:37.615121 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1367870830' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:28:39.197140 I | rook-ceph-mon0: 2017-07-11 14:28:39.197090 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:39.197351 I | rook-ceph-mon0: 2017-07-11 14:28:39.197321 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/653117192' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:39.625851 I | rook-ceph-mon0: 2017-07-11 14:28:39.625816 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:28:39.626031 I | rook-ceph-mon0: 2017-07-11 14:28:39.625951 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1317907745' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:28:40.964746 I | rook-ceph-mon0: 2017-07-11 14:28:40.964710 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:28:40.964977 I | rook-ceph-mon0: 2017-07-11 14:28:40.964930 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/299166243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:28:41.900889 I | rook-ceph-mon0: 2017-07-11 14:28:41.894758 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:41.900970 I | rook-ceph-mon0: 2017-07-11 14:28:41.900666 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/132594656' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:44.113232 I | rook-ceph-mon0: 2017-07-11 14:28:44.113185 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:44.113451 I | rook-ceph-mon0: 2017-07-11 14:28:44.113421 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/67049166' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:44.550209 I | rook-ceph-mon0: 2017-07-11 14:28:44.550166 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:28:44.553888 I | rook-ceph-mon0: 2017-07-11 14:28:44.550329 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3929362325' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:28:44.982848 I | rook-ceph-mon0: 2017-07-11 14:28:44.982810 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:44.983068 I | rook-ceph-mon0: 2017-07-11 14:28:44.982958 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3082291029' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:45.580899 I | rook-ceph-mon0: 2017-07-11 14:28:45.580709 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4822 MB, avail 94364 MB
- 2017-07-11 14:28:46.004959 I | rook-ceph-mon0: 2017-07-11 14:28:46.004896 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:28:46.005257 I | rook-ceph-mon0: 2017-07-11 14:28:46.005237 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4218128361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:28:46.188302 I | rook-ceph-mon0: 2017-07-11 14:28:46.188264 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:28:46.188498 I | rook-ceph-mon0: 2017-07-11 14:28:46.188412 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2203177492' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:28:48.628169 I | rook-ceph-mon0: 2017-07-11 14:28:48.628129 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:48.628425 I | rook-ceph-mon0: 2017-07-11 14:28:48.628281 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2026507962' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:49.560240 I | rook-ceph-mon0: 2017-07-11 14:28:49.560188 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:28:49.560505 I | rook-ceph-mon0: 2017-07-11 14:28:49.560488 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3665130327' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:28:51.689134 I | rook-ceph-mon0: 2017-07-11 14:28:51.689096 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:51.689331 I | rook-ceph-mon0: 2017-07-11 14:28:51.689250 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2732765492' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:53.553431 I | rook-ceph-mon0: 2017-07-11 14:28:53.553393 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:53.553675 I | rook-ceph-mon0: 2017-07-11 14:28:53.553658 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1865668691' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:53.994197 I | rook-ceph-mon0: 2017-07-11 14:28:53.994156 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:53.994391 I | rook-ceph-mon0: 2017-07-11 14:28:53.994304 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1939296080' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:54.396506 I | rook-ceph-mon0: 2017-07-11 14:28:54.396469 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:28:54.396691 I | rook-ceph-mon0: 2017-07-11 14:28:54.396608 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3178424109' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:28:58.487751 I | rook-ceph-mon0: 2017-07-11 14:28:58.487713 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:58.487990 I | rook-ceph-mon0: 2017-07-11 14:28:58.487973 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1186556861' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:59.001532 I | rook-ceph-mon0: 2017-07-11 14:28:59.001480 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:59.001603 I | rook-ceph-mon0: 2017-07-11 14:28:59.001583 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3201934670' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:00.019513 I | rook-ceph-mon0: 2017-07-11 14:29:00.019475 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:00.019582 I | rook-ceph-mon0: 2017-07-11 14:29:00.019566 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2751592018' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:05.902178 I | rook-ceph-mon0: 2017-07-11 14:29:05.902140 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:29:05.902398 I | rook-ceph-mon0: 2017-07-11 14:29:05.902366 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1974486111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:29:06.790298 I | rook-ceph-mon0: 2017-07-11 14:29:06.790262 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:06.790510 I | rook-ceph-mon0: 2017-07-11 14:29:06.790400 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/140904690' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:08.346328 I | rook-ceph-mon0: 2017-07-11 14:29:08.346277 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:08.346564 I | rook-ceph-mon0: 2017-07-11 14:29:08.346440 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1989418571' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:09.245806 I | rook-ceph-mon0: 2017-07-11 14:29:09.245765 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:29:09.245994 I | rook-ceph-mon0: 2017-07-11 14:29:09.245911 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1935463068' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:29:13.288133 I | rook-ceph-mon0: 2017-07-11 14:29:13.288092 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:13.288447 I | rook-ceph-mon0: 2017-07-11 14:29:13.288419 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/270404063' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:13.811465 I | rook-ceph-mon0: 2017-07-11 14:29:13.811418 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:13.811644 I | rook-ceph-mon0: 2017-07-11 14:29:13.811567 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3687744933' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:14.651982 I | rook-ceph-mon0: 2017-07-11 14:29:14.651944 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:14.652236 I | rook-ceph-mon0: 2017-07-11 14:29:14.652219 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2458616827' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:15.549274 I | rook-ceph-mon0: 2017-07-11 14:29:15.549240 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:29:15.549448 I | rook-ceph-mon0: 2017-07-11 14:29:15.549375 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3713373638' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:29:16.689787 I | rook-ceph-mon0: 2017-07-11 14:29:16.689748 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:16.689878 I | rook-ceph-mon0: 2017-07-11 14:29:16.689862 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2285082318' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:18.189768 I | rook-ceph-mon0: 2017-07-11 14:29:18.189730 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:18.190003 I | rook-ceph-mon0: 2017-07-11 14:29:18.189987 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2600716524' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:18.644324 I | rook-ceph-mon0: 2017-07-11 14:29:18.644288 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:18.644553 I | rook-ceph-mon0: 2017-07-11 14:29:18.644428 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2052224441' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:19.088037 I | rook-ceph-mon0: 2017-07-11 14:29:19.087998 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:29:19.088240 I | rook-ceph-mon0: 2017-07-11 14:29:19.088144 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/506855337' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:29:19.119748 I | rook-ceph-mon0: 2017-07-11 14:29:19.119717 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:29:19.119845 I | rook-ceph-mon0: 2017-07-11 14:29:19.119830 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2992560525' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:29:20.600861 I | rook-ceph-mon0: 2017-07-11 14:29:20.600827 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:29:20.601046 I | rook-ceph-mon0: 2017-07-11 14:29:20.600960 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/579072576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:29:22.131722 I | rook-ceph-mon0: 2017-07-11 14:29:22.131685 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:29:22.131989 I | rook-ceph-mon0: 2017-07-11 14:29:22.131973 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/495261567' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:29:25.331718 I | rook-ceph-mon0: 2017-07-11 14:29:25.331681 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:29:25.331946 I | rook-ceph-mon0: 2017-07-11 14:29:25.331826 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2878761686' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:29:28.461767 I | rook-ceph-mon0: 2017-07-11 14:29:28.461732 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:28.462236 I | rook-ceph-mon0: 2017-07-11 14:29:28.462219 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/270190798' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:28.899760 I | rook-ceph-mon0: 2017-07-11 14:29:28.899725 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:29:28.900033 I | rook-ceph-mon0: 2017-07-11 14:29:28.900012 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/873602009' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:29:30.159196 I | rook-ceph-mon0: 2017-07-11 14:29:30.159160 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:29:30.159389 I | rook-ceph-mon0: 2017-07-11 14:29:30.159313 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2300649195' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:29:33.119782 I | rook-ceph-mon0: 2017-07-11 14:29:33.119740 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:29:33.129602 I | rook-ceph-mon0: 2017-07-11 14:29:33.129560 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3323435369' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:29:33.418515 I | rook-ceph-mon0: 2017-07-11 14:29:33.418479 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:33.418839 I | rook-ceph-mon0: 2017-07-11 14:29:33.418816 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/220221313' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:35.241868 I | rook-ceph-mon0: 2017-07-11 14:29:35.241831 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:29:35.242103 I | rook-ceph-mon0: 2017-07-11 14:29:35.242072 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/877279270' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:29:35.582072 I | rook-ceph-mon0: 2017-07-11 14:29:35.582035 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.174452s > max 0.05s
- 2017-07-11 14:29:35.973374 I | rook-ceph-mon0: 2017-07-11 14:29:35.582160 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1036 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.174452s > max 0.05s
- 2017-07-11 14:29:36.313465 I | rook-ceph-mon0: 2017-07-11 14:29:36.313428 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:36.313738 I | rook-ceph-mon0: 2017-07-11 14:29:36.313687 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2015876246' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:37.940137 I | rook-ceph-mon0: 2017-07-11 14:29:37.940099 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:37.940355 I | rook-ceph-mon0: 2017-07-11 14:29:37.940324 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/573558111' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:39.610862 I | rook-ceph-mon0: 2017-07-11 14:29:39.610822 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:39.611606 I | rook-ceph-mon0: 2017-07-11 14:29:39.611583 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/516880864' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:41.527826 I | rook-ceph-mon0: 2017-07-11 14:29:41.527787 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:41.528037 I | rook-ceph-mon0: 2017-07-11 14:29:41.527938 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3799605902' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:43.378094 I | rook-ceph-mon0: 2017-07-11 14:29:43.378057 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:43.378160 I | rook-ceph-mon0: 2017-07-11 14:29:43.378144 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4127435369' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:43.845598 I | rook-ceph-mon0: 2017-07-11 14:29:43.845559 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:29:43.845820 I | rook-ceph-mon0: 2017-07-11 14:29:43.845714 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/731382447' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:29:44.270928 I | rook-ceph-mon0: 2017-07-11 14:29:44.270888 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:29:44.271122 I | rook-ceph-mon0: 2017-07-11 14:29:44.271035 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2448222709' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:29:44.286205 I | rook-ceph-mon0: 2017-07-11 14:29:44.286180 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:44.286293 I | rook-ceph-mon0: 2017-07-11 14:29:44.286278 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/850059218' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:45.581092 I | rook-ceph-mon0: 2017-07-11 14:29:45.580939 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4822 MB, avail 94364 MB
- 2017-07-11 14:29:46.266331 I | rook-ceph-mon0: 2017-07-11 14:29:46.266292 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:46.266559 I | rook-ceph-mon0: 2017-07-11 14:29:46.266441 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3612562599' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:48.252400 I | rook-ceph-mon0: 2017-07-11 14:29:48.252362 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:48.252612 I | rook-ceph-mon0: 2017-07-11 14:29:48.252509 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3947300382' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:51.122064 I | rook-ceph-mon0: 2017-07-11 14:29:51.122026 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:51.122279 I | rook-ceph-mon0: 2017-07-11 14:29:51.122176 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/538900074' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:52.343528 I | rook-ceph-mon0: 2017-07-11 14:29:52.343489 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:29:52.343747 I | rook-ceph-mon0: 2017-07-11 14:29:52.343712 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3309100569' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:29:54.015422 I | rook-ceph-mon0: 2017-07-11 14:29:54.015376 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:29:54.015490 I | rook-ceph-mon0: 2017-07-11 14:29:54.015474 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/683351566' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:29:57.637614 I | rook-ceph-mon0: 2017-07-11 14:29:57.637575 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:57.637686 I | rook-ceph-mon0: 2017-07-11 14:29:57.637668 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2984660670' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:58.556667 I | rook-ceph-mon0: 2017-07-11 14:29:58.556626 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:29:58.556863 I | rook-ceph-mon0: 2017-07-11 14:29:58.556776 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1084968281' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:29:59.987706 I | rook-ceph-mon0: 2017-07-11 14:29:59.987669 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:29:59.987927 I | rook-ceph-mon0: 2017-07-11 14:29:59.987894 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3625815271' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:30:03.550478 I | rook-ceph-mon0: 2017-07-11 14:30:03.550444 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:30:03.550543 I | rook-ceph-mon0: 2017-07-11 14:30:03.550528 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/404743452' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:30:05.330589 I | rook-ceph-mon0: 2017-07-11 14:30:05.330488 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:30:05.833792 I | rook-ceph-mon0: 2017-07-11 14:30:05.330496 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1054 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:30:07.511656 I | rook-ceph-mon0: 2017-07-11 14:30:07.511616 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:07.511892 I | rook-ceph-mon0: 2017-07-11 14:30:07.511768 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/83564455' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:08.478322 I | rook-ceph-mon0: 2017-07-11 14:30:08.478282 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:30:08.478535 I | rook-ceph-mon0: 2017-07-11 14:30:08.478434 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2238580564' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:30:08.975300 I | rook-ceph-mon0: 2017-07-11 14:30:08.975260 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:08.975559 I | rook-ceph-mon0: 2017-07-11 14:30:08.975541 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4186405449' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:10.001060 I | rook-ceph-mon0: 2017-07-11 14:30:10.001021 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:30:10.001285 I | rook-ceph-mon0: 2017-07-11 14:30:10.001246 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/747948170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:30:12.419736 I | rook-ceph-mon0: 2017-07-11 14:30:12.419698 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:12.419932 I | rook-ceph-mon0: 2017-07-11 14:30:12.419847 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/566562845' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:13.422460 I | rook-ceph-mon0: 2017-07-11 14:30:13.422421 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:30:13.422524 I | rook-ceph-mon0: 2017-07-11 14:30:13.422508 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3848522635' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:30:14.450902 I | rook-ceph-mon0: 2017-07-11 14:30:14.450864 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:30:14.451164 I | rook-ceph-mon0: 2017-07-11 14:30:14.451124 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/443938864' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:30:16.050561 I | rook-ceph-mon0: 2017-07-11 14:30:16.050521 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:16.050773 I | rook-ceph-mon0: 2017-07-11 14:30:16.050672 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2710064571' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:17.358787 I | rook-ceph-mon0: 2017-07-11 14:30:17.358749 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:17.358981 I | rook-ceph-mon0: 2017-07-11 14:30:17.358896 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2222434602' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:17.796019 I | rook-ceph-mon0: 2017-07-11 14:30:17.795980 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:17.796090 I | rook-ceph-mon0: 2017-07-11 14:30:17.796075 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1731533932' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:18.685872 I | rook-ceph-mon0: 2017-07-11 14:30:18.685834 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:18.686064 I | rook-ceph-mon0: 2017-07-11 14:30:18.685980 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/926682029' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:20.819215 I | rook-ceph-mon0: 2017-07-11 14:30:20.819173 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:20.819283 I | rook-ceph-mon0: 2017-07-11 14:30:20.819266 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4092791511' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:22.847275 I | rook-ceph-mon0: 2017-07-11 14:30:22.847207 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:22.847604 I | rook-ceph-mon0: 2017-07-11 14:30:22.847575 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2138499121' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:23.297119 I | rook-ceph-mon0: 2017-07-11 14:30:23.297079 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:30:23.297335 I | rook-ceph-mon0: 2017-07-11 14:30:23.297228 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4120510644' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:30:23.745885 I | rook-ceph-mon0: 2017-07-11 14:30:23.745843 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:23.745949 I | rook-ceph-mon0: 2017-07-11 14:30:23.745935 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/790389047' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:25.582897 I | rook-ceph-mon0: 2017-07-11 14:30:25.582852 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:30:25.583135 I | rook-ceph-mon0: 2017-07-11 14:30:25.583107 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/34091834' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:30:27.666916 I | rook-ceph-mon0: 2017-07-11 14:30:27.666878 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:27.667112 I | rook-ceph-mon0: 2017-07-11 14:30:27.667026 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2847862690' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:28.581048 I | rook-ceph-mon0: 2017-07-11 14:30:28.581010 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:28.581273 I | rook-ceph-mon0: 2017-07-11 14:30:28.581155 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/871039171' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:28.627925 I | rook-ceph-mon0: 2017-07-11 14:30:28.627888 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:30:28.628138 I | rook-ceph-mon0: 2017-07-11 14:30:28.628035 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/405392237' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:30:29.523952 I | rook-ceph-mon0: 2017-07-11 14:30:29.523913 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:30:29.524169 I | rook-ceph-mon0: 2017-07-11 14:30:29.524132 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4202807062' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:30:30.424837 I | rook-ceph-mon0: 2017-07-11 14:30:30.424797 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:30.425051 I | rook-ceph-mon0: 2017-07-11 14:30:30.424943 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2690104302' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:31.306197 I | rook-ceph-mon0: 2017-07-11 14:30:31.306082 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #74. Immutable memtables: 0.
- 2017-07-11 14:30:31.306291 I | rook-ceph-mon0:
- 2017-07-11 14:30:31.306330 I | rook-ceph-mon0: 2017-07-11 14:30:31.306141 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 46] Syncing log #71
- 2017-07-11 14:30:31.324851 I | rook-ceph-mon0: 2017-07-11 14:30:31.321537 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.306136) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:30:31.324927 I | rook-ceph-mon0: 2017-07-11 14:30:31.321550 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 46] Flushing memtable with next log file: 74
- 2017-07-11 14:30:31.324944 I | rook-ceph-mon0:
- 2017-07-11 14:30:31.324958 I | rook-ceph-mon0: 2017-07-11 14:30:31.321562 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783431321557, "job": 46, "event": "flush_started", "num_memtables": 1, "num_entries": 2060, "num_deletes": 251, "memory_usage": 5115560}
- 2017-07-11 14:30:31.324971 I | rook-ceph-mon0: 2017-07-11 14:30:31.321564 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 46] Level-0 flush table #75: started
- 2017-07-11 14:30:31.417618 I | rook-ceph-mon0: 2017-07-11 14:30:31.417572 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783431417561, "cf_name": "default", "job": 46, "event": "table_file_creation", "file_number": 75, "file_size": 5060213, "table_properties": {"data_size": 5042677, "index_size": 16716, "filter_size": 0, "raw_key_size": 17109, "raw_average_key_size": 18, "raw_value_size": 5018483, "raw_average_value_size": 5508, "num_data_blocks": 523, "num_entries": 911, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:30:31.417727 I | rook-ceph-mon0: 2017-07-11 14:30:31.417708 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 46] Level-0 flush table #75: 5060213 bytes OK
- 2017-07-11 14:30:31.447792 I | rook-ceph-mon0: 2017-07-11 14:30:31.447754 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.432278) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #75 started
- 2017-07-11 14:30:31.447876 I | rook-ceph-mon0: 2017-07-11 14:30:31.447860 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.447708) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #75: memtable #1 done
- 2017-07-11 14:30:31.447911 I | rook-ceph-mon0: 2017-07-11 14:30:31.447896 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.447726) EVENT_LOG_v1 {"time_micros": 1499783431447720, "job": 46, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:30:31.447975 I | rook-ceph-mon0: 2017-07-11 14:30:31.447961 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.447742) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:30:31.447990 I | rook-ceph-mon0:
- 2017-07-11 14:30:31.448047 I | rook-ceph-mon0: 2017-07-11 14:30:31.448023 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 46] Try to delete WAL files size 5070271, prev total WAL file size 5070271, number of live WAL files 2.
- 2017-07-11 14:30:31.448061 I | rook-ceph-mon0:
- 2017-07-11 14:30:31.457397 I | rook-ceph-mon0: 2017-07-11 14:30:31.448960 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:30:31.457478 I | rook-ceph-mon0: 2017-07-11 14:30:31.449002 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.448996) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:30:31.457498 I | rook-ceph-mon0:
- 2017-07-11 14:30:31.457511 I | rook-ceph-mon0: 2017-07-11 14:30:31.449007 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 47] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:30:31.457539 I | rook-ceph-mon0: 2017-07-11 14:30:31.449012 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 46 Base level 0, inputs: [75(4941KB)], [73(12MB)]
- 2017-07-11 14:30:31.457552 I | rook-ceph-mon0:
- 2017-07-11 14:30:31.457564 I | rook-ceph-mon0: 2017-07-11 14:30:31.449022 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783431449015, "job": 47, "event": "compaction_started", "files_L0": [75], "files_L1": [73], "score": -1, "input_data_size": 18451206}
- 2017-07-11 14:30:31.936763 I | rook-ceph-mon0: 2017-07-11 14:30:31.936711 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 47] Generated table #76: 2384 keys, 16004275 bytes
- 2017-07-11 14:30:31.936883 I | rook-ceph-mon0: 2017-07-11 14:30:31.936866 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783431936856, "cf_name": "default", "job": 47, "event": "table_file_creation", "file_number": 76, "file_size": 16004275, "table_properties": {"data_size": 15950806, "index_size": 52650, "filter_size": 0, "raw_key_size": 45118, "raw_average_key_size": 18, "raw_value_size": 15880797, "raw_average_value_size": 6661, "num_data_blocks": 1618, "num_entries": 2384, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:30:31.968851 I | rook-ceph-mon0: 2017-07-11 14:30:31.968802 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 47] Compacted 1@0 + 1@1 files to L1 => 16004275 bytes
- 2017-07-11 14:30:31.986409 I | rook-ceph-mon0: 2017-07-11 14:30:31.986366 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.986281) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 35.5 rd, 30.8 wr, level 1, files in(1, 1) out(1) MB in(4.8, 12.8) out(15.3), read-write-amplify(6.8) write-amplify(3.2) OK, records in: 2893, records dropped: 509
- 2017-07-11 14:30:31.986478 I | rook-ceph-mon0:
- 2017-07-11 14:30:31.986515 I | rook-ceph-mon0: 2017-07-11 14:30:31.986498 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.986307) EVENT_LOG_v1 {"time_micros": 1499783431986297, "job": 47, "event": "compaction_finished", "compaction_time_micros": 519757, "output_level": 1, "num_output_files": 1, "total_output_size": 16004275, "num_input_records": 2893, "num_output_records": 2384, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:30:31.987468 I | rook-ceph-mon0: 2017-07-11 14:30:31.987452 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783431987449, "job": 47, "event": "table_file_deletion", "file_number": 75}
- 2017-07-11 14:30:31.989207 I | rook-ceph-mon0: 2017-07-11 14:30:31.989188 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783431989185, "job": 47, "event": "table_file_deletion", "file_number": 73}
- 2017-07-11 14:30:33.722513 I | rook-ceph-mon0: 2017-07-11 14:30:33.722238 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:33.722596 I | rook-ceph-mon0: 2017-07-11 14:30:33.722260 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2544444886' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:37.060899 I | rook-ceph-mon0: 2017-07-11 14:30:37.060861 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:37.061112 I | rook-ceph-mon0: 2017-07-11 14:30:37.061011 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2502827755' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:37.995509 I | rook-ceph-mon0: 2017-07-11 14:30:37.995468 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:30:37.995578 I | rook-ceph-mon0: 2017-07-11 14:30:37.995562 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1567795863' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:30:42.012123 I | rook-ceph-mon0: 2017-07-11 14:30:42.012086 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:42.012349 I | rook-ceph-mon0: 2017-07-11 14:30:42.012234 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/267995003' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:42.523777 I | rook-ceph-mon0: 2017-07-11 14:30:42.523740 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:42.524017 I | rook-ceph-mon0: 2017-07-11 14:30:42.523977 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/719237878' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:42.966080 I | rook-ceph-mon0: 2017-07-11 14:30:42.966031 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:30:42.966274 I | rook-ceph-mon0: 2017-07-11 14:30:42.966186 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/943147284' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:30:45.368385 I | rook-ceph-mon0: 2017-07-11 14:30:45.368343 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:45.368598 I | rook-ceph-mon0: 2017-07-11 14:30:45.368497 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1479653221' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:45.581301 I | rook-ceph-mon0: 2017-07-11 14:30:45.581137 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94362 MB
- 2017-07-11 14:30:46.917413 I | rook-ceph-mon0: 2017-07-11 14:30:46.917367 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:46.917811 I | rook-ceph-mon0: 2017-07-11 14:30:46.917793 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1615277156' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:47.340564 I | rook-ceph-mon0: 2017-07-11 14:30:47.340526 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:47.340687 I | rook-ceph-mon0: 2017-07-11 14:30:47.340672 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2887036730' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:47.807396 I | rook-ceph-mon0: 2017-07-11 14:30:47.807358 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:30:47.807610 I | rook-ceph-mon0: 2017-07-11 14:30:47.807501 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/243739720' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:30:47.901206 I | rook-ceph-mon0: 2017-07-11 14:30:47.901162 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:30:47.901274 I | rook-ceph-mon0: 2017-07-11 14:30:47.901259 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4194659980' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:30:50.719710 I | rook-ceph-mon0: 2017-07-11 14:30:50.719668 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:30:50.719818 I | rook-ceph-mon0: 2017-07-11 14:30:50.719803 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1403441868' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:30:51.848846 I | rook-ceph-mon0: 2017-07-11 14:30:51.848760 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:51.849037 I | rook-ceph-mon0: 2017-07-11 14:30:51.848954 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1649916005' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:52.321417 I | rook-ceph-mon0: 2017-07-11 14:30:52.321379 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:52.321485 I | rook-ceph-mon0: 2017-07-11 14:30:52.321470 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2452467769' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:00.328002 I | rook-ceph-mon0: 2017-07-11 14:31:00.327964 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:00.328195 I | rook-ceph-mon0: 2017-07-11 14:31:00.328111 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1125550295' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:03.087711 I | rook-ceph-mon0: 2017-07-11 14:31:03.087674 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:31:03.087916 I | rook-ceph-mon0: 2017-07-11 14:31:03.087817 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2596235272' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:31:03.591852 I | rook-ceph-mon0: 2017-07-11 14:31:03.591800 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:03.601557 I | rook-ceph-mon0: 2017-07-11 14:31:03.601525 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/965982068' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:04.610965 I | rook-ceph-mon0: 2017-07-11 14:31:04.610927 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:31:04.611203 I | rook-ceph-mon0: 2017-07-11 14:31:04.611151 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/852481458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:31:05.482107 I | rook-ceph-mon0: 2017-07-11 14:31:05.482067 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:05.482321 I | rook-ceph-mon0: 2017-07-11 14:31:05.482214 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/740139143' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:10.225819 I | rook-ceph-mon0: 2017-07-11 14:31:10.225768 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:10.226088 I | rook-ceph-mon0: 2017-07-11 14:31:10.226070 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3839825499' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:13.361890 I | rook-ceph-mon0: 2017-07-11 14:31:13.361834 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:31:13.362217 I | rook-ceph-mon0: 2017-07-11 14:31:13.362102 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/935761073' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:31:16.944557 I | rook-ceph-mon0: 2017-07-11 14:31:16.944518 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:16.944756 I | rook-ceph-mon0: 2017-07-11 14:31:16.944669 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1895711529' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:17.793034 I | rook-ceph-mon0: 2017-07-11 14:31:17.792996 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:17.793225 I | rook-ceph-mon0: 2017-07-11 14:31:17.793142 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3534406785' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:21.372536 I | rook-ceph-mon0: 2017-07-11 14:31:21.372498 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:21.372764 I | rook-ceph-mon0: 2017-07-11 14:31:21.372648 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2421102200' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:21.807739 I | rook-ceph-mon0: 2017-07-11 14:31:21.807701 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:21.807969 I | rook-ceph-mon0: 2017-07-11 14:31:21.807925 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3866600523' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:22.695626 I | rook-ceph-mon0: 2017-07-11 14:31:22.695586 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:22.695819 I | rook-ceph-mon0: 2017-07-11 14:31:22.695734 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2613163467' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:24.452601 I | rook-ceph-mon0: 2017-07-11 14:31:24.452562 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:31:24.452812 I | rook-ceph-mon0: 2017-07-11 14:31:24.452709 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3711207698' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:31:24.478315 I | rook-ceph-mon0: 2017-07-11 14:31:24.478280 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:24.478432 I | rook-ceph-mon0: 2017-07-11 14:31:24.478415 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1993206618' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:26.722386 I | rook-ceph-mon0: 2017-07-11 14:31:26.722346 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:26.722597 I | rook-ceph-mon0: 2017-07-11 14:31:26.722505 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1781301098' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:27.149250 I | rook-ceph-mon0: 2017-07-11 14:31:27.149211 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:31:27.149567 I | rook-ceph-mon0: 2017-07-11 14:31:27.149354 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3951964216' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:31:28.405506 I | rook-ceph-mon0: 2017-07-11 14:31:28.405467 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:31:28.405751 I | rook-ceph-mon0: 2017-07-11 14:31:28.405721 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2942589192' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:31:29.262031 I | rook-ceph-mon0: 2017-07-11 14:31:29.261992 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:29.262247 I | rook-ceph-mon0: 2017-07-11 14:31:29.262212 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/435660229' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:32.169220 I | rook-ceph-mon0: 2017-07-11 14:31:32.169181 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:31:32.169432 I | rook-ceph-mon0: 2017-07-11 14:31:32.169329 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4252181452' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:31:32.481124 I | rook-ceph-mon0: 2017-07-11 14:31:32.481085 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:31:32.481312 I | rook-ceph-mon0: 2017-07-11 14:31:32.481294 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3599892559' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:31:32.567062 I | rook-ceph-mon0: 2017-07-11 14:31:32.567011 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:32.567392 I | rook-ceph-mon0: 2017-07-11 14:31:32.567370 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/180726250' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:35.446376 I | rook-ceph-mon0: 2017-07-11 14:31:35.446340 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:31:35.446588 I | rook-ceph-mon0: 2017-07-11 14:31:35.446554 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/580202670' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:31:36.647564 I | rook-ceph-mon0: 2017-07-11 14:31:36.647529 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:36.647758 I | rook-ceph-mon0: 2017-07-11 14:31:36.647668 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/945921017' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:37.611420 I | rook-ceph-mon0: 2017-07-11 14:31:37.611383 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:37.611617 I | rook-ceph-mon0: 2017-07-11 14:31:37.611531 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/946118547' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:39.435183 I | rook-ceph-mon0: 2017-07-11 14:31:39.435143 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:39.435399 I | rook-ceph-mon0: 2017-07-11 14:31:39.435295 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2470469546' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:43.445276 I | rook-ceph-mon0: 2017-07-11 14:31:43.445237 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:31:43.445523 I | rook-ceph-mon0: 2017-07-11 14:31:43.445467 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1711701232' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:31:44.278944 I | rook-ceph-mon0: 2017-07-11 14:31:44.278907 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:44.279012 I | rook-ceph-mon0: 2017-07-11 14:31:44.278997 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/486525401' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:45.581524 I | rook-ceph-mon0: 2017-07-11 14:31:45.581366 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94362 MB
- 2017-07-11 14:31:46.457277 I | rook-ceph-mon0: 2017-07-11 14:31:46.457240 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:31:46.457470 I | rook-ceph-mon0: 2017-07-11 14:31:46.457386 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2559880241' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:31:48.171371 I | rook-ceph-mon0: 2017-07-11 14:31:48.171332 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:31:48.171598 I | rook-ceph-mon0: 2017-07-11 14:31:48.171568 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3627845597' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:31:51.335152 I | rook-ceph-mon0: 2017-07-11 14:31:51.335114 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:51.335218 I | rook-ceph-mon0: 2017-07-11 14:31:51.335203 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/196995991' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:53.344972 I | rook-ceph-mon0: 2017-07-11 14:31:53.344873 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #77. Immutable memtables: 0.
- 2017-07-11 14:31:53.345066 I | rook-ceph-mon0:
- 2017-07-11 14:31:53.345104 I | rook-ceph-mon0: 2017-07-11 14:31:53.344911 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 48] Syncing log #74
- 2017-07-11 14:31:53.408196 I | rook-ceph-mon0: 2017-07-11 14:31:53.406895 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.344906) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:31:53.408280 I | rook-ceph-mon0: 2017-07-11 14:31:53.406906 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 48] Flushing memtable with next log file: 77
- 2017-07-11 14:31:53.408297 I | rook-ceph-mon0:
- 2017-07-11 14:31:53.408311 I | rook-ceph-mon0: 2017-07-11 14:31:53.406916 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513406912, "job": 48, "event": "flush_started", "num_memtables": 1, "num_entries": 982, "num_deletes": 251, "memory_usage": 2059720}
- 2017-07-11 14:31:53.408323 I | rook-ceph-mon0: 2017-07-11 14:31:53.406918 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 48] Level-0 flush table #78: started
- 2017-07-11 14:31:53.490081 I | rook-ceph-mon0: 2017-07-11 14:31:53.490033 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513490023, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 78, "file_size": 1804705, "table_properties": {"data_size": 1798374, "index_size": 5516, "filter_size": 0, "raw_key_size": 9503, "raw_average_key_size": 19, "raw_value_size": 1787833, "raw_average_value_size": 3678, "num_data_blocks": 177, "num_entries": 486, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:31:53.490190 I | rook-ceph-mon0: 2017-07-11 14:31:53.490172 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 48] Level-0 flush table #78: 1804705 bytes OK
- 2017-07-11 14:31:53.533978 I | rook-ceph-mon0: 2017-07-11 14:31:53.533922 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.517156) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #78 started
- 2017-07-11 14:31:53.534313 I | rook-ceph-mon0: 2017-07-11 14:31:53.534277 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.533871) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #78: memtable #1 done
- 2017-07-11 14:31:53.534402 I | rook-ceph-mon0: 2017-07-11 14:31:53.534347 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.533894) EVENT_LOG_v1 {"time_micros": 1499783513533888, "job": 48, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:31:53.534441 I | rook-ceph-mon0: 2017-07-11 14:31:53.534425 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.533910) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:31:53.534474 I | rook-ceph-mon0:
- 2017-07-11 14:31:53.534508 I | rook-ceph-mon0: 2017-07-11 14:31:53.534495 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 48] Try to delete WAL files size 2038908, prev total WAL file size 2038908, number of live WAL files 2.
- 2017-07-11 14:31:53.534546 I | rook-ceph-mon0:
- 2017-07-11 14:31:53.543257 I | rook-ceph-mon0: 2017-07-11 14:31:53.535110 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:31:53.543310 I | rook-ceph-mon0: 2017-07-11 14:31:53.535163 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.535158) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:31:53.543327 I | rook-ceph-mon0:
- 2017-07-11 14:31:53.543340 I | rook-ceph-mon0: 2017-07-11 14:31:53.535169 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 49] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:31:53.543369 I | rook-ceph-mon0: 2017-07-11 14:31:53.535186 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 48 Base level 0, inputs: [78(1762KB)], [76(15MB)]
- 2017-07-11 14:31:53.543385 I | rook-ceph-mon0:
- 2017-07-11 14:31:53.543397 I | rook-ceph-mon0: 2017-07-11 14:31:53.535197 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513535188, "job": 49, "event": "compaction_started", "files_L0": [78], "files_L1": [76], "score": -1, "input_data_size": 17808980}
- 2017-07-11 14:31:53.674806 I | rook-ceph-mon0: 2017-07-11 14:31:53.674756 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 49] Generated table #79: 2396 keys, 16383559 bytes
- 2017-07-11 14:31:53.674991 I | rook-ceph-mon0: 2017-07-11 14:31:53.674908 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513674898, "cf_name": "default", "job": 49, "event": "table_file_creation", "file_number": 79, "file_size": 16383559, "table_properties": {"data_size": 16331518, "index_size": 51222, "filter_size": 0, "raw_key_size": 45094, "raw_average_key_size": 18, "raw_value_size": 16262414, "raw_average_value_size": 6787, "num_data_blocks": 1578, "num_entries": 2396, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:31:53.833268 I | rook-ceph-mon0: 2017-07-11 14:31:53.833221 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 49] Compacted 1@0 + 1@1 files to L1 => 16383559 bytes
- 2017-07-11 14:31:53.865235 I | rook-ceph-mon0: 2017-07-11 14:31:53.865194 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.865119) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 59.8 rd, 55.0 wr, level 1, files in(1, 1) out(1) MB in(1.7, 15.3) out(15.6), read-write-amplify(18.9) write-amplify(9.1) OK, records in: 2870, records dropped: 474
- 2017-07-11 14:31:53.865316 I | rook-ceph-mon0:
- 2017-07-11 14:31:53.865363 I | rook-ceph-mon0: 2017-07-11 14:31:53.865346 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.865138) EVENT_LOG_v1 {"time_micros": 1499783513865130, "job": 49, "event": "compaction_finished", "compaction_time_micros": 298003, "output_level": 1, "num_output_files": 1, "total_output_size": 16383559, "num_input_records": 2870, "num_output_records": 2396, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:31:53.865914 I | rook-ceph-mon0: 2017-07-11 14:31:53.865898 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513865895, "job": 49, "event": "table_file_deletion", "file_number": 78}
- 2017-07-11 14:31:53.867917 I | rook-ceph-mon0: 2017-07-11 14:31:53.867901 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513867899, "job": 49, "event": "table_file_deletion", "file_number": 76}
- 2017-07-11 14:31:53.868336 I | rook-ceph-mon0: 2017-07-11 14:31:53.868202 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #80. Immutable memtables: 0.
- 2017-07-11 14:31:53.868376 I | rook-ceph-mon0:
- 2017-07-11 14:31:53.868392 I | rook-ceph-mon0: 2017-07-11 14:31:53.868271 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 50] Syncing log #77
- 2017-07-11 14:31:53.896399 I | rook-ceph-mon0: 2017-07-11 14:31:53.895607 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.868266) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:31:53.896463 I | rook-ceph-mon0: 2017-07-11 14:31:53.895620 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 50] Flushing memtable with next log file: 80
- 2017-07-11 14:31:53.896480 I | rook-ceph-mon0:
- 2017-07-11 14:31:53.896492 I | rook-ceph-mon0: 2017-07-11 14:31:53.895631 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513895626, "job": 50, "event": "flush_started", "num_memtables": 1, "num_entries": 3, "num_deletes": 0, "memory_usage": 15424}
- 2017-07-11 14:31:53.896504 I | rook-ceph-mon0: 2017-07-11 14:31:53.895633 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 50] Level-0 flush table #81: started
- 2017-07-11 14:31:53.911602 I | rook-ceph-mon0: 2017-07-11 14:31:53.911531 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513911521, "cf_name": "default", "job": 50, "event": "table_file_creation", "file_number": 81, "file_size": 14135, "table_properties": {"data_size": 13275, "index_size": 53, "filter_size": 0, "raw_key_size": 65, "raw_average_key_size": 21, "raw_value_size": 13188, "raw_average_value_size": 4396, "num_data_blocks": 2, "num_entries": 3, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:31:53.911675 I | rook-ceph-mon0: 2017-07-11 14:31:53.911544 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 50] Level-0 flush table #81: 14135 bytes OK
- 2017-07-11 14:31:53.943119 I | rook-ceph-mon0: 2017-07-11 14:31:53.943079 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.927689) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #81 started
- 2017-07-11 14:31:53.943213 I | rook-ceph-mon0: 2017-07-11 14:31:53.943197 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.943026) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #81: memtable #1 done
- 2017-07-11 14:31:53.943245 I | rook-ceph-mon0: 2017-07-11 14:31:53.943233 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.943045) EVENT_LOG_v1 {"time_micros": 1499783513943039, "job": 50, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:31:53.943296 I | rook-ceph-mon0: 2017-07-11 14:31:53.943283 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.943060) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:31:53.943312 I | rook-ceph-mon0:
- 2017-07-11 14:31:53.943359 I | rook-ceph-mon0: 2017-07-11 14:31:53.943346 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 50] Try to delete WAL files size 13251, prev total WAL file size 13251, number of live WAL files 2.
- 2017-07-11 14:31:53.943374 I | rook-ceph-mon0:
- 2017-07-11 14:31:53.943617 I | rook-ceph-mon0: 2017-07-11 14:31:53.943597 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:31:55.975358 I | rook-ceph-mon0: 2017-07-11 14:31:55.975317 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:55.975569 I | rook-ceph-mon0: 2017-07-11 14:31:55.975467 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/18692171' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:56.409879 I | rook-ceph-mon0: 2017-07-11 14:31:56.409843 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:56.410135 I | rook-ceph-mon0: 2017-07-11 14:31:56.410119 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4076217624' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:56.803125 I | rook-ceph-mon0: 2017-07-11 14:31:56.803086 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:31:56.803366 I | rook-ceph-mon0: 2017-07-11 14:31:56.803312 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1560268843' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:31:57.566656 I | rook-ceph-mon0: 2017-07-11 14:31:57.566618 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:31:57.566898 I | rook-ceph-mon0: 2017-07-11 14:31:57.566767 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1792806831' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:31:58.584813 I | rook-ceph-mon0: 2017-07-11 14:31:58.584775 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:31:58.585043 I | rook-ceph-mon0: 2017-07-11 14:31:58.585024 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/976658686' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:31:59.628243 I | rook-ceph-mon0: 2017-07-11 14:31:59.628203 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:59.628526 I | rook-ceph-mon0: 2017-07-11 14:31:59.628352 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1406470407' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:01.212617 I | rook-ceph-mon0: 2017-07-11 14:32:01.212581 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:01.213337 I | rook-ceph-mon0: 2017-07-11 14:32:01.213254 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1156988029' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:03.030392 I | rook-ceph-mon0: 2017-07-11 14:32:03.030354 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:32:03.030616 I | rook-ceph-mon0: 2017-07-11 14:32:03.030584 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1608209754' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:32:06.368533 I | rook-ceph-mon0: 2017-07-11 14:32:06.368493 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:06.368773 I | rook-ceph-mon0: 2017-07-11 14:32:06.368756 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2175117118' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:07.200819 I | rook-ceph-mon0: 2017-07-11 14:32:07.200786 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:07.201007 I | rook-ceph-mon0: 2017-07-11 14:32:07.200923 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1525752742' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:08.596606 I | rook-ceph-mon0: 2017-07-11 14:32:08.596567 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:32:08.596818 I | rook-ceph-mon0: 2017-07-11 14:32:08.596718 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3130671229' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:32:11.111911 I | rook-ceph-mon0: 2017-07-11 14:32:11.111873 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:11.112087 I | rook-ceph-mon0: 2017-07-11 14:32:11.112008 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3741608186' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:11.935959 I | rook-ceph-mon0: 2017-07-11 14:32:11.935920 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:11.936157 I | rook-ceph-mon0: 2017-07-11 14:32:11.936069 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3738119097' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:15.650835 I | rook-ceph-mon0: 2017-07-11 14:32:15.650797 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:15.651045 I | rook-ceph-mon0: 2017-07-11 14:32:15.650946 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4281364743' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:16.071774 I | rook-ceph-mon0: 2017-07-11 14:32:16.071729 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:16.071892 I | rook-ceph-mon0: 2017-07-11 14:32:16.071876 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2546906151' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:17.037940 I | rook-ceph-mon0: 2017-07-11 14:32:17.037901 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:32:17.038158 I | rook-ceph-mon0: 2017-07-11 14:32:17.038127 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1172724681' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:32:17.911265 I | rook-ceph-mon0: 2017-07-11 14:32:17.911227 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:32:17.911540 I | rook-ceph-mon0: 2017-07-11 14:32:17.911524 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3867719078' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:32:20.510004 I | rook-ceph-mon0: 2017-07-11 14:32:20.509579 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:20.510184 I | rook-ceph-mon0: 2017-07-11 14:32:20.510103 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1692726456' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:25.914217 I | rook-ceph-mon0: 2017-07-11 14:32:25.914169 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:25.914438 I | rook-ceph-mon0: 2017-07-11 14:32:25.914325 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/237442804' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:26.788373 I | rook-ceph-mon0: 2017-07-11 14:32:26.788336 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:26.788602 I | rook-ceph-mon0: 2017-07-11 14:32:26.788480 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1498635798' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:30.637735 I | rook-ceph-mon0: 2017-07-11 14:32:30.637697 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:32:30.637956 I | rook-ceph-mon0: 2017-07-11 14:32:30.637857 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2364601830' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:32:31.658179 I | rook-ceph-mon0: 2017-07-11 14:32:31.657830 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:31.658274 I | rook-ceph-mon0: 2017-07-11 14:32:31.657852 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/343272857' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:32.563278 I | rook-ceph-mon0: 2017-07-11 14:32:32.563241 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:32:32.563348 I | rook-ceph-mon0: 2017-07-11 14:32:32.563333 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1612649209' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:32:33.395973 I | rook-ceph-mon0: 2017-07-11 14:32:33.395891 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #82. Immutable memtables: 0.
- 2017-07-11 14:32:33.396054 I | rook-ceph-mon0:
- 2017-07-11 14:32:33.396071 I | rook-ceph-mon0: 2017-07-11 14:32:33.395915 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 51] Syncing log #80
- 2017-07-11 14:32:33.403510 I | rook-ceph-mon0: 2017-07-11 14:32:33.403477 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:33.403592 I | rook-ceph-mon0: 2017-07-11 14:32:33.403575 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3846868641' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:33.429214 I | rook-ceph-mon0: 2017-07-11 14:32:33.427311 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.395910) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:32:33.429274 I | rook-ceph-mon0: 2017-07-11 14:32:33.427321 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 51] Flushing memtable with next log file: 82
- 2017-07-11 14:32:33.429289 I | rook-ceph-mon0:
- 2017-07-11 14:32:33.429301 I | rook-ceph-mon0: 2017-07-11 14:32:33.427332 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553427328, "job": 51, "event": "flush_started", "num_memtables": 1, "num_entries": 860, "num_deletes": 506, "memory_usage": 1012992}
- 2017-07-11 14:32:33.429311 I | rook-ceph-mon0: 2017-07-11 14:32:33.427334 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 51] Level-0 flush table #83: started
- 2017-07-11 14:32:33.506537 I | rook-ceph-mon0: 2017-07-11 14:32:33.506494 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553506486, "cf_name": "default", "job": 51, "event": "table_file_creation", "file_number": 83, "file_size": 992135, "table_properties": {"data_size": 988078, "index_size": 3243, "filter_size": 0, "raw_key_size": 11958, "raw_average_key_size": 18, "raw_value_size": 977285, "raw_average_value_size": 1527, "num_data_blocks": 104, "num_entries": 640, "filter_policy_name": "", "kDeletedKeys": "506", "kMergeOperands": "0"}}
- 2017-07-11 14:32:33.506634 I | rook-ceph-mon0: 2017-07-11 14:32:33.506616 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 51] Level-0 flush table #83: 992135 bytes OK
- 2017-07-11 14:32:33.536727 I | rook-ceph-mon0: 2017-07-11 14:32:33.536693 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.521428) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #83 started
- 2017-07-11 14:32:33.536797 I | rook-ceph-mon0: 2017-07-11 14:32:33.536781 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.536652) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #83: memtable #1 done
- 2017-07-11 14:32:33.536829 I | rook-ceph-mon0: 2017-07-11 14:32:33.536817 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.536665) EVENT_LOG_v1 {"time_micros": 1499783553536661, "job": 51, "event": "flush_finished", "lsm_state": [2, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:32:33.536874 I | rook-ceph-mon0: 2017-07-11 14:32:33.536861 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.536680) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[2 1 0 0 0 0 0] max score 0.50
- 2017-07-11 14:32:33.536891 I | rook-ceph-mon0:
- 2017-07-11 14:32:33.536939 I | rook-ceph-mon0: 2017-07-11 14:32:33.536908 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 51] Try to delete WAL files size 993139, prev total WAL file size 993139, number of live WAL files 2.
- 2017-07-11 14:32:33.536955 I | rook-ceph-mon0:
- 2017-07-11 14:32:33.538154 I | rook-ceph-mon0: 2017-07-11 14:32:33.537336 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:32:33.538201 I | rook-ceph-mon0: 2017-07-11 14:32:33.537368 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.537363) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:32:33.538217 I | rook-ceph-mon0:
- 2017-07-11 14:32:33.538229 I | rook-ceph-mon0: 2017-07-11 14:32:33.537373 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 52] Compacting 2@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:32:33.538240 I | rook-ceph-mon0: 2017-07-11 14:32:33.537377 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 51 Base level 0, inputs: [83(968KB) 81(13KB)], [79(15MB)]
- 2017-07-11 14:32:33.538251 I | rook-ceph-mon0:
- 2017-07-11 14:32:33.538275 I | rook-ceph-mon0: 2017-07-11 14:32:33.537387 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553537380, "job": 52, "event": "compaction_started", "files_L0": [83, 81], "files_L1": [79], "score": -1, "input_data_size": 17389829}
- 2017-07-11 14:32:33.686004 I | rook-ceph-mon0: 2017-07-11 14:32:33.685505 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 52] Generated table #84: 2018 keys, 14336238 bytes
- 2017-07-11 14:32:33.686345 I | rook-ceph-mon0: 2017-07-11 14:32:33.686113 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553686103, "cf_name": "default", "job": 52, "event": "table_file_creation", "file_number": 84, "file_size": 14336238, "table_properties": {"data_size": 14290286, "index_size": 45133, "filter_size": 0, "raw_key_size": 38164, "raw_average_key_size": 18, "raw_value_size": 14230622, "raw_average_value_size": 7051, "num_data_blocks": 1398, "num_entries": 2018, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:32:33.726416 I | rook-ceph-mon0: 2017-07-11 14:32:33.726376 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 52] Compacted 2@0 + 1@1 files to L1 => 14336238 bytes
- 2017-07-11 14:32:33.742245 I | rook-ceph-mon0: 2017-07-11 14:32:33.742215 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.742134) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 92.0 rd, 75.9 wr, level 1, files in(2, 1) out(1) MB in(1.0, 15.6) out(13.7), read-write-amplify(31.5) write-amplify(14.2) OK, records in: 3039, records dropped: 1021
- 2017-07-11 14:32:33.742301 I | rook-ceph-mon0:
- 2017-07-11 14:32:33.742336 I | rook-ceph-mon0: 2017-07-11 14:32:33.742320 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.742152) EVENT_LOG_v1 {"time_micros": 1499783553742145, "job": 52, "event": "compaction_finished", "compaction_time_micros": 188973, "output_level": 1, "num_output_files": 1, "total_output_size": 14336238, "num_input_records": 3039, "num_output_records": 2018, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:32:33.742685 I | rook-ceph-mon0: 2017-07-11 14:32:33.742670 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553742667, "job": 52, "event": "table_file_deletion", "file_number": 83}
- 2017-07-11 14:32:33.742778 I | rook-ceph-mon0: 2017-07-11 14:32:33.742766 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553742764, "job": 52, "event": "table_file_deletion", "file_number": 81}
- 2017-07-11 14:32:33.748191 I | rook-ceph-mon0: 2017-07-11 14:32:33.748173 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553748170, "job": 52, "event": "table_file_deletion", "file_number": 79}
- 2017-07-11 14:32:33.748279 I | rook-ceph-mon0: 2017-07-11 14:32:33.748263 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:32:35.767015 I | rook-ceph-mon0: 2017-07-11 14:32:35.766956 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:35.767252 I | rook-ceph-mon0: 2017-07-11 14:32:35.767145 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1923325515' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:38.446110 I | rook-ceph-mon0: 2017-07-11 14:32:38.446064 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:38.446195 I | rook-ceph-mon0: 2017-07-11 14:32:38.446164 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/289840093' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:39.126101 I | rook-ceph-mon0: 2017-07-11 14:32:39.126060 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:32:39.126316 I | rook-ceph-mon0: 2017-07-11 14:32:39.126281 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1281955303' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:32:45.581768 I | rook-ceph-mon0: 2017-07-11 14:32:45.581601 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4823 MB, avail 94363 MB
- 2017-07-11 14:32:45.624794 I | rook-ceph-mon0: 2017-07-11 14:32:45.624757 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:45.624983 I | rook-ceph-mon0: 2017-07-11 14:32:45.624900 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1418117020' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:48.268438 I | rook-ceph-mon0: 2017-07-11 14:32:48.268399 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:48.268650 I | rook-ceph-mon0: 2017-07-11 14:32:48.268549 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1974236709' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:50.495019 I | rook-ceph-mon0: 2017-07-11 14:32:50.494981 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:50.495215 I | rook-ceph-mon0: 2017-07-11 14:32:50.495128 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/716805968' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:50.899047 I | rook-ceph-mon0: 2017-07-11 14:32:50.899008 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:32:50.899287 I | rook-ceph-mon0: 2017-07-11 14:32:50.899270 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3341557274' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:32:51.329211 I | rook-ceph-mon0: 2017-07-11 14:32:51.329173 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:51.329426 I | rook-ceph-mon0: 2017-07-11 14:32:51.329337 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/317934403' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:52.169362 I | rook-ceph-mon0: 2017-07-11 14:32:52.169323 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:32:52.169580 I | rook-ceph-mon0: 2017-07-11 14:32:52.169549 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1428563164' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:32:52.916841 I | rook-ceph-mon0: 2017-07-11 14:32:52.916801 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:32:52.917031 I | rook-ceph-mon0: 2017-07-11 14:32:52.916947 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/611863839' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:32:53.110949 I | rook-ceph-mon0: 2017-07-11 14:32:53.110910 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:53.111074 I | rook-ceph-mon0: 2017-07-11 14:32:53.111058 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3385450725' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:54.989021 I | rook-ceph-mon0: 2017-07-11 14:32:54.988974 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:54.989277 I | rook-ceph-mon0: 2017-07-11 14:32:54.989260 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/755319295' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:55.364032 I | rook-ceph-mon0: 2017-07-11 14:32:55.363994 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:55.364264 I | rook-ceph-mon0: 2017-07-11 14:32:55.364161 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/280402262' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:00.740171 I | rook-ceph-mon0: 2017-07-11 14:33:00.740133 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:33:00.740288 I | rook-ceph-mon0: 2017-07-11 14:33:00.740266 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/733489656' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:33:01.176477 I | rook-ceph-mon0: 2017-07-11 14:33:01.176438 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:01.176748 I | rook-ceph-mon0: 2017-07-11 14:33:01.176707 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3443848288' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:03.052203 I | rook-ceph-mon0: 2017-07-11 14:33:03.052165 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:03.052486 I | rook-ceph-mon0: 2017-07-11 14:33:03.052467 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3392420341' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:03.917439 I | rook-ceph-mon0: 2017-07-11 14:33:03.917396 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:33:03.917675 I | rook-ceph-mon0: 2017-07-11 14:33:03.917639 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/193662471' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:33:04.817209 I | rook-ceph-mon0: 2017-07-11 14:33:04.817170 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:04.817458 I | rook-ceph-mon0: 2017-07-11 14:33:04.817319 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3557259110' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:06.356209 I | rook-ceph-mon0: 2017-07-11 14:33:06.356171 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:06.356433 I | rook-ceph-mon0: 2017-07-11 14:33:06.356320 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/116334116' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:10.585618 I | rook-ceph-mon0: 2017-07-11 14:33:10.585582 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:33:10.585830 I | rook-ceph-mon0: 2017-07-11 14:33:10.585799 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2801283608' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:33:10.981635 I | rook-ceph-mon0: 2017-07-11 14:33:10.981597 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:10.981829 I | rook-ceph-mon0: 2017-07-11 14:33:10.981744 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4017187486' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:14.684937 I | rook-ceph-mon0: 2017-07-11 14:33:14.684901 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:14.685003 I | rook-ceph-mon0: 2017-07-11 14:33:14.684988 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3996866407' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:15.111417 I | rook-ceph-mon0: 2017-07-11 14:33:15.111378 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:15.111631 I | rook-ceph-mon0: 2017-07-11 14:33:15.111546 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3735666560' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:19.636422 I | rook-ceph-mon0: 2017-07-11 14:33:19.636383 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:19.636658 I | rook-ceph-mon0: 2017-07-11 14:33:19.636640 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2813499857' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:20.076584 I | rook-ceph-mon0: 2017-07-11 14:33:20.076546 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:20.076824 I | rook-ceph-mon0: 2017-07-11 14:33:20.076807 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3695264741' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:25.983726 I | rook-ceph-mon0: 2017-07-11 14:33:25.983688 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:25.983937 I | rook-ceph-mon0: 2017-07-11 14:33:25.983834 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3333928978' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:26.832583 I | rook-ceph-mon0: 2017-07-11 14:33:26.832539 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:33:26.832819 I | rook-ceph-mon0: 2017-07-11 14:33:26.832779 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2363624722' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:33:27.672364 I | rook-ceph-mon0: 2017-07-11 14:33:27.672326 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:27.672544 I | rook-ceph-mon0: 2017-07-11 14:33:27.672466 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/975592823' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:29.883289 I | rook-ceph-mon0: 2017-07-11 14:33:29.883250 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:29.883503 I | rook-ceph-mon0: 2017-07-11 14:33:29.883425 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3757144025' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:30.303429 I | rook-ceph-mon0: 2017-07-11 14:33:30.303390 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:33:30.303559 I | rook-ceph-mon0: 2017-07-11 14:33:30.303539 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/663908377' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:33:30.664831 I | rook-ceph-mon0: 2017-07-11 14:33:30.664793 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:30.665049 I | rook-ceph-mon0: 2017-07-11 14:33:30.664954 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3829833355' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:32.322414 I | rook-ceph-mon0: 2017-07-11 14:33:32.322375 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:32.322648 I | rook-ceph-mon0: 2017-07-11 14:33:32.322607 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/618424685' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:36.883390 I | rook-ceph-mon0: 2017-07-11 14:33:36.883350 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:33:36.883619 I | rook-ceph-mon0: 2017-07-11 14:33:36.883577 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/649071520' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:33:37.421828 I | rook-ceph-mon0: 2017-07-11 14:33:37.421791 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:33:37.422050 I | rook-ceph-mon0: 2017-07-11 14:33:37.421936 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/595260874' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:33:37.754402 I | rook-ceph-mon0: 2017-07-11 14:33:37.754346 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:37.754649 I | rook-ceph-mon0: 2017-07-11 14:33:37.754630 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1010526133' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:44.240907 I | rook-ceph-mon0: 2017-07-11 14:33:44.240868 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:44.241119 I | rook-ceph-mon0: 2017-07-11 14:33:44.241019 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/998491527' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:45.581973 I | rook-ceph-mon0: 2017-07-11 14:33:45.581835 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4823 MB, avail 94363 MB
- 2017-07-11 14:33:45.643658 I | rook-ceph-mon0: 2017-07-11 14:33:45.643620 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:33:45.643784 I | rook-ceph-mon0: 2017-07-11 14:33:45.643769 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3507268175' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:33:48.498509 I | rook-ceph-mon0: 2017-07-11 14:33:48.498471 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:33:48.498706 I | rook-ceph-mon0: 2017-07-11 14:33:48.498619 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2093516302' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:33:49.180890 I | rook-ceph-mon0: 2017-07-11 14:33:49.180835 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:49.181160 I | rook-ceph-mon0: 2017-07-11 14:33:49.181069 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/150267132' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:49.626166 I | rook-ceph-mon0: 2017-07-11 14:33:49.626125 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:49.626379 I | rook-ceph-mon0: 2017-07-11 14:33:49.626349 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1604593651' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:50.043887 I | rook-ceph-mon0: 2017-07-11 14:33:50.043848 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:33:50.044126 I | rook-ceph-mon0: 2017-07-11 14:33:50.044109 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1573293606' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:33:50.419918 I | rook-ceph-mon0: 2017-07-11 14:33:50.419590 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:50.420026 I | rook-ceph-mon0: 2017-07-11 14:33:50.419607 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/289187997' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:52.141720 I | rook-ceph-mon0: 2017-07-11 14:33:52.141618 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #85. Immutable memtables: 0.
- 2017-07-11 14:33:52.141817 I | rook-ceph-mon0:
- 2017-07-11 14:33:52.141913 I | rook-ceph-mon0: 2017-07-11 14:33:52.141663 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 53] Syncing log #82
- 2017-07-11 14:33:52.142461 I | rook-ceph-mon0: 2017-07-11 14:33:52.142439 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:52.142760 I | rook-ceph-mon0: 2017-07-11 14:33:52.142724 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3939058717' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:52.173577 I | rook-ceph-mon0: 2017-07-11 14:33:52.171088 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.141657) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:33:52.173656 I | rook-ceph-mon0: 2017-07-11 14:33:52.171101 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 53] Flushing memtable with next log file: 85
- 2017-07-11 14:33:52.173674 I | rook-ceph-mon0:
- 2017-07-11 14:33:52.173686 I | rook-ceph-mon0: 2017-07-11 14:33:52.171115 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632171110, "job": 53, "event": "flush_started", "num_memtables": 1, "num_entries": 962, "num_deletes": 251, "memory_usage": 2006048}
- 2017-07-11 14:33:52.173728 I | rook-ceph-mon0: 2017-07-11 14:33:52.171117 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 53] Level-0 flush table #86: started
- 2017-07-11 14:33:52.215561 I | rook-ceph-mon0: 2017-07-11 14:33:52.215512 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632215500, "cf_name": "default", "job": 53, "event": "table_file_creation", "file_number": 86, "file_size": 1981484, "table_properties": {"data_size": 1974219, "index_size": 6450, "filter_size": 0, "raw_key_size": 9566, "raw_average_key_size": 18, "raw_value_size": 1962639, "raw_average_value_size": 3818, "num_data_blocks": 206, "num_entries": 514, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:33:52.215778 I | rook-ceph-mon0: 2017-07-11 14:33:52.215656 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 53] Level-0 flush table #86: 1981484 bytes OK
- 2017-07-11 14:33:52.275763 I | rook-ceph-mon0: 2017-07-11 14:33:52.275718 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.230514) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #86 started
- 2017-07-11 14:33:52.275878 I | rook-ceph-mon0: 2017-07-11 14:33:52.275851 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.275662) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #86: memtable #1 done
- 2017-07-11 14:33:52.275929 I | rook-ceph-mon0: 2017-07-11 14:33:52.275897 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.275684) EVENT_LOG_v1 {"time_micros": 1499783632275678, "job": 53, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:33:52.275962 I | rook-ceph-mon0: 2017-07-11 14:33:52.275949 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.275700) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:33:52.275977 I | rook-ceph-mon0:
- 2017-07-11 14:33:52.276025 I | rook-ceph-mon0: 2017-07-11 14:33:52.276011 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 53] Try to delete WAL files size 1984808, prev total WAL file size 1984808, number of live WAL files 2.
- 2017-07-11 14:33:52.276039 I | rook-ceph-mon0:
- 2017-07-11 14:33:52.279231 I | rook-ceph-mon0: 2017-07-11 14:33:52.276558 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:33:52.279299 I | rook-ceph-mon0: 2017-07-11 14:33:52.276731 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:33:52.279318 I | rook-ceph-mon0: 2017-07-11 14:33:52.276736 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:33:52.279333 I | rook-ceph-mon0: ** DB Stats **
- 2017-07-11 14:33:52.279364 I | rook-ceph-mon0: Uptime(secs): 4207.1 total, 624.0 interval
- 2017-07-11 14:33:52.279376 I | rook-ceph-mon0: Cumulative writes: 7180 writes, 30K keys, 7180 commit groups, 1.0 writes per commit group, ingest: 0.06 GB, 0.02 MB/s
- 2017-07-11 14:33:52.279387 I | rook-ceph-mon0: Cumulative WAL: 7180 writes, 7180 syncs, 1.00 writes per sync, written: 0.06 GB, 0.02 MB/s
- 2017-07-11 14:33:52.279400 I | rook-ceph-mon0: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:33:52.279411 I | rook-ceph-mon0: Interval writes: 1566 writes, 7892 keys, 1566 commit groups, 1.0 writes per commit group, ingest: 15.06 MB, 0.02 MB/s
- 2017-07-11 14:33:52.279437 I | rook-ceph-mon0: Interval WAL: 1566 writes, 1566 syncs, 1.00 writes per sync, written: 0.01 MB, 0.02 MB/s
- 2017-07-11 14:33:52.279449 I | rook-ceph-mon0: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:33:52.279460 I | rook-ceph-mon0:
- 2017-07-11 14:33:52.279471 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 14:33:52.279482 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:33:52.279505 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:33:52.279526 I | rook-ceph-mon0: L0 1/1 1.89 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 22.7 3 28 0.090 0 0
- 2017-07-11 14:33:52.279538 I | rook-ceph-mon0: L1 1/1 13.67 MB 0.0 0.3 0.1 0.3 0.3 0.0 0.0 5.5 52.8 46.4 7 24 0.274 56K 11K
- 2017-07-11 14:33:52.279550 I | rook-ceph-mon0: Sum 2/2 15.56 MB 0.0 0.3 0.1 0.3 0.4 0.1 0.0 6.3 38.1 39.8 9 52 0.175 56K 11K
- 2017-07-11 14:33:52.279561 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 7.7 41.7 41.6 3 15 0.184 19K 4477
- 2017-07-11 14:33:52.279586 I | rook-ceph-mon0: Uptime(secs): 4207.1 total, 4207.1 interval
- 2017-07-11 14:33:52.279598 I | rook-ceph-mon0: Flush(GB): cumulative 0.056, interval 0.014
- 2017-07-11 14:33:52.279609 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:33:52.279621 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:33:52.279631 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:33:52.279642 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:33:52.279665 I | rook-ceph-mon0: Cumulative compaction: 0.35 GB write, 0.09 MB/s write, 0.34 GB read, 0.08 MB/s read, 9.1 seconds
- 2017-07-11 14:33:52.279677 I | rook-ceph-mon0: Interval compaction: 0.11 GB write, 0.03 MB/s write, 0.11 GB read, 0.03 MB/s read, 2.8 seconds
- 2017-07-11 14:33:52.279689 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:33:52.279700 I | rook-ceph-mon0:
- 2017-07-11 14:33:52.279712 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:33:52.279741 I | rook-ceph-mon0:
- 2017-07-11 14:33:52.279755 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 14:33:52.279766 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:33:52.279777 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:33:52.279789 I | rook-ceph-mon0: L0 1/1 1.89 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 22.7 3 28 0.090 0 0
- 2017-07-11 14:33:52.279800 I | rook-ceph-mon0: L1 1/1 13.67 MB 0.0 0.3 0.1 0.3 0.3 0.0 0.0 5.5 52.8 46.4 7 24 0.274 56K 11K
- 2017-07-11 14:33:52.279834 I | rook-ceph-mon0: Sum 2/2 15.56 MB 0.0 0.3 0.1 0.3 0.4 0.1 0.0 6.3 38.1 39.8 9 52 0.175 56K 11K
- 2017-07-11 14:33:52.279846 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:33:52.279857 I | rook-ceph-mon0: Uptime(secs): 4207.1 total, 4207.1 interval
- 2017-07-11 14:33:52.279867 I | rook-ceph-mon0: Flush(GB): cumulative 0.056, interval 0.000
- 2017-07-11 14:33:52.279878 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:33:52.279902 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:33:52.279914 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:33:52.292520 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:33:52.292581 I | rook-ceph-mon0: Cumulative compaction: 0.35 GB write, 0.09 MB/s write, 0.34 GB read, 0.08 MB/s read, 9.1 seconds
- 2017-07-11 14:33:52.292598 I | rook-ceph-mon0: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:33:52.292622 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:33:52.292662 I | rook-ceph-mon0:
- 2017-07-11 14:33:52.292686 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:33:52.292699 I | rook-ceph-mon0:
- 2017-07-11 14:33:52.292724 I | rook-ceph-mon0: 2017-07-11 14:33:52.276761 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.276756) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:33:52.292736 I | rook-ceph-mon0:
- 2017-07-11 14:33:52.292748 I | rook-ceph-mon0: 2017-07-11 14:33:52.276765 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 54] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:33:52.292760 I | rook-ceph-mon0: 2017-07-11 14:33:52.276769 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 53 Base level 0, inputs: [86(1935KB)], [84(13MB)]
- 2017-07-11 14:33:52.292771 I | rook-ceph-mon0:
- 2017-07-11 14:33:52.292795 I | rook-ceph-mon0: 2017-07-11 14:33:52.276779 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632276771, "job": 54, "event": "compaction_started", "files_L0": [86], "files_L1": [84], "score": -1, "input_data_size": 16317722}
- 2017-07-11 14:33:52.515452 I | rook-ceph-mon0: 2017-07-11 14:33:52.515399 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 54] Generated table #87: 2023 keys, 13730722 bytes
- 2017-07-11 14:33:52.515637 I | rook-ceph-mon0: 2017-07-11 14:33:52.515554 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632515544, "cf_name": "default", "job": 54, "event": "table_file_creation", "file_number": 87, "file_size": 13730722, "table_properties": {"data_size": 13685891, "index_size": 44012, "filter_size": 0, "raw_key_size": 38509, "raw_average_key_size": 19, "raw_value_size": 13626864, "raw_average_value_size": 6735, "num_data_blocks": 1352, "num_entries": 2023, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:33:52.562738 I | rook-ceph-mon0: 2017-07-11 14:33:52.562687 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 54] Compacted 1@0 + 1@1 files to L1 => 13730722 bytes
- 2017-07-11 14:33:52.578120 I | rook-ceph-mon0: 2017-07-11 14:33:52.578083 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.577986) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 57.1 rd, 48.0 wr, level 1, files in(1, 1) out(1) MB in(1.9, 13.7) out(13.1), read-write-amplify(15.2) write-amplify(6.9) OK, records in: 2532, records dropped: 509
- 2017-07-11 14:33:52.578184 I | rook-ceph-mon0:
- 2017-07-11 14:33:52.578230 I | rook-ceph-mon0: 2017-07-11 14:33:52.578214 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.578008) EVENT_LOG_v1 {"time_micros": 1499783632577999, "job": 54, "event": "compaction_finished", "compaction_time_micros": 285887, "output_level": 1, "num_output_files": 1, "total_output_size": 13730722, "num_input_records": 2532, "num_output_records": 2023, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:33:52.578726 I | rook-ceph-mon0: 2017-07-11 14:33:52.578700 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632578697, "job": 54, "event": "table_file_deletion", "file_number": 86}
- 2017-07-11 14:33:52.580494 I | rook-ceph-mon0: 2017-07-11 14:33:52.580478 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632580476, "job": 54, "event": "table_file_deletion", "file_number": 84}
- 2017-07-11 14:33:54.096006 I | rook-ceph-mon0: 2017-07-11 14:33:54.095959 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:54.096227 I | rook-ceph-mon0: 2017-07-11 14:33:54.096194 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1062790687' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:55.104965 I | rook-ceph-mon0: 2017-07-11 14:33:55.104903 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:33:55.105035 I | rook-ceph-mon0: 2017-07-11 14:33:55.105018 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2355261867' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:33:56.699120 I | rook-ceph-mon0: 2017-07-11 14:33:56.699081 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:33:56.699331 I | rook-ceph-mon0: 2017-07-11 14:33:56.699232 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2202034792' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:33:57.324590 I | rook-ceph-mon0: 2017-07-11 14:33:57.324553 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:57.324703 I | rook-ceph-mon0: 2017-07-11 14:33:57.324687 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1109121109' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:59.003245 I | rook-ceph-mon0: 2017-07-11 14:33:59.003204 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:59.003314 I | rook-ceph-mon0: 2017-07-11 14:33:59.003298 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1182765117' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:59.886000 I | rook-ceph-mon0: 2017-07-11 14:33:59.885962 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:33:59.886191 I | rook-ceph-mon0: 2017-07-11 14:33:59.886106 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3619181866' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:34:03.924554 I | rook-ceph-mon0: 2017-07-11 14:34:03.924517 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:03.924781 I | rook-ceph-mon0: 2017-07-11 14:34:03.924740 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1002972936' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:04.810596 I | rook-ceph-mon0: 2017-07-11 14:34:04.810555 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:34:04.810823 I | rook-ceph-mon0: 2017-07-11 14:34:04.810719 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3131713265' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:34:05.247972 I | rook-ceph-mon0: 2017-07-11 14:34:05.247924 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:05.248200 I | rook-ceph-mon0: 2017-07-11 14:34:05.248166 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3728127840' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:08.862202 I | rook-ceph-mon0: 2017-07-11 14:34:08.862165 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:08.862448 I | rook-ceph-mon0: 2017-07-11 14:34:08.862322 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1463557275' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:14.651136 I | rook-ceph-mon0: 2017-07-11 14:34:14.651097 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:34:14.651339 I | rook-ceph-mon0: 2017-07-11 14:34:14.651249 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2795036892' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:34:18.699907 I | rook-ceph-mon0: 2017-07-11 14:34:18.699868 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:18.700105 I | rook-ceph-mon0: 2017-07-11 14:34:18.700018 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2138629272' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:19.969896 I | rook-ceph-mon0: 2017-07-11 14:34:19.969855 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:19.970114 I | rook-ceph-mon0: 2017-07-11 14:34:19.970082 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1897998301' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:25.241304 I | rook-ceph-mon0: 2017-07-11 14:34:25.241265 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:25.241368 I | rook-ceph-mon0: 2017-07-11 14:34:25.241353 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3275897745' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:26.195508 I | rook-ceph-mon0: 2017-07-11 14:34:26.195470 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:34:26.195725 I | rook-ceph-mon0: 2017-07-11 14:34:26.195688 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3192413949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:34:27.109992 I | rook-ceph-mon0: 2017-07-11 14:34:27.109955 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:27.110181 I | rook-ceph-mon0: 2017-07-11 14:34:27.110095 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3028285971' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:28.549910 I | rook-ceph-mon0: 2017-07-11 14:34:28.549871 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:28.550125 I | rook-ceph-mon0: 2017-07-11 14:34:28.550094 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1265670575' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:30.310868 I | rook-ceph-mon0: 2017-07-11 14:34:30.310831 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:34:30.311109 I | rook-ceph-mon0: 2017-07-11 14:34:30.311056 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1209293396' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:34:30.659626 I | rook-ceph-mon0: 2017-07-11 14:34:30.659544 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:34:30.659710 I | rook-ceph-mon0: 2017-07-11 14:34:30.659569 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3447233905' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:34:31.549635 I | rook-ceph-mon0: 2017-07-11 14:34:31.549594 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:31.549809 I | rook-ceph-mon0: 2017-07-11 14:34:31.549731 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1986455480' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:33.852627 I | rook-ceph-mon0: 2017-07-11 14:34:33.852586 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:33.852838 I | rook-ceph-mon0: 2017-07-11 14:34:33.852738 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3960045223' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:35.588824 I | rook-ceph-mon0: 2017-07-11 14:34:35.588764 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.179707s > max 0.05s
- 2017-07-11 14:34:35.599037 I | rook-ceph-mon0: 2017-07-11 14:34:35.599002 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:34:35.599136 I | rook-ceph-mon0: 2017-07-11 14:34:35.599121 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1268151442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:34:36.775095 I | rook-ceph-mon0: 2017-07-11 14:34:35.588917 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1208 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.179707s > max 0.05s
- 2017-07-11 14:34:38.374894 I | rook-ceph-mon0: 2017-07-11 14:34:38.374853 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:38.375109 I | rook-ceph-mon0: 2017-07-11 14:34:38.375007 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2120007538' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:40.485839 I | rook-ceph-mon0: 2017-07-11 14:34:40.485799 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:34:40.486116 I | rook-ceph-mon0: 2017-07-11 14:34:40.486069 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2339649361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:34:41.270187 I | rook-ceph-mon0: 2017-07-11 14:34:41.270149 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:34:41.270392 I | rook-ceph-mon0: 2017-07-11 14:34:41.270314 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2845868470' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:34:43.721351 I | rook-ceph-mon0: 2017-07-11 14:34:43.721313 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:43.721529 I | rook-ceph-mon0: 2017-07-11 14:34:43.721448 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2760604469' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:45.397300 I | rook-ceph-mon0: 2017-07-11 14:34:45.397261 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:34:45.397548 I | rook-ceph-mon0: 2017-07-11 14:34:45.397485 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2894442696' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:34:45.582229 I | rook-ceph-mon0: 2017-07-11 14:34:45.582071 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4823 MB, avail 94364 MB
- 2017-07-11 14:34:48.655955 I | rook-ceph-mon0: 2017-07-11 14:34:48.655917 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:48.656150 I | rook-ceph-mon0: 2017-07-11 14:34:48.656063 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1872369432' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:49.472988 I | rook-ceph-mon0: 2017-07-11 14:34:49.472948 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:49.473197 I | rook-ceph-mon0: 2017-07-11 14:34:49.473096 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2855784371' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:50.381467 I | rook-ceph-mon0: 2017-07-11 14:34:50.381429 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:34:50.381694 I | rook-ceph-mon0: 2017-07-11 14:34:50.381663 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4107837749' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:34:52.313411 I | rook-ceph-mon0: 2017-07-11 14:34:52.313373 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:34:52.313487 I | rook-ceph-mon0: 2017-07-11 14:34:52.313473 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2654913383' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:34:53.276272 I | rook-ceph-mon0: 2017-07-11 14:34:53.276239 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:53.276496 I | rook-ceph-mon0: 2017-07-11 14:34:53.276375 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/736624522' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:54.103373 I | rook-ceph-mon0: 2017-07-11 14:34:54.103333 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:34:54.103564 I | rook-ceph-mon0: 2017-07-11 14:34:54.103480 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1921646785' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:34:54.948877 I | rook-ceph-mon0: 2017-07-11 14:34:54.948825 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:34:54.949081 I | rook-ceph-mon0: 2017-07-11 14:34:54.948985 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1513394803' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:34:55.349484 I | rook-ceph-mon0: 2017-07-11 14:34:55.349446 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:34:55.349565 I | rook-ceph-mon0: 2017-07-11 14:34:55.349550 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3376975821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:34:58.972378 I | rook-ceph-mon0: 2017-07-11 14:34:58.972342 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:34:58.972552 I | rook-ceph-mon0: 2017-07-11 14:34:58.972474 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2894724756' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:34:59.389164 I | rook-ceph-mon0: 2017-07-11 14:34:59.389124 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:59.389230 I | rook-ceph-mon0: 2017-07-11 14:34:59.389215 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3285372714' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:01.648287 I | rook-ceph-mon0: 2017-07-11 14:35:01.648249 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:01.648501 I | rook-ceph-mon0: 2017-07-11 14:35:01.648399 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3656837878' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:03.073453 I | rook-ceph-mon0: 2017-07-11 14:35:03.073412 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:03.073669 I | rook-ceph-mon0: 2017-07-11 14:35:03.073563 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3807855406' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:03.482048 I | rook-ceph-mon0: 2017-07-11 14:35:03.482001 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:03.482199 I | rook-ceph-mon0: 2017-07-11 14:35:03.482184 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3551300633' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:03.935058 I | rook-ceph-mon0: 2017-07-11 14:35:03.935019 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:35:03.935303 I | rook-ceph-mon0: 2017-07-11 14:35:03.935174 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2218476199' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:35:04.371490 I | rook-ceph-mon0: 2017-07-11 14:35:04.371452 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:04.371702 I | rook-ceph-mon0: 2017-07-11 14:35:04.371603 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2187894859' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:06.008991 I | rook-ceph-mon0: 2017-07-11 14:35:06.008953 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:35:06.011919 I | rook-ceph-mon0: 2017-07-11 14:35:06.009104 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3725099262' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:35:07.971261 I | rook-ceph-mon0: 2017-07-11 14:35:07.971223 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:07.971635 I | rook-ceph-mon0: 2017-07-11 14:35:07.971597 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/276864995' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:09.063075 I | rook-ceph-mon0: 2017-07-11 14:35:09.063030 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:35:09.063295 I | rook-ceph-mon0: 2017-07-11 14:35:09.063186 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3749347249' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:35:11.244309 I | rook-ceph-mon0: 2017-07-11 14:35:11.244270 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:11.244533 I | rook-ceph-mon0: 2017-07-11 14:35:11.244517 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2341582038' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:12.690665 I | rook-ceph-mon0: 2017-07-11 14:35:11.518246 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 950 : cluster [WRN] message from mon.0 was stamped 0.051743s in the future, clocks not synchronized
- 2017-07-11 14:35:12.847575 I | rook-ceph-mon0: 2017-07-11 14:35:12.847536 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:12.847767 I | rook-ceph-mon0: 2017-07-11 14:35:12.847682 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3621057457' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:13.713711 I | rook-ceph-mon0: 2017-07-11 14:35:13.713671 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:35:13.713906 I | rook-ceph-mon0: 2017-07-11 14:35:13.713820 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2489398457' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:35:14.646561 I | rook-ceph-mon0: 2017-07-11 14:35:14.646521 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:35:14.646804 I | rook-ceph-mon0: 2017-07-11 14:35:14.646668 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2118167882' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:35:16.443279 I | rook-ceph-mon0: 2017-07-11 14:35:16.443227 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:16.443532 I | rook-ceph-mon0: 2017-07-11 14:35:16.443514 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3583430889' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:17.144055 I | rook-ceph-mon0: 2017-07-11 14:35:17.144016 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:35:17.144260 I | rook-ceph-mon0: 2017-07-11 14:35:17.144177 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2414734104' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:35:17.772600 I | rook-ceph-mon0: 2017-07-11 14:35:17.772560 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:17.772829 I | rook-ceph-mon0: 2017-07-11 14:35:17.772713 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3996148297' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:20.846243 I | rook-ceph-mon0: 2017-07-11 14:35:20.846205 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:20.846459 I | rook-ceph-mon0: 2017-07-11 14:35:20.846372 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1426369929' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:22.854436 I | rook-ceph-mon0: 2017-07-11 14:35:22.854397 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:22.854660 I | rook-ceph-mon0: 2017-07-11 14:35:22.854623 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1196155297' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:23.317024 I | rook-ceph-mon0: 2017-07-11 14:35:23.316983 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:23.317154 I | rook-ceph-mon0: 2017-07-11 14:35:23.317138 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3420577482' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:25.643153 I | rook-ceph-mon0: 2017-07-11 14:35:25.643095 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:35:25.643369 I | rook-ceph-mon0: 2017-07-11 14:35:25.643330 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2077168331' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:35:25.940993 I | rook-ceph-mon0: 2017-07-11 14:35:25.940955 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:25.941213 I | rook-ceph-mon0: 2017-07-11 14:35:25.941103 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3637954264' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:28.074897 I | rook-ceph-mon0: 2017-07-11 14:35:28.074856 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:28.075091 I | rook-ceph-mon0: 2017-07-11 14:35:28.075007 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/696885607' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:30.650320 I | rook-ceph-mon0: 2017-07-11 14:35:30.650286 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:30.650513 I | rook-ceph-mon0: 2017-07-11 14:35:30.650428 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2742627743' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:36.670225 I | rook-ceph-mon0: 2017-07-11 14:35:36.670186 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:35:36.670440 I | rook-ceph-mon0: 2017-07-11 14:35:36.670409 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4163426115' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:35:37.485198 I | rook-ceph-mon0: 2017-07-11 14:35:37.485148 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:37.485390 I | rook-ceph-mon0: 2017-07-11 14:35:37.485307 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/155131936' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:39.422388 I | rook-ceph-mon0: 2017-07-11 14:35:39.422353 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:35:39.422606 I | rook-ceph-mon0: 2017-07-11 14:35:39.422495 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/778531231' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:35:39.655651 I | rook-ceph-mon0: 2017-07-11 14:35:39.655613 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:35:39.655723 I | rook-ceph-mon0: 2017-07-11 14:35:39.655707 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3347413733' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:35:42.423786 I | rook-ceph-mon0: 2017-07-11 14:35:42.423746 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:42.424014 I | rook-ceph-mon0: 2017-07-11 14:35:42.423898 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2374270573' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:44.601255 I | rook-ceph-mon0: 2017-07-11 14:35:44.601220 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:35:44.601447 I | rook-ceph-mon0: 2017-07-11 14:35:44.601361 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/750037899' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:35:45.560414 I | rook-ceph-mon0: 2017-07-11 14:35:45.560377 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:45.560480 I | rook-ceph-mon0: 2017-07-11 14:35:45.560465 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/543100724' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:45.582519 I | rook-ceph-mon0: 2017-07-11 14:35:45.582296 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4823 MB, avail 94364 MB
- 2017-07-11 14:35:47.362134 I | rook-ceph-mon0: 2017-07-11 14:35:47.362082 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:47.362351 I | rook-ceph-mon0: 2017-07-11 14:35:47.362247 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/813509713' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:48.176085 I | rook-ceph-mon0: 2017-07-11 14:35:48.176046 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:35:48.176332 I | rook-ceph-mon0: 2017-07-11 14:35:48.176315 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1331524475' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:35:52.271735 I | rook-ceph-mon0: 2017-07-11 14:35:52.271493 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:52.271854 I | rook-ceph-mon0: 2017-07-11 14:35:52.271515 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1075992810' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:53.108166 I | rook-ceph-mon0: 2017-07-11 14:35:53.108128 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:35:53.108382 I | rook-ceph-mon0: 2017-07-11 14:35:53.108272 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2697229444' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:35:53.571747 I | rook-ceph-mon0: 2017-07-11 14:35:53.571701 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:53.571986 I | rook-ceph-mon0: 2017-07-11 14:35:53.571945 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/826168757' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:54.410042 I | rook-ceph-mon0: 2017-07-11 14:35:54.410002 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:35:54.410257 I | rook-ceph-mon0: 2017-07-11 14:35:54.410225 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4203957736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:35:57.604335 I | rook-ceph-mon0: 2017-07-11 14:35:57.604296 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:57.604589 I | rook-ceph-mon0: 2017-07-11 14:35:57.604482 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/565322066' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:58.869148 I | rook-ceph-mon0: 2017-07-11 14:35:58.869110 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:35:58.869376 I | rook-ceph-mon0: 2017-07-11 14:35:58.869260 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2968699210' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:36:00.518854 I | rook-ceph-mon0: 2017-07-11 14:36:00.518816 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:00.519101 I | rook-ceph-mon0: 2017-07-11 14:36:00.519074 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2361765993' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:02.132934 I | rook-ceph-mon0: 2017-07-11 14:36:02.132892 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:02.136642 I | rook-ceph-mon0: 2017-07-11 14:36:02.133047 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4136328289' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:02.544235 I | rook-ceph-mon0: 2017-07-11 14:36:02.544196 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:02.544456 I | rook-ceph-mon0: 2017-07-11 14:36:02.544346 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2173261066' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:07.565185 I | rook-ceph-mon0: 2017-07-11 14:36:07.565147 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:07.565379 I | rook-ceph-mon0: 2017-07-11 14:36:07.565291 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3283800224' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:09.224750 I | rook-ceph-mon0: 2017-07-11 14:36:09.224713 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:36:09.224976 I | rook-ceph-mon0: 2017-07-11 14:36:09.224941 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/179908964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:36:12.398076 I | rook-ceph-mon0: 2017-07-11 14:36:12.398036 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:12.398291 I | rook-ceph-mon0: 2017-07-11 14:36:12.398260 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2005422908' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:12.411961 I | rook-ceph-mon0: 2017-07-11 14:36:12.411935 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:36:12.412048 I | rook-ceph-mon0: 2017-07-11 14:36:12.412031 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1509533886' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:36:14.092990 I | rook-ceph-mon0: 2017-07-11 14:36:14.092953 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:36:14.093242 I | rook-ceph-mon0: 2017-07-11 14:36:14.093108 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1675728933' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:36:15.048929 I | rook-ceph-mon0: 2017-07-11 14:36:15.048892 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:15.049157 I | rook-ceph-mon0: 2017-07-11 14:36:15.049038 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2808404115' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:17.914087 I | rook-ceph-mon0: 2017-07-11 14:36:17.914047 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:36:17.914333 I | rook-ceph-mon0: 2017-07-11 14:36:17.914301 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/744271519' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:36:20.026188 I | rook-ceph-mon0: 2017-07-11 14:36:20.026151 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:20.026398 I | rook-ceph-mon0: 2017-07-11 14:36:20.026291 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1314290700' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:22.637716 I | rook-ceph-mon0: 2017-07-11 14:36:22.637677 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:36:22.637911 I | rook-ceph-mon0: 2017-07-11 14:36:22.637823 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2338169342' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:36:23.518530 I | rook-ceph-mon0: 2017-07-11 14:36:23.518494 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:36:23.518636 I | rook-ceph-mon0: 2017-07-11 14:36:23.518620 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2961226655' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:36:23.945913 I | rook-ceph-mon0: 2017-07-11 14:36:23.945878 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:36:23.946144 I | rook-ceph-mon0: 2017-07-11 14:36:23.946035 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2560845920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:36:24.770487 I | rook-ceph-mon0: 2017-07-11 14:36:24.770448 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:24.770662 I | rook-ceph-mon0: 2017-07-11 14:36:24.770583 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2316893584' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:26.757124 I | rook-ceph-mon0: 2017-07-11 14:36:26.757087 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:26.757352 I | rook-ceph-mon0: 2017-07-11 14:36:26.757334 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4221409655' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:32.099185 I | rook-ceph-mon0: 2017-07-11 14:36:32.099130 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:32.099254 I | rook-ceph-mon0: 2017-07-11 14:36:32.099239 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1257608380' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:32.917770 I | rook-ceph-mon0: 2017-07-11 14:36:32.917727 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:32.917839 I | rook-ceph-mon0: 2017-07-11 14:36:32.917824 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1878939711' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:34.552112 I | rook-ceph-mon0: 2017-07-11 14:36:34.552062 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:36:34.552336 I | rook-ceph-mon0: 2017-07-11 14:36:34.552235 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/624488108' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:36:34.645482 I | rook-ceph-mon0: 2017-07-11 14:36:34.645442 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:34.645700 I | rook-ceph-mon0: 2017-07-11 14:36:34.645596 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3468213288' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:36.573729 I | rook-ceph-mon0: 2017-07-11 14:36:36.573692 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:36.573970 I | rook-ceph-mon0: 2017-07-11 14:36:36.573850 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/372711475' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:37.015466 I | rook-ceph-mon0: 2017-07-11 14:36:37.015428 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:37.015661 I | rook-ceph-mon0: 2017-07-11 14:36:37.015574 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/993880176' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:38.733866 I | rook-ceph-mon0: 2017-07-11 14:36:38.733826 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:36:38.734174 I | rook-ceph-mon0: 2017-07-11 14:36:38.734136 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/459200189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:36:42.340115 I | rook-ceph-mon0: 2017-07-11 14:36:42.340077 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:36:42.340308 I | rook-ceph-mon0: 2017-07-11 14:36:42.340222 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/735493116' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:36:42.767457 I | rook-ceph-mon0: 2017-07-11 14:36:42.767416 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:42.767675 I | rook-ceph-mon0: 2017-07-11 14:36:42.767638 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4091092883' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:43.422017 I | rook-ceph-mon0: 2017-07-11 14:36:43.421980 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:36:43.422231 I | rook-ceph-mon0: 2017-07-11 14:36:43.422116 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/296593063' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:36:43.623907 I | rook-ceph-mon0: 2017-07-11 14:36:43.623868 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:36:43.624090 I | rook-ceph-mon0: 2017-07-11 14:36:43.624008 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/700553637' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:36:44.464728 I | rook-ceph-mon0: 2017-07-11 14:36:44.464668 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:44.464925 I | rook-ceph-mon0: 2017-07-11 14:36:44.464840 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2318814687' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:45.557598 I | rook-ceph-mon0: 2017-07-11 14:36:45.557561 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:36:45.557677 I | rook-ceph-mon0: 2017-07-11 14:36:45.557663 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4074079497' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:36:45.582696 I | rook-ceph-mon0: 2017-07-11 14:36:45.582478 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4823 MB, avail 94363 MB
- 2017-07-11 14:36:47.863822 I | rook-ceph-mon0: 2017-07-11 14:36:47.863786 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:47.864014 I | rook-ceph-mon0: 2017-07-11 14:36:47.863930 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3563360660' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:51.862919 I | rook-ceph-mon0: 2017-07-11 14:36:51.862880 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:51.863137 I | rook-ceph-mon0: 2017-07-11 14:36:51.863027 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2726503519' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:58.147561 I | rook-ceph-mon0: 2017-07-11 14:36:58.147520 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:58.147780 I | rook-ceph-mon0: 2017-07-11 14:36:58.147672 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/345416096' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:59.056068 I | rook-ceph-mon0: 2017-07-11 14:36:59.056021 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:36:59.056375 I | rook-ceph-mon0: 2017-07-11 14:36:59.056357 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2791001893' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:37:00.035283 I | rook-ceph-mon0: 2017-07-11 14:37:00.035244 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:00.035352 I | rook-ceph-mon0: 2017-07-11 14:37:00.035336 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2354793686' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:03.369784 I | rook-ceph-mon0: 2017-07-11 14:37:03.369745 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:03.369981 I | rook-ceph-mon0: 2017-07-11 14:37:03.369893 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2012864695' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:05.539089 I | rook-ceph-mon0: 2017-07-11 14:37:05.539053 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:37:05.539316 I | rook-ceph-mon0: 2017-07-11 14:37:05.539187 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3158176315' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:37:07.914341 I | rook-ceph-mon0: 2017-07-11 14:37:07.914299 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:37:07.914566 I | rook-ceph-mon0: 2017-07-11 14:37:07.914531 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3172098879' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:37:08.045272 I | rook-ceph-mon0: 2017-07-11 14:37:08.045237 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:37:08.045466 I | rook-ceph-mon0: 2017-07-11 14:37:08.045448 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/921807712' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:37:10.160752 I | rook-ceph-mon0: 2017-07-11 14:37:10.160682 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:10.160832 I | rook-ceph-mon0: 2017-07-11 14:37:10.160816 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2366140129' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:12.177205 I | rook-ceph-mon0: 2017-07-11 14:37:12.177113 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #88. Immutable memtables: 0.
- 2017-07-11 14:37:12.177309 I | rook-ceph-mon0:
- 2017-07-11 14:37:12.177357 I | rook-ceph-mon0: 2017-07-11 14:37:12.177155 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 55] Syncing log #85
- 2017-07-11 14:37:12.207231 I | rook-ceph-mon0: 2017-07-11 14:37:12.205028 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.177150) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:37:12.207311 I | rook-ceph-mon0: 2017-07-11 14:37:12.205043 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 55] Flushing memtable with next log file: 88
- 2017-07-11 14:37:12.207328 I | rook-ceph-mon0:
- 2017-07-11 14:37:12.207340 I | rook-ceph-mon0: 2017-07-11 14:37:12.205053 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832205049, "job": 55, "event": "flush_started", "num_memtables": 1, "num_entries": 2056, "num_deletes": 251, "memory_usage": 5076400}
- 2017-07-11 14:37:12.207351 I | rook-ceph-mon0: 2017-07-11 14:37:12.205056 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 55] Level-0 flush table #89: started
- 2017-07-11 14:37:12.347128 I | rook-ceph-mon0: 2017-07-11 14:37:12.347077 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832347065, "cf_name": "default", "job": 55, "event": "table_file_creation", "file_number": 89, "file_size": 5023914, "table_properties": {"data_size": 5006413, "index_size": 16681, "filter_size": 0, "raw_key_size": 17071, "raw_average_key_size": 18, "raw_value_size": 4982269, "raw_average_value_size": 5481, "num_data_blocks": 522, "num_entries": 909, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:37:12.347238 I | rook-ceph-mon0: 2017-07-11 14:37:12.347220 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 55] Level-0 flush table #89: 5023914 bytes OK
- 2017-07-11 14:37:12.442132 I | rook-ceph-mon0: 2017-07-11 14:37:12.442081 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.362024) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #89 started
- 2017-07-11 14:37:12.442240 I | rook-ceph-mon0: 2017-07-11 14:37:12.442224 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.442015) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #89: memtable #1 done
- 2017-07-11 14:37:12.442296 I | rook-ceph-mon0: 2017-07-11 14:37:12.442260 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.442041) EVENT_LOG_v1 {"time_micros": 1499783832442034, "job": 55, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:37:12.442328 I | rook-ceph-mon0: 2017-07-11 14:37:12.442314 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.442057) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:37:12.442343 I | rook-ceph-mon0:
- 2017-07-11 14:37:12.442390 I | rook-ceph-mon0: 2017-07-11 14:37:12.442376 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 55] Try to delete WAL files size 5033979, prev total WAL file size 5033979, number of live WAL files 2.
- 2017-07-11 14:37:12.442404 I | rook-ceph-mon0:
- 2017-07-11 14:37:12.451849 I | rook-ceph-mon0: 2017-07-11 14:37:12.443395 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:37:12.451909 I | rook-ceph-mon0: 2017-07-11 14:37:12.443434 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.443429) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:37:12.451927 I | rook-ceph-mon0:
- 2017-07-11 14:37:12.451950 I | rook-ceph-mon0: 2017-07-11 14:37:12.443440 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 56] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:37:12.451984 I | rook-ceph-mon0: 2017-07-11 14:37:12.443447 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 55 Base level 0, inputs: [89(4906KB)], [87(13MB)]
- 2017-07-11 14:37:12.452014 I | rook-ceph-mon0:
- 2017-07-11 14:37:12.452026 I | rook-ceph-mon0: 2017-07-11 14:37:12.443457 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832443449, "job": 56, "event": "compaction_started", "files_L0": [89], "files_L1": [87], "score": -1, "input_data_size": 18754636}
- 2017-07-11 14:37:12.678429 I | rook-ceph-mon0: 2017-07-11 14:37:12.678355 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 56] Generated table #90: 2423 keys, 16200915 bytes
- 2017-07-11 14:37:12.678660 I | rook-ceph-mon0: 2017-07-11 14:37:12.678568 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832678560, "cf_name": "default", "job": 56, "event": "table_file_creation", "file_number": 90, "file_size": 16200915, "table_properties": {"data_size": 16146976, "index_size": 53120, "filter_size": 0, "raw_key_size": 46359, "raw_average_key_size": 19, "raw_value_size": 16076015, "raw_average_value_size": 6634, "num_data_blocks": 1622, "num_entries": 2423, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:37:12.693341 I | rook-ceph-mon0: 2017-07-11 14:37:12.693311 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 56] Compacted 1@0 + 1@1 files to L1 => 16200915 bytes
- 2017-07-11 14:37:12.709549 I | rook-ceph-mon0: 2017-07-11 14:37:12.709512 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.709436) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 75.1 rd, 64.8 wr, level 1, files in(1, 1) out(1) MB in(4.8, 13.1) out(15.5), read-write-amplify(7.0) write-amplify(3.2) OK, records in: 2932, records dropped: 509
- 2017-07-11 14:37:12.709607 I | rook-ceph-mon0:
- 2017-07-11 14:37:12.709644 I | rook-ceph-mon0: 2017-07-11 14:37:12.709627 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.709456) EVENT_LOG_v1 {"time_micros": 1499783832709448, "job": 56, "event": "compaction_finished", "compaction_time_micros": 249839, "output_level": 1, "num_output_files": 1, "total_output_size": 16200915, "num_input_records": 2932, "num_output_records": 2423, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:37:12.710553 I | rook-ceph-mon0: 2017-07-11 14:37:12.710537 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832710531, "job": 56, "event": "table_file_deletion", "file_number": 89}
- 2017-07-11 14:37:12.712801 I | rook-ceph-mon0: 2017-07-11 14:37:12.712784 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832712781, "job": 56, "event": "table_file_deletion", "file_number": 87}
- 2017-07-11 14:37:13.304518 I | rook-ceph-mon0: 2017-07-11 14:37:13.304481 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:13.304586 I | rook-ceph-mon0: 2017-07-11 14:37:13.304571 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/106280066' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:16.519164 I | rook-ceph-mon0: 2017-07-11 14:37:16.519123 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:37:16.519405 I | rook-ceph-mon0: 2017-07-11 14:37:16.519388 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2188344598' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:37:17.943202 I | rook-ceph-mon0: 2017-07-11 14:37:17.943163 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:17.943394 I | rook-ceph-mon0: 2017-07-11 14:37:17.943311 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/233818855' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:18.830077 I | rook-ceph-mon0: 2017-07-11 14:37:18.830037 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:37:18.830319 I | rook-ceph-mon0: 2017-07-11 14:37:18.830299 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1099345324' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:37:21.819912 I | rook-ceph-mon0: 2017-07-11 14:37:21.819873 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:21.820090 I | rook-ceph-mon0: 2017-07-11 14:37:21.820011 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3679319565' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:26.803509 I | rook-ceph-mon0: 2017-07-11 14:37:26.803472 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:26.803697 I | rook-ceph-mon0: 2017-07-11 14:37:26.803613 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/814906373' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:30.276249 I | rook-ceph-mon0: 2017-07-11 14:37:30.266618 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:37:30.284506 I | rook-ceph-mon0: 2017-07-11 14:37:30.276483 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2296101225' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:37:32.531516 I | rook-ceph-mon0: 2017-07-11 14:37:32.522514 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:32.534481 I | rook-ceph-mon0: 2017-07-11 14:37:32.533405 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/340165574' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:36.167667 I | rook-ceph-mon0: 2017-07-11 14:37:36.167624 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:36.167887 I | rook-ceph-mon0: 2017-07-11 14:37:36.167785 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/601725723' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:38.416929 I | rook-ceph-mon0: 2017-07-11 14:37:38.416891 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:37:38.417151 I | rook-ceph-mon0: 2017-07-11 14:37:38.417119 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2205954373' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:37:39.263679 I | rook-ceph-mon0: 2017-07-11 14:37:39.263639 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:39.263895 I | rook-ceph-mon0: 2017-07-11 14:37:39.263860 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2612232874' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:42.017097 I | rook-ceph-mon0: 2017-07-11 14:37:42.017058 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:37:42.017307 I | rook-ceph-mon0: 2017-07-11 14:37:42.017206 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1603292063' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:37:45.591616 I | rook-ceph-mon0: 2017-07-11 14:37:45.583806 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94361 MB
- 2017-07-11 14:37:46.443655 I | rook-ceph-mon0: 2017-07-11 14:37:46.443616 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:46.443728 I | rook-ceph-mon0: 2017-07-11 14:37:46.443713 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1860970434' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:47.350614 I | rook-ceph-mon0: 2017-07-11 14:37:47.350557 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:47.350852 I | rook-ceph-mon0: 2017-07-11 14:37:47.350821 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4202700493' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:49.143039 I | rook-ceph-mon0: 2017-07-11 14:37:49.142999 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:49.143107 I | rook-ceph-mon0: 2017-07-11 14:37:49.143092 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1465006769' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:49.897078 I | rook-ceph-mon0: 2017-07-11 14:37:49.897040 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:37:49.897291 I | rook-ceph-mon0: 2017-07-11 14:37:49.897199 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/661650468' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:37:50.979697 I | rook-ceph-mon0: 2017-07-11 14:37:50.979659 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:50.979973 I | rook-ceph-mon0: 2017-07-11 14:37:50.979955 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2191101663' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:52.567552 I | rook-ceph-mon0: 2017-07-11 14:37:52.567509 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:37:52.567732 I | rook-ceph-mon0: 2017-07-11 14:37:52.567652 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3688781940' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:37:53.204942 I | rook-ceph-mon0: 2017-07-11 14:37:53.204903 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:37:53.205014 I | rook-ceph-mon0: 2017-07-11 14:37:53.204998 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/754575068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:37:55.920173 I | rook-ceph-mon0: 2017-07-11 14:37:55.920127 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:55.920389 I | rook-ceph-mon0: 2017-07-11 14:37:55.920356 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3786067619' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:56.766218 I | rook-ceph-mon0: 2017-07-11 14:37:56.766178 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:37:56.766436 I | rook-ceph-mon0: 2017-07-11 14:37:56.766327 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3076588423' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:37:57.210369 I | rook-ceph-mon0: 2017-07-11 14:37:57.210331 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:57.210619 I | rook-ceph-mon0: 2017-07-11 14:37:57.210493 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3159852630' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:58.163265 I | rook-ceph-mon0: 2017-07-11 14:37:58.163227 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:37:58.163502 I | rook-ceph-mon0: 2017-07-11 14:37:58.163485 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2027004176' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:38:03.299595 I | rook-ceph-mon0: 2017-07-11 14:38:03.299557 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:38:03.299672 I | rook-ceph-mon0: 2017-07-11 14:38:03.299656 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4089926657' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:38:03.616705 I | rook-ceph-mon0: 2017-07-11 14:38:03.616666 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:38:03.616774 I | rook-ceph-mon0: 2017-07-11 14:38:03.616759 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/474130154' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:38:06.669654 I | rook-ceph-mon0: 2017-07-11 14:38:06.669619 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:38:06.669900 I | rook-ceph-mon0: 2017-07-11 14:38:06.669883 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3636113106' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:38:08.030189 I | rook-ceph-mon0: 2017-07-11 14:38:08.030150 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:38:08.030374 I | rook-ceph-mon0: 2017-07-11 14:38:08.030294 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2134369302' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:38:12.141459 I | rook-ceph-mon0: 2017-07-11 14:38:12.141420 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:12.141705 I | rook-ceph-mon0: 2017-07-11 14:38:12.141688 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3841871840' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:12.288628 I | rook-ceph-mon0: 2017-07-11 14:38:12.288579 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:38:12.288765 I | rook-ceph-mon0: 2017-07-11 14:38:12.288750 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1136000467' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:38:13.031520 I | rook-ceph-mon0: 2017-07-11 14:38:13.031480 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:38:13.031739 I | rook-ceph-mon0: 2017-07-11 14:38:13.031704 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3239729856' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:38:13.577595 I | rook-ceph-mon0: 2017-07-11 14:38:13.577499 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #91. Immutable memtables: 0.
- 2017-07-11 14:38:13.577612 I | rook-ceph-mon0:
- 2017-07-11 14:38:13.577618 I | rook-ceph-mon0: 2017-07-11 14:38:13.577528 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 57] Syncing log #88
- 2017-07-11 14:38:13.595243 I | rook-ceph-mon0: 2017-07-11 14:38:13.593153 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:38:13.577523) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:38:13.595307 I | rook-ceph-mon0: 2017-07-11 14:38:13.593163 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 57] Flushing memtable with next log file: 91
- 2017-07-11 14:38:13.595324 I | rook-ceph-mon0:
- 2017-07-11 14:38:13.595336 I | rook-ceph-mon0: 2017-07-11 14:38:13.593173 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783893593169, "job": 57, "event": "flush_started", "num_memtables": 1, "num_entries": 1043, "num_deletes": 506, "memory_usage": 1532968}
- 2017-07-11 14:38:13.595365 I | rook-ceph-mon0: 2017-07-11 14:38:13.593175 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 57] Level-0 flush table #92: started
- 2017-07-11 14:38:13.686597 I | rook-ceph-mon0: 2017-07-11 14:38:13.686547 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783893686537, "cf_name": "default", "job": 57, "event": "table_file_creation", "file_number": 92, "file_size": 1507508, "table_properties": {"data_size": 1501788, "index_size": 4905, "filter_size": 0, "raw_key_size": 13225, "raw_average_key_size": 18, "raw_value_size": 1488887, "raw_average_value_size": 2108, "num_data_blocks": 157, "num_entries": 706, "filter_policy_name": "", "kDeletedKeys": "506", "kMergeOperands": "0"}}
- 2017-07-11 14:38:13.686698 I | rook-ceph-mon0: 2017-07-11 14:38:13.686680 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 57] Level-0 flush table #92: 1507508 bytes OK
- 2017-07-11 14:38:13.796442 I | rook-ceph-mon0: 2017-07-11 14:38:13.796398 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:38:13.733487) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #92 started
- 2017-07-11 14:38:13.796550 I | rook-ceph-mon0: 2017-07-11 14:38:13.796534 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:38:13.796351) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #92: memtable #1 done
- 2017-07-11 14:38:13.796696 I | rook-ceph-mon0: 2017-07-11 14:38:13.796663 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:38:13.796371) EVENT_LOG_v1 {"time_micros": 1499783893796365, "job": 57, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:38:13.796745 I | rook-ceph-mon0: 2017-07-11 14:38:13.796717 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:38:13.796386) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:38:13.796760 I | rook-ceph-mon0:
- 2017-07-11 14:38:13.796792 I | rook-ceph-mon0: 2017-07-11 14:38:13.796779 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 57] Try to delete WAL files size 1509694, prev total WAL file size 1509694, number of live WAL files 2.
- 2017-07-11 14:38:13.796821 I | rook-ceph-mon0:
- 2017-07-11 14:38:13.800338 I | rook-ceph-mon0: 2017-07-11 14:38:13.797264 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:38:13.800376 I | rook-ceph-mon0: 2017-07-11 14:38:13.797295 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:38:13.797290) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:38:13.800392 I | rook-ceph-mon0:
- 2017-07-11 14:38:13.800403 I | rook-ceph-mon0: 2017-07-11 14:38:13.797299 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 58] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:38:13.800415 I | rook-ceph-mon0: 2017-07-11 14:38:13.797315 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 57 Base level 0, inputs: [92(1472KB)], [90(15MB)]
- 2017-07-11 14:38:13.800425 I | rook-ceph-mon0:
- 2017-07-11 14:38:13.800452 I | rook-ceph-mon0: 2017-07-11 14:38:13.797325 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783893797317, "job": 58, "event": "compaction_started", "files_L0": [92], "files_L1": [90], "score": -1, "input_data_size": 17708423}
- 2017-07-11 14:38:14.061213 I | rook-ceph-mon0: 2017-07-11 14:38:14.061060 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:14.061299 I | rook-ceph-mon0: 2017-07-11 14:38:14.061085 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1304971974' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:14.066835 I | rook-ceph-mon0: 2017-07-11 14:38:14.066807 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 58] Generated table #93: 2110 keys, 14597072 bytes
- 2017-07-11 14:38:14.066915 I | rook-ceph-mon0: 2017-07-11 14:38:14.066896 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783894066888, "cf_name": "default", "job": 58, "event": "table_file_creation", "file_number": 93, "file_size": 14597072, "table_properties": {"data_size": 14547806, "index_size": 48447, "filter_size": 0, "raw_key_size": 40650, "raw_average_key_size": 19, "raw_value_size": 14484408, "raw_average_value_size": 6864, "num_data_blocks": 1485, "num_entries": 2110, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:38:14.096839 I | rook-ceph-mon0: 2017-07-11 14:38:14.096805 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 58] Compacted 1@0 + 1@1 files to L1 => 14597072 bytes
- 2017-07-11 14:38:14.112161 I | rook-ceph-mon0: 2017-07-11 14:38:14.112126 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:38:14.112063) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 59.1 rd, 48.7 wr, level 1, files in(1, 1) out(1) MB in(1.4, 15.5) out(13.9), read-write-amplify(21.4) write-amplify(9.7) OK, records in: 3129, records dropped: 1019
- 2017-07-11 14:38:14.112213 I | rook-ceph-mon0:
- 2017-07-11 14:38:14.112284 I | rook-ceph-mon0: 2017-07-11 14:38:14.112231 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:38:14.112083) EVENT_LOG_v1 {"time_micros": 1499783894112075, "job": 58, "event": "compaction_finished", "compaction_time_micros": 299465, "output_level": 1, "num_output_files": 1, "total_output_size": 14597072, "num_input_records": 3129, "num_output_records": 2110, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:38:14.112672 I | rook-ceph-mon0: 2017-07-11 14:38:14.112658 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783894112655, "job": 58, "event": "table_file_deletion", "file_number": 92}
- 2017-07-11 14:38:14.114448 I | rook-ceph-mon0: 2017-07-11 14:38:14.114435 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783894114433, "job": 58, "event": "table_file_deletion", "file_number": 90}
- 2017-07-11 14:38:14.114579 I | rook-ceph-mon0: 2017-07-11 14:38:14.114520 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:38:18.004607 I | rook-ceph-mon0: 2017-07-11 14:38:18.004524 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:38:18.004702 I | rook-ceph-mon0: 2017-07-11 14:38:18.004550 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3553876742' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:38:22.043238 I | rook-ceph-mon0: 2017-07-11 14:38:22.043196 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:22.043455 I | rook-ceph-mon0: 2017-07-11 14:38:22.043425 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/451152875' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:22.897042 I | rook-ceph-mon0: 2017-07-11 14:38:22.897003 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:38:22.897257 I | rook-ceph-mon0: 2017-07-11 14:38:22.897221 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2142252451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:38:23.280401 I | rook-ceph-mon0: 2017-07-11 14:38:23.280362 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:38:23.280529 I | rook-ceph-mon0: 2017-07-11 14:38:23.280514 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3097775676' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:38:26.012540 I | rook-ceph-mon0: 2017-07-11 14:38:26.012501 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:26.012823 I | rook-ceph-mon0: 2017-07-11 14:38:26.012791 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4053492049' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:28.670413 I | rook-ceph-mon0: 2017-07-11 14:38:28.670378 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:28.670607 I | rook-ceph-mon0: 2017-07-11 14:38:28.670523 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1764492276' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:30.472446 I | rook-ceph-mon0: 2017-07-11 14:38:30.472408 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:30.482228 I | rook-ceph-mon0: 2017-07-11 14:38:30.482192 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3568937293' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:30.887555 I | rook-ceph-mon0: 2017-07-11 14:38:30.887516 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:30.887787 I | rook-ceph-mon0: 2017-07-11 14:38:30.887662 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/614935653' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:31.428521 I | rook-ceph-mon0: 2017-07-11 14:38:31.428482 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:38:31.428734 I | rook-ceph-mon0: 2017-07-11 14:38:31.428705 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2416560113' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:38:34.362018 I | rook-ceph-mon0: 2017-07-11 14:38:34.361978 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:38:34.362241 I | rook-ceph-mon0: 2017-07-11 14:38:34.362142 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3579634625' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:38:35.495572 I | rook-ceph-mon0: 2017-07-11 14:38:35.495533 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:35.495787 I | rook-ceph-mon0: 2017-07-11 14:38:35.495683 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3693448563' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:35.887515 I | rook-ceph-mon0: 2017-07-11 14:38:35.887477 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:35.887579 I | rook-ceph-mon0: 2017-07-11 14:38:35.887564 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2096590371' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:36.312828 I | rook-ceph-mon0: 2017-07-11 14:38:36.312789 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:38:36.313019 I | rook-ceph-mon0: 2017-07-11 14:38:36.312936 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/144837158' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:38:36.754885 I | rook-ceph-mon0: 2017-07-11 14:38:36.754848 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:36.755134 I | rook-ceph-mon0: 2017-07-11 14:38:36.755118 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4082847521' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:37.050080 I | rook-ceph-mon0: 2017-07-11 14:38:37.050031 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:38:37.050215 I | rook-ceph-mon0: 2017-07-11 14:38:37.050200 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/487463722' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:38:40.300221 I | rook-ceph-mon0: 2017-07-11 14:38:40.300182 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:40.300440 I | rook-ceph-mon0: 2017-07-11 14:38:40.300341 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/54762253' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:40.710890 I | rook-ceph-mon0: 2017-07-11 14:38:40.710853 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:40.710955 I | rook-ceph-mon0: 2017-07-11 14:38:40.710940 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1833787556' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:41.183692 I | rook-ceph-mon0: 2017-07-11 14:38:41.183654 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:38:41.183801 I | rook-ceph-mon0: 2017-07-11 14:38:41.183786 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/701055030' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:38:42.458158 I | rook-ceph-mon0: 2017-07-11 14:38:42.458121 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:38:42.458352 I | rook-ceph-mon0: 2017-07-11 14:38:42.458273 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1907210855' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:38:45.356665 I | rook-ceph-mon0: 2017-07-11 14:38:45.356627 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:38:45.356881 I | rook-ceph-mon0: 2017-07-11 14:38:45.356777 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/584064440' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:38:45.584744 I | rook-ceph-mon0: 2017-07-11 14:38:45.584562 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4824 MB, avail 94363 MB
- 2017-07-11 14:38:45.810887 I | rook-ceph-mon0: 2017-07-11 14:38:45.810847 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:45.820650 I | rook-ceph-mon0: 2017-07-11 14:38:45.810996 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1803784353' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:46.256260 I | rook-ceph-mon0: 2017-07-11 14:38:46.256219 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:38:46.256497 I | rook-ceph-mon0: 2017-07-11 14:38:46.256413 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1188748844' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:38:48.151426 I | rook-ceph-mon0: 2017-07-11 14:38:48.151388 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:38:48.151609 I | rook-ceph-mon0: 2017-07-11 14:38:48.151528 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3090264931' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:38:48.635894 I | rook-ceph-mon0: 2017-07-11 14:38:48.635815 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:48.636332 I | rook-ceph-mon0: 2017-07-11 14:38:48.636254 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/954695051' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:50.177505 I | rook-ceph-mon0: 2017-07-11 14:38:50.177466 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:50.177700 I | rook-ceph-mon0: 2017-07-11 14:38:50.177613 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/328966298' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:50.591089 I | rook-ceph-mon0: 2017-07-11 14:38:50.591051 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:50.591218 I | rook-ceph-mon0: 2017-07-11 14:38:50.591197 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3062214651' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:50.984928 I | rook-ceph-mon0: 2017-07-11 14:38:50.984890 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:38:50.985138 I | rook-ceph-mon0: 2017-07-11 14:38:50.985032 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2103443930' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:38:51.400930 I | rook-ceph-mon0: 2017-07-11 14:38:51.400890 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:51.401156 I | rook-ceph-mon0: 2017-07-11 14:38:51.401041 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/495256299' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:52.245685 I | rook-ceph-mon0: 2017-07-11 14:38:52.245646 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:38:52.245881 I | rook-ceph-mon0: 2017-07-11 14:38:52.245794 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1260390103' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:38:56.332636 I | rook-ceph-mon0: 2017-07-11 14:38:56.332602 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:38:56.332853 I | rook-ceph-mon0: 2017-07-11 14:38:56.332744 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1215321121' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:38:56.509801 I | rook-ceph-mon0: 2017-07-11 14:38:56.509762 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:56.510105 I | rook-ceph-mon0: 2017-07-11 14:38:56.510083 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1947666107' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:00.523012 I | rook-ceph-mon0: 2017-07-11 14:39:00.522972 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:00.523239 I | rook-ceph-mon0: 2017-07-11 14:39:00.523123 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/210821337' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:00.916487 I | rook-ceph-mon0: 2017-07-11 14:39:00.916447 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:39:00.916691 I | rook-ceph-mon0: 2017-07-11 14:39:00.916674 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/300730954' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:39:03.543843 I | rook-ceph-mon0: 2017-07-11 14:39:03.543802 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:03.544101 I | rook-ceph-mon0: 2017-07-11 14:39:03.543949 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3784491569' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:05.644128 I | rook-ceph-mon0: 2017-07-11 14:39:05.644091 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:05.644310 I | rook-ceph-mon0: 2017-07-11 14:39:05.644229 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/724115030' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:09.924410 I | rook-ceph-mon0: 2017-07-11 14:39:09.924372 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:09.924625 I | rook-ceph-mon0: 2017-07-11 14:39:09.924524 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2604129711' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:10.424016 I | rook-ceph-mon0: 2017-07-11 14:39:10.423957 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:10.424209 I | rook-ceph-mon0: 2017-07-11 14:39:10.424123 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/473828185' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:10.874842 I | rook-ceph-mon0: 2017-07-11 14:39:10.874803 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:39:10.874910 I | rook-ceph-mon0: 2017-07-11 14:39:10.874895 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2023422943' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:39:13.180325 I | rook-ceph-mon0: 2017-07-11 14:39:13.180283 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:13.180548 I | rook-ceph-mon0: 2017-07-11 14:39:13.180506 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3398132740' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:16.318913 I | rook-ceph-mon0: 2017-07-11 14:39:16.318875 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:16.319109 I | rook-ceph-mon0: 2017-07-11 14:39:16.319022 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1963327154' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:17.286496 I | rook-ceph-mon0: 2017-07-11 14:39:17.286452 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:39:17.286759 I | rook-ceph-mon0: 2017-07-11 14:39:17.286705 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2441921726' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:39:18.337406 I | rook-ceph-mon0: 2017-07-11 14:39:18.337367 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:18.337621 I | rook-ceph-mon0: 2017-07-11 14:39:18.337518 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3097130924' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:20.281710 I | rook-ceph-mon0: 2017-07-11 14:39:20.281671 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:20.281927 I | rook-ceph-mon0: 2017-07-11 14:39:20.281893 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/337678741' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:21.702241 I | rook-ceph-mon0: 2017-07-11 14:39:21.701663 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:39:21.702385 I | rook-ceph-mon0: 2017-07-11 14:39:21.702368 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3134255465' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:39:29.589474 I | rook-ceph-mon0: 2017-07-11 14:39:29.589437 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:39:29.589692 I | rook-ceph-mon0: 2017-07-11 14:39:29.589592 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1634357850' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:39:32.729235 I | rook-ceph-mon0: 2017-07-11 14:39:32.729197 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:32.729453 I | rook-ceph-mon0: 2017-07-11 14:39:32.729346 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2607550358' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:32.750806 I | rook-ceph-mon0: 2017-07-11 14:39:32.750782 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:39:32.750971 I | rook-ceph-mon0: 2017-07-11 14:39:32.750896 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4244605211' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:39:35.602730 I | rook-ceph-mon0: 2017-07-11 14:39:35.602696 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0541632s > max 0.05s
- 2017-07-11 14:39:35.606852 I | rook-ceph-mon0: 2017-07-11 14:39:35.606800 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.155999s > max 0.05s
- 2017-07-11 14:39:35.612203 I | rook-ceph-mon0: 2017-07-11 14:39:35.612180 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:39:35.612282 I | rook-ceph-mon0: 2017-07-11 14:39:35.612267 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1989874884' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:39:36.325899 I | rook-ceph-mon0: 2017-07-11 14:39:35.602815 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1379 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0541632s > max 0.05s
- 2017-07-11 14:39:36.325995 I | rook-ceph-mon0: 2017-07-11 14:39:35.606906 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1380 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.155999s > max 0.05s
- 2017-07-11 14:39:39.982012 I | rook-ceph-mon0: 2017-07-11 14:39:39.981973 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:39.982207 I | rook-ceph-mon0: 2017-07-11 14:39:39.982123 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2975186810' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:40.404800 I | rook-ceph-mon0: 2017-07-11 14:39:40.404762 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:39:40.404992 I | rook-ceph-mon0: 2017-07-11 14:39:40.404907 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3808426991' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:39:40.669736 I | rook-ceph-mon0: 2017-07-11 14:39:40.669697 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:39:40.669877 I | rook-ceph-mon0: 2017-07-11 14:39:40.669857 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/166121927' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:39:41.598414 I | rook-ceph-mon0: 2017-07-11 14:39:41.598379 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:39:41.598624 I | rook-ceph-mon0: 2017-07-11 14:39:41.598597 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3846480119' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:39:43.794865 I | rook-ceph-mon0: 2017-07-11 14:39:43.794825 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:39:43.795024 I | rook-ceph-mon0: 2017-07-11 14:39:43.794999 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4067612287' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:39:45.518717 I | rook-ceph-mon0: 2017-07-11 14:39:45.518677 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:39:45.518909 I | rook-ceph-mon0: 2017-07-11 14:39:45.518823 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2629752497' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:39:45.585057 I | rook-ceph-mon0: 2017-07-11 14:39:45.584894 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4824 MB, avail 94362 MB
- 2017-07-11 14:39:50.259419 I | rook-ceph-mon0: 2017-07-11 14:39:50.259379 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:39:50.259628 I | rook-ceph-mon0: 2017-07-11 14:39:50.259526 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2118162757' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:39:50.661133 I | rook-ceph-mon0: 2017-07-11 14:39:50.661094 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:50.661321 I | rook-ceph-mon0: 2017-07-11 14:39:50.661235 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1489403938' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:51.474890 I | rook-ceph-mon0: 2017-07-11 14:39:51.474852 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:39:51.475106 I | rook-ceph-mon0: 2017-07-11 14:39:51.475001 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1894991109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:39:55.017248 I | rook-ceph-mon0: 2017-07-11 14:39:55.017203 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:39:55.017475 I | rook-ceph-mon0: 2017-07-11 14:39:55.017456 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3084842275' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:39:56.036488 I | rook-ceph-mon0: 2017-07-11 14:39:56.036446 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:56.036739 I | rook-ceph-mon0: 2017-07-11 14:39:56.036623 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/55188126' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:56.973441 I | rook-ceph-mon0: 2017-07-11 14:39:56.973403 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:39:56.973526 I | rook-ceph-mon0: 2017-07-11 14:39:56.973508 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1211164353' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:39:59.726664 I | rook-ceph-mon0: 2017-07-11 14:39:59.726615 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:59.726907 I | rook-ceph-mon0: 2017-07-11 14:39:59.726873 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1658844743' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:00.615805 I | rook-ceph-mon0: 2017-07-11 14:40:00.615769 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:00.616053 I | rook-ceph-mon0: 2017-07-11 14:40:00.616020 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3805243146' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:02.613141 I | rook-ceph-mon0: 2017-07-11 14:40:02.613101 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:02.613377 I | rook-ceph-mon0: 2017-07-11 14:40:02.613299 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/356038554' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:05.332825 I | rook-ceph-mon0: 2017-07-11 14:40:05.332744 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:40:05.737303 I | rook-ceph-mon0: 2017-07-11 14:40:05.737266 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:05.737499 I | rook-ceph-mon0: 2017-07-11 14:40:05.737413 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1769964380' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:05.989026 I | rook-ceph-mon0: 2017-07-11 14:40:05.988990 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:40:05.989242 I | rook-ceph-mon0: 2017-07-11 14:40:05.989225 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4244726408' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:40:06.516359 I | rook-ceph-mon0: 2017-07-11 14:40:05.332750 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1397 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:40:10.515835 I | rook-ceph-mon0: 2017-07-11 14:40:10.515799 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:10.516019 I | rook-ceph-mon0: 2017-07-11 14:40:10.515936 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3545956758' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:14.088922 I | rook-ceph-mon0: 2017-07-11 14:40:14.088870 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:14.089021 I | rook-ceph-mon0: 2017-07-11 14:40:14.089005 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1255493238' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:14.492004 I | rook-ceph-mon0: 2017-07-11 14:40:14.491964 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:14.492290 I | rook-ceph-mon0: 2017-07-11 14:40:14.492273 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/907870437' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:15.500724 I | rook-ceph-mon0: 2017-07-11 14:40:15.500686 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:15.500928 I | rook-ceph-mon0: 2017-07-11 14:40:15.500842 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1750415209' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:17.009128 I | rook-ceph-mon0: 2017-07-11 14:40:17.009091 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:40:17.009197 I | rook-ceph-mon0: 2017-07-11 14:40:17.009180 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4089960722' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:40:19.059579 I | rook-ceph-mon0: 2017-07-11 14:40:19.059540 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:19.059802 I | rook-ceph-mon0: 2017-07-11 14:40:19.059690 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1637945744' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:19.968690 I | rook-ceph-mon0: 2017-07-11 14:40:19.968652 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:40:19.968876 I | rook-ceph-mon0: 2017-07-11 14:40:19.968795 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/356566831' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:40:20.393220 I | rook-ceph-mon0: 2017-07-11 14:40:20.393181 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:20.393348 I | rook-ceph-mon0: 2017-07-11 14:40:20.393333 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3116813698' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:23.718774 I | rook-ceph-mon0: 2017-07-11 14:40:23.718677 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #94. Immutable memtables: 0.
- 2017-07-11 14:40:23.718857 I | rook-ceph-mon0:
- 2017-07-11 14:40:23.718876 I | rook-ceph-mon0: 2017-07-11 14:40:23.718715 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 59] Syncing log #91
- 2017-07-11 14:40:23.737423 I | rook-ceph-mon0: 2017-07-11 14:40:23.734357 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:40:23.718709) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:40:23.737491 I | rook-ceph-mon0: 2017-07-11 14:40:23.734369 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 59] Flushing memtable with next log file: 94
- 2017-07-11 14:40:23.737509 I | rook-ceph-mon0:
- 2017-07-11 14:40:23.737523 I | rook-ceph-mon0: 2017-07-11 14:40:23.734379 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784023734375, "job": 59, "event": "flush_started", "num_memtables": 1, "num_entries": 1441, "num_deletes": 254, "memory_usage": 3343752}
- 2017-07-11 14:40:23.737539 I | rook-ceph-mon0: 2017-07-11 14:40:23.734381 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 59] Level-0 flush table #95: started
- 2017-07-11 14:40:23.837447 I | rook-ceph-mon0: 2017-07-11 14:40:23.837401 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784023837391, "cf_name": "default", "job": 59, "event": "table_file_creation", "file_number": 95, "file_size": 2919306, "table_properties": {"data_size": 2909539, "index_size": 8949, "filter_size": 0, "raw_key_size": 12218, "raw_average_key_size": 19, "raw_value_size": 2894607, "raw_average_value_size": 4594, "num_data_blocks": 284, "num_entries": 630, "filter_policy_name": "", "kDeletedKeys": "254", "kMergeOperands": "0"}}
- 2017-07-11 14:40:23.837548 I | rook-ceph-mon0: 2017-07-11 14:40:23.837530 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 59] Level-0 flush table #95: 2919306 bytes OK
- 2017-07-11 14:40:23.940687 I | rook-ceph-mon0: 2017-07-11 14:40:23.940623 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:40:23.916464) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #95 started
- 2017-07-11 14:40:23.940823 I | rook-ceph-mon0: 2017-07-11 14:40:23.940804 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:40:23.940569) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #95: memtable #1 done
- 2017-07-11 14:40:23.940951 I | rook-ceph-mon0: 2017-07-11 14:40:23.940932 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:40:23.940594) EVENT_LOG_v1 {"time_micros": 1499784023940587, "job": 59, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:40:23.940984 I | rook-ceph-mon0: 2017-07-11 14:40:23.940970 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:40:23.940610) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:40:23.941012 I | rook-ceph-mon0:
- 2017-07-11 14:40:23.941046 I | rook-ceph-mon0: 2017-07-11 14:40:23.941033 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 59] Try to delete WAL files size 3314258, prev total WAL file size 3314258, number of live WAL files 2.
- 2017-07-11 14:40:23.941062 I | rook-ceph-mon0:
- 2017-07-11 14:40:23.945413 I | rook-ceph-mon0: 2017-07-11 14:40:23.941734 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:40:23.945490 I | rook-ceph-mon0: 2017-07-11 14:40:23.941778 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:40:23.941772) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:40:23.945528 I | rook-ceph-mon0:
- 2017-07-11 14:40:23.945543 I | rook-ceph-mon0: 2017-07-11 14:40:23.941783 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 60] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:40:23.945556 I | rook-ceph-mon0: 2017-07-11 14:40:23.941788 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 59 Base level 0, inputs: [95(2850KB)], [93(13MB)]
- 2017-07-11 14:40:23.945569 I | rook-ceph-mon0:
- 2017-07-11 14:40:23.945580 I | rook-ceph-mon0: 2017-07-11 14:40:23.941799 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784023941791, "job": 60, "event": "compaction_started", "files_L0": [95], "files_L1": [93], "score": -1, "input_data_size": 17516378}
- 2017-07-11 14:40:24.192028 I | rook-ceph-mon0: 2017-07-11 14:40:24.191976 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 60] Generated table #96: 2284 keys, 16229102 bytes
- 2017-07-11 14:40:24.192094 I | rook-ceph-mon0: 2017-07-11 14:40:24.192074 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784024192064, "cf_name": "default", "job": 60, "event": "table_file_creation", "file_number": 96, "file_size": 16229102, "table_properties": {"data_size": 16177120, "index_size": 51163, "filter_size": 0, "raw_key_size": 43701, "raw_average_key_size": 19, "raw_value_size": 16109509, "raw_average_value_size": 7053, "num_data_blocks": 1573, "num_entries": 2284, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:40:24.223722 I | rook-ceph-mon0: 2017-07-11 14:40:24.223666 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 60] Compacted 1@0 + 1@1 files to L1 => 16229102 bytes
- 2017-07-11 14:40:24.281002 I | rook-ceph-mon0: 2017-07-11 14:40:24.280949 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:40:24.280863) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 62.1 rd, 57.6 wr, level 1, files in(1, 1) out(1) MB in(2.8, 13.9) out(15.5), read-write-amplify(11.6) write-amplify(5.6) OK, records in: 2740, records dropped: 456
- 2017-07-11 14:40:24.281022 I | rook-ceph-mon0:
- 2017-07-11 14:40:24.281054 I | rook-ceph-mon0: 2017-07-11 14:40:24.281038 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:40:24.280891) EVENT_LOG_v1 {"time_micros": 1499784024280881, "job": 60, "event": "compaction_finished", "compaction_time_micros": 281843, "output_level": 1, "num_output_files": 1, "total_output_size": 16229102, "num_input_records": 2740, "num_output_records": 2284, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:40:24.281579 I | rook-ceph-mon0: 2017-07-11 14:40:24.281563 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784024281560, "job": 60, "event": "table_file_deletion", "file_number": 95}
- 2017-07-11 14:40:24.283572 I | rook-ceph-mon0: 2017-07-11 14:40:24.283557 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784024283554, "job": 60, "event": "table_file_deletion", "file_number": 93}
- 2017-07-11 14:40:24.283619 I | rook-ceph-mon0: 2017-07-11 14:40:24.283604 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:40:25.471484 I | rook-ceph-mon0: 2017-07-11 14:40:25.471433 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:25.471678 I | rook-ceph-mon0: 2017-07-11 14:40:25.471590 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1842511519' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:26.286748 I | rook-ceph-mon0: 2017-07-11 14:40:26.286706 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:40:26.286872 I | rook-ceph-mon0: 2017-07-11 14:40:26.286806 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3174129357' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:40:28.106674 I | rook-ceph-mon0: 2017-07-11 14:40:28.106636 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:40:28.106872 I | rook-ceph-mon0: 2017-07-11 14:40:28.106785 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/373665259' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:40:31.706732 I | rook-ceph-mon0: 2017-07-11 14:40:31.706626 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #97. Immutable memtables: 0.
- 2017-07-11 14:40:31.706818 I | rook-ceph-mon0:
- 2017-07-11 14:40:31.706834 I | rook-ceph-mon0: 2017-07-11 14:40:31.706666 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 61] Syncing log #94
- 2017-07-11 14:40:31.721870 I | rook-ceph-mon0: 2017-07-11 14:40:31.721278 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:40:31.706660) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:40:31.721923 I | rook-ceph-mon0: 2017-07-11 14:40:31.721287 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 61] Flushing memtable with next log file: 97
- 2017-07-11 14:40:31.721940 I | rook-ceph-mon0:
- 2017-07-11 14:40:31.721953 I | rook-ceph-mon0: 2017-07-11 14:40:31.721296 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784031721292, "job": 61, "event": "flush_started", "num_memtables": 1, "num_entries": 328, "num_deletes": 251, "memory_usage": 224248}
- 2017-07-11 14:40:31.721964 I | rook-ceph-mon0: 2017-07-11 14:40:31.721298 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 61] Level-0 flush table #98: started
- 2017-07-11 14:40:31.768846 I | rook-ceph-mon0: 2017-07-11 14:40:31.768733 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784031768722, "cf_name": "default", "job": 61, "event": "table_file_creation", "file_number": 98, "file_size": 215737, "table_properties": {"data_size": 214220, "index_size": 703, "filter_size": 0, "raw_key_size": 5215, "raw_average_key_size": 18, "raw_value_size": 209927, "raw_average_value_size": 736, "num_data_blocks": 23, "num_entries": 285, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:40:31.768973 I | rook-ceph-mon0: 2017-07-11 14:40:31.768746 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 61] Level-0 flush table #98: 215737 bytes OK
- 2017-07-11 14:40:31.802085 I | rook-ceph-mon0: 2017-07-11 14:40:31.801887 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:40:31.784571) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #98 started
- 2017-07-11 14:40:31.802167 I | rook-ceph-mon0: 2017-07-11 14:40:31.801899 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:40:31.801836) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #98: memtable #1 done
- 2017-07-11 14:40:31.802184 I | rook-ceph-mon0: 2017-07-11 14:40:31.801900 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:40:31.801858) EVENT_LOG_v1 {"time_micros": 1499784031801852, "job": 61, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:40:31.802214 I | rook-ceph-mon0: 2017-07-11 14:40:31.801902 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:40:31.801875) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:40:31.802233 I | rook-ceph-mon0:
- 2017-07-11 14:40:31.802246 I | rook-ceph-mon0: 2017-07-11 14:40:31.801907 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 61] Try to delete WAL files size 214981, prev total WAL file size 214981, number of live WAL files 2.
- 2017-07-11 14:40:31.802257 I | rook-ceph-mon0:
- 2017-07-11 14:40:31.804884 I | rook-ceph-mon0: 2017-07-11 14:40:31.802293 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:40:31.804920 I | rook-ceph-mon0: 2017-07-11 14:40:31.802328 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:40:31.802322) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:40:31.804947 I | rook-ceph-mon0:
- 2017-07-11 14:40:31.804961 I | rook-ceph-mon0: 2017-07-11 14:40:31.802332 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 62] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:40:31.804972 I | rook-ceph-mon0: 2017-07-11 14:40:31.802337 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 61 Base level 0, inputs: [98(210KB)], [96(15MB)]
- 2017-07-11 14:40:31.804984 I | rook-ceph-mon0:
- 2017-07-11 14:40:31.805011 I | rook-ceph-mon0: 2017-07-11 14:40:31.802347 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784031802339, "job": 62, "event": "compaction_started", "files_L0": [98], "files_L1": [96], "score": -1, "input_data_size": 16444839}
- 2017-07-11 14:40:31.976091 I | rook-ceph-mon0: 2017-07-11 14:40:31.975977 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 62] Generated table #99: 2060 keys, 13903472 bytes
- 2017-07-11 14:40:31.976348 I | rook-ceph-mon0: 2017-07-11 14:40:31.976280 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784031976206, "cf_name": "default", "job": 62, "event": "table_file_creation", "file_number": 99, "file_size": 13903472, "table_properties": {"data_size": 13858534, "index_size": 44119, "filter_size": 0, "raw_key_size": 39695, "raw_average_key_size": 19, "raw_value_size": 13798842, "raw_average_value_size": 6698, "num_data_blocks": 1344, "num_entries": 2060, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:40:32.021543 I | rook-ceph-mon0: 2017-07-11 14:40:32.021481 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 62] Compacted 1@0 + 1@1 files to L1 => 13903472 bytes
- 2017-07-11 14:40:32.037025 I | rook-ceph-mon0: 2017-07-11 14:40:32.036984 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:40:32.036898) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 75.1 rd, 63.5 wr, level 1, files in(1, 1) out(1) MB in(0.2, 15.5) out(13.3), read-write-amplify(140.7) write-amplify(64.4) OK, records in: 2569, records dropped: 509
- 2017-07-11 14:40:32.037104 I | rook-ceph-mon0:
- 2017-07-11 14:40:32.037160 I | rook-ceph-mon0: 2017-07-11 14:40:32.037124 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:40:32.036924) EVENT_LOG_v1 {"time_micros": 1499784032036915, "job": 62, "event": "compaction_finished", "compaction_time_micros": 219111, "output_level": 1, "num_output_files": 1, "total_output_size": 13903472, "num_input_records": 2569, "num_output_records": 2060, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:40:32.037416 I | rook-ceph-mon0: 2017-07-11 14:40:32.037400 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784032037397, "job": 62, "event": "table_file_deletion", "file_number": 98}
- 2017-07-11 14:40:32.039438 I | rook-ceph-mon0: 2017-07-11 14:40:32.039418 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784032039416, "job": 62, "event": "table_file_deletion", "file_number": 96}
- 2017-07-11 14:40:33.791393 I | rook-ceph-mon0: 2017-07-11 14:40:33.791357 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:33.791567 I | rook-ceph-mon0: 2017-07-11 14:40:33.791489 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3423748931' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:34.209317 I | rook-ceph-mon0: 2017-07-11 14:40:34.209278 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:34.209391 I | rook-ceph-mon0: 2017-07-11 14:40:34.209370 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3848719277' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:36.974176 I | rook-ceph-mon0: 2017-07-11 14:40:36.974137 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:36.974390 I | rook-ceph-mon0: 2017-07-11 14:40:36.974296 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2186659570' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:40.164411 I | rook-ceph-mon0: 2017-07-11 14:40:40.164371 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:40:40.164621 I | rook-ceph-mon0: 2017-07-11 14:40:40.164519 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2949815971' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:40:41.385783 I | rook-ceph-mon0: 2017-07-11 14:40:41.385736 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:40:41.385863 I | rook-ceph-mon0: 2017-07-11 14:40:41.385847 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/862580390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:40:42.295752 I | rook-ceph-mon0: 2017-07-11 14:40:42.295714 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:42.295963 I | rook-ceph-mon0: 2017-07-11 14:40:42.295863 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3448276288' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:43.673072 I | rook-ceph-mon0: 2017-07-11 14:40:43.673032 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:43.673291 I | rook-ceph-mon0: 2017-07-11 14:40:43.673184 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3617488969' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:45.585279 I | rook-ceph-mon0: 2017-07-11 14:40:45.585142 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4823 MB, avail 94363 MB
- 2017-07-11 14:40:47.175519 I | rook-ceph-mon0: 2017-07-11 14:40:47.175481 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:47.175970 I | rook-ceph-mon0: 2017-07-11 14:40:47.175871 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3724014509' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:48.595739 I | rook-ceph-mon0: 2017-07-11 14:40:48.595700 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:48.595955 I | rook-ceph-mon0: 2017-07-11 14:40:48.595859 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3728046578' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:49.011332 I | rook-ceph-mon0: 2017-07-11 14:40:49.011291 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:49.011539 I | rook-ceph-mon0: 2017-07-11 14:40:49.011458 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3091564382' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:53.936919 I | rook-ceph-mon0: 2017-07-11 14:40:53.936880 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:53.937149 I | rook-ceph-mon0: 2017-07-11 14:40:53.937110 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1749836895' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:54.356894 I | rook-ceph-mon0: 2017-07-11 14:40:54.356856 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:40:54.357589 I | rook-ceph-mon0: 2017-07-11 14:40:54.357507 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1391539359' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:40:55.885799 I | rook-ceph-mon0: 2017-07-11 14:40:55.885760 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:40:55.886038 I | rook-ceph-mon0: 2017-07-11 14:40:55.886006 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/219935772' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:40:58.363710 I | rook-ceph-mon0: 2017-07-11 14:40:58.363670 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:40:58.363931 I | rook-ceph-mon0: 2017-07-11 14:40:58.363902 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1701725882' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:40:59.386597 I | rook-ceph-mon0: 2017-07-11 14:40:59.386559 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:40:59.386792 I | rook-ceph-mon0: 2017-07-11 14:40:59.386705 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/915015231' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:41:00.755358 I | rook-ceph-mon0: 2017-07-11 14:41:00.755321 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:41:00.755570 I | rook-ceph-mon0: 2017-07-11 14:41:00.755537 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3836516682' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:41:01.596415 I | rook-ceph-mon0: 2017-07-11 14:41:01.596379 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:01.596483 I | rook-ceph-mon0: 2017-07-11 14:41:01.596467 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2199656715' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:03.323285 I | rook-ceph-mon0: 2017-07-11 14:41:03.323245 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:03.323504 I | rook-ceph-mon0: 2017-07-11 14:41:03.323399 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/910326306' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:05.711327 I | rook-ceph-mon0: 2017-07-11 14:41:05.711289 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"} v 0) v1
- 2017-07-11 14:41:05.711544 I | rook-ceph-mon0: 2017-07-11 14:41:05.711433 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.5776 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:41:06.390313 I | rook-ceph-mon0: 2017-07-11 14:41:05.711585 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1429 : audit [INF] from='client.5776 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:41:06.390444 I | rook-ceph-mon0: 2017-07-11 14:41:05.856584 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 1016 : audit [INF] from='client.? 10.233.99.0:0/2415758692' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:41:08.726940 I | rook-ceph-mon0: 2017-07-11 14:41:08.726905 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:08.727047 I | rook-ceph-mon0: 2017-07-11 14:41:08.727031 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2916773591' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:09.160726 I | rook-ceph-mon0: 2017-07-11 14:41:09.160687 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:41:09.160916 I | rook-ceph-mon0: 2017-07-11 14:41:09.160832 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1413792697' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:41:09.397917 I | rook-ceph-mon0: 2017-07-11 14:41:09.397876 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:09.398180 I | rook-ceph-mon0: 2017-07-11 14:41:09.398159 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1735374455' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:13.261033 I | rook-ceph-mon0: 2017-07-11 14:41:13.260994 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:13.261241 I | rook-ceph-mon0: 2017-07-11 14:41:13.261143 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2169952233' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:13.674084 I | rook-ceph-mon0: 2017-07-11 14:41:13.674047 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:13.674323 I | rook-ceph-mon0: 2017-07-11 14:41:13.674295 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3798476434' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:14.090468 I | rook-ceph-mon0: 2017-07-11 14:41:14.090430 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:41:14.090657 I | rook-ceph-mon0: 2017-07-11 14:41:14.090578 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2067294502' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:41:18.170923 I | rook-ceph-mon0: 2017-07-11 14:41:18.170884 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:18.171138 I | rook-ceph-mon0: 2017-07-11 14:41:18.171032 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2687549393' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:19.447485 I | rook-ceph-mon0: 2017-07-11 14:41:19.447448 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:19.447691 I | rook-ceph-mon0: 2017-07-11 14:41:19.447588 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4277825440' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:23.543889 I | rook-ceph-mon0: 2017-07-11 14:41:23.543836 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:23.544094 I | rook-ceph-mon0: 2017-07-11 14:41:23.544000 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3378719716' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:24.329814 I | rook-ceph-mon0: 2017-07-11 14:41:24.329765 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:24.330073 I | rook-ceph-mon0: 2017-07-11 14:41:24.329992 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3712470023' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:25.189845 I | rook-ceph-mon0: 2017-07-11 14:41:25.189801 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:41:25.190059 I | rook-ceph-mon0: 2017-07-11 14:41:25.190025 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4261280137' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:41:28.117515 I | rook-ceph-mon0: 2017-07-11 14:41:28.117476 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:28.117710 I | rook-ceph-mon0: 2017-07-11 14:41:28.117626 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2296617866' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:29.287702 I | rook-ceph-mon0: 2017-07-11 14:41:29.287663 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:29.287898 I | rook-ceph-mon0: 2017-07-11 14:41:29.287813 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3253250281' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:31.652127 I | rook-ceph-mon0: 2017-07-11 14:41:31.652089 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:31.652265 I | rook-ceph-mon0: 2017-07-11 14:41:31.652247 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1501749121' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:35.342029 I | rook-ceph-mon0: 2017-07-11 14:41:35.341991 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:35.342250 I | rook-ceph-mon0: 2017-07-11 14:41:35.342137 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3534082923' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:36.215070 I | rook-ceph-mon0: 2017-07-11 14:41:36.215021 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:36.215291 I | rook-ceph-mon0: 2017-07-11 14:41:36.215204 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2294459000' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:39.153379 I | rook-ceph-mon0: 2017-07-11 14:41:39.153342 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:39.153589 I | rook-ceph-mon0: 2017-07-11 14:41:39.153488 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3414009085' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:39.744282 I | rook-ceph-mon0: 2017-07-11 14:41:39.744240 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:39.744506 I | rook-ceph-mon0: 2017-07-11 14:41:39.744394 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3841306580' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:41.848414 I | rook-ceph-mon0: 2017-07-11 14:41:41.848374 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:41:41.848487 I | rook-ceph-mon0: 2017-07-11 14:41:41.848471 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/748024677' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:41:44.703954 I | rook-ceph-mon0: 2017-07-11 14:41:44.703916 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:44.704023 I | rook-ceph-mon0: 2017-07-11 14:41:44.704008 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3299470132' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:45.585600 I | rook-ceph-mon0: 2017-07-11 14:41:45.585432 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4823 MB, avail 94363 MB
- 2017-07-11 14:41:46.300733 I | rook-ceph-mon0: 2017-07-11 14:41:46.300673 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:46.300963 I | rook-ceph-mon0: 2017-07-11 14:41:46.300843 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2340880930' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:48.234276 I | rook-ceph-mon0: 2017-07-11 14:41:48.234237 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:48.234494 I | rook-ceph-mon0: 2017-07-11 14:41:48.234385 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3178527156' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:49.587567 I | rook-ceph-mon0: 2017-07-11 14:41:49.587529 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:49.587761 I | rook-ceph-mon0: 2017-07-11 14:41:49.587675 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1849674099' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:50.205244 I | rook-ceph-mon0: 2017-07-11 14:41:50.205204 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:50.205516 I | rook-ceph-mon0: 2017-07-11 14:41:50.205432 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1576842400' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:53.002871 I | rook-ceph-mon0: 2017-07-11 14:41:53.002792 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:53.003059 I | rook-ceph-mon0: 2017-07-11 14:41:53.002984 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2887919997' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:55.479697 I | rook-ceph-mon0: 2017-07-11 14:41:55.479651 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:41:55.479891 I | rook-ceph-mon0: 2017-07-11 14:41:55.479805 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1297659892' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:41:56.911332 I | rook-ceph-mon0: 2017-07-11 14:41:56.911295 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:41:56.911548 I | rook-ceph-mon0: 2017-07-11 14:41:56.911513 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/780346329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:41:57.753657 I | rook-ceph-mon0: 2017-07-11 14:41:57.753620 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:57.753728 I | rook-ceph-mon0: 2017-07-11 14:41:57.753712 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3617557223' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:00.498368 I | rook-ceph-mon0: 2017-07-11 14:42:00.498331 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:42:00.498557 I | rook-ceph-mon0: 2017-07-11 14:42:00.498475 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/639048491' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:42:01.303447 I | rook-ceph-mon0: 2017-07-11 14:42:01.303408 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:01.303653 I | rook-ceph-mon0: 2017-07-11 14:42:01.303556 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2624755538' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:01.774299 I | rook-ceph-mon0: 2017-07-11 14:42:01.774261 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:42:01.774370 I | rook-ceph-mon0: 2017-07-11 14:42:01.774355 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1204978741' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:42:02.645429 I | rook-ceph-mon0: 2017-07-11 14:42:02.645389 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:02.645623 I | rook-ceph-mon0: 2017-07-11 14:42:02.645540 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3517017781' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:04.439703 I | rook-ceph-mon0: 2017-07-11 14:42:04.439664 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:04.439915 I | rook-ceph-mon0: 2017-07-11 14:42:04.439815 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3501462606' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:04.930903 I | rook-ceph-mon0: 2017-07-11 14:42:04.930853 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:04.930973 I | rook-ceph-mon0: 2017-07-11 14:42:04.930958 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4018153424' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:05.252940 I | rook-ceph-mon0: 2017-07-11 14:42:05.252904 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:42:05.253130 I | rook-ceph-mon0: 2017-07-11 14:42:05.253036 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1854962721' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:42:05.809726 I | rook-ceph-mon0: 2017-07-11 14:42:05.809688 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:05.809940 I | rook-ceph-mon0: 2017-07-11 14:42:05.809838 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1727366551' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:08.669727 I | rook-ceph-mon0: 2017-07-11 14:42:08.669688 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:08.669946 I | rook-ceph-mon0: 2017-07-11 14:42:08.669837 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3192709720' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:09.906111 I | rook-ceph-mon0: 2017-07-11 14:42:09.906075 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:09.906309 I | rook-ceph-mon0: 2017-07-11 14:42:09.906221 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3824787127' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:10.406365 I | rook-ceph-mon0: 2017-07-11 14:42:10.406326 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:42:10.406559 I | rook-ceph-mon0: 2017-07-11 14:42:10.406473 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/293488948' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:42:12.388196 I | rook-ceph-mon0: 2017-07-11 14:42:12.388159 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:12.388392 I | rook-ceph-mon0: 2017-07-11 14:42:12.388305 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1154342262' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:14.725376 I | rook-ceph-mon0: 2017-07-11 14:42:14.725339 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:14.725572 I | rook-ceph-mon0: 2017-07-11 14:42:14.725486 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/602138188' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:15.551035 I | rook-ceph-mon0: 2017-07-11 14:42:15.550983 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:15.551432 I | rook-ceph-mon0: 2017-07-11 14:42:15.551414 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1797325011' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:15.956487 I | rook-ceph-mon0: 2017-07-11 14:42:15.956442 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:15.956608 I | rook-ceph-mon0: 2017-07-11 14:42:15.956591 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/676067031' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:19.622547 I | rook-ceph-mon0: 2017-07-11 14:42:19.622506 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:19.622774 I | rook-ceph-mon0: 2017-07-11 14:42:19.622734 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2804005387' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:19.699472 I | rook-ceph-mon0: 2017-07-11 14:42:19.699432 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:19.699599 I | rook-ceph-mon0: 2017-07-11 14:42:19.699583 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/650113190' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:20.032408 I | rook-ceph-mon0: 2017-07-11 14:42:20.032369 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:42:20.032616 I | rook-ceph-mon0: 2017-07-11 14:42:20.032513 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3792848749' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:42:22.210896 I | rook-ceph-mon0: 2017-07-11 14:42:22.210857 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:22.211111 I | rook-ceph-mon0: 2017-07-11 14:42:22.211006 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/779630765' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:23.613596 I | rook-ceph-mon0: 2017-07-11 14:42:23.613543 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:23.613846 I | rook-ceph-mon0: 2017-07-11 14:42:23.613827 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3878597455' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:24.625089 I | rook-ceph-mon0: 2017-07-11 14:42:24.625042 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:24.625214 I | rook-ceph-mon0: 2017-07-11 14:42:24.625198 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1619729081' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:25.437753 I | rook-ceph-mon0: 2017-07-11 14:42:25.437713 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:25.437974 I | rook-ceph-mon0: 2017-07-11 14:42:25.437943 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2450057032' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:26.423787 I | rook-ceph-mon0: 2017-07-11 14:42:26.423750 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:42:26.424032 I | rook-ceph-mon0: 2017-07-11 14:42:26.423964 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3521338171' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:42:30.024589 I | rook-ceph-mon0: 2017-07-11 14:42:30.019175 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:42:30.025036 I | rook-ceph-mon0: 2017-07-11 14:42:30.024687 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3809429966' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:42:30.887189 I | rook-ceph-mon0: 2017-07-11 14:42:30.886947 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:30.887293 I | rook-ceph-mon0: 2017-07-11 14:42:30.886979 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3198154918' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:32.186112 I | rook-ceph-mon0: 2017-07-11 14:42:32.186064 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:32.186339 I | rook-ceph-mon0: 2017-07-11 14:42:32.186299 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4247213226' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:34.001083 I | rook-ceph-mon0: 2017-07-11 14:42:34.001048 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:34.001729 I | rook-ceph-mon0: 2017-07-11 14:42:34.001277 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2829625294' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:34.614623 I | rook-ceph-mon0: 2017-07-11 14:42:34.614587 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:34.614727 I | rook-ceph-mon0: 2017-07-11 14:42:34.614711 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1436937315' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:36.499963 I | rook-ceph-mon0: 2017-07-11 14:42:36.499929 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:42:36.500449 I | rook-ceph-mon0: 2017-07-11 14:42:36.500429 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3315947558' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:42:42.054516 I | rook-ceph-mon0: 2017-07-11 14:42:42.054479 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:42.054604 I | rook-ceph-mon0: 2017-07-11 14:42:42.054590 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/659525903' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:45.585962 I | rook-ceph-mon0: 2017-07-11 14:42:45.585693 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4823 MB, avail 94363 MB
- 2017-07-11 14:42:45.659373 I | rook-ceph-mon0: 2017-07-11 14:42:45.659335 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:45.659564 I | rook-ceph-mon0: 2017-07-11 14:42:45.659482 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3558250668' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:47.272780 I | rook-ceph-mon0: 2017-07-11 14:42:47.272741 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:47.273010 I | rook-ceph-mon0: 2017-07-11 14:42:47.272993 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3045442758' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:49.116397 I | rook-ceph-mon0: 2017-07-11 14:42:49.116361 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:49.116601 I | rook-ceph-mon0: 2017-07-11 14:42:49.116503 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2697857173' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:53.067134 I | rook-ceph-mon0: 2017-07-11 14:42:53.067096 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:53.067201 I | rook-ceph-mon0: 2017-07-11 14:42:53.067186 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1021697304' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:53.775417 I | rook-ceph-mon0: 2017-07-11 14:42:53.775378 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:53.775644 I | rook-ceph-mon0: 2017-07-11 14:42:53.775626 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/565896620' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:54.686633 I | rook-ceph-mon0: 2017-07-11 14:42:54.686595 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:42:54.686852 I | rook-ceph-mon0: 2017-07-11 14:42:54.686735 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1337145331' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:42:56.931896 I | rook-ceph-mon0: 2017-07-11 14:42:56.931858 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:56.932131 I | rook-ceph-mon0: 2017-07-11 14:42:56.932004 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2888698634' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:59.244930 I | rook-ceph-mon0: 2017-07-11 14:42:59.244884 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:59.245125 I | rook-ceph-mon0: 2017-07-11 14:42:59.245036 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3918505975' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:00.322308 I | rook-ceph-mon0: 2017-07-11 14:43:00.322266 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:00.322543 I | rook-ceph-mon0: 2017-07-11 14:43:00.322526 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1535400089' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:01.005651 I | rook-ceph-mon0: 2017-07-11 14:43:01.005474 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:43:01.006594 I | rook-ceph-mon0: 2017-07-11 14:43:01.006503 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3293152050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:43:04.128346 I | rook-ceph-mon0: 2017-07-11 14:43:04.128308 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:04.128536 I | rook-ceph-mon0: 2017-07-11 14:43:04.128451 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1611116347' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:04.471791 I | rook-ceph-mon0: 2017-07-11 14:43:04.471753 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:43:04.471924 I | rook-ceph-mon0: 2017-07-11 14:43:04.471909 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/839349952' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:43:04.876763 I | rook-ceph-mon0: 2017-07-11 14:43:04.876722 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:04.876976 I | rook-ceph-mon0: 2017-07-11 14:43:04.876876 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/97277899' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:08.508111 I | rook-ceph-mon0: 2017-07-11 14:43:08.508072 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:08.508359 I | rook-ceph-mon0: 2017-07-11 14:43:08.508320 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3379645389' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:08.934906 I | rook-ceph-mon0: 2017-07-11 14:43:08.934865 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:08.935122 I | rook-ceph-mon0: 2017-07-11 14:43:08.935014 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1816920586' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:11.374354 I | rook-ceph-mon0: 2017-07-11 14:43:11.374304 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:11.374589 I | rook-ceph-mon0: 2017-07-11 14:43:11.374547 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/95097759' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:14.295270 I | rook-ceph-mon0: 2017-07-11 14:43:14.295232 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:43:14.295509 I | rook-ceph-mon0: 2017-07-11 14:43:14.295377 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1945786525' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:43:14.718066 I | rook-ceph-mon0: 2017-07-11 14:43:14.718030 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:14.718263 I | rook-ceph-mon0: 2017-07-11 14:43:14.718169 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3873774527' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:19.644293 I | rook-ceph-mon0: 2017-07-11 14:43:19.644255 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:19.644486 I | rook-ceph-mon0: 2017-07-11 14:43:19.644401 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4052671310' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:23.306968 I | rook-ceph-mon0: 2017-07-11 14:43:23.306928 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:23.307196 I | rook-ceph-mon0: 2017-07-11 14:43:23.307178 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3048908418' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:25.562184 I | rook-ceph-mon0: 2017-07-11 14:43:25.562145 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:43:25.562418 I | rook-ceph-mon0: 2017-07-11 14:43:25.562379 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/182314516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:43:26.197697 I | rook-ceph-mon0: 2017-07-11 14:43:26.197660 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:26.197905 I | rook-ceph-mon0: 2017-07-11 14:43:26.197806 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3492877040' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:28.441735 I | rook-ceph-mon0: 2017-07-11 14:43:28.441697 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:28.441804 I | rook-ceph-mon0: 2017-07-11 14:43:28.441788 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/279875495' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:28.836181 I | rook-ceph-mon0: 2017-07-11 14:43:28.836123 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:28.836427 I | rook-ceph-mon0: 2017-07-11 14:43:28.836390 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2791782954' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:31.409774 I | rook-ceph-mon0: 2017-07-11 14:43:31.409729 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:31.410010 I | rook-ceph-mon0: 2017-07-11 14:43:31.409913 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1721131303' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:33.606337 I | rook-ceph-mon0: 2017-07-11 14:43:33.606296 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:33.606585 I | rook-ceph-mon0: 2017-07-11 14:43:33.606568 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/180976482' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:33.658235 I | rook-ceph-mon0: 2017-07-11 14:43:33.658197 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:33.658462 I | rook-ceph-mon0: 2017-07-11 14:43:33.658421 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/217737573' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:35.274326 I | rook-ceph-mon0: 2017-07-11 14:43:35.274288 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:43:35.274594 I | rook-ceph-mon0: 2017-07-11 14:43:35.274450 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/646659626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:43:36.164093 I | rook-ceph-mon0: 2017-07-11 14:43:36.164056 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:36.164310 I | rook-ceph-mon0: 2017-07-11 14:43:36.164203 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2754556024' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:37.297332 I | rook-ceph-mon0: 2017-07-11 14:43:37.297289 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:37.297399 I | rook-ceph-mon0: 2017-07-11 14:43:37.297385 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1364048048' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:38.490416 I | rook-ceph-mon0: 2017-07-11 14:43:38.490377 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:38.490483 I | rook-ceph-mon0: 2017-07-11 14:43:38.490468 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2074051109' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:40.261977 I | rook-ceph-mon0: 2017-07-11 14:43:40.261938 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:43:40.262210 I | rook-ceph-mon0: 2017-07-11 14:43:40.262171 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/384762096' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:43:41.091330 I | rook-ceph-mon0: 2017-07-11 14:43:41.091291 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:41.091520 I | rook-ceph-mon0: 2017-07-11 14:43:41.091434 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1037655095' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:41.476914 I | rook-ceph-mon0: 2017-07-11 14:43:41.476877 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:41.477046 I | rook-ceph-mon0: 2017-07-11 14:43:41.477031 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3321283171' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:43.904346 I | rook-ceph-mon0: 2017-07-11 14:43:43.904310 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:43:43.904521 I | rook-ceph-mon0: 2017-07-11 14:43:43.904444 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1210258971' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:43:43.968050 I | rook-ceph-mon0: 2017-07-11 14:43:43.967959 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #100. Immutable memtables: 0.
- 2017-07-11 14:43:43.968123 I | rook-ceph-mon0:
- 2017-07-11 14:43:43.968141 I | rook-ceph-mon0: 2017-07-11 14:43:43.967985 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 63] Syncing log #97
- 2017-07-11 14:43:44.094794 I | rook-ceph-mon0: 2017-07-11 14:43:44.090733 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:43:43.967980) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:43:44.094880 I | rook-ceph-mon0: 2017-07-11 14:43:44.090745 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 63] Flushing memtable with next log file: 100
- 2017-07-11 14:43:44.094896 I | rook-ceph-mon0:
- 2017-07-11 14:43:44.094911 I | rook-ceph-mon0: 2017-07-11 14:43:44.090756 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224090751, "job": 63, "event": "flush_started", "num_memtables": 1, "num_entries": 2275, "num_deletes": 508, "memory_usage": 5014800}
- 2017-07-11 14:43:44.094924 I | rook-ceph-mon0: 2017-07-11 14:43:44.090758 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 63] Level-0 flush table #101: started
- 2017-07-11 14:43:44.148541 I | rook-ceph-mon0: 2017-07-11 14:43:44.148491 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224148481, "cf_name": "default", "job": 63, "event": "table_file_creation", "file_number": 101, "file_size": 4952867, "table_properties": {"data_size": 4935718, "index_size": 16330, "filter_size": 0, "raw_key_size": 22211, "raw_average_key_size": 19, "raw_value_size": 4908620, "raw_average_value_size": 4257, "num_data_blocks": 511, "num_entries": 1153, "filter_policy_name": "", "kDeletedKeys": "508", "kMergeOperands": "0"}}
- 2017-07-11 14:43:44.148675 I | rook-ceph-mon0: 2017-07-11 14:43:44.148647 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 63] Level-0 flush table #101: 4952867 bytes OK
- 2017-07-11 14:43:44.192325 I | rook-ceph-mon0: 2017-07-11 14:43:44.192288 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.177349) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #101 started
- 2017-07-11 14:43:44.192422 I | rook-ceph-mon0: 2017-07-11 14:43:44.192396 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.192237) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #101: memtable #1 done
- 2017-07-11 14:43:44.192493 I | rook-ceph-mon0: 2017-07-11 14:43:44.192467 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.192255) EVENT_LOG_v1 {"time_micros": 1499784224192249, "job": 63, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:43:44.192524 I | rook-ceph-mon0: 2017-07-11 14:43:44.192512 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.192270) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:43:44.192552 I | rook-ceph-mon0:
- 2017-07-11 14:43:44.192583 I | rook-ceph-mon0: 2017-07-11 14:43:44.192572 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 63] Try to delete WAL files size 4963111, prev total WAL file size 4963111, number of live WAL files 2.
- 2017-07-11 14:43:44.192596 I | rook-ceph-mon0:
- 2017-07-11 14:43:44.194782 I | rook-ceph-mon0: 2017-07-11 14:43:44.193399 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:43:44.194837 I | rook-ceph-mon0: 2017-07-11 14:43:44.193434 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.193429) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:43:44.194856 I | rook-ceph-mon0:
- 2017-07-11 14:43:44.194868 I | rook-ceph-mon0: 2017-07-11 14:43:44.193439 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 64] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:43:44.194895 I | rook-ceph-mon0: 2017-07-11 14:43:44.193444 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 63 Base level 0, inputs: [101(4836KB)], [99(13MB)]
- 2017-07-11 14:43:44.194909 I | rook-ceph-mon0:
- 2017-07-11 14:43:44.194920 I | rook-ceph-mon0: 2017-07-11 14:43:44.193453 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224193446, "job": 64, "event": "compaction_started", "files_L0": [101], "files_L1": [99], "score": -1, "input_data_size": 18856339}
- 2017-07-11 14:43:44.430693 I | rook-ceph-mon0: 2017-07-11 14:43:44.430632 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 64] Generated table #102: 2190 keys, 15738949 bytes
- 2017-07-11 14:43:44.430904 I | rook-ceph-mon0: 2017-07-11 14:43:44.430824 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224430813, "cf_name": "default", "job": 64, "event": "table_file_creation", "file_number": 102, "file_size": 15738949, "table_properties": {"data_size": 15687416, "index_size": 50714, "filter_size": 0, "raw_key_size": 41910, "raw_average_key_size": 19, "raw_value_size": 15621416, "raw_average_value_size": 7133, "num_data_blocks": 1564, "num_entries": 2190, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:43:44.461698 I | rook-ceph-mon0: 2017-07-11 14:43:44.461661 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 64] Compacted 1@0 + 1@1 files to L1 => 15738949 bytes
- 2017-07-11 14:43:44.476600 I | rook-ceph-mon0: 2017-07-11 14:43:44.476567 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.476487) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 70.3 rd, 58.7 wr, level 1, files in(1, 1) out(1) MB in(4.7, 13.3) out(15.0), read-write-amplify(7.0) write-amplify(3.2) OK, records in: 3213, records dropped: 1023
- 2017-07-11 14:43:44.476653 I | rook-ceph-mon0:
- 2017-07-11 14:43:44.476690 I | rook-ceph-mon0: 2017-07-11 14:43:44.476672 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.476508) EVENT_LOG_v1 {"time_micros": 1499784224476500, "job": 64, "event": "compaction_finished", "compaction_time_micros": 268189, "output_level": 1, "num_output_files": 1, "total_output_size": 15738949, "num_input_records": 3213, "num_output_records": 2190, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:43:44.477651 I | rook-ceph-mon0: 2017-07-11 14:43:44.477635 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224477632, "job": 64, "event": "table_file_deletion", "file_number": 101}
- 2017-07-11 14:43:44.479534 I | rook-ceph-mon0: 2017-07-11 14:43:44.479518 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224479516, "job": 64, "event": "table_file_deletion", "file_number": 99}
- 2017-07-11 14:43:44.479630 I | rook-ceph-mon0: 2017-07-11 14:43:44.479615 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:43:45.586116 I | rook-ceph-mon0: 2017-07-11 14:43:45.585941 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94361 MB
- 2017-07-11 14:43:46.533827 I | rook-ceph-mon0: 2017-07-11 14:43:46.533788 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:46.534047 I | rook-ceph-mon0: 2017-07-11 14:43:46.533934 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2749698495' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:47.805125 I | rook-ceph-mon0: 2017-07-11 14:43:47.805026 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #103. Immutable memtables: 0.
- 2017-07-11 14:43:47.805211 I | rook-ceph-mon0:
- 2017-07-11 14:43:47.805228 I | rook-ceph-mon0: 2017-07-11 14:43:47.805059 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 65] Syncing log #100
- 2017-07-11 14:43:47.821122 I | rook-ceph-mon0: 2017-07-11 14:43:47.820664 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:43:47.805053) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:43:47.821179 I | rook-ceph-mon0: 2017-07-11 14:43:47.820675 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 65] Flushing memtable with next log file: 103
- 2017-07-11 14:43:47.821197 I | rook-ceph-mon0:
- 2017-07-11 14:43:47.821210 I | rook-ceph-mon0: 2017-07-11 14:43:47.820685 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784227820680, "job": 65, "event": "flush_started", "num_memtables": 1, "num_entries": 292, "num_deletes": 251, "memory_usage": 121216}
- 2017-07-11 14:43:47.821242 I | rook-ceph-mon0: 2017-07-11 14:43:47.820687 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 65] Level-0 flush table #104: started
- 2017-07-11 14:43:47.904120 I | rook-ceph-mon0: 2017-07-11 14:43:47.904041 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784227904031, "cf_name": "default", "job": 65, "event": "table_file_creation", "file_number": 104, "file_size": 113634, "table_properties": {"data_size": 112456, "index_size": 364, "filter_size": 0, "raw_key_size": 4968, "raw_average_key_size": 18, "raw_value_size": 108591, "raw_average_value_size": 399, "num_data_blocks": 12, "num_entries": 272, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:43:47.904205 I | rook-ceph-mon0: 2017-07-11 14:43:47.904053 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 65] Level-0 flush table #104: 113634 bytes OK
- 2017-07-11 14:43:47.966472 I | rook-ceph-mon0: 2017-07-11 14:43:47.962688 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:43:47.930571) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #104 started
- 2017-07-11 14:43:47.966554 I | rook-ceph-mon0: 2017-07-11 14:43:47.962696 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:43:47.962634) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #104: memtable #1 done
- 2017-07-11 14:43:47.966582 I | rook-ceph-mon0: 2017-07-11 14:43:47.962697 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:43:47.962659) EVENT_LOG_v1 {"time_micros": 1499784227962653, "job": 65, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:43:47.966611 I | rook-ceph-mon0: 2017-07-11 14:43:47.962699 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:43:47.962675) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:43:47.966636 I | rook-ceph-mon0:
- 2017-07-11 14:43:47.966647 I | rook-ceph-mon0: 2017-07-11 14:43:47.962704 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 65] Try to delete WAL files size 112673, prev total WAL file size 112673, number of live WAL files 2.
- 2017-07-11 14:43:47.966657 I | rook-ceph-mon0:
- 2017-07-11 14:43:47.966681 I | rook-ceph-mon0: 2017-07-11 14:43:47.962815 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:43:47.966693 I | rook-ceph-mon0: 2017-07-11 14:43:47.962845 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:43:47.962840) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:43:47.966704 I | rook-ceph-mon0:
- 2017-07-11 14:43:47.966724 I | rook-ceph-mon0: 2017-07-11 14:43:47.962849 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 66] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:43:47.966737 I | rook-ceph-mon0: 2017-07-11 14:43:47.962854 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 65 Base level 0, inputs: [104(110KB)], [102(15MB)]
- 2017-07-11 14:43:47.966761 I | rook-ceph-mon0:
- 2017-07-11 14:43:47.966773 I | rook-ceph-mon0: 2017-07-11 14:43:47.962863 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784227962856, "job": 66, "event": "compaction_started", "files_L0": [104], "files_L1": [102], "score": -1, "input_data_size": 15852583}
- 2017-07-11 14:43:48.196885 I | rook-ceph-mon0: 2017-07-11 14:43:48.196837 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 66] Generated table #105: 1953 keys, 13316913 bytes
- 2017-07-11 14:43:48.197098 I | rook-ceph-mon0: 2017-07-11 14:43:48.196992 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784228196981, "cf_name": "default", "job": 66, "event": "table_file_creation", "file_number": 105, "file_size": 13316913, "table_properties": {"data_size": 13272748, "index_size": 43346, "filter_size": 0, "raw_key_size": 37657, "raw_average_key_size": 19, "raw_value_size": 13215072, "raw_average_value_size": 6766, "num_data_blocks": 1325, "num_entries": 1953, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:43:48.232655 I | rook-ceph-mon0: 2017-07-11 14:43:48.232618 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 66] Compacted 1@0 + 1@1 files to L1 => 13316913 bytes
- 2017-07-11 14:43:48.261995 I | rook-ceph-mon0: 2017-07-11 14:43:48.261958 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:43:48.261869) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 58.8 rd, 49.4 wr, level 1, files in(1, 1) out(1) MB in(0.1, 15.0) out(12.7), read-write-amplify(256.7) write-amplify(117.2) OK, records in: 2462, records dropped: 509
- 2017-07-11 14:43:48.262061 I | rook-ceph-mon0:
- 2017-07-11 14:43:48.262097 I | rook-ceph-mon0: 2017-07-11 14:43:48.262080 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:43:48.261893) EVENT_LOG_v1 {"time_micros": 1499784228261883, "job": 66, "event": "compaction_finished", "compaction_time_micros": 269738, "output_level": 1, "num_output_files": 1, "total_output_size": 13316913, "num_input_records": 2462, "num_output_records": 1953, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:43:48.262324 I | rook-ceph-mon0: 2017-07-11 14:43:48.262309 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784228262306, "job": 66, "event": "table_file_deletion", "file_number": 104}
- 2017-07-11 14:43:48.264349 I | rook-ceph-mon0: 2017-07-11 14:43:48.264332 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784228264330, "job": 66, "event": "table_file_deletion", "file_number": 102}
- 2017-07-11 14:43:48.517151 I | rook-ceph-mon0: 2017-07-11 14:43:48.517002 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:48.517180 I | rook-ceph-mon0: 2017-07-11 14:43:48.517024 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1084368665' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:52.574178 I | rook-ceph-mon0: 2017-07-11 14:43:52.574118 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:52.574266 I | rook-ceph-mon0: 2017-07-11 14:43:52.574251 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/735612144' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:54.196951 I | rook-ceph-mon0: 2017-07-11 14:43:54.196906 7f7c4bd55700 0 log_channel(cluster) log [WRN] : message from mon.1 was stamped 0.213162s in the future, clocks not synchronized
- 2017-07-11 14:43:55.185779 I | rook-ceph-mon0: 2017-07-11 14:43:54.197025 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1526 : cluster [WRN] message from mon.1 was stamped 0.213162s in the future, clocks not synchronized
- 2017-07-11 14:43:57.897655 I | rook-ceph-mon0: 2017-07-11 14:43:57.897615 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:57.897851 I | rook-ceph-mon0: 2017-07-11 14:43:57.897762 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2796540806' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:58.334367 I | rook-ceph-mon0: 2017-07-11 14:43:58.334330 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:58.334559 I | rook-ceph-mon0: 2017-07-11 14:43:58.334475 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2917713931' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:59.215834 I | rook-ceph-mon0: 2017-07-11 14:43:59.215799 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:59.216129 I | rook-ceph-mon0: 2017-07-11 14:43:59.215940 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2318668272' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:59.548031 I | rook-ceph-mon0: 2017-07-11 14:43:59.547992 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:59.548275 I | rook-ceph-mon0: 2017-07-11 14:43:59.548232 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4076954815' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:00.073573 I | rook-ceph-mon0: 2017-07-11 14:44:00.073535 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:44:00.073806 I | rook-ceph-mon0: 2017-07-11 14:44:00.073684 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/222388917' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:44:01.061668 I | rook-ceph-mon0: 2017-07-11 14:44:01.061630 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:01.061865 I | rook-ceph-mon0: 2017-07-11 14:44:01.061778 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1345858943' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:03.224219 I | rook-ceph-mon0: 2017-07-11 14:44:03.224179 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:03.224432 I | rook-ceph-mon0: 2017-07-11 14:44:03.224330 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3536563311' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:04.868664 I | rook-ceph-mon0: 2017-07-11 14:44:04.868624 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:44:04.868894 I | rook-ceph-mon0: 2017-07-11 14:44:04.868860 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4070851695' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:44:05.850714 I | rook-ceph-mon0: 2017-07-11 14:44:05.850679 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:05.850944 I | rook-ceph-mon0: 2017-07-11 14:44:05.850824 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2510984343' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:08.169352 I | rook-ceph-mon0: 2017-07-11 14:44:08.169299 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:08.169549 I | rook-ceph-mon0: 2017-07-11 14:44:08.169463 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3858645667' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:13.057338 I | rook-ceph-mon0: 2017-07-11 14:44:13.057297 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:13.057517 I | rook-ceph-mon0: 2017-07-11 14:44:13.057437 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/531288312' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:13.478041 I | rook-ceph-mon0: 2017-07-11 14:44:13.478003 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:44:13.478164 I | rook-ceph-mon0: 2017-07-11 14:44:13.478148 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/913441613' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:44:16.028646 I | rook-ceph-mon0: 2017-07-11 14:44:16.028608 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:16.028843 I | rook-ceph-mon0: 2017-07-11 14:44:16.028756 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4246617527' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:18.071176 I | rook-ceph-mon0: 2017-07-11 14:44:18.071137 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:18.071420 I | rook-ceph-mon0: 2017-07-11 14:44:18.071389 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1258857196' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:18.122216 I | rook-ceph-mon0: 2017-07-11 14:44:18.122179 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:18.122336 I | rook-ceph-mon0: 2017-07-11 14:44:18.122321 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3008936272' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:20.165375 I | rook-ceph-mon0: 2017-07-11 14:44:20.165335 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:44:20.165610 I | rook-ceph-mon0: 2017-07-11 14:44:20.165590 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/268172690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:44:22.482264 I | rook-ceph-mon0: 2017-07-11 14:44:22.482225 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:22.482440 I | rook-ceph-mon0: 2017-07-11 14:44:22.482360 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1450767399' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:23.313412 I | rook-ceph-mon0: 2017-07-11 14:44:23.313373 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:44:23.313642 I | rook-ceph-mon0: 2017-07-11 14:44:23.313601 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1149426316' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:44:24.619431 I | rook-ceph-mon0: 2017-07-11 14:44:24.619387 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:44:24.619645 I | rook-ceph-mon0: 2017-07-11 14:44:24.619616 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3589541575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:44:25.473675 I | rook-ceph-mon0: 2017-07-11 14:44:25.473636 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:25.473807 I | rook-ceph-mon0: 2017-07-11 14:44:25.473791 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2050895350' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:26.133512 I | rook-ceph-mon0: 2017-07-11 14:44:26.133474 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:26.133705 I | rook-ceph-mon0: 2017-07-11 14:44:26.133620 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1613072246' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:29.298328 I | rook-ceph-mon0: 2017-07-11 14:44:29.298289 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:29.298547 I | rook-ceph-mon0: 2017-07-11 14:44:29.298449 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3684469674' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:30.473478 I | rook-ceph-mon0: 2017-07-11 14:44:30.473444 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:30.473657 I | rook-ceph-mon0: 2017-07-11 14:44:30.473577 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1716743555' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:32.313453 I | rook-ceph-mon0: 2017-07-11 14:44:32.313415 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:32.313648 I | rook-ceph-mon0: 2017-07-11 14:44:32.313562 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2458016747' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:32.739726 I | rook-ceph-mon0: 2017-07-11 14:44:32.739689 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:32.739940 I | rook-ceph-mon0: 2017-07-11 14:44:32.739829 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2758268639' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:33.120465 I | rook-ceph-mon0: 2017-07-11 14:44:33.120426 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:33.120535 I | rook-ceph-mon0: 2017-07-11 14:44:33.120519 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1621370894' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:35.287879 I | rook-ceph-mon0: 2017-07-11 14:44:35.287840 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:35.288100 I | rook-ceph-mon0: 2017-07-11 14:44:35.288068 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3653065632' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:35.622620 I | rook-ceph-mon0: 2017-07-11 14:44:35.622583 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.159445s > max 0.05s
- 2017-07-11 14:44:36.240779 I | rook-ceph-mon0: 2017-07-11 14:44:35.622703 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1554 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.159445s > max 0.05s
- 2017-07-11 14:44:37.179363 I | rook-ceph-mon0: 2017-07-11 14:44:37.179327 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:37.179592 I | rook-ceph-mon0: 2017-07-11 14:44:37.179555 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3500614551' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:37.296630 I | rook-ceph-mon0: 2017-07-11 14:44:37.296590 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:37.296754 I | rook-ceph-mon0: 2017-07-11 14:44:37.296738 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2502079959' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:37.767911 I | rook-ceph-mon0: 2017-07-11 14:44:37.757988 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:37.768149 I | rook-ceph-mon0: 2017-07-11 14:44:37.768102 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/884204726' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:40.367217 I | rook-ceph-mon0: 2017-07-11 14:44:40.367178 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:40.367447 I | rook-ceph-mon0: 2017-07-11 14:44:40.367415 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2408406108' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:40.388397 I | rook-ceph-mon0: 2017-07-11 14:44:40.388355 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:40.388528 I | rook-ceph-mon0: 2017-07-11 14:44:40.388511 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/29622520' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:42.614253 I | rook-ceph-mon0: 2017-07-11 14:44:42.614216 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:42.614504 I | rook-ceph-mon0: 2017-07-11 14:44:42.614458 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3227282171' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:45.586396 I | rook-ceph-mon0: 2017-07-11 14:44:45.586227 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4823 MB, avail 94363 MB
- 2017-07-11 14:44:47.132024 I | rook-ceph-mon0: 2017-07-11 14:44:47.131987 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:47.132260 I | rook-ceph-mon0: 2017-07-11 14:44:47.132132 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/248570756' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:47.568836 I | rook-ceph-mon0: 2017-07-11 14:44:47.568798 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:47.569047 I | rook-ceph-mon0: 2017-07-11 14:44:47.568946 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2833495074' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:53.409923 I | rook-ceph-mon0: 2017-07-11 14:44:53.409881 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:53.410141 I | rook-ceph-mon0: 2017-07-11 14:44:53.410110 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1618589266' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:54.364141 I | rook-ceph-mon0: 2017-07-11 14:44:54.363996 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:44:54.364380 I | rook-ceph-mon0: 2017-07-11 14:44:54.364351 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2215628693' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:44:59.369589 I | rook-ceph-mon0: 2017-07-11 14:44:59.369549 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:59.369658 I | rook-ceph-mon0: 2017-07-11 14:44:59.369643 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2811218162' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:04.412731 I | rook-ceph-mon0: 2017-07-11 14:45:04.412692 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:45:04.412975 I | rook-ceph-mon0: 2017-07-11 14:45:04.412944 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4199883548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:45:05.334301 I | rook-ceph-mon0: 2017-07-11 14:45:05.334210 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:45:05.598995 I | rook-ceph-mon0: 2017-07-11 14:45:05.334218 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1567 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:45:06.802163 I | rook-ceph-mon0: 2017-07-11 14:45:06.802125 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:06.802391 I | rook-ceph-mon0: 2017-07-11 14:45:06.802352 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3798483412' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:10.071248 I | rook-ceph-mon0: 2017-07-11 14:45:10.071204 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:10.071456 I | rook-ceph-mon0: 2017-07-11 14:45:10.071355 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2409451815' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:11.746159 I | rook-ceph-mon0: 2017-07-11 14:45:11.746120 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:11.746406 I | rook-ceph-mon0: 2017-07-11 14:45:11.746312 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1071545297' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:16.671655 I | rook-ceph-mon0: 2017-07-11 14:45:16.671599 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:16.671889 I | rook-ceph-mon0: 2017-07-11 14:45:16.671867 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/829928072' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:17.118339 I | rook-ceph-mon0: 2017-07-11 14:45:17.118303 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:17.118578 I | rook-ceph-mon0: 2017-07-11 14:45:17.118499 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1645928845' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:17.624403 I | rook-ceph-mon0: 2017-07-11 14:45:17.624364 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:17.624612 I | rook-ceph-mon0: 2017-07-11 14:45:17.624524 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/428025535' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:18.136207 I | rook-ceph-mon0: 2017-07-11 14:45:18.136153 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:18.136336 I | rook-ceph-mon0: 2017-07-11 14:45:18.136320 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3164001410' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:20.201589 I | rook-ceph-mon0: 2017-07-11 14:45:20.201547 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:20.201822 I | rook-ceph-mon0: 2017-07-11 14:45:20.201804 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/59356542' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:21.564922 I | rook-ceph-mon0: 2017-07-11 14:45:21.564886 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:21.565099 I | rook-ceph-mon0: 2017-07-11 14:45:21.565021 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4086745359' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:21.619834 I | rook-ceph-mon0: 2017-07-11 14:45:21.619797 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:21.619954 I | rook-ceph-mon0: 2017-07-11 14:45:21.619939 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/411321356' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:25.068407 I | rook-ceph-mon0: 2017-07-11 14:45:25.068374 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:25.068628 I | rook-ceph-mon0: 2017-07-11 14:45:25.068591 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/639615839' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:27.119998 I | rook-ceph-mon0: 2017-07-11 14:45:27.119960 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:27.120193 I | rook-ceph-mon0: 2017-07-11 14:45:27.120108 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/477165185' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:27.565321 I | rook-ceph-mon0: 2017-07-11 14:45:27.559089 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:45:27.575275 I | rook-ceph-mon0: 2017-07-11 14:45:27.575252 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2146431723' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:45:28.029441 I | rook-ceph-mon0: 2017-07-11 14:45:28.029401 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:28.029510 I | rook-ceph-mon0: 2017-07-11 14:45:28.029495 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3208247198' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:32.664460 I | rook-ceph-mon0: 2017-07-11 14:45:32.664423 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:32.664692 I | rook-ceph-mon0: 2017-07-11 14:45:32.664653 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2992340451' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:33.716793 I | rook-ceph-mon0: 2017-07-11 14:45:33.716743 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:45:33.717044 I | rook-ceph-mon0: 2017-07-11 14:45:33.716916 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1318969611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:45:40.016847 I | rook-ceph-mon0: 2017-07-11 14:45:40.016809 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:40.017075 I | rook-ceph-mon0: 2017-07-11 14:45:40.016956 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/403782658' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:41.368659 I | rook-ceph-mon0: 2017-07-11 14:45:41.368622 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:41.368853 I | rook-ceph-mon0: 2017-07-11 14:45:41.368769 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3084976691' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:43.710804 I | rook-ceph-mon0: 2017-07-11 14:45:43.710763 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:45:43.710876 I | rook-ceph-mon0: 2017-07-11 14:45:43.710860 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/14827865' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:45:45.586708 I | rook-ceph-mon0: 2017-07-11 14:45:45.586527 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4823 MB, avail 94363 MB
- 2017-07-11 14:45:46.664894 I | rook-ceph-mon0: 2017-07-11 14:45:46.664858 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:46.670684 I | rook-ceph-mon0: 2017-07-11 14:45:46.665086 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2201870018' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:47.089365 I | rook-ceph-mon0: 2017-07-11 14:45:47.089315 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:45:47.089571 I | rook-ceph-mon0: 2017-07-11 14:45:47.089484 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1228038522' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:45:47.155532 I | rook-ceph-mon0: 2017-07-11 14:45:47.155495 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:47.155659 I | rook-ceph-mon0: 2017-07-11 14:45:47.155643 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/759478105' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:48.610676 I | rook-ceph-mon0: 2017-07-11 14:45:48.610636 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:45:48.620555 I | rook-ceph-mon0: 2017-07-11 14:45:48.613555 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2288241771' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:45:52.134820 I | rook-ceph-mon0: 2017-07-11 14:45:52.134782 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:45:52.135018 I | rook-ceph-mon0: 2017-07-11 14:45:52.134931 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/930883554' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:45:52.527892 I | rook-ceph-mon0: 2017-07-11 14:45:52.527853 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:52.528154 I | rook-ceph-mon0: 2017-07-11 14:45:52.528137 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1294728485' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:54.905731 I | rook-ceph-mon0: 2017-07-11 14:45:54.905684 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:54.905940 I | rook-ceph-mon0: 2017-07-11 14:45:54.905853 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2086451107' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:56.212533 I | rook-ceph-mon0: 2017-07-11 14:45:56.212499 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:56.212720 I | rook-ceph-mon0: 2017-07-11 14:45:56.212640 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4012357929' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:59.709256 I | rook-ceph-mon0: 2017-07-11 14:45:59.709217 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:59.709471 I | rook-ceph-mon0: 2017-07-11 14:45:59.709370 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3023469478' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:01.552577 I | rook-ceph-mon0: 2017-07-11 14:46:01.552541 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:01.552690 I | rook-ceph-mon0: 2017-07-11 14:46:01.552675 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1094423096' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:01.982079 I | rook-ceph-mon0: 2017-07-11 14:46:01.982029 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:46:01.982328 I | rook-ceph-mon0: 2017-07-11 14:46:01.982189 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1283712500' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:46:06.009230 I | rook-ceph-mon0: 2017-07-11 14:46:06.009193 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:06.009445 I | rook-ceph-mon0: 2017-07-11 14:46:06.009360 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3368616286' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:07.316515 I | rook-ceph-mon0: 2017-07-11 14:46:07.316476 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:07.316713 I | rook-ceph-mon0: 2017-07-11 14:46:07.316626 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3203007654' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:09.134583 I | rook-ceph-mon0: 2017-07-11 14:46:09.134545 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:09.134790 I | rook-ceph-mon0: 2017-07-11 14:46:09.134692 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3606128911' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:09.344724 I | rook-ceph-mon0: 2017-07-11 14:46:09.344685 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:09.344917 I | rook-ceph-mon0: 2017-07-11 14:46:09.344834 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1377508875' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:12.320877 I | rook-ceph-mon0: 2017-07-11 14:46:12.320838 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:12.321089 I | rook-ceph-mon0: 2017-07-11 14:46:12.320990 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2666108577' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:13.386467 I | rook-ceph-mon0: 2017-07-11 14:46:13.386428 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:13.386680 I | rook-ceph-mon0: 2017-07-11 14:46:13.386578 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/83008622' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:16.320641 I | rook-ceph-mon0: 2017-07-11 14:46:16.320601 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:16.320880 I | rook-ceph-mon0: 2017-07-11 14:46:16.320770 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2542621963' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:18.333928 I | rook-ceph-mon0: 2017-07-11 14:46:18.333888 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:46:18.334144 I | rook-ceph-mon0: 2017-07-11 14:46:18.334114 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3004496282' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:46:19.245363 I | rook-ceph-mon0: 2017-07-11 14:46:19.245326 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:19.245591 I | rook-ceph-mon0: 2017-07-11 14:46:19.245473 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1437152956' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:20.896494 I | rook-ceph-mon0: 2017-07-11 14:46:20.896458 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:20.896703 I | rook-ceph-mon0: 2017-07-11 14:46:20.896604 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1396806265' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:21.333787 I | rook-ceph-mon0: 2017-07-11 14:46:21.333749 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:21.333979 I | rook-ceph-mon0: 2017-07-11 14:46:21.333895 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/736951230' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:22.265385 I | rook-ceph-mon0: 2017-07-11 14:46:22.265347 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:22.265588 I | rook-ceph-mon0: 2017-07-11 14:46:22.265504 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2525838844' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:24.399668 I | rook-ceph-mon0: 2017-07-11 14:46:24.399629 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:24.399883 I | rook-ceph-mon0: 2017-07-11 14:46:24.399852 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2810819602' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:25.839498 I | rook-ceph-mon0: 2017-07-11 14:46:25.839460 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:25.839754 I | rook-ceph-mon0: 2017-07-11 14:46:25.839738 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1639263753' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:26.255571 I | rook-ceph-mon0: 2017-07-11 14:46:26.255534 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:26.255752 I | rook-ceph-mon0: 2017-07-11 14:46:26.255675 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1589495563' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:28.193013 I | rook-ceph-mon0: 2017-07-11 14:46:28.164278 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:28.193275 I | rook-ceph-mon0: 2017-07-11 14:46:28.193253 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1682084913' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:31.580160 I | rook-ceph-mon0: 2017-07-11 14:46:31.580125 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:46:31.580360 I | rook-ceph-mon0: 2017-07-11 14:46:31.580279 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1127941695' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:46:32.936236 I | rook-ceph-mon0: 2017-07-11 14:46:32.936194 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:46:32.936451 I | rook-ceph-mon0: 2017-07-11 14:46:32.936348 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3263874296' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:46:33.837359 I | rook-ceph-mon0: 2017-07-11 14:46:33.837324 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:33.837555 I | rook-ceph-mon0: 2017-07-11 14:46:33.837466 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4043332940' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:36.141053 I | rook-ceph-mon0: 2017-07-11 14:46:36.141017 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:36.141278 I | rook-ceph-mon0: 2017-07-11 14:46:36.141261 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1729123385' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:36.572301 I | rook-ceph-mon0: 2017-07-11 14:46:36.572265 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:46:36.572494 I | rook-ceph-mon0: 2017-07-11 14:46:36.572423 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1904539431' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:46:37.058006 I | rook-ceph-mon0: 2017-07-11 14:46:37.057966 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:37.058220 I | rook-ceph-mon0: 2017-07-11 14:46:37.058118 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1126246817' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:38.011909 I | rook-ceph-mon0: 2017-07-11 14:46:38.011832 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:46:38.012099 I | rook-ceph-mon0: 2017-07-11 14:46:38.012017 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1184872009' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:46:39.286238 I | rook-ceph-mon0: 2017-07-11 14:46:39.286199 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:39.286456 I | rook-ceph-mon0: 2017-07-11 14:46:39.286421 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/588305875' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:41.085940 I | rook-ceph-mon0: 2017-07-11 14:46:41.085901 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:41.086135 I | rook-ceph-mon0: 2017-07-11 14:46:41.086049 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2428581119' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:42.125333 I | rook-ceph-mon0: 2017-07-11 14:46:42.125293 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:42.125456 I | rook-ceph-mon0: 2017-07-11 14:46:42.125440 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1159885640' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:42.665783 I | rook-ceph-mon0: 2017-07-11 14:46:42.665744 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:42.665983 I | rook-ceph-mon0: 2017-07-11 14:46:42.665902 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1602247311' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:45.587063 I | rook-ceph-mon0: 2017-07-11 14:46:45.586954 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4823 MB, avail 94363 MB
- 2017-07-11 14:46:47.010593 I | rook-ceph-mon0: 2017-07-11 14:46:47.010555 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:47.010765 I | rook-ceph-mon0: 2017-07-11 14:46:47.010696 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1455426153' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:47.946015 I | rook-ceph-mon0: 2017-07-11 14:46:47.945977 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:46:47.946193 I | rook-ceph-mon0: 2017-07-11 14:46:47.946116 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/156158440' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:46:50.382455 I | rook-ceph-mon0: 2017-07-11 14:46:50.382415 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:50.382639 I | rook-ceph-mon0: 2017-07-11 14:46:50.382551 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/150881402' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:53.070255 I | rook-ceph-mon0: 2017-07-11 14:46:53.070218 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:46:53.070470 I | rook-ceph-mon0: 2017-07-11 14:46:53.070440 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3616900509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:46:53.690246 I | rook-ceph-mon0: 2017-07-11 14:46:53.690209 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:53.690440 I | rook-ceph-mon0: 2017-07-11 14:46:53.690364 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2279525503' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:54.052290 I | rook-ceph-mon0: 2017-07-11 14:46:54.052252 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:54.052419 I | rook-ceph-mon0: 2017-07-11 14:46:54.052403 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3633463670' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:57.821536 I | rook-ceph-mon0: 2017-07-11 14:46:57.821486 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:57.821759 I | rook-ceph-mon0: 2017-07-11 14:46:57.821647 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1690343464' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:58.350991 I | rook-ceph-mon0: 2017-07-11 14:46:58.350924 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:46:58.370158 I | rook-ceph-mon0: 2017-07-11 14:46:58.370117 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/512921826' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:47:00.306410 I | rook-ceph-mon0: 2017-07-11 14:47:00.306373 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:00.306601 I | rook-ceph-mon0: 2017-07-11 14:47:00.306516 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2219075451' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:01.509223 I | rook-ceph-mon0: 2017-07-11 14:47:01.509187 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:01.509514 I | rook-ceph-mon0: 2017-07-11 14:47:01.509330 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3212875496' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:02.646851 I | rook-ceph-mon0: 2017-07-11 14:47:02.646761 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:47:02.646939 I | rook-ceph-mon0: 2017-07-11 14:47:02.646786 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2714136640' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:47:04.744706 I | rook-ceph-mon0: 2017-07-11 14:47:04.744668 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:04.744941 I | rook-ceph-mon0: 2017-07-11 14:47:04.744912 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/49310299' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:06.488329 I | rook-ceph-mon0: 2017-07-11 14:47:06.488290 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:47:06.488538 I | rook-ceph-mon0: 2017-07-11 14:47:06.488434 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1465366939' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:47:07.736226 I | rook-ceph-mon0: 2017-07-11 14:47:07.736127 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #106. Immutable memtables: 0.
- 2017-07-11 14:47:07.736313 I | rook-ceph-mon0:
- 2017-07-11 14:47:07.736330 I | rook-ceph-mon0: 2017-07-11 14:47:07.736157 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 67] Syncing log #103
- 2017-07-11 14:47:07.766786 I | rook-ceph-mon0: 2017-07-11 14:47:07.765193 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:47:07.736152) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:47:07.766862 I | rook-ceph-mon0: 2017-07-11 14:47:07.765219 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 67] Flushing memtable with next log file: 106
- 2017-07-11 14:47:07.766880 I | rook-ceph-mon0:
- 2017-07-11 14:47:07.766910 I | rook-ceph-mon0: 2017-07-11 14:47:07.765231 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784427765226, "job": 67, "event": "flush_started", "num_memtables": 1, "num_entries": 2060, "num_deletes": 251, "memory_usage": 5112936}
- 2017-07-11 14:47:07.766925 I | rook-ceph-mon0: 2017-07-11 14:47:07.765233 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 67] Level-0 flush table #107: started
- 2017-07-11 14:47:08.001618 I | rook-ceph-mon0: 2017-07-11 14:47:08.001565 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784428001555, "cf_name": "default", "job": 67, "event": "table_file_creation", "file_number": 107, "file_size": 5058867, "table_properties": {"data_size": 5041332, "index_size": 16715, "filter_size": 0, "raw_key_size": 17110, "raw_average_key_size": 18, "raw_value_size": 5017131, "raw_average_value_size": 5507, "num_data_blocks": 523, "num_entries": 911, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:47:08.001800 I | rook-ceph-mon0: 2017-07-11 14:47:08.001714 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 67] Level-0 flush table #107: 5058867 bytes OK
- 2017-07-11 14:47:08.253406 I | rook-ceph-mon0: 2017-07-11 14:47:08.253359 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.150197) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #107 started
- 2017-07-11 14:47:08.253507 I | rook-ceph-mon0: 2017-07-11 14:47:08.253490 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.253305) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #107: memtable #1 done
- 2017-07-11 14:47:08.253586 I | rook-ceph-mon0: 2017-07-11 14:47:08.253543 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.253330) EVENT_LOG_v1 {"time_micros": 1499784428253324, "job": 67, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:47:08.253627 I | rook-ceph-mon0: 2017-07-11 14:47:08.253601 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.253346) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:47:08.253641 I | rook-ceph-mon0:
- 2017-07-11 14:47:08.253670 I | rook-ceph-mon0: 2017-07-11 14:47:08.253658 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 67] Try to delete WAL files size 5068929, prev total WAL file size 5068929, number of live WAL files 2.
- 2017-07-11 14:47:08.253693 I | rook-ceph-mon0:
- 2017-07-11 14:47:08.254749 I | rook-ceph-mon0: 2017-07-11 14:47:08.254711 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:47:08.263970 I | rook-ceph-mon0: 2017-07-11 14:47:08.254978 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:47:08.264027 I | rook-ceph-mon0: 2017-07-11 14:47:08.254983 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:47:08.264045 I | rook-ceph-mon0: ** DB Stats **
- 2017-07-11 14:47:08.264059 I | rook-ceph-mon0: Uptime(secs): 5003.1 total, 796.0 interval
- 2017-07-11 14:47:08.264101 I | rook-ceph-mon0: Cumulative writes: 9188 writes, 40K keys, 9188 commit groups, 1.0 writes per commit group, ingest: 0.08 GB, 0.02 MB/s
- 2017-07-11 14:47:08.264184 I | rook-ceph-mon0: Cumulative WAL: 9188 writes, 9188 syncs, 1.00 writes per sync, written: 0.08 GB, 0.02 MB/s
- 2017-07-11 14:47:08.264199 I | rook-ceph-mon0: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:47:08.264211 I | rook-ceph-mon0: Interval writes: 2008 writes, 9495 keys, 2008 commit groups, 1.0 writes per commit group, ingest: 19.28 MB, 0.02 MB/s
- 2017-07-11 14:47:08.264224 I | rook-ceph-mon0: Interval WAL: 2008 writes, 2008 syncs, 1.00 writes per sync, written: 0.02 MB, 0.02 MB/s
- 2017-07-11 14:47:08.264236 I | rook-ceph-mon0: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:47:08.264259 I | rook-ceph-mon0:
- 2017-07-11 14:47:08.264272 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 14:47:08.264284 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:47:08.264296 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:47:08.264308 I | rook-ceph-mon0: L0 1/1 4.82 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 20.9 4 35 0.104 0 0
- 2017-07-11 14:47:08.264338 I | rook-ceph-mon0: L1 1/1 12.70 MB 0.0 0.5 0.1 0.4 0.4 0.0 0.0 5.7 54.8 47.8 8 31 0.273 76K 16K
- 2017-07-11 14:47:08.264352 I | rook-ceph-mon0: Sum 2/2 17.52 MB 0.0 0.5 0.1 0.4 0.5 0.1 0.0 6.3 38.2 39.7 12 66 0.183 76K 16K
- 2017-07-11 14:47:08.264364 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 6.2 38.6 39.3 3 14 0.214 19K 4534
- 2017-07-11 14:47:08.264375 I | rook-ceph-mon0: Uptime(secs): 5003.1 total, 5003.1 interval
- 2017-07-11 14:47:08.264386 I | rook-ceph-mon0: Flush(GB): cumulative 0.074, interval 0.018
- 2017-07-11 14:47:08.264397 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:47:08.264422 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:47:08.264435 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:47:08.264446 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:47:08.264458 I | rook-ceph-mon0: Cumulative compaction: 0.47 GB write, 0.10 MB/s write, 0.45 GB read, 0.09 MB/s read, 12.1 seconds
- 2017-07-11 14:47:08.264470 I | rook-ceph-mon0: Interval compaction: 0.12 GB write, 0.02 MB/s write, 0.11 GB read, 0.02 MB/s read, 3.0 seconds
- 2017-07-11 14:47:08.264493 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:47:08.264506 I | rook-ceph-mon0:
- 2017-07-11 14:47:08.264518 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:47:08.264529 I | rook-ceph-mon0:
- 2017-07-11 14:47:08.264540 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 14:47:08.264552 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:47:08.264580 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:47:08.264593 I | rook-ceph-mon0: L0 1/1 4.82 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 20.9 4 35 0.104 0 0
- 2017-07-11 14:47:08.264605 I | rook-ceph-mon0: L1 1/1 12.70 MB 0.0 0.5 0.1 0.4 0.4 0.0 0.0 5.7 54.8 47.8 8 31 0.273 76K 16K
- 2017-07-11 14:47:08.264620 I | rook-ceph-mon0: Sum 2/2 17.52 MB 0.0 0.5 0.1 0.4 0.5 0.1 0.0 6.3 38.2 39.7 12 66 0.183 76K 16K
- 2017-07-11 14:47:08.264646 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:47:08.264659 I | rook-ceph-mon0: Uptime(secs): 5003.1 total, 5003.1 interval
- 2017-07-11 14:47:08.264670 I | rook-ceph-mon0: Flush(GB): cumulative 0.074, interval 0.000
- 2017-07-11 14:47:08.264682 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:47:08.264693 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:47:08.264704 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:47:08.264727 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:47:08.264740 I | rook-ceph-mon0: Cumulative compaction: 0.47 GB write, 0.10 MB/s write, 0.45 GB read, 0.09 MB/s read, 12.1 seconds
- 2017-07-11 14:47:08.264752 I | rook-ceph-mon0: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:47:08.264764 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:47:08.264775 I | rook-ceph-mon0:
- 2017-07-11 14:47:08.264786 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:47:08.264810 I | rook-ceph-mon0:
- 2017-07-11 14:47:08.264822 I | rook-ceph-mon0: 2017-07-11 14:47:08.255010 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.255001) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:47:08.264833 I | rook-ceph-mon0:
- 2017-07-11 14:47:08.264845 I | rook-ceph-mon0: 2017-07-11 14:47:08.255014 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 68] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:47:08.264856 I | rook-ceph-mon0: 2017-07-11 14:47:08.255017 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 67 Base level 0, inputs: [107(4940KB)], [105(12MB)]
- 2017-07-11 14:47:08.264879 I | rook-ceph-mon0:
- 2017-07-11 14:47:08.264891 I | rook-ceph-mon0: 2017-07-11 14:47:08.255027 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784428255020, "job": 68, "event": "compaction_started", "files_L0": [107], "files_L1": [105], "score": -1, "input_data_size": 18375780}
- 2017-07-11 14:47:08.532097 I | rook-ceph-mon0: 2017-07-11 14:47:08.532047 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 68] Generated table #108: 2355 keys, 15830116 bytes
- 2017-07-11 14:47:08.534771 I | rook-ceph-mon0: 2017-07-11 14:47:08.532202 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784428532192, "cf_name": "default", "job": 68, "event": "table_file_creation", "file_number": 108, "file_size": 15830116, "table_properties": {"data_size": 15776808, "index_size": 52489, "filter_size": 0, "raw_key_size": 45546, "raw_average_key_size": 19, "raw_value_size": 15707146, "raw_average_value_size": 6669, "num_data_blocks": 1596, "num_entries": 2355, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:47:08.589730 I | rook-ceph-mon0: 2017-07-11 14:47:08.589679 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 68] Compacted 1@0 + 1@1 files to L1 => 15830116 bytes
- 2017-07-11 14:47:08.615959 I | rook-ceph-mon0: 2017-07-11 14:47:08.615910 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.615818) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 54.9 rd, 47.3 wr, level 1, files in(1, 1) out(1) MB in(4.8, 12.7) out(15.1), read-write-amplify(6.8) write-amplify(3.1) OK, records in: 2864, records dropped: 509
- 2017-07-11 14:47:08.616033 I | rook-ceph-mon0:
- 2017-07-11 14:47:08.616070 I | rook-ceph-mon0: 2017-07-11 14:47:08.616053 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.615843) EVENT_LOG_v1 {"time_micros": 1499784428615834, "job": 68, "event": "compaction_finished", "compaction_time_micros": 334596, "output_level": 1, "num_output_files": 1, "total_output_size": 15830116, "num_input_records": 2864, "num_output_records": 2355, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:47:08.616900 I | rook-ceph-mon0: 2017-07-11 14:47:08.616882 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784428616879, "job": 68, "event": "table_file_deletion", "file_number": 107}
- 2017-07-11 14:47:08.618511 I | rook-ceph-mon0: 2017-07-11 14:47:08.618496 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784428618494, "job": 68, "event": "table_file_deletion", "file_number": 105}
- 2017-07-11 14:47:11.523457 I | rook-ceph-mon0: 2017-07-11 14:47:11.523347 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:11.523679 I | rook-ceph-mon0: 2017-07-11 14:47:11.523647 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1564387897' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:12.567731 I | rook-ceph-mon0: 2017-07-11 14:47:12.567694 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:12.567841 I | rook-ceph-mon0: 2017-07-11 14:47:12.567826 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4262048197' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:16.616560 I | rook-ceph-mon0: 2017-07-11 14:47:16.616519 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:16.616784 I | rook-ceph-mon0: 2017-07-11 14:47:16.616753 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1647911405' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:18.656961 I | rook-ceph-mon0: 2017-07-11 14:47:18.656922 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:18.657032 I | rook-ceph-mon0: 2017-07-11 14:47:18.657016 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3574223901' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:19.993775 I | rook-ceph-mon0: 2017-07-11 14:47:19.993736 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:19.993844 I | rook-ceph-mon0: 2017-07-11 14:47:19.993828 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2124237470' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:20.992747 I | rook-ceph-mon0: 2017-07-11 14:47:20.992702 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:47:20.992947 I | rook-ceph-mon0: 2017-07-11 14:47:20.992845 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1931552348' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:47:21.413457 I | rook-ceph-mon0: 2017-07-11 14:47:21.413417 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:21.413586 I | rook-ceph-mon0: 2017-07-11 14:47:21.413570 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2608829148' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:23.742628 I | rook-ceph-mon0: 2017-07-11 14:47:23.742589 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:23.742857 I | rook-ceph-mon0: 2017-07-11 14:47:23.742738 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3562706154' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:26.154536 I | rook-ceph-mon0: 2017-07-11 14:47:26.154498 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:47:26.154734 I | rook-ceph-mon0: 2017-07-11 14:47:26.154650 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2744550889' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:47:26.561434 I | rook-ceph-mon0: 2017-07-11 14:47:26.561398 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:26.570748 I | rook-ceph-mon0: 2017-07-11 14:47:26.564606 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/571040980' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:27.138736 I | rook-ceph-mon0: 2017-07-11 14:47:27.138687 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:27.138900 I | rook-ceph-mon0: 2017-07-11 14:47:27.138831 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/679036015' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:30.849992 I | rook-ceph-mon0: 2017-07-11 14:47:30.849927 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:47:30.850290 I | rook-ceph-mon0: 2017-07-11 14:47:30.850185 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1971667118' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:47:38.324074 I | rook-ceph-mon0: 2017-07-11 14:47:38.324032 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:38.324318 I | rook-ceph-mon0: 2017-07-11 14:47:38.324271 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3646262263' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:40.149840 I | rook-ceph-mon0: 2017-07-11 14:47:40.149802 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:40.150002 I | rook-ceph-mon0: 2017-07-11 14:47:40.149935 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2566909684' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:41.221575 I | rook-ceph-mon0: 2017-07-11 14:47:41.221537 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:41.221794 I | rook-ceph-mon0: 2017-07-11 14:47:41.221685 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2934934795' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:42.178408 I | rook-ceph-mon0: 2017-07-11 14:47:42.178368 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:47:42.178570 I | rook-ceph-mon0: 2017-07-11 14:47:42.178548 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1163364151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:47:42.215109 I | rook-ceph-mon0: 2017-07-11 14:47:42.215073 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:42.215227 I | rook-ceph-mon0: 2017-07-11 14:47:42.215212 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2241771753' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:44.614024 I | rook-ceph-mon0: 2017-07-11 14:47:44.613983 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:44.614247 I | rook-ceph-mon0: 2017-07-11 14:47:44.614214 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1880310856' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:45.624566 I | rook-ceph-mon0: 2017-07-11 14:47:45.624289 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94361 MB
- 2017-07-11 14:47:45.652599 I | rook-ceph-mon0: 2017-07-11 14:47:45.652567 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:47:45.652703 I | rook-ceph-mon0: 2017-07-11 14:47:45.652688 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2802798781' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:47:46.125781 I | rook-ceph-mon0: 2017-07-11 14:47:46.125740 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:46.126008 I | rook-ceph-mon0: 2017-07-11 14:47:46.125890 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3098774955' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:49.362055 I | rook-ceph-mon0: 2017-07-11 14:47:49.362015 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:49.362265 I | rook-ceph-mon0: 2017-07-11 14:47:49.362166 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3360858463' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:50.063922 I | rook-ceph-mon0: 2017-07-11 14:47:50.063881 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:50.063989 I | rook-ceph-mon0: 2017-07-11 14:47:50.063974 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/136608328' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:50.509049 I | rook-ceph-mon0: 2017-07-11 14:47:50.509010 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:47:50.509257 I | rook-ceph-mon0: 2017-07-11 14:47:50.509215 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/614885971' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:47:52.827275 I | rook-ceph-mon0: 2017-07-11 14:47:52.827236 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:52.827472 I | rook-ceph-mon0: 2017-07-11 14:47:52.827384 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2725960383' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:55.071339 I | rook-ceph-mon0: 2017-07-11 14:47:55.071290 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:55.071556 I | rook-ceph-mon0: 2017-07-11 14:47:55.071453 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/834736406' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:00.307614 I | rook-ceph-mon0: 2017-07-11 14:48:00.307576 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:48:00.307806 I | rook-ceph-mon0: 2017-07-11 14:48:00.307721 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1223807482' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:48:00.409465 I | rook-ceph-mon0: 2017-07-11 14:48:00.409426 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:00.409659 I | rook-ceph-mon0: 2017-07-11 14:48:00.409574 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/973711189' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:04.301730 I | rook-ceph-mon0: 2017-07-11 14:48:04.301691 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:04.301943 I | rook-ceph-mon0: 2017-07-11 14:48:04.301841 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1440518694' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:04.323475 I | rook-ceph-mon0: 2017-07-11 14:48:04.323438 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:04.323597 I | rook-ceph-mon0: 2017-07-11 14:48:04.323580 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4225461681' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:07.992774 I | rook-ceph-mon0: 2017-07-11 14:48:07.992736 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:07.992967 I | rook-ceph-mon0: 2017-07-11 14:48:07.992880 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/203359417' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:09.266575 I | rook-ceph-mon0: 2017-07-11 14:48:09.266534 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:09.266840 I | rook-ceph-mon0: 2017-07-11 14:48:09.266696 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1260918974' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:10.671159 I | rook-ceph-mon0: 2017-07-11 14:48:10.671113 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:10.671390 I | rook-ceph-mon0: 2017-07-11 14:48:10.671358 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2941406573' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:14.147821 I | rook-ceph-mon0: 2017-07-11 14:48:14.147782 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:14.147891 I | rook-ceph-mon0: 2017-07-11 14:48:14.147875 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1143974361' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:16.533385 I | rook-ceph-mon0: 2017-07-11 14:48:16.533349 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:48:16.533598 I | rook-ceph-mon0: 2017-07-11 14:48:16.533563 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1600711554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:48:17.457152 I | rook-ceph-mon0: 2017-07-11 14:48:17.457113 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:17.457371 I | rook-ceph-mon0: 2017-07-11 14:48:17.457262 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/561007747' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:19.569942 I | rook-ceph-mon0: 2017-07-11 14:48:19.569905 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:19.570183 I | rook-ceph-mon0: 2017-07-11 14:48:19.570166 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2760886159' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:24.079207 I | rook-ceph-mon0: 2017-07-11 14:48:24.079167 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:24.079420 I | rook-ceph-mon0: 2017-07-11 14:48:24.079327 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2703785877' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:24.526099 I | rook-ceph-mon0: 2017-07-11 14:48:24.526058 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:24.526298 I | rook-ceph-mon0: 2017-07-11 14:48:24.526211 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/927499239' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:25.672025 I | rook-ceph-mon0: 2017-07-11 14:48:25.671985 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:25.672243 I | rook-ceph-mon0: 2017-07-11 14:48:25.672138 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/271268072' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:27.572272 I | rook-ceph-mon0: 2017-07-11 14:48:27.572231 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:27.572498 I | rook-ceph-mon0: 2017-07-11 14:48:27.572465 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/728251185' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:28.964144 I | rook-ceph-mon0: 2017-07-11 14:48:28.964092 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:28.966194 I | rook-ceph-mon0: 2017-07-11 14:48:28.964254 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1334440025' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:29.435823 I | rook-ceph-mon0: 2017-07-11 14:48:29.435785 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:29.436072 I | rook-ceph-mon0: 2017-07-11 14:48:29.435958 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/392791644' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:29.878647 I | rook-ceph-mon0: 2017-07-11 14:48:29.878609 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:48:29.878852 I | rook-ceph-mon0: 2017-07-11 14:48:29.878771 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1037348613' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:48:30.306450 I | rook-ceph-mon0: 2017-07-11 14:48:30.306410 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:30.306534 I | rook-ceph-mon0: 2017-07-11 14:48:30.306518 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3609667698' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:33.877819 I | rook-ceph-mon0: 2017-07-11 14:48:33.877782 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:33.878048 I | rook-ceph-mon0: 2017-07-11 14:48:33.878008 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2573392829' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:34.332524 I | rook-ceph-mon0: 2017-07-11 14:48:34.332486 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:34.332591 I | rook-ceph-mon0: 2017-07-11 14:48:34.332576 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1823292346' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:38.823700 I | rook-ceph-mon0: 2017-07-11 14:48:38.823662 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:38.823945 I | rook-ceph-mon0: 2017-07-11 14:48:38.823841 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1955800832' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:39.721173 I | rook-ceph-mon0: 2017-07-11 14:48:39.721130 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:48:39.721368 I | rook-ceph-mon0: 2017-07-11 14:48:39.721280 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2020536347' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:48:40.293810 I | rook-ceph-mon0: 2017-07-11 14:48:40.293770 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:40.293879 I | rook-ceph-mon0: 2017-07-11 14:48:40.293863 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2762948906' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:43.708012 I | rook-ceph-mon0: 2017-07-11 14:48:43.707974 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:43.708220 I | rook-ceph-mon0: 2017-07-11 14:48:43.708134 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/363135350' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:44.650692 I | rook-ceph-mon0: 2017-07-11 14:48:44.650653 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:48:44.650887 I | rook-ceph-mon0: 2017-07-11 14:48:44.650800 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1419836559' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:48:45.624716 I | rook-ceph-mon0: 2017-07-11 14:48:45.624560 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4826 MB, avail 94361 MB
- 2017-07-11 14:48:48.720568 I | rook-ceph-mon0: 2017-07-11 14:48:48.720529 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:48.720785 I | rook-ceph-mon0: 2017-07-11 14:48:48.720680 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3944361775' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:49.327137 I | rook-ceph-mon0: 2017-07-11 14:48:49.327035 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #109. Immutable memtables: 0.
- 2017-07-11 14:48:49.327222 I | rook-ceph-mon0:
- 2017-07-11 14:48:49.327241 I | rook-ceph-mon0: 2017-07-11 14:48:49.327069 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 69] Syncing log #106
- 2017-07-11 14:48:49.368264 I | rook-ceph-mon0: 2017-07-11 14:48:49.364825 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.327064) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:48:49.368363 I | rook-ceph-mon0: 2017-07-11 14:48:49.364844 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 69] Flushing memtable with next log file: 109
- 2017-07-11 14:48:49.368448 I | rook-ceph-mon0:
- 2017-07-11 14:48:49.368484 I | rook-ceph-mon0: 2017-07-11 14:48:49.364859 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784529364850, "job": 69, "event": "flush_started", "num_memtables": 1, "num_entries": 1196, "num_deletes": 251, "memory_usage": 2671192}
- 2017-07-11 14:48:49.368499 I | rook-ceph-mon0: 2017-07-11 14:48:49.364862 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 69] Level-0 flush table #110: started
- 2017-07-11 14:48:49.421537 I | rook-ceph-mon0: 2017-07-11 14:48:49.421486 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784529421473, "cf_name": "default", "job": 69, "event": "table_file_creation", "file_number": 110, "file_size": 2351746, "table_properties": {"data_size": 2343780, "index_size": 7148, "filter_size": 0, "raw_key_size": 10805, "raw_average_key_size": 19, "raw_value_size": 2331145, "raw_average_value_size": 4200, "num_data_blocks": 228, "num_entries": 555, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:48:49.421651 I | rook-ceph-mon0: 2017-07-11 14:48:49.421633 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 69] Level-0 flush table #110: 2351746 bytes OK
- 2017-07-11 14:48:49.456779 I | rook-ceph-mon0: 2017-07-11 14:48:49.456738 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.436713) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #110 started
- 2017-07-11 14:48:49.456878 I | rook-ceph-mon0: 2017-07-11 14:48:49.456862 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.456696) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #110: memtable #1 done
- 2017-07-11 14:48:49.456931 I | rook-ceph-mon0: 2017-07-11 14:48:49.456915 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.456713) EVENT_LOG_v1 {"time_micros": 1499784529456707, "job": 69, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:48:49.456996 I | rook-ceph-mon0: 2017-07-11 14:48:49.456949 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.456727) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:48:49.457012 I | rook-ceph-mon0:
- 2017-07-11 14:48:49.457045 I | rook-ceph-mon0: 2017-07-11 14:48:49.457032 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 69] Try to delete WAL files size 2646549, prev total WAL file size 2646549, number of live WAL files 2.
- 2017-07-11 14:48:49.457074 I | rook-ceph-mon0:
- 2017-07-11 14:48:49.460133 I | rook-ceph-mon0: 2017-07-11 14:48:49.457653 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:48:49.460188 I | rook-ceph-mon0: 2017-07-11 14:48:49.457695 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.457690) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:48:49.460206 I | rook-ceph-mon0:
- 2017-07-11 14:48:49.460219 I | rook-ceph-mon0: 2017-07-11 14:48:49.457701 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 70] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:48:49.460247 I | rook-ceph-mon0: 2017-07-11 14:48:49.457706 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 69 Base level 0, inputs: [110(2296KB)], [108(15MB)]
- 2017-07-11 14:48:49.460261 I | rook-ceph-mon0:
- 2017-07-11 14:48:49.460272 I | rook-ceph-mon0: 2017-07-11 14:48:49.457716 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784529457708, "job": 70, "event": "compaction_started", "files_L0": [110], "files_L1": [108], "score": -1, "input_data_size": 18181862}
- 2017-07-11 14:48:49.658140 I | rook-ceph-mon0: 2017-07-11 14:48:49.658088 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 70] Generated table #111: 2445 keys, 16815679 bytes
- 2017-07-11 14:48:49.658379 I | rook-ceph-mon0: 2017-07-11 14:48:49.658335 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784529658250, "cf_name": "default", "job": 70, "event": "table_file_creation", "file_number": 111, "file_size": 16815679, "table_properties": {"data_size": 16761851, "index_size": 53009, "filter_size": 0, "raw_key_size": 47004, "raw_average_key_size": 19, "raw_value_size": 16690665, "raw_average_value_size": 6826, "num_data_blocks": 1616, "num_entries": 2445, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:48:49.737438 I | rook-ceph-mon0: 2017-07-11 14:48:49.737380 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 70] Compacted 1@0 + 1@1 files to L1 => 16815679 bytes
- 2017-07-11 14:48:49.768700 I | rook-ceph-mon0: 2017-07-11 14:48:49.768650 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.768565) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 65.0 rd, 60.1 wr, level 1, files in(1, 1) out(1) MB in(2.2, 15.1) out(16.0), read-write-amplify(14.9) write-amplify(7.2) OK, records in: 2910, records dropped: 465
- 2017-07-11 14:48:49.768780 I | rook-ceph-mon0:
- 2017-07-11 14:48:49.768836 I | rook-ceph-mon0: 2017-07-11 14:48:49.768800 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.768589) EVENT_LOG_v1 {"time_micros": 1499784529768580, "job": 70, "event": "compaction_finished", "compaction_time_micros": 279640, "output_level": 1, "num_output_files": 1, "total_output_size": 16815679, "num_input_records": 2910, "num_output_records": 2445, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:48:49.769388 I | rook-ceph-mon0: 2017-07-11 14:48:49.769372 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784529769369, "job": 70, "event": "table_file_deletion", "file_number": 110}
- 2017-07-11 14:48:49.771316 I | rook-ceph-mon0: 2017-07-11 14:48:49.771298 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784529771296, "job": 70, "event": "table_file_deletion", "file_number": 108}
- 2017-07-11 14:48:49.771386 I | rook-ceph-mon0: 2017-07-11 14:48:49.771371 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:48:52.548464 I | rook-ceph-mon0: 2017-07-11 14:48:52.548430 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:52.548529 I | rook-ceph-mon0: 2017-07-11 14:48:52.548514 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/19080466' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:52.891540 I | rook-ceph-mon0: 2017-07-11 14:48:52.891499 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:52.891669 I | rook-ceph-mon0: 2017-07-11 14:48:52.891652 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2377494377' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:55.413152 I | rook-ceph-mon0: 2017-07-11 14:48:55.413113 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:55.413375 I | rook-ceph-mon0: 2017-07-11 14:48:55.413262 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2351381330' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:56.342551 I | rook-ceph-mon0: 2017-07-11 14:48:56.342513 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:56.342746 I | rook-ceph-mon0: 2017-07-11 14:48:56.342662 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3965042223' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:56.373173 I | rook-ceph-mon0: 2017-07-11 14:48:56.373136 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:48:56.373297 I | rook-ceph-mon0: 2017-07-11 14:48:56.373281 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/15486118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:48:57.455855 I | rook-ceph-mon0: 2017-07-11 14:48:57.455805 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:57.456150 I | rook-ceph-mon0: 2017-07-11 14:48:57.456111 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3363115645' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:58.618829 I | rook-ceph-mon0: 2017-07-11 14:48:58.618792 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:58.619059 I | rook-ceph-mon0: 2017-07-11 14:48:58.618930 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3921736447' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:59.597564 I | rook-ceph-mon0: 2017-07-11 14:48:59.597525 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:48:59.597758 I | rook-ceph-mon0: 2017-07-11 14:48:59.597672 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3816987623' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:48:59.866949 I | rook-ceph-mon0: 2017-07-11 14:48:59.866912 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:59.867167 I | rook-ceph-mon0: 2017-07-11 14:48:59.867051 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2770803666' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:03.889067 I | rook-ceph-mon0: 2017-07-11 14:49:03.889029 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:03.889323 I | rook-ceph-mon0: 2017-07-11 14:49:03.889256 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/788470503' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:07.342030 I | rook-ceph-mon0: 2017-07-11 14:49:07.341993 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:07.342235 I | rook-ceph-mon0: 2017-07-11 14:49:07.342151 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2095762892' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:09.470200 I | rook-ceph-mon0: 2017-07-11 14:49:09.470155 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:49:09.470425 I | rook-ceph-mon0: 2017-07-11 14:49:09.470308 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1008269213' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:49:11.168348 I | rook-ceph-mon0: 2017-07-11 14:49:11.168311 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:11.168470 I | rook-ceph-mon0: 2017-07-11 14:49:11.168455 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3482118901' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:13.281103 I | rook-ceph-mon0: 2017-07-11 14:49:13.281065 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:13.281314 I | rook-ceph-mon0: 2017-07-11 14:49:13.281214 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1408449096' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:14.376570 I | rook-ceph-mon0: 2017-07-11 14:49:14.376459 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #112. Immutable memtables: 0.
- 2017-07-11 14:49:14.376643 I | rook-ceph-mon0:
- 2017-07-11 14:49:14.376660 I | rook-ceph-mon0: 2017-07-11 14:49:14.376485 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 71] Syncing log #109
- 2017-07-11 14:49:14.415511 I | rook-ceph-mon0: 2017-07-11 14:49:14.414347 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.376480) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:49:14.415593 I | rook-ceph-mon0: 2017-07-11 14:49:14.414357 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 71] Flushing memtable with next log file: 112
- 2017-07-11 14:49:14.415621 I | rook-ceph-mon0:
- 2017-07-11 14:49:14.415633 I | rook-ceph-mon0: 2017-07-11 14:49:14.414367 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554414363, "job": 71, "event": "flush_started", "num_memtables": 1, "num_entries": 728, "num_deletes": 504, "memory_usage": 663432}
- 2017-07-11 14:49:14.415644 I | rook-ceph-mon0: 2017-07-11 14:49:14.414370 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 71] Level-0 flush table #113: started
- 2017-07-11 14:49:14.516783 I | rook-ceph-mon0: 2017-07-11 14:49:14.516735 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554516725, "cf_name": "default", "job": 71, "event": "table_file_creation", "file_number": 113, "file_size": 645848, "table_properties": {"data_size": 642950, "index_size": 2084, "filter_size": 0, "raw_key_size": 11530, "raw_average_key_size": 19, "raw_value_size": 633622, "raw_average_value_size": 1072, "num_data_blocks": 67, "num_entries": 591, "filter_policy_name": "", "kDeletedKeys": "504", "kMergeOperands": "0"}}
- 2017-07-11 14:49:14.516835 I | rook-ceph-mon0: 2017-07-11 14:49:14.516819 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 71] Level-0 flush table #113: 645848 bytes OK
- 2017-07-11 14:49:14.689270 I | rook-ceph-mon0: 2017-07-11 14:49:14.689218 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.631907) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #113 started
- 2017-07-11 14:49:14.689319 I | rook-ceph-mon0: 2017-07-11 14:49:14.689304 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.689164) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #113: memtable #1 done
- 2017-07-11 14:49:14.689338 I | rook-ceph-mon0: 2017-07-11 14:49:14.689326 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.689189) EVENT_LOG_v1 {"time_micros": 1499784554689183, "job": 71, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:49:14.689356 I | rook-ceph-mon0: 2017-07-11 14:49:14.689344 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.689206) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:49:14.689360 I | rook-ceph-mon0:
- 2017-07-11 14:49:14.689392 I | rook-ceph-mon0: 2017-07-11 14:49:14.689379 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 71] Try to delete WAL files size 646436, prev total WAL file size 666078, number of live WAL files 2.
- 2017-07-11 14:49:14.689397 I | rook-ceph-mon0:
- 2017-07-11 14:49:14.693703 I | rook-ceph-mon0: 2017-07-11 14:49:14.689652 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:49:14.693825 I | rook-ceph-mon0: 2017-07-11 14:49:14.689687 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.689680) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:49:14.693842 I | rook-ceph-mon0:
- 2017-07-11 14:49:14.693868 I | rook-ceph-mon0: 2017-07-11 14:49:14.689691 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 72] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:49:14.693883 I | rook-ceph-mon0: 2017-07-11 14:49:14.689695 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 71 Base level 0, inputs: [113(630KB)], [111(16MB)]
- 2017-07-11 14:49:14.693895 I | rook-ceph-mon0:
- 2017-07-11 14:49:14.693917 I | rook-ceph-mon0: 2017-07-11 14:49:14.689705 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554689698, "job": 72, "event": "compaction_started", "files_L0": [113], "files_L1": [111], "score": -1, "input_data_size": 17461527}
- 2017-07-11 14:49:14.859476 I | rook-ceph-mon0: 2017-07-11 14:49:14.859326 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:14.859561 I | rook-ceph-mon0: 2017-07-11 14:49:14.859348 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3957335980' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:14.894474 I | rook-ceph-mon0: 2017-07-11 14:49:14.894428 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 72] Generated table #114: 2021 keys, 14374779 bytes
- 2017-07-11 14:49:14.894664 I | rook-ceph-mon0: 2017-07-11 14:49:14.894591 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554894571, "cf_name": "default", "job": 72, "event": "table_file_creation", "file_number": 114, "file_size": 14374779, "table_properties": {"data_size": 14328676, "index_size": 45284, "filter_size": 0, "raw_key_size": 38694, "raw_average_key_size": 19, "raw_value_size": 14268790, "raw_average_value_size": 7060, "num_data_blocks": 1394, "num_entries": 2021, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:49:14.941382 I | rook-ceph-mon0: 2017-07-11 14:49:14.941327 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 72] Compacted 1@0 + 1@1 files to L1 => 14374779 bytes
- 2017-07-11 14:49:15.035535 I | rook-ceph-mon0: 2017-07-11 14:49:15.035490 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.035390) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 69.4 rd, 57.1 wr, level 1, files in(1, 1) out(1) MB in(0.6, 16.0) out(13.7), read-write-amplify(49.3) write-amplify(22.3) OK, records in: 3036, records dropped: 1015
- 2017-07-11 14:49:15.035618 I | rook-ceph-mon0:
- 2017-07-11 14:49:15.035683 I | rook-ceph-mon0: 2017-07-11 14:49:15.035637 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.035416) EVENT_LOG_v1 {"time_micros": 1499784555035407, "job": 72, "event": "compaction_finished", "compaction_time_micros": 251597, "output_level": 1, "num_output_files": 1, "total_output_size": 14374779, "num_input_records": 3036, "num_output_records": 2021, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:49:15.036032 I | rook-ceph-mon0: 2017-07-11 14:49:15.036016 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555036014, "job": 72, "event": "table_file_deletion", "file_number": 113}
- 2017-07-11 14:49:15.038200 I | rook-ceph-mon0: 2017-07-11 14:49:15.038174 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555038172, "job": 72, "event": "table_file_deletion", "file_number": 111}
- 2017-07-11 14:49:15.038545 I | rook-ceph-mon0: 2017-07-11 14:49:15.038457 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #115. Immutable memtables: 0.
- 2017-07-11 14:49:15.038580 I | rook-ceph-mon0:
- 2017-07-11 14:49:15.038595 I | rook-ceph-mon0: 2017-07-11 14:49:15.038497 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 73] Syncing log #112
- 2017-07-11 14:49:15.098674 I | rook-ceph-mon0: 2017-07-11 14:49:15.098304 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.038492) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:49:15.098900 I | rook-ceph-mon0: 2017-07-11 14:49:15.098324 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 73] Flushing memtable with next log file: 115
- 2017-07-11 14:49:15.098939 I | rook-ceph-mon0:
- 2017-07-11 14:49:15.098954 I | rook-ceph-mon0: 2017-07-11 14:49:15.098337 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555098332, "job": 73, "event": "flush_started", "num_memtables": 1, "num_entries": 7, "num_deletes": 0, "memory_usage": 21840}
- 2017-07-11 14:49:15.098981 I | rook-ceph-mon0: 2017-07-11 14:49:15.098344 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 73] Level-0 flush table #116: started
- 2017-07-11 14:49:15.118611 I | rook-ceph-mon0: 2017-07-11 14:49:15.118542 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555118522, "cf_name": "default", "job": 73, "event": "table_file_creation", "file_number": 116, "file_size": 20612, "table_properties": {"data_size": 19715, "index_size": 86, "filter_size": 0, "raw_key_size": 168, "raw_average_key_size": 24, "raw_value_size": 19494, "raw_average_value_size": 2784, "num_data_blocks": 3, "num_entries": 7, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:49:15.118661 I | rook-ceph-mon0: 2017-07-11 14:49:15.118552 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 73] Level-0 flush table #116: 20612 bytes OK
- 2017-07-11 14:49:15.161960 I | rook-ceph-mon0: 2017-07-11 14:49:15.161792 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.145604) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #116 started
- 2017-07-11 14:49:15.162025 I | rook-ceph-mon0: 2017-07-11 14:49:15.161799 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.161746) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #116: memtable #1 done
- 2017-07-11 14:49:15.162044 I | rook-ceph-mon0: 2017-07-11 14:49:15.161801 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.161765) EVENT_LOG_v1 {"time_micros": 1499784555161759, "job": 73, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:49:15.162057 I | rook-ceph-mon0: 2017-07-11 14:49:15.161802 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.161780) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:49:15.162088 I | rook-ceph-mon0:
- 2017-07-11 14:49:15.162101 I | rook-ceph-mon0: 2017-07-11 14:49:15.161807 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 73] Try to delete WAL files size 19642, prev total WAL file size 19642, number of live WAL files 2.
- 2017-07-11 14:49:15.162113 I | rook-ceph-mon0:
- 2017-07-11 14:49:15.162124 I | rook-ceph-mon0: 2017-07-11 14:49:15.161924 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:49:15.162201 I | rook-ceph-mon0: 2017-07-11 14:49:15.162184 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.162178) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:49:15.162218 I | rook-ceph-mon0:
- 2017-07-11 14:49:15.162265 I | rook-ceph-mon0: 2017-07-11 14:49:15.162233 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 74] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:49:15.162300 I | rook-ceph-mon0: 2017-07-11 14:49:15.162287 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 73 Base level 0, inputs: [116(20KB)], [114(13MB)]
- 2017-07-11 14:49:15.162331 I | rook-ceph-mon0:
- 2017-07-11 14:49:15.162371 I | rook-ceph-mon0: 2017-07-11 14:49:15.162357 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555162348, "job": 74, "event": "compaction_started", "files_L0": [116], "files_L1": [114], "score": -1, "input_data_size": 14395391}
- 2017-07-11 14:49:15.986585 I | rook-ceph-mon0: 2017-07-11 14:49:15.986535 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 74] Generated table #117: 2024 keys, 14394443 bytes
- 2017-07-11 14:49:15.986768 I | rook-ceph-mon0: 2017-07-11 14:49:15.986686 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555986676, "cf_name": "default", "job": 74, "event": "table_file_creation", "file_number": 117, "file_size": 14394443, "table_properties": {"data_size": 14348245, "index_size": 45379, "filter_size": 0, "raw_key_size": 38753, "raw_average_key_size": 19, "raw_value_size": 14288252, "raw_average_value_size": 7059, "num_data_blocks": 1397, "num_entries": 2024, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:49:16.043833 I | rook-ceph-mon0: 2017-07-11 14:49:16.043795 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 74] Compacted 1@0 + 1@1 files to L1 => 14394443 bytes
- 2017-07-11 14:49:16.059190 I | rook-ceph-mon0: 2017-07-11 14:49:16.059148 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:49:16.059031) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 16.3 rd, 16.3 wr, level 1, files in(1, 1) out(1) MB in(0.0, 13.7) out(13.7), read-write-amplify(1396.8) write-amplify(698.4) OK, records in: 2028, records dropped: 4
- 2017-07-11 14:49:16.059270 I | rook-ceph-mon0:
- 2017-07-11 14:49:16.059306 I | rook-ceph-mon0: 2017-07-11 14:49:16.059290 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:49:16.059055) EVENT_LOG_v1 {"time_micros": 1499784556059046, "job": 74, "event": "compaction_finished", "compaction_time_micros": 881395, "output_level": 1, "num_output_files": 1, "total_output_size": 14394443, "num_input_records": 2028, "num_output_records": 2024, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:49:16.059542 I | rook-ceph-mon0: 2017-07-11 14:49:16.059527 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784556059524, "job": 74, "event": "table_file_deletion", "file_number": 116}
- 2017-07-11 14:49:16.061434 I | rook-ceph-mon0: 2017-07-11 14:49:16.061417 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784556061415, "job": 74, "event": "table_file_deletion", "file_number": 114}
- 2017-07-11 14:49:17.331156 I | rook-ceph-mon0: 2017-07-11 14:49:17.331097 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:17.331280 I | rook-ceph-mon0: 2017-07-11 14:49:17.331264 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/786510145' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:18.394915 I | rook-ceph-mon0: 2017-07-11 14:49:18.394880 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:18.395109 I | rook-ceph-mon0: 2017-07-11 14:49:18.395024 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2055039622' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:19.152712 I | rook-ceph-mon0: 2017-07-11 14:49:19.152673 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:49:19.155229 I | rook-ceph-mon0: 2017-07-11 14:49:19.155206 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3125042007' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:49:19.658407 I | rook-ceph-mon0: 2017-07-11 14:49:19.658368 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:19.658631 I | rook-ceph-mon0: 2017-07-11 14:49:19.658591 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/44608232' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:20.635716 I | rook-ceph-mon0: 2017-07-11 14:49:20.635678 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:49:20.635810 I | rook-ceph-mon0: 2017-07-11 14:49:20.635782 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/664986937' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:49:22.296505 I | rook-ceph-mon0: 2017-07-11 14:49:22.296467 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:22.296681 I | rook-ceph-mon0: 2017-07-11 14:49:22.296602 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3331879926' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:23.771919 I | rook-ceph-mon0: 2017-07-11 14:49:23.771880 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:23.772117 I | rook-ceph-mon0: 2017-07-11 14:49:23.772031 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1838999145' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:26.010319 I | rook-ceph-mon0: 2017-07-11 14:49:26.010275 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:26.010512 I | rook-ceph-mon0: 2017-07-11 14:49:26.010428 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/24919298' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:26.643099 I | rook-ceph-mon0: 2017-07-11 14:49:26.643060 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:26.643311 I | rook-ceph-mon0: 2017-07-11 14:49:26.643210 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3032079708' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:28.545931 I | rook-ceph-mon0: 2017-07-11 14:49:28.545890 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:28.546148 I | rook-ceph-mon0: 2017-07-11 14:49:28.546069 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1950520317' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:29.558633 I | rook-ceph-mon0: 2017-07-11 14:49:29.558584 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:29.558701 I | rook-ceph-mon0: 2017-07-11 14:49:29.558686 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3419205609' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:30.503880 I | rook-ceph-mon0: 2017-07-11 14:49:30.503844 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:49:30.504130 I | rook-ceph-mon0: 2017-07-11 14:49:30.504114 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3468135628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:49:33.012167 I | rook-ceph-mon0: 2017-07-11 14:49:33.012130 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:33.012393 I | rook-ceph-mon0: 2017-07-11 14:49:33.012363 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/153986254' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:33.379937 I | rook-ceph-mon0: 2017-07-11 14:49:33.379898 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:33.380148 I | rook-ceph-mon0: 2017-07-11 14:49:33.380045 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/180766748' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:35.633185 I | rook-ceph-mon0: 2017-07-11 14:49:35.633151 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.1693s > max 0.05s
- 2017-07-11 14:49:36.574412 I | rook-ceph-mon0: 2017-07-11 14:49:35.633293 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1719 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.1693s > max 0.05s
- 2017-07-11 14:49:37.013312 I | rook-ceph-mon0: 2017-07-11 14:49:37.013273 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:37.013439 I | rook-ceph-mon0: 2017-07-11 14:49:37.013424 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3674836114' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:37.961281 I | rook-ceph-mon0: 2017-07-11 14:49:37.961243 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:37.961477 I | rook-ceph-mon0: 2017-07-11 14:49:37.961393 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2834645623' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:38.422680 I | rook-ceph-mon0: 2017-07-11 14:49:38.422630 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:38.422929 I | rook-ceph-mon0: 2017-07-11 14:49:38.422857 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2604396748' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:39.546921 I | rook-ceph-mon0: 2017-07-11 14:49:39.546883 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:39.547139 I | rook-ceph-mon0: 2017-07-11 14:49:39.547032 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3712388593' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:40.662205 I | rook-ceph-mon0: 2017-07-11 14:49:40.662169 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:40.662400 I | rook-ceph-mon0: 2017-07-11 14:49:40.662315 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1198995602' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:41.399790 I | rook-ceph-mon0: 2017-07-11 14:49:41.399751 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:41.399987 I | rook-ceph-mon0: 2017-07-11 14:49:41.399900 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/397237528' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:44.500558 I | rook-ceph-mon0: 2017-07-11 14:49:44.500522 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:44.500663 I | rook-ceph-mon0: 2017-07-11 14:49:44.500647 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3323067458' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:45.625070 I | rook-ceph-mon0: 2017-07-11 14:49:45.624797 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4824 MB, avail 94362 MB
- 2017-07-11 14:49:45.656032 I | rook-ceph-mon0: 2017-07-11 14:49:45.655994 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:49:45.656559 I | rook-ceph-mon0: 2017-07-11 14:49:45.656527 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4231462975' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:49:48.057689 I | rook-ceph-mon0: 2017-07-11 14:49:48.057648 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:48.057758 I | rook-ceph-mon0: 2017-07-11 14:49:48.057743 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3062344332' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:50.646979 I | rook-ceph-mon0: 2017-07-11 14:49:50.646939 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:49:50.647170 I | rook-ceph-mon0: 2017-07-11 14:49:50.647085 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2660050055' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:49:51.595558 I | rook-ceph-mon0: 2017-07-11 14:49:51.595520 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:51.595737 I | rook-ceph-mon0: 2017-07-11 14:49:51.595658 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1990242493' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:52.879421 I | rook-ceph-mon0: 2017-07-11 14:49:52.879387 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:52.879639 I | rook-ceph-mon0: 2017-07-11 14:49:52.879535 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3764935610' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:53.414164 I | rook-ceph-mon0: 2017-07-11 14:49:53.414126 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:53.414375 I | rook-ceph-mon0: 2017-07-11 14:49:53.414273 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1803864523' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:57.668348 I | rook-ceph-mon0: 2017-07-11 14:49:57.668303 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:57.668565 I | rook-ceph-mon0: 2017-07-11 14:49:57.668462 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/641174955' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:58.154415 I | rook-ceph-mon0: 2017-07-11 14:49:58.154368 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:58.154690 I | rook-ceph-mon0: 2017-07-11 14:49:58.154666 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1879371953' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:59.073037 I | rook-ceph-mon0: 2017-07-11 14:49:59.073004 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:59.073140 I | rook-ceph-mon0: 2017-07-11 14:49:59.073125 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/386792576' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:59.168362 I | rook-ceph-mon0: 2017-07-11 14:49:59.168325 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:59.168588 I | rook-ceph-mon0: 2017-07-11 14:49:59.168465 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2106354923' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:59.991040 I | rook-ceph-mon0: 2017-07-11 14:49:59.991000 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:49:59.991293 I | rook-ceph-mon0: 2017-07-11 14:49:59.991272 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1183663428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:50:00.921191 I | rook-ceph-mon0: 2017-07-11 14:50:00.921152 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:00.921260 I | rook-ceph-mon0: 2017-07-11 14:50:00.921244 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2096658136' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:03.032525 I | rook-ceph-mon0: 2017-07-11 14:50:03.032486 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:03.032735 I | rook-ceph-mon0: 2017-07-11 14:50:03.032632 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3028950365' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:03.149289 I | rook-ceph-mon0: 2017-07-11 14:50:03.149250 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:03.149420 I | rook-ceph-mon0: 2017-07-11 14:50:03.149405 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2844723078' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:04.043509 I | rook-ceph-mon0: 2017-07-11 14:50:04.043464 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:04.043740 I | rook-ceph-mon0: 2017-07-11 14:50:04.043614 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/819014402' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:06.887790 I | rook-ceph-mon0: 2017-07-11 14:50:06.887751 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:06.887984 I | rook-ceph-mon0: 2017-07-11 14:50:06.887899 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2395820261' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:10.108879 I | rook-ceph-mon0: 2017-07-11 14:50:10.108839 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:50:10.109116 I | rook-ceph-mon0: 2017-07-11 14:50:10.108989 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3184492828' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:50:17.334562 I | rook-ceph-mon0: 2017-07-11 14:50:17.334525 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:17.334759 I | rook-ceph-mon0: 2017-07-11 14:50:17.334672 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1466869317' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:18.036074 I | rook-ceph-mon0: 2017-07-11 14:50:18.036035 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:18.036268 I | rook-ceph-mon0: 2017-07-11 14:50:18.036180 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1568104839' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:18.317550 I | rook-ceph-mon0: 2017-07-11 14:50:18.317512 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:50:18.317673 I | rook-ceph-mon0: 2017-07-11 14:50:18.317657 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1294897585' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:50:20.647659 I | rook-ceph-mon0: 2017-07-11 14:50:20.647619 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:20.647938 I | rook-ceph-mon0: 2017-07-11 14:50:20.647887 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1118443559' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:22.814615 I | rook-ceph-mon0: 2017-07-11 14:50:22.814575 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:22.814840 I | rook-ceph-mon0: 2017-07-11 14:50:22.814810 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/184161373' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:23.282300 I | rook-ceph-mon0: 2017-07-11 14:50:23.282262 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:50:23.282494 I | rook-ceph-mon0: 2017-07-11 14:50:23.282408 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/893452390' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:50:23.952213 I | rook-ceph-mon0: 2017-07-11 14:50:23.952106 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #118. Immutable memtables: 0.
- 2017-07-11 14:50:23.952351 I | rook-ceph-mon0:
- 2017-07-11 14:50:23.952373 I | rook-ceph-mon0: 2017-07-11 14:50:23.952143 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 75] Syncing log #115
- 2017-07-11 14:50:24.016575 I | rook-ceph-mon0: 2017-07-11 14:50:24.014327 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:50:23.952138) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:50:24.016673 I | rook-ceph-mon0: 2017-07-11 14:50:24.014342 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 75] Flushing memtable with next log file: 118
- 2017-07-11 14:50:24.016706 I | rook-ceph-mon0:
- 2017-07-11 14:50:24.016722 I | rook-ceph-mon0: 2017-07-11 14:50:24.014353 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624014349, "job": 75, "event": "flush_started", "num_memtables": 1, "num_entries": 884, "num_deletes": 251, "memory_usage": 1785656}
- 2017-07-11 14:50:24.016734 I | rook-ceph-mon0: 2017-07-11 14:50:24.014356 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 75] Level-0 flush table #119: started
- 2017-07-11 14:50:24.062375 I | rook-ceph-mon0: 2017-07-11 14:50:24.062294 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624062285, "cf_name": "default", "job": 75, "event": "table_file_creation", "file_number": 119, "file_size": 1763004, "table_properties": {"data_size": 1756486, "index_size": 5703, "filter_size": 0, "raw_key_size": 9034, "raw_average_key_size": 18, "raw_value_size": 1745837, "raw_average_value_size": 3592, "num_data_blocks": 182, "num_entries": 486, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:50:24.062569 I | rook-ceph-mon0: 2017-07-11 14:50:24.062480 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 75] Level-0 flush table #119: 1763004 bytes OK
- 2017-07-11 14:50:24.093948 I | rook-ceph-mon0: 2017-07-11 14:50:24.093902 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.077778) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #119 started
- 2017-07-11 14:50:24.094199 I | rook-ceph-mon0: 2017-07-11 14:50:24.094099 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.093851) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #119: memtable #1 done
- 2017-07-11 14:50:24.094275 I | rook-ceph-mon0: 2017-07-11 14:50:24.094256 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.093873) EVENT_LOG_v1 {"time_micros": 1499784624093867, "job": 75, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:50:24.094323 I | rook-ceph-mon0: 2017-07-11 14:50:24.094294 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.093889) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:50:24.094339 I | rook-ceph-mon0:
- 2017-07-11 14:50:24.094401 I | rook-ceph-mon0: 2017-07-11 14:50:24.094358 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 75] Try to delete WAL files size 1765891, prev total WAL file size 1765891, number of live WAL files 2.
- 2017-07-11 14:50:24.094419 I | rook-ceph-mon0:
- 2017-07-11 14:50:24.102154 I | rook-ceph-mon0: 2017-07-11 14:50:24.094903 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:50:24.102204 I | rook-ceph-mon0: 2017-07-11 14:50:24.094941 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.094935) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:50:24.102226 I | rook-ceph-mon0:
- 2017-07-11 14:50:24.102240 I | rook-ceph-mon0: 2017-07-11 14:50:24.094945 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 76] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:50:24.102267 I | rook-ceph-mon0: 2017-07-11 14:50:24.094950 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 75 Base level 0, inputs: [119(1721KB)], [117(13MB)]
- 2017-07-11 14:50:24.102280 I | rook-ceph-mon0:
- 2017-07-11 14:50:24.102292 I | rook-ceph-mon0: 2017-07-11 14:50:24.094960 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624094953, "job": 76, "event": "compaction_started", "files_L0": [119], "files_L1": [117], "score": -1, "input_data_size": 16157447}
- 2017-07-11 14:50:24.235919 I | rook-ceph-mon0: 2017-07-11 14:50:24.235864 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 76] Generated table #120: 2001 keys, 13595849 bytes
- 2017-07-11 14:50:24.236111 I | rook-ceph-mon0: 2017-07-11 14:50:24.236025 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624236015, "cf_name": "default", "job": 76, "event": "table_file_creation", "file_number": 120, "file_size": 13595849, "table_properties": {"data_size": 13551539, "index_size": 43491, "filter_size": 0, "raw_key_size": 38566, "raw_average_key_size": 19, "raw_value_size": 13493104, "raw_average_value_size": 6743, "num_data_blocks": 1327, "num_entries": 2001, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:50:24.282768 I | rook-ceph-mon0: 2017-07-11 14:50:24.282711 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 76] Compacted 1@0 + 1@1 files to L1 => 13595849 bytes
- 2017-07-11 14:50:24.298824 I | rook-ceph-mon0: 2017-07-11 14:50:24.298783 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.298669) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 86.1 rd, 72.4 wr, level 1, files in(1, 1) out(1) MB in(1.7, 13.7) out(13.0), read-write-amplify(16.9) write-amplify(7.7) OK, records in: 2510, records dropped: 509
- 2017-07-11 14:50:24.298891 I | rook-ceph-mon0:
- 2017-07-11 14:50:24.298929 I | rook-ceph-mon0: 2017-07-11 14:50:24.298913 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.298693) EVENT_LOG_v1 {"time_micros": 1499784624298684, "job": 76, "event": "compaction_finished", "compaction_time_micros": 187721, "output_level": 1, "num_output_files": 1, "total_output_size": 13595849, "num_input_records": 2510, "num_output_records": 2001, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:50:24.299412 I | rook-ceph-mon0: 2017-07-11 14:50:24.299397 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624299391, "job": 76, "event": "table_file_deletion", "file_number": 119}
- 2017-07-11 14:50:24.308790 I | rook-ceph-mon0: 2017-07-11 14:50:24.308763 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624308759, "job": 76, "event": "table_file_deletion", "file_number": 117}
- 2017-07-11 14:50:28.630453 I | rook-ceph-mon0: 2017-07-11 14:50:28.630415 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:28.630652 I | rook-ceph-mon0: 2017-07-11 14:50:28.630564 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1452991715' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:29.160470 I | rook-ceph-mon0: 2017-07-11 14:50:29.160431 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:29.160697 I | rook-ceph-mon0: 2017-07-11 14:50:29.160581 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/223429504' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:29.566829 I | rook-ceph-mon0: 2017-07-11 14:50:29.566790 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:50:29.567044 I | rook-ceph-mon0: 2017-07-11 14:50:29.567014 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/170313795' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:50:30.505429 I | rook-ceph-mon0: 2017-07-11 14:50:30.505390 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:30.505647 I | rook-ceph-mon0: 2017-07-11 14:50:30.505609 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3827085145' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:33.638983 I | rook-ceph-mon0: 2017-07-11 14:50:33.638944 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:33.639238 I | rook-ceph-mon0: 2017-07-11 14:50:33.639092 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3870032405' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:35.754648 I | rook-ceph-mon0: 2017-07-11 14:50:35.754614 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:35.754859 I | rook-ceph-mon0: 2017-07-11 14:50:35.754755 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/447445851' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:36.715261 I | rook-ceph-mon0: 2017-07-11 14:50:36.715222 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:36.715474 I | rook-ceph-mon0: 2017-07-11 14:50:36.715440 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2298939938' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:37.068826 I | rook-ceph-mon0: 2017-07-11 14:50:37.068786 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:37.069055 I | rook-ceph-mon0: 2017-07-11 14:50:37.068938 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1522879626' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:37.568143 I | rook-ceph-mon0: 2017-07-11 14:50:37.568103 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:37.568358 I | rook-ceph-mon0: 2017-07-11 14:50:37.568273 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1262295075' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:38.618010 I | rook-ceph-mon0: 2017-07-11 14:50:38.617970 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:38.618233 I | rook-ceph-mon0: 2017-07-11 14:50:38.618194 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3427674419' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:42.404436 I | rook-ceph-mon0: 2017-07-11 14:50:42.404398 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:42.404671 I | rook-ceph-mon0: 2017-07-11 14:50:42.404625 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3534958450' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:42.844710 I | rook-ceph-mon0: 2017-07-11 14:50:42.844672 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:50:42.844884 I | rook-ceph-mon0: 2017-07-11 14:50:42.844806 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/884048954' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:50:43.378029 I | rook-ceph-mon0: 2017-07-11 14:50:43.377992 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:43.378217 I | rook-ceph-mon0: 2017-07-11 14:50:43.378135 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/175563421' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:44.188513 I | rook-ceph-mon0: 2017-07-11 14:50:44.188474 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:44.188717 I | rook-ceph-mon0: 2017-07-11 14:50:44.188634 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/581234904' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:45.625267 I | rook-ceph-mon0: 2017-07-11 14:50:45.625090 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4824 MB, avail 94363 MB
- 2017-07-11 14:50:47.448481 I | rook-ceph-mon0: 2017-07-11 14:50:47.448442 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:47.448695 I | rook-ceph-mon0: 2017-07-11 14:50:47.448593 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1490205943' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:48.400588 I | rook-ceph-mon0: 2017-07-11 14:50:48.400551 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:48.400812 I | rook-ceph-mon0: 2017-07-11 14:50:48.400773 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1688688221' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:49.368010 I | rook-ceph-mon0: 2017-07-11 14:50:49.367974 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:50:49.368267 I | rook-ceph-mon0: 2017-07-11 14:50:49.368251 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2835016957' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:50:51.882970 I | rook-ceph-mon0: 2017-07-11 14:50:51.882928 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:51.883194 I | rook-ceph-mon0: 2017-07-11 14:50:51.883081 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1100297310' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:52.386714 I | rook-ceph-mon0: 2017-07-11 14:50:52.386669 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:52.386911 I | rook-ceph-mon0: 2017-07-11 14:50:52.386824 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1999067405' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:55.338397 I | rook-ceph-mon0: 2017-07-11 14:50:55.338356 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:55.338611 I | rook-ceph-mon0: 2017-07-11 14:50:55.338507 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2131545678' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:58.862123 I | rook-ceph-mon0: 2017-07-11 14:50:58.862047 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:58.862361 I | rook-ceph-mon0: 2017-07-11 14:50:58.862343 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1363414440' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:00.134419 I | rook-ceph-mon0: 2017-07-11 14:51:00.134379 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:00.134616 I | rook-ceph-mon0: 2017-07-11 14:51:00.134528 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1339502634' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:01.650535 I | rook-ceph-mon0: 2017-07-11 14:51:01.650484 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:01.650774 I | rook-ceph-mon0: 2017-07-11 14:51:01.650757 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2275839663' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:02.530796 I | rook-ceph-mon0: 2017-07-11 14:51:02.530755 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:51:02.531010 I | rook-ceph-mon0: 2017-07-11 14:51:02.530910 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/379615811' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:51:02.766376 I | rook-ceph-mon0: 2017-07-11 14:51:02.766337 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:02.766571 I | rook-ceph-mon0: 2017-07-11 14:51:02.766485 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3064769758' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:04.931639 I | rook-ceph-mon0: 2017-07-11 14:51:04.931599 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:04.931852 I | rook-ceph-mon0: 2017-07-11 14:51:04.931751 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3052753126' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:06.417033 I | rook-ceph-mon0: 2017-07-11 14:51:06.416950 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:06.417119 I | rook-ceph-mon0: 2017-07-11 14:51:06.416973 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3150004844' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:07.587375 I | rook-ceph-mon0: 2017-07-11 14:51:07.587327 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:51:07.587620 I | rook-ceph-mon0: 2017-07-11 14:51:07.587603 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/275177542' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:51:08.958772 I | rook-ceph-mon0: 2017-07-11 14:51:08.958735 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:51:08.958997 I | rook-ceph-mon0: 2017-07-11 14:51:08.958956 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/932725372' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:51:09.895334 I | rook-ceph-mon0: 2017-07-11 14:51:09.895098 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:09.895522 I | rook-ceph-mon0: 2017-07-11 14:51:09.895119 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1789772739' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:09.906165 I | rook-ceph-mon0: 2017-07-11 14:51:09.906004 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:09.906224 I | rook-ceph-mon0: 2017-07-11 14:51:09.906022 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1640338985' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:11.930302 I | rook-ceph-mon0: 2017-07-11 14:51:11.930222 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:11.930396 I | rook-ceph-mon0: 2017-07-11 14:51:11.930243 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1985871567' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:14.016077 I | rook-ceph-mon0: 2017-07-11 14:51:14.016036 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:14.016299 I | rook-ceph-mon0: 2017-07-11 14:51:14.016259 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/391566825' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:18.089934 I | rook-ceph-mon0: 2017-07-11 14:51:18.089895 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:18.090003 I | rook-ceph-mon0: 2017-07-11 14:51:18.089988 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2255692316' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:20.102491 I | rook-ceph-mon0: 2017-07-11 14:51:20.102356 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:20.102582 I | rook-ceph-mon0: 2017-07-11 14:51:20.102379 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1543406920' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:22.035508 I | rook-ceph-mon0: 2017-07-11 14:51:22.035468 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:22.035720 I | rook-ceph-mon0: 2017-07-11 14:51:22.035620 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/173635858' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:22.515552 I | rook-ceph-mon0: 2017-07-11 14:51:22.515514 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:51:22.515894 I | rook-ceph-mon0: 2017-07-11 14:51:22.515872 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/412568931' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:51:25.300818 I | rook-ceph-mon0: 2017-07-11 14:51:25.300679 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:25.300884 I | rook-ceph-mon0: 2017-07-11 14:51:25.300699 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2749479932' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:27.196634 I | rook-ceph-mon0: 2017-07-11 14:51:27.196592 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:51:27.196848 I | rook-ceph-mon0: 2017-07-11 14:51:27.196745 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2465838807' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:51:31.251195 I | rook-ceph-mon0: 2017-07-11 14:51:31.251159 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:31.251269 I | rook-ceph-mon0: 2017-07-11 14:51:31.251248 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1484130890' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:32.170364 I | rook-ceph-mon0: 2017-07-11 14:51:32.170323 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:32.170584 I | rook-ceph-mon0: 2017-07-11 14:51:32.170550 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3036384961' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:33.599684 I | rook-ceph-mon0: 2017-07-11 14:51:33.599647 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:51:33.599898 I | rook-ceph-mon0: 2017-07-11 14:51:33.599863 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3547761682' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:51:34.538943 I | rook-ceph-mon0: 2017-07-11 14:51:34.538906 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:34.539204 I | rook-ceph-mon0: 2017-07-11 14:51:34.539186 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3886632755' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:36.469946 I | rook-ceph-mon0: 2017-07-11 14:51:36.469901 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:36.470139 I | rook-ceph-mon0: 2017-07-11 14:51:36.470053 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2471903700' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:37.880567 I | rook-ceph-mon0: 2017-07-11 14:51:37.880528 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:37.880798 I | rook-ceph-mon0: 2017-07-11 14:51:37.880781 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2207889326' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:40.042037 I | rook-ceph-mon0: 2017-07-11 14:51:40.041998 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:40.042249 I | rook-ceph-mon0: 2017-07-11 14:51:40.042148 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1381743889' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:41.572759 I | rook-ceph-mon0: 2017-07-11 14:51:41.572707 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:41.572990 I | rook-ceph-mon0: 2017-07-11 14:51:41.572961 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1744754721' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:43.351573 I | rook-ceph-mon0: 2017-07-11 14:51:43.351536 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:43.351815 I | rook-ceph-mon0: 2017-07-11 14:51:43.351798 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1922940426' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:45.625516 I | rook-ceph-mon0: 2017-07-11 14:51:45.625354 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4824 MB, avail 94363 MB
- 2017-07-11 14:51:46.086997 I | rook-ceph-mon0: 2017-07-11 14:51:46.086866 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:46.087090 I | rook-ceph-mon0: 2017-07-11 14:51:46.086889 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1824990589' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:47.469138 I | rook-ceph-mon0: 2017-07-11 14:51:47.469101 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:47.469364 I | rook-ceph-mon0: 2017-07-11 14:51:47.469286 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2308202784' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:51.110920 I | rook-ceph-mon0: 2017-07-11 14:51:51.110880 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:51.111133 I | rook-ceph-mon0: 2017-07-11 14:51:51.111031 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/780501201' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:51.125767 I | rook-ceph-mon0: 2017-07-11 14:51:51.125744 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:51.125850 I | rook-ceph-mon0: 2017-07-11 14:51:51.125836 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2324553254' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:51.611502 I | rook-ceph-mon0: 2017-07-11 14:51:51.611464 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:51.611627 I | rook-ceph-mon0: 2017-07-11 14:51:51.611612 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1320539558' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:52.087715 I | rook-ceph-mon0: 2017-07-11 14:51:52.087677 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:51:52.087934 I | rook-ceph-mon0: 2017-07-11 14:51:52.087823 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/264440794' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:51:52.541772 I | rook-ceph-mon0: 2017-07-11 14:51:52.541733 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:52.541841 I | rook-ceph-mon0: 2017-07-11 14:51:52.541827 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1131878405' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:53.482783 I | rook-ceph-mon0: 2017-07-11 14:51:53.482745 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:51:53.482999 I | rook-ceph-mon0: 2017-07-11 14:51:53.482970 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/802259814' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:51:54.481569 I | rook-ceph-mon0: 2017-07-11 14:51:54.481523 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:54.481873 I | rook-ceph-mon0: 2017-07-11 14:51:54.481834 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2636640989' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:56.775871 I | rook-ceph-mon0: 2017-07-11 14:51:56.775833 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:51:56.776241 I | rook-ceph-mon0: 2017-07-11 14:51:56.775979 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/938904634' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:51:59.088165 I | rook-ceph-mon0: 2017-07-11 14:51:59.088127 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:59.088379 I | rook-ceph-mon0: 2017-07-11 14:51:59.088275 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1351265206' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:00.803370 I | rook-ceph-mon0: 2017-07-11 14:52:00.803328 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:00.803584 I | rook-ceph-mon0: 2017-07-11 14:52:00.803482 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3019762930' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:01.666464 I | rook-ceph-mon0: 2017-07-11 14:52:01.666425 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:52:01.666587 I | rook-ceph-mon0: 2017-07-11 14:52:01.666571 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/447727848' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:52:02.190498 I | rook-ceph-mon0: 2017-07-11 14:52:02.190461 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:02.190753 I | rook-ceph-mon0: 2017-07-11 14:52:02.190667 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3624046115' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:02.390925 I | rook-ceph-mon0: 2017-07-11 14:52:02.390887 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:02.391122 I | rook-ceph-mon0: 2017-07-11 14:52:02.391035 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3201676603' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:05.586786 I | rook-ceph-mon0: 2017-07-11 14:52:05.586746 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:05.586860 I | rook-ceph-mon0: 2017-07-11 14:52:05.586842 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1894609694' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:10.037415 I | rook-ceph-mon0: 2017-07-11 14:52:10.037340 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:10.037737 I | rook-ceph-mon0: 2017-07-11 14:52:10.037470 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4195151903' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:10.679542 I | rook-ceph-mon0: 2017-07-11 14:52:10.679506 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:10.679686 I | rook-ceph-mon0: 2017-07-11 14:52:10.679648 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1178128178' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:11.144818 I | rook-ceph-mon0: 2017-07-11 14:52:11.144780 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:11.144970 I | rook-ceph-mon0: 2017-07-11 14:52:11.144927 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1844582014' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:13.403950 I | rook-ceph-mon0: 2017-07-11 14:52:13.403909 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:13.404144 I | rook-ceph-mon0: 2017-07-11 14:52:13.404060 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3693282543' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:15.629425 I | rook-ceph-mon0: 2017-07-11 14:52:15.629390 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:15.629498 I | rook-ceph-mon0: 2017-07-11 14:52:15.629481 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3344492219' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:16.068619 I | rook-ceph-mon0: 2017-07-11 14:52:16.068581 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:16.074185 I | rook-ceph-mon0: 2017-07-11 14:52:16.074161 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2735400185' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:19.003926 I | rook-ceph-mon0: 2017-07-11 14:52:19.003884 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:19.004043 I | rook-ceph-mon0: 2017-07-11 14:52:19.004027 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1497855988' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:20.603373 I | rook-ceph-mon0: 2017-07-11 14:52:20.603335 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:20.603620 I | rook-ceph-mon0: 2017-07-11 14:52:20.603491 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/945716148' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:21.120872 I | rook-ceph-mon0: 2017-07-11 14:52:21.120835 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:21.121061 I | rook-ceph-mon0: 2017-07-11 14:52:21.120978 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1970646909' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:21.536248 I | rook-ceph-mon0: 2017-07-11 14:52:21.536208 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:52:21.536314 I | rook-ceph-mon0: 2017-07-11 14:52:21.536298 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1604408686' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:52:21.978047 I | rook-ceph-mon0: 2017-07-11 14:52:21.978012 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:21.978281 I | rook-ceph-mon0: 2017-07-11 14:52:21.978146 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1406306882' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:22.906201 I | rook-ceph-mon0: 2017-07-11 14:52:22.906163 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:52:22.906433 I | rook-ceph-mon0: 2017-07-11 14:52:22.906392 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3145698553' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:52:24.823946 I | rook-ceph-mon0: 2017-07-11 14:52:24.823906 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:24.830143 I | rook-ceph-mon0: 2017-07-11 14:52:24.824057 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3785718119' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:26.516772 I | rook-ceph-mon0: 2017-07-11 14:52:26.516735 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:52:26.517002 I | rook-ceph-mon0: 2017-07-11 14:52:26.516973 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4174877546' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:52:27.862539 I | rook-ceph-mon0: 2017-07-11 14:52:27.862503 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:52:27.863280 I | rook-ceph-mon0: 2017-07-11 14:52:27.863227 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1086530963' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:52:28.788586 I | rook-ceph-mon0: 2017-07-11 14:52:28.788546 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:28.788801 I | rook-ceph-mon0: 2017-07-11 14:52:28.788697 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1885272217' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:31.700002 I | rook-ceph-mon0: 2017-07-11 14:52:31.699687 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:31.700096 I | rook-ceph-mon0: 2017-07-11 14:52:31.699708 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2036427872' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:35.471811 I | rook-ceph-mon0: 2017-07-11 14:52:35.471752 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:35.472090 I | rook-ceph-mon0: 2017-07-11 14:52:35.471951 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3658902916' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:35.897812 I | rook-ceph-mon0: 2017-07-11 14:52:35.897774 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:35.897933 I | rook-ceph-mon0: 2017-07-11 14:52:35.897915 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/383862171' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:37.931453 I | rook-ceph-mon0: 2017-07-11 14:52:37.931414 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:52:37.931759 I | rook-ceph-mon0: 2017-07-11 14:52:37.931686 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3985739675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:52:38.921593 I | rook-ceph-mon0: 2017-07-11 14:52:38.921559 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:38.921782 I | rook-ceph-mon0: 2017-07-11 14:52:38.921695 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2103861295' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:39.245131 I | rook-ceph-mon0: 2017-07-11 14:52:39.245095 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:39.245274 I | rook-ceph-mon0: 2017-07-11 14:52:39.245259 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/543687777' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:40.201935 I | rook-ceph-mon0: 2017-07-11 14:52:40.195301 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:40.214687 I | rook-ceph-mon0: 2017-07-11 14:52:40.214660 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3090478186' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:41.177072 I | rook-ceph-mon0: 2017-07-11 14:52:41.177008 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:52:41.177311 I | rook-ceph-mon0: 2017-07-11 14:52:41.177265 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2025708940' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:52:41.669636 I | rook-ceph-mon0: 2017-07-11 14:52:41.669598 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:41.669701 I | rook-ceph-mon0: 2017-07-11 14:52:41.669686 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2185028092' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:42.677376 I | rook-ceph-mon0: 2017-07-11 14:52:42.677337 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:52:42.677626 I | rook-ceph-mon0: 2017-07-11 14:52:42.677610 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1785900229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:52:43.280518 I | rook-ceph-mon0: 2017-07-11 14:52:43.280478 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:43.280712 I | rook-ceph-mon0: 2017-07-11 14:52:43.280628 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1369792185' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:43.664116 I | rook-ceph-mon0: 2017-07-11 14:52:43.664078 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:43.664184 I | rook-ceph-mon0: 2017-07-11 14:52:43.664169 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3620934331' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:45.625792 I | rook-ceph-mon0: 2017-07-11 14:52:45.625651 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4824 MB, avail 94363 MB
- 2017-07-11 14:52:45.703629 I | rook-ceph-mon0: 2017-07-11 14:52:45.703591 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:45.703695 I | rook-ceph-mon0: 2017-07-11 14:52:45.703680 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3841244801' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:48.558505 I | rook-ceph-mon0: 2017-07-11 14:52:48.558467 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:48.558575 I | rook-ceph-mon0: 2017-07-11 14:52:48.558559 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1027640891' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:50.413114 I | rook-ceph-mon0: 2017-07-11 14:52:50.413077 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:50.413179 I | rook-ceph-mon0: 2017-07-11 14:52:50.413164 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/895345705' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:54.018296 I | rook-ceph-mon0: 2017-07-11 14:52:54.018261 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:54.018552 I | rook-ceph-mon0: 2017-07-11 14:52:54.018400 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1098624694' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:01.435370 I | rook-ceph-mon0: 2017-07-11 14:53:01.435331 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:01.435581 I | rook-ceph-mon0: 2017-07-11 14:53:01.435481 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3975423811' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:06.359678 I | rook-ceph-mon0: 2017-07-11 14:53:06.359641 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:06.359895 I | rook-ceph-mon0: 2017-07-11 14:53:06.359786 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2614186301' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:09.358301 I | rook-ceph-mon0: 2017-07-11 14:53:09.358263 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:09.358511 I | rook-ceph-mon0: 2017-07-11 14:53:09.358411 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1326110458' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:09.722321 I | rook-ceph-mon0: 2017-07-11 14:53:09.722281 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:09.722573 I | rook-ceph-mon0: 2017-07-11 14:53:09.722556 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2362252146' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:12.891848 I | rook-ceph-mon0: 2017-07-11 14:53:12.891802 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:12.892070 I | rook-ceph-mon0: 2017-07-11 14:53:12.892039 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/772575418' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:16.218268 I | rook-ceph-mon0: 2017-07-11 14:53:16.218230 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:16.218518 I | rook-ceph-mon0: 2017-07-11 14:53:16.218450 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2350491720' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:16.597238 I | rook-ceph-mon0: 2017-07-11 14:53:16.597193 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:16.597366 I | rook-ceph-mon0: 2017-07-11 14:53:16.597350 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2813107320' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:20.667405 I | rook-ceph-mon0: 2017-07-11 14:53:20.667328 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:53:20.667442 I | rook-ceph-mon0: 2017-07-11 14:53:20.667348 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2593776286' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:53:22.967935 I | rook-ceph-mon0: 2017-07-11 14:53:22.967894 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:22.968178 I | rook-ceph-mon0: 2017-07-11 14:53:22.968055 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2104208337' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:23.703238 I | rook-ceph-mon0: 2017-07-11 14:53:23.703198 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:23.703430 I | rook-ceph-mon0: 2017-07-11 14:53:23.703348 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3821543326' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:24.989427 I | rook-ceph-mon0: 2017-07-11 14:53:24.989389 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:24.989622 I | rook-ceph-mon0: 2017-07-11 14:53:24.989536 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/37525461' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:25.587171 I | rook-ceph-mon0: 2017-07-11 14:53:25.587128 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:53:25.592973 I | rook-ceph-mon0: 2017-07-11 14:53:25.592946 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4001761903' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:53:26.038266 I | rook-ceph-mon0: 2017-07-11 14:53:26.038230 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:26.038447 I | rook-ceph-mon0: 2017-07-11 14:53:26.038366 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1173524933' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:26.910751 I | rook-ceph-mon0: 2017-07-11 14:53:26.910712 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:53:26.910992 I | rook-ceph-mon0: 2017-07-11 14:53:26.910975 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/610231344' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:53:27.806098 I | rook-ceph-mon0: 2017-07-11 14:53:27.806061 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:27.806294 I | rook-ceph-mon0: 2017-07-11 14:53:27.806204 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3111178974' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:27.841214 I | rook-ceph-mon0: 2017-07-11 14:53:27.841180 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:27.841329 I | rook-ceph-mon0: 2017-07-11 14:53:27.841314 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3684478236' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:29.904801 I | rook-ceph-mon0: 2017-07-11 14:53:29.904764 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:29.905030 I | rook-ceph-mon0: 2017-07-11 14:53:29.905014 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4100633767' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:30.887977 I | rook-ceph-mon0: 2017-07-11 14:53:30.887938 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:30.888171 I | rook-ceph-mon0: 2017-07-11 14:53:30.888086 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3880413203' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:32.670879 I | rook-ceph-mon0: 2017-07-11 14:53:32.670839 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:32.671115 I | rook-ceph-mon0: 2017-07-11 14:53:32.671070 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3534958708' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:36.996652 I | rook-ceph-mon0: 2017-07-11 14:53:36.996614 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:53:36.996862 I | rook-ceph-mon0: 2017-07-11 14:53:36.996771 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/682172941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:53:40.516218 I | rook-ceph-mon0: 2017-07-11 14:53:40.516130 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #121. Immutable memtables: 0.
- 2017-07-11 14:53:40.516326 I | rook-ceph-mon0:
- 2017-07-11 14:53:40.516363 I | rook-ceph-mon0: 2017-07-11 14:53:40.516173 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 77] Syncing log #118
- 2017-07-11 14:53:40.621650 I | rook-ceph-mon0: 2017-07-11 14:53:40.536535 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.516168) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:53:40.621668 I | rook-ceph-mon0: 2017-07-11 14:53:40.536545 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 77] Flushing memtable with next log file: 121
- 2017-07-11 14:53:40.621671 I | rook-ceph-mon0:
- 2017-07-11 14:53:40.621676 I | rook-ceph-mon0: 2017-07-11 14:53:40.536555 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784820536550, "job": 77, "event": "flush_started", "num_memtables": 1, "num_entries": 2060, "num_deletes": 251, "memory_usage": 5109080}
- 2017-07-11 14:53:40.621679 I | rook-ceph-mon0: 2017-07-11 14:53:40.536557 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 77] Level-0 flush table #122: started
- 2017-07-11 14:53:40.704233 I | rook-ceph-mon0: 2017-07-11 14:53:40.704173 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784820704163, "cf_name": "default", "job": 77, "event": "table_file_creation", "file_number": 122, "file_size": 5054475, "table_properties": {"data_size": 5036974, "index_size": 16681, "filter_size": 0, "raw_key_size": 17109, "raw_average_key_size": 18, "raw_value_size": 5012797, "raw_average_value_size": 5502, "num_data_blocks": 522, "num_entries": 911, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:53:40.704382 I | rook-ceph-mon0: 2017-07-11 14:53:40.704328 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 77] Level-0 flush table #122: 5054475 bytes OK
- 2017-07-11 14:53:40.751843 I | rook-ceph-mon0: 2017-07-11 14:53:40.751811 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.722400) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #122 started
- 2017-07-11 14:53:40.751916 I | rook-ceph-mon0: 2017-07-11 14:53:40.751900 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.751773) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #122: memtable #1 done
- 2017-07-11 14:53:40.751980 I | rook-ceph-mon0: 2017-07-11 14:53:40.751935 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.751786) EVENT_LOG_v1 {"time_micros": 1499784820751781, "job": 77, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:53:40.752010 I | rook-ceph-mon0: 2017-07-11 14:53:40.751997 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.751800) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:53:40.752040 I | rook-ceph-mon0:
- 2017-07-11 14:53:40.752072 I | rook-ceph-mon0: 2017-07-11 14:53:40.752060 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 77] Try to delete WAL files size 5064585, prev total WAL file size 5064585, number of live WAL files 2.
- 2017-07-11 14:53:40.752086 I | rook-ceph-mon0:
- 2017-07-11 14:53:40.753407 I | rook-ceph-mon0: 2017-07-11 14:53:40.752976 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:53:40.753462 I | rook-ceph-mon0: 2017-07-11 14:53:40.753014 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.753008) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:53:40.753490 I | rook-ceph-mon0:
- 2017-07-11 14:53:40.753517 I | rook-ceph-mon0: 2017-07-11 14:53:40.753019 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 78] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:53:40.753530 I | rook-ceph-mon0: 2017-07-11 14:53:40.753023 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 77 Base level 0, inputs: [122(4936KB)], [120(12MB)]
- 2017-07-11 14:53:40.753541 I | rook-ceph-mon0:
- 2017-07-11 14:53:40.753552 I | rook-ceph-mon0: 2017-07-11 14:53:40.753033 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784820753026, "job": 78, "event": "compaction_started", "files_L0": [122], "files_L1": [120], "score": -1, "input_data_size": 18650324}
- 2017-07-11 14:53:40.893269 I | rook-ceph-mon0: 2017-07-11 14:53:40.893217 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 78] Generated table #123: 2403 keys, 16097268 bytes
- 2017-07-11 14:53:40.893423 I | rook-ceph-mon0: 2017-07-11 14:53:40.893368 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784820893358, "cf_name": "default", "job": 78, "event": "table_file_creation", "file_number": 123, "file_size": 16097268, "table_properties": {"data_size": 16043851, "index_size": 52598, "filter_size": 0, "raw_key_size": 46454, "raw_average_key_size": 19, "raw_value_size": 15973454, "raw_average_value_size": 6647, "num_data_blocks": 1597, "num_entries": 2403, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:53:40.934163 I | rook-ceph-mon0: 2017-07-11 14:53:40.933920 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:40.934248 I | rook-ceph-mon0: 2017-07-11 14:53:40.933940 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3275930253' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:41.012784 I | rook-ceph-mon0: 2017-07-11 14:53:41.012724 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 78] Compacted 1@0 + 1@1 files to L1 => 16097268 bytes
- 2017-07-11 14:53:41.054258 I | rook-ceph-mon0: 2017-07-11 14:53:41.054205 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:53:41.054087) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 73.4 rd, 63.4 wr, level 1, files in(1, 1) out(1) MB in(4.8, 13.0) out(15.4), read-write-amplify(6.9) write-amplify(3.2) OK, records in: 2912, records dropped: 509
- 2017-07-11 14:53:41.054351 I | rook-ceph-mon0:
- 2017-07-11 14:53:41.054405 I | rook-ceph-mon0: 2017-07-11 14:53:41.054370 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:53:41.054115) EVENT_LOG_v1 {"time_micros": 1499784821054105, "job": 78, "event": "compaction_finished", "compaction_time_micros": 253958, "output_level": 1, "num_output_files": 1, "total_output_size": 16097268, "num_input_records": 2912, "num_output_records": 2403, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:53:41.055247 I | rook-ceph-mon0: 2017-07-11 14:53:41.055231 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784821055228, "job": 78, "event": "table_file_deletion", "file_number": 122}
- 2017-07-11 14:53:41.056913 I | rook-ceph-mon0: 2017-07-11 14:53:41.056899 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784821056897, "job": 78, "event": "table_file_deletion", "file_number": 120}
- 2017-07-11 14:53:42.001226 I | rook-ceph-mon0: 2017-07-11 14:53:42.001188 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:53:42.001296 I | rook-ceph-mon0: 2017-07-11 14:53:42.001281 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2749048010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:53:42.731820 I | rook-ceph-mon0: 2017-07-11 14:53:42.731777 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:42.732012 I | rook-ceph-mon0: 2017-07-11 14:53:42.731928 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/73529013' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:45.626658 I | rook-ceph-mon0: 2017-07-11 14:53:45.626491 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4826 MB, avail 94360 MB
- 2017-07-11 14:53:45.896129 I | rook-ceph-mon0: 2017-07-11 14:53:45.896094 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:45.896194 I | rook-ceph-mon0: 2017-07-11 14:53:45.896180 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1963740319' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:46.113802 I | rook-ceph-mon0: 2017-07-11 14:53:46.113763 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:46.113870 I | rook-ceph-mon0: 2017-07-11 14:53:46.113856 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1846598804' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:49.177429 I | rook-ceph-mon0: 2017-07-11 14:53:49.177392 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:49.177648 I | rook-ceph-mon0: 2017-07-11 14:53:49.177536 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/838361999' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:50.677836 I | rook-ceph-mon0: 2017-07-11 14:53:50.677799 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:50.687395 I | rook-ceph-mon0: 2017-07-11 14:53:50.677943 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3591428724' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:54.179028 I | rook-ceph-mon0: 2017-07-11 14:53:54.178949 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:54.179237 I | rook-ceph-mon0: 2017-07-11 14:53:54.179137 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1190940681' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:59.430289 I | rook-ceph-mon0: 2017-07-11 14:53:59.430244 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:59.430484 I | rook-ceph-mon0: 2017-07-11 14:53:59.430396 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/855002767' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:01.389755 I | rook-ceph-mon0: 2017-07-11 14:54:01.389719 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:01.389943 I | rook-ceph-mon0: 2017-07-11 14:54:01.389924 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3411357284' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:05.154165 I | rook-ceph-mon0: 2017-07-11 14:54:05.154127 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:54:05.154359 I | rook-ceph-mon0: 2017-07-11 14:54:05.154273 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2393547306' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:54:05.609915 I | rook-ceph-mon0: 2017-07-11 14:54:05.609877 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:05.610129 I | rook-ceph-mon0: 2017-07-11 14:54:05.610017 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/887767177' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:07.426536 I | rook-ceph-mon0: 2017-07-11 14:54:07.426470 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:07.426806 I | rook-ceph-mon0: 2017-07-11 14:54:07.426788 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2511461351' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:09.750381 I | rook-ceph-mon0: 2017-07-11 14:54:09.750334 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:54:09.750558 I | rook-ceph-mon0: 2017-07-11 14:54:09.750481 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2185116485' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:54:10.276002 I | rook-ceph-mon0: 2017-07-11 14:54:10.275956 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:10.276128 I | rook-ceph-mon0: 2017-07-11 14:54:10.276113 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/361826284' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:11.231515 I | rook-ceph-mon0: 2017-07-11 14:54:11.231477 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:54:11.231711 I | rook-ceph-mon0: 2017-07-11 14:54:11.231625 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4234155711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:54:13.747421 I | rook-ceph-mon0: 2017-07-11 14:54:13.747384 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:13.747644 I | rook-ceph-mon0: 2017-07-11 14:54:13.747604 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2067550761' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:14.652862 I | rook-ceph-mon0: 2017-07-11 14:54:14.652816 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:54:14.653098 I | rook-ceph-mon0: 2017-07-11 14:54:14.653053 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3118237346' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:54:16.513698 I | rook-ceph-mon0: 2017-07-11 14:54:16.513649 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:54:16.513870 I | rook-ceph-mon0: 2017-07-11 14:54:16.513797 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/449137494' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:54:17.380610 I | rook-ceph-mon0: 2017-07-11 14:54:17.380572 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:17.380858 I | rook-ceph-mon0: 2017-07-11 14:54:17.380743 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/151783762' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:19.467855 I | rook-ceph-mon0: 2017-07-11 14:54:19.467820 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:19.467919 I | rook-ceph-mon0: 2017-07-11 14:54:19.467905 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3391856622' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:20.184955 I | rook-ceph-mon0: 2017-07-11 14:54:20.184917 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:20.185151 I | rook-ceph-mon0: 2017-07-11 14:54:20.185065 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3602679140' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:21.161217 I | rook-ceph-mon0: 2017-07-11 14:54:21.161178 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:54:21.161444 I | rook-ceph-mon0: 2017-07-11 14:54:21.161403 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3770336042' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:54:23.599363 I | rook-ceph-mon0: 2017-07-11 14:54:23.599325 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:23.599579 I | rook-ceph-mon0: 2017-07-11 14:54:23.599475 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3543873650' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:25.193056 I | rook-ceph-mon0: 2017-07-11 14:54:25.193018 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:25.193236 I | rook-ceph-mon0: 2017-07-11 14:54:25.193156 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1025874166' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:27.345134 I | rook-ceph-mon0: 2017-07-11 14:54:27.345095 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:27.345357 I | rook-ceph-mon0: 2017-07-11 14:54:27.345245 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1708964463' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:28.957523 I | rook-ceph-mon0: 2017-07-11 14:54:28.957469 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:28.957706 I | rook-ceph-mon0: 2017-07-11 14:54:28.957627 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3883136860' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:29.510926 I | rook-ceph-mon0: 2017-07-11 14:54:29.510889 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:54:29.511035 I | rook-ceph-mon0: 2017-07-11 14:54:29.511019 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3951029903' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:54:29.966140 I | rook-ceph-mon0: 2017-07-11 14:54:29.966102 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:29.966326 I | rook-ceph-mon0: 2017-07-11 14:54:29.966246 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1724809236' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:30.626740 I | rook-ceph-mon0: 2017-07-11 14:54:30.626698 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:30.626949 I | rook-ceph-mon0: 2017-07-11 14:54:30.626850 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/250684505' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:33.452649 I | rook-ceph-mon0: 2017-07-11 14:54:33.452610 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:33.452862 I | rook-ceph-mon0: 2017-07-11 14:54:33.452759 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/923855353' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:33.930053 I | rook-ceph-mon0: 2017-07-11 14:54:33.930014 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:33.930289 I | rook-ceph-mon0: 2017-07-11 14:54:33.930251 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1206388286' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:34.391924 I | rook-ceph-mon0: 2017-07-11 14:54:34.391890 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:54:34.392131 I | rook-ceph-mon0: 2017-07-11 14:54:34.392025 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2033925492' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:54:34.699949 I | rook-ceph-mon0: 2017-07-11 14:54:34.699910 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:34.700075 I | rook-ceph-mon0: 2017-07-11 14:54:34.700060 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1709368501' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:35.635622 I | rook-ceph-mon0: 2017-07-11 14:54:35.635574 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0516715s > max 0.05s
- 2017-07-11 14:54:35.636106 I | rook-ceph-mon0: 2017-07-11 14:54:35.636090 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.184127s > max 0.05s
- 2017-07-11 14:54:36.417300 I | rook-ceph-mon0: 2017-07-11 14:54:35.635715 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1900 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0516715s > max 0.05s
- 2017-07-11 14:54:36.417318 I | rook-ceph-mon0: 2017-07-11 14:54:35.636147 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1901 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.184127s > max 0.05s
- 2017-07-11 14:54:38.458049 I | rook-ceph-mon0: 2017-07-11 14:54:38.458012 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:38.458247 I | rook-ceph-mon0: 2017-07-11 14:54:38.458159 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1160090763' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:39.519583 I | rook-ceph-mon0: 2017-07-11 14:54:39.519486 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #124. Immutable memtables: 0.
- 2017-07-11 14:54:39.519601 I | rook-ceph-mon0:
- 2017-07-11 14:54:39.519605 I | rook-ceph-mon0: 2017-07-11 14:54:39.519512 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 79] Syncing log #121
- 2017-07-11 14:54:39.541740 I | rook-ceph-mon0: 2017-07-11 14:54:39.539924 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.519506) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:54:39.541790 I | rook-ceph-mon0: 2017-07-11 14:54:39.539935 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 79] Flushing memtable with next log file: 124
- 2017-07-11 14:54:39.541809 I | rook-ceph-mon0:
- 2017-07-11 14:54:39.541834 I | rook-ceph-mon0: 2017-07-11 14:54:39.539944 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784879539940, "job": 79, "event": "flush_started", "num_memtables": 1, "num_entries": 1041, "num_deletes": 502, "memory_usage": 1541512}
- 2017-07-11 14:54:39.541863 I | rook-ceph-mon0: 2017-07-11 14:54:39.539947 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 79] Level-0 flush table #125: started
- 2017-07-11 14:54:39.651898 I | rook-ceph-mon0: 2017-07-11 14:54:39.651823 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784879651812, "cf_name": "default", "job": 79, "event": "table_file_creation", "file_number": 125, "file_size": 1516529, "table_properties": {"data_size": 1510769, "index_size": 4945, "filter_size": 0, "raw_key_size": 13658, "raw_average_key_size": 19, "raw_value_size": 1497845, "raw_average_value_size": 2130, "num_data_blocks": 158, "num_entries": 703, "filter_policy_name": "", "kDeletedKeys": "502", "kMergeOperands": "0"}}
- 2017-07-11 14:54:39.652137 I | rook-ceph-mon0: 2017-07-11 14:54:39.651998 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 79] Level-0 flush table #125: 1516529 bytes OK
- 2017-07-11 14:54:39.697557 I | rook-ceph-mon0: 2017-07-11 14:54:39.697511 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.681112) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #125 started
- 2017-07-11 14:54:39.697661 I | rook-ceph-mon0: 2017-07-11 14:54:39.697644 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.697444) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #125: memtable #1 done
- 2017-07-11 14:54:39.697715 I | rook-ceph-mon0: 2017-07-11 14:54:39.697680 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.697470) EVENT_LOG_v1 {"time_micros": 1499784879697463, "job": 79, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:54:39.697748 I | rook-ceph-mon0: 2017-07-11 14:54:39.697734 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.697487) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:54:39.697763 I | rook-ceph-mon0:
- 2017-07-11 14:54:39.697812 I | rook-ceph-mon0: 2017-07-11 14:54:39.697798 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 79] Try to delete WAL files size 1519129, prev total WAL file size 1519129, number of live WAL files 2.
- 2017-07-11 14:54:39.697826 I | rook-ceph-mon0:
- 2017-07-11 14:54:39.698606 I | rook-ceph-mon0: 2017-07-11 14:54:39.698319 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:54:39.698660 I | rook-ceph-mon0: 2017-07-11 14:54:39.698359 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.698354) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:54:39.698678 I | rook-ceph-mon0:
- 2017-07-11 14:54:39.698690 I | rook-ceph-mon0: 2017-07-11 14:54:39.698365 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 80] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:54:39.698702 I | rook-ceph-mon0: 2017-07-11 14:54:39.698369 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 79 Base level 0, inputs: [125(1480KB)], [123(15MB)]
- 2017-07-11 14:54:39.698730 I | rook-ceph-mon0:
- 2017-07-11 14:54:39.698743 I | rook-ceph-mon0: 2017-07-11 14:54:39.698380 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784879698372, "job": 80, "event": "compaction_started", "files_L0": [125], "files_L1": [123], "score": -1, "input_data_size": 17613797}
- 2017-07-11 14:54:39.873948 I | rook-ceph-mon0: 2017-07-11 14:54:39.873895 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 80] Generated table #126: 2095 keys, 14538027 bytes
- 2017-07-11 14:54:39.874062 I | rook-ceph-mon0: 2017-07-11 14:54:39.874045 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784879874035, "cf_name": "default", "job": 80, "event": "table_file_creation", "file_number": 126, "file_size": 14538027, "table_properties": {"data_size": 14489317, "index_size": 47891, "filter_size": 0, "raw_key_size": 40350, "raw_average_key_size": 19, "raw_value_size": 14426520, "raw_average_value_size": 6886, "num_data_blocks": 1468, "num_entries": 2095, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:54:40.122250 I | rook-ceph-mon0: 2017-07-11 14:54:40.122197 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 80] Compacted 1@0 + 1@1 files to L1 => 14538027 bytes
- 2017-07-11 14:54:40.209881 I | rook-ceph-mon0: 2017-07-11 14:54:40.209831 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:54:40.209729) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 41.6 rd, 34.3 wr, level 1, files in(1, 1) out(1) MB in(1.4, 15.4) out(13.9), read-write-amplify(21.2) write-amplify(9.6) OK, records in: 3106, records dropped: 1011
- 2017-07-11 14:54:40.209964 I | rook-ceph-mon0:
- 2017-07-11 14:54:40.210000 I | rook-ceph-mon0: 2017-07-11 14:54:40.209983 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:54:40.209747) EVENT_LOG_v1 {"time_micros": 1499784880209739, "job": 80, "event": "compaction_finished", "compaction_time_micros": 423793, "output_level": 1, "num_output_files": 1, "total_output_size": 14538027, "num_input_records": 3106, "num_output_records": 2095, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:54:40.210424 I | rook-ceph-mon0: 2017-07-11 14:54:40.210408 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784880210405, "job": 80, "event": "table_file_deletion", "file_number": 125}
- 2017-07-11 14:54:40.212622 I | rook-ceph-mon0: 2017-07-11 14:54:40.212606 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784880212604, "job": 80, "event": "table_file_deletion", "file_number": 123}
- 2017-07-11 14:54:40.212955 I | rook-ceph-mon0: 2017-07-11 14:54:40.212875 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #127. Immutable memtables: 0.
- 2017-07-11 14:54:40.213413 I | rook-ceph-mon0:
- 2017-07-11 14:54:40.213454 I | rook-ceph-mon0: 2017-07-11 14:54:40.212914 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 81] Syncing log #124
- 2017-07-11 14:54:40.304189 I | rook-ceph-mon0: 2017-07-11 14:54:40.303846 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:54:40.212908) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:54:40.304276 I | rook-ceph-mon0: 2017-07-11 14:54:40.303867 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 81] Flushing memtable with next log file: 127
- 2017-07-11 14:54:40.304292 I | rook-ceph-mon0:
- 2017-07-11 14:54:40.304305 I | rook-ceph-mon0: 2017-07-11 14:54:40.303880 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784880303875, "job": 81, "event": "flush_started", "num_memtables": 1, "num_entries": 3, "num_deletes": 0, "memory_usage": 14568}
- 2017-07-11 14:54:40.304345 I | rook-ceph-mon0: 2017-07-11 14:54:40.303883 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 81] Level-0 flush table #128: started
- 2017-07-11 14:54:40.344061 I | rook-ceph-mon0: 2017-07-11 14:54:40.343993 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784880343984, "cf_name": "default", "job": 81, "event": "table_file_creation", "file_number": 128, "file_size": 13255, "table_properties": {"data_size": 12395, "index_size": 53, "filter_size": 0, "raw_key_size": 65, "raw_average_key_size": 21, "raw_value_size": 12308, "raw_average_value_size": 4102, "num_data_blocks": 2, "num_entries": 3, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:54:40.344121 I | rook-ceph-mon0: 2017-07-11 14:54:40.344006 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 81] Level-0 flush table #128: 13255 bytes OK
- 2017-07-11 14:54:40.485716 I | rook-ceph-mon0: 2017-07-11 14:54:40.485473 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:54:40.423655) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #128 started
- 2017-07-11 14:54:40.485822 I | rook-ceph-mon0: 2017-07-11 14:54:40.485480 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:54:40.485408) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #128: memtable #1 done
- 2017-07-11 14:54:40.485841 I | rook-ceph-mon0: 2017-07-11 14:54:40.485482 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:54:40.485420) EVENT_LOG_v1 {"time_micros": 1499784880485415, "job": 81, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:54:40.485854 I | rook-ceph-mon0: 2017-07-11 14:54:40.485485 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:54:40.485432) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:54:40.485867 I | rook-ceph-mon0:
- 2017-07-11 14:54:40.485897 I | rook-ceph-mon0: 2017-07-11 14:54:40.485491 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 81] Try to delete WAL files size 12371, prev total WAL file size 24606, number of live WAL files 2.
- 2017-07-11 14:54:40.485926 I | rook-ceph-mon0:
- 2017-07-11 14:54:40.485942 I | rook-ceph-mon0: 2017-07-11 14:54:40.485602 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:54:40.793257 I | rook-ceph-mon0: 2017-07-11 14:54:40.793217 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:54:40.793464 I | rook-ceph-mon0: 2017-07-11 14:54:40.793381 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2428617555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:54:41.786055 I | rook-ceph-mon0: 2017-07-11 14:54:41.786021 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:41.786265 I | rook-ceph-mon0: 2017-07-11 14:54:41.786162 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2496654309' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:43.311077 I | rook-ceph-mon0: 2017-07-11 14:54:43.311038 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:43.311332 I | rook-ceph-mon0: 2017-07-11 14:54:43.311313 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4193203083' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:45.626900 I | rook-ceph-mon0: 2017-07-11 14:54:45.626754 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94362 MB
- 2017-07-11 14:54:45.813802 I | rook-ceph-mon0: 2017-07-11 14:54:45.813766 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:45.813993 I | rook-ceph-mon0: 2017-07-11 14:54:45.813911 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2147765337' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:46.787301 I | rook-ceph-mon0: 2017-07-11 14:54:46.787263 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:46.787526 I | rook-ceph-mon0: 2017-07-11 14:54:46.787411 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3846367248' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:49.881279 I | rook-ceph-mon0: 2017-07-11 14:54:49.881242 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:49.881470 I | rook-ceph-mon0: 2017-07-11 14:54:49.881384 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1087839866' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:50.173303 I | rook-ceph-mon0: 2017-07-11 14:54:50.173264 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:50.173435 I | rook-ceph-mon0: 2017-07-11 14:54:50.173414 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2261753569' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:54.112653 I | rook-ceph-mon0: 2017-07-11 14:54:54.112614 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:54:54.112857 I | rook-ceph-mon0: 2017-07-11 14:54:54.112770 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/189277312' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:54:54.556264 I | rook-ceph-mon0: 2017-07-11 14:54:54.556227 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:54.556455 I | rook-ceph-mon0: 2017-07-11 14:54:54.556373 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1083934888' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:55.708539 I | rook-ceph-mon0: 2017-07-11 14:54:55.708501 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:54:55.708740 I | rook-ceph-mon0: 2017-07-11 14:54:55.708648 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2281930029' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:54:56.950926 I | rook-ceph-mon0: 2017-07-11 14:54:56.950569 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:56.951211 I | rook-ceph-mon0: 2017-07-11 14:54:56.951173 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3896133660' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:59.450669 I | rook-ceph-mon0: 2017-07-11 14:54:59.450628 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:54:59.450754 I | rook-ceph-mon0: 2017-07-11 14:54:59.450718 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4094111614' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:55:00.988593 I | rook-ceph-mon0: 2017-07-11 14:55:00.988555 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:00.988812 I | rook-ceph-mon0: 2017-07-11 14:55:00.988795 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/769688200' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:00.999875 I | rook-ceph-mon0: 2017-07-11 14:55:00.999855 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:55:01.002768 I | rook-ceph-mon0: 2017-07-11 14:55:00.999939 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2632801162' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:55:01.892662 I | rook-ceph-mon0: 2017-07-11 14:55:01.892621 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:01.892857 I | rook-ceph-mon0: 2017-07-11 14:55:01.892772 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2472492251' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:03.900420 I | rook-ceph-mon0: 2017-07-11 14:55:03.900380 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:03.900642 I | rook-ceph-mon0: 2017-07-11 14:55:03.900526 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/610103785' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:05.336689 I | rook-ceph-mon0: 2017-07-11 14:55:05.336560 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:55:05.713650 I | rook-ceph-mon0: 2017-07-11 14:55:05.713612 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:55:05.713889 I | rook-ceph-mon0: 2017-07-11 14:55:05.713760 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3917043111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:55:05.956389 I | rook-ceph-mon0: 2017-07-11 14:55:05.336568 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1919 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:55:06.619454 I | rook-ceph-mon0: 2017-07-11 14:55:06.619416 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:06.619683 I | rook-ceph-mon0: 2017-07-11 14:55:06.619574 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4206649164' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:08.030200 I | rook-ceph-mon0: 2017-07-11 14:55:08.030162 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:08.030440 I | rook-ceph-mon0: 2017-07-11 14:55:08.030403 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/533973819' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:08.444168 I | rook-ceph-mon0: 2017-07-11 14:55:08.444127 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:08.444297 I | rook-ceph-mon0: 2017-07-11 14:55:08.444281 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2403109134' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:08.925285 I | rook-ceph-mon0: 2017-07-11 14:55:08.925241 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:55:08.925480 I | rook-ceph-mon0: 2017-07-11 14:55:08.925393 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1689762971' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:55:09.409758 I | rook-ceph-mon0: 2017-07-11 14:55:09.409720 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:09.409981 I | rook-ceph-mon0: 2017-07-11 14:55:09.409876 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2905621263' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:10.351592 I | rook-ceph-mon0: 2017-07-11 14:55:10.351555 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:55:10.351805 I | rook-ceph-mon0: 2017-07-11 14:55:10.351776 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1561731795' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:55:11.292215 I | rook-ceph-mon0: 2017-07-11 14:55:11.292172 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:11.292283 I | rook-ceph-mon0: 2017-07-11 14:55:11.292267 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/344680278' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:12.072806 I | rook-ceph-mon0: 2017-07-11 14:55:12.072767 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:12.073016 I | rook-ceph-mon0: 2017-07-11 14:55:12.072913 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2736241265' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:12.871362 I | rook-ceph-mon0: 2017-07-11 14:55:12.871323 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:12.871632 I | rook-ceph-mon0: 2017-07-11 14:55:12.871576 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2836431936' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:15.028798 I | rook-ceph-mon0: 2017-07-11 14:55:15.028759 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:15.029054 I | rook-ceph-mon0: 2017-07-11 14:55:15.029036 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/575896483' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:18.901954 I | rook-ceph-mon0: 2017-07-11 14:55:18.901917 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:55:18.902139 I | rook-ceph-mon0: 2017-07-11 14:55:18.902059 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/701474439' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:55:19.072069 I | rook-ceph-mon0: 2017-07-11 14:55:19.072030 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:19.072266 I | rook-ceph-mon0: 2017-07-11 14:55:19.072182 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1505518061' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:20.270501 I | rook-ceph-mon0: 2017-07-11 14:55:20.270462 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:55:20.271021 I | rook-ceph-mon0: 2017-07-11 14:55:20.271002 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3760903412' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:55:21.202578 I | rook-ceph-mon0: 2017-07-11 14:55:21.198556 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:21.254524 I | rook-ceph-mon0: 2017-07-11 14:55:21.250417 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2243390680' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:23.187147 I | rook-ceph-mon0: 2017-07-11 14:55:23.187108 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:23.187400 I | rook-ceph-mon0: 2017-07-11 14:55:23.187383 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1521460161' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:26.358098 I | rook-ceph-mon0: 2017-07-11 14:55:26.358061 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:26.358360 I | rook-ceph-mon0: 2017-07-11 14:55:26.358338 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4291424652' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:28.656793 I | rook-ceph-mon0: 2017-07-11 14:55:28.656754 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:55:28.656988 I | rook-ceph-mon0: 2017-07-11 14:55:28.656901 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/937151377' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:55:33.788822 I | rook-ceph-mon0: 2017-07-11 14:55:33.788771 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:55:33.789040 I | rook-ceph-mon0: 2017-07-11 14:55:33.788951 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2446338762' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:55:34.695999 I | rook-ceph-mon0: 2017-07-11 14:55:34.695951 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:34.696173 I | rook-ceph-mon0: 2017-07-11 14:55:34.696097 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3420674274' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:35.902374 I | rook-ceph-mon0: 2017-07-11 14:55:35.902335 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:55:35.902617 I | rook-ceph-mon0: 2017-07-11 14:55:35.902588 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3256101787' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:55:37.659052 I | rook-ceph-mon0: 2017-07-11 14:55:37.659013 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:37.659309 I | rook-ceph-mon0: 2017-07-11 14:55:37.659292 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4136496833' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:38.284676 I | rook-ceph-mon0: 2017-07-11 14:55:38.284637 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:38.284960 I | rook-ceph-mon0: 2017-07-11 14:55:38.284785 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/215064709' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:42.955094 I | rook-ceph-mon0: 2017-07-11 14:55:42.955030 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:42.955286 I | rook-ceph-mon0: 2017-07-11 14:55:42.955208 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3743726124' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:45.627166 I | rook-ceph-mon0: 2017-07-11 14:55:45.626996 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94362 MB
- 2017-07-11 14:55:45.748927 I | rook-ceph-mon0: 2017-07-11 14:55:45.748891 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:45.749055 I | rook-ceph-mon0: 2017-07-11 14:55:45.749039 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1067003478' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:48.736851 I | rook-ceph-mon0: 2017-07-11 14:55:48.736814 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:48.737079 I | rook-ceph-mon0: 2017-07-11 14:55:48.736959 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3188340173' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:48.907789 I | rook-ceph-mon0: 2017-07-11 14:55:48.907750 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:48.907963 I | rook-ceph-mon0: 2017-07-11 14:55:48.907886 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3637074842' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:52.824188 I | rook-ceph-mon0: 2017-07-11 14:55:52.824151 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:52.824256 I | rook-ceph-mon0: 2017-07-11 14:55:52.824241 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2767701450' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:57.262932 I | rook-ceph-mon0: 2017-07-11 14:55:57.262885 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:57.263147 I | rook-ceph-mon0: 2017-07-11 14:55:57.263044 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2668906669' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:02.194427 I | rook-ceph-mon0: 2017-07-11 14:56:02.194386 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:02.194685 I | rook-ceph-mon0: 2017-07-11 14:56:02.194665 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3439472804' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:03.835445 I | rook-ceph-mon0: 2017-07-11 14:56:03.835400 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:56:03.835669 I | rook-ceph-mon0: 2017-07-11 14:56:03.835651 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2836665330' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:56:05.616132 I | rook-ceph-mon0: 2017-07-11 14:56:05.616094 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:05.616359 I | rook-ceph-mon0: 2017-07-11 14:56:05.616328 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3220045908' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:07.134732 I | rook-ceph-mon0: 2017-07-11 14:56:07.134684 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:07.134928 I | rook-ceph-mon0: 2017-07-11 14:56:07.134841 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2632097352' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:08.077152 I | rook-ceph-mon0: 2017-07-11 14:56:08.077097 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:56:08.077395 I | rook-ceph-mon0: 2017-07-11 14:56:08.077375 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1998555253' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:56:09.520015 I | rook-ceph-mon0: 2017-07-11 14:56:09.519975 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:56:09.520234 I | rook-ceph-mon0: 2017-07-11 14:56:09.520203 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4010920390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:56:13.509171 I | rook-ceph-mon0: 2017-07-11 14:56:13.509125 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:13.509429 I | rook-ceph-mon0: 2017-07-11 14:56:13.509412 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1035630047' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:14.899426 I | rook-ceph-mon0: 2017-07-11 14:56:14.899389 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:56:14.899614 I | rook-ceph-mon0: 2017-07-11 14:56:14.899532 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2077348536' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:56:15.487796 I | rook-ceph-mon0: 2017-07-11 14:56:15.487758 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:15.487970 I | rook-ceph-mon0: 2017-07-11 14:56:15.487892 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3434300595' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:17.058768 I | rook-ceph-mon0: 2017-07-11 14:56:17.058730 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:17.058836 I | rook-ceph-mon0: 2017-07-11 14:56:17.058821 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/684001299' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:18.919989 I | rook-ceph-mon0: 2017-07-11 14:56:18.919950 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:56:18.920199 I | rook-ceph-mon0: 2017-07-11 14:56:18.920100 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/353491823' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:56:20.669426 I | rook-ceph-mon0: 2017-07-11 14:56:20.669385 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:20.669536 I | rook-ceph-mon0: 2017-07-11 14:56:20.669521 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3200345646' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:21.935522 I | rook-ceph-mon0: 2017-07-11 14:56:21.935484 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:21.935719 I | rook-ceph-mon0: 2017-07-11 14:56:21.935633 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/688486010' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:23.706206 I | rook-ceph-mon0: 2017-07-11 14:56:23.705954 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:23.706304 I | rook-ceph-mon0: 2017-07-11 14:56:23.705974 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4180773098' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:25.662368 I | rook-ceph-mon0: 2017-07-11 14:56:25.662331 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:25.662588 I | rook-ceph-mon0: 2017-07-11 14:56:25.662508 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4150938200' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:25.995741 I | rook-ceph-mon0: 2017-07-11 14:56:25.995704 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:56:25.995964 I | rook-ceph-mon0: 2017-07-11 14:56:25.995834 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2459635664' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:56:29.486144 I | rook-ceph-mon0: 2017-07-11 14:56:29.486105 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:56:29.486362 I | rook-ceph-mon0: 2017-07-11 14:56:29.486333 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/970694388' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:56:30.030250 I | rook-ceph-mon0: 2017-07-11 14:56:30.030214 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:56:30.030316 I | rook-ceph-mon0: 2017-07-11 14:56:30.030300 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2867561294' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:56:32.713988 I | rook-ceph-mon0: 2017-07-11 14:56:32.713950 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:56:32.714246 I | rook-ceph-mon0: 2017-07-11 14:56:32.714184 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/766481798' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:56:35.382632 I | rook-ceph-mon0: 2017-07-11 14:56:35.382592 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:35.382872 I | rook-ceph-mon0: 2017-07-11 14:56:35.382744 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/20969745' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:36.950569 I | rook-ceph-mon0: 2017-07-11 14:56:36.950479 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:56:36.950641 I | rook-ceph-mon0: 2017-07-11 14:56:36.950624 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3956280435' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:56:41.145373 I | rook-ceph-mon0: 2017-07-11 14:56:41.145332 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:56:41.145569 I | rook-ceph-mon0: 2017-07-11 14:56:41.145481 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1803830729' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:56:41.767076 I | rook-ceph-mon0: 2017-07-11 14:56:41.767040 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:41.767289 I | rook-ceph-mon0: 2017-07-11 14:56:41.767258 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/780574519' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:43.218733 I | rook-ceph-mon0: 2017-07-11 14:56:43.218696 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:43.218799 I | rook-ceph-mon0: 2017-07-11 14:56:43.218785 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1865075826' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:44.169126 I | rook-ceph-mon0: 2017-07-11 14:56:44.169085 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:56:44.169376 I | rook-ceph-mon0: 2017-07-11 14:56:44.169354 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3519524741' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:56:44.383569 I | rook-ceph-mon0: 2017-07-11 14:56:44.383530 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:56:44.383806 I | rook-ceph-mon0: 2017-07-11 14:56:44.383791 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1382308738' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:56:45.627377 I | rook-ceph-mon0: 2017-07-11 14:56:45.627227 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94361 MB
- 2017-07-11 14:57:07.674463 I | rook-ceph-mon0: 2017-07-11 14:57:07.674368 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #129. Immutable memtables: 0.
- 2017-07-11 14:57:07.674550 I | rook-ceph-mon0:
- 2017-07-11 14:57:07.674569 I | rook-ceph-mon0: 2017-07-11 14:57:07.674394 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 82] Syncing log #127
- 2017-07-11 14:57:07.733041 I | rook-ceph-mon0: 2017-07-11 14:57:07.730207 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:57:07.674389) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:57:07.733141 I | rook-ceph-mon0: 2017-07-11 14:57:07.730227 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 82] Flushing memtable with next log file: 129
- 2017-07-11 14:57:07.733159 I | rook-ceph-mon0:
- 2017-07-11 14:57:07.733187 I | rook-ceph-mon0: 2017-07-11 14:57:07.730239 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785027730234, "job": 82, "event": "flush_started", "num_memtables": 1, "num_entries": 1509, "num_deletes": 251, "memory_usage": 3530424}
- 2017-07-11 14:57:07.733202 I | rook-ceph-mon0: 2017-07-11 14:57:07.730241 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 82] Level-0 flush table #130: started
- 2017-07-11 14:57:07.815515 I | rook-ceph-mon0: 2017-07-11 14:57:07.815458 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785027815445, "cf_name": "default", "job": 82, "event": "table_file_creation", "file_number": 130, "file_size": 3492562, "table_properties": {"data_size": 3480164, "index_size": 11580, "filter_size": 0, "raw_key_size": 13311, "raw_average_key_size": 18, "raw_value_size": 3462287, "raw_average_value_size": 4869, "num_data_blocks": 365, "num_entries": 711, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:57:07.815613 I | rook-ceph-mon0: 2017-07-11 14:57:07.815597 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 82] Level-0 flush table #130: 3492562 bytes OK
- 2017-07-11 14:57:07.849264 I | rook-ceph-mon0: 2017-07-11 14:57:07.849226 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:57:07.831720) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #130 started
- 2017-07-11 14:57:07.849350 I | rook-ceph-mon0: 2017-07-11 14:57:07.849334 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:57:07.849167) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #130: memtable #1 done
- 2017-07-11 14:57:07.849403 I | rook-ceph-mon0: 2017-07-11 14:57:07.849387 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:57:07.849186) EVENT_LOG_v1 {"time_micros": 1499785027849180, "job": 82, "event": "flush_finished", "lsm_state": [2, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:57:07.849434 I | rook-ceph-mon0: 2017-07-11 14:57:07.849421 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:57:07.849204) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[2 1 0 0 0 0 0] max score 0.50
- 2017-07-11 14:57:07.849475 I | rook-ceph-mon0:
- 2017-07-11 14:57:07.849508 I | rook-ceph-mon0: 2017-07-11 14:57:07.849495 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 82] Try to delete WAL files size 3499271, prev total WAL file size 3499271, number of live WAL files 2.
- 2017-07-11 14:57:07.849522 I | rook-ceph-mon0:
- 2017-07-11 14:57:07.853043 I | rook-ceph-mon0: 2017-07-11 14:57:07.850217 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:57:07.853100 I | rook-ceph-mon0: 2017-07-11 14:57:07.850258 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:57:07.850252) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:57:07.853119 I | rook-ceph-mon0:
- 2017-07-11 14:57:07.853132 I | rook-ceph-mon0: 2017-07-11 14:57:07.850263 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 83] Compacting 2@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:57:07.853144 I | rook-ceph-mon0: 2017-07-11 14:57:07.850268 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 82 Base level 0, inputs: [130(3410KB) 128(12KB)], [126(13MB)]
- 2017-07-11 14:57:07.853175 I | rook-ceph-mon0:
- 2017-07-11 14:57:07.853188 I | rook-ceph-mon0: 2017-07-11 14:57:07.850280 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785027850270, "job": 83, "event": "compaction_started", "files_L0": [130, 128], "files_L1": [126], "score": -1, "input_data_size": 18043844}
- 2017-07-11 14:57:08.116431 I | rook-ceph-mon0: 2017-07-11 14:57:08.116377 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 83] Generated table #131: 2298 keys, 15477487 bytes
- 2017-07-11 14:57:08.116558 I | rook-ceph-mon0: 2017-07-11 14:57:08.116540 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785028116530, "cf_name": "default", "job": 83, "event": "table_file_creation", "file_number": 131, "file_size": 15477487, "table_properties": {"data_size": 15424721, "index_size": 51947, "filter_size": 0, "raw_key_size": 44458, "raw_average_key_size": 19, "raw_value_size": 15356225, "raw_average_value_size": 6682, "num_data_blocks": 1582, "num_entries": 2298, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:57:08.178651 I | rook-ceph-mon0: 2017-07-11 14:57:08.178600 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 83] Compacted 2@0 + 1@1 files to L1 => 15477487 bytes
- 2017-07-11 14:57:08.194190 I | rook-ceph-mon0: 2017-07-11 14:57:08.194149 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:57:08.194030) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 55.0 rd, 47.1 wr, level 1, files in(2, 1) out(1) MB in(3.3, 13.9) out(14.8), read-write-amplify(9.6) write-amplify(4.4) OK, records in: 2809, records dropped: 511
- 2017-07-11 14:57:08.194289 I | rook-ceph-mon0:
- 2017-07-11 14:57:08.194343 I | rook-ceph-mon0: 2017-07-11 14:57:08.194326 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:57:08.194053) EVENT_LOG_v1 {"time_micros": 1499785028194043, "job": 83, "event": "compaction_finished", "compaction_time_micros": 328297, "output_level": 1, "num_output_files": 1, "total_output_size": 15477487, "num_input_records": 2809, "num_output_records": 2298, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:57:08.195047 I | rook-ceph-mon0: 2017-07-11 14:57:08.195029 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785028195026, "job": 83, "event": "table_file_deletion", "file_number": 130}
- 2017-07-11 14:57:08.195174 I | rook-ceph-mon0: 2017-07-11 14:57:08.195127 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785028195125, "job": 83, "event": "table_file_deletion", "file_number": 128}
- 2017-07-11 14:57:08.197045 I | rook-ceph-mon0: 2017-07-11 14:57:08.197025 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785028197022, "job": 83, "event": "table_file_deletion", "file_number": 126}
- 2017-07-11 14:57:14.554986 I | rook-ceph-mon0: 2017-07-11 14:57:14.554878 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #132. Immutable memtables: 0.
- 2017-07-11 14:57:14.555075 I | rook-ceph-mon0:
- 2017-07-11 14:57:14.555092 I | rook-ceph-mon0: 2017-07-11 14:57:14.554919 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 84] Syncing log #129
- 2017-07-11 14:57:14.581838 I | rook-ceph-mon0: 2017-07-11 14:57:14.581402 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.554913) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:57:14.581910 I | rook-ceph-mon0: 2017-07-11 14:57:14.581414 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 84] Flushing memtable with next log file: 132
- 2017-07-11 14:57:14.581926 I | rook-ceph-mon0:
- 2017-07-11 14:57:14.581953 I | rook-ceph-mon0: 2017-07-11 14:57:14.581424 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785034581419, "job": 84, "event": "flush_started", "num_memtables": 1, "num_entries": 290, "num_deletes": 251, "memory_usage": 108816}
- 2017-07-11 14:57:14.581967 I | rook-ceph-mon0: 2017-07-11 14:57:14.581426 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 84] Level-0 flush table #133: started
- 2017-07-11 14:57:14.632592 I | rook-ceph-mon0: 2017-07-11 14:57:14.632480 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785034632471, "cf_name": "default", "job": 84, "event": "table_file_creation", "file_number": 133, "file_size": 101274, "table_properties": {"data_size": 100099, "index_size": 361, "filter_size": 0, "raw_key_size": 5453, "raw_average_key_size": 20, "raw_value_size": 96219, "raw_average_value_size": 355, "num_data_blocks": 12, "num_entries": 271, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:57:14.632664 I | rook-ceph-mon0: 2017-07-11 14:57:14.632490 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 84] Level-0 flush table #133: 101274 bytes OK
- 2017-07-11 14:57:14.677614 I | rook-ceph-mon0: 2017-07-11 14:57:14.677405 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.660822) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #133 started
- 2017-07-11 14:57:14.677679 I | rook-ceph-mon0: 2017-07-11 14:57:14.677412 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.677359) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #133: memtable #1 done
- 2017-07-11 14:57:14.677695 I | rook-ceph-mon0: 2017-07-11 14:57:14.677414 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.677378) EVENT_LOG_v1 {"time_micros": 1499785034677372, "job": 84, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:57:14.677707 I | rook-ceph-mon0: 2017-07-11 14:57:14.677418 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.677393) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:57:14.677718 I | rook-ceph-mon0:
- 2017-07-11 14:57:14.677729 I | rook-ceph-mon0: 2017-07-11 14:57:14.677423 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 84] Try to delete WAL files size 100766, prev total WAL file size 100766, number of live WAL files 2.
- 2017-07-11 14:57:14.677753 I | rook-ceph-mon0:
- 2017-07-11 14:57:14.677765 I | rook-ceph-mon0: 2017-07-11 14:57:14.677543 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:57:14.678023 I | rook-ceph-mon0: 2017-07-11 14:57:14.678004 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:57:14.678080 I | rook-ceph-mon0: 2017-07-11 14:57:14.678057 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:57:14.678095 I | rook-ceph-mon0: ** DB Stats **
- 2017-07-11 14:57:14.678106 I | rook-ceph-mon0: Uptime(secs): 5609.5 total, 606.4 interval
- 2017-07-11 14:57:14.678131 I | rook-ceph-mon0: Cumulative writes: 10K writes, 48K keys, 10K commit groups, 1.0 writes per commit group, ingest: 0.10 GB, 0.02 MB/s
- 2017-07-11 14:57:14.678142 I | rook-ceph-mon0: Cumulative WAL: 10K writes, 10K syncs, 1.00 writes per sync, written: 0.10 GB, 0.02 MB/s
- 2017-07-11 14:57:14.678152 I | rook-ceph-mon0: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:57:14.678162 I | rook-ceph-mon0: Interval writes: 1518 writes, 7718 keys, 1518 commit groups, 1.0 writes per commit group, ingest: 14.57 MB, 0.02 MB/s
- 2017-07-11 14:57:14.678173 I | rook-ceph-mon0: Interval WAL: 1518 writes, 1518 syncs, 1.00 writes per sync, written: 0.01 MB, 0.02 MB/s
- 2017-07-11 14:57:14.678182 I | rook-ceph-mon0: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:57:14.678204 I | rook-ceph-mon0:
- 2017-07-11 14:57:14.678214 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 14:57:14.678236 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:57:14.678248 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:57:14.678259 I | rook-ceph-mon0: L0 1/1 98.90 KB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 19.3 5 44 0.106 0 0
- 2017-07-11 14:57:14.678281 I | rook-ceph-mon0: L1 1/1 14.76 MB 0.0 0.6 0.1 0.5 0.5 0.0 0.0 5.7 52.3 45.6 11 39 0.292 98K 20K
- 2017-07-11 14:57:14.678294 I | rook-ceph-mon0: Sum 2/2 14.86 MB 0.0 0.6 0.1 0.5 0.6 0.1 0.0 6.7 37.0 38.0 16 83 0.194 98K 20K
- 2017-07-11 14:57:14.678304 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 9.1 33.4 32.7 4 17 0.233 22K 4533
- 2017-07-11 14:57:14.678326 I | rook-ceph-mon0: Uptime(secs): 5609.5 total, 5609.5 interval
- 2017-07-11 14:57:14.678337 I | rook-ceph-mon0: Flush(GB): cumulative 0.088, interval 0.014
- 2017-07-11 14:57:14.678358 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:57:14.678370 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:57:14.678380 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:57:14.678391 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:57:14.678403 I | rook-ceph-mon0: Cumulative compaction: 0.60 GB write, 0.11 MB/s write, 0.58 GB read, 0.11 MB/s read, 16.1 seconds
- 2017-07-11 14:57:14.678415 I | rook-ceph-mon0: Interval compaction: 0.13 GB write, 0.02 MB/s write, 0.13 GB read, 0.02 MB/s read, 4.0 seconds
- 2017-07-11 14:57:14.678438 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:57:14.678461 I | rook-ceph-mon0:
- 2017-07-11 14:57:14.678472 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:57:14.678483 I | rook-ceph-mon0:
- 2017-07-11 14:57:14.678493 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 14:57:14.678525 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:57:14.678541 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:57:14.678552 I | rook-ceph-mon0: L0 1/1 98.90 KB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 19.3 5 44 0.106 0 0
- 2017-07-11 14:57:14.678563 I | rook-ceph-mon0: L1 1/1 14.76 MB 0.0 0.6 0.1 0.5 0.5 0.0 0.0 5.7 52.3 45.6 11 39 0.292 98K 20K
- 2017-07-11 14:57:14.678573 I | rook-ceph-mon0: Sum 2/2 14.86 MB 0.0 0.6 0.1 0.5 0.6 0.1 0.0 6.7 37.0 38.0 16 83 0.194 98K 20K
- 2017-07-11 14:57:14.678595 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:57:14.678606 I | rook-ceph-mon0: Uptime(secs): 5609.5 total, 5609.5 interval
- 2017-07-11 14:57:14.678615 I | rook-ceph-mon0: Flush(GB): cumulative 0.088, interval 0.000
- 2017-07-11 14:57:14.678625 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:57:14.678635 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:57:14.678645 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:57:14.678665 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:57:14.678676 I | rook-ceph-mon0: Cumulative compaction: 0.60 GB write, 0.11 MB/s write, 0.58 GB read, 0.11 MB/s read, 16.1 seconds
- 2017-07-11 14:57:14.678686 I | rook-ceph-mon0: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:57:14.678696 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:57:14.678706 I | rook-ceph-mon0:
- 2017-07-11 14:57:14.678716 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:57:14.678725 I | rook-ceph-mon0:
- 2017-07-11 14:57:14.678771 I | rook-ceph-mon0: 2017-07-11 14:57:14.678756 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.678751) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:57:14.678784 I | rook-ceph-mon0:
- 2017-07-11 14:57:14.678823 I | rook-ceph-mon0: 2017-07-11 14:57:14.678797 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 85] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:57:14.678871 I | rook-ceph-mon0: 2017-07-11 14:57:14.678840 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 84 Base level 0, inputs: [133(98KB)], [131(14MB)]
- 2017-07-11 14:57:14.678884 I | rook-ceph-mon0:
- 2017-07-11 14:57:14.678917 I | rook-ceph-mon0: 2017-07-11 14:57:14.678906 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785034678897, "job": 85, "event": "compaction_started", "files_L0": [133], "files_L1": [131], "score": -1, "input_data_size": 15578761}
- 2017-07-11 14:57:14.893560 I | rook-ceph-mon0: 2017-07-11 14:57:14.893506 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 85] Generated table #134: 2060 keys, 13922877 bytes
- 2017-07-11 14:57:14.893741 I | rook-ceph-mon0: 2017-07-11 14:57:14.893660 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785034893650, "cf_name": "default", "job": 85, "event": "table_file_creation", "file_number": 134, "file_size": 13922877, "table_properties": {"data_size": 13878012, "index_size": 44046, "filter_size": 0, "raw_key_size": 39684, "raw_average_key_size": 19, "raw_value_size": 13818378, "raw_average_value_size": 6707, "num_data_blocks": 1342, "num_entries": 2060, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:57:14.930732 I | rook-ceph-mon0: 2017-07-11 14:57:14.930686 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 85] Compacted 1@0 + 1@1 files to L1 => 13922877 bytes
- 2017-07-11 14:57:15.039868 I | rook-ceph-mon0: 2017-07-11 14:57:15.039819 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:57:15.039711) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 61.9 rd, 55.3 wr, level 1, files in(1, 1) out(1) MB in(0.1, 14.8) out(13.3), read-write-amplify(291.3) write-amplify(137.5) OK, records in: 2569, records dropped: 509
- 2017-07-11 14:57:15.039957 I | rook-ceph-mon0:
- 2017-07-11 14:57:15.040014 I | rook-ceph-mon0: 2017-07-11 14:57:15.039978 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-14:57:15.039738) EVENT_LOG_v1 {"time_micros": 1499785035039729, "job": 85, "event": "compaction_finished", "compaction_time_micros": 251708, "output_level": 1, "num_output_files": 1, "total_output_size": 13922877, "num_input_records": 2569, "num_output_records": 2060, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:57:15.040261 I | rook-ceph-mon0: 2017-07-11 14:57:15.040244 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785035040232, "job": 85, "event": "table_file_deletion", "file_number": 133}
- 2017-07-11 14:57:15.042214 I | rook-ceph-mon0: 2017-07-11 14:57:15.042193 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785035042190, "job": 85, "event": "table_file_deletion", "file_number": 131}
- 2017-07-11 14:57:15.042295 I | rook-ceph-mon0: 2017-07-11 14:57:15.042280 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:57:45.627634 I | rook-ceph-mon0: 2017-07-11 14:57:45.627464 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4824 MB, avail 94362 MB
- 2017-07-11 14:57:54.061994 I | rook-ceph-mon0: 2017-07-11 14:57:54.061848 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:57:54.062099 I | rook-ceph-mon0: 2017-07-11 14:57:54.061870 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3895367400' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:57:59.112556 I | rook-ceph-mon0: 2017-07-11 14:57:59.112510 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:57:59.112802 I | rook-ceph-mon0: 2017-07-11 14:57:59.112782 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/488560772' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:03.928758 I | rook-ceph-mon0: 2017-07-11 14:58:03.928719 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:03.928955 I | rook-ceph-mon0: 2017-07-11 14:58:03.928869 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2167836593' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:04.153746 I | rook-ceph-mon0: 2017-07-11 14:58:04.153706 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:04.154045 I | rook-ceph-mon0: 2017-07-11 14:58:04.153861 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/982688211' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:04.852099 I | rook-ceph-mon0: 2017-07-11 14:58:04.852061 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:04.852225 I | rook-ceph-mon0: 2017-07-11 14:58:04.852209 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2919105866' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:05.313815 I | rook-ceph-mon0: 2017-07-11 14:58:05.313776 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:05.313945 I | rook-ceph-mon0: 2017-07-11 14:58:05.313929 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2919490033' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:08.220269 I | rook-ceph-mon0: 2017-07-11 14:58:08.220230 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:08.220481 I | rook-ceph-mon0: 2017-07-11 14:58:08.220379 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2118603869' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:09.153831 I | rook-ceph-mon0: 2017-07-11 14:58:09.153792 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:09.154054 I | rook-ceph-mon0: 2017-07-11 14:58:09.154016 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3861274733' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:10.538547 I | rook-ceph-mon0: 2017-07-11 14:58:10.538508 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:10.538777 I | rook-ceph-mon0: 2017-07-11 14:58:10.538761 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2729385248' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:11.901266 I | rook-ceph-mon0: 2017-07-11 14:58:11.901227 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:11.901463 I | rook-ceph-mon0: 2017-07-11 14:58:11.901381 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3152044258' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:12.439549 I | rook-ceph-mon0: 2017-07-11 14:58:12.439513 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:12.439739 I | rook-ceph-mon0: 2017-07-11 14:58:12.439655 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3373633475' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:12.892943 I | rook-ceph-mon0: 2017-07-11 14:58:12.892905 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:12.893169 I | rook-ceph-mon0: 2017-07-11 14:58:12.893127 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4040959441' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:13.340943 I | rook-ceph-mon0: 2017-07-11 14:58:13.340903 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:13.341152 I | rook-ceph-mon0: 2017-07-11 14:58:13.341049 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3942966591' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:16.334899 I | rook-ceph-mon0: 2017-07-11 14:58:16.334856 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:16.335120 I | rook-ceph-mon0: 2017-07-11 14:58:16.335089 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2165289699' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:16.387077 I | rook-ceph-mon0: 2017-07-11 14:58:16.387041 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:16.387202 I | rook-ceph-mon0: 2017-07-11 14:58:16.387186 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/396590552' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:16.774043 I | rook-ceph-mon0: 2017-07-11 14:58:16.774004 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:16.774507 I | rook-ceph-mon0: 2017-07-11 14:58:16.774488 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2490480096' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:24.983291 I | rook-ceph-mon0: 2017-07-11 14:58:24.983252 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:24.983506 I | rook-ceph-mon0: 2017-07-11 14:58:24.983474 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/313586086' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:25.018077 I | rook-ceph-mon0: 2017-07-11 14:58:25.018046 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:25.018180 I | rook-ceph-mon0: 2017-07-11 14:58:25.018165 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4224899237' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:26.614933 I | rook-ceph-mon0: 2017-07-11 14:58:26.614891 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:26.615121 I | rook-ceph-mon0: 2017-07-11 14:58:26.615037 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3538935462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:27.256841 I | rook-ceph-mon0: 2017-07-11 14:58:27.256804 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:27.257028 I | rook-ceph-mon0: 2017-07-11 14:58:27.256946 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1928651543' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:27.693550 I | rook-ceph-mon0: 2017-07-11 14:58:27.693510 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:27.693745 I | rook-ceph-mon0: 2017-07-11 14:58:27.693660 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1380256369' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:27.914834 I | rook-ceph-mon0: 2017-07-11 14:58:27.914795 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:27.914904 I | rook-ceph-mon0: 2017-07-11 14:58:27.914888 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2601242425' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:28.361291 I | rook-ceph-mon0: 2017-07-11 14:58:28.361252 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:28.361561 I | rook-ceph-mon0: 2017-07-11 14:58:28.361543 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4030232487' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:29.307563 I | rook-ceph-mon0: 2017-07-11 14:58:29.307522 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:29.307761 I | rook-ceph-mon0: 2017-07-11 14:58:29.307673 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1442827690' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:30.262651 I | rook-ceph-mon0: 2017-07-11 14:58:30.262601 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:30.262881 I | rook-ceph-mon0: 2017-07-11 14:58:30.262850 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1933223896' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:31.753474 I | rook-ceph-mon0: 2017-07-11 14:58:31.753439 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:31.753646 I | rook-ceph-mon0: 2017-07-11 14:58:31.753576 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/529327954' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:36.084648 I | rook-ceph-mon0: 2017-07-11 14:58:36.084609 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:36.084845 I | rook-ceph-mon0: 2017-07-11 14:58:36.084758 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3378726036' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:36.456158 I | rook-ceph-mon0: 2017-07-11 14:58:36.456120 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:36.456355 I | rook-ceph-mon0: 2017-07-11 14:58:36.456267 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1113204836' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:36.854482 I | rook-ceph-mon0: 2017-07-11 14:58:36.854442 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:36.854611 I | rook-ceph-mon0: 2017-07-11 14:58:36.854596 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/299500332' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:40.028368 I | rook-ceph-mon0: 2017-07-11 14:58:40.028327 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:40.028583 I | rook-ceph-mon0: 2017-07-11 14:58:40.028480 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2902493106' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:40.465287 I | rook-ceph-mon0: 2017-07-11 14:58:40.465247 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:40.465500 I | rook-ceph-mon0: 2017-07-11 14:58:40.465401 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2056361033' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:42.461603 I | rook-ceph-mon0: 2017-07-11 14:58:42.461565 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:42.461818 I | rook-ceph-mon0: 2017-07-11 14:58:42.461788 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3167963626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:43.458524 I | rook-ceph-mon0: 2017-07-11 14:58:43.458486 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:43.458717 I | rook-ceph-mon0: 2017-07-11 14:58:43.458630 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/534959463' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:43.949996 I | rook-ceph-mon0: 2017-07-11 14:58:43.949925 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:43.950075 I | rook-ceph-mon0: 2017-07-11 14:58:43.950054 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1535267889' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:45.529552 I | rook-ceph-mon0: 2017-07-11 14:58:45.529516 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:45.529748 I | rook-ceph-mon0: 2017-07-11 14:58:45.529661 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2318600344' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:45.627877 I | rook-ceph-mon0: 2017-07-11 14:58:45.627710 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4824 MB, avail 94362 MB
- 2017-07-11 14:58:47.129319 I | rook-ceph-mon0: 2017-07-11 14:58:47.129281 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:47.129521 I | rook-ceph-mon0: 2017-07-11 14:58:47.129437 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1029263799' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:47.439143 I | rook-ceph-mon0: 2017-07-11 14:58:47.439104 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:47.439340 I | rook-ceph-mon0: 2017-07-11 14:58:47.439255 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/614947733' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:48.406406 I | rook-ceph-mon0: 2017-07-11 14:58:48.406367 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:48.406675 I | rook-ceph-mon0: 2017-07-11 14:58:48.406635 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/595919299' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:49.365400 I | rook-ceph-mon0: 2017-07-11 14:58:49.365362 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:49.365663 I | rook-ceph-mon0: 2017-07-11 14:58:49.365646 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3404952139' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:50.334487 I | rook-ceph-mon0: 2017-07-11 14:58:50.334449 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:50.334699 I | rook-ceph-mon0: 2017-07-11 14:58:50.334669 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3908444607' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:50.471908 I | rook-ceph-mon0: 2017-07-11 14:58:50.471868 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:50.472104 I | rook-ceph-mon0: 2017-07-11 14:58:50.472018 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3796744251' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:50.582506 I | rook-ceph-mon0: 2017-07-11 14:58:50.582465 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:50.582700 I | rook-ceph-mon0: 2017-07-11 14:58:50.582615 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2027216922' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:51.328311 I | rook-ceph-mon0: 2017-07-11 14:58:51.328262 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:51.328528 I | rook-ceph-mon0: 2017-07-11 14:58:51.328425 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2161494345' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:51.799643 I | rook-ceph-mon0: 2017-07-11 14:58:51.799604 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:51.799754 I | rook-ceph-mon0: 2017-07-11 14:58:51.799731 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4282525465' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:55.323653 I | rook-ceph-mon0: 2017-07-11 14:58:55.323615 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:55.323866 I | rook-ceph-mon0: 2017-07-11 14:58:55.323763 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3367105284' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:55.845845 I | rook-ceph-mon0: 2017-07-11 14:58:55.845809 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:55.846224 I | rook-ceph-mon0: 2017-07-11 14:58:55.846207 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3172556145' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:56.816311 I | rook-ceph-mon0: 2017-07-11 14:58:56.816257 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:56.816537 I | rook-ceph-mon0: 2017-07-11 14:58:56.816496 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4117111887' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:57.267499 I | rook-ceph-mon0: 2017-07-11 14:58:57.267459 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:57.267735 I | rook-ceph-mon0: 2017-07-11 14:58:57.267631 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/761579246' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:59.694863 I | rook-ceph-mon0: 2017-07-11 14:58:59.694826 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:59.695083 I | rook-ceph-mon0: 2017-07-11 14:58:59.694973 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3761056758' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:00.576128 I | rook-ceph-mon0: 2017-07-11 14:59:00.576090 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:00.576340 I | rook-ceph-mon0: 2017-07-11 14:59:00.576239 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1291592761' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:01.813576 I | rook-ceph-mon0: 2017-07-11 14:59:01.813539 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:01.813919 I | rook-ceph-mon0: 2017-07-11 14:59:01.813902 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3350637519' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:01.966283 I | rook-ceph-mon0: 2017-07-11 14:59:01.966243 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:01.966507 I | rook-ceph-mon0: 2017-07-11 14:59:01.966468 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1037863055' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:01.992481 I | rook-ceph-mon0: 2017-07-11 14:59:01.992440 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:01.992823 I | rook-ceph-mon0: 2017-07-11 14:59:01.992630 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2415840694' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:04.166988 I | rook-ceph-mon0: 2017-07-11 14:59:04.166948 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:04.167229 I | rook-ceph-mon0: 2017-07-11 14:59:04.167212 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1344204066' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:04.605111 I | rook-ceph-mon0: 2017-07-11 14:59:04.605072 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:04.605307 I | rook-ceph-mon0: 2017-07-11 14:59:04.605221 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2821723444' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:05.059924 I | rook-ceph-mon0: 2017-07-11 14:59:05.059884 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:05.060138 I | rook-ceph-mon0: 2017-07-11 14:59:05.060033 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1069942861' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:06.283620 I | rook-ceph-mon0: 2017-07-11 14:59:06.283581 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:06.283861 I | rook-ceph-mon0: 2017-07-11 14:59:06.283811 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/431672387' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:08.335549 I | rook-ceph-mon0: 2017-07-11 14:59:08.335512 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:08.335623 I | rook-ceph-mon0: 2017-07-11 14:59:08.335609 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2716083809' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:09.256965 I | rook-ceph-mon0: 2017-07-11 14:59:09.256927 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:09.257123 I | rook-ceph-mon0: 2017-07-11 14:59:09.257106 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/555356996' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:09.514470 I | rook-ceph-mon0: 2017-07-11 14:59:09.514433 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:09.514624 I | rook-ceph-mon0: 2017-07-11 14:59:09.514608 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2889597406' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:11.177039 I | rook-ceph-mon0: 2017-07-11 14:59:11.176994 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:11.177251 I | rook-ceph-mon0: 2017-07-11 14:59:11.177150 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2715880172' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:11.672830 I | rook-ceph-mon0: 2017-07-11 14:59:11.672790 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:11.673062 I | rook-ceph-mon0: 2017-07-11 14:59:11.672942 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/635547036' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:13.133288 I | rook-ceph-mon0: 2017-07-11 14:59:13.133249 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:13.133485 I | rook-ceph-mon0: 2017-07-11 14:59:13.133398 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2170412081' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:13.694317 I | rook-ceph-mon0: 2017-07-11 14:59:13.694275 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:13.694543 I | rook-ceph-mon0: 2017-07-11 14:59:13.694503 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1264682941' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:14.458111 I | rook-ceph-mon0: 2017-07-11 14:59:14.458072 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:14.458335 I | rook-ceph-mon0: 2017-07-11 14:59:14.458296 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/935769396' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:15.529794 I | rook-ceph-mon0: 2017-07-11 14:59:15.529756 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:15.530017 I | rook-ceph-mon0: 2017-07-11 14:59:15.529904 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/935157130' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:16.480546 I | rook-ceph-mon0: 2017-07-11 14:59:16.480503 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:16.480744 I | rook-ceph-mon0: 2017-07-11 14:59:16.480658 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2732594622' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:18.275402 I | rook-ceph-mon0: 2017-07-11 14:59:18.275363 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:18.275638 I | rook-ceph-mon0: 2017-07-11 14:59:18.275597 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/816605872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:20.888445 I | rook-ceph-mon0: 2017-07-11 14:59:20.888406 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:20.888640 I | rook-ceph-mon0: 2017-07-11 14:59:20.888553 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3771906930' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:23.380339 I | rook-ceph-mon0: 2017-07-11 14:59:23.380303 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:23.380550 I | rook-ceph-mon0: 2017-07-11 14:59:23.380448 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1567367110' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:24.343025 I | rook-ceph-mon0: 2017-07-11 14:59:24.342991 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:24.343238 I | rook-ceph-mon0: 2017-07-11 14:59:24.343132 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1941655691' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:24.723294 I | rook-ceph-mon0: 2017-07-11 14:59:24.723256 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:24.724132 I | rook-ceph-mon0: 2017-07-11 14:59:24.723402 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2884392228' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:24.900022 I | rook-ceph-mon0: 2017-07-11 14:59:24.899982 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:24.900220 I | rook-ceph-mon0: 2017-07-11 14:59:24.900135 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2945254824' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:25.180279 I | rook-ceph-mon0: 2017-07-11 14:59:25.180239 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:25.180407 I | rook-ceph-mon0: 2017-07-11 14:59:25.180391 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1729018862' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:26.273869 I | rook-ceph-mon0: 2017-07-11 14:59:26.273834 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:26.274067 I | rook-ceph-mon0: 2017-07-11 14:59:26.273999 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2603530357' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:27.183511 I | rook-ceph-mon0: 2017-07-11 14:59:27.183473 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:27.183734 I | rook-ceph-mon0: 2017-07-11 14:59:27.183621 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2147145221' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:27.674086 I | rook-ceph-mon0: 2017-07-11 14:59:27.674047 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:27.674305 I | rook-ceph-mon0: 2017-07-11 14:59:27.674283 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2627567189' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:28.146707 I | rook-ceph-mon0: 2017-07-11 14:59:28.146668 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:28.146912 I | rook-ceph-mon0: 2017-07-11 14:59:28.146814 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3098835666' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:28.605464 I | rook-ceph-mon0: 2017-07-11 14:59:28.605423 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:28.605676 I | rook-ceph-mon0: 2017-07-11 14:59:28.605583 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2322836760' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:29.094621 I | rook-ceph-mon0: 2017-07-11 14:59:29.094511 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:29.095100 I | rook-ceph-mon0: 2017-07-11 14:59:29.095067 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3575617697' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:30.196523 I | rook-ceph-mon0: 2017-07-11 14:59:30.196485 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:30.196742 I | rook-ceph-mon0: 2017-07-11 14:59:30.196712 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3897110346' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:31.341571 I | rook-ceph-mon0: 2017-07-11 14:59:31.341532 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:31.341793 I | rook-ceph-mon0: 2017-07-11 14:59:31.341681 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/540011913' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:32.271531 I | rook-ceph-mon0: 2017-07-11 14:59:32.271467 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:32.271771 I | rook-ceph-mon0: 2017-07-11 14:59:32.271644 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2394154578' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:34.059444 I | rook-ceph-mon0: 2017-07-11 14:59:34.059403 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:34.059528 I | rook-ceph-mon0: 2017-07-11 14:59:34.059511 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1966785859' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:34.954649 I | rook-ceph-mon0: 2017-07-11 14:59:34.954608 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:34.954864 I | rook-ceph-mon0: 2017-07-11 14:59:34.954761 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2422276620' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:35.628830 I | rook-ceph-mon0: 2017-07-11 14:59:35.628792 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:35.629010 I | rook-ceph-mon0: 2017-07-11 14:59:35.628931 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1052908781' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:35.637231 I | rook-ceph-mon0: 2017-07-11 14:59:35.637198 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0654328s > max 0.05s
- 2017-07-11 14:59:35.637729 I | rook-ceph-mon0: 2017-07-11 14:59:35.637712 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.212449s > max 0.05s
- 2017-07-11 14:59:35.768582 I | rook-ceph-mon0: 2017-07-11 14:59:35.768542 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:35.768797 I | rook-ceph-mon0: 2017-07-11 14:59:35.768768 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3613512687' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:36.074687 I | rook-ceph-mon0: 2017-07-11 14:59:36.074648 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:36.075113 I | rook-ceph-mon0: 2017-07-11 14:59:36.075012 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4047838165' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:36.515764 I | rook-ceph-mon0: 2017-07-11 14:59:36.515713 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:36.516002 I | rook-ceph-mon0: 2017-07-11 14:59:36.515879 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3366510858' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:36.724742 I | rook-ceph-mon0: 2017-07-11 14:59:35.637306 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2061 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0654328s > max 0.05s
- 2017-07-11 14:59:36.724925 I | rook-ceph-mon0: 2017-07-11 14:59:35.637769 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2062 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.212449s > max 0.05s
- 2017-07-11 14:59:36.941652 I | rook-ceph-mon0: 2017-07-11 14:59:36.941616 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:36.941878 I | rook-ceph-mon0: 2017-07-11 14:59:36.941861 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3715233975' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:39.374258 I | rook-ceph-mon0: 2017-07-11 14:59:39.374214 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:39.374495 I | rook-ceph-mon0: 2017-07-11 14:59:39.374460 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3079779884' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:40.793344 I | rook-ceph-mon0: 2017-07-11 14:59:40.793114 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:40.793436 I | rook-ceph-mon0: 2017-07-11 14:59:40.793135 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1350820033' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:41.704909 I | rook-ceph-mon0: 2017-07-11 14:59:41.704869 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:41.705145 I | rook-ceph-mon0: 2017-07-11 14:59:41.705104 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1771007573' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:43.117134 I | rook-ceph-mon0: 2017-07-11 14:59:43.117095 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:43.117347 I | rook-ceph-mon0: 2017-07-11 14:59:43.117318 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1904873560' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:45.628112 I | rook-ceph-mon0: 2017-07-11 14:59:45.627960 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4824 MB, avail 94362 MB
- 2017-07-11 14:59:45.680533 I | rook-ceph-mon0: 2017-07-11 14:59:45.680489 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:45.680664 I | rook-ceph-mon0: 2017-07-11 14:59:45.680648 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1066691660' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:47.141594 I | rook-ceph-mon0: 2017-07-11 14:59:47.141555 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:47.141817 I | rook-ceph-mon0: 2017-07-11 14:59:47.141780 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3923357390' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:47.608708 I | rook-ceph-mon0: 2017-07-11 14:59:47.608672 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:47.608903 I | rook-ceph-mon0: 2017-07-11 14:59:47.608817 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/779266062' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:48.048242 I | rook-ceph-mon0: 2017-07-11 14:59:48.048204 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:48.048306 I | rook-ceph-mon0: 2017-07-11 14:59:48.048291 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3650280731' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:49.429403 I | rook-ceph-mon0: 2017-07-11 14:59:49.429365 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:49.429593 I | rook-ceph-mon0: 2017-07-11 14:59:49.429513 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3741992287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:50.768289 I | rook-ceph-mon0: 2017-07-11 14:59:50.768249 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:50.768670 I | rook-ceph-mon0: 2017-07-11 14:59:50.768554 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/783006446' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:51.246063 I | rook-ceph-mon0: 2017-07-11 14:59:51.246020 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:51.246362 I | rook-ceph-mon0: 2017-07-11 14:59:51.246316 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/396271195' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:51.696036 I | rook-ceph-mon0: 2017-07-11 14:59:51.695999 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:51.696249 I | rook-ceph-mon0: 2017-07-11 14:59:51.696232 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1605247685' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:54.451949 I | rook-ceph-mon0: 2017-07-11 14:59:54.451909 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:54.452144 I | rook-ceph-mon0: 2017-07-11 14:59:54.452057 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/47330321' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:55.592757 I | rook-ceph-mon0: 2017-07-11 14:59:55.592709 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:55.592883 I | rook-ceph-mon0: 2017-07-11 14:59:55.592866 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/259400449' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:56.507537 I | rook-ceph-mon0: 2017-07-11 14:59:56.507499 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:56.507709 I | rook-ceph-mon0: 2017-07-11 14:59:56.507633 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1959845732' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:58.894092 I | rook-ceph-mon0: 2017-07-11 14:59:58.894053 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:58.894303 I | rook-ceph-mon0: 2017-07-11 14:59:58.894202 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2349545428' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:59.236529 I | rook-ceph-mon0: 2017-07-11 14:59:59.236490 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:59.236747 I | rook-ceph-mon0: 2017-07-11 14:59:59.236641 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3648230576' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:00.000406 I | rook-ceph-mon0: 2017-07-11 15:00:00.000322 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 15:00:01.096550 I | rook-ceph-mon0: 2017-07-11 15:00:00.000329 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2084 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 15:00:03.570761 I | rook-ceph-mon0: 2017-07-11 15:00:03.570722 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:03.570948 I | rook-ceph-mon0: 2017-07-11 15:00:03.570865 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3455050511' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:04.478128 I | rook-ceph-mon0: 2017-07-11 15:00:04.478089 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:04.478358 I | rook-ceph-mon0: 2017-07-11 15:00:04.478341 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1348010020' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:05.616974 I | rook-ceph-mon0: 2017-07-11 15:00:05.616934 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:05.617220 I | rook-ceph-mon0: 2017-07-11 15:00:05.617202 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2299424596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:05.679131 I | rook-ceph-mon0: 2017-07-11 15:00:05.679094 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:05.679259 I | rook-ceph-mon0: 2017-07-11 15:00:05.679243 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/520256062' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:06.577737 I | rook-ceph-mon0: 2017-07-11 15:00:06.577695 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:06.578003 I | rook-ceph-mon0: 2017-07-11 15:00:06.577961 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1244893806' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:07.014353 I | rook-ceph-mon0: 2017-07-11 15:00:07.014304 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:07.014563 I | rook-ceph-mon0: 2017-07-11 15:00:07.014459 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3192772739' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:12.475334 I | rook-ceph-mon0: 2017-07-11 15:00:12.475294 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:12.475523 I | rook-ceph-mon0: 2017-07-11 15:00:12.475438 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3442016636' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:13.396522 I | rook-ceph-mon0: 2017-07-11 15:00:13.396483 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:13.396733 I | rook-ceph-mon0: 2017-07-11 15:00:13.396633 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3859067360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:15.320220 I | rook-ceph-mon0: 2017-07-11 15:00:15.320181 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:15.320341 I | rook-ceph-mon0: 2017-07-11 15:00:15.320326 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3413460841' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:16.381273 I | rook-ceph-mon0: 2017-07-11 15:00:16.381234 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:16.381470 I | rook-ceph-mon0: 2017-07-11 15:00:16.381383 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/544998847' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:16.798627 I | rook-ceph-mon0: 2017-07-11 15:00:16.798588 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:16.798865 I | rook-ceph-mon0: 2017-07-11 15:00:16.798813 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3030489923' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:18.606075 I | rook-ceph-mon0: 2017-07-11 15:00:18.606035 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:18.606292 I | rook-ceph-mon0: 2017-07-11 15:00:18.606258 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2641867161' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:19.089705 I | rook-ceph-mon0: 2017-07-11 15:00:19.089656 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:19.089925 I | rook-ceph-mon0: 2017-07-11 15:00:19.089815 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1980776709' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:23.495493 I | rook-ceph-mon0: 2017-07-11 15:00:23.495454 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:23.496017 I | rook-ceph-mon0: 2017-07-11 15:00:23.495604 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/809133906' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:24.382568 I | rook-ceph-mon0: 2017-07-11 15:00:24.382531 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:24.382633 I | rook-ceph-mon0: 2017-07-11 15:00:24.382619 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/966167388' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:26.929196 I | rook-ceph-mon0: 2017-07-11 15:00:26.929157 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:26.929417 I | rook-ceph-mon0: 2017-07-11 15:00:26.929331 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2185781665' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:30.469665 I | rook-ceph-mon0: 2017-07-11 15:00:30.469613 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:30.469863 I | rook-ceph-mon0: 2017-07-11 15:00:30.469778 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2817190692' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:33.081694 I | rook-ceph-mon0: 2017-07-11 15:00:33.081651 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:33.081764 I | rook-ceph-mon0: 2017-07-11 15:00:33.081748 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/365995986' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:33.411747 I | rook-ceph-mon0: 2017-07-11 15:00:33.411709 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:33.411969 I | rook-ceph-mon0: 2017-07-11 15:00:33.411938 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3105949225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:39.063440 I | rook-ceph-mon0: 2017-07-11 15:00:39.063403 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:39.063672 I | rook-ceph-mon0: 2017-07-11 15:00:39.063656 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/305330397' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:39.673988 I | rook-ceph-mon0: 2017-07-11 15:00:39.673952 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:39.675540 I | rook-ceph-mon0: 2017-07-11 15:00:39.674283 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2521701238' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:40.123571 I | rook-ceph-mon0: 2017-07-11 15:00:40.123533 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:40.123636 I | rook-ceph-mon0: 2017-07-11 15:00:40.123621 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/123112605' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:43.542581 I | rook-ceph-mon0: 2017-07-11 15:00:43.542543 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:43.542776 I | rook-ceph-mon0: 2017-07-11 15:00:43.542690 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1390615243' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:44.422266 I | rook-ceph-mon0: 2017-07-11 15:00:44.422230 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:44.422332 I | rook-ceph-mon0: 2017-07-11 15:00:44.422317 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/114224157' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:44.545054 I | rook-ceph-mon0: 2017-07-11 15:00:44.545017 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:44.545265 I | rook-ceph-mon0: 2017-07-11 15:00:44.545159 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3814518758' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:44.824677 I | rook-ceph-mon0: 2017-07-11 15:00:44.824632 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:44.824934 I | rook-ceph-mon0: 2017-07-11 15:00:44.824799 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2560895206' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:45.628480 I | rook-ceph-mon0: 2017-07-11 15:00:45.628244 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4824 MB, avail 94362 MB
- 2017-07-11 15:00:45.993858 I | rook-ceph-mon0: 2017-07-11 15:00:45.993772 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #135. Immutable memtables: 0.
- 2017-07-11 15:00:45.994128 I | rook-ceph-mon0:
- 2017-07-11 15:00:45.994167 I | rook-ceph-mon0: 2017-07-11 15:00:45.993809 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 86] Syncing log #132
- 2017-07-11 15:00:46.015361 I | rook-ceph-mon0: 2017-07-11 15:00:46.015043 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:00:45.993804) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:00:46.015431 I | rook-ceph-mon0: 2017-07-11 15:00:46.015057 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 86] Flushing memtable with next log file: 135
- 2017-07-11 15:00:46.015448 I | rook-ceph-mon0:
- 2017-07-11 15:00:46.015462 I | rook-ceph-mon0: 2017-07-11 15:00:46.015068 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246015064, "job": 86, "event": "flush_started", "num_memtables": 1, "num_entries": 1998, "num_deletes": 251, "memory_usage": 4902048}
- 2017-07-11 15:00:46.015475 I | rook-ceph-mon0: 2017-07-11 15:00:46.015071 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 86] Level-0 flush table #136: started
- 2017-07-11 15:00:46.129249 I | rook-ceph-mon0: 2017-07-11 15:00:46.129201 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246129190, "cf_name": "default", "job": 86, "event": "table_file_creation", "file_number": 136, "file_size": 4846034, "table_properties": {"data_size": 4828922, "index_size": 16293, "filter_size": 0, "raw_key_size": 16634, "raw_average_key_size": 18, "raw_value_size": 4805351, "raw_average_value_size": 5423, "num_data_blocks": 511, "num_entries": 886, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 15:00:46.129349 I | rook-ceph-mon0: 2017-07-11 15:00:46.129331 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 86] Level-0 flush table #136: 4846034 bytes OK
- 2017-07-11 15:00:46.188577 I | rook-ceph-mon0: 2017-07-11 15:00:46.188531 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.157103) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #136 started
- 2017-07-11 15:00:46.188682 I | rook-ceph-mon0: 2017-07-11 15:00:46.188666 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.188480) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #136: memtable #1 done
- 2017-07-11 15:00:46.188812 I | rook-ceph-mon0: 2017-07-11 15:00:46.188776 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.188503) EVENT_LOG_v1 {"time_micros": 1499785246188497, "job": 86, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:00:46.188859 I | rook-ceph-mon0: 2017-07-11 15:00:46.188832 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.188518) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:00:46.188874 I | rook-ceph-mon0:
- 2017-07-11 15:00:46.188904 I | rook-ceph-mon0: 2017-07-11 15:00:46.188892 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 86] Try to delete WAL files size 4855606, prev total WAL file size 4855606, number of live WAL files 2.
- 2017-07-11 15:00:46.188917 I | rook-ceph-mon0:
- 2017-07-11 15:00:46.194178 I | rook-ceph-mon0: 2017-07-11 15:00:46.189806 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:00:46.194233 I | rook-ceph-mon0: 2017-07-11 15:00:46.189855 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.189849) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 15:00:46.194250 I | rook-ceph-mon0:
- 2017-07-11 15:00:46.194262 I | rook-ceph-mon0: 2017-07-11 15:00:46.189860 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 87] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:00:46.194288 I | rook-ceph-mon0: 2017-07-11 15:00:46.189865 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 86 Base level 0, inputs: [136(4732KB)], [134(13MB)]
- 2017-07-11 15:00:46.194300 I | rook-ceph-mon0:
- 2017-07-11 15:00:46.194311 I | rook-ceph-mon0: 2017-07-11 15:00:46.189875 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246189867, "job": 87, "event": "compaction_started", "files_L0": [136], "files_L1": [134], "score": -1, "input_data_size": 18768911}
- 2017-07-11 15:00:46.433363 I | rook-ceph-mon0: 2017-07-11 15:00:46.433310 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 87] Generated table #137: 2437 keys, 16218042 bytes
- 2017-07-11 15:00:46.433547 I | rook-ceph-mon0: 2017-07-11 15:00:46.433468 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246433458, "cf_name": "default", "job": 87, "event": "table_file_creation", "file_number": 137, "file_size": 16218042, "table_properties": {"data_size": 16164445, "index_size": 52778, "filter_size": 0, "raw_key_size": 47097, "raw_average_key_size": 19, "raw_value_size": 16093454, "raw_average_value_size": 6603, "num_data_blocks": 1601, "num_entries": 2437, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:00:46.456373 I | rook-ceph-mon0: 2017-07-11 15:00:46.456329 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 87] Compacted 1@0 + 1@1 files to L1 => 16218042 bytes
- 2017-07-11 15:00:46.472478 I | rook-ceph-mon0: 2017-07-11 15:00:46.472411 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.472315) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 70.4 rd, 60.9 wr, level 1, files in(1, 1) out(1) MB in(4.6, 13.3) out(15.5), read-write-amplify(7.2) write-amplify(3.3) OK, records in: 2946, records dropped: 509
- 2017-07-11 15:00:46.472559 I | rook-ceph-mon0:
- 2017-07-11 15:00:46.472616 I | rook-ceph-mon0: 2017-07-11 15:00:46.472580 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.472340) EVENT_LOG_v1 {"time_micros": 1499785246472331, "job": 87, "event": "compaction_finished", "compaction_time_micros": 266437, "output_level": 1, "num_output_files": 1, "total_output_size": 16218042, "num_input_records": 2946, "num_output_records": 2437, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:00:46.473433 I | rook-ceph-mon0: 2017-07-11 15:00:46.473418 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246473415, "job": 87, "event": "table_file_deletion", "file_number": 136}
- 2017-07-11 15:00:46.475077 I | rook-ceph-mon0: 2017-07-11 15:00:46.475062 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246475060, "job": 87, "event": "table_file_deletion", "file_number": 134}
- 2017-07-11 15:00:47.971243 I | rook-ceph-mon0: 2017-07-11 15:00:47.971203 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:47.971474 I | rook-ceph-mon0: 2017-07-11 15:00:47.971457 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1080914432' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:48.938123 I | rook-ceph-mon0: 2017-07-11 15:00:48.938084 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:48.938322 I | rook-ceph-mon0: 2017-07-11 15:00:48.938236 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1799892899' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:51.336896 I | rook-ceph-mon0: 2017-07-11 15:00:51.336859 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:51.337105 I | rook-ceph-mon0: 2017-07-11 15:00:51.337003 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4117928505' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:54.972788 I | rook-ceph-mon0: 2017-07-11 15:00:54.972752 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:54.973023 I | rook-ceph-mon0: 2017-07-11 15:00:54.972908 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4281799316' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:55.547596 I | rook-ceph-mon0: 2017-07-11 15:00:55.547544 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:55.547701 I | rook-ceph-mon0: 2017-07-11 15:00:55.547687 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3384922473' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:56.038429 I | rook-ceph-mon0: 2017-07-11 15:00:56.038371 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:56.038640 I | rook-ceph-mon0: 2017-07-11 15:00:56.038622 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4138152010' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:56.193511 I | rook-ceph-mon0: 2017-07-11 15:00:56.193472 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:56.193701 I | rook-ceph-mon0: 2017-07-11 15:00:56.193618 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4097426469' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:57.948415 I | rook-ceph-mon0: 2017-07-11 15:00:57.948369 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:57.948639 I | rook-ceph-mon0: 2017-07-11 15:00:57.948608 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/122541068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:59.682257 I | rook-ceph-mon0: 2017-07-11 15:00:59.682145 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #138. Immutable memtables: 0.
- 2017-07-11 15:00:59.682500 I | rook-ceph-mon0:
- 2017-07-11 15:00:59.682524 I | rook-ceph-mon0: 2017-07-11 15:00:59.682177 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 88] Syncing log #135
- 2017-07-11 15:00:59.711118 I | rook-ceph-mon0: 2017-07-11 15:00:59.710504 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:00:59.682172) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:00:59.711177 I | rook-ceph-mon0: 2017-07-11 15:00:59.710518 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 88] Flushing memtable with next log file: 138
- 2017-07-11 15:00:59.711194 I | rook-ceph-mon0:
- 2017-07-11 15:00:59.711206 I | rook-ceph-mon0: 2017-07-11 15:00:59.710529 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785259710524, "job": 88, "event": "flush_started", "num_memtables": 1, "num_entries": 633, "num_deletes": 506, "memory_usage": 379736}
- 2017-07-11 15:00:59.711233 I | rook-ceph-mon0: 2017-07-11 15:00:59.710531 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 88] Level-0 flush table #139: started
- 2017-07-11 15:00:59.742128 I | rook-ceph-mon0: 2017-07-11 15:00:59.742054 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785259742045, "cf_name": "default", "job": 88, "event": "table_file_creation", "file_number": 139, "file_size": 364544, "table_properties": {"data_size": 362525, "index_size": 1205, "filter_size": 0, "raw_key_size": 10905, "raw_average_key_size": 19, "raw_value_size": 354293, "raw_average_value_size": 634, "num_data_blocks": 39, "num_entries": 558, "filter_policy_name": "", "kDeletedKeys": "506", "kMergeOperands": "0"}}
- 2017-07-11 15:00:59.742201 I | rook-ceph-mon0: 2017-07-11 15:00:59.742066 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 88] Level-0 flush table #139: 364544 bytes OK
- 2017-07-11 15:00:59.772636 I | rook-ceph-mon0: 2017-07-11 15:00:59.772603 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:00:59.757030) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #139 started
- 2017-07-11 15:00:59.772709 I | rook-ceph-mon0: 2017-07-11 15:00:59.772695 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:00:59.772564) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #139: memtable #1 done
- 2017-07-11 15:00:59.772756 I | rook-ceph-mon0: 2017-07-11 15:00:59.772727 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:00:59.772578) EVENT_LOG_v1 {"time_micros": 1499785259772573, "job": 88, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:00:59.772784 I | rook-ceph-mon0: 2017-07-11 15:00:59.772771 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:00:59.772593) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:00:59.772797 I | rook-ceph-mon0:
- 2017-07-11 15:00:59.772862 I | rook-ceph-mon0: 2017-07-11 15:00:59.772836 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 88] Try to delete WAL files size 364519, prev total WAL file size 364519, number of live WAL files 2.
- 2017-07-11 15:00:59.772876 I | rook-ceph-mon0:
- 2017-07-11 15:00:59.775125 I | rook-ceph-mon0: 2017-07-11 15:00:59.773141 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:00:59.775188 I | rook-ceph-mon0: 2017-07-11 15:00:59.773171 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:00:59.773165) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 15:00:59.775204 I | rook-ceph-mon0:
- 2017-07-11 15:00:59.775232 I | rook-ceph-mon0: 2017-07-11 15:00:59.773175 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 89] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:00:59.775245 I | rook-ceph-mon0: 2017-07-11 15:00:59.773178 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 88 Base level 0, inputs: [139(356KB)], [137(15MB)]
- 2017-07-11 15:00:59.775257 I | rook-ceph-mon0:
- 2017-07-11 15:00:59.775268 I | rook-ceph-mon0: 2017-07-11 15:00:59.773188 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785259773181, "job": 89, "event": "compaction_started", "files_L0": [139], "files_L1": [137], "score": -1, "input_data_size": 16582586}
- 2017-07-11 15:00:59.983897 I | rook-ceph-mon0: 2017-07-11 15:00:59.983846 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 89] Generated table #140: 1976 keys, 13481934 bytes
- 2017-07-11 15:00:59.984071 I | rook-ceph-mon0: 2017-07-11 15:00:59.983994 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785259983985, "cf_name": "default", "job": 89, "event": "table_file_creation", "file_number": 140, "file_size": 13481934, "table_properties": {"data_size": 13436961, "index_size": 44154, "filter_size": 0, "raw_key_size": 38084, "raw_average_key_size": 19, "raw_value_size": 13378409, "raw_average_value_size": 6770, "num_data_blocks": 1351, "num_entries": 1976, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:01:00.011449 I | rook-ceph-mon0: 2017-07-11 15:01:00.011404 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 89] Compacted 1@0 + 1@1 files to L1 => 13481934 bytes
- 2017-07-11 15:01:00.042660 I | rook-ceph-mon0: 2017-07-11 15:01:00.042598 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:01:00.042505) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 69.6 rd, 56.6 wr, level 1, files in(1, 1) out(1) MB in(0.3, 15.5) out(12.9), read-write-amplify(82.5) write-amplify(37.0) OK, records in: 2995, records dropped: 1019
- 2017-07-11 15:01:00.042735 I | rook-ceph-mon0:
- 2017-07-11 15:01:00.042772 I | rook-ceph-mon0: 2017-07-11 15:01:00.042755 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:01:00.042533) EVENT_LOG_v1 {"time_micros": 1499785260042524, "job": 89, "event": "compaction_finished", "compaction_time_micros": 238193, "output_level": 1, "num_output_files": 1, "total_output_size": 13481934, "num_input_records": 2995, "num_output_records": 1976, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:01:00.043066 I | rook-ceph-mon0: 2017-07-11 15:01:00.043052 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785260043049, "job": 89, "event": "table_file_deletion", "file_number": 139}
- 2017-07-11 15:01:00.045036 I | rook-ceph-mon0: 2017-07-11 15:01:00.045021 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785260045019, "job": 89, "event": "table_file_deletion", "file_number": 137}
- 2017-07-11 15:01:00.045105 I | rook-ceph-mon0: 2017-07-11 15:01:00.045090 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:01:00.845014 I | rook-ceph-mon0: 2017-07-11 15:01:00.844974 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:00.845216 I | rook-ceph-mon0: 2017-07-11 15:01:00.845123 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3642439980' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:01.256618 I | rook-ceph-mon0: 2017-07-11 15:01:01.256581 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:01.256817 I | rook-ceph-mon0: 2017-07-11 15:01:01.256735 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1809816473' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:01.276440 I | rook-ceph-mon0: 2017-07-11 15:01:01.276408 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:01.276544 I | rook-ceph-mon0: 2017-07-11 15:01:01.276529 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3689815972' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:02.121477 I | rook-ceph-mon0: 2017-07-11 15:01:02.121436 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:02.121703 I | rook-ceph-mon0: 2017-07-11 15:01:02.121661 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2519309276' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:01:03.462409 I | rook-ceph-mon0: 2017-07-11 15:01:03.462333 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:03.462654 I | rook-ceph-mon0: 2017-07-11 15:01:03.462513 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1754153291' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:03.930636 I | rook-ceph-mon0: 2017-07-11 15:01:03.930598 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:03.930789 I | rook-ceph-mon0: 2017-07-11 15:01:03.930766 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1853095404' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:05.905581 I | rook-ceph-mon0: 2017-07-11 15:01:05.905538 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:05.905809 I | rook-ceph-mon0: 2017-07-11 15:01:05.905779 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1380037833' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:01:07.280276 I | rook-ceph-mon0: 2017-07-11 15:01:07.280237 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:07.280485 I | rook-ceph-mon0: 2017-07-11 15:01:07.280386 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1112702092' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:08.705451 I | rook-ceph-mon0: 2017-07-11 15:01:08.705412 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:08.705684 I | rook-ceph-mon0: 2017-07-11 15:01:08.705667 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2880610164' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:10.712369 I | rook-ceph-mon0: 2017-07-11 15:01:10.712331 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:10.712615 I | rook-ceph-mon0: 2017-07-11 15:01:10.712574 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/916106930' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:11.195240 I | rook-ceph-mon0: 2017-07-11 15:01:11.195202 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:11.195435 I | rook-ceph-mon0: 2017-07-11 15:01:11.195351 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1826982168' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:12.147383 I | rook-ceph-mon0: 2017-07-11 15:01:12.147345 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:12.147573 I | rook-ceph-mon0: 2017-07-11 15:01:12.147486 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2760694531' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:12.460604 I | rook-ceph-mon0: 2017-07-11 15:01:12.460569 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:12.460853 I | rook-ceph-mon0: 2017-07-11 15:01:12.460712 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3642428884' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:13.657562 I | rook-ceph-mon0: 2017-07-11 15:01:13.657522 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:13.657784 I | rook-ceph-mon0: 2017-07-11 15:01:13.657752 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3076691603' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:01:14.606354 I | rook-ceph-mon0: 2017-07-11 15:01:14.606315 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:14.606421 I | rook-ceph-mon0: 2017-07-11 15:01:14.606406 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2236779131' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:15.630866 I | rook-ceph-mon0: 2017-07-11 15:01:15.630828 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:15.631060 I | rook-ceph-mon0: 2017-07-11 15:01:15.630975 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3664602111' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:17.684990 I | rook-ceph-mon0: 2017-07-11 15:01:17.684947 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:17.685224 I | rook-ceph-mon0: 2017-07-11 15:01:17.685184 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3443379311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:01:18.848934 I | rook-ceph-mon0: 2017-07-11 15:01:18.848897 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:18.849183 I | rook-ceph-mon0: 2017-07-11 15:01:18.849029 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2242374853' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:19.341081 I | rook-ceph-mon0: 2017-07-11 15:01:19.341034 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:19.341252 I | rook-ceph-mon0: 2017-07-11 15:01:19.341177 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3521481155' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:21.721845 I | rook-ceph-mon0: 2017-07-11 15:01:21.712363 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:21.722101 I | rook-ceph-mon0: 2017-07-11 15:01:21.722076 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1558785225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:01:23.576476 I | rook-ceph-mon0: 2017-07-11 15:01:23.576436 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:23.576694 I | rook-ceph-mon0: 2017-07-11 15:01:23.576587 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2906071646' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:25.709957 I | rook-ceph-mon0: 2017-07-11 15:01:25.709919 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:25.710168 I | rook-ceph-mon0: 2017-07-11 15:01:25.710139 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1802589903' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:01:29.848174 I | rook-ceph-mon0: 2017-07-11 15:01:29.848136 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:29.848415 I | rook-ceph-mon0: 2017-07-11 15:01:29.848357 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4210853426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:01:30.159166 I | rook-ceph-mon0: 2017-07-11 15:01:30.159128 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:30.159234 I | rook-ceph-mon0: 2017-07-11 15:01:30.159219 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/822643103' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:32.912934 I | rook-ceph-mon0: 2017-07-11 15:01:32.912896 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:32.913138 I | rook-ceph-mon0: 2017-07-11 15:01:32.913051 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/20094379' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:33.862509 I | rook-ceph-mon0: 2017-07-11 15:01:33.862470 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:33.862747 I | rook-ceph-mon0: 2017-07-11 15:01:33.862731 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3017233377' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:01:35.484086 I | rook-ceph-mon0: 2017-07-11 15:01:35.484049 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:35.484283 I | rook-ceph-mon0: 2017-07-11 15:01:35.484197 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/764247713' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:36.417274 I | rook-ceph-mon0: 2017-07-11 15:01:36.417235 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:36.417502 I | rook-ceph-mon0: 2017-07-11 15:01:36.417384 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/967188857' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:40.322289 I | rook-ceph-mon0: 2017-07-11 15:01:40.322251 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:40.322522 I | rook-ceph-mon0: 2017-07-11 15:01:40.322480 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/452401466' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:41.626811 I | rook-ceph-mon0: 2017-07-11 15:01:41.626775 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:41.626879 I | rook-ceph-mon0: 2017-07-11 15:01:41.626864 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1008882099' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:41.697824 I | rook-ceph-mon0: 2017-07-11 15:01:41.697786 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:41.697889 I | rook-ceph-mon0: 2017-07-11 15:01:41.697874 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1666939778' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:41.798898 I | rook-ceph-mon0: 2017-07-11 15:01:41.798859 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:41.798971 I | rook-ceph-mon0: 2017-07-11 15:01:41.798956 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2950845316' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:01:42.672274 I | rook-ceph-mon0: 2017-07-11 15:01:42.672239 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:42.672464 I | rook-ceph-mon0: 2017-07-11 15:01:42.672372 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3560369044' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:43.120779 I | rook-ceph-mon0: 2017-07-11 15:01:43.118315 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:43.127620 I | rook-ceph-mon0: 2017-07-11 15:01:43.127599 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2759339209' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:44.127646 I | rook-ceph-mon0: 2017-07-11 15:01:44.127606 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:44.127842 I | rook-ceph-mon0: 2017-07-11 15:01:44.127755 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/909487075' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:44.574124 I | rook-ceph-mon0: 2017-07-11 15:01:44.574088 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:44.574315 I | rook-ceph-mon0: 2017-07-11 15:01:44.574225 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2463653782' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:45.623749 I | rook-ceph-mon0: 2017-07-11 15:01:45.623622 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:45.623965 I | rook-ceph-mon0: 2017-07-11 15:01:45.623938 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3328496770' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:01:45.628792 I | rook-ceph-mon0: 2017-07-11 15:01:45.628550 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4824 MB, avail 94362 MB
- 2017-07-11 15:01:46.525292 I | rook-ceph-mon0: 2017-07-11 15:01:46.525252 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:46.525515 I | rook-ceph-mon0: 2017-07-11 15:01:46.525474 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1164540115' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:51.198229 I | rook-ceph-mon0: 2017-07-11 15:01:51.198192 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:51.198425 I | rook-ceph-mon0: 2017-07-11 15:01:51.198342 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3880524619' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:51.638429 I | rook-ceph-mon0: 2017-07-11 15:01:51.638396 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:51.638514 I | rook-ceph-mon0: 2017-07-11 15:01:51.638487 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3399407369' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:52.883739 I | rook-ceph-mon0: 2017-07-11 15:01:52.883699 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:52.883964 I | rook-ceph-mon0: 2017-07-11 15:01:52.883923 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1403752704' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:02:00.607630 I | rook-ceph-mon0: 2017-07-11 15:02:00.607584 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:02:00.607862 I | rook-ceph-mon0: 2017-07-11 15:02:00.607829 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1041586315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:02:01.521416 I | rook-ceph-mon0: 2017-07-11 15:02:01.521378 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:01.521605 I | rook-ceph-mon0: 2017-07-11 15:02:01.521523 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/613292722' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:01.951700 I | rook-ceph-mon0: 2017-07-11 15:02:01.951662 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:01.951915 I | rook-ceph-mon0: 2017-07-11 15:02:01.951885 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4200118649' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:04.312512 I | rook-ceph-mon0: 2017-07-11 15:02:04.312474 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:04.312706 I | rook-ceph-mon0: 2017-07-11 15:02:04.312619 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3218465154' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:05.884858 I | rook-ceph-mon0: 2017-07-11 15:02:05.884820 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:05.885084 I | rook-ceph-mon0: 2017-07-11 15:02:05.884971 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/714890334' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:06.307365 I | rook-ceph-mon0: 2017-07-11 15:02:06.307305 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:06.307552 I | rook-ceph-mon0: 2017-07-11 15:02:06.307476 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4115279498' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:06.733308 I | rook-ceph-mon0: 2017-07-11 15:02:06.733271 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:02:06.733552 I | rook-ceph-mon0: 2017-07-11 15:02:06.733423 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1554224912' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:02:07.983618 I | rook-ceph-mon0: 2017-07-11 15:02:07.983564 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:02:07.987341 I | rook-ceph-mon0: 2017-07-11 15:02:07.987311 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2507954109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:02:08.521109 I | rook-ceph-mon0: 2017-07-11 15:02:08.521071 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:08.521339 I | rook-ceph-mon0: 2017-07-11 15:02:08.521224 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/704006161' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:09.335341 I | rook-ceph-mon0: 2017-07-11 15:02:09.335299 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:09.342707 I | rook-ceph-mon0: 2017-07-11 15:02:09.337043 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1880522918' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:10.725693 I | rook-ceph-mon0: 2017-07-11 15:02:10.725654 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:10.725889 I | rook-ceph-mon0: 2017-07-11 15:02:10.725802 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2586615452' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:15.789623 I | rook-ceph-mon0: 2017-07-11 15:02:15.789585 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:15.789872 I | rook-ceph-mon0: 2017-07-11 15:02:15.789854 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3430736316' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:15.838083 I | rook-ceph-mon0: 2017-07-11 15:02:15.838049 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:02:15.838197 I | rook-ceph-mon0: 2017-07-11 15:02:15.838181 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1060336098' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:02:17.072425 I | rook-ceph-mon0: 2017-07-11 15:02:17.072388 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:17.072626 I | rook-ceph-mon0: 2017-07-11 15:02:17.072543 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3357660182' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:18.326308 I | rook-ceph-mon0: 2017-07-11 15:02:18.326272 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:18.326513 I | rook-ceph-mon0: 2017-07-11 15:02:18.326432 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1840810901' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:22.409694 I | rook-ceph-mon0: 2017-07-11 15:02:22.409647 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:02:22.409919 I | rook-ceph-mon0: 2017-07-11 15:02:22.409823 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3617650574' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:02:26.936929 I | rook-ceph-mon0: 2017-07-11 15:02:26.936892 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:26.937162 I | rook-ceph-mon0: 2017-07-11 15:02:26.937121 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2909900670' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:27.314047 I | rook-ceph-mon0: 2017-07-11 15:02:27.314013 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:02:27.314156 I | rook-ceph-mon0: 2017-07-11 15:02:27.314140 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1274038166' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:02:28.765603 I | rook-ceph-mon0: 2017-07-11 15:02:28.765563 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:02:28.765819 I | rook-ceph-mon0: 2017-07-11 15:02:28.765789 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3083179202' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:02:31.471794 I | rook-ceph-mon0: 2017-07-11 15:02:31.471756 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:31.472047 I | rook-ceph-mon0: 2017-07-11 15:02:31.471902 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/322707005' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:32.687296 I | rook-ceph-mon0: 2017-07-11 15:02:32.687253 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:32.687487 I | rook-ceph-mon0: 2017-07-11 15:02:32.687405 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2574049462' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:41.852722 I | rook-ceph-mon0: 2017-07-11 15:02:41.852683 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:41.852949 I | rook-ceph-mon0: 2017-07-11 15:02:41.852834 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2123186383' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:45.628940 I | rook-ceph-mon0: 2017-07-11 15:02:45.628781 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4824 MB, avail 94362 MB
- 2017-07-11 15:02:50.227020 I | rook-ceph-mon0: 2017-07-11 15:02:50.226978 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:50.227214 I | rook-ceph-mon0: 2017-07-11 15:02:50.227128 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4209501432' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:01.499157 I | rook-ceph-mon0: 2017-07-11 15:03:01.499107 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:01.499374 I | rook-ceph-mon0: 2017-07-11 15:03:01.499265 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3005635766' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:01.548453 I | rook-ceph-mon0: 2017-07-11 15:03:01.548415 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:01.548676 I | rook-ceph-mon0: 2017-07-11 15:03:01.548560 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1160838730' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:04.009320 I | rook-ceph-mon0: 2017-07-11 15:03:04.009259 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:04.009387 I | rook-ceph-mon0: 2017-07-11 15:03:04.009372 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3166078958' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:14.961468 I | rook-ceph-mon0: 2017-07-11 15:03:14.961429 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:14.961704 I | rook-ceph-mon0: 2017-07-11 15:03:14.961662 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/173596089' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:24.481723 I | rook-ceph-mon0: 2017-07-11 15:03:24.481686 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:24.481917 I | rook-ceph-mon0: 2017-07-11 15:03:24.481830 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/156300799' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:35.659059 I | rook-ceph-mon0: 2017-07-11 15:03:35.659020 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:35.659272 I | rook-ceph-mon0: 2017-07-11 15:03:35.659171 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/296521441' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:35.729823 I | rook-ceph-mon0: 2017-07-11 15:03:35.729786 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:35.730015 I | rook-ceph-mon0: 2017-07-11 15:03:35.729933 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/230491234' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:37.108423 I | rook-ceph-mon0: 2017-07-11 15:03:37.108381 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:37.108616 I | rook-ceph-mon0: 2017-07-11 15:03:37.108531 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1110659607' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:45.629163 I | rook-ceph-mon0: 2017-07-11 15:03:45.629004 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4824 MB, avail 94362 MB
- 2017-07-11 15:03:48.320972 I | rook-ceph-mon0: 2017-07-11 15:03:48.320935 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:48.321188 I | rook-ceph-mon0: 2017-07-11 15:03:48.321103 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1400664880' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:34.777671 I | rook-ceph-mon0: 2017-07-11 15:04:34.777626 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:04:34.777886 I | rook-ceph-mon0: 2017-07-11 15:04:34.777782 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2813120706' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:35.639092 I | rook-ceph-mon0: 2017-07-11 15:04:35.639056 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0585989s > max 0.05s
- 2017-07-11 15:04:35.639374 I | rook-ceph-mon0: 2017-07-11 15:04:35.639357 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.224719s > max 0.05s
- 2017-07-11 15:04:36.754322 I | rook-ceph-mon0: 2017-07-11 15:04:35.639122 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2193 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0585989s > max 0.05s
- 2017-07-11 15:04:36.754413 I | rook-ceph-mon0: 2017-07-11 15:04:35.639389 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2194 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.224719s > max 0.05s
- 2017-07-11 15:04:42.209101 I | rook-ceph-mon0: 2017-07-11 15:04:42.209063 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:04:42.209341 I | rook-ceph-mon0: 2017-07-11 15:04:42.209322 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3759654997' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:43.106442 I | rook-ceph-mon0: 2017-07-11 15:04:43.106403 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:04:43.106681 I | rook-ceph-mon0: 2017-07-11 15:04:43.106665 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2186097283' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:45.629441 I | rook-ceph-mon0: 2017-07-11 15:04:45.629293 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4824 MB, avail 94362 MB
- 2017-07-11 15:04:53.317525 I | rook-ceph-mon0: 2017-07-11 15:04:53.317477 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:04:53.326965 I | rook-ceph-mon0: 2017-07-11 15:04:53.317632 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4175950492' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:56.802253 I | rook-ceph-mon0: 2017-07-11 15:04:56.802216 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:04:56.802430 I | rook-ceph-mon0: 2017-07-11 15:04:56.802350 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2770258467' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:05.173669 I | rook-ceph-mon0: 2017-07-11 15:05:05.173630 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:05.173897 I | rook-ceph-mon0: 2017-07-11 15:05:05.173855 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2006653731' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:07.807015 I | rook-ceph-mon0: 2017-07-11 15:05:07.806975 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:07.807219 I | rook-ceph-mon0: 2017-07-11 15:05:07.807135 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2035221193' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:09.457596 I | rook-ceph-mon0: 2017-07-11 15:05:09.457496 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #141. Immutable memtables: 0.
- 2017-07-11 15:05:09.457697 I | rook-ceph-mon0:
- 2017-07-11 15:05:09.457715 I | rook-ceph-mon0: 2017-07-11 15:05:09.457548 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 90] Syncing log #138
- 2017-07-11 15:05:09.492827 I | rook-ceph-mon0: 2017-07-11 15:05:09.487860 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.457531) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:05:09.492910 I | rook-ceph-mon0: 2017-07-11 15:05:09.487882 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 90] Flushing memtable with next log file: 141
- 2017-07-11 15:05:09.492927 I | rook-ceph-mon0:
- 2017-07-11 15:05:09.492941 I | rook-ceph-mon0: 2017-07-11 15:05:09.487894 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785509487889, "job": 90, "event": "flush_started", "num_memtables": 1, "num_entries": 1864, "num_deletes": 251, "memory_usage": 4352920}
- 2017-07-11 15:05:09.492953 I | rook-ceph-mon0: 2017-07-11 15:05:09.487896 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 90] Level-0 flush table #142: started
- 2017-07-11 15:05:09.566294 I | rook-ceph-mon0: 2017-07-11 15:05:09.566236 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785509566226, "cf_name": "default", "job": 90, "event": "table_file_creation", "file_number": 142, "file_size": 4305368, "table_properties": {"data_size": 4289285, "index_size": 15265, "filter_size": 0, "raw_key_size": 15589, "raw_average_key_size": 18, "raw_value_size": 4267177, "raw_average_value_size": 5134, "num_data_blocks": 481, "num_entries": 831, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 15:05:09.566430 I | rook-ceph-mon0: 2017-07-11 15:05:09.566414 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 90] Level-0 flush table #142: 4305368 bytes OK
- 2017-07-11 15:05:09.596988 I | rook-ceph-mon0: 2017-07-11 15:05:09.596950 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.580900) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #142 started
- 2017-07-11 15:05:09.597071 I | rook-ceph-mon0: 2017-07-11 15:05:09.597055 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.596906) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #142: memtable #1 done
- 2017-07-11 15:05:09.597106 I | rook-ceph-mon0: 2017-07-11 15:05:09.597092 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.596922) EVENT_LOG_v1 {"time_micros": 1499785509596917, "job": 90, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:05:09.597160 I | rook-ceph-mon0: 2017-07-11 15:05:09.597146 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.596937) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:05:09.597176 I | rook-ceph-mon0:
- 2017-07-11 15:05:09.597223 I | rook-ceph-mon0: 2017-07-11 15:05:09.597209 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 90] Try to delete WAL files size 4314171, prev total WAL file size 4314171, number of live WAL files 2.
- 2017-07-11 15:05:09.597238 I | rook-ceph-mon0:
- 2017-07-11 15:05:09.606002 I | rook-ceph-mon0: 2017-07-11 15:05:09.598044 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:05:09.606083 I | rook-ceph-mon0: 2017-07-11 15:05:09.598082 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.598077) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 15:05:09.606112 I | rook-ceph-mon0:
- 2017-07-11 15:05:09.606140 I | rook-ceph-mon0: 2017-07-11 15:05:09.598088 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 91] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:05:09.606154 I | rook-ceph-mon0: 2017-07-11 15:05:09.598092 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 90 Base level 0, inputs: [142(4204KB)], [140(12MB)]
- 2017-07-11 15:05:09.606178 I | rook-ceph-mon0:
- 2017-07-11 15:05:09.606189 I | rook-ceph-mon0: 2017-07-11 15:05:09.598102 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785509598095, "job": 91, "event": "compaction_started", "files_L0": [142], "files_L1": [140], "score": -1, "input_data_size": 17787302}
- 2017-07-11 15:05:09.742596 I | rook-ceph-mon0: 2017-07-11 15:05:09.742543 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 91] Generated table #143: 2298 keys, 15248390 bytes
- 2017-07-11 15:05:09.742718 I | rook-ceph-mon0: 2017-07-11 15:05:09.742700 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785509742691, "cf_name": "default", "job": 91, "event": "table_file_creation", "file_number": 143, "file_size": 15248390, "table_properties": {"data_size": 15195691, "index_size": 51880, "filter_size": 0, "raw_key_size": 44452, "raw_average_key_size": 19, "raw_value_size": 15127242, "raw_average_value_size": 6582, "num_data_blocks": 1580, "num_entries": 2298, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:05:09.780421 I | rook-ceph-mon0: 2017-07-11 15:05:09.780367 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 91] Compacted 1@0 + 1@1 files to L1 => 15248390 bytes
- 2017-07-11 15:05:09.802496 I | rook-ceph-mon0: 2017-07-11 15:05:09.802455 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.802346) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 97.6 rd, 83.7 wr, level 1, files in(1, 1) out(1) MB in(4.1, 12.9) out(14.5), read-write-amplify(7.7) write-amplify(3.5) OK, records in: 2807, records dropped: 509
- 2017-07-11 15:05:09.802559 I | rook-ceph-mon0:
- 2017-07-11 15:05:09.802610 I | rook-ceph-mon0: 2017-07-11 15:05:09.802579 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.802368) EVENT_LOG_v1 {"time_micros": 1499785509802359, "job": 91, "event": "compaction_finished", "compaction_time_micros": 182241, "output_level": 1, "num_output_files": 1, "total_output_size": 15248390, "num_input_records": 2807, "num_output_records": 2298, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:05:09.803353 I | rook-ceph-mon0: 2017-07-11 15:05:09.803338 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785509803335, "job": 91, "event": "table_file_deletion", "file_number": 142}
- 2017-07-11 15:05:09.805069 I | rook-ceph-mon0: 2017-07-11 15:05:09.805053 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785509805051, "job": 91, "event": "table_file_deletion", "file_number": 140}
- 2017-07-11 15:05:16.285388 I | rook-ceph-mon0: 2017-07-11 15:05:16.285351 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:16.285573 I | rook-ceph-mon0: 2017-07-11 15:05:16.285483 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1087303328' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:27.402922 I | rook-ceph-mon0: 2017-07-11 15:05:27.402880 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:27.403051 I | rook-ceph-mon0: 2017-07-11 15:05:27.403037 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1805130435' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:29.935952 I | rook-ceph-mon0: 2017-07-11 15:05:29.935915 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:29.936031 I | rook-ceph-mon0: 2017-07-11 15:05:29.936016 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/636451094' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:38.395765 I | rook-ceph-mon0: 2017-07-11 15:05:38.395722 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:38.396014 I | rook-ceph-mon0: 2017-07-11 15:05:38.395962 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2222173255' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:39.898722 I | rook-ceph-mon0: 2017-07-11 15:05:39.898618 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #144. Immutable memtables: 0.
- 2017-07-11 15:05:39.898817 I | rook-ceph-mon0:
- 2017-07-11 15:05:39.898854 I | rook-ceph-mon0: 2017-07-11 15:05:39.898669 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 92] Syncing log #141
- 2017-07-11 15:05:39.916118 I | rook-ceph-mon0: 2017-07-11 15:05:39.915430 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:05:39.898664) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:05:39.916170 I | rook-ceph-mon0: 2017-07-11 15:05:39.915440 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 92] Flushing memtable with next log file: 144
- 2017-07-11 15:05:39.916187 I | rook-ceph-mon0:
- 2017-07-11 15:05:39.916198 I | rook-ceph-mon0: 2017-07-11 15:05:39.915449 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785539915445, "job": 92, "event": "flush_started", "num_memtables": 1, "num_entries": 402, "num_deletes": 251, "memory_usage": 384584}
- 2017-07-11 15:05:39.916208 I | rook-ceph-mon0: 2017-07-11 15:05:39.915453 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 92] Level-0 flush table #145: started
- 2017-07-11 15:05:39.965375 I | rook-ceph-mon0: 2017-07-11 15:05:39.965317 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785539965306, "cf_name": "default", "job": 92, "event": "table_file_creation", "file_number": 145, "file_size": 315036, "table_properties": {"data_size": 313089, "index_size": 1133, "filter_size": 0, "raw_key_size": 6014, "raw_average_key_size": 19, "raw_value_size": 308243, "raw_average_value_size": 1024, "num_data_blocks": 37, "num_entries": 301, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 15:05:39.965393 I | rook-ceph-mon0: 2017-07-11 15:05:39.965330 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 92] Level-0 flush table #145: 315036 bytes OK
- 2017-07-11 15:05:40.028746 I | rook-ceph-mon0: 2017-07-11 15:05:40.028700 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.003616) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #145 started
- 2017-07-11 15:05:40.028792 I | rook-ceph-mon0: 2017-07-11 15:05:40.028777 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.028651) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #145: memtable #1 done
- 2017-07-11 15:05:40.028811 I | rook-ceph-mon0: 2017-07-11 15:05:40.028799 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.028671) EVENT_LOG_v1 {"time_micros": 1499785540028665, "job": 92, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:05:40.028828 I | rook-ceph-mon0: 2017-07-11 15:05:40.028817 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.028687) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:05:40.028832 I | rook-ceph-mon0:
- 2017-07-11 15:05:40.028868 I | rook-ceph-mon0: 2017-07-11 15:05:40.028855 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 92] Try to delete WAL files size 374482, prev total WAL file size 374482, number of live WAL files 2.
- 2017-07-11 15:05:40.028874 I | rook-ceph-mon0:
- 2017-07-11 15:05:40.030541 I | rook-ceph-mon0: 2017-07-11 15:05:40.029064 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:05:40.030549 I | rook-ceph-mon0: 2017-07-11 15:05:40.029103 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.029097) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 15:05:40.030552 I | rook-ceph-mon0:
- 2017-07-11 15:05:40.030555 I | rook-ceph-mon0: 2017-07-11 15:05:40.029107 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 93] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:05:40.030559 I | rook-ceph-mon0: 2017-07-11 15:05:40.029112 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 92 Base level 0, inputs: [145(307KB)], [143(14MB)]
- 2017-07-11 15:05:40.030562 I | rook-ceph-mon0:
- 2017-07-11 15:05:40.030564 I | rook-ceph-mon0: 2017-07-11 15:05:40.029123 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785540029114, "job": 93, "event": "compaction_started", "files_L0": [145], "files_L1": [143], "score": -1, "input_data_size": 15563426}
- 2017-07-11 15:05:40.163965 I | rook-ceph-mon0: 2017-07-11 15:05:40.163914 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 93] Generated table #146: 2099 keys, 13966789 bytes
- 2017-07-11 15:05:40.164164 I | rook-ceph-mon0: 2017-07-11 15:05:40.164077 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785540164067, "cf_name": "default", "job": 93, "event": "table_file_creation", "file_number": 146, "file_size": 13966789, "table_properties": {"data_size": 13920896, "index_size": 45074, "filter_size": 0, "raw_key_size": 40419, "raw_average_key_size": 19, "raw_value_size": 13860009, "raw_average_value_size": 6603, "num_data_blocks": 1374, "num_entries": 2099, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:05:40.184173 I | rook-ceph-mon0: 2017-07-11 15:05:40.184141 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 93] Compacted 1@0 + 1@1 files to L1 => 13966789 bytes
- 2017-07-11 15:05:40.211968 I | rook-ceph-mon0: 2017-07-11 15:05:40.211931 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.211835) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 100.4 rd, 90.1 wr, level 1, files in(1, 1) out(1) MB in(0.3, 14.5) out(13.3), read-write-amplify(93.7) write-amplify(44.3) OK, records in: 2599, records dropped: 500
- 2017-07-11 15:05:40.212035 I | rook-ceph-mon0:
- 2017-07-11 15:05:40.212070 I | rook-ceph-mon0: 2017-07-11 15:05:40.212054 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.211858) EVENT_LOG_v1 {"time_micros": 1499785540211849, "job": 93, "event": "compaction_finished", "compaction_time_micros": 155003, "output_level": 1, "num_output_files": 1, "total_output_size": 13966789, "num_input_records": 2599, "num_output_records": 2099, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:05:40.212343 I | rook-ceph-mon0: 2017-07-11 15:05:40.212329 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785540212326, "job": 93, "event": "table_file_deletion", "file_number": 145}
- 2017-07-11 15:05:40.216636 I | rook-ceph-mon0: 2017-07-11 15:05:40.216610 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785540216607, "job": 93, "event": "table_file_deletion", "file_number": 143}
- 2017-07-11 15:05:40.216805 I | rook-ceph-mon0: 2017-07-11 15:05:40.216729 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:05:41.189931 I | rook-ceph-mon0: 2017-07-11 15:05:41.189880 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:41.190148 I | rook-ceph-mon0: 2017-07-11 15:05:41.190047 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1386101670' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:45.630056 I | rook-ceph-mon0: 2017-07-11 15:05:45.629892 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94361 MB
- 2017-07-11 15:05:49.469102 I | rook-ceph-mon0: 2017-07-11 15:05:49.469064 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:49.469304 I | rook-ceph-mon0: 2017-07-11 15:05:49.469211 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/524213825' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:52.285319 I | rook-ceph-mon0: 2017-07-11 15:05:52.285245 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:52.285407 I | rook-ceph-mon0: 2017-07-11 15:05:52.285393 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3711725668' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:11.040568 I | rook-ceph-mon0: 2017-07-11 15:06:11.040522 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:11.040788 I | rook-ceph-mon0: 2017-07-11 15:06:11.040754 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3168530301' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:22.667859 I | rook-ceph-mon0: 2017-07-11 15:06:22.667819 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:22.668067 I | rook-ceph-mon0: 2017-07-11 15:06:22.667967 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1108582697' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:33.875692 I | rook-ceph-mon0: 2017-07-11 15:06:33.875654 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:33.875921 I | rook-ceph-mon0: 2017-07-11 15:06:33.875833 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3985438793' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:44.423848 I | rook-ceph-mon0: 2017-07-11 15:06:44.423810 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:44.424060 I | rook-ceph-mon0: 2017-07-11 15:06:44.423960 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/750159835' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:45.035520 I | rook-ceph-mon0: 2017-07-11 15:06:45.035480 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:45.035732 I | rook-ceph-mon0: 2017-07-11 15:06:45.035629 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3509756361' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:45.630323 I | rook-ceph-mon0: 2017-07-11 15:06:45.630170 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94361 MB
- 2017-07-11 15:06:47.668898 I | rook-ceph-mon0: 2017-07-11 15:06:47.668858 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:47.669144 I | rook-ceph-mon0: 2017-07-11 15:06:47.669104 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3189740058' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:55.615616 I | rook-ceph-mon0: 2017-07-11 15:06:55.615577 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:55.615810 I | rook-ceph-mon0: 2017-07-11 15:06:55.615717 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/346757228' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:58.753919 I | rook-ceph-mon0: 2017-07-11 15:06:58.753883 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:58.754153 I | rook-ceph-mon0: 2017-07-11 15:06:58.754022 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3338007624' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:07.486366 I | rook-ceph-mon0: 2017-07-11 15:07:07.486326 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:07.486584 I | rook-ceph-mon0: 2017-07-11 15:07:07.486553 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/579842785' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:09.852423 I | rook-ceph-mon0: 2017-07-11 15:07:09.852381 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:09.852651 I | rook-ceph-mon0: 2017-07-11 15:07:09.852620 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2161686517' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:17.608992 I | rook-ceph-mon0: 2017-07-11 15:07:17.608953 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:17.609184 I | rook-ceph-mon0: 2017-07-11 15:07:17.609097 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/903740732' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:18.478174 I | rook-ceph-mon0: 2017-07-11 15:07:18.478135 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:18.478424 I | rook-ceph-mon0: 2017-07-11 15:07:18.478406 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1202067522' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:19.512645 I | rook-ceph-mon0: 2017-07-11 15:07:19.510408 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd lspools", "format": "json"} v 0) v1
- 2017-07-11 15:07:19.519707 I | rook-ceph-mon0: 2017-07-11 15:07:19.519662 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1433491448' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json"}]: dispatch
- 2017-07-11 15:07:19.523081 I | rook-ceph-mon0: 2017-07-11 15:07:19.523062 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "osd lspools", "format": "json"} v 0) v1
- 2017-07-11 15:07:19.523160 I | rook-ceph-mon0: 2017-07-11 15:07:19.523145 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2310981270' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json"}]: dispatch
- 2017-07-11 15:07:20.838520 I | rook-ceph-mon0: 2017-07-11 15:07:20.838479 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"var": "all", "prefix": "osd pool get", "pool": "rbd", "format": "json"} v 0) v1
- 2017-07-11 15:07:20.838784 I | rook-ceph-mon0: 2017-07-11 15:07:20.838759 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1471205679' entity='client.admin' cmd=[{"var": "all", "prefix": "osd pool get", "pool": "rbd", "format": "json"}]: dispatch
- 2017-07-11 15:07:20.871077 I | rook-ceph-mon0: 2017-07-11 15:07:20.871042 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"var": "all", "prefix": "osd pool get", "pool": "rbd", "format": "json"} v 0) v1
- 2017-07-11 15:07:20.871281 I | rook-ceph-mon0: 2017-07-11 15:07:20.871204 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3920329796' entity='client.admin' cmd=[{"var": "all", "prefix": "osd pool get", "pool": "rbd", "format": "json"}]: dispatch
- 2017-07-11 15:07:20.914586 I | rook-ceph-mon0: 2017-07-11 15:07:20.914544 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:20.914711 I | rook-ceph-mon0: 2017-07-11 15:07:20.914695 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/984436994' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:22.510805 I | rook-ceph-mon0: 2017-07-11 15:07:22.510764 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"} v 0) v1
- 2017-07-11 15:07:22.511040 I | rook-ceph-mon0: 2017-07-11 15:07:22.510999 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.13433 -' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:23.382320 I | rook-ceph-mon0: 2017-07-11 15:07:23.374591 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"} v 0) v1
- 2017-07-11 15:07:23.384146 I | rook-ceph-mon0: 2017-07-11 15:07:23.374620 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.13430 -' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:23.651411 I | rook-ceph-mon0: 2017-07-11 15:07:23.641507 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"} v 0) v1
- 2017-07-11 15:07:23.661169 I | rook-ceph-mon0: 2017-07-11 15:07:23.641538 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.13436 -' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.190118 I | rook-ceph-mon0: 2017-07-11 15:07:22.116874 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 2218 : audit [INF] from='client.? 10.233.124.5:0/6333933' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.190226 I | rook-ceph-mon0: 2017-07-11 15:07:22.118898 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 2219 : audit [INF] from='client.? 10.233.124.0:0/842394772' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.190320 I | rook-ceph-mon0: 2017-07-11 15:07:22.144880 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 2220 : audit [INF] from='client.? 10.233.124.0:0/2650355890' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.190349 I | rook-ceph-mon0: 2017-07-11 15:07:22.511073 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2225 : audit [INF] from='client.13433 -' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.190364 I | rook-ceph-mon0: 2017-07-11 15:07:23.374621 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2226 : audit [INF] from='client.13430 -' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.190391 I | rook-ceph-mon0: 2017-07-11 15:07:23.641539 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2227 : audit [INF] from='client.13436 -' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.442779 I | rook-ceph-mon0: 2017-07-11 15:07:24.442697 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.13433 -' entity='client.admin' cmd='[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]': finished
- 2017-07-11 15:07:24.443216 I | rook-ceph-mon0: 2017-07-11 15:07:24.443084 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.13430 -' entity='client.admin' cmd='[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]': finished
- 2017-07-11 15:07:24.443487 I | rook-ceph-mon0: 2017-07-11 15:07:24.443403 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.13436 -' entity='client.admin' cmd='[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]': finished
- 2017-07-11 15:07:24.443776 I | rook-ceph-mon0: 2017-07-11 15:07:24.443755 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e138: 6 total, 1 up, 4 in
- 2017-07-11 15:07:25.672896 I | rook-ceph-mon0: 2017-07-11 15:07:24.442863 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2228 : audit [INF] from='client.13433 -' entity='client.admin' cmd='[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]': finished
- 2017-07-11 15:07:25.673366 I | rook-ceph-mon0: 2017-07-11 15:07:24.443270 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2229 : audit [INF] from='client.13430 -' entity='client.admin' cmd='[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]': finished
- 2017-07-11 15:07:25.673411 I | rook-ceph-mon0: 2017-07-11 15:07:24.443542 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2230 : audit [INF] from='client.13436 -' entity='client.admin' cmd='[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]': finished
- 2017-07-11 15:07:25.673436 I | rook-ceph-mon0: 2017-07-11 15:07:24.443817 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2231 : cluster [INF] osdmap e138: 6 total, 1 up, 4 in
- 2017-07-11 15:07:26.031256 I | rook-ceph-mon0: 2017-07-11 15:07:26.030869 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"} v 0) v1
- 2017-07-11 15:07:26.031474 I | rook-ceph-mon0: 2017-07-11 15:07:26.031443 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.0:0/210354122' entity='client.admin' cmd=[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]: dispatch
- 2017-07-11 15:07:26.082863 I | rook-ceph-mon0: 2017-07-11 15:07:26.082823 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"} v 0) v1
- 2017-07-11 15:07:26.083137 I | rook-ceph-mon0: 2017-07-11 15:07:26.082993 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.0:0/2191274531' entity='client.admin' cmd=[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]: dispatch
- 2017-07-11 15:07:26.116992 I | rook-ceph-mon0: 2017-07-11 15:07:26.116949 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"} v 0) v1
- 2017-07-11 15:07:26.117195 I | rook-ceph-mon0: 2017-07-11 15:07:26.117113 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.5:0/3838214036' entity='client.admin' cmd=[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]: dispatch
- 2017-07-11 15:07:27.134116 I | rook-ceph-mon0: 2017-07-11 15:07:26.031513 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2232 : audit [INF] from='client.? 10.233.124.0:0/210354122' entity='client.admin' cmd=[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]: dispatch
- 2017-07-11 15:07:27.134286 I | rook-ceph-mon0: 2017-07-11 15:07:26.083167 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2233 : audit [INF] from='client.? 10.233.124.0:0/2191274531' entity='client.admin' cmd=[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]: dispatch
- 2017-07-11 15:07:27.134347 I | rook-ceph-mon0: 2017-07-11 15:07:26.117235 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2234 : audit [INF] from='client.? 10.233.124.5:0/3838214036' entity='client.admin' cmd=[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]: dispatch
- 2017-07-11 15:07:27.318828 I | rook-ceph-mon0: 2017-07-11 15:07:27.316832 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.0:0/210354122' entity='client.admin' cmd='[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]': finished
- 2017-07-11 15:07:27.318927 I | rook-ceph-mon0: 2017-07-11 15:07:27.316871 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.0:0/2191274531' entity='client.admin' cmd='[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]': finished
- 2017-07-11 15:07:27.318943 I | rook-ceph-mon0: 2017-07-11 15:07:27.316898 7f7c4754c700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.5:0/3838214036' entity='client.admin' cmd='[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]': finished
- 2017-07-11 15:07:27.318954 I | rook-ceph-mon0: 2017-07-11 15:07:27.316919 7f7c4754c700 0 log_channel(cluster) log [INF] : osdmap e139: 6 total, 1 up, 4 in
- 2017-07-11 15:07:28.463112 I | rook-ceph-mon0: 2017-07-11 15:07:27.316834 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2235 : audit [INF] from='client.? 10.233.124.0:0/210354122' entity='client.admin' cmd='[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]': finished
- 2017-07-11 15:07:28.463205 I | rook-ceph-mon0: 2017-07-11 15:07:27.316872 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2236 : audit [INF] from='client.? 10.233.124.0:0/2191274531' entity='client.admin' cmd='[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]': finished
- 2017-07-11 15:07:28.463243 I | rook-ceph-mon0: 2017-07-11 15:07:27.316899 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2237 : audit [INF] from='client.? 10.233.124.5:0/3838214036' entity='client.admin' cmd='[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]': finished
- 2017-07-11 15:07:28.463259 I | rook-ceph-mon0: 2017-07-11 15:07:27.316919 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2238 : cluster [INF] osdmap e139: 6 total, 1 up, 4 in
- 2017-07-11 15:07:31.892862 I | rook-ceph-mon0: 2017-07-11 15:07:31.892823 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:31.893075 I | rook-ceph-mon0: 2017-07-11 15:07:31.892974 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4130156041' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:39.855234 I | rook-ceph-mon0: 2017-07-11 15:07:39.855183 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:39.855467 I | rook-ceph-mon0: 2017-07-11 15:07:39.855427 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1113226098' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:45.640655 I | rook-ceph-mon0: 2017-07-11 15:07:45.630657 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94361 MB
- 2017-07-11 15:07:50.819883 I | rook-ceph-mon0: 2017-07-11 15:07:50.819845 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:50.819952 I | rook-ceph-mon0: 2017-07-11 15:07:50.819937 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3289846374' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:53.979722 I | rook-ceph-mon0: 2017-07-11 15:07:53.979682 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:53.979919 I | rook-ceph-mon0: 2017-07-11 15:07:53.979832 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/801032359' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:08:05.359764 I | rook-ceph-mon0: 2017-07-11 15:08:05.359595 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (537 > max 300); Monitor clock skew detected
- 2017-07-11 15:08:06.321038 I | rook-ceph-mon0: 2017-07-11 15:08:05.359607 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2243 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (537 > max 300); Monitor clock skew detected
- 2017-07-11 15:08:12.332246 I | rook-ceph-mon0: 2017-07-11 15:08:12.332205 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:08:12.332467 I | rook-ceph-mon0: 2017-07-11 15:08:12.332432 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/261216319' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:08:45.631061 I | rook-ceph-mon0: 2017-07-11 15:08:45.630926 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94361 MB
- 2017-07-11 15:08:54.737995 I | rook-ceph-mon0: 2017-07-11 15:08:54.737955 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:08:54.738216 I | rook-ceph-mon0: 2017-07-11 15:08:54.738106 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3086473650' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:08:58.442229 I | rook-ceph-mon0: 2017-07-11 15:08:58.442189 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:08:58.442444 I | rook-ceph-mon0: 2017-07-11 15:08:58.442414 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2285206030' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:05.345539 I | rook-ceph-mon0: 2017-07-11 15:09:05.345500 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:05.345755 I | rook-ceph-mon0: 2017-07-11 15:09:05.345724 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1759645550' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:35.640468 I | rook-ceph-mon0: 2017-07-11 15:09:35.640391 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0597843s > max 0.05s
- 2017-07-11 15:09:35.646133 I | rook-ceph-mon0: 2017-07-11 15:09:35.645998 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.227679s > max 0.05s
- 2017-07-11 15:09:35.879445 I | rook-ceph-mon0: 2017-07-11 15:09:35.640393 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2248 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0597843s > max 0.05s
- 2017-07-11 15:09:35.886157 I | rook-ceph-mon0: 2017-07-11 15:09:35.646000 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2249 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.227679s > max 0.05s
- 2017-07-11 15:09:40.885859 I | rook-ceph-mon0: 2017-07-11 15:09:40.885805 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:40.886074 I | rook-ceph-mon0: 2017-07-11 15:09:40.886042 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2040980496' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:45.631422 I | rook-ceph-mon0: 2017-07-11 15:09:45.631200 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94361 MB
- 2017-07-11 15:09:58.463583 I | rook-ceph-mon0: 2017-07-11 15:09:58.463536 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:58.463844 I | rook-ceph-mon0: 2017-07-11 15:09:58.463813 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2517813107' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:59.115898 I | rook-ceph-mon0: 2017-07-11 15:09:59.115861 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:59.116164 I | rook-ceph-mon0: 2017-07-11 15:09:59.116099 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3566638095' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:09.066769 I | rook-ceph-mon0: 2017-07-11 15:10:09.066731 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:09.066983 I | rook-ceph-mon0: 2017-07-11 15:10:09.066875 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2345420611' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:23.281981 I | rook-ceph-mon0: 2017-07-11 15:10:23.281942 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:23.282212 I | rook-ceph-mon0: 2017-07-11 15:10:23.282104 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/900209784' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:35.146417 I | rook-ceph-mon0: 2017-07-11 15:10:35.146319 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #147. Immutable memtables: 0.
- 2017-07-11 15:10:35.146502 I | rook-ceph-mon0:
- 2017-07-11 15:10:35.146521 I | rook-ceph-mon0: 2017-07-11 15:10:35.146355 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 94] Syncing log #144
- 2017-07-11 15:10:35.163591 I | rook-ceph-mon0: 2017-07-11 15:10:35.162215 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.146348) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:10:35.163668 I | rook-ceph-mon0: 2017-07-11 15:10:35.162234 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 94] Flushing memtable with next log file: 147
- 2017-07-11 15:10:35.163685 I | rook-ceph-mon0:
- 2017-07-11 15:10:35.163715 I | rook-ceph-mon0: 2017-07-11 15:10:35.162248 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835162243, "job": 94, "event": "flush_started", "num_memtables": 1, "num_entries": 1788, "num_deletes": 251, "memory_usage": 4084696}
- 2017-07-11 15:10:35.163730 I | rook-ceph-mon0: 2017-07-11 15:10:35.162251 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 94] Level-0 flush table #148: started
- 2017-07-11 15:10:35.336658 I | rook-ceph-mon0: 2017-07-11 15:10:35.336607 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835336596, "cf_name": "default", "job": 94, "event": "table_file_creation", "file_number": 148, "file_size": 4037792, "table_properties": {"data_size": 4022270, "index_size": 14704, "filter_size": 0, "raw_key_size": 15036, "raw_average_key_size": 18, "raw_value_size": 4000925, "raw_average_value_size": 5001, "num_data_blocks": 465, "num_entries": 800, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 15:10:35.336772 I | rook-ceph-mon0: 2017-07-11 15:10:35.336754 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 94] Level-0 flush table #148: 4037792 bytes OK
- 2017-07-11 15:10:35.415057 I | rook-ceph-mon0: 2017-07-11 15:10:35.415009 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.366179) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #148 started
- 2017-07-11 15:10:35.415162 I | rook-ceph-mon0: 2017-07-11 15:10:35.415145 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.414953) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #148: memtable #1 done
- 2017-07-11 15:10:35.415308 I | rook-ceph-mon0: 2017-07-11 15:10:35.415240 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.414977) EVENT_LOG_v1 {"time_micros": 1499785835414971, "job": 94, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:10:35.415343 I | rook-ceph-mon0: 2017-07-11 15:10:35.415329 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.414993) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:10:35.415373 I | rook-ceph-mon0:
- 2017-07-11 15:10:35.415407 I | rook-ceph-mon0: 2017-07-11 15:10:35.415394 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 94] Try to delete WAL files size 4049162, prev total WAL file size 4049162, number of live WAL files 2.
- 2017-07-11 15:10:35.415423 I | rook-ceph-mon0:
- 2017-07-11 15:10:35.419089 I | rook-ceph-mon0: 2017-07-11 15:10:35.416339 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:10:35.419211 I | rook-ceph-mon0: 2017-07-11 15:10:35.416546 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 15:10:35.419262 I | rook-ceph-mon0: 2017-07-11 15:10:35.416550 7f7c45d49700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 15:10:35.419293 I | rook-ceph-mon0: ** DB Stats **
- 2017-07-11 15:10:35.419308 I | rook-ceph-mon0: Uptime(secs): 6410.2 total, 800.7 interval
- 2017-07-11 15:10:35.419321 I | rook-ceph-mon0: Cumulative writes: 12K writes, 54K keys, 12K commit groups, 1.0 writes per commit group, ingest: 0.11 GB, 0.02 MB/s
- 2017-07-11 15:10:35.419332 I | rook-ceph-mon0: Cumulative WAL: 12K writes, 12K syncs, 1.00 writes per sync, written: 0.11 GB, 0.02 MB/s
- 2017-07-11 15:10:35.419343 I | rook-ceph-mon0: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 15:10:35.419368 I | rook-ceph-mon0: Interval writes: 1496 writes, 6685 keys, 1496 commit groups, 1.0 writes per commit group, ingest: 13.31 MB, 0.02 MB/s
- 2017-07-11 15:10:35.419383 I | rook-ceph-mon0: Interval WAL: 1496 writes, 1496 syncs, 1.00 writes per sync, written: 0.01 MB, 0.02 MB/s
- 2017-07-11 15:10:35.419395 I | rook-ceph-mon0: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 15:10:35.419406 I | rook-ceph-mon0:
- 2017-07-11 15:10:35.419417 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 15:10:35.419429 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 15:10:35.419455 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 15:10:35.419467 I | rook-ceph-mon0: L0 1/1 3.85 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 19.7 5 49 0.107 0 0
- 2017-07-11 15:10:35.419480 I | rook-ceph-mon0: L1 1/1 13.32 MB 0.0 0.7 0.1 0.6 0.6 0.0 0.0 5.9 54.1 47.2 12 44 0.284 112K 23K
- 2017-07-11 15:10:35.419508 I | rook-ceph-mon0: Sum 2/2 17.17 MB 0.0 0.7 0.1 0.6 0.7 0.1 0.0 6.7 38.1 39.1 18 93 0.191 112K 23K
- 2017-07-11 15:10:35.419547 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 6.3 48.2 49.6 2 10 0.167 13K 3046
- 2017-07-11 15:10:35.419575 I | rook-ceph-mon0: Uptime(secs): 6410.2 total, 6410.2 interval
- 2017-07-11 15:10:35.419600 I | rook-ceph-mon0: Flush(GB): cumulative 0.101, interval 0.013
- 2017-07-11 15:10:35.419612 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 15:10:35.419624 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 15:10:35.419634 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 15:10:35.419646 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 15:10:35.419657 I | rook-ceph-mon0: Cumulative compaction: 0.68 GB write, 0.11 MB/s write, 0.66 GB read, 0.11 MB/s read, 17.7 seconds
- 2017-07-11 15:10:35.419681 I | rook-ceph-mon0: Interval compaction: 0.08 GB write, 0.01 MB/s write, 0.08 GB read, 0.01 MB/s read, 1.7 seconds
- 2017-07-11 15:10:35.419694 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 15:10:35.419705 I | rook-ceph-mon0:
- 2017-07-11 15:10:35.419717 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 15:10:35.419728 I | rook-ceph-mon0:
- 2017-07-11 15:10:35.419739 I | rook-ceph-mon0: ** Compaction Stats [default] **
- 2017-07-11 15:10:35.419767 I | rook-ceph-mon0: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 15:10:35.419781 I | rook-ceph-mon0: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 15:10:35.419792 I | rook-ceph-mon0: L0 1/1 3.85 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 19.7 5 49 0.107 0 0
- 2017-07-11 15:10:35.419804 I | rook-ceph-mon0: L1 1/1 13.32 MB 0.0 0.7 0.1 0.6 0.6 0.0 0.0 5.9 54.1 47.2 12 44 0.284 112K 23K
- 2017-07-11 15:10:35.419815 I | rook-ceph-mon0: Sum 2/2 17.17 MB 0.0 0.7 0.1 0.6 0.7 0.1 0.0 6.7 38.1 39.1 18 93 0.191 112K 23K
- 2017-07-11 15:10:35.419840 I | rook-ceph-mon0: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 15:10:35.419852 I | rook-ceph-mon0: Uptime(secs): 6410.2 total, 6410.2 interval
- 2017-07-11 15:10:35.419863 I | rook-ceph-mon0: Flush(GB): cumulative 0.101, interval 0.000
- 2017-07-11 15:10:35.419874 I | rook-ceph-mon0: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 15:10:35.419885 I | rook-ceph-mon0: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 15:10:35.419907 I | rook-ceph-mon0: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 15:10:35.419919 I | rook-ceph-mon0: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 15:10:35.419930 I | rook-ceph-mon0: Cumulative compaction: 0.68 GB write, 0.11 MB/s write, 0.66 GB read, 0.11 MB/s read, 17.7 seconds
- 2017-07-11 15:10:35.419941 I | rook-ceph-mon0: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 15:10:35.419953 I | rook-ceph-mon0: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 15:10:35.419964 I | rook-ceph-mon0:
- 2017-07-11 15:10:35.419995 I | rook-ceph-mon0: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 15:10:35.420007 I | rook-ceph-mon0:
- 2017-07-11 15:10:35.420018 I | rook-ceph-mon0: 2017-07-11 15:10:35.416579 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.416560) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 15:10:35.420028 I | rook-ceph-mon0:
- 2017-07-11 15:10:35.420039 I | rook-ceph-mon0: 2017-07-11 15:10:35.416583 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 95] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:10:35.420050 I | rook-ceph-mon0: 2017-07-11 15:10:35.416588 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 94 Base level 0, inputs: [148(3943KB)], [146(13MB)]
- 2017-07-11 15:10:35.420071 I | rook-ceph-mon0:
- 2017-07-11 15:10:35.420084 I | rook-ceph-mon0: 2017-07-11 15:10:35.416599 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835416591, "job": 95, "event": "compaction_started", "files_L0": [148], "files_L1": [146], "score": -1, "input_data_size": 18004581}
- 2017-07-11 15:10:35.580911 I | rook-ceph-mon0: 2017-07-11 15:10:35.580863 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 95] Generated table #149: 2387 keys, 15505403 bytes
- 2017-07-11 15:10:35.581150 I | rook-ceph-mon0: 2017-07-11 15:10:35.581015 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835581005, "cf_name": "default", "job": 95, "event": "table_file_creation", "file_number": 149, "file_size": 15505403, "table_properties": {"data_size": 15452327, "index_size": 52257, "filter_size": 0, "raw_key_size": 46147, "raw_average_key_size": 19, "raw_value_size": 15382379, "raw_average_value_size": 6444, "num_data_blocks": 1587, "num_entries": 2387, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:10:35.622246 I | rook-ceph-mon0: 2017-07-11 15:10:35.622193 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 95] Compacted 1@0 + 1@1 files to L1 => 15505403 bytes
- 2017-07-11 15:10:35.651280 I | rook-ceph-mon0: 2017-07-11 15:10:35.651238 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.651126) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 87.6 rd, 75.4 wr, level 1, files in(1, 1) out(1) MB in(3.9, 13.3) out(14.8), read-write-amplify(8.3) write-amplify(3.8) OK, records in: 2899, records dropped: 512
- 2017-07-11 15:10:35.651348 I | rook-ceph-mon0:
- 2017-07-11 15:10:35.651405 I | rook-ceph-mon0: 2017-07-11 15:10:35.651367 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.651149) EVENT_LOG_v1 {"time_micros": 1499785835651140, "job": 95, "event": "compaction_finished", "compaction_time_micros": 205569, "output_level": 1, "num_output_files": 1, "total_output_size": 15505403, "num_input_records": 2899, "num_output_records": 2387, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:10:35.652118 I | rook-ceph-mon0: 2017-07-11 15:10:35.652103 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835652100, "job": 95, "event": "table_file_deletion", "file_number": 148}
- 2017-07-11 15:10:35.654032 I | rook-ceph-mon0: 2017-07-11 15:10:35.654014 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835654012, "job": 95, "event": "table_file_deletion", "file_number": 146}
- 2017-07-11 15:10:45.631614 I | rook-ceph-mon0: 2017-07-11 15:10:45.631452 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4827 MB, avail 94360 MB
- 2017-07-11 15:10:52.238482 I | rook-ceph-mon0: 2017-07-11 15:10:52.238442 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:52.238693 I | rook-ceph-mon0: 2017-07-11 15:10:52.238593 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3874485937' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:02.562811 I | rook-ceph-mon0: 2017-07-11 15:11:02.562774 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:02.563026 I | rook-ceph-mon0: 2017-07-11 15:11:02.562995 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2544883431' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:13.754630 I | rook-ceph-mon0: 2017-07-11 15:11:13.754593 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:13.754739 I | rook-ceph-mon0: 2017-07-11 15:11:13.754724 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1698463766' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:14.989055 I | rook-ceph-mon0: 2017-07-11 15:11:14.988856 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"} v 0) v1
- 2017-07-11 15:11:14.989142 I | rook-ceph-mon0: 2017-07-11 15:11:14.988876 7f7c4bd55700 0 log_channel(audit) log [INF] : from='client.7123 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 15:11:15.685117 I | rook-ceph-mon0: 2017-07-11 15:11:14.988878 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2258 : audit [INF] from='client.7123 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 15:11:15.685211 I | rook-ceph-mon0: 2017-07-11 15:11:15.246998 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 1269 : audit [INF] from='client.? 10.233.99.2:0/211370252' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 15:11:26.093369 I | rook-ceph-mon0: 2017-07-11 15:11:26.093331 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:26.093547 I | rook-ceph-mon0: 2017-07-11 15:11:26.093466 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1694391126' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:35.633769 I | rook-ceph-mon0: 2017-07-11 15:11:35.633729 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:35.633990 I | rook-ceph-mon0: 2017-07-11 15:11:35.633880 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1216485701' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:36.735394 I | rook-ceph-mon0: 2017-07-11 15:11:36.735359 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:36.735462 I | rook-ceph-mon0: 2017-07-11 15:11:36.735446 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2320840122' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:45.631889 I | rook-ceph-mon0: 2017-07-11 15:11:45.631694 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4827 MB, avail 94360 MB
- 2017-07-11 15:11:46.362827 I | rook-ceph-mon0: 2017-07-11 15:11:46.362790 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:46.363023 I | rook-ceph-mon0: 2017-07-11 15:11:46.362937 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2725765594' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:47.553817 I | rook-ceph-mon0: 2017-07-11 15:11:47.553777 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:47.553884 I | rook-ceph-mon0: 2017-07-11 15:11:47.553868 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1402954564' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:48.496122 I | rook-ceph-mon0: 2017-07-11 15:11:48.496082 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:48.496345 I | rook-ceph-mon0: 2017-07-11 15:11:48.496305 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3094981069' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:58.217433 I | rook-ceph-mon0: 2017-07-11 15:11:58.217386 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:58.217657 I | rook-ceph-mon0: 2017-07-11 15:11:58.217623 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/783399067' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:08.195748 I | rook-ceph-mon0: 2017-07-11 15:12:08.195709 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:08.195993 I | rook-ceph-mon0: 2017-07-11 15:12:08.195861 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3377361394' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:29.701775 I | rook-ceph-mon0: 2017-07-11 15:12:29.701737 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:29.701991 I | rook-ceph-mon0: 2017-07-11 15:12:29.701889 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/283350306' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:41.618338 I | rook-ceph-mon0: 2017-07-11 15:12:41.618301 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:41.618515 I | rook-ceph-mon0: 2017-07-11 15:12:41.618432 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4152332893' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:45.632306 I | rook-ceph-mon0: 2017-07-11 15:12:45.632139 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4827 MB, avail 94360 MB
- 2017-07-11 15:12:51.926750 I | rook-ceph-mon0: 2017-07-11 15:12:51.926712 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:51.926816 I | rook-ceph-mon0: 2017-07-11 15:12:51.926801 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3155048784' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:02.785841 I | rook-ceph-mon0: 2017-07-11 15:13:02.785804 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:02.786052 I | rook-ceph-mon0: 2017-07-11 15:13:02.785952 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3526085674' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:03.089604 I | rook-ceph-mon0: 2017-07-11 15:13:03.089566 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:03.089818 I | rook-ceph-mon0: 2017-07-11 15:13:03.089714 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3158754136' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:05.374976 I | rook-ceph-mon0: 2017-07-11 15:13:05.367463 7f7c4e55a700 0 log_channel(cluster) log [INF] : HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1796 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 100 pgs stuck inactive; 1696 pgs stuck stale; 100 pgs stuck unclean; too many PGs per OSD (537 > max 300); Monitor clock skew detected
- 2017-07-11 15:13:05.647685 I | rook-ceph-mon0: 2017-07-11 15:13:05.367470 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2272 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1796 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 100 pgs stuck inactive; 1696 pgs stuck stale; 100 pgs stuck unclean; too many PGs per OSD (537 > max 300); Monitor clock skew detected
- 2017-07-11 15:13:24.506765 I | rook-ceph-mon0: 2017-07-11 15:13:24.506727 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:24.507002 I | rook-ceph-mon0: 2017-07-11 15:13:24.506987 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3599566329' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:25.709917 I | rook-ceph-mon0: 2017-07-11 15:13:25.709877 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:25.710216 I | rook-ceph-mon0: 2017-07-11 15:13:25.710198 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1014175218' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:25.979524 I | rook-ceph-mon0: 2017-07-11 15:13:25.979488 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:25.979715 I | rook-ceph-mon0: 2017-07-11 15:13:25.979625 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2498543540' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:45.632543 I | rook-ceph-mon0: 2017-07-11 15:13:45.632381 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4827 MB, avail 94360 MB
- 2017-07-11 15:13:45.769454 I | rook-ceph-mon0: 2017-07-11 15:13:45.769418 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:45.769643 I | rook-ceph-mon0: 2017-07-11 15:13:45.769558 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/98604634' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:48.181296 I | rook-ceph-mon0: 2017-07-11 15:13:48.181258 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:48.181507 I | rook-ceph-mon0: 2017-07-11 15:13:48.181405 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/166630236' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:56.366931 I | rook-ceph-mon0: 2017-07-11 15:13:56.366887 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:56.367221 I | rook-ceph-mon0: 2017-07-11 15:13:56.367202 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3785913648' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:59.004806 I | rook-ceph-mon0: 2017-07-11 15:13:59.004765 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:59.005023 I | rook-ceph-mon0: 2017-07-11 15:13:59.004993 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/896324207' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:04.869860 I | rook-ceph-mon0: 2017-07-11 15:14:04.869760 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #150. Immutable memtables: 0.
- 2017-07-11 15:14:04.870104 I | rook-ceph-mon0:
- 2017-07-11 15:14:04.870135 I | rook-ceph-mon0: 2017-07-11 15:14:04.869802 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 96] Syncing log #147
- 2017-07-11 15:14:05.031212 I | rook-ceph-mon0: 2017-07-11 15:14:05.028065 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:14:04.869798) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:14:05.031320 I | rook-ceph-mon0: 2017-07-11 15:14:05.028085 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 96] Flushing memtable with next log file: 150
- 2017-07-11 15:14:05.031356 I | rook-ceph-mon0:
- 2017-07-11 15:14:05.031372 I | rook-ceph-mon0: 2017-07-11 15:14:05.028098 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045028093, "job": 96, "event": "flush_started", "num_memtables": 1, "num_entries": 1303, "num_deletes": 252, "memory_usage": 3665152}
- 2017-07-11 15:14:05.031399 I | rook-ceph-mon0: 2017-07-11 15:14:05.028100 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 96] Level-0 flush table #151: started
- 2017-07-11 15:14:05.121487 I | rook-ceph-mon0: 2017-07-11 15:14:05.121435 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045121425, "cf_name": "default", "job": 96, "event": "table_file_creation", "file_number": 151, "file_size": 2540781, "table_properties": {"data_size": 2533124, "index_size": 6839, "filter_size": 0, "raw_key_size": 10219, "raw_average_key_size": 19, "raw_value_size": 2521112, "raw_average_value_size": 4783, "num_data_blocks": 221, "num_entries": 527, "filter_policy_name": "", "kDeletedKeys": "252", "kMergeOperands": "0"}}
- 2017-07-11 15:14:05.121594 I | rook-ceph-mon0: 2017-07-11 15:14:05.121575 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 96] Level-0 flush table #151: 2540781 bytes OK
- 2017-07-11 15:14:05.152355 I | rook-ceph-mon0: 2017-07-11 15:14:05.152313 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.136950) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #151 started
- 2017-07-11 15:14:05.152448 I | rook-ceph-mon0: 2017-07-11 15:14:05.152432 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.152261) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #151: memtable #1 done
- 2017-07-11 15:14:05.152499 I | rook-ceph-mon0: 2017-07-11 15:14:05.152483 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.152281) EVENT_LOG_v1 {"time_micros": 1499786045152276, "job": 96, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:14:05.152530 I | rook-ceph-mon0: 2017-07-11 15:14:05.152516 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.152297) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:14:05.152559 I | rook-ceph-mon0:
- 2017-07-11 15:14:05.152594 I | rook-ceph-mon0: 2017-07-11 15:14:05.152581 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 96] Try to delete WAL files size 3638880, prev total WAL file size 3638880, number of live WAL files 2.
- 2017-07-11 15:14:05.152608 I | rook-ceph-mon0:
- 2017-07-11 15:14:05.155654 I | rook-ceph-mon0: 2017-07-11 15:14:05.153336 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:14:05.156300 I | rook-ceph-mon0: 2017-07-11 15:14:05.153375 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.153370) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 15:14:05.156345 I | rook-ceph-mon0:
- 2017-07-11 15:14:05.156360 I | rook-ceph-mon0: 2017-07-11 15:14:05.153380 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 97] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:14:05.156373 I | rook-ceph-mon0: 2017-07-11 15:14:05.153385 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 96 Base level 0, inputs: [151(2481KB)], [149(14MB)]
- 2017-07-11 15:14:05.156385 I | rook-ceph-mon0:
- 2017-07-11 15:14:05.156397 I | rook-ceph-mon0: 2017-07-11 15:14:05.153395 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045153387, "job": 97, "event": "compaction_started", "files_L0": [151], "files_L1": [149], "score": -1, "input_data_size": 18046184}
- 2017-07-11 15:14:05.373787 I | rook-ceph-mon0: 2017-07-11 15:14:05.373742 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 97] Generated table #152: 2502 keys, 16970691 bytes
- 2017-07-11 15:14:05.373972 I | rook-ceph-mon0: 2017-07-11 15:14:05.373885 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045373876, "cf_name": "default", "job": 97, "event": "table_file_creation", "file_number": 152, "file_size": 16970691, "table_properties": {"data_size": 16915637, "index_size": 54235, "filter_size": 0, "raw_key_size": 48079, "raw_average_key_size": 19, "raw_value_size": 16842805, "raw_average_value_size": 6731, "num_data_blocks": 1654, "num_entries": 2502, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:14:05.452628 I | rook-ceph-mon0: 2017-07-11 15:14:05.452574 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 97] Compacted 1@0 + 1@1 files to L1 => 16970691 bytes
- 2017-07-11 15:14:05.483832 I | rook-ceph-mon0: 2017-07-11 15:14:05.483781 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.483672) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 60.3 rd, 56.7 wr, level 1, files in(1, 1) out(1) MB in(2.4, 14.8) out(16.2), read-write-amplify(13.8) write-amplify(6.7) OK, records in: 2914, records dropped: 412
- 2017-07-11 15:14:05.483946 I | rook-ceph-mon0:
- 2017-07-11 15:14:05.484024 I | rook-ceph-mon0: 2017-07-11 15:14:05.484006 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.483699) EVENT_LOG_v1 {"time_micros": 1499786045483689, "job": 97, "event": "compaction_finished", "compaction_time_micros": 299154, "output_level": 1, "num_output_files": 1, "total_output_size": 16970691, "num_input_records": 2914, "num_output_records": 2502, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:14:05.484617 I | rook-ceph-mon0: 2017-07-11 15:14:05.484600 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045484597, "job": 97, "event": "table_file_deletion", "file_number": 151}
- 2017-07-11 15:14:05.486631 I | rook-ceph-mon0: 2017-07-11 15:14:05.486616 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045486614, "job": 97, "event": "table_file_deletion", "file_number": 149}
- 2017-07-11 15:14:05.486701 I | rook-ceph-mon0: 2017-07-11 15:14:05.486686 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:14:08.523556 I | rook-ceph-mon0: 2017-07-11 15:14:08.523515 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:08.523776 I | rook-ceph-mon0: 2017-07-11 15:14:08.523670 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2532294333' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:09.629234 I | rook-ceph-mon0: 2017-07-11 15:14:09.629191 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:09.629491 I | rook-ceph-mon0: 2017-07-11 15:14:09.629473 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/494743572' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:15.048934 I | rook-ceph-mon0: 2017-07-11 15:14:15.048828 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #153. Immutable memtables: 0.
- 2017-07-11 15:14:15.049018 I | rook-ceph-mon0:
- 2017-07-11 15:14:15.049035 I | rook-ceph-mon0: 2017-07-11 15:14:15.048859 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 98] Syncing log #150
- 2017-07-11 15:14:15.079744 I | rook-ceph-mon0: 2017-07-11 15:14:15.079021 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.048854) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:14:15.079822 I | rook-ceph-mon0: 2017-07-11 15:14:15.079043 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 98] Flushing memtable with next log file: 153
- 2017-07-11 15:14:15.079839 I | rook-ceph-mon0:
- 2017-07-11 15:14:15.079851 I | rook-ceph-mon0: 2017-07-11 15:14:15.079055 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055079050, "job": 98, "event": "flush_started", "num_memtables": 1, "num_entries": 569, "num_deletes": 502, "memory_usage": 288728}
- 2017-07-11 15:14:15.079863 I | rook-ceph-mon0: 2017-07-11 15:14:15.079058 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 98] Level-0 flush table #154: started
- 2017-07-11 15:14:15.217143 I | rook-ceph-mon0: 2017-07-11 15:14:15.217000 7f7c4654a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055216990, "cf_name": "default", "job": 98, "event": "table_file_creation", "file_number": 154, "file_size": 275195, "table_properties": {"data_size": 273739, "index_size": 642, "filter_size": 0, "raw_key_size": 10409, "raw_average_key_size": 19, "raw_value_size": 266267, "raw_average_value_size": 500, "num_data_blocks": 21, "num_entries": 532, "filter_policy_name": "", "kDeletedKeys": "502", "kMergeOperands": "0"}}
- 2017-07-11 15:14:15.217248 I | rook-ceph-mon0: 2017-07-11 15:14:15.217013 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 98] Level-0 flush table #154: 275195 bytes OK
- 2017-07-11 15:14:15.341991 I | rook-ceph-mon0: 2017-07-11 15:14:15.341791 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.326186) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #154 started
- 2017-07-11 15:14:15.342099 I | rook-ceph-mon0: 2017-07-11 15:14:15.341800 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.341740) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #154: memtable #1 done
- 2017-07-11 15:14:15.342120 I | rook-ceph-mon0: 2017-07-11 15:14:15.341802 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.341763) EVENT_LOG_v1 {"time_micros": 1499786055341757, "job": 98, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:14:15.342134 I | rook-ceph-mon0: 2017-07-11 15:14:15.341803 7f7c4654a700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.341779) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:14:15.342147 I | rook-ceph-mon0:
- 2017-07-11 15:14:15.342175 I | rook-ceph-mon0: 2017-07-11 15:14:15.341809 7f7c4654a700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 98] Try to delete WAL files size 274837, prev total WAL file size 274837, number of live WAL files 2.
- 2017-07-11 15:14:15.342187 I | rook-ceph-mon0:
- 2017-07-11 15:14:15.346693 I | rook-ceph-mon0: 2017-07-11 15:14:15.342209 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:14:15.346753 I | rook-ceph-mon0: 2017-07-11 15:14:15.342269 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.342263) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 15:14:15.346771 I | rook-ceph-mon0:
- 2017-07-11 15:14:15.346784 I | rook-ceph-mon0: 2017-07-11 15:14:15.342275 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 99] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:14:15.346798 I | rook-ceph-mon0: 2017-07-11 15:14:15.342282 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 98 Base level 0, inputs: [154(268KB)], [152(16MB)]
- 2017-07-11 15:14:15.346810 I | rook-ceph-mon0:
- 2017-07-11 15:14:15.346839 I | rook-ceph-mon0: 2017-07-11 15:14:15.342293 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055342285, "job": 99, "event": "compaction_started", "files_L0": [154], "files_L1": [152], "score": -1, "input_data_size": 17245886}
- 2017-07-11 15:14:15.661102 I | rook-ceph-mon0: 2017-07-11 15:14:15.661050 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 99] Generated table #155: 2023 keys, 14172963 bytes
- 2017-07-11 15:14:15.661169 I | rook-ceph-mon0: 2017-07-11 15:14:15.661150 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055661140, "cf_name": "default", "job": 99, "event": "table_file_creation", "file_number": 155, "file_size": 14172963, "table_properties": {"data_size": 14126957, "index_size": 45187, "filter_size": 0, "raw_key_size": 38726, "raw_average_key_size": 19, "raw_value_size": 14067104, "raw_average_value_size": 6953, "num_data_blocks": 1391, "num_entries": 2023, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:14:15.691478 I | rook-ceph-mon0: 2017-07-11 15:14:15.691431 7f7c45d49700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 99] Compacted 1@0 + 1@1 files to L1 => 14172963 bytes
- 2017-07-11 15:14:15.742343 I | rook-ceph-mon0: 2017-07-11 15:14:15.742297 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.742160) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 49.4 rd, 40.6 wr, level 1, files in(1, 1) out(1) MB in(0.3, 16.2) out(13.5), read-write-amplify(114.2) write-amplify(51.5) OK, records in: 3034, records dropped: 1011
- 2017-07-11 15:14:15.742361 I | rook-ceph-mon0:
- 2017-07-11 15:14:15.742393 I | rook-ceph-mon0: 2017-07-11 15:14:15.742377 7f7c45d49700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.742186) EVENT_LOG_v1 {"time_micros": 1499786055742177, "job": 99, "event": "compaction_finished", "compaction_time_micros": 349117, "output_level": 1, "num_output_files": 1, "total_output_size": 14172963, "num_input_records": 3034, "num_output_records": 2023, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:14:15.742564 I | rook-ceph-mon0: 2017-07-11 15:14:15.742550 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055742547, "job": 99, "event": "table_file_deletion", "file_number": 154}
- 2017-07-11 15:14:15.744653 I | rook-ceph-mon0: 2017-07-11 15:14:15.744637 7f7c45d49700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055744634, "job": 99, "event": "table_file_deletion", "file_number": 152}
- 2017-07-11 15:14:15.744821 I | rook-ceph-mon0: 2017-07-11 15:14:15.744707 7f7c46d4b700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:14:19.185502 I | rook-ceph-mon0: 2017-07-11 15:14:19.185458 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:19.185730 I | rook-ceph-mon0: 2017-07-11 15:14:19.185614 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/961875689' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:20.336323 I | rook-ceph-mon0: 2017-07-11 15:14:20.336284 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:20.336566 I | rook-ceph-mon0: 2017-07-11 15:14:20.336547 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3007387021' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:29.799412 I | rook-ceph-mon0: 2017-07-11 15:14:29.799307 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:29.799609 I | rook-ceph-mon0: 2017-07-11 15:14:29.799522 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/997491911' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:30.961980 I | rook-ceph-mon0: 2017-07-11 15:14:30.961942 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:30.962196 I | rook-ceph-mon0: 2017-07-11 15:14:30.962094 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1923854247' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:35.647343 I | rook-ceph-mon0: 2017-07-11 15:14:35.647308 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.2 10.233.124.3:6790/0 clock skew 0.0763369s > max 0.05s
- 2017-07-11 15:14:35.647623 I | rook-ceph-mon0: 2017-07-11 15:14:35.647607 7f7c4bd55700 0 log_channel(cluster) log [WRN] : mon.1 10.233.99.4:6790/0 clock skew 0.240121s > max 0.05s
- 2017-07-11 15:14:35.798405 I | rook-ceph-mon0: 2017-07-11 15:14:35.647435 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2286 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0763369s > max 0.05s
- 2017-07-11 15:14:35.798434 I | rook-ceph-mon0: 2017-07-11 15:14:35.647668 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2287 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.240121s > max 0.05s
- 2017-07-11 15:14:45.633010 I | rook-ceph-mon0: 2017-07-11 15:14:45.632836 7f7c4e55a700 0 mon.rook-ceph-mon0@0(leader).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4825 MB, avail 94361 MB
- 2017-07-11 15:14:49.489965 I | rook-ceph-mon0: 2017-07-11 15:14:49.489919 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:49.490280 I | rook-ceph-mon0: 2017-07-11 15:14:49.490076 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1195691969' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:15:00.242894 I | rook-ceph-mon0: 2017-07-11 15:15:00.242855 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:15:00.243099 I | rook-ceph-mon0: 2017-07-11 15:15:00.243006 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2982654411' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:15:01.801002 I | rook-ceph-mon0: 2017-07-11 15:15:01.800964 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:15:01.801195 I | rook-ceph-mon0: 2017-07-11 15:15:01.801110 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1223519444' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:15:14.511698 I | rook-ceph-mon0: 2017-07-11 15:15:14.511660 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:15:14.511934 I | rook-ceph-mon0: 2017-07-11 15:15:14.511819 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3116520022' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:15:24.278012 I | rook-ceph-mon0: 2017-07-11 15:15:24.277973 7f7c4bd55700 0 mon.rook-ceph-mon0@0(leader) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:15:24.278226 I | rook-ceph-mon0: 2017-07-11 15:15:24.278122 7f7c4bd55700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1916834088' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- END logs from pod: rook-ceph-mon0-3dkfv
- BEGIN logs from pod: rook-ceph-mon1-ktck0
- 2017-07-11 13:23:51.604411 I | cephmon: parsing mon endpoints: rook-ceph-mon0=10.233.76.3:6790
- 2017-07-11 13:23:51.604857 I | cephmon: writing config file /var/lib/rook/rook/rook.config
- 2017-07-11 13:23:51.605110 I | cephmon: generated admin config in /var/lib/rook/rook
- 2017-07-11 13:23:51.605351 I | cephmon: writing config file /var/lib/rook/rook-ceph-mon1/rook.config
- 2017-07-11 13:23:51.605576 I | cephmon: initializing mon
- 2017-07-11 13:23:51.605614 I | proc: Running process ceph-mon with args: [--mkfs --name=mon.rook-ceph-mon1 --cluster=rook --mon-data=/var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1 --conf=/var/lib/rook/rook-ceph-mon1/rook.config --keyring=/var/lib/rook/rook-ceph-mon1/keyring]
- 2017-07-11 13:23:51.605633 I | exec: Running command: ceph-mon --mkfs --name=mon.rook-ceph-mon1 --cluster=rook --mon-data=/var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1 --conf=/var/lib/rook/rook-ceph-mon1/rook.config --keyring=/var/lib/rook/rook-ceph-mon1/keyring
- 2017-07-11 13:23:52.207059 I | mkfs-rook-ceph-mon1: ceph-mon: set fsid to 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:23:52.228844 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.228788 7f99ee498c40 0 set rocksdb option compression = kNoCompression
- 2017-07-11 13:23:52.228923 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.228908 7f99ee498c40 0 set rocksdb option write_buffer_size = 33554432
- 2017-07-11 13:23:52.229023 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229007 7f99ee498c40 0 set rocksdb option compression = kNoCompression
- 2017-07-11 13:23:52.229103 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229089 7f99ee498c40 0 set rocksdb option write_buffer_size = 33554432
- 2017-07-11 13:23:52.229296 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229266 7f99ee498c40 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:23:52.229320 I | mkfs-rook-ceph-mon1:
- 2017-07-11 13:23:52.229347 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229333 7f99ee498c40 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:23:52.229387 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229362 7f99ee498c40 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:23:52.229411 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229402 7f99ee498c40 4 rocksdb: DB SUMMARY
- 2017-07-11 13:23:52.229423 I | mkfs-rook-ceph-mon1:
- 2017-07-11 13:23:52.229482 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229466 7f99ee498c40 4 rocksdb: SST files in /var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1/store.db dir, Total Num: 0, files:
- 2017-07-11 13:23:52.229496 I | mkfs-rook-ceph-mon1:
- 2017-07-11 13:23:52.229533 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229508 7f99ee498c40 4 rocksdb: Write Ahead Log file in /var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1/store.db:
- 2017-07-11 13:23:52.229547 I | mkfs-rook-ceph-mon1:
- 2017-07-11 13:23:52.229571 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229559 7f99ee498c40 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:23:52.229609 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229587 7f99ee498c40 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:23:52.229633 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229623 7f99ee498c40 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:23:52.229667 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229657 7f99ee498c40 4 rocksdb: Options.env: 0x55673ce4bdc0
- 2017-07-11 13:23:52.229703 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229692 7f99ee498c40 4 rocksdb: Options.info_log: 0x55673d9ec780
- 2017-07-11 13:23:52.229726 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229716 7f99ee498c40 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:23:52.229749 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229739 7f99ee498c40 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:23:52.229786 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229776 7f99ee498c40 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:23:52.229809 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229800 7f99ee498c40 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:23:52.229845 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229822 7f99ee498c40 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:23:52.229870 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229860 7f99ee498c40 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:23:52.229893 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229883 7f99ee498c40 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:23:52.229928 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229917 7f99ee498c40 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:23:52.229952 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229942 7f99ee498c40 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:23:52.229997 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.229964 7f99ee498c40 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:23:52.230021 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230011 7f99ee498c40 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:23:52.230043 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230034 7f99ee498c40 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:23:52.230078 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230056 7f99ee498c40 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:23:52.230103 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230094 7f99ee498c40 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:23:52.230126 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230117 7f99ee498c40 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:23:52.230162 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230151 7f99ee498c40 4 rocksdb: Options.wal_dir: /var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1/store.db
- 2017-07-11 13:23:52.230185 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230175 7f99ee498c40 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:23:52.230206 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230197 7f99ee498c40 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:23:52.230239 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230229 7f99ee498c40 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:23:52.230262 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230252 7f99ee498c40 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:23:52.230282 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230273 7f99ee498c40 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:23:52.230316 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230306 7f99ee498c40 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:23:52.230341 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230330 7f99ee498c40 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:23:52.230363 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230354 7f99ee498c40 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:23:52.230396 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230386 7f99ee498c40 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:23:52.230418 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230409 7f99ee498c40 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:23:52.230439 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230430 7f99ee498c40 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:23:52.230471 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230461 7f99ee498c40 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:23:52.230493 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.230484 7f99ee498c40 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:23:52.246774 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246525 7f99ee498c40 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:23:52.246805 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246540 7f99ee498c40 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:23:52.246820 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246547 7f99ee498c40 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:23:52.246831 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246553 7f99ee498c40 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:23:52.246854 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246568 7f99ee498c40 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:23:52.246866 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246573 7f99ee498c40 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:23:52.246877 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246577 7f99ee498c40 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:23:52.246889 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246582 7f99ee498c40 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:23:52.246899 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246606 7f99ee498c40 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:23:52.246909 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246611 7f99ee498c40 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:23:52.246929 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246616 7f99ee498c40 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:23:52.246940 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246621 7f99ee498c40 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:23:52.246950 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246626 7f99ee498c40 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:23:52.246961 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246631 7f99ee498c40 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:23:52.246970 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246636 7f99ee498c40 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:23:52.246984 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246641 7f99ee498c40 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:23:52.247005 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246646 7f99ee498c40 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:23:52.247017 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246650 7f99ee498c40 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:23:52.247027 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246655 7f99ee498c40 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:23:52.247037 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246659 7f99ee498c40 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:23:52.247047 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246672 7f99ee498c40 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:23:52.247057 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246677 7f99ee498c40 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:23:52.247067 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246682 7f99ee498c40 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:23:52.247091 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246686 7f99ee498c40 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:23:52.247101 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246691 7f99ee498c40 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:23:52.247111 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246696 7f99ee498c40 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:23:52.247120 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246700 7f99ee498c40 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:23:52.247131 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246705 7f99ee498c40 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:23:52.247141 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.246711 7f99ee498c40 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:23:52.256789 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.256418 7f99ee498c40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:192] Creating manifest 1
- 2017-07-11 13:23:52.256820 I | mkfs-rook-ceph-mon1:
- 2017-07-11 13:23:52.449218 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.448891 7f99ee498c40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001
- 2017-07-11 13:23:52.449251 I | mkfs-rook-ceph-mon1:
- 2017-07-11 13:23:52.449265 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.448993 7f99ee498c40 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:23:52.449297 I | mkfs-rook-ceph-mon1:
- 2017-07-11 13:23:52.449309 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449002 7f99ee498c40 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:23:52.449321 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449003 7f99ee498c40 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:23:52.449331 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449004 7f99ee498c40 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:23:52.449341 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449004 7f99ee498c40 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:23:52.449352 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449005 7f99ee498c40 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:23:52.449373 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449006 7f99ee498c40 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:23:52.449389 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449024 7f99ee498c40 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55673d812150)
- 2017-07-11 13:23:52.449400 I | mkfs-rook-ceph-mon1: cache_index_and_filter_blocks: 0
- 2017-07-11 13:23:52.449411 I | mkfs-rook-ceph-mon1: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:23:52.449421 I | mkfs-rook-ceph-mon1: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:23:52.449430 I | mkfs-rook-ceph-mon1: index_type: 0
- 2017-07-11 13:23:52.449453 I | mkfs-rook-ceph-mon1: hash_index_allow_collision: 1
- 2017-07-11 13:23:52.449465 I | mkfs-rook-ceph-mon1: checksum: 1
- 2017-07-11 13:23:52.449475 I | mkfs-rook-ceph-mon1: no_block_cache: 0
- 2017-07-11 13:23:52.449484 I | mkfs-rook-ceph-mon1: block_cache: 0x55673d8448c0
- 2017-07-11 13:23:52.449494 I | mkfs-rook-ceph-mon1: block_cache_name: LRUCache
- 2017-07-11 13:23:52.449503 I | mkfs-rook-ceph-mon1: block_cache_options:
- 2017-07-11 13:23:52.449513 I | mkfs-rook-ceph-mon1: capacity : 107374182
- 2017-07-11 13:23:52.449534 I | mkfs-rook-ceph-mon1: num_shard_bits : 4
- 2017-07-11 13:23:52.449544 I | mkfs-rook-ceph-mon1: strict_capacity_limit : 0
- 2017-07-11 13:23:52.449553 I | mkfs-rook-ceph-mon1: high_pri_pool_ratio: 0.000
- 2017-07-11 13:23:52.449563 I | mkfs-rook-ceph-mon1: block_cache_compressed: (nil)
- 2017-07-11 13:23:52.449572 I | mkfs-rook-ceph-mon1: persistent_cache: (nil)
- 2017-07-11 13:23:52.449581 I | mkfs-rook-ceph-mon1: block_size: 4096
- 2017-07-11 13:23:52.449591 I | mkfs-rook-ceph-mon1: block_size_deviation: 10
- 2017-07-11 13:23:52.449612 I | mkfs-rook-ceph-mon1: block_restart_interval: 16
- 2017-07-11 13:23:52.449622 I | mkfs-rook-ceph-mon1: index_block_restart_interval: 1
- 2017-07-11 13:23:52.449632 I | mkfs-rook-ceph-mon1: filter_policy: nullptr
- 2017-07-11 13:23:52.449641 I | mkfs-rook-ceph-mon1: whole_key_filtering: 1
- 2017-07-11 13:23:52.449650 I | mkfs-rook-ceph-mon1: format_version: 2
- 2017-07-11 13:23:52.449659 I | mkfs-rook-ceph-mon1:
- 2017-07-11 13:23:52.449679 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449027 7f99ee498c40 4 rocksdb: Options.write_buffer_size: 33554432
- 2017-07-11 13:23:52.449691 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449028 7f99ee498c40 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:23:52.449701 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449029 7f99ee498c40 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:23:52.449712 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449029 7f99ee498c40 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:23:52.449724 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449030 7f99ee498c40 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:23:52.455965 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449031 7f99ee498c40 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:23:52.455983 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449031 7f99ee498c40 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:23:52.455990 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449032 7f99ee498c40 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:23:52.455996 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449032 7f99ee498c40 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:23:52.456002 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449033 7f99ee498c40 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:23:52.456007 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449033 7f99ee498c40 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:23:52.456012 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449034 7f99ee498c40 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:23:52.456038 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449034 7f99ee498c40 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:23:52.456045 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449035 7f99ee498c40 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:23:52.456050 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449036 7f99ee498c40 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:23:52.456056 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449036 7f99ee498c40 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:23:52.456065 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449037 7f99ee498c40 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:23:52.456070 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449037 7f99ee498c40 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:23:52.456076 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449038 7f99ee498c40 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:23:52.456085 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449038 7f99ee498c40 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:23:52.456090 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449039 7f99ee498c40 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:23:52.456096 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449041 7f99ee498c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:23:52.456122 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449041 7f99ee498c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:23:52.456128 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449042 7f99ee498c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:23:52.456134 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449042 7f99ee498c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:23:52.456139 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449043 7f99ee498c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:23:52.456145 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449043 7f99ee498c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:23:52.456151 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449044 7f99ee498c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:23:52.456156 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449045 7f99ee498c40 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:23:52.456162 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449045 7f99ee498c40 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:23:52.456168 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449046 7f99ee498c40 4 rocksdb: Options.arena_block_size: 4194304
- 2017-07-11 13:23:52.456173 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449046 7f99ee498c40 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:23:52.456194 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449047 7f99ee498c40 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:23:52.456197 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449048 7f99ee498c40 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:23:52.456199 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449048 7f99ee498c40 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:23:52.456201 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449049 7f99ee498c40 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:23:52.456203 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449050 7f99ee498c40 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:23:52.456205 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449051 7f99ee498c40 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:23:52.456208 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449051 7f99ee498c40 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:23:52.456211 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449052 7f99ee498c40 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:23:52.456214 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449052 7f99ee498c40 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:23:52.456216 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449053 7f99ee498c40 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:23:52.456218 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449053 7f99ee498c40 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:23:52.456220 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449054 7f99ee498c40 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:23:52.456222 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449055 7f99ee498c40 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:23:52.456226 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449055 7f99ee498c40 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:23:52.456228 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449056 7f99ee498c40 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:23:52.456230 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449056 7f99ee498c40 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:23:52.456232 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449057 7f99ee498c40 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:23:52.456234 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449062 7f99ee498c40 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:23:52.456236 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449063 7f99ee498c40 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:23:52.456238 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449063 7f99ee498c40 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:23:52.456241 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449064 7f99ee498c40 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:23:52.456243 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.449064 7f99ee498c40 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:23:52.456592 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.456378 7f99ee498c40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:23:52.456598 I | mkfs-rook-ceph-mon1:
- 2017-07-11 13:23:52.456601 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.456387 7f99ee498c40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 0
- 2017-07-11 13:23:52.456603 I | mkfs-rook-ceph-mon1:
- 2017-07-11 13:23:52.536953 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.536850 7f99ee498c40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55673da32000
- 2017-07-11 13:23:52.805742 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.805702 7f99ee498c40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:217] Shutdown: canceling all background work
- 2017-07-11 13:23:52.805969 I | mkfs-rook-ceph-mon1: 2017-07-11 13:23:52.805948 7f99ee498c40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:343] Shutdown complete
- 2017-07-11 13:23:52.806085 I | mkfs-rook-ceph-mon1: ceph-mon: created monfs at /var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1 for mon.rook-ceph-mon1
- 2017-07-11 13:23:52.808063 I | cephmon: starting mon
- 2017-07-11 13:23:52.808141 I | cephmon: Config file /var/lib/rook/rook-ceph-mon1/rook.config:
- [global]
- enable experimental unrecoverable data corrupting features =
- fsid = 14d33745-7e28-4202-a25a-906da8bffbcf
- run dir = /var/lib/rook/rook-ceph-mon1
- mon initial members = rook-ceph-mon1 rook-ceph-mon0
- log file = /dev/stdout
- mon cluster log file = /dev/stdout
- mon keyvaluedb = rocksdb
- debug default = 0
- debug rados = 0
- debug mon = 0
- debug osd = 0
- debug bluestore = 0
- debug filestore = 0
- debug journal = 0
- debug leveldb = 0
- filestore_omap_backend = rocksdb
- osd pg bits = 11
- osd pgp bits = 11
- osd pool default size = 1
- osd pool default min size = 1
- osd pool default pg num = 100
- osd pool default pgp num = 100
- osd objectstore = filestore
- rbd_default_features = 3
- fatal signal handlers = false
- [client.admin]
- keyring = /var/lib/rook/rook-ceph-mon1/keyring
- [mon.rook-ceph-mon0]
- name = rook-ceph-mon0
- mon addr = 10.233.76.3:6790
- [mon.rook-ceph-mon1]
- name = rook-ceph-mon1
- mon addr = 10.233.99.4:6790
- 2017-07-11 13:23:52.808188 I | proc: Running process ceph-mon with args: [--foreground --name=mon.rook-ceph-mon1 --cluster=rook --mon-data=/var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1 --conf=/var/lib/rook/rook-ceph-mon1/rook.config --keyring=/var/lib/rook/rook-ceph-mon1/keyring]
- 2017-07-11 13:23:52.808207 I | exec: Running command: ceph-mon --foreground --name=mon.rook-ceph-mon1 --cluster=rook --mon-data=/var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1 --conf=/var/lib/rook/rook-ceph-mon1/rook.config --keyring=/var/lib/rook/rook-ceph-mon1/keyring
- 2017-07-11 13:23:52.908243 I | rook-ceph-mon1: 2017-07-11 13:23:52.908163 7f004c56ec40 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 30
- 2017-07-11 13:23:52.908404 I | rook-ceph-mon1: 2017-07-11 13:23:52.908387 7f004c56ec40 0 pidfile_write: ignore empty --pid-file
- 2017-07-11 13:23:53.700821 I | rook-ceph-mon1: 2017-07-11 13:23:53.700773 7f004c56ec40 0 load: jerasure load: lrc load: isa
- 2017-07-11 13:23:53.701072 I | rook-ceph-mon1: 2017-07-11 13:23:53.701052 7f004c56ec40 0 set rocksdb option compression = kNoCompression
- 2017-07-11 13:23:53.701132 I | rook-ceph-mon1: 2017-07-11 13:23:53.701119 7f004c56ec40 0 set rocksdb option write_buffer_size = 33554432
- 2017-07-11 13:23:53.701222 I | rook-ceph-mon1: 2017-07-11 13:23:53.701188 7f004c56ec40 0 set rocksdb option compression = kNoCompression
- 2017-07-11 13:23:53.701275 I | rook-ceph-mon1: 2017-07-11 13:23:53.701262 7f004c56ec40 0 set rocksdb option write_buffer_size = 33554432
- 2017-07-11 13:23:53.701467 I | rook-ceph-mon1: 2017-07-11 13:23:53.701452 7f004c56ec40 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:23:53.701500 I | rook-ceph-mon1:
- 2017-07-11 13:23:53.701530 I | rook-ceph-mon1: 2017-07-11 13:23:53.701515 7f004c56ec40 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:23:53.701556 I | rook-ceph-mon1: 2017-07-11 13:23:53.701546 7f004c56ec40 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:23:53.701597 I | rook-ceph-mon1: 2017-07-11 13:23:53.701584 7f004c56ec40 4 rocksdb: DB SUMMARY
- 2017-07-11 13:23:53.701610 I | rook-ceph-mon1:
- 2017-07-11 13:23:53.701686 I | rook-ceph-mon1: 2017-07-11 13:23:53.701672 7f004c56ec40 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:23:53.701701 I | rook-ceph-mon1:
- 2017-07-11 13:23:53.701742 I | rook-ceph-mon1: 2017-07-11 13:23:53.701714 7f004c56ec40 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:23:53.701755 I | rook-ceph-mon1:
- 2017-07-11 13:23:53.701790 I | rook-ceph-mon1: 2017-07-11 13:23:53.701777 7f004c56ec40 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes
- 2017-07-11 13:23:53.701817 I | rook-ceph-mon1:
- 2017-07-11 13:23:53.701843 I | rook-ceph-mon1: 2017-07-11 13:23:53.701831 7f004c56ec40 4 rocksdb: SST files in /var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1/store.db dir, Total Num: 0, files:
- 2017-07-11 13:23:53.701856 I | rook-ceph-mon1:
- 2017-07-11 13:23:53.701891 I | rook-ceph-mon1: 2017-07-11 13:23:53.701868 7f004c56ec40 4 rocksdb: Write Ahead Log file in /var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1/store.db: 000003.log size: 787 ;
- 2017-07-11 13:23:53.701904 I | rook-ceph-mon1:
- 2017-07-11 13:23:53.701929 I | rook-ceph-mon1: 2017-07-11 13:23:53.701916 7f004c56ec40 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:23:53.701966 I | rook-ceph-mon1: 2017-07-11 13:23:53.701943 7f004c56ec40 4 rocksdb: Options.create_if_missing: 0
- 2017-07-11 13:23:53.701989 I | rook-ceph-mon1: 2017-07-11 13:23:53.701980 7f004c56ec40 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:23:53.702013 I | rook-ceph-mon1: 2017-07-11 13:23:53.702003 7f004c56ec40 4 rocksdb: Options.env: 0x55d3438e9dc0
- 2017-07-11 13:23:53.702048 I | rook-ceph-mon1: 2017-07-11 13:23:53.702038 7f004c56ec40 4 rocksdb: Options.info_log: 0x55d345c168a0
- 2017-07-11 13:23:53.702072 I | rook-ceph-mon1: 2017-07-11 13:23:53.702063 7f004c56ec40 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:23:53.702094 I | rook-ceph-mon1: 2017-07-11 13:23:53.702085 7f004c56ec40 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:23:53.702129 I | rook-ceph-mon1: 2017-07-11 13:23:53.702119 7f004c56ec40 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:23:53.702153 I | rook-ceph-mon1: 2017-07-11 13:23:53.702144 7f004c56ec40 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:23:53.702175 I | rook-ceph-mon1: 2017-07-11 13:23:53.702166 7f004c56ec40 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:23:53.702210 I | rook-ceph-mon1: 2017-07-11 13:23:53.702200 7f004c56ec40 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:23:53.702233 I | rook-ceph-mon1: 2017-07-11 13:23:53.702224 7f004c56ec40 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:23:53.702255 I | rook-ceph-mon1: 2017-07-11 13:23:53.702245 7f004c56ec40 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:23:53.702303 I | rook-ceph-mon1: 2017-07-11 13:23:53.702281 7f004c56ec40 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:23:53.702325 I | rook-ceph-mon1: 2017-07-11 13:23:53.702316 7f004c56ec40 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:23:53.702362 I | rook-ceph-mon1: 2017-07-11 13:23:53.702351 7f004c56ec40 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:23:53.702387 I | rook-ceph-mon1: 2017-07-11 13:23:53.702377 7f004c56ec40 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:23:53.702423 I | rook-ceph-mon1: 2017-07-11 13:23:53.702401 7f004c56ec40 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:23:53.702449 I | rook-ceph-mon1: 2017-07-11 13:23:53.702438 7f004c56ec40 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:23:53.702472 I | rook-ceph-mon1: 2017-07-11 13:23:53.702462 7f004c56ec40 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:23:53.702509 I | rook-ceph-mon1: 2017-07-11 13:23:53.702485 7f004c56ec40 4 rocksdb: Options.wal_dir: /var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1/store.db
- 2017-07-11 13:23:53.702534 I | rook-ceph-mon1: 2017-07-11 13:23:53.702524 7f004c56ec40 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:23:53.702560 I | rook-ceph-mon1: 2017-07-11 13:23:53.702547 7f004c56ec40 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:23:53.702598 I | rook-ceph-mon1: 2017-07-11 13:23:53.702588 7f004c56ec40 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:23:53.702632 I | rook-ceph-mon1: 2017-07-11 13:23:53.702612 7f004c56ec40 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:23:53.702665 I | rook-ceph-mon1: 2017-07-11 13:23:53.702655 7f004c56ec40 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:23:53.702687 I | rook-ceph-mon1: 2017-07-11 13:23:53.702679 7f004c56ec40 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:23:53.702709 I | rook-ceph-mon1: 2017-07-11 13:23:53.702701 7f004c56ec40 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:23:53.702743 I | rook-ceph-mon1: 2017-07-11 13:23:53.702733 7f004c56ec40 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:23:53.702770 I | rook-ceph-mon1: 2017-07-11 13:23:53.702761 7f004c56ec40 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:23:53.702792 I | rook-ceph-mon1: 2017-07-11 13:23:53.702783 7f004c56ec40 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:23:53.702828 I | rook-ceph-mon1: 2017-07-11 13:23:53.702818 7f004c56ec40 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:23:53.702850 I | rook-ceph-mon1: 2017-07-11 13:23:53.702841 7f004c56ec40 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:23:53.702882 I | rook-ceph-mon1: 2017-07-11 13:23:53.702862 7f004c56ec40 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:23:53.702907 I | rook-ceph-mon1: 2017-07-11 13:23:53.702896 7f004c56ec40 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:23:53.702929 I | rook-ceph-mon1: 2017-07-11 13:23:53.702920 7f004c56ec40 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:23:53.702963 I | rook-ceph-mon1: 2017-07-11 13:23:53.702942 7f004c56ec40 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:23:53.702987 I | rook-ceph-mon1: 2017-07-11 13:23:53.702978 7f004c56ec40 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:23:53.703009 I | rook-ceph-mon1: 2017-07-11 13:23:53.703000 7f004c56ec40 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:23:53.703042 I | rook-ceph-mon1: 2017-07-11 13:23:53.703032 7f004c56ec40 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:23:53.703065 I | rook-ceph-mon1: 2017-07-11 13:23:53.703055 7f004c56ec40 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:23:53.703110 I | rook-ceph-mon1: 2017-07-11 13:23:53.703099 7f004c56ec40 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:23:53.703135 I | rook-ceph-mon1: 2017-07-11 13:23:53.703126 7f004c56ec40 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:23:53.703171 I | rook-ceph-mon1: 2017-07-11 13:23:53.703150 7f004c56ec40 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:23:53.703195 I | rook-ceph-mon1: 2017-07-11 13:23:53.703185 7f004c56ec40 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:23:53.703217 I | rook-ceph-mon1: 2017-07-11 13:23:53.703208 7f004c56ec40 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:23:53.703255 I | rook-ceph-mon1: 2017-07-11 13:23:53.703230 7f004c56ec40 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:23:53.703279 I | rook-ceph-mon1: 2017-07-11 13:23:53.703270 7f004c56ec40 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:23:53.703301 I | rook-ceph-mon1: 2017-07-11 13:23:53.703292 7f004c56ec40 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:23:53.703336 I | rook-ceph-mon1: 2017-07-11 13:23:53.703326 7f004c56ec40 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:23:53.703358 I | rook-ceph-mon1: 2017-07-11 13:23:53.703350 7f004c56ec40 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:23:53.703380 I | rook-ceph-mon1: 2017-07-11 13:23:53.703371 7f004c56ec40 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:23:53.703433 I | rook-ceph-mon1: 2017-07-11 13:23:53.703423 7f004c56ec40 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:23:53.703458 I | rook-ceph-mon1: 2017-07-11 13:23:53.703448 7f004c56ec40 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:23:53.703493 I | rook-ceph-mon1: 2017-07-11 13:23:53.703471 7f004c56ec40 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:23:53.703518 I | rook-ceph-mon1: 2017-07-11 13:23:53.703508 7f004c56ec40 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:23:53.703541 I | rook-ceph-mon1: 2017-07-11 13:23:53.703532 7f004c56ec40 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:23:53.703578 I | rook-ceph-mon1: 2017-07-11 13:23:53.703567 7f004c56ec40 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:23:53.703602 I | rook-ceph-mon1: 2017-07-11 13:23:53.703593 7f004c56ec40 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:23:53.703625 I | rook-ceph-mon1: 2017-07-11 13:23:53.703615 7f004c56ec40 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:23:53.703662 I | rook-ceph-mon1: 2017-07-11 13:23:53.703651 7f004c56ec40 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:23:53.703685 I | rook-ceph-mon1: 2017-07-11 13:23:53.703676 7f004c56ec40 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:23:53.703724 I | rook-ceph-mon1: 2017-07-11 13:23:53.703701 7f004c56ec40 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:23:53.711414 I | rook-ceph-mon1: 2017-07-11 13:23:53.711380 7f004c56ec40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001
- 2017-07-11 13:23:53.711495 I | rook-ceph-mon1:
- 2017-07-11 13:23:53.714317 I | rook-ceph-mon1: 2017-07-11 13:23:53.714286 7f004c56ec40 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:23:53.714367 I | rook-ceph-mon1:
- 2017-07-11 13:23:53.714399 I | rook-ceph-mon1: 2017-07-11 13:23:53.714385 7f004c56ec40 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:23:53.714453 I | rook-ceph-mon1: 2017-07-11 13:23:53.714439 7f004c56ec40 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:23:53.714507 I | rook-ceph-mon1: 2017-07-11 13:23:53.714470 7f004c56ec40 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:23:53.714533 I | rook-ceph-mon1: 2017-07-11 13:23:53.714522 7f004c56ec40 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:23:53.730377 I | rook-ceph-mon1: 2017-07-11 13:23:53.730356 7f004c56ec40 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:23:53.730464 I | rook-ceph-mon1: 2017-07-11 13:23:53.730450 7f004c56ec40 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:23:53.730653 I | rook-ceph-mon1: 2017-07-11 13:23:53.730589 7f004c56ec40 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d345a40140)
- 2017-07-11 13:23:53.730672 I | rook-ceph-mon1: cache_index_and_filter_blocks: 0
- 2017-07-11 13:23:53.730705 I | rook-ceph-mon1: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:23:53.730720 I | rook-ceph-mon1: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:23:53.730733 I | rook-ceph-mon1: index_type: 0
- 2017-07-11 13:23:53.730756 I | rook-ceph-mon1: hash_index_allow_collision: 1
- 2017-07-11 13:23:53.730779 I | rook-ceph-mon1: checksum: 1
- 2017-07-11 13:23:53.730792 I | rook-ceph-mon1: no_block_cache: 0
- 2017-07-11 13:23:53.730815 I | rook-ceph-mon1: block_cache: 0x55d345a729a0
- 2017-07-11 13:23:53.730879 I | rook-ceph-mon1: block_cache_name: LRUCache
- 2017-07-11 13:23:53.730895 I | rook-ceph-mon1: block_cache_options:
- 2017-07-11 13:23:53.730909 I | rook-ceph-mon1: capacity : 107374182
- 2017-07-11 13:23:53.730921 I | rook-ceph-mon1: num_shard_bits : 4
- 2017-07-11 13:23:53.730933 I | rook-ceph-mon1: strict_capacity_limit : 0
- 2017-07-11 13:23:53.730958 I | rook-ceph-mon1: high_pri_pool_ratio: 0.000
- 2017-07-11 13:23:53.730971 I | rook-ceph-mon1: block_cache_compressed: (nil)
- 2017-07-11 13:23:53.730984 I | rook-ceph-mon1: persistent_cache: (nil)
- 2017-07-11 13:23:53.730996 I | rook-ceph-mon1: block_size: 4096
- 2017-07-11 13:23:53.731008 I | rook-ceph-mon1: block_size_deviation: 10
- 2017-07-11 13:23:53.731032 I | rook-ceph-mon1: block_restart_interval: 16
- 2017-07-11 13:23:53.731045 I | rook-ceph-mon1: index_block_restart_interval: 1
- 2017-07-11 13:23:53.731057 I | rook-ceph-mon1: filter_policy: nullptr
- 2017-07-11 13:23:53.731069 I | rook-ceph-mon1: whole_key_filtering: 1
- 2017-07-11 13:23:53.731101 I | rook-ceph-mon1: format_version: 2
- 2017-07-11 13:23:53.731115 I | rook-ceph-mon1:
- 2017-07-11 13:23:53.731182 I | rook-ceph-mon1: 2017-07-11 13:23:53.731130 7f004c56ec40 4 rocksdb: Options.write_buffer_size: 33554432
- 2017-07-11 13:23:53.731210 I | rook-ceph-mon1: 2017-07-11 13:23:53.731198 7f004c56ec40 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:23:53.731235 I | rook-ceph-mon1: 2017-07-11 13:23:53.731225 7f004c56ec40 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:23:53.731274 I | rook-ceph-mon1: 2017-07-11 13:23:53.731262 7f004c56ec40 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:23:53.731307 I | rook-ceph-mon1: 2017-07-11 13:23:53.731298 7f004c56ec40 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:23:53.731343 I | rook-ceph-mon1: 2017-07-11 13:23:53.731332 7f004c56ec40 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:23:53.731375 I | rook-ceph-mon1: 2017-07-11 13:23:53.731364 7f004c56ec40 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:23:53.731410 I | rook-ceph-mon1: 2017-07-11 13:23:53.731390 7f004c56ec40 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:23:53.731435 I | rook-ceph-mon1: 2017-07-11 13:23:53.731425 7f004c56ec40 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:23:53.731467 I | rook-ceph-mon1: 2017-07-11 13:23:53.731457 7f004c56ec40 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:23:53.731506 I | rook-ceph-mon1: 2017-07-11 13:23:53.731495 7f004c56ec40 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:23:53.731532 I | rook-ceph-mon1: 2017-07-11 13:23:53.731520 7f004c56ec40 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:23:53.731569 I | rook-ceph-mon1: 2017-07-11 13:23:53.731546 7f004c56ec40 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:23:53.731592 I | rook-ceph-mon1: 2017-07-11 13:23:53.731583 7f004c56ec40 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:23:53.731615 I | rook-ceph-mon1: 2017-07-11 13:23:53.731606 7f004c56ec40 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:23:53.731649 I | rook-ceph-mon1: 2017-07-11 13:23:53.731639 7f004c56ec40 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:23:53.731672 I | rook-ceph-mon1: 2017-07-11 13:23:53.731663 7f004c56ec40 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:23:53.731694 I | rook-ceph-mon1: 2017-07-11 13:23:53.731685 7f004c56ec40 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:23:53.731730 I | rook-ceph-mon1: 2017-07-11 13:23:53.731718 7f004c56ec40 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:23:53.731754 I | rook-ceph-mon1: 2017-07-11 13:23:53.731745 7f004c56ec40 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:23:53.731789 I | rook-ceph-mon1: 2017-07-11 13:23:53.731767 7f004c56ec40 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:23:53.731814 I | rook-ceph-mon1: 2017-07-11 13:23:53.731804 7f004c56ec40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:23:53.731836 I | rook-ceph-mon1: 2017-07-11 13:23:53.731827 7f004c56ec40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:23:53.731882 I | rook-ceph-mon1: 2017-07-11 13:23:53.731872 7f004c56ec40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:23:53.731917 I | rook-ceph-mon1: 2017-07-11 13:23:53.731908 7f004c56ec40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:23:53.731955 I | rook-ceph-mon1: 2017-07-11 13:23:53.731944 7f004c56ec40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:23:53.731980 I | rook-ceph-mon1: 2017-07-11 13:23:53.731970 7f004c56ec40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:23:53.732003 I | rook-ceph-mon1: 2017-07-11 13:23:53.731994 7f004c56ec40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:23:53.732042 I | rook-ceph-mon1: 2017-07-11 13:23:53.732031 7f004c56ec40 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:23:53.732066 I | rook-ceph-mon1: 2017-07-11 13:23:53.732056 7f004c56ec40 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:23:53.732104 I | rook-ceph-mon1: 2017-07-11 13:23:53.732080 7f004c56ec40 4 rocksdb: Options.arena_block_size: 4194304
- 2017-07-11 13:23:53.732130 I | rook-ceph-mon1: 2017-07-11 13:23:53.732120 7f004c56ec40 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:23:53.732154 I | rook-ceph-mon1: 2017-07-11 13:23:53.732144 7f004c56ec40 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:23:53.732192 I | rook-ceph-mon1: 2017-07-11 13:23:53.732181 7f004c56ec40 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:23:53.732228 I | rook-ceph-mon1: 2017-07-11 13:23:53.732207 7f004c56ec40 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:23:53.732262 I | rook-ceph-mon1: 2017-07-11 13:23:53.732252 7f004c56ec40 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:23:53.732286 I | rook-ceph-mon1: 2017-07-11 13:23:53.732276 7f004c56ec40 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:23:53.732309 I | rook-ceph-mon1: 2017-07-11 13:23:53.732300 7f004c56ec40 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:23:53.732343 I | rook-ceph-mon1: 2017-07-11 13:23:53.732334 7f004c56ec40 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:23:53.732366 I | rook-ceph-mon1: 2017-07-11 13:23:53.732357 7f004c56ec40 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:23:53.732387 I | rook-ceph-mon1: 2017-07-11 13:23:53.732378 7f004c56ec40 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:23:53.732423 I | rook-ceph-mon1: 2017-07-11 13:23:53.732413 7f004c56ec40 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:23:53.732445 I | rook-ceph-mon1: 2017-07-11 13:23:53.732436 7f004c56ec40 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:23:53.732467 I | rook-ceph-mon1: 2017-07-11 13:23:53.732458 7f004c56ec40 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:23:53.732502 I | rook-ceph-mon1: 2017-07-11 13:23:53.732492 7f004c56ec40 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:23:53.732525 I | rook-ceph-mon1: 2017-07-11 13:23:53.732515 7f004c56ec40 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:23:53.732560 I | rook-ceph-mon1: 2017-07-11 13:23:53.732539 7f004c56ec40 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:23:53.732584 I | rook-ceph-mon1: 2017-07-11 13:23:53.732575 7f004c56ec40 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:23:53.732606 I | rook-ceph-mon1: 2017-07-11 13:23:53.732597 7f004c56ec40 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:23:53.732641 I | rook-ceph-mon1: 2017-07-11 13:23:53.732619 7f004c56ec40 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:23:53.732667 I | rook-ceph-mon1: 2017-07-11 13:23:53.732655 7f004c56ec40 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:23:53.732690 I | rook-ceph-mon1: 2017-07-11 13:23:53.732680 7f004c56ec40 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:23:53.732723 I | rook-ceph-mon1: 2017-07-11 13:23:53.732714 7f004c56ec40 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:23:53.732746 I | rook-ceph-mon1: 2017-07-11 13:23:53.732737 7f004c56ec40 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:23:53.733690 I | rook-ceph-mon1: 2017-07-11 13:23:53.733667 7f004c56ec40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:23:53.739552 I | rook-ceph-mon1:
- 2017-07-11 13:23:53.739646 I | rook-ceph-mon1: 2017-07-11 13:23:53.739627 7f004c56ec40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 0
- 2017-07-11 13:23:53.739666 I | rook-ceph-mon1:
- 2017-07-11 13:23:53.739806 I | rook-ceph-mon1: 2017-07-11 13:23:53.739743 7f004c56ec40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779433739737, "job": 1, "event": "recovery_started", "log_files": [3]}
- 2017-07-11 13:23:53.739870 I | rook-ceph-mon1: 2017-07-11 13:23:53.739856 7f004c56ec40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #3 mode 2
- 2017-07-11 13:23:53.783056 I | rook-ceph-mon1: 2017-07-11 13:23:53.783031 7f004c56ec40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779433783024, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1634, "table_properties": {"data_size": 799, "index_size": 28, "filter_size": 0, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 676, "raw_average_value_size": 135, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:23:53.783364 I | rook-ceph-mon1: 2017-07-11 13:23:53.783351 7f004c56ec40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 5
- 2017-07-11 13:23:53.783476 I | rook-ceph-mon1:
- 2017-07-11 13:23:53.970341 I | rook-ceph-mon1: 2017-07-11 13:23:53.970305 7f004c56ec40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779433970302, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:23:54.103200 I | rook-ceph-mon1: 2017-07-11 13:23:54.103178 7f004c56ec40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55d345d0e000
- 2017-07-11 13:23:54.120992 I | rook-ceph-mon1: 2017-07-11 13:23:54.113779 7f004c56ec40 0 starting mon.rook-ceph-mon1 rank 1 at 10.233.99.4:6790/0 mon_data /var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:23:54.123704 I | rook-ceph-mon1: starting mon.rook-ceph-mon1 rank 1 at 10.233.99.4:6790/0 mon_data /var/lib/rook/rook-ceph-mon1/mon.rook-ceph-mon1 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:23:54.151969 I | rook-ceph-mon1: 2017-07-11 13:23:54.151953 7f004c56ec40 0 mon.rook-ceph-mon1@-1(probing) e0 my rank is now 1 (was -1)
- 2017-07-11 13:23:54.181913 I | rook-ceph-mon1: 2017-07-11 13:23:54.181893 7f0040b3f700 0 mon.rook-ceph-mon1@1(probing) e1 my rank is now -1 (was 1)
- 2017-07-11 13:23:54.195168 I | rook-ceph-mon1: 2017-07-11 13:23:54.195140 7f003db39700 0 -- 10.233.99.4:6790/0 >> 10.233.76.3:6790/0 conn(0x55d345e51800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=2 cs=1 l=0).process missed message? skipped from seq 0 to 1492577755
- 2017-07-11 13:23:56.191268 I | rook-ceph-mon1: 2017-07-11 13:23:56.191238 7f0040b3f700 0 mon.rook-ceph-mon1@-1(probing) e2 my rank is now 1 (was -1)
- 2017-07-11 13:23:56.211233 I | rook-ceph-mon1: 2017-07-11 13:23:56.211195 7f003db39700 0 -- 10.233.99.4:6790/0 >> 10.233.76.3:6790/0 conn(0x55d345e61800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=3 cs=1 l=0).process missed message? skipped from seq 0 to 516839629
- 2017-07-11 13:23:56.211397 I | rook-ceph-mon1: 2017-07-11 13:23:56.211377 7f0040b3f700 0 log_channel(cluster) log [INF] : mon.rook-ceph-mon1 calling new monitor election
- 2017-07-11 13:23:59.815091 I | rook-ceph-mon1: 2017-07-11 13:23:59.815041 7f0040b3f700 1 mon.rook-ceph-mon1@1(peon).paxosservice(pgmap 1..2) refresh upgraded, format 0 -> 1
- 2017-07-11 13:23:59.826347 I | rook-ceph-mon1: 2017-07-11 13:23:59.826317 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon).mds e1 print_map
- 2017-07-11 13:23:59.826386 I | rook-ceph-mon1: e1
- 2017-07-11 13:23:59.826401 I | rook-ceph-mon1: enable_multiple, ever_enabled_multiple: 0,0
- 2017-07-11 13:23:59.826418 I | rook-ceph-mon1: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=file layout v2}
- 2017-07-11 13:23:59.826432 I | rook-ceph-mon1: legacy client fscid: -1
- 2017-07-11 13:23:59.826442 I | rook-ceph-mon1:
- 2017-07-11 13:23:59.826466 I | rook-ceph-mon1: No filesystems configured
- 2017-07-11 13:23:59.826480 I | rook-ceph-mon1:
- 2017-07-11 13:23:59.875639 I | rook-ceph-mon1: 2017-07-11 13:23:59.875545 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon).osd e1 crush map has features 288514051259236352, adjusting msgr requires
- 2017-07-11 13:23:59.875697 I | rook-ceph-mon1: 2017-07-11 13:23:59.875682 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon).osd e1 crush map has features 288514051259236352, adjusting msgr requires
- 2017-07-11 13:23:59.875730 I | rook-ceph-mon1: 2017-07-11 13:23:59.875718 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon).osd e1 crush map has features 1009089991638532096, adjusting msgr requires
- 2017-07-11 13:23:59.875772 I | rook-ceph-mon1: 2017-07-11 13:23:59.875760 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon).osd e1 crush map has features 288514051259236352, adjusting msgr requires
- 2017-07-11 13:23:59.876457 I | rook-ceph-mon1: 2017-07-11 13:23:45.483848 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2 : cluster [INF] mon.rook-ceph-mon0@0 won leader election with quorum 0
- 2017-07-11 13:23:59.876493 I | rook-ceph-mon1: 2017-07-11 13:23:45.499259 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 3 : cluster [INF] monmap e1: 1 mons at {rook-ceph-mon0=10.233.76.3:6790/0}
- 2017-07-11 13:23:59.876507 I | rook-ceph-mon1: 2017-07-11 13:23:45.610357 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 4 : cluster [INF] pgmap 0 pgs: ; 0 bytes data, 0 kB used, 0 kB / 0 kB avail
- 2017-07-11 13:23:59.876518 I | rook-ceph-mon1: 2017-07-11 13:23:45.688565 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 5 : cluster [INF] fsmap
- 2017-07-11 13:23:59.876528 I | rook-ceph-mon1: 2017-07-11 13:23:45.704448 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 6 : cluster [INF] osdmap e1: 0 total, 0 up, 0 in
- 2017-07-11 13:23:59.876539 I | rook-ceph-mon1: 2017-07-11 13:23:45.705260 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 7 : cluster [INF] mgrmap e1: no daemons active
- 2017-07-11 13:23:59.876616 I | rook-ceph-mon1: 2017-07-11 13:23:59.876598 7f0040b3f700 1 mon.rook-ceph-mon1@1(peon).paxosservice(auth 1..1) refresh upgraded, format 0 -> 2
- 2017-07-11 13:24:00.170509 I | rook-ceph-mon1: 2017-07-11 13:24:00.170489 7f0040b3f700 0 log_channel(cluster) log [INF] : mon.rook-ceph-mon1 calling new monitor election
- 2017-07-11 13:24:01.534264 I | rook-ceph-mon1: 2017-07-11 13:24:01.534161 7f003d338700 0 -- 10.233.99.4:6790/0 >> 10.233.124.3:6790/0 conn(0x55d345e7d000 :6790 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 0 vs existing csq=1 existing_state=STATE_CONNECTING_RE
- 2017-07-11 13:24:01.534355 I | rook-ceph-mon1: 2017-07-11 13:24:01.534171 7f003d338700 0 -- 10.233.99.4:6790/0 >> 10.233.124.3:6790/0 conn(0x55d345e7d000 :6790 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept peer reset, then tried to connect to us, replacing
- 2017-07-11 13:24:05.995772 I | rook-ceph-mon1: 2017-07-11 13:23:56.211454 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 1 : cluster [INF] mon.rook-ceph-mon1 calling new monitor election
- 2017-07-11 13:24:05.998234 I | rook-ceph-mon1: 2017-07-11 13:24:00.108593 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 15 : cluster [INF] mon.rook-ceph-mon0 calling new monitor election
- 2017-07-11 13:24:05.998261 I | rook-ceph-mon1: 2017-07-11 13:24:05.263887 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 16 : cluster [INF] mon.rook-ceph-mon0@0 won leader election with quorum 0,1,2
- 2017-07-11 13:24:05.998276 I | rook-ceph-mon1: 2017-07-11 13:24:05.280481 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 17 : cluster [INF] HEALTH_ERR; no osds
- 2017-07-11 13:24:07.108305 I | rook-ceph-mon1: 2017-07-11 13:24:00.170561 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 2 : cluster [INF] mon.rook-ceph-mon1 calling new monitor election
- 2017-07-11 13:24:07.108387 I | rook-ceph-mon1: 2017-07-11 13:24:01.517487 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 1 : cluster [INF] mon.rook-ceph-mon2 calling new monitor election
- 2017-07-11 13:24:07.108404 I | rook-ceph-mon1: 2017-07-11 13:24:05.448242 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 18 : cluster [INF] monmap e3: 3 mons at {rook-ceph-mon0=10.233.76.3:6790/0,rook-ceph-mon1=10.233.99.4:6790/0,rook-ceph-mon2=10.233.124.3:6790/0}
- 2017-07-11 13:24:07.108432 I | rook-ceph-mon1: 2017-07-11 13:24:05.448482 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 19 : cluster [INF] fsmap
- 2017-07-11 13:24:07.108444 I | rook-ceph-mon1: 2017-07-11 13:24:05.448744 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 20 : cluster [INF] osdmap e1: 0 total, 0 up, 0 in
- 2017-07-11 13:24:07.108455 I | rook-ceph-mon1: 2017-07-11 13:24:05.449703 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 21 : cluster [INF] mgrmap e1: no daemons active
- 2017-07-11 13:24:07.318571 I | rook-ceph-mon1: 2017-07-11 13:24:07.318546 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon).osd e2 crush map has features 283675107524608, adjusting msgr requires
- 2017-07-11 13:24:07.318638 I | rook-ceph-mon1: 2017-07-11 13:24:07.318623 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon).osd e2 crush map has features 283675107524608, adjusting msgr requires
- 2017-07-11 13:24:07.318685 I | rook-ceph-mon1: 2017-07-11 13:24:07.318658 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon).osd e2 crush map has features 720859615486820352, adjusting msgr requires
- 2017-07-11 13:24:07.318716 I | rook-ceph-mon1: 2017-07-11 13:24:07.318703 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon).osd e2 crush map has features 283675107524608, adjusting msgr requires
- 2017-07-11 13:24:08.248185 I | rook-ceph-mon1: 2017-07-11 13:24:07.012032 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 23 : audit [INF] from='client.? 10.233.99.0:0/3047177237' entity='client.admin' cmd=[{"profile": "firefly", "prefix": "osd crush tunables", "format": "plain"}]: dispatch
- 2017-07-11 13:24:08.258287 I | rook-ceph-mon1: 2017-07-11 13:24:07.302815 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 24 : audit [INF] from='client.? 10.233.99.0:0/3047177237' entity='client.admin' cmd='[{"profile": "firefly", "prefix": "osd crush tunables", "format": "plain"}]': finished
- 2017-07-11 13:24:08.258330 I | rook-ceph-mon1: 2017-07-11 13:24:07.303065 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 25 : cluster [INF] osdmap e2: 0 total, 0 up, 0 in
- 2017-07-11 13:24:08.346233 I | rook-ceph-mon1: 2017-07-11 13:24:08.278299 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd setcrushmap", "format": "json"} v 0) v1
- 2017-07-11 13:24:08.346279 I | rook-ceph-mon1: 2017-07-11 13:24:08.278324 7f0040b3f700 0 log_channel(audit) log [INF] : from='client.? 10.233.99.2:0/1924409' entity='client.admin' cmd=[{"prefix": "osd setcrushmap", "format": "json"}]: dispatch
- 2017-07-11 13:24:09.271561 I | rook-ceph-mon1: 2017-07-11 13:24:08.278326 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 3 : audit [INF] from='client.? 10.233.99.2:0/1924409' entity='client.admin' cmd=[{"prefix": "osd setcrushmap", "format": "json"}]: dispatch
- 2017-07-11 13:24:09.271619 I | rook-ceph-mon1: 2017-07-11 13:24:08.339350 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 26 : audit [INF] from='client.4102 -' entity='client.admin' cmd=[{"prefix": "osd setcrushmap", "format": "json"}]: dispatch
- 2017-07-11 13:24:09.615425 I | rook-ceph-mon1: 2017-07-11 13:24:09.614668 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon).osd e3 crush map has features 2200130813952, adjusting msgr requires
- 2017-07-11 13:24:09.615535 I | rook-ceph-mon1: 2017-07-11 13:24:09.615518 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon).osd e3 crush map has features 2200130813952, adjusting msgr requires
- 2017-07-11 13:24:09.615587 I | rook-ceph-mon1: 2017-07-11 13:24:09.615558 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon).osd e3 crush map has features 720578140510109696, adjusting msgr requires
- 2017-07-11 13:24:09.615618 I | rook-ceph-mon1: 2017-07-11 13:24:09.615606 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon).osd e3 crush map has features 2200130813952, adjusting msgr requires
- 2017-07-11 13:24:10.649630 I | rook-ceph-mon1: 2017-07-11 13:24:09.590922 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 27 : audit [INF] from='client.4102 -' entity='client.admin' cmd='[{"prefix": "osd setcrushmap", "format": "json"}]': finished
- 2017-07-11 13:24:10.651410 I | rook-ceph-mon1: 2017-07-11 13:24:09.591245 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 28 : cluster [INF] osdmap e3: 0 total, 0 up, 0 in
- 2017-07-11 13:24:11.912018 I | rook-ceph-mon1: 2017-07-11 13:24:10.844669 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 2 : audit [INF] from='client.? 10.233.99.0:0/1815105145' entity='client.admin' cmd=[{"entity": "mgr.rook-ceph-mgr0", "prefix": "auth get-or-create-key", "caps": ["mon", "allow *"], "format": "json"}]: dispatch
- 2017-07-11 13:24:11.914371 I | rook-ceph-mon1: 2017-07-11 13:24:10.897838 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 29 : audit [INF] from='client.4103 -' entity='client.admin' cmd=[{"entity": "mgr.rook-ceph-mgr0", "prefix": "auth get-or-create-key", "caps": ["mon", "allow *"], "format": "json"}]: dispatch
- 2017-07-11 13:24:11.914400 I | rook-ceph-mon1: 2017-07-11 13:24:11.020381 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 30 : audit [INF] from='client.4103 -' entity='client.admin' cmd='[{"entity": "mgr.rook-ceph-mgr0", "prefix": "auth get-or-create-key", "caps": ["mon", "allow *"], "format": "json"}]': finished
- 2017-07-11 13:24:13.371054 I | rook-ceph-mon1: 2017-07-11 13:24:13.371020 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"} v 0) v1
- 2017-07-11 13:24:13.371254 I | rook-ceph-mon1: 2017-07-11 13:24:13.371232 7f0040b3f700 0 log_channel(audit) log [INF] : from='client.? 10.233.99.0:0/329149194' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 13:24:13.948637 I | rook-ceph-mon1: 2017-07-11 13:24:13.364737 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 31 : audit [INF] from='client.4105 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 13:24:13.948658 I | rook-ceph-mon1: 2017-07-11 13:24:13.371310 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 4 : audit [INF] from='client.? 10.233.99.0:0/329149194' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 13:24:15.371526 I | rook-ceph-mon1: 2017-07-11 13:24:13.703951 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 32 : audit [INF] from='client.4105 -' entity='client.admin' cmd='[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]': finished
- 2017-07-11 13:24:18.510145 I | rook-ceph-mon1: 2017-07-11 13:24:18.018558 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 3 : cluster [WRN] message from mon.0 was stamped 0.073977s in the future, clocks not synchronized
- 2017-07-11 13:24:20.691016 I | rook-ceph-mon1: 2017-07-11 13:24:20.363489 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 4 : audit [INF] from='client.? 10.233.72.0:0/3023866456' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "87446daf-adb9-4330-b384-dc39dca0e7d4", "format": "json"}]: dispatch
- 2017-07-11 13:24:20.691085 I | rook-ceph-mon1: 2017-07-11 13:24:20.426137 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 33 : audit [INF] from='client.4106 -' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "87446daf-adb9-4330-b384-dc39dca0e7d4", "format": "json"}]: dispatch
- 2017-07-11 13:24:20.691102 I | rook-ceph-mon1: 2017-07-11 13:24:20.460061 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 34 : audit [INF] from='client.? 10.233.76.4:0/3208763407' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "73875ada-81e5-484d-a5cb-4fd39d3ea97f", "format": "json"}]: dispatch
- 2017-07-11 13:24:21.380234 I | rook-ceph-mon1: 2017-07-11 13:24:21.380205 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon getmap", "format": "json"} v 0) v1
- 2017-07-11 13:24:21.380412 I | rook-ceph-mon1: 2017-07-11 13:24:21.380340 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.76.0:0/3791349278' entity='client.admin' cmd=[{"prefix": "mon getmap", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.073914 I | rook-ceph-mon1: 2017-07-11 13:24:20.862019 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 35 : audit [INF] from='client.4106 -' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "87446daf-adb9-4330-b384-dc39dca0e7d4", "format": "json"}]': finished
- 2017-07-11 13:24:22.074287 I | rook-ceph-mon1: 2017-07-11 13:24:20.862058 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 36 : audit [INF] from='client.? 10.233.76.4:0/3208763407' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "73875ada-81e5-484d-a5cb-4fd39d3ea97f", "format": "json"}]': finished
- 2017-07-11 13:24:22.074331 I | rook-ceph-mon1: 2017-07-11 13:24:21.059934 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 38 : audit [INF] from='client.? 10.233.69.0:0/2353069969' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "0623e5ff-56df-42b2-b682-76e1b77cba81", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.074347 I | rook-ceph-mon1: 2017-07-11 13:24:21.332571 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 39 : audit [INF] from='client.? 10.233.86.0:0/4247247533' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "cd112926-e214-4caa-9506-6797fb79af42", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.074479 I | rook-ceph-mon1: 2017-07-11 13:24:21.845081 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 5 : audit [INF] from='client.? 10.233.124.4:0/2258242595' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "7fa3db3b-e42c-44ec-ac2c-d78a63760e1b", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.074529 I | rook-ceph-mon1: 2017-07-11 13:24:20.862083 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 37 : cluster [INF] osdmap e4: 2 total, 0 up, 0 in
- 2017-07-11 13:24:22.901589 I | rook-ceph-mon1: 2017-07-11 13:24:22.901560 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd create", "uuid": "9771b2a8-0591-4ce0-ba50-846d5c052724", "format": "json"} v 0) v1
- 2017-07-11 13:24:22.901777 I | rook-ceph-mon1: 2017-07-11 13:24:22.901761 7f0040b3f700 0 log_channel(audit) log [INF] : from='client.? 10.233.99.6:0/1526158553' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "9771b2a8-0591-4ce0-ba50-846d5c052724", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.909193 I | rook-ceph-mon1: 2017-07-11 13:24:22.909175 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "config-key list"} v 0) v1
- 2017-07-11 13:24:22.909267 I | rook-ceph-mon1: 2017-07-11 13:24:22.909253 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "config-key list"}]: dispatch
- 2017-07-11 13:24:23.230518 I | rook-ceph-mon1: 2017-07-11 13:24:21.846875 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 41 : audit [INF] from='client.4112 -' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "7fa3db3b-e42c-44ec-ac2c-d78a63760e1b", "format": "json"}]: dispatch
- 2017-07-11 13:24:23.234094 I | rook-ceph-mon1: 2017-07-11 13:24:22.307936 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 42 : audit [INF] from='client.? 10.233.69.0:0/2353069969' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "0623e5ff-56df-42b2-b682-76e1b77cba81", "format": "json"}]': finished
- 2017-07-11 13:24:23.234131 I | rook-ceph-mon1: 2017-07-11 13:24:22.308241 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 43 : audit [INF] from='client.? 10.233.86.0:0/4247247533' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "cd112926-e214-4caa-9506-6797fb79af42", "format": "json"}]': finished
- 2017-07-11 13:24:23.234147 I | rook-ceph-mon1: 2017-07-11 13:24:22.308455 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 44 : audit [INF] from='client.4112 -' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "7fa3db3b-e42c-44ec-ac2c-d78a63760e1b", "format": "json"}]': finished
- 2017-07-11 13:24:23.234173 I | rook-ceph-mon1: 2017-07-11 13:24:22.895280 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 47 : audit [INF] from='client.4111 -' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "9771b2a8-0591-4ce0-ba50-846d5c052724", "format": "json"}]: dispatch
- 2017-07-11 13:24:23.234188 I | rook-ceph-mon1: 2017-07-11 13:24:22.901821 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 6 : audit [INF] from='client.? 10.233.99.6:0/1526158553' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "9771b2a8-0591-4ce0-ba50-846d5c052724", "format": "json"}]: dispatch
- 2017-07-11 13:24:23.234225 I | rook-ceph-mon1: 2017-07-11 13:24:22.309218 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 45 : cluster [INF] osdmap e5: 5 total, 0 up, 0 in
- 2017-07-11 13:24:23.234258 I | rook-ceph-mon1: 2017-07-11 13:24:22.738947 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 46 : cluster [INF] mgrmap e2: rook-ceph-mgr0(active, starting)
- 2017-07-11 13:24:24.129422 I | rook-ceph-mon1: 2017-07-11 13:24:24.129366 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:24:24.129702 I | rook-ceph-mon1: 2017-07-11 13:24:24.129686 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:24:24.130090 I | rook-ceph-mon1: 2017-07-11 13:24:24.130073 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:24:24.130158 I | rook-ceph-mon1: 2017-07-11 13:24:24.130144 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:24:24.130504 I | rook-ceph-mon1: 2017-07-11 13:24:24.130488 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:24:24.130640 I | rook-ceph-mon1: 2017-07-11 13:24:24.130556 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:24:24.130981 I | rook-ceph-mon1: 2017-07-11 13:24:24.130965 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:24:24.131044 I | rook-ceph-mon1: 2017-07-11 13:24:24.131031 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:24:24.131393 I | rook-ceph-mon1: 2017-07-11 13:24:24.131377 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:24:24.131466 I | rook-ceph-mon1: 2017-07-11 13:24:24.131453 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:24:24.131799 I | rook-ceph-mon1: 2017-07-11 13:24:24.131784 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:24:24.131860 I | rook-ceph-mon1: 2017-07-11 13:24:24.131847 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:24:24.411724 I | rook-ceph-mon1: 2017-07-11 13:24:24.411690 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 1, "weight": 0.0946, "format": "json"} v 0) v1
- 2017-07-11 13:24:24.414279 I | rook-ceph-mon1: 2017-07-11 13:24:24.414254 7f0040b3f700 0 log_channel(audit) log [INF] : from='client.? 10.233.76.0:0/3770583375' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 1, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:24.542636 I | rook-ceph-mon1: 2017-07-11 13:24:23.247532 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 49 : audit [INF] from='client.? 10.233.72.0:0/3883659066' entity='client.admin' cmd=[{"entity": "osd.0", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:24.545863 I | rook-ceph-mon1: 2017-07-11 13:24:23.373766 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 11 : audit [INF] from='client.? 10.233.76.0:0/1251607715' entity='client.admin' cmd=[{"entity": "osd.1", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:24.545935 I | rook-ceph-mon1: 2017-07-11 13:24:23.376712 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 50 : audit [INF] from='client.? 10.233.72.0:0/3883659066' entity='client.admin' cmd='[{"entity": "osd.0", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:24.545956 I | rook-ceph-mon1: 2017-07-11 13:24:23.447026 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 51 : audit [INF] from='client.4127 -' entity='client.admin' cmd=[{"entity": "osd.1", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:24.545970 I | rook-ceph-mon1: 2017-07-11 13:24:23.624355 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 52 : audit [INF] from='client.4127 -' entity='client.admin' cmd='[{"entity": "osd.1", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:24.545983 I | rook-ceph-mon1: 2017-07-11 13:24:23.826405 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 53 : audit [INF] from='client.? 10.233.72.0:0/3273515169' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 0, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:24.546016 I | rook-ceph-mon1: 2017-07-11 13:24:24.097956 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 54 : audit [INF] from='client.4111 -' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "9771b2a8-0591-4ce0-ba50-846d5c052724", "format": "json"}]': finished
- 2017-07-11 13:24:24.585887 I | rook-ceph-mon1: 2017-07-11 13:24:24.098133 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 55 : cluster [INF] osdmap e6: 6 total, 0 up, 0 in
- 2017-07-11 13:24:24.854647 I | rook-ceph-mon1: 2017-07-11 13:24:24.854612 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"entity": "osd.3", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"} v 0) v1
- 2017-07-11 13:24:24.854757 I | rook-ceph-mon1: 2017-07-11 13:24:24.854742 7f0040b3f700 0 log_channel(audit) log [INF] : from='client.? 10.233.86.0:0/2946127837' entity='client.admin' cmd=[{"entity": "osd.3", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:25.016119 I | rook-ceph-mon1: 2017-07-11 13:24:25.016092 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon getmap", "format": "json"} v 0) v1
- 2017-07-11 13:24:25.016213 I | rook-ceph-mon1: 2017-07-11 13:24:25.016198 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.6:0/1572158718' entity='client.admin' cmd=[{"prefix": "mon getmap", "format": "json"}]: dispatch
- 2017-07-11 13:24:25.397364 I | rook-ceph-mon1: 2017-07-11 13:24:25.397046 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:24:25.397712 I | rook-ceph-mon1: 2017-07-11 13:24:25.397071 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:24:25.397769 I | rook-ceph-mon1: 2017-07-11 13:24:25.397293 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:24:25.398303 I | rook-ceph-mon1: 2017-07-11 13:24:25.397307 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:24:25.398791 I | rook-ceph-mon1: 2017-07-11 13:24:25.398740 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:24:25.399058 I | rook-ceph-mon1: 2017-07-11 13:24:25.398756 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:24:25.406333 I | rook-ceph-mon1: 2017-07-11 13:24:25.406315 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:24:25.415602 I | rook-ceph-mon1: 2017-07-11 13:24:25.415562 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:24:25.416106 I | rook-ceph-mon1: 2017-07-11 13:24:25.416089 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:24:25.416362 I | rook-ceph-mon1: 2017-07-11 13:24:25.416347 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:24:25.416819 I | rook-ceph-mon1: 2017-07-11 13:24:25.416803 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:24:25.417079 I | rook-ceph-mon1: 2017-07-11 13:24:25.417045 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:24:25.686024 I | rook-ceph-mon1: 2017-07-11 13:24:25.685977 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 3, "weight": 0.0946, "format": "json"} v 0) v1
- 2017-07-11 13:24:25.686141 I | rook-ceph-mon1: 2017-07-11 13:24:25.686125 7f0040b3f700 0 log_channel(audit) log [INF] : from='client.? 10.233.86.0:0/4142784513' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 3, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:25.764329 I | rook-ceph-mon1: 2017-07-11 13:24:25.764167 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:24:25.764538 I | rook-ceph-mon1: 2017-07-11 13:24:25.764183 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4003387011' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:24:26.204110 I | rook-ceph-mon1: 2017-07-11 13:24:24.414311 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 14 : audit [INF] from='client.? 10.233.76.0:0/3770583375' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 1, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:26.205538 I | rook-ceph-mon1: 2017-07-11 13:24:24.653786 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 56 : audit [INF] from='client.4117 -' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 1, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:26.205567 I | rook-ceph-mon1: 2017-07-11 13:24:24.854871 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 15 : audit [INF] from='client.? 10.233.86.0:0/2946127837' entity='client.admin' cmd=[{"entity": "osd.3", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:26.205581 I | rook-ceph-mon1: 2017-07-11 13:24:25.064304 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 57 : audit [INF] from='client.4120 -' entity='client.admin' cmd=[{"entity": "osd.3", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:26.205592 I | rook-ceph-mon1: 2017-07-11 13:24:25.168891 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 58 : audit [INF] from='client.4120 -' entity='client.admin' cmd='[{"entity": "osd.3", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:26.205617 I | rook-ceph-mon1: 2017-07-11 13:24:25.427547 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 59 : audit [INF] from='client.? 10.233.72.0:0/3273515169' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 0, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:26.205630 I | rook-ceph-mon1: 2017-07-11 13:24:25.427850 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 60 : audit [INF] from='client.4117 -' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 1, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:26.205641 I | rook-ceph-mon1: 2017-07-11 13:24:25.428027 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 61 : cluster [INF] osdmap e7: 6 total, 0 up, 0 in
- 2017-07-11 13:24:26.742365 I | rook-ceph-mon1: 2017-07-11 13:24:26.742338 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:24:26.742468 I | rook-ceph-mon1: 2017-07-11 13:24:26.742453 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:24:26.742965 I | rook-ceph-mon1: 2017-07-11 13:24:26.742925 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:24:26.743203 I | rook-ceph-mon1: 2017-07-11 13:24:26.743188 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:24:26.743639 I | rook-ceph-mon1: 2017-07-11 13:24:26.743613 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:24:26.743856 I | rook-ceph-mon1: 2017-07-11 13:24:26.743843 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:24:26.744372 I | rook-ceph-mon1: 2017-07-11 13:24:26.744233 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:24:26.744468 I | rook-ceph-mon1: 2017-07-11 13:24:26.744425 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:24:26.745019 I | rook-ceph-mon1: 2017-07-11 13:24:26.745004 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:24:26.745086 I | rook-ceph-mon1: 2017-07-11 13:24:26.745073 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:24:26.745616 I | rook-ceph-mon1: 2017-07-11 13:24:26.745600 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:24:26.761770 I | rook-ceph-mon1: 2017-07-11 13:24:26.761752 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:24:29.014293 I | rook-ceph-mon1: 2017-07-11 13:24:25.686214 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 23 : audit [INF] from='client.? 10.233.86.0:0/4142784513' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 3, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:29.014358 I | rook-ceph-mon1: 2017-07-11 13:24:25.752141 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 62 : audit [INF] from='client.4129 -' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 3, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:29.014374 I | rook-ceph-mon1: 2017-07-11 13:24:25.864248 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 63 : audit [INF] from='osd.0 10.233.72.0:6800/180' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0946, "args": ["host=master-1", "root=default"]}]: dispatch
- 2017-07-11 13:24:29.014385 I | rook-ceph-mon1: 2017-07-11 13:24:25.968277 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 65 : audit [INF] from='client.? 10.233.69.0:0/1725450048' entity='client.admin' cmd=[{"entity": "osd.2", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:29.014397 I | rook-ceph-mon1: 2017-07-11 13:24:26.155792 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 66 : audit [INF] from='osd.1 10.233.76.4:6800/178' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0946, "args": ["host=minion-0", "root=default"]}]: dispatch
- 2017-07-11 13:24:29.014427 I | rook-ceph-mon1: 2017-07-11 13:24:26.340949 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 67 : audit [INF] from='client.? 10.233.69.0:0/1725450048' entity='client.admin' cmd='[{"entity": "osd.2", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:29.014438 I | rook-ceph-mon1: 2017-07-11 13:24:26.623119 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 68 : audit [INF] from='client.4129 -' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 3, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:29.014449 I | rook-ceph-mon1: 2017-07-11 13:24:26.623588 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 69 : audit [INF] from='osd.0 10.233.72.0:6800/180' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0946, "args": ["host=master-1", "root=default"]}]': finished
- 2017-07-11 13:24:29.014465 I | rook-ceph-mon1: 2017-07-11 13:24:26.623745 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 70 : audit [INF] from='osd.1 10.233.76.4:6800/178' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0946, "args": ["host=minion-0", "root=default"]}]': finished
- 2017-07-11 13:24:29.014478 I | rook-ceph-mon1: 2017-07-11 13:24:26.832567 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 72 : audit [INF] from='client.? 10.233.69.0:0/1655086740' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 2, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:29.014502 I | rook-ceph-mon1: 2017-07-11 13:24:26.969323 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 73 : audit [INF] from='client.? 10.233.124.0:0/354492821' entity='client.admin' cmd=[{"entity": "osd.4", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:29.014536 I | rook-ceph-mon1: 2017-07-11 13:24:25.896041 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 64 : cluster [INF] mgrmap e3: rook-ceph-mgr0(active)
- 2017-07-11 13:24:29.014550 I | rook-ceph-mon1: 2017-07-11 13:24:26.623871 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 71 : cluster [INF] osdmap e8: 6 total, 0 up, 0 in
- 2017-07-11 13:24:29.024901 I | rook-ceph-mon1: 2017-07-11 13:24:29.024882 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:24:29.024982 I | rook-ceph-mon1: 2017-07-11 13:24:29.024963 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:24:29.041317 I | rook-ceph-mon1: 2017-07-11 13:24:29.041301 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:24:29.041515 I | rook-ceph-mon1: 2017-07-11 13:24:29.041484 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:24:29.041895 I | rook-ceph-mon1: 2017-07-11 13:24:29.041879 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:24:29.042052 I | rook-ceph-mon1: 2017-07-11 13:24:29.042033 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:24:29.042433 I | rook-ceph-mon1: 2017-07-11 13:24:29.042417 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:24:29.042791 I | rook-ceph-mon1: 2017-07-11 13:24:29.042739 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:24:29.043177 I | rook-ceph-mon1: 2017-07-11 13:24:29.043162 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:24:29.043390 I | rook-ceph-mon1: 2017-07-11 13:24:29.043377 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:24:29.043806 I | rook-ceph-mon1: 2017-07-11 13:24:29.043789 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:24:29.044011 I | rook-ceph-mon1: 2017-07-11 13:24:29.043998 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:24:30.394143 I | rook-ceph-mon1: 2017-07-11 13:24:27.151038 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 74 : audit [INF] from='osd.3 10.233.86.0:6800/178' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0946, "args": ["host=master-2", "root=default"]}]: dispatch
- 2017-07-11 13:24:30.394220 I | rook-ceph-mon1: 2017-07-11 13:24:28.719165 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 75 : audit [INF] from='client.? 10.233.124.0:0/354492821' entity='client.admin' cmd='[{"entity": "osd.4", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:30.394239 I | rook-ceph-mon1: 2017-07-11 13:24:29.044553 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 78 : audit [INF] from='client.? 10.233.69.0:0/1655086740' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 2, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:30.394268 I | rook-ceph-mon1: 2017-07-11 13:24:29.044957 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 79 : audit [INF] from='osd.3 10.233.86.0:6800/178' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0946, "args": ["host=master-2", "root=default"]}]': finished
- 2017-07-11 13:24:30.394282 I | rook-ceph-mon1: 2017-07-11 13:24:29.280696 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 81 : audit [INF] from='client.? 10.233.124.0:0/3518883843' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 4, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:30.394294 I | rook-ceph-mon1: 2017-07-11 13:24:29.504937 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 12 : audit [INF] from='osd.2 10.233.69.0:6800/178' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0946, "args": ["host=master-0", "root=default"]}]: dispatch
- 2017-07-11 13:24:30.394306 I | rook-ceph-mon1: 2017-07-11 13:24:29.568221 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 82 : audit [INF] from='osd.2 -' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0946, "args": ["host=master-0", "root=default"]}]: dispatch
- 2017-07-11 13:24:30.394368 I | rook-ceph-mon1: 2017-07-11 13:24:29.043632 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 76 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:24:30.394385 I | rook-ceph-mon1: 2017-07-11 13:24:29.044061 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 77 : cluster [INF] osd.1 10.233.76.4:6800/178 boot
- 2017-07-11 13:24:30.394397 I | rook-ceph-mon1: 2017-07-11 13:24:29.045183 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 80 : cluster [INF] osdmap e9: 6 total, 2 up, 2 in
- 2017-07-11 13:24:30.442778 I | rook-ceph-mon1: 2017-07-11 13:24:30.442758 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:24:30.443060 I | rook-ceph-mon1: 2017-07-11 13:24:30.443044 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:24:30.451689 I | rook-ceph-mon1: 2017-07-11 13:24:30.451672 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:24:30.451764 I | rook-ceph-mon1: 2017-07-11 13:24:30.451750 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:24:30.452169 I | rook-ceph-mon1: 2017-07-11 13:24:30.452153 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:24:30.452239 I | rook-ceph-mon1: 2017-07-11 13:24:30.452225 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:24:30.452785 I | rook-ceph-mon1: 2017-07-11 13:24:30.452769 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:24:30.453090 I | rook-ceph-mon1: 2017-07-11 13:24:30.453076 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:24:30.453580 I | rook-ceph-mon1: 2017-07-11 13:24:30.453563 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:24:30.453758 I | rook-ceph-mon1: 2017-07-11 13:24:30.453743 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:24:30.454163 I | rook-ceph-mon1: 2017-07-11 13:24:30.454147 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:24:30.454413 I | rook-ceph-mon1: 2017-07-11 13:24:30.454399 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:24:30.912629 I | rook-ceph-mon1: 2017-07-11 13:24:30.912598 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:24:30.912729 I | rook-ceph-mon1: 2017-07-11 13:24:30.912715 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:24:30.913005 I | rook-ceph-mon1: 2017-07-11 13:24:30.912973 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:24:30.913071 I | rook-ceph-mon1: 2017-07-11 13:24:30.913052 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:24:30.913309 I | rook-ceph-mon1: 2017-07-11 13:24:30.913294 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:24:30.913373 I | rook-ceph-mon1: 2017-07-11 13:24:30.913361 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:24:30.913590 I | rook-ceph-mon1: 2017-07-11 13:24:30.913574 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:24:30.913649 I | rook-ceph-mon1: 2017-07-11 13:24:30.913636 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:24:30.913837 I | rook-ceph-mon1: 2017-07-11 13:24:30.913822 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:24:30.913906 I | rook-ceph-mon1: 2017-07-11 13:24:30.913894 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:24:30.914112 I | rook-ceph-mon1: 2017-07-11 13:24:30.914097 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:24:30.914183 I | rook-ceph-mon1: 2017-07-11 13:24:30.914170 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:24:31.828708 I | rook-ceph-mon1: 2017-07-11 13:24:30.375600 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 84 : audit [INF] from='client.? 10.233.124.0:0/3518883843' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 4, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:31.828855 I | rook-ceph-mon1: 2017-07-11 13:24:30.375796 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 85 : audit [INF] from='osd.2 -' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0946, "args": ["host=master-0", "root=default"]}]': finished
- 2017-07-11 13:24:31.828924 I | rook-ceph-mon1: 2017-07-11 13:24:30.375331 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 83 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:24:31.828939 I | rook-ceph-mon1: 2017-07-11 13:24:30.376299 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 86 : cluster [INF] osdmap e10: 6 total, 3 up, 3 in
- 2017-07-11 13:24:31.828950 I | rook-ceph-mon1: 2017-07-11 13:24:30.980570 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 87 : cluster [INF] osdmap e11: 6 total, 3 up, 3 in
- 2017-07-11 13:24:32.430406 I | rook-ceph-mon1: 2017-07-11 13:24:32.430084 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:24:32.431785 I | rook-ceph-mon1: 2017-07-11 13:24:32.430113 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:24:32.431826 I | rook-ceph-mon1: 2017-07-11 13:24:32.430166 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:24:32.431840 I | rook-ceph-mon1: 2017-07-11 13:24:32.430176 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:24:32.431882 I | rook-ceph-mon1: 2017-07-11 13:24:32.430208 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:24:32.431895 I | rook-ceph-mon1: 2017-07-11 13:24:32.430217 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:24:32.431911 I | rook-ceph-mon1: 2017-07-11 13:24:32.430248 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:24:32.431922 I | rook-ceph-mon1: 2017-07-11 13:24:32.430256 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:24:32.431946 I | rook-ceph-mon1: 2017-07-11 13:24:32.430282 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:24:32.431958 I | rook-ceph-mon1: 2017-07-11 13:24:32.430290 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:24:32.431971 I | rook-ceph-mon1: 2017-07-11 13:24:32.430317 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:24:32.431981 I | rook-ceph-mon1: 2017-07-11 13:24:32.430324 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:24:33.022923 I | rook-ceph-mon1: 2017-07-11 13:24:31.439537 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 13 : audit [INF] from='osd.4 10.233.124.4:6800/178' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0946, "args": ["host=minion-2", "root=default"]}]: dispatch
- 2017-07-11 13:24:33.024515 I | rook-ceph-mon1: 2017-07-11 13:24:31.621753 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 88 : audit [INF] from='client.? 10.233.99.0:0/3135454564' entity='client.admin' cmd=[{"entity": "osd.5", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:33.024546 I | rook-ceph-mon1: 2017-07-11 13:24:31.622367 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 89 : audit [INF] from='osd.4 -' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0946, "args": ["host=minion-2", "root=default"]}]: dispatch
- 2017-07-11 13:24:33.024571 I | rook-ceph-mon1: 2017-07-11 13:24:31.918962 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 90 : audit [INF] from='client.? 10.233.99.0:0/3135454564' entity='client.admin' cmd='[{"entity": "osd.5", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:33.024585 I | rook-ceph-mon1: 2017-07-11 13:24:32.203458 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 92 : audit [INF] from='osd.4 -' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0946, "args": ["host=minion-2", "root=default"]}]': finished
- 2017-07-11 13:24:33.024625 I | rook-ceph-mon1: 2017-07-11 13:24:32.203129 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 91 : cluster [INF] osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:24:33.024638 I | rook-ceph-mon1: 2017-07-11 13:24:32.203799 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 93 : cluster [INF] osdmap e12: 6 total, 4 up, 4 in
- 2017-07-11 13:24:33.024649 I | rook-ceph-mon1: 2017-07-11 13:24:32.614491 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 14 : cluster [WRN] message from mon.0 was stamped 0.071119s in the future, clocks not synchronized
- 2017-07-11 13:24:33.024836 I | rook-ceph-mon1: 2017-07-11 13:24:32.686410 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 94 : cluster [INF] osdmap e13: 6 total, 4 up, 4 in
- 2017-07-11 13:24:33.815621 I | rook-ceph-mon1: 2017-07-11 13:24:33.815587 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:24:33.815726 I | rook-ceph-mon1: 2017-07-11 13:24:33.815712 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:24:33.816243 I | rook-ceph-mon1: 2017-07-11 13:24:33.816227 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:24:33.816446 I | rook-ceph-mon1: 2017-07-11 13:24:33.816410 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:24:33.816833 I | rook-ceph-mon1: 2017-07-11 13:24:33.816816 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:24:33.817059 I | rook-ceph-mon1: 2017-07-11 13:24:33.817037 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:24:33.817496 I | rook-ceph-mon1: 2017-07-11 13:24:33.817480 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:24:33.817697 I | rook-ceph-mon1: 2017-07-11 13:24:33.817667 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:24:33.818110 I | rook-ceph-mon1: 2017-07-11 13:24:33.818094 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:24:33.818301 I | rook-ceph-mon1: 2017-07-11 13:24:33.818260 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:24:33.818691 I | rook-ceph-mon1: 2017-07-11 13:24:33.818675 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:24:33.824807 I | rook-ceph-mon1: 2017-07-11 13:24:33.824789 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:24:34.133941 I | rook-ceph-mon1: 2017-07-11 13:24:32.852788 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 95 : audit [INF] from='client.? 10.233.99.0:0/4057176481' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 5, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:34.134175 I | rook-ceph-mon1: 2017-07-11 13:24:33.849151 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 97 : audit [INF] from='client.? 10.233.99.0:0/4057176481' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 5, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:34.134270 I | rook-ceph-mon1: 2017-07-11 13:24:33.848800 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 96 : cluster [INF] osd.4 10.233.124.4:6800/178 boot
- 2017-07-11 13:24:34.134327 I | rook-ceph-mon1: 2017-07-11 13:24:33.849364 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 98 : cluster [INF] osdmap e14: 6 total, 5 up, 5 in
- 2017-07-11 13:24:35.461376 I | rook-ceph-mon1: 2017-07-11 13:24:35.461350 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "id": 5, "weight":0.0946, "args": ["host=minion-1", "root=default"]} v 0) v1
- 2017-07-11 13:24:35.461533 I | rook-ceph-mon1: 2017-07-11 13:24:35.461468 7f0040b3f700 0 log_channel(audit) log [INF] : from='osd.5 10.233.99.6:6800/179' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0946, "args": ["host=minion-1", "root=default"]}]: dispatch
- 2017-07-11 13:24:36.669601 I | rook-ceph-mon1: 2017-07-11 13:24:36.669574 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:24:36.669911 I | rook-ceph-mon1: 2017-07-11 13:24:36.669869 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:24:36.670459 I | rook-ceph-mon1: 2017-07-11 13:24:36.670442 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:24:36.670991 I | rook-ceph-mon1: 2017-07-11 13:24:36.670946 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:24:36.671390 I | rook-ceph-mon1: 2017-07-11 13:24:36.671373 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:24:36.671455 I | rook-ceph-mon1: 2017-07-11 13:24:36.671442 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:24:36.671936 I | rook-ceph-mon1: 2017-07-11 13:24:36.671918 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:24:36.672222 I | rook-ceph-mon1: 2017-07-11 13:24:36.672203 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:24:36.689710 I | rook-ceph-mon1: 2017-07-11 13:24:36.689690 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:24:36.689784 I | rook-ceph-mon1: 2017-07-11 13:24:36.689769 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:24:36.690168 I | rook-ceph-mon1: 2017-07-11 13:24:36.690151 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:24:36.698740 I | rook-ceph-mon1: 2017-07-11 13:24:36.698721 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:24:36.908611 I | rook-ceph-mon1: 2017-07-11 13:24:35.461554 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 61 : audit [INF] from='osd.5 10.233.99.6:6800/179' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0946, "args": ["host=minion-1", "root=default"]}]: dispatch
- 2017-07-11 13:24:36.909361 I | rook-ceph-mon1: 2017-07-11 13:24:35.505800 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 99 : audit [INF] from='osd.5 -' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0946, "args": ["host=minion-1", "root=default"]}]: dispatch
- 2017-07-11 13:24:37.394814 I | rook-ceph-mon1: 2017-07-11 13:24:37.394641 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:24:37.394886 I | rook-ceph-mon1: 2017-07-11 13:24:37.394672 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:24:37.395449 I | rook-ceph-mon1: 2017-07-11 13:24:37.395399 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:24:37.395779 I | rook-ceph-mon1: 2017-07-11 13:24:37.395412 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:24:37.396365 I | rook-ceph-mon1: 2017-07-11 13:24:37.396349 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:24:37.396584 I | rook-ceph-mon1: 2017-07-11 13:24:37.396569 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:24:37.396972 I | rook-ceph-mon1: 2017-07-11 13:24:37.396956 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:24:37.397187 I | rook-ceph-mon1: 2017-07-11 13:24:37.397168 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:24:37.397519 I | rook-ceph-mon1: 2017-07-11 13:24:37.397503 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:24:37.397672 I | rook-ceph-mon1: 2017-07-11 13:24:37.397658 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:24:37.397981 I | rook-ceph-mon1: 2017-07-11 13:24:37.397966 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:24:37.398127 I | rook-ceph-mon1: 2017-07-11 13:24:37.398112 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:24:38.028618 I | rook-ceph-mon1: 2017-07-11 13:24:36.592631 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 100 : audit [INF] from='osd.5 -' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0946, "args": ["host=minion-1", "root=default"]}]': finished
- 2017-07-11 13:24:38.028713 I | rook-ceph-mon1: 2017-07-11 13:24:36.592944 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 101 : cluster [INF] osdmap e15: 6 total, 5 up, 5 in
- 2017-07-11 13:24:38.028776 I | rook-ceph-mon1: 2017-07-11 13:24:37.266277 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 102 : cluster [INF] osd.5 10.233.99.6:6800/179 boot
- 2017-07-11 13:24:38.028793 I | rook-ceph-mon1: 2017-07-11 13:24:37.266651 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 103 : cluster [INF] osdmap e16: 6 total, 6 up, 6 in
- 2017-07-11 13:24:41.691511 I | rook-ceph-mon1: 2017-07-11 13:24:41.689115 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:24:41.691918 I | rook-ceph-mon1: 2017-07-11 13:24:41.689140 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:24:41.691972 I | rook-ceph-mon1: 2017-07-11 13:24:41.689398 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:24:41.691992 I | rook-ceph-mon1: 2017-07-11 13:24:41.689412 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:24:41.692009 I | rook-ceph-mon1: 2017-07-11 13:24:41.689623 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:24:41.692038 I | rook-ceph-mon1: 2017-07-11 13:24:41.689635 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:24:41.692056 I | rook-ceph-mon1: 2017-07-11 13:24:41.690779 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:24:41.692072 I | rook-ceph-mon1: 2017-07-11 13:24:41.690793 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:24:41.692087 I | rook-ceph-mon1: 2017-07-11 13:24:41.691012 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:24:41.692114 I | rook-ceph-mon1: 2017-07-11 13:24:41.691023 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:24:41.692132 I | rook-ceph-mon1: 2017-07-11 13:24:41.691266 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:24:41.692148 I | rook-ceph-mon1: 2017-07-11 13:24:41.691277 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:24:42.700216 I | rook-ceph-mon1: 2017-07-11 13:24:41.556133 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 104 : cluster [INF] osdmap e17: 6 total, 6 up, 6 in
- 2017-07-11 13:24:47.870013 I | rook-ceph-mon1: 2017-07-11 13:24:47.869982 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:24:47.870114 I | rook-ceph-mon1: 2017-07-11 13:24:47.870101 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2358919971' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:24:54.154632 I | rook-ceph-mon1: 2017-07-11 13:24:54.154391 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4676 MB, avail 94511 MB
- 2017-07-11 13:25:06.149054 I | rook-ceph-mon1: 2017-07-11 13:25:05.280508 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 116 : cluster [INF] HEALTH_WARN; 614 pgs peering; 6 requests are blocked > 32 sec; 6 osds have slow requests; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:25:07.250431 I | rook-ceph-mon1: 2017-07-11 13:24:59.141639 osd.1 osd.1 10.233.76.4:6800/178 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.086934 secs
- 2017-07-11 13:25:07.257699 I | rook-ceph-mon1: 2017-07-11 13:24:59.141653 osd.1 osd.1 10.233.76.4:6800/178 2 : cluster [WRN] slow request 30.086934 seconds old, received at 2017-07-11 13:24:29.054610: osd_pg_create(e9 0.1:2 0.4:2 0.8:2 0.c:2 0.11:2 0.12:2 0.13:2 0.16:2 0.1a:2 0.1b:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.2b:2 0.33:2 0.34:2 0.36:2 0.37:2 0.38:2 0.39:2 0.3c:2 0.40:2 0.41:2 0.43:2 0.4b:2 0.4d:2 0.4e:2 0.52:2 0.57:2 0.5a:2 0.5f:2 0.62:2 0.67:2 0.6d:2 0.74:2 0.75:2 0.80:2 0.81:2 0.84:2 0.86:2 0.87:2 0.8c:2 0.8d:2 0.8f:2 0.92:2 0.93:2 0.96:2 0.99:2 0.9a:2 0.9b:2 0.9c:2 0.a4:2 0.a9:2 0.aa:2 0.ae:2 0.af:2 0.b1:2 0.b2:2 0.b7:2 0.b9:2 0.be:2 0.c1:2 0.c7:2 0.c9:2 0.cf:2 0.db:2 0.df:2 0.e6:2 0.f0:2 0.f1:2 0.f2:2 0.f3:2 0.f5:2 0.f6:2 0.fa:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.106:2 0.109:2 0.10b:2 0.10d:2 0.113:2 0.114:2 0.115:2 0.11a:2 0.121:2 0.124:2 0.125:2 0.12b:2 0.130:2 0.136:2 0.137:2 0.139:2 0.13a:2 0.13b:2 0.13c:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14b:2 0.14d:2 0.155:2 0.156:2 0.158:2 0.159:2 0.15b:2 0.15d:2 0.161:2 0.164:2 0.165:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.178:2 0.17d:2 0.184:2 0.187:2 0.18c:2 0.18e:2 0.18f:2 0.190:2 0.191:2 0.193:2 0.197:2 0.199:2 0.19a:2 0.19b:2 0.19d:2 0.1a1:2 0.1a2:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b2:2 0.1b3:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1c9:2 0.1d1:2 0.1d3:2 0.1d9:2 0.1da:2 0.1dd:2 0.1e0:2 0.1e3:2 0.1e5:2 0.1e7:2 0.1e8:2 0.1ea:2 0.1ee:2 0.1f1:2 0.1f2:2 0.1f3:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fb:2 0.1fc:2 0.1fd:2 0.1ff:2 0.202:2 0.208:2 0.209:2 0.20c:2 0.210:2 0.213:2 0.215:2 0.219:2 0.21b:2 0.220:2 0.221:2 0.225:2 0.229:2 0.22e:2 0.230:2 0.233:2 0.234:2 0.236:2 0.238:2 0.240:2 0.241:2 0.244:2 0.245:2 0.24b:2 0.24f:2 0.256:2 0.257:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.268:2 0.26c:2 0.26f:2 0.274:2 0.275:2 0.278:2 0.27b:2 0.27c:2 0.27d:2 0.27e:2 0.281:2 0.284:2 0.287:2 0.288:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.293:2 0.29b:2 0.29c:2 0.29f:2 0.2a2:2 0.2a3:2 0.2a5:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ad:2 0.2b0:2 0.2b6:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2bd:2 0.2c0:2 0.2c3:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2cf:2 0.2d4:2 0.2d6:2 0.2d8:2 0.2da:2 0.2dc:2 0.2e6:2 0.2e8:2 0.2f2:2 0.2f4:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2fd:2 0.2ff:2 0.301:2 0.302:2 0.303:2 0.305:2 0.307:2 0.30b:2 0.30d:2 0.30f:2 0.311:2 0.314:2 0.315:2 0.318:2 0.319:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.336:2 0.339:2 0.33a:2 0.33d:2 0.347:2 0.348:2 0.34a:2 0.34e:2 0.34f:2 0.350:2 0.353:2 0.357:2 0.35b:2 0.35d:2 0.35e:2 0.35f:2 0.361:2 0.366:2 0.368:2 0.369:2 0.36f:2 0.370:2 0.371:2 0.375:2 0.376:2 0.37c:2 0.37e:2 0.380:2 0.384:2 0.387:2 0.38a:2 0.38e:2 0.390:2 0.392:2 0.395:2 0.39a:2 0.39b:2 0.39c:2 0.39d:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b3:2 0.3b4:2 0.3b5:2 0.3ba:2 0.3c1:2 0.3c3:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cc:2 0.3cd:2 0.3d1:2 0.3d2:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3da:2 0.3db:2 0.3dc:2 0.3dd:2 0.3df:2 0.3e0:2 0.3e2:2 0.3e3:2 0.3e5:2 0.3e7:2 0.3ea:2 0.3ec:2 0.3f0:2 0.3f1:2 0.3f4:2 0.3f8:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:07.257741 I | rook-ceph-mon1: 2017-07-11 13:24:59.815551 osd.0 osd.0 10.233.72.0:6800/180 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.826397 secs
- 2017-07-11 13:25:07.257768 I | rook-ceph-mon1: 2017-07-11 13:24:59.815574 osd.0 osd.0 10.233.72.0:6800/180 2 : cluster [WRN] slow request 30.826397 seconds old, received at 2017-07-11 13:24:28.989049: osd_pg_create(e9 0.6:2 0.7:2 0.9:2 0.b:2 0.10:2 0.14:2 0.18:2 0.19:2 0.27:2 0.28:2 0.29:2 0.2c:2 0.31:2 0.3b:2 0.3d:2 0.42:2 0.44:2 0.46:2 0.49:2 0.50:2 0.53:2 0.55:2 0.59:2 0.5b:2 0.5d:2 0.5e:2 0.61:2 0.63:2 0.64:2 0.65:2 0.66:2 0.69:2 0.6b:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.82:2 0.83:2 0.90:2 0.9d:2 0.9f:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.a7:2 0.a8:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.ba:2 0.bb:2 0.bd:2 0.bf:2 0.c6:2 0.cd:2 0.d0:2 0.d3:2 0.d4:2 0.d6:2 0.d7:2 0.da:2 0.dd:2 0.e1:2 0.e3:2 0.e4:2 0.e5:2 0.e7:2 0.e8:2 0.e9:2 0.ed:2 0.ee:2 0.f4:2 0.f8:2 0.fc:2 0.fd:2 0.10c:2 0.10e:2 0.110:2 0.116:2 0.117:2 0.118:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.128:2 0.12a:2 0.12c:2 0.12f:2 0.132:2 0.135:2 0.140:2 0.141:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.160:2 0.163:2 0.166:2 0.16a:2 0.170:2 0.179:2 0.17b:2 0.17c:2 0.17e:2 0.17f:2 0.180:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.192:2 0.194:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b0:2 0.1b1:2 0.1b4:2 0.1b7:2 0.1b8:2 0.1b9:2 0.1ba:2 0.1be:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1ce:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1de:2 0.1e1:2 0.1e2:2 0.1e4:2 0.1e6:2 0.1eb:2 0.1ed:2 0.1f5:2 0.1f7:2 0.1f8:2 0.1fe:2 0.200:2 0.204:2 0.206:2 0.207:2 0.20a:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.214:2 0.216:2 0.21c:2 0.21e:2 0.227:2 0.228:2 0.22a:2 0.22b:2 0.22c:2 0.22d:2 0.231:2 0.23c:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.250:2 0.252:2 0.255:2 0.25b:2 0.25e:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26d:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.277:2 0.279:2 0.27f:2 0.282:2 0.286:2 0.28c:2 0.28f:2 0.292:2 0.294:2 0.295:2 0.296:2 0.298:2 0.299:2 0.29d:2 0.2a1:2 0.2a4:2 0.2ab:2 0.2ae:2 0.2b2:2 0.2b3:2 0.2b4:2 0.2b5:2 0.2bb:2 0.2bc:2 0.2be:2 0.2c1:2 0.2c4:2 0.2c5:2 0.2cb:2 0.2cd:2 0.2ce:2 0.2d2:2 0.2d3:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e7:2 0.2ee:2 0.2ef:2 0.2f0:2 0.2f6:2 0.2fa:2 0.2fb:2 0.304:2 0.306:2 0.309:2 0.30c:2 0.310:2 0.312:2 0.316:2 0.317:2 0.31a:2 0.31d:2 0.31e:2 0.31f:2 0.323:2 0.324:2 0.328:2 0.32b:2 0.32d:2 0.331:2 0.332:2 0.338:2 0.33b:2 0.33e:2 0.340:2 0.343:2 0.346:2 0.349:2 0.34d:2 0.351:2 0.352:2 0.355:2 0.356:2 0.358:2 0.35c:2 0.362:2 0.363:2 0.36b:2 0.372:2 0.373:2 0.374:2 0.377:2 0.378:2 0.37b:2 0.381:2 0.382:2 0.385:2 0.386:2 0.389:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.396:2 0.399:2 0.3a5:2 0.3a6:2 0.3a7:2 0.3a9:2 0.3ac:2 0.3af:2 0.3b6:2 0.3b7:2 0.3b8:2 0.3b9:2 0.3bc:2 0.3bd:2 0.3be:2 0.3c0:2 0.3c2:2 0.3c7:2 0.3ce:2 0.3cf:2 0.3d4:2 0.3d7:2 0.3d8:2 0.3de:2 0.3e6:2 0.3eb:2 0.3ed:2 0.3ee:2 0.3ef:2 0.3f3:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2) currently started
- 2017-07-11 13:25:08.418231 I | rook-ceph-mon1: 2017-07-11 13:25:01.102920 osd.3 osd.3 10.233.86.0:6800/178 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.754338 secs
- 2017-07-11 13:25:08.418347 I | rook-ceph-mon1: 2017-07-11 13:25:01.102935 osd.3 osd.3 10.233.86.0:6800/178 2 : cluster [WRN] slow request 30.754338 seconds old, received at 2017-07-11 13:24:30.348500: osd_pg_create(e10 0.7:2 0.a:2 0.12:2 0.13:2 0.15:2 0.18:2 0.1b:2 0.1f:2 0.22:2 0.23:2 0.24:2 0.2c:2 0.30:2 0.33:2 0.34:2 0.3d:2 0.3e:2 0.42:2 0.45:2 0.4a:2 0.4c:2 0.50:2 0.51:2 0.54:2 0.57:2 0.58:2 0.59:2 0.66:2 0.67:2 0.68:2 0.6a:2 0.6b:2 0.6c:2 0.6f:2 0.71:2 0.7c:2 0.82:2 0.85:2 0.89:2 0.90:2 0.95:2 0.9e:2 0.9f:2 0.a3:2 0.aa:2 0.af:2 0.b3:2 0.b7:2 0.ba:2 0.bd:2 0.c0:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e0:2 0.e2:2 0.e5:2 0.e9:2 0.ea:2 0.ed:2 0.ef:2 0.f7:2 0.fc:2 0.fd:2 0.fe:2 0.ff:2 0.106:2 0.107:2 0.108:2 0.10a:2 0.10c:2 0.10d:2 0.10e:2 0.10f:2 0.110:2 0.11a:2 0.123:2 0.127:2 0.128:2 0.130:2 0.132:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.143:2 0.152:2 0.153:2 0.156:2 0.15c:2 0.15f:2 0.162:2 0.163:2 0.16f:2 0.173:2 0.176:2 0.177:2 0.17e:2 0.181:2 0.187:2 0.188:2 0.18b:2 0.18c:2 0.191:2 0.192:2 0.194:2 0.195:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b0:2 0.1b1:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c2:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1dc:2 0.1de:2 0.1df:2 0.1e2:2 0.1e3:2 0.1ec:2 0.1f3:2 0.1fb:2 0.1fe:2 0.201:2 0.204:2 0.205:2 0.20a:2 0.213:2 0.21c:2 0.21e:2 0.221:2 0.224:2 0.229:2 0.232:2 0.235:2 0.237:2 0.238:2 0.23a:2 0.23f:2 0.242:2 0.245:2 0.24b:2 0.250:2 0.256:2 0.257:2 0.25e:2 0.264:2 0.267:2 0.268:2 0.26a:2 0.278:2 0.27e:2 0.280:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.29e:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ae:2 0.2b0:2 0.2c1:2 0.2c8:2 0.2cb:2 0.2d5:2 0.2d6:2 0.2da:2 0.2db:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ea:2 0.2ec:2 0.2ef:2 0.2f0:2 0.2f2:2 0.2f4:2 0.2f9:2 0.2fb:2 0.305:2 0.306:2 0.308:2 0.309:2 0.30a:2 0.30c:2 0.310:2 0.314:2 0.319:2 0.31d:2 0.322:2 0.327:2 0.329:2 0.331:2 0.334:2 0.335:2 0.337:2 0.33e:2 0.340:2 0.344:2 0.348:2 0.349:2 0.34a:2 0.34c:2 0.350:2 0.354:2 0.355:2 0.357:2 0.359:2 0.35a:2 0.35e:2 0.365:2 0.367:2 0.369:2 0.36a:2 0.36e:2 0.37d:2 0.382:2 0.389:2 0.38c:2 0.38f:2 0.390:2 0.394:2 0.398:2 0.399:2 0.39a:2 0.3a0:2 0.3a7:2 0.3af:2 0.3b0:2 0.3b7:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c5:2 0.3c6:2 0.3cf:2 0.3d2:2 0.3d4:2 0.3d5:2 0.3db:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3e5:2 0.3e7:2 0.3f0:2 0.3f6:2 0.3f9:2) currently started
- 2017-07-11 13:25:11.555914 I | rook-ceph-mon1: 2017-07-11 13:25:02.581395 osd.2 osd.2 10.233.69.0:6800/178 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.293208 secs
- 2017-07-11 13:25:11.556912 I | rook-ceph-mon1: 2017-07-11 13:25:02.581413 osd.2 osd.2 10.233.69.0:6800/178 2 : cluster [WRN] slow request 30.293208 seconds old, received at 2017-07-11 13:24:32.288034: osd_pg_create(e12 0.5:2 0.7:2 0.9:2 0.12:2 0.13:2 0.14:2 0.15:2 0.16:2 0.17:2 0.1b:2 0.21:2 0.27:2 0.29:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.39:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5b:2 0.5f:2 0.60:2 0.63:2 0.6e:2 0.72:2 0.7a:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.95:2 0.98:2 0.9a:2 0.9d:2 0.9e:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.b8:2 0.ba:2 0.c0:2 0.c2:2 0.c5:2 0.cb:2 0.ce:2 0.d2:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.fe:2 0.100:2 0.106:2 0.107:2 0.10c:2 0.10d:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.127:2 0.128:2 0.12c:2 0.12f:2 0.131:2 0.133:2 0.134:2 0.141:2 0.142:2 0.14b:2 0.14d:2 0.159:2 0.15a:2 0.15c:2 0.160:2 0.161:2 0.166:2 0.169:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.17f:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1db:2 0.1e1:2 0.1e4:2 0.1e9:2 0.1ee:2 0.1f2:2 0.1f3:2 0.1f6:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.21d:2 0.21f:2 0.223:2 0.224:2 0.228:2 0.229:2 0.22b:2 0.22e:2 0.233:2 0.235:2 0.237:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.251:2 0.252:2 0.253:2 0.254:2 0.25c:2 0.265:2 0.267:2 0.269:2 0.26b:2 0.26c:2 0.26d:2 0.276:2 0.278:2 0.279:2 0.27b:2 0.27f:2 0.280:2 0.284:2 0.286:2 0.288:2 0.290:2 0.298:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b3:2 0.2b8:2 0.2b9:2 0.2bf:2 0.2c8:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2df:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ea:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30b:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32d:2 0.32f:2 0.330:2 0.334:2 0.336:2 0.33a:2 0.344:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.359:2 0.363:2 0.364:2 0.366:2 0.369:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b0:2 0.3b2:2 0.3b3:2 0.3b5:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3ed:2 0.3f4:2) currently started
- 2017-07-11 13:25:12.605265 I | rook-ceph-mon1: 2017-07-11 13:25:04.442289 osd.4 osd.4 10.233.124.4:6800/178 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.644850 secs
- 2017-07-11 13:25:12.605953 I | rook-ceph-mon1: 2017-07-11 13:25:04.442463 osd.4 osd.4 10.233.124.4:6800/178 2 : cluster [WRN] slow request 30.644850 seconds old, received at 2017-07-11 13:24:33.797300: osd_pg_create(e14 0.0:2 0.14:2 0.17:2 0.23:2 0.29:2 0.2d:2 0.37:2 0.39:2 0.3d:2 0.40:2 0.41:2 0.42:2 0.45:2 0.46:2 0.48:2 0.4a:2 0.55:2 0.5a:2 0.5c:2 0.62:2 0.65:2 0.66:2 0.68:2 0.6d:2 0.78:2 0.83:2 0.88:2 0.95:2 0.9c:2 0.a1:2 0.b0:2 0.b5:2 0.b8:2 0.bc:2 0.bd:2 0.c0:2 0.c1:2 0.c8:2 0.cb:2 0.e6:2 0.e7:2 0.f0:2 0.fe:2 0.100:2 0.101:2 0.10a:2 0.10d:2 0.10f:2 0.114:2 0.128:2 0.12a:2 0.12f:2 0.134:2 0.138:2 0.143:2 0.148:2 0.149:2 0.14c:2 0.14f:2 0.160:2 0.162:2 0.163:2 0.164:2 0.169:2 0.16b:2 0.17f:2 0.182:2 0.185:2 0.18f:2 0.190:2 0.19b:2 0.1a5:2 0.1b6:2 0.1bc:2 0.1c7:2 0.1d8:2 0.1d9:2 0.1db:2 0.1dd:2 0.1e4:2 0.1ee:2 0.1f0:2 0.1f6:2 0.1f7:2 0.204:2 0.208:2 0.210:2 0.217:2 0.219:2 0.21d:2 0.226:2 0.229:2 0.22a:2 0.22b:2 0.230:2 0.235:2 0.237:2 0.23a:2 0.23b:2 0.241:2 0.243:2 0.24d:2 0.25b:2 0.25e:2 0.261:2 0.265:2 0.267:2 0.26c:2 0.27b:2 0.27d:2 0.27f:2 0.283:2 0.284:2 0.288:2 0.28e:2 0.29e:2 0.2a6:2 0.2ae:2 0.2b1:2 0.2b4:2 0.2b6:2 0.2bb:2 0.2bf:2 0.2c0:2 0.2c3:2 0.2c5:2 0.2c6:2 0.2cd:2 0.2cf:2 0.2d5:2 0.2d8:2 0.2df:2 0.2e0:2 0.2e9:2 0.2ea:2 0.2f9:2 0.303:2 0.309:2 0.30a:2 0.30b:2 0.30d:2 0.312:2 0.325:2 0.32b:2 0.32c:2 0.32d:2 0.333:2 0.334:2 0.335:2 0.339:2 0.33a:2 0.342:2 0.359:2 0.362:2 0.368:2 0.36f:2 0.37a:2 0.384:2 0.38f:2 0.3a2:2 0.3a8:2 0.3a9:2 0.3b1:2 0.3b4:2 0.3b5:2 0.3be:2 0.3c5:2 0.3d1:2 0.3d5:2 0.3da:2 0.3e0:2 0.3e9:2 0.3eb:2 0.3ed:2 0.3ef:2 0.3f6:2 0.3f7:2 0.3f9:2 0.3fc:2) currently started
- 2017-07-11 13:25:16.605410 I | rook-ceph-mon1: 2017-07-11 13:25:08.359890 osd.5 osd.5 10.233.99.6:6800/179 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.964326 secs
- 2017-07-11 13:25:16.605494 I | rook-ceph-mon1: 2017-07-11 13:25:08.359905 osd.5 osd.5 10.233.99.6:6800/179 2 : cluster [WRN] slow request 30.964326 seconds old, received at 2017-07-11 13:24:37.395485: osd_pg_create(e16 0.0:2 0.2:2 0.f:2 0.13:2 0.22:2 0.23:2 0.25:2 0.26:2 0.2a:2 0.39:2 0.41:2 0.4d:2 0.50:2 0.5b:2 0.60:2 0.66:2 0.70:2 0.72:2 0.76:2 0.77:2 0.7e:2 0.7f:2 0.88:2 0.89:2 0.8c:2 0.91:2 0.97:2 0.a1:2 0.a7:2 0.a8:2 0.ac:2 0.b9:2 0.c1:2 0.c3:2 0.c9:2 0.ca:2 0.cd:2 0.d2:2 0.d5:2 0.de:2 0.e1:2 0.e2:2 0.e8:2 0.ec:2 0.ed:2 0.f0:2 0.fc:2 0.103:2 0.10d:2 0.10e:2 0.115:2 0.11b:2 0.125:2 0.127:2 0.129:2 0.131:2 0.133:2 0.134:2 0.135:2 0.138:2 0.13d:2 0.143:2 0.146:2 0.148:2 0.14b:2 0.154:2 0.157:2 0.159:2 0.15a:2 0.16c:2 0.175:2 0.176:2 0.177:2 0.17b:2 0.184:2 0.187:2 0.18d:2 0.190:2 0.191:2 0.195:2 0.198:2 0.19a:2 0.1a0:2 0.1a7:2 0.1a8:2 0.1ab:2 0.1b5:2 0.1b6:2 0.1bf:2 0.1c4:2 0.1d2:2 0.1d7:2 0.1d8:2 0.1e3:2 0.1f0:2 0.1f8:2 0.1fd:2 0.1fe:2 0.202:2 0.203:2 0.20a:2 0.219:2 0.21f:2 0.228:2 0.22a:2 0.239:2 0.23d:2 0.24e:2 0.24f:2 0.251:2 0.267:2 0.26a:2 0.274:2 0.278:2 0.27a:2 0.28b:2 0.28e:2 0.294:2 0.298:2 0.29e:2 0.2a6:2 0.2b3:2 0.2b6:2 0.2ba:2 0.2c6:2 0.2c8:2 0.2ca:2 0.2d5:2 0.2d8:2 0.2dd:2 0.2e0:2 0.2ed:2 0.2f4:2 0.2f8:2 0.2ff:2 0.311:2 0.314:2 0.315:2 0.316:2 0.31f:2 0.322:2 0.326:2 0.32a:2 0.335:2 0.33c:2 0.343:2 0.34b:2 0.35a:2 0.35e:2 0.363:2 0.369:2 0.36f:2 0.37f:2 0.384:2 0.386:2 0.39a:2 0.39c:2 0.3a7:2 0.3ac:2 0.3ae:2 0.3b0:2 0.3ba:2 0.3d2:2 0.3d6:2 0.3dd:2 0.3e3:2 0.3ea:2 0.3f1:2 0.3f5:2 0.3fc:2 0.3fe:2) currently started
- 2017-07-11 13:25:20.271339 I | rook-ceph-mon1: 2017-07-11 13:25:20.271310 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:25:20.271517 I | rook-ceph-mon1: 2017-07-11 13:25:20.271439 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2773922011' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:25:21.042418 I | rook-ceph-mon1: 2017-07-11 13:25:21.042394 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:21.042628 I | rook-ceph-mon1: 2017-07-11 13:25:21.042613 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:21.043032 I | rook-ceph-mon1: 2017-07-11 13:25:21.043016 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:21.043266 I | rook-ceph-mon1: 2017-07-11 13:25:21.043252 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:21.043810 I | rook-ceph-mon1: 2017-07-11 13:25:21.043789 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:21.044012 I | rook-ceph-mon1: 2017-07-11 13:25:21.043867 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:21.044467 I | rook-ceph-mon1: 2017-07-11 13:25:21.044451 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:21.044624 I | rook-ceph-mon1: 2017-07-11 13:25:21.044609 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:21.045023 I | rook-ceph-mon1: 2017-07-11 13:25:21.045007 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:21.062751 I | rook-ceph-mon1: 2017-07-11 13:25:21.045189 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:21.062788 I | rook-ceph-mon1: 2017-07-11 13:25:21.061788 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:21.062802 I | rook-ceph-mon1: 2017-07-11 13:25:21.061810 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:21.806414 I | rook-ceph-mon1: 2017-07-11 13:25:20.610722 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 118 : cluster [INF] osd.0 failed (root=default,host=master-1) (5 reporters from different host after 22.086509 >= grace 20.000000)
- 2017-07-11 13:25:21.806511 I | rook-ceph-mon1: 2017-07-11 13:25:20.610763 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 119 : cluster [INF] osd.2 failed (root=default,host=master-0) (2 reporters from different host after 22.085972 >= grace 20.000000)
- 2017-07-11 13:25:21.806563 I | rook-ceph-mon1: 2017-07-11 13:25:20.610783 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 120 : cluster [INF] osd.3 failed (root=default,host=master-2) (3 reporters from different host after 22.085702 >= grace 20.000000)
- 2017-07-11 13:25:21.806583 I | rook-ceph-mon1: 2017-07-11 13:25:20.942180 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 121 : cluster [INF] osdmap e18: 6 total, 3 up, 6 in
- 2017-07-11 13:25:23.490700 I | rook-ceph-mon1: 2017-07-11 13:25:22.186747 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 123 : cluster [INF] osd.4 failed (root=default,host=minion-2) (connection refused reported by osd.5)
- 2017-07-11 13:25:23.863987 I | rook-ceph-mon1: 2017-07-11 13:25:23.863957 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:23.870047 I | rook-ceph-mon1: 2017-07-11 13:25:23.870028 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:23.870517 I | rook-ceph-mon1: 2017-07-11 13:25:23.870500 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:23.870566 I | rook-ceph-mon1: 2017-07-11 13:25:23.870553 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:23.870947 I | rook-ceph-mon1: 2017-07-11 13:25:23.870930 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:23.870985 I | rook-ceph-mon1: 2017-07-11 13:25:23.870973 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:23.871437 I | rook-ceph-mon1: 2017-07-11 13:25:23.871421 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:23.871478 I | rook-ceph-mon1: 2017-07-11 13:25:23.871465 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:23.871852 I | rook-ceph-mon1: 2017-07-11 13:25:23.871836 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:23.871891 I | rook-ceph-mon1: 2017-07-11 13:25:23.871879 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:23.872191 I | rook-ceph-mon1: 2017-07-11 13:25:23.872176 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:23.872233 I | rook-ceph-mon1: 2017-07-11 13:25:23.872221 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:24.970018 I | rook-ceph-mon1: 2017-07-11 13:25:23.792859 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 129 : cluster [INF] osdmap e19: 6 total, 2 up, 6 in
- 2017-07-11 13:25:26.401366 I | rook-ceph-mon1: 2017-07-11 13:25:24.354685 osd.5 osd.5 10.233.99.6:6800/179 3 : cluster [ERR] map e17 had wrong cluster addr (10.233.99.6:6801/179 != my 10.233.99.0:6801/179)
- 2017-07-11 13:25:32.316905 I | rook-ceph-mon1: 2017-07-11 13:25:21.991262 osd.4 osd.4 10.233.124.4:6800/178 3 : cluster [ERR] map e16 had wrong cluster addr (10.233.124.4:6801/178 != my 10.233.124.0:6801/178)
- 2017-07-11 13:25:32.316976 I | rook-ceph-mon1: 2017-07-11 13:25:22.446168 osd.4 osd.4 10.233.124.4:6800/178 4 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 45.667737 secs
- 2017-07-11 13:25:32.316993 I | rook-ceph-mon1: 2017-07-11 13:25:22.446172 osd.4 osd.4 10.233.124.4:6800/178 5 : cluster [WRN] slow request 45.667737 seconds old, received at 2017-07-11 13:24:36.778345: osd_pg_create(e15 0.10:2 0.13:2 0.1d:2 0.24:2 0.4d:2 0.5b:2 0.6c:2 0.77:2 0.7e:2 0.90:2 0.9e:2 0.ac:2 0.b7:2 0.cd:2 0.ce:2 0.d1:2 0.ed:2 0.f2:2 0.116:2 0.11b:2 0.129:2 0.12e:2 0.133:2 0.13d:2 0.13e:2 0.142:2 0.146:2 0.15e:2 0.176:2 0.187:2 0.1c4:2 0.1dc:2 0.1e8:2 0.203:2 0.23e:2 0.251:2 0.254:2 0.274:2 0.28b:2 0.2b0:2 0.2b3:2 0.2c8:2 0.2f4:2 0.311:2 0.326:2 0.33f:2 0.343:2 0.344:2 0.35e:2 0.36c:2 0.379:2 0.395:2 0.39c:2 0.3a7:2 0.3b0:2 0.3c3:2 0.3e3:2) currently wait for new map
- 2017-07-11 13:25:32.317027 I | rook-ceph-mon1: 2017-07-11 13:25:22.446234 osd.4 osd.4 10.233.124.4:6800/178 6 : cluster [WRN] slow request 40.751310 seconds old, received at 2017-07-11 13:24:41.694773: osd_pg_create(e17 0.10:2 0.14:2 0.17:2 0.1d:2 0.24:2 0.29:2 0.2d:2 0.37:2 0.3d:2 0.40:2 0.42:2 0.45:2 0.46:2 0.48:2 0.4a:2 0.55:2 0.5a:2 0.5c:2 0.62:2 0.65:2 0.68:2 0.6c:2 0.6d:2 0.78:2 0.83:2 0.90:2 0.95:2 0.9c:2 0.9e:2 0.b0:2 0.b5:2 0.b7:2 0.b8:2 0.bc:2 0.bd:2 0.c0:2 0.c8:2 0.cb:2 0.ce:2 0.d1:2 0.e6:2 0.e7:2 0.f2:2 0.fe:2 0.100:2 0.101:2 0.10a:2 0.10f:2 0.114:2 0.116:2 0.128:2 0.12a:2 0.12e:2 0.12f:2 0.13e:2 0.142:2 0.149:2 0.14c:2 0.14f:2 0.15e:2 0.160:2 0.162:2 0.163:2 0.164:2 0.169:2 0.16b:2 0.17f:2 0.182:2 0.185:2 0.18f:2 0.19b:2 0.1a5:2 0.1bc:2 0.1c7:2 0.1d9:2 0.1db:2 0.1dc:2 0.1dd:2 0.1e4:2 0.1e8:2 0.1ee:2 0.1f6:2 0.1f7:2 0.204:2 0.208:2 0.210:2 0.217:2 0.21d:2 0.226:2 0.229:2 0.22b:2 0.230:2 0.235:2 0.237:2 0.23a:2 0.23b:2 0.23e:2 0.241:2 0.243:2 0.24d:2 0.254:2 0.25b:2 0.25e:2 0.261:2 0.265:2 0.26c:2 0.27b:2 0.27d:2 0.27f:2 0.283:2 0.284:2 0.288:2 0.2ae:2 0.2b0:2 0.2b1:2 0.2b4:2 0.2bb:2 0.2bf:2 0.2c0:2 0.2c3:2 0.2c5:2 0.2cd:2 0.2cf:2 0.2df:2 0.2e9:2 0.2ea:2 0.2f9:2 0.303:2 0.309:2 0.30a:2 0.30b:2 0.30d:2 0.312:2 0.325:2 0.32b:2 0.32c:2 0.32d:2 0.333:2 0.334:2 0.339:2 0.33a:2 0.33f:2 0.342:2 0.344:2 0.359:2 0.362:2 0.368:2 0.36c:2 0.379:2 0.37a:2 0.38f:2 0.395:2 0.3a2:2 0.3a8:2 0.3a9:2 0.3b1:2 0.3b4:2 0.3b5:2 0.3be:2 0.3c3:2 0.3c5:2 0.3d1:2 0.3d5:2 0.3da:2 0.3e0:2 0.3e9:2 0.3eb:2 0.3ed:2 0.3ef:2 0.3f6:2 0.3f7:2 0.3f9:2) currently wait for new map
- 2017-07-11 13:25:36.245037 I | rook-ceph-mon1: 2017-07-11 13:25:29.820925 osd.0 osd.0 10.233.72.0:6800/180 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.831826 secs
- 2017-07-11 13:25:36.245879 I | rook-ceph-mon1: 2017-07-11 13:25:29.820936 osd.0 osd.0 10.233.72.0:6800/180 4 : cluster [WRN] slow request 60.831826 seconds old, received at 2017-07-11 13:24:28.989049: osd_pg_create(e9 0.6:2 0.7:2 0.9:2 0.b:2 0.10:2 0.14:2 0.18:2 0.19:2 0.27:2 0.28:2 0.29:2 0.2c:2 0.31:2 0.3b:2 0.3d:2 0.42:2 0.44:2 0.46:2 0.49:2 0.50:2 0.53:2 0.55:2 0.59:2 0.5b:2 0.5d:2 0.5e:2 0.61:2 0.63:2 0.64:2 0.65:2 0.66:2 0.69:2 0.6b:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.82:2 0.83:2 0.90:2 0.9d:2 0.9f:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.a7:2 0.a8:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.ba:2 0.bb:2 0.bd:2 0.bf:2 0.c6:2 0.cd:2 0.d0:2 0.d3:2 0.d4:2 0.d6:2 0.d7:2 0.da:2 0.dd:2 0.e1:2 0.e3:2 0.e4:2 0.e5:2 0.e7:2 0.e8:2 0.e9:2 0.ed:2 0.ee:2 0.f4:2 0.f8:2 0.fc:2 0.fd:2 0.10c:2 0.10e:2 0.110:2 0.116:2 0.117:2 0.118:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.128:2 0.12a:2 0.12c:2 0.12f:2 0.132:2 0.135:2 0.140:2 0.141:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.160:2 0.163:2 0.166:2 0.16a:2 0.170:2 0.179:2 0.17b:2 0.17c:2 0.17e:2 0.17f:2 0.180:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.192:2 0.194:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b0:2 0.1b1:2 0.1b4:2 0.1b7:2 0.1b8:2 0.1b9:2 0.1ba:2 0.1be:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1ce:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1de:2 0.1e1:2 0.1e2:2 0.1e4:2 0.1e6:2 0.1eb:2 0.1ed:2 0.1f5:2 0.1f7:2 0.1f8:2 0.1fe:2 0.200:2 0.204:2 0.206:2 0.207:2 0.20a:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.214:2 0.216:2 0.21c:2 0.21e:2 0.227:2 0.228:2 0.22a:2 0.22b:2 0.22c:2 0.22d:2 0.231:2 0.23c:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.250:2 0.252:2 0.255:2 0.25b:2 0.25e:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26d:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.277:2 0.279:2 0.27f:2 0.282:2 0.286:2 0.28c:2 0.28f:2 0.292:2 0.294:2 0.295:2 0.296:2 0.298:2 0.299:2 0.29d:2 0.2a1:2 0.2a4:2 0.2ab:2 0.2ae:2 0.2b2:2 0.2b3:2 0.2b4:2 0.2b5:2 0.2bb:2 0.2bc:2 0.2be:2 0.2c1:2 0.2c4:2 0.2c5:2 0.2cb:2 0.2cd:2 0.2ce:2 0.2d2:2 0.2d3:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e7:2 0.2ee:2 0.2ef:2 0.2f0:2 0.2f6:2 0.2fa:2 0.2fb:2 0.304:2 0.306:2 0.309:2 0.30c:2 0.310:2 0.312:2 0.316:2 0.317:2 0.31a:2 0.31d:2 0.31e:2 0.31f:2 0.323:2 0.324:2 0.328:2 0.32b:2 0.32d:2 0.331:2 0.332:2 0.338:2 0.33b:2 0.33e:2 0.340:2 0.343:2 0.346:2 0.349:2 0.34d:2 0.351:2 0.352:2 0.355:2 0.356:2 0.358:2 0.35c:2 0.362:2 0.363:2 0.36b:2 0.372:2 0.373:2 0.374:2 0.377:2 0.378:2 0.37b:2 0.381:2 0.382:2 0.385:2 0.386:2 0.389:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.396:2 0.399:2 0.3a5:2 0.3a6:2 0.3a7:2 0.3a9:2 0.3ac:2 0.3af:2 0.3b6:2 0.3b7:2 0.3b8:2 0.3b9:2 0.3bc:2 0.3bd:2 0.3be:2 0.3c0:2 0.3c2:2 0.3c7:2 0.3ce:2 0.3cf:2 0.3d4:2 0.3d7:2 0.3d8:2 0.3de:2 0.3e6:2 0.3eb:2 0.3ed:2 0.3ee:2 0.3ef:2 0.3f3:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2) currently started
- 2017-07-11 13:25:36.254548 I | rook-ceph-mon1: 2017-07-11 13:25:32.821643 osd.0 osd.0 10.233.72.0:6800/180 5 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 62.492130 secs
- 2017-07-11 13:25:36.254706 I | rook-ceph-mon1: 2017-07-11 13:25:32.821648 osd.0 osd.0 10.233.72.0:6800/180 6 : cluster [WRN] slow request 62.492130 seconds old, received at 2017-07-11 13:24:30.329295: osd_pg_create(e10 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.254748 I | rook-ceph-mon1: 2017-07-11 13:25:32.821663 osd.0 osd.0 10.233.72.0:6800/180 7 : cluster [WRN] slow request 61.883204 seconds old, received at 2017-07-11 13:24:30.938221: osd_pg_create(e11 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.254776 I | rook-ceph-mon1: 2017-07-11 13:25:32.821665 osd.0 osd.0 10.233.72.0:6800/180 8 : cluster [WRN] slow request 60.602348 seconds old, received at 2017-07-11 13:24:32.219078: osd_pg_create(e12 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.254791 I | rook-ceph-mon1: 2017-07-11 13:25:32.821668 osd.0 osd.0 10.233.72.0:6800/180 9 : cluster [WRN] slow request 60.120760 seconds old, received at 2017-07-11 13:24:32.700666: osd_pg_create(e13 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.254826 I | rook-ceph-mon1: 2017-07-11 13:25:32.821670 osd.0 osd.0 10.233.72.0:6800/180 10 : cluster [WRN] slow request 59.026349 seconds old, received at 2017-07-11 13:24:33.795077: osd_pg_create(e14 0.6:2 0.b:2 0.f:2 0.26:2 0.28:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f4:2 0.f8:2 0.112:2 0.117:2 0.119:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.154:2 0.16a:2 0.170:2 0.179:2 0.183:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f8:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24e:2 0.25f:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e5:2 0.2ee:2 0.2f3:2 0.2fa:2 0.304:2 0.316:2 0.317:2 0.31e:2 0.31f:2 0.320:2 0.324:2 0.328:2 0.332:2 0.343:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3e6:2 0.3f3:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.254840 I | rook-ceph-mon1: 2017-07-11 13:25:33.077046 osd.0 osd.0 10.233.72.0:6800/180 11 : cluster [WRN] map e19 wrongly marked me down at e18
- 2017-07-11 13:25:36.254851 I | rook-ceph-mon1: 2017-07-11 13:25:33.821853 osd.0 osd.0 10.233.72.0:6800/180 12 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 63.492492 secs
- 2017-07-11 13:25:36.254868 I | rook-ceph-mon1: 2017-07-11 13:25:33.821865 osd.0 osd.0 10.233.72.0:6800/180 13 : cluster [WRN] slow request 63.492492 seconds old, received at 2017-07-11 13:24:30.329295: osd_pg_create(e10 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.254883 I | rook-ceph-mon1: 2017-07-11 13:25:33.821871 osd.0 osd.0 10.233.72.0:6800/180 14 : cluster [WRN] slow request 62.883566 seconds old, received at 2017-07-11 13:24:30.938221: osd_pg_create(e11 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.254909 I | rook-ceph-mon1: 2017-07-11 13:25:33.821880 osd.0 osd.0 10.233.72.0:6800/180 15 : cluster [WRN] slow request 61.602710 seconds old, received at 2017-07-11 13:24:32.219078: osd_pg_create(e12 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.254936 I | rook-ceph-mon1: 2017-07-11 13:25:33.821885 osd.0 osd.0 10.233.72.0:6800/180 16 : cluster [WRN] slow request 61.121121 seconds old, received at 2017-07-11 13:24:32.700666: osd_pg_create(e13 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.254951 I | rook-ceph-mon1: 2017-07-11 13:25:33.821891 osd.0 osd.0 10.233.72.0:6800/180 17 : cluster [WRN] slow request 60.026710 seconds old, received at 2017-07-11 13:24:33.795077: osd_pg_create(e14 0.6:2 0.b:2 0.f:2 0.26:2 0.28:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f4:2 0.f8:2 0.112:2 0.117:2 0.119:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.154:2 0.16a:2 0.170:2 0.179:2 0.183:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f8:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24e:2 0.25f:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e5:2 0.2ee:2 0.2f3:2 0.2fa:2 0.304:2 0.316:2 0.317:2 0.31e:2 0.31f:2 0.320:2 0.324:2 0.328:2 0.332:2 0.343:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3e6:2 0.3f3:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.254975 I | rook-ceph-mon1: 2017-07-11 13:25:34.822145 osd.0 osd.0 10.233.72.0:6800/180 18 : cluster [WRN] 8 slow requests, 3 included below; oldest blocked for > 64.492734 secs
- 2017-07-11 13:25:36.254991 I | rook-ceph-mon1: 2017-07-11 13:25:34.822151 osd.0 osd.0 10.233.72.0:6800/180 19 : cluster [WRN] slow request 58.219143 seconds old, received at 2017-07-11 13:24:36.602887: osd_pg_create(e15 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.7f:2 0.8b:2 0.a1:2 0.a2:2 0.a6:2 0.a7:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.125:2 0.135:2 0.147:2 0.150:2 0.151:2 0.15a:2 0.16a:2 0.170:2 0.171:2 0.175:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.190:2 0.196:2 0.19c:2 0.1a0:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.21f:2 0.227:2 0.228:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.239:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.32a:2 0.332:2 0.338:2 0.346:2 0.34b:2 0.34d:2 0.35a:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39a:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:36.255004 I | rook-ceph-mon1: 2017-07-11 13:25:34.822159 osd.0 osd.0 10.233.72.0:6800/180 20 : cluster [WRN] slow request 57.546311 seconds old, received at 2017-07-11 13:24:37.275719: osd_pg_create(e16 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:36.255020 I | rook-ceph-mon1: 2017-07-11 13:25:34.822164 osd.0 osd.0 10.233.72.0:6800/180 21 : cluster [WRN] slow request 53.261450 seconds old, received at 2017-07-11 13:24:41.560579: osd_pg_create(e17 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:37.541781 I | rook-ceph-mon1: 2017-07-11 13:25:29.147192 osd.1 osd.1 10.233.76.4:6800/178 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.092556 secs
- 2017-07-11 13:25:37.542009 I | rook-ceph-mon1: 2017-07-11 13:25:29.147198 osd.1 osd.1 10.233.76.4:6800/178 4 : cluster [WRN] slow request 60.092556 seconds old, received at 2017-07-11 13:24:29.054610: osd_pg_create(e9 0.1:2 0.4:2 0.8:2 0.c:2 0.11:2 0.12:2 0.13:2 0.16:2 0.1a:2 0.1b:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.2b:2 0.33:2 0.34:2 0.36:2 0.37:2 0.38:2 0.39:2 0.3c:2 0.40:2 0.41:2 0.43:2 0.4b:2 0.4d:2 0.4e:2 0.52:2 0.57:2 0.5a:2 0.5f:2 0.62:2 0.67:2 0.6d:2 0.74:2 0.75:2 0.80:2 0.81:2 0.84:2 0.86:2 0.87:2 0.8c:2 0.8d:2 0.8f:2 0.92:2 0.93:2 0.96:2 0.99:2 0.9a:2 0.9b:2 0.9c:2 0.a4:2 0.a9:2 0.aa:2 0.ae:2 0.af:2 0.b1:2 0.b2:2 0.b7:2 0.b9:2 0.be:2 0.c1:2 0.c7:2 0.c9:2 0.cf:2 0.db:2 0.df:2 0.e6:2 0.f0:2 0.f1:2 0.f2:2 0.f3:2 0.f5:2 0.f6:2 0.fa:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.106:2 0.109:2 0.10b:2 0.10d:2 0.113:2 0.114:2 0.115:2 0.11a:2 0.121:2 0.124:2 0.125:2 0.12b:2 0.130:2 0.136:2 0.137:2 0.139:2 0.13a:2 0.13b:2 0.13c:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14b:2 0.14d:2 0.155:2 0.156:2 0.158:2 0.159:2 0.15b:2 0.15d:2 0.161:2 0.164:2 0.165:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.178:2 0.17d:2 0.184:2 0.187:2 0.18c:2 0.18e:2 0.18f:2 0.190:2 0.191:2 0.193:2 0.197:2 0.199:2 0.19a:2 0.19b:2 0.19d:2 0.1a1:2 0.1a2:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b2:2 0.1b3:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1c9:2 0.1d1:2 0.1d3:2 0.1d9:2 0.1da:2 0.1dd:2 0.1e0:2 0.1e3:2 0.1e5:2 0.1e7:2 0.1e8:2 0.1ea:2 0.1ee:2 0.1f1:2 0.1f2:2 0.1f3:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fb:2 0.1fc:2 0.1fd:2 0.1ff:2 0.202:2 0.208:2 0.209:2 0.20c:2 0.210:2 0.213:2 0.215:2 0.219:2 0.21b:2 0.220:2 0.221:2 0.225:2 0.229:2 0.22e:2 0.230:2 0.233:2 0.234:2 0.236:2 0.238:2 0.240:2 0.241:2 0.244:2 0.245:2 0.24b:2 0.24f:2 0.256:2 0.257:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.268:2 0.26c:2 0.26f:2 0.274:2 0.275:2 0.278:2 0.27b:2 0.27c:2 0.27d:2 0.27e:2 0.281:2 0.284:2 0.287:2 0.288:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.293:2 0.29b:2 0.29c:2 0.29f:2 0.2a2:2 0.2a3:2 0.2a5:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ad:2 0.2b0:2 0.2b6:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2bd:2 0.2c0:2 0.2c3:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2cf:2 0.2d4:2 0.2d6:2 0.2d8:2 0.2da:2 0.2dc:2 0.2e6:2 0.2e8:2 0.2f2:2 0.2f4:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2fd:2 0.2ff:2 0.301:2 0.302:2 0.303:2 0.305:2 0.307:2 0.30b:2 0.30d:2 0.30f:2 0.311:2 0.314:2 0.315:2 0.318:2 0.319:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.336:2 0.339:2 0.33a:2 0.33d:2 0.347:2 0.348:2 0.34a:2 0.34e:2 0.34f:2 0.350:2 0.353:2 0.357:2 0.35b:2 0.35d:2 0.35e:2 0.35f:2 0.361:2 0.366:2 0.368:2 0.369:2 0.36f:2 0.370:2 0.371:2 0.375:2 0.376:2 0.37c:2 0.37e:2 0.380:2 0.384:2 0.387:2 0.38a:2 0.38e:2 0.390:2 0.392:2 0.395:2 0.39a:2 0.39b:2 0.39c:2 0.39d:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b3:2 0.3b4:2 0.3b5:2 0.3ba:2 0.3c1:2 0.3c3:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cc:2 0.3cd:2 0.3d1:2 0.3d2:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3da:2 0.3db:2 0.3dc:2 0.3dd:2 0.3df:2 0.3e0:2 0.3e2:2 0.3e3:2 0.3e5:2 0.3e7:2 0.3ea:2 0.3ec:2 0.3f0:2 0.3f1:2 0.3f4:2 0.3f8:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:37.542173 I | rook-ceph-mon1: 2017-07-11 13:25:33.108430 osd.3 osd.3 10.233.86.0:6800/178 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 56.563008 secs
- 2017-07-11 13:25:37.542207 I | rook-ceph-mon1: 2017-07-11 13:25:33.108435 osd.3 osd.3 10.233.86.0:6800/178 4 : cluster [WRN] slow request 56.563008 seconds old, received at 2017-07-11 13:24:36.545354: osd_pg_create(e15 0.a:2 0.d:2 0.18:2 0.1f:2 0.23:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.72:2 0.7c:2 0.88:2 0.89:2 0.8d:2 0.91:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.b9:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e2:2 0.e9:2 0.ea:2 0.ef:2 0.fc:2 0.ff:2 0.108:2 0.10e:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.127:2 0.12d:2 0.130:2 0.131:2 0.132:2 0.136:2 0.138:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.154:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.184:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.195:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1d7:2 0.1de:2 0.1df:2 0.1e2:2 0.1e3:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1f8:2 0.1fb:2 0.202:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.24e:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.278:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.298:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2ed:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.2ff:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.314:2 0.316:2 0.319:2 0.31d:2 0.31f:2 0.329:2 0.331:2 0.335:2 0.337:2 0.33b:2 0.33c:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.369:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3ba:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3d2:2 0.3d6:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2 0.3f1:2) currently started
- 2017-07-11 13:25:40.234830 I | rook-ceph-mon1: 2017-07-11 13:25:32.591136 osd.2 osd.2 10.233.69.0:6800/178 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.303083 secs
- 2017-07-11 13:25:40.235872 I | rook-ceph-mon1: 2017-07-11 13:25:32.591150 osd.2 osd.2 10.233.69.0:6800/178 4 : cluster [WRN] slow request 60.303083 seconds old, received at 2017-07-11 13:24:32.288034: osd_pg_create(e12 0.5:2 0.7:2 0.9:2 0.12:2 0.13:2 0.14:2 0.15:2 0.16:2 0.17:2 0.1b:2 0.21:2 0.27:2 0.29:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.39:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5b:2 0.5f:2 0.60:2 0.63:2 0.6e:2 0.72:2 0.7a:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.95:2 0.98:2 0.9a:2 0.9d:2 0.9e:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.b8:2 0.ba:2 0.c0:2 0.c2:2 0.c5:2 0.cb:2 0.ce:2 0.d2:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.fe:2 0.100:2 0.106:2 0.107:2 0.10c:2 0.10d:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.127:2 0.128:2 0.12c:2 0.12f:2 0.131:2 0.133:2 0.134:2 0.141:2 0.142:2 0.14b:2 0.14d:2 0.159:2 0.15a:2 0.15c:2 0.160:2 0.161:2 0.166:2 0.169:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.17f:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1db:2 0.1e1:2 0.1e4:2 0.1e9:2 0.1ee:2 0.1f2:2 0.1f3:2 0.1f6:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.21d:2 0.21f:2 0.223:2 0.224:2 0.228:2 0.229:2 0.22b:2 0.22e:2 0.233:2 0.235:2 0.237:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.251:2 0.252:2 0.253:2 0.254:2 0.25c:2 0.265:2 0.267:2 0.269:2 0.26b:2 0.26c:2 0.26d:2 0.276:2 0.278:2 0.279:2 0.27b:2 0.27f:2 0.280:2 0.284:2 0.286:2 0.288:2 0.290:2 0.298:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b3:2 0.2b8:2 0.2b9:2 0.2bf:2 0.2c8:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2df:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ea:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30b:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32d:2 0.32f:2 0.330:2 0.334:2 0.336:2 0.33a:2 0.344:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.359:2 0.363:2 0.364:2 0.366:2 0.369:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b0:2 0.3b2:2 0.3b3:2 0.3b5:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3ed:2 0.3f4:2) currently started
- 2017-07-11 13:25:40.235919 I | rook-ceph-mon1: 2017-07-11 13:25:38.595704 osd.2 osd.2 10.233.69.0:6800/178 5 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 65.997406 secs
- 2017-07-11 13:25:40.235954 I | rook-ceph-mon1: 2017-07-11 13:25:38.595710 osd.2 osd.2 10.233.69.0:6800/178 6 : cluster [WRN] slow request 65.997406 seconds old, received at 2017-07-11 13:24:32.598200: osd_pg_create(e13 0.5:2 0.7:2 0.9:2 0.12:2 0.13:2 0.14:2 0.15:2 0.16:2 0.17:2 0.1b:2 0.21:2 0.27:2 0.29:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.39:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5b:2 0.5f:2 0.60:2 0.63:2 0.6e:2 0.72:2 0.7a:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.95:2 0.98:2 0.9a:2 0.9d:2 0.9e:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.b8:2 0.ba:2 0.c0:2 0.c2:2 0.c5:2 0.cb:2 0.ce:2 0.d2:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.fe:2 0.100:2 0.106:2 0.107:2 0.10c:2 0.10d:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.127:2 0.128:2 0.12c:2 0.12f:2 0.131:2 0.133:2 0.134:2 0.141:2 0.142:2 0.14b:2 0.14d:2 0.159:2 0.15a:2 0.15c:2 0.160:2 0.161:2 0.166:2 0.169:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.17f:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1db:2 0.1e1:2 0.1e4:2 0.1e9:2 0.1ee:2 0.1f2:2 0.1f3:2 0.1f6:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.21d:2 0.21f:2 0.223:2 0.224:2 0.228:2 0.229:2 0.22b:2 0.22e:2 0.233:2 0.235:2 0.237:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.251:2 0.252:2 0.253:2 0.254:2 0.25c:2 0.265:2 0.267:2 0.269:2 0.26b:2 0.26c:2 0.26d:2 0.276:2 0.278:2 0.279:2 0.27b:2 0.27f:2 0.280:2 0.284:2 0.286:2 0.288:2 0.290:2 0.298:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b3:2 0.2b8:2 0.2b9:2 0.2bf:2 0.2c8:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2df:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ea:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30b:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32d:2 0.32f:2 0.330:2 0.334:2 0.336:2 0.33a:2 0.344:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.359:2 0.363:2 0.364:2 0.366:2 0.369:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b0:2 0.3b2:2 0.3b3:2 0.3b5:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3ed:2 0.3f4:2) currently wait for new map
- 2017-07-11 13:25:40.235973 I | rook-ceph-mon1: 2017-07-11 13:25:38.595723 osd.2 osd.2 10.233.69.0:6800/178 7 : cluster [WRN] slow request 64.714804 seconds old, received at 2017-07-11 13:24:33.880802: osd_pg_create(e14 0.5:2 0.7:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.72:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.9a:2 0.9d:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.c2:2 0.c5:2 0.d8:2 0.e0:2 0.e5:2 0.eb:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.127:2 0.12c:2 0.131:2 0.133:2 0.141:2 0.14d:2 0.159:2 0.15c:2 0.161:2 0.166:2 0.16f:2 0.17a:2 0.17b:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.198:2 0.199:2 0.1b7:2 0.1c2:2 0.1c9:2 0.1ce:2 0.1d2:2 0.1da:2 0.1e1:2 0.1f2:2 0.1f3:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.213:2 0.218:2 0.21a:2 0.21f:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26b:2 0.26d:2 0.278:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2cb:2 0.2ce:2 0.2d3:2 0.2d7:2 0.2da:2 0.2db:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f6:2 0.2fd:2 0.306:2 0.30e:2 0.31b:2 0.32f:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.356:2 0.363:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2) currently wait for new map
- 2017-07-11 13:25:41.795682 I | rook-ceph-mon1: 2017-07-11 13:25:41.795651 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:41.795842 I | rook-ceph-mon1: 2017-07-11 13:25:41.795771 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:41.796242 I | rook-ceph-mon1: 2017-07-11 13:25:41.796226 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:41.796433 I | rook-ceph-mon1: 2017-07-11 13:25:41.796403 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:41.796812 I | rook-ceph-mon1: 2017-07-11 13:25:41.796796 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:41.796977 I | rook-ceph-mon1: 2017-07-11 13:25:41.796963 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:41.797372 I | rook-ceph-mon1: 2017-07-11 13:25:41.797356 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:41.797532 I | rook-ceph-mon1: 2017-07-11 13:25:41.797518 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:41.797993 I | rook-ceph-mon1: 2017-07-11 13:25:41.797978 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:41.804926 I | rook-ceph-mon1: 2017-07-11 13:25:41.804908 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:41.805450 I | rook-ceph-mon1: 2017-07-11 13:25:41.805343 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:41.805521 I | rook-ceph-mon1: 2017-07-11 13:25:41.805506 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:42.941685 I | rook-ceph-mon1: 2017-07-11 13:25:37.449548 osd.4 osd.4 10.233.124.4:6800/178 7 : cluster [WRN] 2 slow requests, 1 included below; oldest blocked for > 60.671172 secs
- 2017-07-11 13:25:42.941757 I | rook-ceph-mon1: 2017-07-11 13:25:37.449554 osd.4 osd.4 10.233.124.4:6800/178 8 : cluster [WRN] slow request 60.671172 seconds old, received at 2017-07-11 13:24:36.778345: osd_pg_create(e15 0.10:2 0.13:2 0.1d:2 0.24:2 0.4d:2 0.5b:2 0.6c:2 0.77:2 0.7e:2 0.90:2 0.9e:2 0.ac:2 0.b7:2 0.cd:2 0.ce:2 0.d1:2 0.ed:2 0.f2:2 0.116:2 0.11b:2 0.129:2 0.12e:2 0.133:2 0.13d:2 0.13e:2 0.142:2 0.146:2 0.15e:2 0.176:2 0.187:2 0.1c4:2 0.1dc:2 0.1e8:2 0.203:2 0.23e:2 0.251:2 0.254:2 0.274:2 0.28b:2 0.2b0:2 0.2b3:2 0.2c8:2 0.2f4:2 0.311:2 0.326:2 0.33f:2 0.343:2 0.344:2 0.35e:2 0.36c:2 0.379:2 0.395:2 0.39c:2 0.3a7:2 0.3b0:2 0.3c3:2 0.3e3:2) currently wait for new map
- 2017-07-11 13:25:42.941775 I | rook-ceph-mon1: 2017-07-11 13:25:41.691126 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 131 : cluster [INF] osdmap e20: 6 total, 1 up, 6 in
- 2017-07-11 13:25:43.352181 I | rook-ceph-mon1: 2017-07-11 13:25:43.352150 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:43.352770 I | rook-ceph-mon1: 2017-07-11 13:25:43.352752 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:43.353269 I | rook-ceph-mon1: 2017-07-11 13:25:43.353253 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:43.353497 I | rook-ceph-mon1: 2017-07-11 13:25:43.353482 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:43.354022 I | rook-ceph-mon1: 2017-07-11 13:25:43.354005 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:43.354355 I | rook-ceph-mon1: 2017-07-11 13:25:43.354319 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:43.354891 I | rook-ceph-mon1: 2017-07-11 13:25:43.354875 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:43.354954 I | rook-ceph-mon1: 2017-07-11 13:25:43.354941 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:43.355393 I | rook-ceph-mon1: 2017-07-11 13:25:43.355375 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:43.361545 I | rook-ceph-mon1: 2017-07-11 13:25:43.361510 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:43.361894 I | rook-ceph-mon1: 2017-07-11 13:25:43.361878 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:43.361936 I | rook-ceph-mon1: 2017-07-11 13:25:43.361924 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:43.623813 I | rook-ceph-mon1: 2017-07-11 13:25:43.623776 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:43.623994 I | rook-ceph-mon1: 2017-07-11 13:25:43.623980 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:43.624683 I | rook-ceph-mon1: 2017-07-11 13:25:43.624667 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:43.624758 I | rook-ceph-mon1: 2017-07-11 13:25:43.624739 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:43.640861 I | rook-ceph-mon1: 2017-07-11 13:25:43.640832 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:43.641070 I | rook-ceph-mon1: 2017-07-11 13:25:43.641021 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:43.641612 I | rook-ceph-mon1: 2017-07-11 13:25:43.641596 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:43.641697 I | rook-ceph-mon1: 2017-07-11 13:25:43.641681 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:43.642208 I | rook-ceph-mon1: 2017-07-11 13:25:43.642191 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:43.642278 I | rook-ceph-mon1: 2017-07-11 13:25:43.642265 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:43.642738 I | rook-ceph-mon1: 2017-07-11 13:25:43.642710 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:43.642981 I | rook-ceph-mon1: 2017-07-11 13:25:43.642966 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:43.900534 I | rook-ceph-mon1: 2017-07-11 13:25:43.900502 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:25:43.900681 I | rook-ceph-mon1: 2017-07-11 13:25:43.900644 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1357651291' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:25:44.440551 I | rook-ceph-mon1: 2017-07-11 13:25:43.184296 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 133 : cluster [INF] osd.5 10.233.99.6:6800/179 boot
- 2017-07-11 13:25:44.440624 I | rook-ceph-mon1: 2017-07-11 13:25:43.184645 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 134 : cluster [INF] osd.4 10.233.124.4:6800/178 boot
- 2017-07-11 13:25:44.440642 I | rook-ceph-mon1: 2017-07-11 13:25:43.184928 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 135 : cluster [INF] osdmap e21: 6 total, 3 up, 6 in
- 2017-07-11 13:25:44.440654 I | rook-ceph-mon1: 2017-07-11 13:25:43.610372 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 136 : cluster [INF] osdmap e22: 6 total, 3 up, 6 in
- 2017-07-11 13:25:44.690447 I | rook-ceph-mon1: 2017-07-11 13:25:44.690422 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "auth get-key", "entity": "client.admin", "format": "json"} v 0) v1
- 2017-07-11 13:25:44.690536 I | rook-ceph-mon1: 2017-07-11 13:25:44.690521 7f0040b3f700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.5:0/4091151238' entity='client.admin' cmd=[{"prefix": "auth get-key", "entity": "client.admin", "format": "json"}]: dispatch
- 2017-07-11 13:25:44.791425 I | rook-ceph-mon1: 2017-07-11 13:25:44.791377 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:44.791677 I | rook-ceph-mon1: 2017-07-11 13:25:44.791661 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:44.792133 I | rook-ceph-mon1: 2017-07-11 13:25:44.792116 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:44.792293 I | rook-ceph-mon1: 2017-07-11 13:25:44.792267 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:44.792773 I | rook-ceph-mon1: 2017-07-11 13:25:44.792757 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:44.792912 I | rook-ceph-mon1: 2017-07-11 13:25:44.792897 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:44.793298 I | rook-ceph-mon1: 2017-07-11 13:25:44.793282 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:44.793457 I | rook-ceph-mon1: 2017-07-11 13:25:44.793441 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:44.793956 I | rook-ceph-mon1: 2017-07-11 13:25:44.793940 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:44.794092 I | rook-ceph-mon1: 2017-07-11 13:25:44.794078 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:44.810678 I | rook-ceph-mon1: 2017-07-11 13:25:44.810661 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:44.810823 I | rook-ceph-mon1: 2017-07-11 13:25:44.810809 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:46.420590 I | rook-ceph-mon1: 2017-07-11 13:25:44.690576 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 113 : audit [INF] from='client.? 10.233.124.5:0/4091151238' entity='client.admin' cmd=[{"prefix": "auth get-key", "entity": "client.admin", "format": "json"}]: dispatch
- 2017-07-11 13:25:46.420664 I | rook-ceph-mon1: 2017-07-11 13:25:44.824113 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 137 : cluster [INF] osdmap e23: 6 total, 3 up, 6 in
- 2017-07-11 13:25:46.421498 I | rook-ceph-mon1: 2017-07-11 13:25:46.421480 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:46.421581 I | rook-ceph-mon1: 2017-07-11 13:25:46.421567 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:46.421984 I | rook-ceph-mon1: 2017-07-11 13:25:46.421969 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:46.422258 I | rook-ceph-mon1: 2017-07-11 13:25:46.422224 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:46.422684 I | rook-ceph-mon1: 2017-07-11 13:25:46.422668 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:46.422847 I | rook-ceph-mon1: 2017-07-11 13:25:46.422832 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:46.423257 I | rook-ceph-mon1: 2017-07-11 13:25:46.423241 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:46.423488 I | rook-ceph-mon1: 2017-07-11 13:25:46.423472 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:46.432702 I | rook-ceph-mon1: 2017-07-11 13:25:46.432686 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:46.432880 I | rook-ceph-mon1: 2017-07-11 13:25:46.432865 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:46.433318 I | rook-ceph-mon1: 2017-07-11 13:25:46.433303 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:46.439734 I | rook-ceph-mon1: 2017-07-11 13:25:46.439712 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:47.630924 I | rook-ceph-mon1: 2017-07-11 13:25:36.822488 osd.0 osd.0 10.233.72.0:6800/180 22 : cluster [WRN] 8 slow requests, 1 included below; oldest blocked for > 66.493134 secs
- 2017-07-11 13:25:47.637287 I | rook-ceph-mon1: 2017-07-11 13:25:36.822497 osd.0 osd.0 10.233.72.0:6800/180 23 : cluster [WRN] slow request 60.219543 seconds old, received at 2017-07-11 13:24:36.602887: osd_pg_create(e15 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.7f:2 0.8b:2 0.a1:2 0.a2:2 0.a6:2 0.a7:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.125:2 0.135:2 0.147:2 0.150:2 0.151:2 0.15a:2 0.16a:2 0.170:2 0.171:2 0.175:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.190:2 0.196:2 0.19c:2 0.1a0:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.21f:2 0.227:2 0.228:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.239:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.32a:2 0.332:2 0.338:2 0.346:2 0.34b:2 0.34d:2 0.35a:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39a:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:47.637340 I | rook-ceph-mon1: 2017-07-11 13:25:37.109010 osd.3 osd.3 10.233.86.0:6800/178 5 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.563637 secs
- 2017-07-11 13:25:47.637377 I | rook-ceph-mon1: 2017-07-11 13:25:37.109016 osd.3 osd.3 10.233.86.0:6800/178 6 : cluster [WRN] slow request 60.563637 seconds old, received at 2017-07-11 13:24:36.545354: osd_pg_create(e15 0.a:2 0.d:2 0.18:2 0.1f:2 0.23:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.72:2 0.7c:2 0.88:2 0.89:2 0.8d:2 0.91:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.b9:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e2:2 0.e9:2 0.ea:2 0.ef:2 0.fc:2 0.ff:2 0.108:2 0.10e:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.127:2 0.12d:2 0.130:2 0.131:2 0.132:2 0.136:2 0.138:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.154:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.184:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.195:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1d7:2 0.1de:2 0.1df:2 0.1e2:2 0.1e3:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1f8:2 0.1fb:2 0.202:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.24e:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.278:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.298:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2ed:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.2ff:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.314:2 0.316:2 0.319:2 0.31d:2 0.31f:2 0.329:2 0.331:2 0.335:2 0.337:2 0.33b:2 0.33c:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.369:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3ba:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3d2:2 0.3d6:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2 0.3f1:2) currently started
- 2017-07-11 13:25:47.637405 I | rook-ceph-mon1: 2017-07-11 13:25:37.822707 osd.0 osd.0 10.233.72.0:6800/180 24 : cluster [WRN] 8 slow requests, 1 included below; oldest blocked for > 67.493358 secs
- 2017-07-11 13:25:47.637422 I | rook-ceph-mon1: 2017-07-11 13:25:37.822725 osd.0 osd.0 10.233.72.0:6800/180 25 : cluster [WRN] slow request 60.546935 seconds old, received at 2017-07-11 13:24:37.275719: osd_pg_create(e16 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:47.637491 I | rook-ceph-mon1: 2017-07-11 13:25:41.823480 osd.0 osd.0 10.233.72.0:6800/180 26 : cluster [WRN] 8 slow requests, 1 included below; oldest blocked for > 71.494159 secs
- 2017-07-11 13:25:47.637509 I | rook-ceph-mon1: 2017-07-11 13:25:41.823485 osd.0 osd.0 10.233.72.0:6800/180 27 : cluster [WRN] slow request 60.262875 seconds old, received at 2017-07-11 13:24:41.560579: osd_pg_create(e17 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:47.637535 I | rook-ceph-mon1: 2017-07-11 13:25:42.116011 osd.3 osd.3 10.233.86.0:6800/178 7 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 64.892901 secs
- 2017-07-11 13:25:47.637548 I | rook-ceph-mon1: 2017-07-11 13:25:42.116021 osd.3 osd.3 10.233.86.0:6800/178 8 : cluster [WRN] slow request 64.892901 seconds old, received at 2017-07-11 13:24:37.222959: osd_pg_create(e16 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:47.637577 I | rook-ceph-mon1: 2017-07-11 13:25:42.116031 osd.3 osd.3 10.233.86.0:6800/178 9 : cluster [WRN] slow request 60.607081 seconds old, received at 2017-07-11 13:24:41.508779: osd_pg_create(e17 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:47.637603 I | rook-ceph-mon1: 2017-07-11 13:25:43.116354 osd.3 osd.3 10.233.86.0:6800/178 10 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 65.893370 secs
- 2017-07-11 13:25:47.637615 I | rook-ceph-mon1: 2017-07-11 13:25:43.116360 osd.3 osd.3 10.233.86.0:6800/178 11 : cluster [WRN] slow request 65.893370 seconds old, received at 2017-07-11 13:24:37.222959: osd_pg_create(e16 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:47.637643 I | rook-ceph-mon1: 2017-07-11 13:25:43.116363 osd.3 osd.3 10.233.86.0:6800/178 12 : cluster [WRN] slow request 61.607550 seconds old, received at 2017-07-11 13:24:41.508779: osd_pg_create(e17 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:47.637657 I | rook-ceph-mon1: 2017-07-11 13:25:44.152154 osd.1 osd.1 10.233.76.4:6800/178 5 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 73.772555 secs
- 2017-07-11 13:25:47.637671 I | rook-ceph-mon1: 2017-07-11 13:25:44.152167 osd.1 osd.1 10.233.76.4:6800/178 6 : cluster [WRN] slow request 73.772555 seconds old, received at 2017-07-11 13:24:30.379551: osd_pg_create(e10 0.3:2 0.9:2 0.2a:2 0.2d:2 0.35:2 0.60:2 0.63:2 0.6e:2 0.76:2 0.7a:2 0.7d:2 0.8a:2 0.ab:2 0.b6:2 0.bc:2 0.ca:2 0.ce:2 0.d2:2 0.eb:2 0.11f:2 0.133:2 0.13e:2 0.141:2 0.148:2 0.14c:2 0.14e:2 0.166:2 0.167:2 0.180:2 0.198:2 0.19e:2 0.1a5:2 0.1a6:2 0.1b6:2 0.1bc:2 0.1d8:2 0.1ef:2 0.21a:2 0.222:2 0.223:2 0.226:2 0.24a:2 0.25c:2 0.25d:2 0.29a:2 0.2a0:2 0.2a6:2 0.2af:2 0.2b1:2 0.2b3:2 0.2c6:2 0.2f6:2 0.300:2 0.325:2 0.32c:2 0.330:2 0.33c:2 0.342:2 0.34b:2 0.363:2 0.36c:2 0.378:2 0.379:2 0.37f:2 0.388:2 0.396:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3e8:2 0.3eb:2) currently wait for new map
- 2017-07-11 13:25:47.637692 I | rook-ceph-mon1: 2017-07-11 13:25:44.491846 osd.3 osd.3 10.233.86.0:6800/178 13 : cluster [WRN] map e18 wrongly marked me down at e18
- 2017-07-11 13:25:47.637703 I | rook-ceph-mon1: 2017-07-11 13:25:45.152387 osd.1 osd.1 10.233.76.4:6800/178 7 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 74.772758 secs
- 2017-07-11 13:25:47.637723 I | rook-ceph-mon1: 2017-07-11 13:25:45.152616 osd.1 osd.1 10.233.76.4:6800/178 8 : cluster [WRN] slow request 74.772758 seconds old, received at 2017-07-11 13:24:30.379551: osd_pg_create(e10 0.3:2 0.9:2 0.2a:2 0.2d:2 0.35:2 0.60:2 0.63:2 0.6e:2 0.76:2 0.7a:2 0.7d:2 0.8a:2 0.ab:2 0.b6:2 0.bc:2 0.ca:2 0.ce:2 0.d2:2 0.eb:2 0.11f:2 0.133:2 0.13e:2 0.141:2 0.148:2 0.14c:2 0.14e:2 0.166:2 0.167:2 0.180:2 0.198:2 0.19e:2 0.1a5:2 0.1a6:2 0.1b6:2 0.1bc:2 0.1d8:2 0.1ef:2 0.21a:2 0.222:2 0.223:2 0.226:2 0.24a:2 0.25c:2 0.25d:2 0.29a:2 0.2a0:2 0.2a6:2 0.2af:2 0.2b1:2 0.2b3:2 0.2c6:2 0.2f6:2 0.300:2 0.325:2 0.32c:2 0.330:2 0.33c:2 0.342:2 0.34b:2 0.363:2 0.36c:2 0.378:2 0.379:2 0.37f:2 0.388:2 0.396:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3e8:2 0.3eb:2) currently wait for new map
- 2017-07-11 13:25:47.637745 I | rook-ceph-mon1: 2017-07-11 13:25:45.152638 osd.1 osd.1 10.233.76.4:6800/178 9 : cluster [WRN] slow request 74.168544 seconds old, received at 2017-07-11 13:24:30.983765: osd_pg_create(e11 0.1:2 0.3:2 0.4:2 0.8:2 0.9:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2a:2 0.2b:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.39:2 0.3c:2 0.40:2 0.41:2 0.43:2 0.4b:2 0.4d:2 0.4e:2 0.52:2 0.5a:2 0.5f:2 0.60:2 0.62:2 0.63:2 0.6d:2 0.6e:2 0.75:2 0.76:2 0.7a:2 0.7d:2 0.80:2 0.81:2 0.87:2 0.8a:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.9a:2 0.9b:2 0.9c:2 0.a9:2 0.ab:2 0.b1:2 0.b2:2 0.b6:2 0.bc:2 0.be:2 0.c9:2 0.ca:2 0.ce:2 0.cf:2 0.d2:2 0.db:2 0.df:2 0.e6:2 0.eb:2 0.f1:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.133:2 0.139:2 0.13b:2 0.13e:2 0.141:2 0.144:2 0.145:2 0.148:2 0.14a:2 0.14b:2 0.14c:2 0.14d:2 0.14e:2 0.155:2 0.158:2 0.159:2 0.15d:2 0.164:2 0.165:2 0.166:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.180:2 0.18e:2 0.18f:2 0.193:2 0.198:2 0.199:2 0.19a:2 0.19b:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d3:2 0.1d8:2 0.1d9:2 0.1dd:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f9:2 0.1fa:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21a:2 0.21b:2 0.220:2 0.222:2 0.223:2 0.225:2 0.226:2 0.230:2 0.233:2 0.234:2 0.236:2 0.240:2 0.241:2 0.244:2 0.24a:2 0.24f:2 0.258:2 0.25a:2 0.25c:2 0.25d:2 0.262:2 0.266:2 0.26c:2 0.274:2 0.275:2 0.27d:2 0.281:2 0.288:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.2a0:2 0.2a3:2 0.2a5:2 0.2a6:2 0.2ad:2 0.2af:2 0.2b1:2 0.2b3:2 0.2ba:2 0.2bd:2 0.2c3:2 0.2c6:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cf:2 0.2d8:2 0.2f6:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.303:2 0.307:2 0.30d:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.325:2 0.32a:2 0.32c:2 0.32e:2 0.330:2 0.336:2 0.339:2 0.33c:2 0.33d:2 0.342:2 0.347:2 0.34b:2 0.34e:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.363:2 0.36c:2 0.370:2 0.375:2 0.376:2 0.378:2 0.379:2 0.37c:2 0.37f:2 0.380:2 0.384:2 0.387:2 0.388:2 0.38a:2 0.38e:2 0.392:2 0.396:2 0.39b:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c3:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cc:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3e0:2 0.3e3:2 0.3e8:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f4:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:25:47.637761 I | rook-ceph-mon1: 2017-07-11 13:25:46.304297 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 138 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:25:47.637774 I | rook-ceph-mon1: 2017-07-11 13:25:46.304832 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 139 : cluster [INF] osdmap e24: 6 total, 4 up, 6 in
- 2017-07-11 13:25:47.848147 I | rook-ceph-mon1: 2017-07-11 13:25:47.848119 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:47.848358 I | rook-ceph-mon1: 2017-07-11 13:25:47.848342 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:47.848967 I | rook-ceph-mon1: 2017-07-11 13:25:47.848948 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:47.849225 I | rook-ceph-mon1: 2017-07-11 13:25:47.849196 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:47.849618 I | rook-ceph-mon1: 2017-07-11 13:25:47.849581 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:47.849811 I | rook-ceph-mon1: 2017-07-11 13:25:47.849784 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:47.850230 I | rook-ceph-mon1: 2017-07-11 13:25:47.850206 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:47.850393 I | rook-ceph-mon1: 2017-07-11 13:25:47.850378 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:47.850796 I | rook-ceph-mon1: 2017-07-11 13:25:47.850779 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:47.850970 I | rook-ceph-mon1: 2017-07-11 13:25:47.850944 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:47.851375 I | rook-ceph-mon1: 2017-07-11 13:25:47.851359 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:47.851532 I | rook-ceph-mon1: 2017-07-11 13:25:47.851517 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:49.102156 I | rook-ceph-mon1: 2017-07-11 13:25:47.816193 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 140 : cluster [INF] osdmap e25: 6 total, 4 up, 6 in
- 2017-07-11 13:25:49.549653 I | rook-ceph-mon1: 2017-07-11 13:25:49.549625 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:49.549863 I | rook-ceph-mon1: 2017-07-11 13:25:49.549847 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:49.550254 I | rook-ceph-mon1: 2017-07-11 13:25:49.550237 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:49.550445 I | rook-ceph-mon1: 2017-07-11 13:25:49.550416 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:49.550901 I | rook-ceph-mon1: 2017-07-11 13:25:49.550885 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:49.551082 I | rook-ceph-mon1: 2017-07-11 13:25:49.551045 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:49.551475 I | rook-ceph-mon1: 2017-07-11 13:25:49.551459 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:49.551702 I | rook-ceph-mon1: 2017-07-11 13:25:49.551688 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:49.552818 I | rook-ceph-mon1: 2017-07-11 13:25:49.552802 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:49.553009 I | rook-ceph-mon1: 2017-07-11 13:25:49.552977 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:49.559938 I | rook-ceph-mon1: 2017-07-11 13:25:49.559921 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:49.559982 I | rook-ceph-mon1: 2017-07-11 13:25:49.559969 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:50.534766 I | rook-ceph-mon1: 2017-07-11 13:25:39.596040 osd.2 osd.2 10.233.69.0:6800/178 8 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 62.798606 secs
- 2017-07-11 13:25:50.534825 I | rook-ceph-mon1: 2017-07-11 13:25:39.596070 osd.2 osd.2 10.233.69.0:6800/178 9 : cluster [WRN] slow request 62.798606 seconds old, received at 2017-07-11 13:24:36.797317: osd_pg_create(e15 0.5:2 0.7:2 0.9:2 0.f:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.70:2 0.7a:2 0.7d:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.92:2 0.94:2 0.97:2 0.98:2 0.9a:2 0.9d:2 0.a5:2 0.a8:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.ba:2 0.c2:2 0.c5:2 0.c9:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.12c:2 0.134:2 0.141:2 0.143:2 0.14b:2 0.14d:2 0.15c:2 0.161:2 0.166:2 0.16c:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19a:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b5:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1e1:2 0.1e9:2 0.1f2:2 0.1f3:2 0.1fd:2 0.1fe:2 0.1ff:2 0.200:2 0.201:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.248:2 0.24a:2 0.24b:2 0.24f:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26a:2 0.26b:2 0.26d:2 0.276:2 0.279:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2f8:2 0.2fd:2 0.306:2 0.30e:2 0.313:2 0.315:2 0.31b:2 0.322:2 0.327:2 0.32f:2 0.330:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.386:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d4:2 0.3d8:2 0.3db:2 0.3dd:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:50.534848 I | rook-ceph-mon1: 2017-07-11 13:25:40.596214 osd.2 osd.2 10.233.69.0:6800/178 10 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 63.798877 secs
- 2017-07-11 13:25:50.534862 I | rook-ceph-mon1: 2017-07-11 13:25:40.596220 osd.2 osd.2 10.233.69.0:6800/178 11 : cluster [WRN] slow request 63.798877 seconds old, received at 2017-07-11 13:24:36.797317: osd_pg_create(e15 0.5:2 0.7:2 0.9:2 0.f:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.70:2 0.7a:2 0.7d:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.92:2 0.94:2 0.97:2 0.98:2 0.9a:2 0.9d:2 0.a5:2 0.a8:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.ba:2 0.c2:2 0.c5:2 0.c9:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.12c:2 0.134:2 0.141:2 0.143:2 0.14b:2 0.14d:2 0.15c:2 0.161:2 0.166:2 0.16c:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19a:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b5:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1e1:2 0.1e9:2 0.1f2:2 0.1f3:2 0.1fd:2 0.1fe:2 0.1ff:2 0.200:2 0.201:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.248:2 0.24a:2 0.24b:2 0.24f:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26a:2 0.26b:2 0.26d:2 0.276:2 0.279:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2f8:2 0.2fd:2 0.306:2 0.30e:2 0.313:2 0.315:2 0.31b:2 0.322:2 0.327:2 0.32f:2 0.330:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.386:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d4:2 0.3d8:2 0.3db:2 0.3dd:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:50.534875 I | rook-ceph-mon1: 2017-07-11 13:25:49.415298 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 141 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:25:50.534903 I | rook-ceph-mon1: 2017-07-11 13:25:49.415718 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 142 : cluster [INF] osdmap e26: 6 total, 5 up, 6 in
- 2017-07-11 13:25:50.939422 I | rook-ceph-mon1: 2017-07-11 13:25:50.939398 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:50.939634 I | rook-ceph-mon1: 2017-07-11 13:25:50.939600 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:50.940042 I | rook-ceph-mon1: 2017-07-11 13:25:50.940026 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:50.956661 I | rook-ceph-mon1: 2017-07-11 13:25:50.956642 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:50.957450 I | rook-ceph-mon1: 2017-07-11 13:25:50.957047 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:50.957757 I | rook-ceph-mon1: 2017-07-11 13:25:50.957060 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:50.957785 I | rook-ceph-mon1: 2017-07-11 13:25:50.957138 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:50.957799 I | rook-ceph-mon1: 2017-07-11 13:25:50.957148 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:50.957810 I | rook-ceph-mon1: 2017-07-11 13:25:50.957212 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:50.957837 I | rook-ceph-mon1: 2017-07-11 13:25:50.957221 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:50.957850 I | rook-ceph-mon1: 2017-07-11 13:25:50.957283 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:50.957861 I | rook-ceph-mon1: 2017-07-11 13:25:50.957303 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:51.968039 I | rook-ceph-mon1: 2017-07-11 13:25:42.450433 osd.4 osd.4 10.233.124.4:6800/178 9 : cluster [WRN] 2 slow requests, 1 included below; oldest blocked for > 65.672029 secs
- 2017-07-11 13:25:51.969034 I | rook-ceph-mon1: 2017-07-11 13:25:42.450446 osd.4 osd.4 10.233.124.4:6800/178 10 : cluster [WRN] slow request 60.755602 seconds old, received at 2017-07-11 13:24:41.694773: osd_pg_create(e17 0.10:2 0.14:2 0.17:2 0.1d:2 0.24:2 0.29:2 0.2d:2 0.37:2 0.3d:2 0.40:2 0.42:2 0.45:2 0.46:2 0.48:2 0.4a:2 0.55:2 0.5a:2 0.5c:2 0.62:2 0.65:2 0.68:2 0.6c:2 0.6d:2 0.78:2 0.83:2 0.90:2 0.95:2 0.9c:2 0.9e:2 0.b0:2 0.b5:2 0.b7:2 0.b8:2 0.bc:2 0.bd:2 0.c0:2 0.c8:2 0.cb:2 0.ce:2 0.d1:2 0.e6:2 0.e7:2 0.f2:2 0.fe:2 0.100:2 0.101:2 0.10a:2 0.10f:2 0.114:2 0.116:2 0.128:2 0.12a:2 0.12e:2 0.12f:2 0.13e:2 0.142:2 0.149:2 0.14c:2 0.14f:2 0.15e:2 0.160:2 0.162:2 0.163:2 0.164:2 0.169:2 0.16b:2 0.17f:2 0.182:2 0.185:2 0.18f:2 0.19b:2 0.1a5:2 0.1bc:2 0.1c7:2 0.1d9:2 0.1db:2 0.1dc:2 0.1dd:2 0.1e4:2 0.1e8:2 0.1ee:2 0.1f6:2 0.1f7:2 0.204:2 0.208:2 0.210:2 0.217:2 0.21d:2 0.226:2 0.229:2 0.22b:2 0.230:2 0.235:2 0.237:2 0.23a:2 0.23b:2 0.23e:2 0.241:2 0.243:2 0.24d:2 0.254:2 0.25b:2 0.25e:2 0.261:2 0.265:2 0.26c:2 0.27b:2 0.27d:2 0.27f:2 0.283:2 0.284:2 0.288:2 0.2ae:2 0.2b0:2 0.2b1:2 0.2b4:2 0.2bb:2 0.2bf:2 0.2c0:2 0.2c3:2 0.2c5:2 0.2cd:2 0.2cf:2 0.2df:2 0.2e9:2 0.2ea:2 0.2f9:2 0.303:2 0.309:2 0.30a:2 0.30b:2 0.30d:2 0.312:2 0.325:2 0.32b:2 0.32c:2 0.32d:2 0.333:2 0.334:2 0.339:2 0.33a:2 0.33f:2 0.342:2 0.344:2 0.359:2 0.362:2 0.368:2 0.36c:2 0.379:2 0.37a:2 0.38f:2 0.395:2 0.3a2:2 0.3a8:2 0.3a9:2 0.3b1:2 0.3b4:2 0.3b5:2 0.3be:2 0.3c3:2 0.3c5:2 0.3d1:2 0.3d5:2 0.3da:2 0.3e0:2 0.3e9:2 0.3eb:2 0.3ed:2 0.3ef:2 0.3f6:2 0.3f7:2 0.3f9:2) currently wait for new map
- 2017-07-11 13:25:51.969128 I | rook-ceph-mon1: 2017-07-11 13:25:50.802127 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 143 : cluster [INF] osdmap e27: 6 total, 5 up, 6 in
- 2017-07-11 13:25:52.411371 I | rook-ceph-mon1: 2017-07-11 13:25:52.410831 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:52.411438 I | rook-ceph-mon1: 2017-07-11 13:25:52.410854 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:52.411454 I | rook-ceph-mon1: 2017-07-11 13:25:52.410950 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:52.411494 I | rook-ceph-mon1: 2017-07-11 13:25:52.410961 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:52.411699 I | rook-ceph-mon1: 2017-07-11 13:25:52.411027 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:52.411719 I | rook-ceph-mon1: 2017-07-11 13:25:52.411036 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:52.411758 I | rook-ceph-mon1: 2017-07-11 13:25:52.411097 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:52.411771 I | rook-ceph-mon1: 2017-07-11 13:25:52.411106 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:52.411825 I | rook-ceph-mon1: 2017-07-11 13:25:52.411166 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:52.411840 I | rook-ceph-mon1: 2017-07-11 13:25:52.411175 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:52.411851 I | rook-ceph-mon1: 2017-07-11 13:25:52.411236 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:52.411904 I | rook-ceph-mon1: 2017-07-11 13:25:52.411244 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:53.354251 I | rook-ceph-mon1: 2017-07-11 13:25:52.276339 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 144 : cluster [INF] osdmap e28: 6 total, 5 up, 6 in
- 2017-07-11 13:25:53.608072 I | rook-ceph-mon1: 2017-07-11 13:25:53.608036 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:53.608292 I | rook-ceph-mon1: 2017-07-11 13:25:53.608276 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:53.624468 I | rook-ceph-mon1: 2017-07-11 13:25:53.624451 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:53.624684 I | rook-ceph-mon1: 2017-07-11 13:25:53.624655 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:53.625126 I | rook-ceph-mon1: 2017-07-11 13:25:53.625110 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:53.625338 I | rook-ceph-mon1: 2017-07-11 13:25:53.625297 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:53.625751 I | rook-ceph-mon1: 2017-07-11 13:25:53.625735 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:53.625953 I | rook-ceph-mon1: 2017-07-11 13:25:53.625910 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:53.626355 I | rook-ceph-mon1: 2017-07-11 13:25:53.626339 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:53.634207 I | rook-ceph-mon1: 2017-07-11 13:25:53.634190 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:53.634621 I | rook-ceph-mon1: 2017-07-11 13:25:53.634605 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:53.634802 I | rook-ceph-mon1: 2017-07-11 13:25:53.634771 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:54.162049 I | rook-ceph-mon1: 2017-07-11 13:25:54.161775 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4678 MB, avail 94508 MB
- 2017-07-11 13:25:54.756613 I | rook-ceph-mon1: 2017-07-11 13:25:54.756582 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:54.756827 I | rook-ceph-mon1: 2017-07-11 13:25:54.756810 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:54.757271 I | rook-ceph-mon1: 2017-07-11 13:25:54.757254 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:54.757338 I | rook-ceph-mon1: 2017-07-11 13:25:54.757324 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:54.757756 I | rook-ceph-mon1: 2017-07-11 13:25:54.757739 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:54.757825 I | rook-ceph-mon1: 2017-07-11 13:25:54.757809 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:54.758222 I | rook-ceph-mon1: 2017-07-11 13:25:54.758206 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:54.758290 I | rook-ceph-mon1: 2017-07-11 13:25:54.758272 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:54.758729 I | rook-ceph-mon1: 2017-07-11 13:25:54.758712 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:54.758795 I | rook-ceph-mon1: 2017-07-11 13:25:54.758781 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:54.759933 I | rook-ceph-mon1: 2017-07-11 13:25:54.759915 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:54.760004 I | rook-ceph-mon1: 2017-07-11 13:25:54.759990 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:55.076236 I | rook-ceph-mon1: 2017-07-11 13:25:53.484257 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 145 : cluster [INF] osdmap e29: 6 total, 5 up, 6 in
- 2017-07-11 13:25:56.380592 I | rook-ceph-mon1: 2017-07-11 13:25:56.380547 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:56.380835 I | rook-ceph-mon1: 2017-07-11 13:25:56.380786 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:56.381150 I | rook-ceph-mon1: 2017-07-11 13:25:56.381134 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:56.381215 I | rook-ceph-mon1: 2017-07-11 13:25:56.381202 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:56.381450 I | rook-ceph-mon1: 2017-07-11 13:25:56.381423 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:56.381542 I | rook-ceph-mon1: 2017-07-11 13:25:56.381522 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:56.381860 I | rook-ceph-mon1: 2017-07-11 13:25:56.381846 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:56.381928 I | rook-ceph-mon1: 2017-07-11 13:25:56.381914 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:56.382165 I | rook-ceph-mon1: 2017-07-11 13:25:56.382150 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:56.382227 I | rook-ceph-mon1: 2017-07-11 13:25:56.382212 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:56.382408 I | rook-ceph-mon1: 2017-07-11 13:25:56.382394 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:56.382469 I | rook-ceph-mon1: 2017-07-11 13:25:56.382457 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:56.642063 I | rook-ceph-mon1: 2017-07-11 13:25:54.731782 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 146 : cluster [INF] osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:25:56.642148 I | rook-ceph-mon1: 2017-07-11 13:25:54.732341 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 147 : cluster [INF] osdmap e30: 6 total, 6 up, 6 in
- 2017-07-11 13:25:57.661905 I | rook-ceph-mon1: 2017-07-11 13:25:57.661876 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:57.662272 I | rook-ceph-mon1: 2017-07-11 13:25:57.662155 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:57.662810 I | rook-ceph-mon1: 2017-07-11 13:25:57.662787 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:57.663020 I | rook-ceph-mon1: 2017-07-11 13:25:57.663006 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:57.663478 I | rook-ceph-mon1: 2017-07-11 13:25:57.663461 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:57.663690 I | rook-ceph-mon1: 2017-07-11 13:25:57.663676 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:57.664104 I | rook-ceph-mon1: 2017-07-11 13:25:57.664088 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:57.664470 I | rook-ceph-mon1: 2017-07-11 13:25:57.664452 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:57.675962 I | rook-ceph-mon1: 2017-07-11 13:25:57.675942 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:57.676032 I | rook-ceph-mon1: 2017-07-11 13:25:57.676019 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:57.678261 I | rook-ceph-mon1: 2017-07-11 13:25:57.678241 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:57.678344 I | rook-ceph-mon1: 2017-07-11 13:25:57.678328 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:57.945925 I | rook-ceph-mon1: 2017-07-11 13:25:46.152882 osd.1 osd.1 10.233.76.4:6800/178 10 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 73.939919 secs
- 2017-07-11 13:25:57.946174 I | rook-ceph-mon1: 2017-07-11 13:25:46.152889 osd.1 osd.1 10.233.76.4:6800/178 11 : cluster [WRN] slow request 73.939919 seconds old, received at 2017-07-11 13:24:32.212896: osd_pg_create(e12 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:57.946329 I | rook-ceph-mon1: 2017-07-11 13:25:47.153164 osd.1 osd.1 10.233.76.4:6800/178 12 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 74.940232 secs
- 2017-07-11 13:25:57.946381 I | rook-ceph-mon1: 2017-07-11 13:25:47.153170 osd.1 osd.1 10.233.76.4:6800/178 13 : cluster [WRN] slow request 74.940232 seconds old, received at 2017-07-11 13:24:32.212896: osd_pg_create(e12 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:57.946447 I | rook-ceph-mon1: 2017-07-11 13:25:56.232388 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 148 : cluster [INF] osdmap e31: 6 total, 6 up, 6 in
- 2017-07-11 13:25:57.946463 I | rook-ceph-mon1: 2017-07-11 13:25:57.505311 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 149 : cluster [INF] osdmap e32: 6 total, 6 up, 6 in
- 2017-07-11 13:25:58.772529 I | rook-ceph-mon1: 2017-07-11 13:25:58.772500 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:25:58.772782 I | rook-ceph-mon1: 2017-07-11 13:25:58.772760 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:25:58.798746 I | rook-ceph-mon1: 2017-07-11 13:25:58.798723 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:25:58.798882 I | rook-ceph-mon1: 2017-07-11 13:25:58.798816 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:25:58.799332 I | rook-ceph-mon1: 2017-07-11 13:25:58.799316 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:25:58.799525 I | rook-ceph-mon1: 2017-07-11 13:25:58.799498 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:25:58.799969 I | rook-ceph-mon1: 2017-07-11 13:25:58.799953 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:25:58.800138 I | rook-ceph-mon1: 2017-07-11 13:25:58.800123 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:25:58.800600 I | rook-ceph-mon1: 2017-07-11 13:25:58.800583 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:25:58.800773 I | rook-ceph-mon1: 2017-07-11 13:25:58.800759 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:25:58.801213 I | rook-ceph-mon1: 2017-07-11 13:25:58.801196 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:25:58.801399 I | rook-ceph-mon1: 2017-07-11 13:25:58.801369 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:25:59.128186 I | rook-ceph-mon1: 2017-07-11 13:25:58.721953 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 150 : cluster [INF] osdmap e33: 6 total, 6 up, 6 in
- 2017-07-11 13:26:00.322886 I | rook-ceph-mon1: 2017-07-11 13:26:00.322580 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:00.325050 I | rook-ceph-mon1: 2017-07-11 13:26:00.322603 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:00.325092 I | rook-ceph-mon1: 2017-07-11 13:26:00.322656 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:00.325106 I | rook-ceph-mon1: 2017-07-11 13:26:00.322666 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:00.325118 I | rook-ceph-mon1: 2017-07-11 13:26:00.322696 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:00.325128 I | rook-ceph-mon1: 2017-07-11 13:26:00.322704 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:00.325139 I | rook-ceph-mon1: 2017-07-11 13:26:00.322731 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:00.325173 I | rook-ceph-mon1: 2017-07-11 13:26:00.322739 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:00.325187 I | rook-ceph-mon1: 2017-07-11 13:26:00.322766 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:00.325198 I | rook-ceph-mon1: 2017-07-11 13:26:00.322774 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:00.325209 I | rook-ceph-mon1: 2017-07-11 13:26:00.322801 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:00.325220 I | rook-ceph-mon1: 2017-07-11 13:26:00.322809 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:00.445651 I | rook-ceph-mon1: 2017-07-11 13:25:52.187081 osd.2 osd.2 10.233.69.0:6800/178 12 : cluster [WRN] map e18 wrongly marked me down at e18
- 2017-07-11 13:26:00.445881 I | rook-ceph-mon1: 2017-07-11 13:25:52.604404 osd.2 osd.2 10.233.69.0:6800/178 13 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 70.890580 secs
- 2017-07-11 13:26:00.445915 I | rook-ceph-mon1: 2017-07-11 13:25:52.604411 osd.2 osd.2 10.233.69.0:6800/178 14 : cluster [WRN] slow request 70.890580 seconds old, received at 2017-07-11 13:24:41.713752: osd_pg_create(e17 0.5:2 0.7:2 0.9:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.7a:2 0.7d:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.92:2 0.94:2 0.98:2 0.9a:2 0.9d:2 0.a5:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.ba:2 0.c2:2 0.c5:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.12c:2 0.141:2 0.14d:2 0.15c:2 0.161:2 0.166:2 0.16f:2 0.178:2 0.17a:2 0.180:2 0.189:2 0.18c:2 0.197:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1da:2 0.1e1:2 0.1e9:2 0.1f2:2 0.1f3:2 0.1ff:2 0.200:2 0.201:2 0.213:2 0.218:2 0.21a:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.248:2 0.24a:2 0.24b:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26b:2 0.26d:2 0.276:2 0.279:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b8:2 0.2b9:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d7:2 0.2da:2 0.2db:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32f:2 0.330:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2) currently wait for new map
- 2017-07-11 13:26:01.630082 I | rook-ceph-mon1: 2017-07-11 13:26:01.630053 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:01.630621 I | rook-ceph-mon1: 2017-07-11 13:26:01.630605 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:01.630952 I | rook-ceph-mon1: 2017-07-11 13:26:01.630938 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:01.631264 I | rook-ceph-mon1: 2017-07-11 13:26:01.631244 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:01.632231 I | rook-ceph-mon1: 2017-07-11 13:26:01.632211 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:01.632301 I | rook-ceph-mon1: 2017-07-11 13:26:01.632287 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:01.632547 I | rook-ceph-mon1: 2017-07-11 13:26:01.632520 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:01.632606 I | rook-ceph-mon1: 2017-07-11 13:26:01.632593 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:01.632790 I | rook-ceph-mon1: 2017-07-11 13:26:01.632774 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:01.632945 I | rook-ceph-mon1: 2017-07-11 13:26:01.632932 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:01.639837 I | rook-ceph-mon1: 2017-07-11 13:26:01.639820 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:01.639911 I | rook-ceph-mon1: 2017-07-11 13:26:01.639897 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:01.737145 I | rook-ceph-mon1: 2017-07-11 13:26:00.125232 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 151 : cluster [INF] osdmap e34: 6 total, 6 up, 6 in
- 2017-07-11 13:26:02.674601 I | rook-ceph-mon1: 2017-07-11 13:26:02.674572 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:02.674773 I | rook-ceph-mon1: 2017-07-11 13:26:02.674702 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:02.675218 I | rook-ceph-mon1: 2017-07-11 13:26:02.675202 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:02.675389 I | rook-ceph-mon1: 2017-07-11 13:26:02.675374 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:02.675799 I | rook-ceph-mon1: 2017-07-11 13:26:02.675782 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:02.675989 I | rook-ceph-mon1: 2017-07-11 13:26:02.675960 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:02.676482 I | rook-ceph-mon1: 2017-07-11 13:26:02.676466 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:02.676640 I | rook-ceph-mon1: 2017-07-11 13:26:02.676625 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:02.677057 I | rook-ceph-mon1: 2017-07-11 13:26:02.677042 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:02.677211 I | rook-ceph-mon1: 2017-07-11 13:26:02.677197 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:02.734218 I | rook-ceph-mon1: 2017-07-11 13:26:02.734198 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:02.735649 I | rook-ceph-mon1: 2017-07-11 13:26:02.735630 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:02.857732 I | rook-ceph-mon1: 2017-07-11 13:26:01.452352 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 152 : cluster [INF] osdmap e35: 6 total, 6 up, 6 in
- 2017-07-11 13:26:02.863827 I | rook-ceph-mon1: 2017-07-11 13:26:02.568175 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 153 : cluster [INF] osdmap e36: 6 total, 6 up, 6 in
- 2017-07-11 13:26:03.969857 I | rook-ceph-mon1: 2017-07-11 13:26:03.969829 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:03.975917 I | rook-ceph-mon1: 2017-07-11 13:26:03.975890 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:03.976153 I | rook-ceph-mon1: 2017-07-11 13:26:03.976126 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:03.976215 I | rook-ceph-mon1: 2017-07-11 13:26:03.976202 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:03.976418 I | rook-ceph-mon1: 2017-07-11 13:26:03.976389 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:03.976478 I | rook-ceph-mon1: 2017-07-11 13:26:03.976460 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:03.977908 I | rook-ceph-mon1: 2017-07-11 13:26:03.977892 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:03.977970 I | rook-ceph-mon1: 2017-07-11 13:26:03.977957 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:03.978155 I | rook-ceph-mon1: 2017-07-11 13:26:03.978141 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:03.978225 I | rook-ceph-mon1: 2017-07-11 13:26:03.978212 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:03.978482 I | rook-ceph-mon1: 2017-07-11 13:26:03.978463 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:03.978695 I | rook-ceph-mon1: 2017-07-11 13:26:03.978682 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:05.149336 I | rook-ceph-mon1: 2017-07-11 13:26:05.149307 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:05.150768 I | rook-ceph-mon1: 2017-07-11 13:26:05.150742 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:05.151005 I | rook-ceph-mon1: 2017-07-11 13:26:05.150986 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:05.151067 I | rook-ceph-mon1: 2017-07-11 13:26:05.151054 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:05.151336 I | rook-ceph-mon1: 2017-07-11 13:26:05.151313 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:05.151404 I | rook-ceph-mon1: 2017-07-11 13:26:05.151390 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:05.151635 I | rook-ceph-mon1: 2017-07-11 13:26:05.151619 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:05.151694 I | rook-ceph-mon1: 2017-07-11 13:26:05.151681 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:05.151985 I | rook-ceph-mon1: 2017-07-11 13:26:05.151967 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:05.152051 I | rook-ceph-mon1: 2017-07-11 13:26:05.152037 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:05.159348 I | rook-ceph-mon1: 2017-07-11 13:26:05.159320 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:05.159428 I | rook-ceph-mon1: 2017-07-11 13:26:05.159415 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:05.312476 I | rook-ceph-mon1: 2017-07-11 13:26:03.831913 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 155 : cluster [INF] osdmap e37: 6 total, 6 up, 6 in
- 2017-07-11 13:26:05.312523 I | rook-ceph-mon1: 2017-07-11 13:26:04.966217 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 156 : cluster [INF] osdmap e38: 6 total, 6 up, 6 in
- 2017-07-11 13:26:06.480135 I | rook-ceph-mon1: 2017-07-11 13:26:06.480102 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:06.481518 I | rook-ceph-mon1: 2017-07-11 13:26:06.481497 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:06.481740 I | rook-ceph-mon1: 2017-07-11 13:26:06.481724 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:06.481803 I | rook-ceph-mon1: 2017-07-11 13:26:06.481791 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:06.482034 I | rook-ceph-mon1: 2017-07-11 13:26:06.482019 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:06.482095 I | rook-ceph-mon1: 2017-07-11 13:26:06.482082 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:06.482305 I | rook-ceph-mon1: 2017-07-11 13:26:06.482278 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:06.482365 I | rook-ceph-mon1: 2017-07-11 13:26:06.482348 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:06.482547 I | rook-ceph-mon1: 2017-07-11 13:26:06.482533 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:06.482614 I | rook-ceph-mon1: 2017-07-11 13:26:06.482602 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:06.482870 I | rook-ceph-mon1: 2017-07-11 13:26:06.482857 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:06.483095 I | rook-ceph-mon1: 2017-07-11 13:26:06.483071 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:07.135554 I | rook-ceph-mon1: 2017-07-11 13:26:03.158303 osd.1 osd.1 10.233.76.4:6800/178 14 : cluster [WRN] 3 slow requests, 2 included below; oldest blocked for > 90.945374 secs
- 2017-07-11 13:26:07.135632 I | rook-ceph-mon1: 2017-07-11 13:26:03.158308 osd.1 osd.1 10.233.76.4:6800/178 15 : cluster [WRN] slow request 30.315376 seconds old, received at 2017-07-11 13:25:32.842895: pg_notify((query:13 sent:13 0.10a( empty local-lis/les=0/0 n=0 ec=2/2 lis/c 0/0 les/c/f 0/0/0 12/12/12))=([2,11] intervals=) epoch 13) currently wait for new map
- 2017-07-11 13:26:07.135649 I | rook-ceph-mon1: 2017-07-11 13:26:03.158311 osd.1 osd.1 10.233.76.4:6800/178 16 : cluster [WRN] slow request 30.095310 seconds old, received at 2017-07-11 13:25:33.062960: pg_notify((query:13 sent:13 0.187( empty local-lis/les=0/0 n=0 ec=2/2 lis/c 0/0 les/c/f 0/0/0 12/12/12))=([2,11] intervals=) epoch 15) currently wait for new map
- 2017-07-11 13:26:07.135676 I | rook-ceph-mon1: 2017-07-11 13:26:05.280675 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 157 : cluster [INF] HEALTH_WARN; 750 pgs peering; 4 requests are blocked > 32 sec; 1 osds have slow requests; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:26:07.682639 I | rook-ceph-mon1: 2017-07-11 13:26:07.682613 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:07.682732 I | rook-ceph-mon1: 2017-07-11 13:26:07.682717 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:07.683138 I | rook-ceph-mon1: 2017-07-11 13:26:07.683122 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:07.683214 I | rook-ceph-mon1: 2017-07-11 13:26:07.683189 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:07.719838 I | rook-ceph-mon1: 2017-07-11 13:26:07.693580 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:07.719946 I | rook-ceph-mon1: 2017-07-11 13:26:07.703587 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:07.720359 I | rook-ceph-mon1: 2017-07-11 13:26:07.720343 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:07.720556 I | rook-ceph-mon1: 2017-07-11 13:26:07.720525 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:07.720951 I | rook-ceph-mon1: 2017-07-11 13:26:07.720935 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:07.721120 I | rook-ceph-mon1: 2017-07-11 13:26:07.721090 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:07.721624 I | rook-ceph-mon1: 2017-07-11 13:26:07.721585 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:07.721717 I | rook-ceph-mon1: 2017-07-11 13:26:07.721702 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:08.340880 I | rook-ceph-mon1: 2017-07-11 13:26:06.296015 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 158 : cluster [INF] osdmap e39: 6 total, 6 up, 6 in
- 2017-07-11 13:26:08.341439 I | rook-ceph-mon1: 2017-07-11 13:26:07.583646 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 159 : cluster [INF] osdmap e40: 6 total, 6 up, 6 in
- 2017-07-11 13:26:08.943308 I | rook-ceph-mon1: 2017-07-11 13:26:08.943281 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:08.943402 I | rook-ceph-mon1: 2017-07-11 13:26:08.943389 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:08.943809 I | rook-ceph-mon1: 2017-07-11 13:26:08.943793 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:08.943870 I | rook-ceph-mon1: 2017-07-11 13:26:08.943858 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:08.944223 I | rook-ceph-mon1: 2017-07-11 13:26:08.944203 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:08.944351 I | rook-ceph-mon1: 2017-07-11 13:26:08.944303 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:08.944744 I | rook-ceph-mon1: 2017-07-11 13:26:08.944724 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:08.944806 I | rook-ceph-mon1: 2017-07-11 13:26:08.944793 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:08.945239 I | rook-ceph-mon1: 2017-07-11 13:26:08.945223 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:08.945314 I | rook-ceph-mon1: 2017-07-11 13:26:08.945299 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:08.945682 I | rook-ceph-mon1: 2017-07-11 13:26:08.945667 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:08.945773 I | rook-ceph-mon1: 2017-07-11 13:26:08.945760 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:09.957377 I | rook-ceph-mon1: 2017-07-11 13:26:08.812100 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 161 : cluster [INF] osdmap e41: 6 total, 6 up, 6 in
- 2017-07-11 13:26:10.240964 I | rook-ceph-mon1: 2017-07-11 13:26:10.240445 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:10.241060 I | rook-ceph-mon1: 2017-07-11 13:26:10.240467 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:10.241078 I | rook-ceph-mon1: 2017-07-11 13:26:10.240561 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:10.241091 I | rook-ceph-mon1: 2017-07-11 13:26:10.240572 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:10.241102 I | rook-ceph-mon1: 2017-07-11 13:26:10.240637 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:10.241114 I | rook-ceph-mon1: 2017-07-11 13:26:10.240646 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:10.241142 I | rook-ceph-mon1: 2017-07-11 13:26:10.240707 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:10.241152 I | rook-ceph-mon1: 2017-07-11 13:26:10.240716 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:10.241163 I | rook-ceph-mon1: 2017-07-11 13:26:10.240776 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:10.241174 I | rook-ceph-mon1: 2017-07-11 13:26:10.240785 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:10.241188 I | rook-ceph-mon1: 2017-07-11 13:26:10.240854 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:10.241211 I | rook-ceph-mon1: 2017-07-11 13:26:10.240864 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:11.323799 I | rook-ceph-mon1: 2017-07-11 13:26:10.140233 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 162 : cluster [INF] osdmap e42: 6 total, 6 up, 6 in
- 2017-07-11 13:26:11.796088 I | rook-ceph-mon1: 2017-07-11 13:26:11.795529 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:11.796153 I | rook-ceph-mon1: 2017-07-11 13:26:11.795553 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:11.796170 I | rook-ceph-mon1: 2017-07-11 13:26:11.795655 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:11.796183 I | rook-ceph-mon1: 2017-07-11 13:26:11.795666 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:11.796193 I | rook-ceph-mon1: 2017-07-11 13:26:11.795744 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:11.796220 I | rook-ceph-mon1: 2017-07-11 13:26:11.795754 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:11.796232 I | rook-ceph-mon1: 2017-07-11 13:26:11.795816 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:11.796243 I | rook-ceph-mon1: 2017-07-11 13:26:11.795825 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:11.796253 I | rook-ceph-mon1: 2017-07-11 13:26:11.795886 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:11.796263 I | rook-ceph-mon1: 2017-07-11 13:26:11.795895 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:11.796274 I | rook-ceph-mon1: 2017-07-11 13:26:11.795969 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:11.796300 I | rook-ceph-mon1: 2017-07-11 13:26:11.795979 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:12.720336 I | rook-ceph-mon1: 2017-07-11 13:26:11.581302 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 163 : cluster [INF] osdmap e43: 6 total, 6 up, 6 in
- 2017-07-11 13:26:13.022367 I | rook-ceph-mon1: 2017-07-11 13:26:13.022341 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:13.022461 I | rook-ceph-mon1: 2017-07-11 13:26:13.022445 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:13.029958 I | rook-ceph-mon1: 2017-07-11 13:26:13.029939 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:13.030141 I | rook-ceph-mon1: 2017-07-11 13:26:13.030109 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:13.030561 I | rook-ceph-mon1: 2017-07-11 13:26:13.030545 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:13.030731 I | rook-ceph-mon1: 2017-07-11 13:26:13.030701 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:13.031139 I | rook-ceph-mon1: 2017-07-11 13:26:13.031122 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:13.031307 I | rook-ceph-mon1: 2017-07-11 13:26:13.031292 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:13.031803 I | rook-ceph-mon1: 2017-07-11 13:26:13.031786 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:13.031963 I | rook-ceph-mon1: 2017-07-11 13:26:13.031948 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:13.032452 I | rook-ceph-mon1: 2017-07-11 13:26:13.032416 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:13.032641 I | rook-ceph-mon1: 2017-07-11 13:26:13.032609 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:14.074077 I | rook-ceph-mon1: 2017-07-11 13:26:12.836360 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 164 : cluster [INF] osdmap e44: 6 total, 6 up, 6 in
- 2017-07-11 13:26:14.343884 I | rook-ceph-mon1: 2017-07-11 13:26:14.343855 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:14.343991 I | rook-ceph-mon1: 2017-07-11 13:26:14.343976 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:14.350657 I | rook-ceph-mon1: 2017-07-11 13:26:14.350639 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:14.350702 I | rook-ceph-mon1: 2017-07-11 13:26:14.350689 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:14.351055 I | rook-ceph-mon1: 2017-07-11 13:26:14.351039 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:14.351096 I | rook-ceph-mon1: 2017-07-11 13:26:14.351084 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:14.351420 I | rook-ceph-mon1: 2017-07-11 13:26:14.351404 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:14.351460 I | rook-ceph-mon1: 2017-07-11 13:26:14.351447 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:14.351969 I | rook-ceph-mon1: 2017-07-11 13:26:14.351936 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:14.352012 I | rook-ceph-mon1: 2017-07-11 13:26:14.351999 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:14.352346 I | rook-ceph-mon1: 2017-07-11 13:26:14.352330 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:14.352386 I | rook-ceph-mon1: 2017-07-11 13:26:14.352373 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:15.458243 I | rook-ceph-mon1: 2017-07-11 13:26:14.259921 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 165 : cluster [INF] osdmap e45: 6 total, 6 up, 6 in
- 2017-07-11 13:26:15.949866 I | rook-ceph-mon1: 2017-07-11 13:26:15.949837 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:15.950052 I | rook-ceph-mon1: 2017-07-11 13:26:15.950029 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:15.950517 I | rook-ceph-mon1: 2017-07-11 13:26:15.950500 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:15.950702 I | rook-ceph-mon1: 2017-07-11 13:26:15.950673 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:15.951138 I | rook-ceph-mon1: 2017-07-11 13:26:15.951120 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:15.951371 I | rook-ceph-mon1: 2017-07-11 13:26:15.951356 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:15.951818 I | rook-ceph-mon1: 2017-07-11 13:26:15.951803 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:15.951895 I | rook-ceph-mon1: 2017-07-11 13:26:15.951881 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:15.961200 I | rook-ceph-mon1: 2017-07-11 13:26:15.961183 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:15.961387 I | rook-ceph-mon1: 2017-07-11 13:26:15.961355 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:15.961798 I | rook-ceph-mon1: 2017-07-11 13:26:15.961783 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:15.968158 I | rook-ceph-mon1: 2017-07-11 13:26:15.968131 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:17.060877 I | rook-ceph-mon1: 2017-07-11 13:26:07.159298 osd.1 osd.1 10.233.76.4:6800/178 17 : cluster [WRN] 9 slow requests, 5 included below; oldest blocked for > 94.465619 secs
- 2017-07-11 13:26:17.066937 I | rook-ceph-mon1: 2017-07-11 13:26:07.159317 osd.1 osd.1 10.233.76.4:6800/178 18 : cluster [WRN] slow request 94.465619 seconds old, received at 2017-07-11 13:24:32.693479: osd_pg_create(e13 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.066981 I | rook-ceph-mon1: 2017-07-11 13:26:07.159321 osd.1 osd.1 10.233.76.4:6800/178 19 : cluster [WRN] slow request 93.307052 seconds old, received at 2017-07-11 13:24:33.852047: osd_pg_create(e14 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.35:2 0.36:2 0.38:2 0.4d:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.76:2 0.80:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a9:2 0.b1:2 0.b2:2 0.b9:2 0.be:2 0.c9:2 0.ca:2 0.cf:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.209:2 0.215:2 0.21b:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.274:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2ed:2 0.2f7:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cd:2 0.3d3:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.067015 I | rook-ceph-mon1: 2017-07-11 13:26:07.159324 osd.1 osd.1 10.233.76.4:6800/178 20 : cluster [WRN] slow request 90.557336 seconds old, received at 2017-07-11 13:24:36.601763: osd_pg_create(e15 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.26:2 0.2a:2 0.35:2 0.36:2 0.38:2 0.41:2 0.4e:2 0.4f:2 0.50:2 0.52:2 0.60:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.c3:2 0.ca:2 0.cf:2 0.d2:2 0.db:2 0.df:2 0.e8:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.115:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.157:2 0.158:2 0.159:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.177:2 0.17d:2 0.18d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ab:2 0.1ae:2 0.1af:2 0.1b6:2 0.1bb:2 0.1bd:2 0.1bf:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.23d:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28e:2 0.291:2 0.294:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2a6:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2dd:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.363:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ac:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ea:2 0.3ec:2 0.3f5:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.067033 I | rook-ceph-mon1: 2017-07-11 13:26:07.159327 osd.1 osd.1 10.233.76.4:6800/178 21 : cluster [WRN] slow request 89.889977 seconds old, received at 2017-07-11 13:24:37.269122: osd_pg_create(e16 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.067047 I | rook-ceph-mon1: 2017-07-11 13:26:07.159329 osd.1 osd.1 10.233.76.4:6800/178 22 : cluster [WRN] slow request 85.594176 seconds old, received at 2017-07-11 13:24:41.564923: osd_pg_create(e17 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.067063 I | rook-ceph-mon1: 2017-07-11 13:26:08.159690 osd.1 osd.1 10.233.76.4:6800/178 23 : cluster [WRN] 9 slow requests, 5 included below; oldest blocked for > 95.466107 secs
- 2017-07-11 13:26:17.067088 I | rook-ceph-mon1: 2017-07-11 13:26:08.159695 osd.1 osd.1 10.233.76.4:6800/178 24 : cluster [WRN] slow request 95.466107 seconds old, received at 2017-07-11 13:24:32.693479: osd_pg_create(e13 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.067105 I | rook-ceph-mon1: 2017-07-11 13:26:08.159700 osd.1 osd.1 10.233.76.4:6800/178 25 : cluster [WRN] slow request 94.307540 seconds old, received at 2017-07-11 13:24:33.852047: osd_pg_create(e14 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.35:2 0.36:2 0.38:2 0.4d:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.76:2 0.80:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a9:2 0.b1:2 0.b2:2 0.b9:2 0.be:2 0.c9:2 0.ca:2 0.cf:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.209:2 0.215:2 0.21b:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.274:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2ed:2 0.2f7:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cd:2 0.3d3:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.067165 I | rook-ceph-mon1: 2017-07-11 13:26:08.159703 osd.1 osd.1 10.233.76.4:6800/178 26 : cluster [WRN] slow request 91.557823 seconds old, received at 2017-07-11 13:24:36.601763: osd_pg_create(e15 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.26:2 0.2a:2 0.35:2 0.36:2 0.38:2 0.41:2 0.4e:2 0.4f:2 0.50:2 0.52:2 0.60:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.c3:2 0.ca:2 0.cf:2 0.d2:2 0.db:2 0.df:2 0.e8:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.115:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.157:2 0.158:2 0.159:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.177:2 0.17d:2 0.18d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ab:2 0.1ae:2 0.1af:2 0.1b6:2 0.1bb:2 0.1bd:2 0.1bf:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.23d:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28e:2 0.291:2 0.294:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2a6:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2dd:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.363:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ac:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ea:2 0.3ec:2 0.3f5:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.067184 I | rook-ceph-mon1: 2017-07-11 13:26:08.159713 osd.1 osd.1 10.233.76.4:6800/178 27 : cluster [WRN] slow request 90.890464 seconds old, received at 2017-07-11 13:24:37.269122: osd_pg_create(e16 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.067200 I | rook-ceph-mon1: 2017-07-11 13:26:08.159722 osd.1 osd.1 10.233.76.4:6800/178 28 : cluster [WRN] slow request 86.594663 seconds old, received at 2017-07-11 13:24:41.564923: osd_pg_create(e17 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.067215 I | rook-ceph-mon1: 2017-07-11 13:26:12.160449 osd.1 osd.1 10.233.76.4:6800/178 29 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.466879 secs
- 2017-07-11 13:26:17.067246 I | rook-ceph-mon1: 2017-07-11 13:26:12.160455 osd.1 osd.1 10.233.76.4:6800/178 30 : cluster [WRN] slow request 30.466879 seconds old, received at 2017-07-11 13:25:41.693498: osd_pg_create(e20 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20) currently started
- 2017-07-11 13:26:17.067261 I | rook-ceph-mon1: 2017-07-11 13:26:14.161571 osd.1 osd.1 10.233.76.4:6800/178 31 : cluster [WRN] 2 slow requests, 1 included below; oldest blocked for > 32.468001 secs
- 2017-07-11 13:26:17.067275 I | rook-ceph-mon1: 2017-07-11 13:26:14.161591 osd.1 osd.1 10.233.76.4:6800/178 32 : cluster [WRN] slow request 30.543300 seconds old, received at 2017-07-11 13:25:43.618199: osd_pg_create(e22 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22) currently wait for new map
- 2017-07-11 13:26:17.067288 I | rook-ceph-mon1: 2017-07-11 13:26:15.161812 osd.1 osd.1 10.233.76.4:6800/178 33 : cluster [WRN] 3 slow requests, 1 included below; oldest blocked for > 33.468212 secs
- 2017-07-11 13:26:17.067323 I | rook-ceph-mon1: 2017-07-11 13:26:15.161819 osd.1 osd.1 10.233.76.4:6800/178 34 : cluster [WRN] slow request 30.327390 seconds old, received at 2017-07-11 13:25:44.834321: osd_pg_create(e23 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23) currently wait for new map
- 2017-07-11 13:26:17.067339 I | rook-ceph-mon1: 2017-07-11 13:26:15.869629 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 167 : cluster [INF] osdmap e46: 6 total, 6 up, 6 in
- 2017-07-11 13:26:17.278916 I | rook-ceph-mon1: 2017-07-11 13:26:17.278880 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:17.279011 I | rook-ceph-mon1: 2017-07-11 13:26:17.278996 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:17.279539 I | rook-ceph-mon1: 2017-07-11 13:26:17.279523 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:17.279742 I | rook-ceph-mon1: 2017-07-11 13:26:17.279727 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:17.280312 I | rook-ceph-mon1: 2017-07-11 13:26:17.280294 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:17.280512 I | rook-ceph-mon1: 2017-07-11 13:26:17.280480 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:17.280942 I | rook-ceph-mon1: 2017-07-11 13:26:17.280926 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:17.281098 I | rook-ceph-mon1: 2017-07-11 13:26:17.281083 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:17.281553 I | rook-ceph-mon1: 2017-07-11 13:26:17.281533 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:17.281746 I | rook-ceph-mon1: 2017-07-11 13:26:17.281717 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:17.290810 I | rook-ceph-mon1: 2017-07-11 13:26:17.290791 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:17.290882 I | rook-ceph-mon1: 2017-07-11 13:26:17.290868 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:18.588033 I | rook-ceph-mon1: 2017-07-11 13:26:18.587665 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:18.588930 I | rook-ceph-mon1: 2017-07-11 13:26:18.587690 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:18.588971 I | rook-ceph-mon1: 2017-07-11 13:26:18.587732 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:18.588991 I | rook-ceph-mon1: 2017-07-11 13:26:18.587742 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:18.589037 I | rook-ceph-mon1: 2017-07-11 13:26:18.587771 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:18.589049 I | rook-ceph-mon1: 2017-07-11 13:26:18.587779 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:18.589061 I | rook-ceph-mon1: 2017-07-11 13:26:18.587807 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:18.589085 I | rook-ceph-mon1: 2017-07-11 13:26:18.587815 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:18.589097 I | rook-ceph-mon1: 2017-07-11 13:26:18.587842 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:18.589108 I | rook-ceph-mon1: 2017-07-11 13:26:18.587850 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:18.589119 I | rook-ceph-mon1: 2017-07-11 13:26:18.587878 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:18.589130 I | rook-ceph-mon1: 2017-07-11 13:26:18.587886 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:18.657838 I | rook-ceph-mon1: 2017-07-11 13:26:17.194839 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 170 : cluster [INF] osdmap e47: 6 total, 6 up, 6 in
- 2017-07-11 13:26:20.159329 I | rook-ceph-mon1: 2017-07-11 13:26:18.359917 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 171 : cluster [INF] osdmap e48: 6 total, 6 up, 6 in
- 2017-07-11 13:26:20.182421 I | rook-ceph-mon1: 2017-07-11 13:26:20.182402 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:20.182504 I | rook-ceph-mon1: 2017-07-11 13:26:20.182491 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:20.183087 I | rook-ceph-mon1: 2017-07-11 13:26:20.183071 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:20.183161 I | rook-ceph-mon1: 2017-07-11 13:26:20.183147 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:20.183551 I | rook-ceph-mon1: 2017-07-11 13:26:20.183536 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:20.183711 I | rook-ceph-mon1: 2017-07-11 13:26:20.183696 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:20.184184 I | rook-ceph-mon1: 2017-07-11 13:26:20.184167 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:20.190181 I | rook-ceph-mon1: 2017-07-11 13:26:20.190164 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:20.190535 I | rook-ceph-mon1: 2017-07-11 13:26:20.190519 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:20.190576 I | rook-ceph-mon1: 2017-07-11 13:26:20.190563 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:20.190910 I | rook-ceph-mon1: 2017-07-11 13:26:20.190893 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:20.190951 I | rook-ceph-mon1: 2017-07-11 13:26:20.190939 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:21.413707 I | rook-ceph-mon1: 2017-07-11 13:26:20.095975 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 174 : cluster [INF] osdmap e49: 6 total, 6 up, 6 in
- 2017-07-11 13:26:21.703195 I | rook-ceph-mon1: 2017-07-11 13:26:21.703171 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:21.703432 I | rook-ceph-mon1: 2017-07-11 13:26:21.703374 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:21.704138 I | rook-ceph-mon1: 2017-07-11 13:26:21.704120 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:21.704828 I | rook-ceph-mon1: 2017-07-11 13:26:21.704812 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:21.705655 I | rook-ceph-mon1: 2017-07-11 13:26:21.705638 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:21.705796 I | rook-ceph-mon1: 2017-07-11 13:26:21.705778 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:21.706404 I | rook-ceph-mon1: 2017-07-11 13:26:21.706377 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:21.712482 I | rook-ceph-mon1: 2017-07-11 13:26:21.712464 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:21.712902 I | rook-ceph-mon1: 2017-07-11 13:26:21.712885 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:21.712972 I | rook-ceph-mon1: 2017-07-11 13:26:21.712958 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:21.713372 I | rook-ceph-mon1: 2017-07-11 13:26:21.713353 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:21.713438 I | rook-ceph-mon1: 2017-07-11 13:26:21.713425 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:22.793778 I | rook-ceph-mon1: 2017-07-11 13:26:21.595157 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 176 : cluster [INF] osdmap e50: 6 total, 6 up, 6 in
- 2017-07-11 13:26:23.097826 I | rook-ceph-mon1: 2017-07-11 13:26:23.097798 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:23.097925 I | rook-ceph-mon1: 2017-07-11 13:26:23.097910 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:23.098453 I | rook-ceph-mon1: 2017-07-11 13:26:23.098424 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:23.098634 I | rook-ceph-mon1: 2017-07-11 13:26:23.098603 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:23.099068 I | rook-ceph-mon1: 2017-07-11 13:26:23.099052 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:23.099220 I | rook-ceph-mon1: 2017-07-11 13:26:23.099206 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:23.099627 I | rook-ceph-mon1: 2017-07-11 13:26:23.099606 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:23.099848 I | rook-ceph-mon1: 2017-07-11 13:26:23.099823 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:23.100273 I | rook-ceph-mon1: 2017-07-11 13:26:23.100257 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:23.100417 I | rook-ceph-mon1: 2017-07-11 13:26:23.100404 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:23.100855 I | rook-ceph-mon1: 2017-07-11 13:26:23.100839 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:23.101013 I | rook-ceph-mon1: 2017-07-11 13:26:23.100998 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:24.160628 I | rook-ceph-mon1: 2017-07-11 13:26:22.933159 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 177 : cluster [INF] osdmap e51: 6 total, 6 up, 6 in
- 2017-07-11 13:26:24.492365 I | rook-ceph-mon1: 2017-07-11 13:26:24.492334 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:24.492487 I | rook-ceph-mon1: 2017-07-11 13:26:24.492472 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:24.492774 I | rook-ceph-mon1: 2017-07-11 13:26:24.492759 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:24.492867 I | rook-ceph-mon1: 2017-07-11 13:26:24.492853 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:24.493109 I | rook-ceph-mon1: 2017-07-11 13:26:24.493092 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:24.493182 I | rook-ceph-mon1: 2017-07-11 13:26:24.493169 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:24.493400 I | rook-ceph-mon1: 2017-07-11 13:26:24.493385 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:24.493461 I | rook-ceph-mon1: 2017-07-11 13:26:24.493444 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:24.493671 I | rook-ceph-mon1: 2017-07-11 13:26:24.493642 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:24.493734 I | rook-ceph-mon1: 2017-07-11 13:26:24.493721 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:24.493966 I | rook-ceph-mon1: 2017-07-11 13:26:24.493904 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:24.494107 I | rook-ceph-mon1: 2017-07-11 13:26:24.494013 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:24.955259 I | rook-ceph-mon1: 2017-07-11 13:26:24.955234 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:24.955362 I | rook-ceph-mon1: 2017-07-11 13:26:24.955347 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:24.955819 I | rook-ceph-mon1: 2017-07-11 13:26:24.955803 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:24.956055 I | rook-ceph-mon1: 2017-07-11 13:26:24.955979 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:24.956556 I | rook-ceph-mon1: 2017-07-11 13:26:24.956540 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:24.956752 I | rook-ceph-mon1: 2017-07-11 13:26:24.956721 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:24.957178 I | rook-ceph-mon1: 2017-07-11 13:26:24.957163 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:24.957271 I | rook-ceph-mon1: 2017-07-11 13:26:24.957257 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:24.957860 I | rook-ceph-mon1: 2017-07-11 13:26:24.957844 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:24.957924 I | rook-ceph-mon1: 2017-07-11 13:26:24.957910 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:24.958353 I | rook-ceph-mon1: 2017-07-11 13:26:24.958338 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:24.958486 I | rook-ceph-mon1: 2017-07-11 13:26:24.958438 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:25.452292 I | rook-ceph-mon1: 2017-07-11 13:26:25.452263 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:26:25.452394 I | rook-ceph-mon1: 2017-07-11 13:26:25.452379 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/437088173' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:26:25.678475 I | rook-ceph-mon1: 2017-07-11 13:26:24.544978 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 17 : cluster [WRN] message from mon.0 was stamped 0.061434s in the future, clocks not synchronized
- 2017-07-11 13:26:25.681745 I | rook-ceph-mon1: 2017-07-11 13:26:24.607488 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 181 : cluster [INF] osdmap e52: 6 total, 6 up, 6 in
- 2017-07-11 13:26:25.681777 I | rook-ceph-mon1: 2017-07-11 13:26:24.984666 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 182 : cluster [INF] osdmap e53: 6 total, 6 up, 6 in
- 2017-07-11 13:26:26.337827 I | rook-ceph-mon1: 2017-07-11 13:26:26.337784 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:26.338044 I | rook-ceph-mon1: 2017-07-11 13:26:26.337929 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:26.338467 I | rook-ceph-mon1: 2017-07-11 13:26:26.338451 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:26.338663 I | rook-ceph-mon1: 2017-07-11 13:26:26.338633 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:26.339133 I | rook-ceph-mon1: 2017-07-11 13:26:26.339116 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:26.339314 I | rook-ceph-mon1: 2017-07-11 13:26:26.339283 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:26.339688 I | rook-ceph-mon1: 2017-07-11 13:26:26.339672 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:26.339967 I | rook-ceph-mon1: 2017-07-11 13:26:26.339885 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:26.340380 I | rook-ceph-mon1: 2017-07-11 13:26:26.340364 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:26.340559 I | rook-ceph-mon1: 2017-07-11 13:26:26.340525 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:26.364673 I | rook-ceph-mon1: 2017-07-11 13:26:26.364645 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:26.364977 I | rook-ceph-mon1: 2017-07-11 13:26:26.364961 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:27.124908 I | rook-ceph-mon1: 2017-07-11 13:26:17.162225 osd.1 osd.1 10.233.76.4:6800/178 35 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 35.468642 secs
- 2017-07-11 13:26:27.124965 I | rook-ceph-mon1: 2017-07-11 13:26:17.162232 osd.1 osd.1 10.233.76.4:6800/178 36 : cluster [WRN] slow request 30.848726 seconds old, received at 2017-07-11 13:25:46.313414: osd_pg_create(e24 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24) currently wait for new map
- 2017-07-11 13:26:27.124984 I | rook-ceph-mon1: 2017-07-11 13:26:20.829370 osd.0 osd.0 10.233.72.0:6800/180 28 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.071046 secs
- 2017-07-11 13:26:27.124999 I | rook-ceph-mon1: 2017-07-11 13:26:20.829376 osd.0 osd.0 10.233.72.0:6800/180 29 : cluster [WRN] slow request 30.071046 seconds old, received at 2017-07-11 13:25:50.758281: osd_pg_create(e27 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27) currently started
- 2017-07-11 13:26:27.125026 I | rook-ceph-mon1: 2017-07-11 13:26:22.829661 osd.0 osd.0 10.233.72.0:6800/180 30 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.543594 secs
- 2017-07-11 13:26:27.125043 I | rook-ceph-mon1: 2017-07-11 13:26:22.829679 osd.0 osd.0 10.233.72.0:6800/180 31 : cluster [WRN] slow request 30.543594 seconds old, received at 2017-07-11 13:25:52.286024: osd_pg_create(e28 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28) currently started
- 2017-07-11 13:26:27.125055 I | rook-ceph-mon1: 2017-07-11 13:26:24.830147 osd.0 osd.0 10.233.72.0:6800/180 32 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.142821 secs
- 2017-07-11 13:26:27.125068 I | rook-ceph-mon1: 2017-07-11 13:26:24.830158 osd.0 osd.0 10.233.72.0:6800/180 33 : cluster [WRN] slow request 30.142821 seconds old, received at 2017-07-11 13:25:54.687199: osd_pg_create(e30 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30) currently started
- 2017-07-11 13:26:27.125086 I | rook-ceph-mon1: 2017-07-11 13:26:26.249529 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 183 : cluster [INF] osdmap e54: 6 total, 6 up, 6 in
- 2017-07-11 13:26:27.625863 I | rook-ceph-mon1: 2017-07-11 13:26:27.625831 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:27.626073 I | rook-ceph-mon1: 2017-07-11 13:26:27.625981 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:27.643082 I | rook-ceph-mon1: 2017-07-11 13:26:27.626506 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:27.643342 I | rook-ceph-mon1: 2017-07-11 13:26:27.633790 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:27.643391 I | rook-ceph-mon1: 2017-07-11 13:26:27.634202 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:27.643405 I | rook-ceph-mon1: 2017-07-11 13:26:27.634225 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:27.643444 I | rook-ceph-mon1: 2017-07-11 13:26:27.634580 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:27.643458 I | rook-ceph-mon1: 2017-07-11 13:26:27.634658 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:27.643483 I | rook-ceph-mon1: 2017-07-11 13:26:27.634993 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:27.643494 I | rook-ceph-mon1: 2017-07-11 13:26:27.642317 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:27.643505 I | rook-ceph-mon1: 2017-07-11 13:26:27.642691 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:27.643581 I | rook-ceph-mon1: 2017-07-11 13:26:27.642717 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:28.720560 I | rook-ceph-mon1: 2017-07-11 13:26:27.534845 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 184 : cluster [INF] osdmap e55: 6 total, 6 up, 6 in
- 2017-07-11 13:26:28.971377 I | rook-ceph-mon1: 2017-07-11 13:26:28.971350 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:28.971473 I | rook-ceph-mon1: 2017-07-11 13:26:28.971459 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:28.972039 I | rook-ceph-mon1: 2017-07-11 13:26:28.972022 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:28.972212 I | rook-ceph-mon1: 2017-07-11 13:26:28.972181 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:28.972641 I | rook-ceph-mon1: 2017-07-11 13:26:28.972625 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:28.972807 I | rook-ceph-mon1: 2017-07-11 13:26:28.972778 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:28.973242 I | rook-ceph-mon1: 2017-07-11 13:26:28.973225 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:28.973405 I | rook-ceph-mon1: 2017-07-11 13:26:28.973391 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:28.973803 I | rook-ceph-mon1: 2017-07-11 13:26:28.973787 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:28.974009 I | rook-ceph-mon1: 2017-07-11 13:26:28.973971 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:28.974463 I | rook-ceph-mon1: 2017-07-11 13:26:28.974446 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:28.974649 I | rook-ceph-mon1: 2017-07-11 13:26:28.974618 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:30.267902 I | rook-ceph-mon1: 2017-07-11 13:26:28.974868 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 185 : cluster [INF] osdmap e56: 6 total, 6 up, 6 in
- 2017-07-11 13:26:30.548934 I | rook-ceph-mon1: 2017-07-11 13:26:30.547680 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:30.549128 I | rook-ceph-mon1: 2017-07-11 13:26:30.547715 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:30.549188 I | rook-ceph-mon1: 2017-07-11 13:26:30.547989 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:30.549205 I | rook-ceph-mon1: 2017-07-11 13:26:30.548009 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:30.549256 I | rook-ceph-mon1: 2017-07-11 13:26:30.548270 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:30.549289 I | rook-ceph-mon1: 2017-07-11 13:26:30.548301 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:30.549328 I | rook-ceph-mon1: 2017-07-11 13:26:30.548545 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:30.549400 I | rook-ceph-mon1: 2017-07-11 13:26:30.548565 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:30.549488 I | rook-ceph-mon1: 2017-07-11 13:26:30.549456 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:30.549533 I | rook-ceph-mon1: 2017-07-11 13:26:30.549520 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:30.549999 I | rook-ceph-mon1: 2017-07-11 13:26:30.549925 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:30.550058 I | rook-ceph-mon1: 2017-07-11 13:26:30.550045 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:32.051165 I | rook-ceph-mon1: 2017-07-11 13:26:30.479527 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 186 : cluster [INF] osdmap e57: 6 total, 6 up, 6 in
- 2017-07-11 13:26:32.059531 I | rook-ceph-mon1: 2017-07-11 13:26:32.059510 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:32.059611 I | rook-ceph-mon1: 2017-07-11 13:26:32.059597 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:32.061368 I | rook-ceph-mon1: 2017-07-11 13:26:32.061352 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:32.061433 I | rook-ceph-mon1: 2017-07-11 13:26:32.061420 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:32.061827 I | rook-ceph-mon1: 2017-07-11 13:26:32.061811 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:32.061894 I | rook-ceph-mon1: 2017-07-11 13:26:32.061880 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:32.062288 I | rook-ceph-mon1: 2017-07-11 13:26:32.062273 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:32.062349 I | rook-ceph-mon1: 2017-07-11 13:26:32.062337 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:32.062840 I | rook-ceph-mon1: 2017-07-11 13:26:32.062824 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:32.079570 I | rook-ceph-mon1: 2017-07-11 13:26:32.079549 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:32.082707 I | rook-ceph-mon1: 2017-07-11 13:26:32.082691 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:32.082917 I | rook-ceph-mon1: 2017-07-11 13:26:32.082881 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:33.136092 I | rook-ceph-mon1: 2017-07-11 13:26:31.970396 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 187 : cluster [INF] osdmap e58: 6 total, 6 up, 6 in
- 2017-07-11 13:26:33.455327 I | rook-ceph-mon1: 2017-07-11 13:26:33.455184 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:33.455376 I | rook-ceph-mon1: 2017-07-11 13:26:33.455208 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:33.455838 I | rook-ceph-mon1: 2017-07-11 13:26:33.455727 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:33.455874 I | rook-ceph-mon1: 2017-07-11 13:26:33.455751 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:33.456258 I | rook-ceph-mon1: 2017-07-11 13:26:33.456150 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:33.456291 I | rook-ceph-mon1: 2017-07-11 13:26:33.456168 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:33.456671 I | rook-ceph-mon1: 2017-07-11 13:26:33.456571 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:33.456704 I | rook-ceph-mon1: 2017-07-11 13:26:33.456588 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:33.456958 I | rook-ceph-mon1: 2017-07-11 13:26:33.456941 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:33.457016 I | rook-ceph-mon1: 2017-07-11 13:26:33.457004 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:33.457411 I | rook-ceph-mon1: 2017-07-11 13:26:33.457396 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:33.457472 I | rook-ceph-mon1: 2017-07-11 13:26:33.457459 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:34.461478 I | rook-ceph-mon1: 2017-07-11 13:26:33.376719 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 188 : cluster [INF] osdmap e59: 6 total, 6 up, 6 in
- 2017-07-11 13:26:34.747654 I | rook-ceph-mon1: 2017-07-11 13:26:34.747630 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:34.747751 I | rook-ceph-mon1: 2017-07-11 13:26:34.747735 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:34.748343 I | rook-ceph-mon1: 2017-07-11 13:26:34.748312 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:34.748414 I | rook-ceph-mon1: 2017-07-11 13:26:34.748400 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:34.748868 I | rook-ceph-mon1: 2017-07-11 13:26:34.748823 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:34.749026 I | rook-ceph-mon1: 2017-07-11 13:26:34.749012 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:34.749412 I | rook-ceph-mon1: 2017-07-11 13:26:34.749397 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:34.749584 I | rook-ceph-mon1: 2017-07-11 13:26:34.749569 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:34.749993 I | rook-ceph-mon1: 2017-07-11 13:26:34.749977 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:34.750146 I | rook-ceph-mon1: 2017-07-11 13:26:34.750132 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:34.766508 I | rook-ceph-mon1: 2017-07-11 13:26:34.766472 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:34.766577 I | rook-ceph-mon1: 2017-07-11 13:26:34.766564 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:35.883747 I | rook-ceph-mon1: 2017-07-11 13:26:34.780390 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 190 : cluster [INF] osdmap e60: 6 total, 6 up, 6 in
- 2017-07-11 13:26:36.173875 I | rook-ceph-mon1: 2017-07-11 13:26:36.173842 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:36.174035 I | rook-ceph-mon1: 2017-07-11 13:26:36.173971 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:36.174438 I | rook-ceph-mon1: 2017-07-11 13:26:36.174422 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:36.174638 I | rook-ceph-mon1: 2017-07-11 13:26:36.174622 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:36.175091 I | rook-ceph-mon1: 2017-07-11 13:26:36.175075 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:36.175269 I | rook-ceph-mon1: 2017-07-11 13:26:36.175239 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:36.175636 I | rook-ceph-mon1: 2017-07-11 13:26:36.175620 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:36.175807 I | rook-ceph-mon1: 2017-07-11 13:26:36.175792 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:36.176238 I | rook-ceph-mon1: 2017-07-11 13:26:36.176221 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:36.176392 I | rook-ceph-mon1: 2017-07-11 13:26:36.176378 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:36.176850 I | rook-ceph-mon1: 2017-07-11 13:26:36.176834 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:36.177009 I | rook-ceph-mon1: 2017-07-11 13:26:36.176994 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:37.379682 I | rook-ceph-mon1: 2017-07-11 13:26:26.830562 osd.0 osd.0 10.233.72.0:6800/180 34 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.597081 secs
- 2017-07-11 13:26:37.382530 I | rook-ceph-mon1: 2017-07-11 13:26:26.830569 osd.0 osd.0 10.233.72.0:6800/180 35 : cluster [WRN] slow request 30.597081 seconds old, received at 2017-07-11 13:25:56.233433: osd_pg_create(e31 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31) currently started
- 2017-07-11 13:26:37.382566 I | rook-ceph-mon1: 2017-07-11 13:26:27.830893 osd.0 osd.0 10.233.72.0:6800/180 36 : cluster [WRN] 2 slow requests, 1 included below; oldest blocked for > 31.597350 secs
- 2017-07-11 13:26:37.382585 I | rook-ceph-mon1: 2017-07-11 13:26:27.830902 osd.0 osd.0 10.233.72.0:6800/180 37 : cluster [WRN] slow request 30.309489 seconds old, received at 2017-07-11 13:25:57.521293: osd_pg_create(e32 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32) currently wait for new map
- 2017-07-11 13:26:37.382617 I | rook-ceph-mon1: 2017-07-11 13:26:28.831009 osd.0 osd.0 10.233.72.0:6800/180 38 : cluster [WRN] 3 slow requests, 1 included below; oldest blocked for > 32.597519 secs
- 2017-07-11 13:26:37.399354 I | rook-ceph-mon1: 2017-07-11 13:26:28.831014 osd.0 osd.0 10.233.72.0:6800/180 39 : cluster [WRN] slow request 30.100007 seconds old, received at 2017-07-11 13:25:58.730944: osd_pg_create(e33 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33) currently wait for new map
- 2017-07-11 13:26:37.399622 I | rook-ceph-mon1: 2017-07-11 13:26:30.831460 osd.0 osd.0 10.233.72.0:6800/180 40 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 34.597969 secs
- 2017-07-11 13:26:37.399654 I | rook-ceph-mon1: 2017-07-11 13:26:30.831466 osd.0 osd.0 10.233.72.0:6800/180 41 : cluster [WRN] slow request 30.753834 seconds old, received at 2017-07-11 13:26:00.077568: osd_pg_create(e34 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:37.399670 I | rook-ceph-mon1: 2017-07-11 13:26:31.831824 osd.0 osd.0 10.233.72.0:6800/180 42 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 34.310429 secs
- 2017-07-11 13:26:37.399699 I | rook-ceph-mon1: 2017-07-11 13:26:31.831833 osd.0 osd.0 10.233.72.0:6800/180 43 : cluster [WRN] slow request 30.375894 seconds old, received at 2017-07-11 13:26:01.455829: osd_pg_create(e35 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:37.399713 I | rook-ceph-mon1: 2017-07-11 13:26:32.832209 osd.0 osd.0 10.233.72.0:6800/180 44 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 34.101149 secs
- 2017-07-11 13:26:37.399724 I | rook-ceph-mon1: 2017-07-11 13:26:32.832221 osd.0 osd.0 10.233.72.0:6800/180 45 : cluster [WRN] slow request 30.254009 seconds old, received at 2017-07-11 13:26:02.578084: osd_pg_create(e36 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:37.399738 I | rook-ceph-mon1: 2017-07-11 13:26:33.832455 osd.0 osd.0 10.233.72.0:6800/180 46 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 33.754838 secs
- 2017-07-11 13:26:37.399750 I | rook-ceph-mon1: 2017-07-11 13:26:33.832460 osd.0 osd.0 10.233.72.0:6800/180 47 : cluster [WRN] slow request 30.052972 seconds old, received at 2017-07-11 13:26:03.779434: osd_pg_create(e37 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:37.399780 I | rook-ceph-mon1: 2017-07-11 13:26:36.091120 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 191 : cluster [INF] osdmap e61: 6 total, 6 up, 6 in
- 2017-07-11 13:26:37.590991 I | rook-ceph-mon1: 2017-07-11 13:26:37.590176 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:37.591044 I | rook-ceph-mon1: 2017-07-11 13:26:37.590214 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:37.591070 I | rook-ceph-mon1: 2017-07-11 13:26:37.590340 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:37.591086 I | rook-ceph-mon1: 2017-07-11 13:26:37.590359 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:37.591097 I | rook-ceph-mon1: 2017-07-11 13:26:37.590457 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:37.591123 I | rook-ceph-mon1: 2017-07-11 13:26:37.590476 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:37.591144 I | rook-ceph-mon1: 2017-07-11 13:26:37.590584 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:37.591168 I | rook-ceph-mon1: 2017-07-11 13:26:37.590614 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:37.591179 I | rook-ceph-mon1: 2017-07-11 13:26:37.590714 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:37.591202 I | rook-ceph-mon1: 2017-07-11 13:26:37.590731 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:37.591215 I | rook-ceph-mon1: 2017-07-11 13:26:37.590845 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:37.591226 I | rook-ceph-mon1: 2017-07-11 13:26:37.590863 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:38.732640 I | rook-ceph-mon1: 2017-07-11 13:26:38.732616 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:38.732800 I | rook-ceph-mon1: 2017-07-11 13:26:38.732721 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:38.733246 I | rook-ceph-mon1: 2017-07-11 13:26:38.733230 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:38.733431 I | rook-ceph-mon1: 2017-07-11 13:26:38.733398 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:38.733935 I | rook-ceph-mon1: 2017-07-11 13:26:38.733919 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:38.739859 I | rook-ceph-mon1: 2017-07-11 13:26:38.739842 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:38.740232 I | rook-ceph-mon1: 2017-07-11 13:26:38.740214 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:38.740276 I | rook-ceph-mon1: 2017-07-11 13:26:38.740263 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:38.740741 I | rook-ceph-mon1: 2017-07-11 13:26:38.740725 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:38.740782 I | rook-ceph-mon1: 2017-07-11 13:26:38.740770 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:38.741180 I | rook-ceph-mon1: 2017-07-11 13:26:38.741152 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:38.741226 I | rook-ceph-mon1: 2017-07-11 13:26:38.741212 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:38.937003 I | rook-ceph-mon1: 2017-07-11 13:26:37.593638 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 193 : cluster [INF] osdmap e62: 6 total, 6 up, 6 in
- 2017-07-11 13:26:39.860043 I | rook-ceph-mon1: 2017-07-11 13:26:39.860015 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:39.860147 I | rook-ceph-mon1: 2017-07-11 13:26:39.860131 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:39.860674 I | rook-ceph-mon1: 2017-07-11 13:26:39.860658 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:39.860838 I | rook-ceph-mon1: 2017-07-11 13:26:39.860823 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:39.861247 I | rook-ceph-mon1: 2017-07-11 13:26:39.861231 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:39.861458 I | rook-ceph-mon1: 2017-07-11 13:26:39.861426 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:39.861914 I | rook-ceph-mon1: 2017-07-11 13:26:39.861897 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:39.862085 I | rook-ceph-mon1: 2017-07-11 13:26:39.862054 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:39.862504 I | rook-ceph-mon1: 2017-07-11 13:26:39.862488 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:39.862660 I | rook-ceph-mon1: 2017-07-11 13:26:39.862645 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:39.863059 I | rook-ceph-mon1: 2017-07-11 13:26:39.863043 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:39.863229 I | rook-ceph-mon1: 2017-07-11 13:26:39.863214 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:40.121594 I | rook-ceph-mon1: 2017-07-11 13:26:38.748128 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 194 : cluster [INF] osdmap e63: 6 total, 6 up, 6 in
- 2017-07-11 13:26:40.121674 I | rook-ceph-mon1: 2017-07-11 13:26:39.827594 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 195 : cluster [INF] osdmap e64: 6 total, 6 up, 6 in
- 2017-07-11 13:26:40.969063 I | rook-ceph-mon1: 2017-07-11 13:26:40.969036 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:40.969162 I | rook-ceph-mon1: 2017-07-11 13:26:40.969146 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:40.969695 I | rook-ceph-mon1: 2017-07-11 13:26:40.969679 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:40.969871 I | rook-ceph-mon1: 2017-07-11 13:26:40.969841 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:40.970315 I | rook-ceph-mon1: 2017-07-11 13:26:40.970287 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:40.970504 I | rook-ceph-mon1: 2017-07-11 13:26:40.970469 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:40.977980 I | rook-ceph-mon1: 2017-07-11 13:26:40.977962 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:40.979533 I | rook-ceph-mon1: 2017-07-11 13:26:40.979517 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:40.979975 I | rook-ceph-mon1: 2017-07-11 13:26:40.979959 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:40.980039 I | rook-ceph-mon1: 2017-07-11 13:26:40.980025 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:40.980364 I | rook-ceph-mon1: 2017-07-11 13:26:40.980348 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:40.980534 I | rook-ceph-mon1: 2017-07-11 13:26:40.980519 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:42.064479 I | rook-ceph-mon1: 2017-07-11 13:26:40.946120 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 196 : cluster [INF] osdmap e65: 6 total, 6 up, 6 in
- 2017-07-11 13:26:42.325700 I | rook-ceph-mon1: 2017-07-11 13:26:42.325672 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:42.325862 I | rook-ceph-mon1: 2017-07-11 13:26:42.325796 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:42.326223 I | rook-ceph-mon1: 2017-07-11 13:26:42.326207 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:42.326284 I | rook-ceph-mon1: 2017-07-11 13:26:42.326272 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:42.326654 I | rook-ceph-mon1: 2017-07-11 13:26:42.326614 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:42.326727 I | rook-ceph-mon1: 2017-07-11 13:26:42.326714 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:42.327037 I | rook-ceph-mon1: 2017-07-11 13:26:42.327022 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:42.327101 I | rook-ceph-mon1: 2017-07-11 13:26:42.327084 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:42.327410 I | rook-ceph-mon1: 2017-07-11 13:26:42.327395 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:42.327484 I | rook-ceph-mon1: 2017-07-11 13:26:42.327471 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:42.327832 I | rook-ceph-mon1: 2017-07-11 13:26:42.327817 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:42.327891 I | rook-ceph-mon1: 2017-07-11 13:26:42.327879 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:43.378807 I | rook-ceph-mon1: 2017-07-11 13:26:42.221963 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 197 : cluster [INF] osdmap e66: 6 total, 6 up, 6 in
- 2017-07-11 13:26:43.553120 I | rook-ceph-mon1: 2017-07-11 13:26:43.553089 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:43.553280 I | rook-ceph-mon1: 2017-07-11 13:26:43.553215 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:43.553510 I | rook-ceph-mon1: 2017-07-11 13:26:43.553493 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:43.553572 I | rook-ceph-mon1: 2017-07-11 13:26:43.553559 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:43.553825 I | rook-ceph-mon1: 2017-07-11 13:26:43.553806 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:43.553889 I | rook-ceph-mon1: 2017-07-11 13:26:43.553875 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:43.554118 I | rook-ceph-mon1: 2017-07-11 13:26:43.554102 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:43.554182 I | rook-ceph-mon1: 2017-07-11 13:26:43.554164 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:43.570082 I | rook-ceph-mon1: 2017-07-11 13:26:43.570064 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:43.570151 I | rook-ceph-mon1: 2017-07-11 13:26:43.570138 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:43.570370 I | rook-ceph-mon1: 2017-07-11 13:26:43.570354 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:43.570430 I | rook-ceph-mon1: 2017-07-11 13:26:43.570417 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:44.646646 I | rook-ceph-mon1: 2017-07-11 13:26:44.646254 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:44.646720 I | rook-ceph-mon1: 2017-07-11 13:26:44.646278 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:44.646736 I | rook-ceph-mon1: 2017-07-11 13:26:44.646319 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:44.646748 I | rook-ceph-mon1: 2017-07-11 13:26:44.646329 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:44.646758 I | rook-ceph-mon1: 2017-07-11 13:26:44.646382 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:44.646785 I | rook-ceph-mon1: 2017-07-11 13:26:44.646391 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:44.646797 I | rook-ceph-mon1: 2017-07-11 13:26:44.646424 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:44.646807 I | rook-ceph-mon1: 2017-07-11 13:26:44.646433 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:44.646817 I | rook-ceph-mon1: 2017-07-11 13:26:44.646460 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:44.646827 I | rook-ceph-mon1: 2017-07-11 13:26:44.646468 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:44.646839 I | rook-ceph-mon1: 2017-07-11 13:26:44.646495 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:44.646861 I | rook-ceph-mon1: 2017-07-11 13:26:44.646504 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:44.789445 I | rook-ceph-mon1: 2017-07-11 13:26:43.554323 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 199 : cluster [INF] osdmap e67: 6 total, 6 up, 6 in
- 2017-07-11 13:26:45.761963 I | rook-ceph-mon1: 2017-07-11 13:26:45.761396 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:45.762012 I | rook-ceph-mon1: 2017-07-11 13:26:45.761419 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:45.762027 I | rook-ceph-mon1: 2017-07-11 13:26:45.761517 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:45.762039 I | rook-ceph-mon1: 2017-07-11 13:26:45.761527 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:45.762049 I | rook-ceph-mon1: 2017-07-11 13:26:45.761593 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:45.762060 I | rook-ceph-mon1: 2017-07-11 13:26:45.761602 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:45.762093 I | rook-ceph-mon1: 2017-07-11 13:26:45.761682 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:45.762104 I | rook-ceph-mon1: 2017-07-11 13:26:45.761691 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:45.762114 I | rook-ceph-mon1: 2017-07-11 13:26:45.761754 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:45.762127 I | rook-ceph-mon1: 2017-07-11 13:26:45.761763 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:45.762139 I | rook-ceph-mon1: 2017-07-11 13:26:45.761826 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:45.762163 I | rook-ceph-mon1: 2017-07-11 13:26:45.761845 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:45.958861 I | rook-ceph-mon1: 2017-07-11 13:26:44.559618 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 200 : cluster [INF] osdmap e68: 6 total, 6 up, 6 in
- 2017-07-11 13:26:45.961278 I | rook-ceph-mon1: 2017-07-11 13:26:45.713969 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 202 : cluster [INF] osdmap e69: 6 total, 6 up, 6 in
- 2017-07-11 13:26:46.267123 I | rook-ceph-mon1: 2017-07-11 13:26:46.267093 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:46.268331 I | rook-ceph-mon1: 2017-07-11 13:26:46.268314 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:46.268725 I | rook-ceph-mon1: 2017-07-11 13:26:46.268710 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:46.268932 I | rook-ceph-mon1: 2017-07-11 13:26:46.268917 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:46.269305 I | rook-ceph-mon1: 2017-07-11 13:26:46.269289 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:46.269505 I | rook-ceph-mon1: 2017-07-11 13:26:46.269475 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:46.269837 I | rook-ceph-mon1: 2017-07-11 13:26:46.269821 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:46.270017 I | rook-ceph-mon1: 2017-07-11 13:26:46.269998 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:46.270479 I | rook-ceph-mon1: 2017-07-11 13:26:46.270462 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:46.270542 I | rook-ceph-mon1: 2017-07-11 13:26:46.270527 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:46.286960 I | rook-ceph-mon1: 2017-07-11 13:26:46.286942 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:46.287026 I | rook-ceph-mon1: 2017-07-11 13:26:46.287012 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:47.319392 I | rook-ceph-mon1: 2017-07-11 13:26:38.835307 osd.0 osd.0 10.233.72.0:6800/180 48 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.076084 secs
- 2017-07-11 13:26:47.319483 I | rook-ceph-mon1: 2017-07-11 13:26:38.835318 osd.0 osd.0 10.233.72.0:6800/180 49 : cluster [WRN] slow request 30.076084 seconds old, received at 2017-07-11 13:26:08.759104: osd_pg_create(e41 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:47.319519 I | rook-ceph-mon1: 2017-07-11 13:26:43.166749 osd.1 osd.1 10.233.76.4:6800/178 37 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 55.346405 secs
- 2017-07-11 13:26:47.319541 I | rook-ceph-mon1: 2017-07-11 13:26:43.166758 osd.1 osd.1 10.233.76.4:6800/178 38 : cluster [WRN] slow request 55.346405 seconds old, received at 2017-07-11 13:25:47.820229: osd_pg_create(e25 0.3:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25) currently started
- 2017-07-11 13:26:47.319557 I | rook-ceph-mon1: 2017-07-11 13:26:45.805588 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 203 : cluster [INF] osd.0 failed (root=default,host=master-1) (4 reporters from different host after 26.267545 >= grace 23.937452)
- 2017-07-11 13:26:47.319567 I | rook-ceph-mon1: 2017-07-11 13:26:45.805620 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 204 : cluster [INF] osd.3 failed (root=default,host=master-2) (4 reporters from different host after 26.267504 >= grace 23.712746)
- 2017-07-11 13:26:47.319578 I | rook-ceph-mon1: 2017-07-11 13:26:46.134972 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 205 : cluster [INF] osdmap e70: 6 total, 4 up, 6 in
- 2017-07-11 13:26:47.592642 I | rook-ceph-mon1: 2017-07-11 13:26:47.592622 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:47.592728 I | rook-ceph-mon1: 2017-07-11 13:26:47.592713 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:47.593157 I | rook-ceph-mon1: 2017-07-11 13:26:47.593140 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:47.593245 I | rook-ceph-mon1: 2017-07-11 13:26:47.593222 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:47.593653 I | rook-ceph-mon1: 2017-07-11 13:26:47.593637 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:47.593720 I | rook-ceph-mon1: 2017-07-11 13:26:47.593706 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:47.594076 I | rook-ceph-mon1: 2017-07-11 13:26:47.594061 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:47.594145 I | rook-ceph-mon1: 2017-07-11 13:26:47.594127 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:47.600467 I | rook-ceph-mon1: 2017-07-11 13:26:47.600449 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:47.600511 I | rook-ceph-mon1: 2017-07-11 13:26:47.600499 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:47.600822 I | rook-ceph-mon1: 2017-07-11 13:26:47.600806 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:47.600865 I | rook-ceph-mon1: 2017-07-11 13:26:47.600852 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:48.698762 I | rook-ceph-mon1: 2017-07-11 13:26:46.043420 osd.3 osd.3 10.233.86.0:6800/178 14 : cluster [WRN] map e70 wrongly marked me down at e70
- 2017-07-11 13:26:48.705616 I | rook-ceph-mon1: 2017-07-11 13:26:47.543925 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 206 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:26:48.705625 I | rook-ceph-mon1: 2017-07-11 13:26:47.544312 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 207 : cluster [INF] osdmap e71: 6 total, 5 up, 6 in
- 2017-07-11 13:26:48.826354 I | rook-ceph-mon1: 2017-07-11 13:26:48.826333 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:48.826556 I | rook-ceph-mon1: 2017-07-11 13:26:48.826524 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:48.833976 I | rook-ceph-mon1: 2017-07-11 13:26:48.833959 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:48.834147 I | rook-ceph-mon1: 2017-07-11 13:26:48.834133 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:48.834569 I | rook-ceph-mon1: 2017-07-11 13:26:48.834552 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:48.834724 I | rook-ceph-mon1: 2017-07-11 13:26:48.834710 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:48.835147 I | rook-ceph-mon1: 2017-07-11 13:26:48.835132 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:48.835326 I | rook-ceph-mon1: 2017-07-11 13:26:48.835298 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:48.835696 I | rook-ceph-mon1: 2017-07-11 13:26:48.835681 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:48.835868 I | rook-ceph-mon1: 2017-07-11 13:26:48.835838 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:48.836275 I | rook-ceph-mon1: 2017-07-11 13:26:48.836260 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:48.836426 I | rook-ceph-mon1: 2017-07-11 13:26:48.836412 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:49.937886 I | rook-ceph-mon1: 2017-07-11 13:26:48.833016 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 208 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:26:49.939950 I | rook-ceph-mon1: 2017-07-11 13:26:48.833386 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 209 : cluster [INF] osdmap e72: 6 total, 6 up, 6 in
- 2017-07-11 13:26:50.210144 I | rook-ceph-mon1: 2017-07-11 13:26:50.210122 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:50.210229 I | rook-ceph-mon1: 2017-07-11 13:26:50.210215 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:50.210715 I | rook-ceph-mon1: 2017-07-11 13:26:50.210699 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:50.210885 I | rook-ceph-mon1: 2017-07-11 13:26:50.210871 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:50.211334 I | rook-ceph-mon1: 2017-07-11 13:26:50.211319 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:50.211491 I | rook-ceph-mon1: 2017-07-11 13:26:50.211476 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:50.211871 I | rook-ceph-mon1: 2017-07-11 13:26:50.211855 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:50.212058 I | rook-ceph-mon1: 2017-07-11 13:26:50.212015 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:50.212536 I | rook-ceph-mon1: 2017-07-11 13:26:50.212521 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:50.212696 I | rook-ceph-mon1: 2017-07-11 13:26:50.212678 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:50.213077 I | rook-ceph-mon1: 2017-07-11 13:26:50.213062 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:50.221687 I | rook-ceph-mon1: 2017-07-11 13:26:50.221670 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:51.738777 I | rook-ceph-mon1: 2017-07-11 13:26:50.173078 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 210 : cluster [INF] osdmap e73: 6 total, 6 up, 6 in
- 2017-07-11 13:26:51.981770 I | rook-ceph-mon1: 2017-07-11 13:26:51.981741 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:51.981860 I | rook-ceph-mon1: 2017-07-11 13:26:51.981845 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:51.982312 I | rook-ceph-mon1: 2017-07-11 13:26:51.982293 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:51.982381 I | rook-ceph-mon1: 2017-07-11 13:26:51.982367 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:51.982759 I | rook-ceph-mon1: 2017-07-11 13:26:51.982743 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:51.982822 I | rook-ceph-mon1: 2017-07-11 13:26:51.982809 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:51.999041 I | rook-ceph-mon1: 2017-07-11 13:26:51.999021 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:51.999127 I | rook-ceph-mon1: 2017-07-11 13:26:51.999112 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:51.999448 I | rook-ceph-mon1: 2017-07-11 13:26:51.999432 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:51.999511 I | rook-ceph-mon1: 2017-07-11 13:26:51.999497 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:51.999804 I | rook-ceph-mon1: 2017-07-11 13:26:51.999787 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:51.999869 I | rook-ceph-mon1: 2017-07-11 13:26:51.999855 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:53.088596 I | rook-ceph-mon1: 2017-07-11 13:26:51.878798 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 211 : cluster [INF] osdmap e74: 6 total, 6 up, 6 in
- 2017-07-11 13:26:53.279111 I | rook-ceph-mon1: 2017-07-11 13:26:53.279083 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:53.279201 I | rook-ceph-mon1: 2017-07-11 13:26:53.279186 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:53.279835 I | rook-ceph-mon1: 2017-07-11 13:26:53.279815 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:53.279902 I | rook-ceph-mon1: 2017-07-11 13:26:53.279888 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:53.280205 I | rook-ceph-mon1: 2017-07-11 13:26:53.280189 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:53.280363 I | rook-ceph-mon1: 2017-07-11 13:26:53.280348 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:53.280655 I | rook-ceph-mon1: 2017-07-11 13:26:53.280639 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:53.280811 I | rook-ceph-mon1: 2017-07-11 13:26:53.280796 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:53.281127 I | rook-ceph-mon1: 2017-07-11 13:26:53.281107 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:53.281284 I | rook-ceph-mon1: 2017-07-11 13:26:53.281269 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:53.281573 I | rook-ceph-mon1: 2017-07-11 13:26:53.281556 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:53.281737 I | rook-ceph-mon1: 2017-07-11 13:26:53.281719 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:54.162436 I | rook-ceph-mon1: 2017-07-11 13:26:54.162217 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4681 MB, avail 94506 MB
- 2017-07-11 13:26:54.334232 I | rook-ceph-mon1: 2017-07-11 13:26:54.334207 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:54.334344 I | rook-ceph-mon1: 2017-07-11 13:26:54.334328 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:54.334928 I | rook-ceph-mon1: 2017-07-11 13:26:54.334910 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:54.335140 I | rook-ceph-mon1: 2017-07-11 13:26:54.335124 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:54.335715 I | rook-ceph-mon1: 2017-07-11 13:26:54.335697 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:54.335939 I | rook-ceph-mon1: 2017-07-11 13:26:54.335906 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:54.336403 I | rook-ceph-mon1: 2017-07-11 13:26:54.336386 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:54.336704 I | rook-ceph-mon1: 2017-07-11 13:26:54.336689 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:54.337120 I | rook-ceph-mon1: 2017-07-11 13:26:54.337104 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:54.337310 I | rook-ceph-mon1: 2017-07-11 13:26:54.337280 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:54.337834 I | rook-ceph-mon1: 2017-07-11 13:26:54.337818 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:54.347606 I | rook-ceph-mon1: 2017-07-11 13:26:54.347585 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:54.484762 I | rook-ceph-mon1: 2017-07-11 13:26:53.234203 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 212 : cluster [INF] osdmap e75: 6 total, 6 up, 6 in
- 2017-07-11 13:26:55.441797 I | rook-ceph-mon1: 2017-07-11 13:26:55.441764 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:26:55.441977 I | rook-ceph-mon1: 2017-07-11 13:26:55.441906 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:26:55.442237 I | rook-ceph-mon1: 2017-07-11 13:26:55.442223 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:26:55.442297 I | rook-ceph-mon1: 2017-07-11 13:26:55.442284 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:26:55.448898 I | rook-ceph-mon1: 2017-07-11 13:26:55.448882 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:26:55.449272 I | rook-ceph-mon1: 2017-07-11 13:26:55.449256 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:26:55.449483 I | rook-ceph-mon1: 2017-07-11 13:26:55.449468 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:26:55.449542 I | rook-ceph-mon1: 2017-07-11 13:26:55.449529 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:26:55.449776 I | rook-ceph-mon1: 2017-07-11 13:26:55.449754 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:26:55.449835 I | rook-ceph-mon1: 2017-07-11 13:26:55.449822 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:26:55.450070 I | rook-ceph-mon1: 2017-07-11 13:26:55.450054 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:26:55.450145 I | rook-ceph-mon1: 2017-07-11 13:26:55.450129 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:26:55.663583 I | rook-ceph-mon1: 2017-07-11 13:26:54.323052 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 213 : cluster [INF] osdmap e76: 6 total, 6 up, 6 in
- 2017-07-11 13:26:55.663634 I | rook-ceph-mon1: 2017-07-11 13:26:55.490453 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 214 : cluster [INF] osdmap e77: 6 total, 6 up, 6 in
- 2017-07-11 13:26:57.239698 I | rook-ceph-mon1: 2017-07-11 13:26:46.164978 osd.0 osd.0 10.233.72.0:6800/180 50 : cluster [WRN] map e70 wrongly marked me down at e70
- 2017-07-11 13:26:57.239769 I | rook-ceph-mon1: 2017-07-11 13:26:48.170150 osd.1 osd.1 10.233.76.4:6800/178 39 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.349894 secs
- 2017-07-11 13:26:57.239797 I | rook-ceph-mon1: 2017-07-11 13:26:48.170157 osd.1 osd.1 10.233.76.4:6800/178 40 : cluster [WRN] slow request 60.349894 seconds old, received at 2017-07-11 13:25:47.820229: osd_pg_create(e25 0.3:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25) currently started
- 2017-07-11 13:26:57.239839 I | rook-ceph-mon1: 2017-07-11 13:26:51.170943 osd.1 osd.1 10.233.76.4:6800/178 41 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 63.350666 secs
- 2017-07-11 13:26:57.239854 I | rook-ceph-mon1: 2017-07-11 13:26:51.170947 osd.1 osd.1 10.233.76.4:6800/178 42 : cluster [WRN] slow request 30.189307 seconds old, received at 2017-07-11 13:26:20.981588: pg_notify((query:21 sent:36 0.4a4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.239869 I | rook-ceph-mon1: 2017-07-11 13:26:51.170951 osd.1 osd.1 10.233.76.4:6800/178 43 : cluster [WRN] slow request 30.189245 seconds old, received at 2017-07-11 13:26:20.981650: pg_notify((query:21 sent:36 0.4a6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.239880 I | rook-ceph-mon1: 2017-07-11 13:26:51.170954 osd.1 osd.1 10.233.76.4:6800/178 44 : cluster [WRN] slow request 30.189811 seconds old, received at 2017-07-11 13:26:20.981085: pg_notify((query:21 sent:36 0.427( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.239891 I | rook-ceph-mon1: 2017-07-11 13:26:51.170956 osd.1 osd.1 10.233.76.4:6800/178 45 : cluster [WRN] slow request 30.189572 seconds old, received at 2017-07-11 13:26:20.981323: pg_notify((query:21 sent:36 0.434( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.239902 I | rook-ceph-mon1: 2017-07-11 13:26:51.170958 osd.1 osd.1 10.233.76.4:6800/178 46 : cluster [WRN] slow request 30.189524 seconds old, received at 2017-07-11 13:26:20.981372: pg_notify((query:21 sent:36 0.437( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.239925 I | rook-ceph-mon1: 2017-07-11 13:26:52.171148 osd.1 osd.1 10.233.76.4:6800/178 47 : cluster [WRN] 8 slow requests, 2 included below; oldest blocked for > 64.350875 secs
- 2017-07-11 13:26:57.239936 I | rook-ceph-mon1: 2017-07-11 13:26:52.171151 osd.1 osd.1 10.233.76.4:6800/178 48 : cluster [WRN] slow request 31.189582 seconds old, received at 2017-07-11 13:26:20.981522: pg_notify((query:21 sent:36 0.46a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.239948 I | rook-ceph-mon1: 2017-07-11 13:26:52.171154 osd.1 osd.1 10.233.76.4:6800/178 49 : cluster [WRN] slow request 31.189544 seconds old, received at 2017-07-11 13:26:20.981560: pg_notify((query:21 sent:36 0.474( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.239959 I | rook-ceph-mon1: 2017-07-11 13:26:55.179725 osd.1 osd.1 10.233.76.4:6800/178 50 : cluster [WRN] 9 slow requests, 1 included below; oldest blocked for > 67.359467 secs
- 2017-07-11 13:26:57.239970 I | rook-ceph-mon1: 2017-07-11 13:26:55.179746 osd.1 osd.1 10.233.76.4:6800/178 51 : cluster [WRN] slow request 30.092543 seconds old, received at 2017-07-11 13:26:25.087153: pg_notify((query:25 sent:53 0.4b2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:00.709853 I | rook-ceph-mon1: 2017-07-11 13:27:00.709824 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:00.710014 I | rook-ceph-mon1: 2017-07-11 13:27:00.709943 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:00.710400 I | rook-ceph-mon1: 2017-07-11 13:27:00.710383 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:00.710502 I | rook-ceph-mon1: 2017-07-11 13:27:00.710449 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:00.710915 I | rook-ceph-mon1: 2017-07-11 13:27:00.710899 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:00.710981 I | rook-ceph-mon1: 2017-07-11 13:27:00.710968 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:00.711392 I | rook-ceph-mon1: 2017-07-11 13:27:00.711365 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:00.711681 I | rook-ceph-mon1: 2017-07-11 13:27:00.711549 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:00.728350 I | rook-ceph-mon1: 2017-07-11 13:27:00.728332 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:00.728546 I | rook-ceph-mon1: 2017-07-11 13:27:00.728530 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:00.728981 I | rook-ceph-mon1: 2017-07-11 13:27:00.728961 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:00.729164 I | rook-ceph-mon1: 2017-07-11 13:27:00.729133 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:01.948173 I | rook-ceph-mon1: 2017-07-11 13:27:00.630736 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 215 : cluster [INF] osdmap e78: 6 total, 6 up, 6 in
- 2017-07-11 13:27:02.167701 I | rook-ceph-mon1: 2017-07-11 13:27:02.167671 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:02.167800 I | rook-ceph-mon1: 2017-07-11 13:27:02.167786 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:02.168305 I | rook-ceph-mon1: 2017-07-11 13:27:02.168289 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:02.168517 I | rook-ceph-mon1: 2017-07-11 13:27:02.168499 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:02.168928 I | rook-ceph-mon1: 2017-07-11 13:27:02.168913 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:02.169103 I | rook-ceph-mon1: 2017-07-11 13:27:02.169088 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:02.169525 I | rook-ceph-mon1: 2017-07-11 13:27:02.169509 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:02.169685 I | rook-ceph-mon1: 2017-07-11 13:27:02.169670 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:02.170089 I | rook-ceph-mon1: 2017-07-11 13:27:02.170067 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:02.170299 I | rook-ceph-mon1: 2017-07-11 13:27:02.170284 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:02.170870 I | rook-ceph-mon1: 2017-07-11 13:27:02.170853 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:02.170935 I | rook-ceph-mon1: 2017-07-11 13:27:02.170922 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:03.571821 I | rook-ceph-mon1: 2017-07-11 13:27:02.106320 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 216 : cluster [INF] osdmap e79: 6 total, 6 up, 6 in
- 2017-07-11 13:27:04.862543 I | rook-ceph-mon1: 2017-07-11 13:27:04.856387 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:04.862603 I | rook-ceph-mon1: 2017-07-11 13:27:04.856412 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:04.864074 I | rook-ceph-mon1: 2017-07-11 13:27:04.864059 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:04.864149 I | rook-ceph-mon1: 2017-07-11 13:27:04.864131 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:04.864632 I | rook-ceph-mon1: 2017-07-11 13:27:04.864615 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:04.864695 I | rook-ceph-mon1: 2017-07-11 13:27:04.864683 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:04.865157 I | rook-ceph-mon1: 2017-07-11 13:27:04.865142 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:04.865289 I | rook-ceph-mon1: 2017-07-11 13:27:04.865275 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:04.872702 I | rook-ceph-mon1: 2017-07-11 13:27:04.872684 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:04.872899 I | rook-ceph-mon1: 2017-07-11 13:27:04.872867 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:04.873303 I | rook-ceph-mon1: 2017-07-11 13:27:04.873287 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:04.873502 I | rook-ceph-mon1: 2017-07-11 13:27:04.873461 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:05.992050 I | rook-ceph-mon1: 2017-07-11 13:27:04.826723 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 217 : cluster [INF] osdmap e80: 6 total, 6 up, 6 in
- 2017-07-11 13:27:05.992111 I | rook-ceph-mon1: 2017-07-11 13:27:05.281025 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 218 : cluster [INF] HEALTH_WARN; 275 pgs peering; 39 requests are blocked > 32 sec; 1 osds have slow requests; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:27:06.254989 I | rook-ceph-mon1: 2017-07-11 13:27:06.254960 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:06.255093 I | rook-ceph-mon1: 2017-07-11 13:27:06.255079 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:06.255568 I | rook-ceph-mon1: 2017-07-11 13:27:06.255551 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:06.255637 I | rook-ceph-mon1: 2017-07-11 13:27:06.255623 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:06.256048 I | rook-ceph-mon1: 2017-07-11 13:27:06.256032 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:06.256112 I | rook-ceph-mon1: 2017-07-11 13:27:06.256099 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:06.273136 I | rook-ceph-mon1: 2017-07-11 13:27:06.273117 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:06.273207 I | rook-ceph-mon1: 2017-07-11 13:27:06.273193 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:06.273627 I | rook-ceph-mon1: 2017-07-11 13:27:06.273611 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:06.273693 I | rook-ceph-mon1: 2017-07-11 13:27:06.273679 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:06.274036 I | rook-ceph-mon1: 2017-07-11 13:27:06.274020 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:06.274105 I | rook-ceph-mon1: 2017-07-11 13:27:06.274092 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:07.214633 I | rook-ceph-mon1: 2017-07-11 13:26:57.180313 osd.1 osd.1 10.233.76.4:6800/178 52 : cluster [WRN] 11 slow requests, 2 included below; oldest blocked for > 69.360050 secs
- 2017-07-11 13:27:07.216368 I | rook-ceph-mon1: 2017-07-11 13:26:57.180319 osd.1 osd.1 10.233.76.4:6800/178 53 : cluster [WRN] slow request 30.599795 seconds old, received at 2017-07-11 13:26:26.580485: pg_notify((query:25 sent:53 0.4d9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:07.216398 I | rook-ceph-mon1: 2017-07-11 13:26:57.180322 osd.1 osd.1 10.233.76.4:6800/178 54 : cluster [WRN] slow request 30.045284 seconds old, received at 2017-07-11 13:26:27.134996: pg_notify((query:25 sent:54 0.4dd( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 54) currently wait for new map
- 2017-07-11 13:27:07.216412 I | rook-ceph-mon1: 2017-07-11 13:26:58.180539 osd.1 osd.1 10.233.76.4:6800/178 55 : cluster [WRN] 13 slow requests, 2 included below; oldest blocked for > 70.360263 secs
- 2017-07-11 13:27:07.216424 I | rook-ceph-mon1: 2017-07-11 13:26:58.180543 osd.1 osd.1 10.233.76.4:6800/178 56 : cluster [WRN] slow request 30.704741 seconds old, received at 2017-07-11 13:26:27.475751: pg_notify((query:25 sent:53 0.4e3( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:07.216455 I | rook-ceph-mon1: 2017-07-11 13:26:58.180545 osd.1 osd.1 10.233.76.4:6800/178 57 : cluster [WRN] slow request 30.305323 seconds old, received at 2017-07-11 13:26:27.875170: pg_notify((query:25 sent:55 0.4e6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:07.216478 I | rook-ceph-mon1: 2017-07-11 13:26:59.186774 osd.1 osd.1 10.233.76.4:6800/178 58 : cluster [WRN] 14 slow requests, 1 included below; oldest blocked for > 71.366516 secs
- 2017-07-11 13:27:07.216489 I | rook-ceph-mon1: 2017-07-11 13:26:59.186778 osd.1 osd.1 10.233.76.4:6800/178 59 : cluster [WRN] slow request 30.888978 seconds old, received at 2017-07-11 13:26:28.297767: pg_notify((query:25 sent:55 0.4ec( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:07.216521 I | rook-ceph-mon1: 2017-07-11 13:27:00.187024 osd.1 osd.1 10.233.76.4:6800/178 60 : cluster [WRN] 23 slow requests, 5 included below; oldest blocked for > 72.366735 secs
- 2017-07-11 13:27:07.216534 I | rook-ceph-mon1: 2017-07-11 13:27:00.187028 osd.1 osd.1 10.233.76.4:6800/178 61 : cluster [WRN] slow request 30.168011 seconds old, received at 2017-07-11 13:26:30.018953: pg_notify((query:21 sent:42 0.486( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.216545 I | rook-ceph-mon1: 2017-07-11 13:27:00.187045 osd.1 osd.1 10.233.76.4:6800/178 62 : cluster [WRN] slow request 30.167945 seconds old, received at 2017-07-11 13:26:30.019019: pg_notify((query:21 sent:42 0.49d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.216555 I | rook-ceph-mon1: 2017-07-11 13:27:00.187053 osd.1 osd.1 10.233.76.4:6800/178 63 : cluster [WRN] slow request 30.167925 seconds old, received at 2017-07-11 13:26:30.019039: pg_notify((query:21 sent:42 0.4a5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.216565 I | rook-ceph-mon1: 2017-07-11 13:27:00.187055 osd.1 osd.1 10.233.76.4:6800/178 64 : cluster [WRN] slow request 30.874083 seconds old, received at 2017-07-11 13:26:29.312882: pg_notify((query:25 sent:56 0.4f7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.216581 I | rook-ceph-mon1: 2017-07-11 13:27:00.187057 osd.1 osd.1 10.233.76.4:6800/178 65 : cluster [WRN] slow request 30.485377 seconds old, received at 2017-07-11 13:26:29.701587: pg_notify((query:25 sent:56 0.4fb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.216609 I | rook-ceph-mon1: 2017-07-11 13:27:01.187328 osd.1 osd.1 10.233.76.4:6800/178 66 : cluster [WRN] 25 slow requests, 5 included below; oldest blocked for > 40.206130 secs
- 2017-07-11 13:27:07.216627 I | rook-ceph-mon1: 2017-07-11 13:27:01.187340 osd.1 osd.1 10.233.76.4:6800/178 67 : cluster [WRN] slow request 71.768138 seconds old, received at 2017-07-11 13:25:49.419076: osd_pg_create(e26 0.3:2 0.35:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26) currently started
- 2017-07-11 13:27:07.216645 I | rook-ceph-mon1: 2017-07-11 13:27:01.187362 osd.1 osd.1 10.233.76.4:6800/178 68 : cluster [WRN] slow request 31.168161 seconds old, received at 2017-07-11 13:26:30.019054: pg_notify((query:25 sent:42 0.4b0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.216656 I | rook-ceph-mon1: 2017-07-11 13:27:01.187364 osd.1 osd.1 10.233.76.4:6800/178 69 : cluster [WRN] slow request 30.388593 seconds old, received at 2017-07-11 13:26:30.798622: pg_notify((query:25 sent:57 0.503( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 57) currently wait for new map
- 2017-07-11 13:27:07.216678 I | rook-ceph-mon1: 2017-07-11 13:27:01.187366 osd.1 osd.1 10.233.76.4:6800/178 70 : cluster [WRN] slow request 30.412681 seconds old, received at 2017-07-11 13:26:30.774533: pg_notify((query:25 sent:56 0.502( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.216689 I | rook-ceph-mon1: 2017-07-11 13:27:01.187368 osd.1 osd.1 10.233.76.4:6800/178 71 : cluster [WRN] slow request 31.168146 seconds old, received at 2017-07-11 13:26:30.019069: pg_notify((query:25 sent:42 0.4bb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.216699 I | rook-ceph-mon1: 2017-07-11 13:27:02.187617 osd.1 osd.1 10.233.76.4:6800/178 72 : cluster [WRN] 26 slow requests, 4 included below; oldest blocked for > 41.206484 secs
- 2017-07-11 13:27:07.216716 I | rook-ceph-mon1: 2017-07-11 13:27:02.187642 osd.1 osd.1 10.233.76.4:6800/178 73 : cluster [WRN] slow request 72.768492 seconds old, received at 2017-07-11 13:25:49.419076: osd_pg_create(e26 0.3:2 0.35:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26) currently started
- 2017-07-11 13:27:07.216732 I | rook-ceph-mon1: 2017-07-11 13:27:02.187646 osd.1 osd.1 10.233.76.4:6800/178 74 : cluster [WRN] slow request 30.529653 seconds old, received at 2017-07-11 13:26:31.657915: pg_notify((query:25 sent:56 0.509( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.216755 I | rook-ceph-mon1: 2017-07-11 13:27:02.187648 osd.1 osd.1 10.233.76.4:6800/178 75 : cluster [WRN] slow request 32.168482 seconds old, received at 2017-07-11 13:26:30.019086: pg_notify((query:25 sent:42 0.4e0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.216766 I | rook-ceph-mon1: 2017-07-11 13:27:02.187650 osd.1 osd.1 10.233.76.4:6800/178 76 : cluster [WRN] slow request 32.168466 seconds old, received at 2017-07-11 13:26:30.019102: pg_notify((query:25 sent:42 0.4f5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.216776 I | rook-ceph-mon1: 2017-07-11 13:27:03.187912 osd.1 osd.1 10.233.76.4:6800/178 77 : cluster [WRN] 28 slow requests, 2 included below; oldest blocked for > 42.206789 secs
- 2017-07-11 13:27:07.216789 I | rook-ceph-mon1: 2017-07-11 13:27:03.187916 osd.1 osd.1 10.233.76.4:6800/178 78 : cluster [WRN] slow request 30.530131 seconds old, received at 2017-07-11 13:26:32.657742: pg_notify((query:25 sent:58 0.514( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 58) currently wait for new map
- 2017-07-11 13:27:07.216800 I | rook-ceph-mon1: 2017-07-11 13:27:03.187933 osd.1 osd.1 10.233.76.4:6800/178 79 : cluster [WRN] slow request 30.689602 seconds old, received at 2017-07-11 13:26:32.498272: pg_notify((query:25 sent:56 0.513( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.216810 I | rook-ceph-mon1: 2017-07-11 13:27:04.188110 osd.1 osd.1 10.233.76.4:6800/178 80 : cluster [WRN] 30 slow requests, 2 included below; oldest blocked for > 43.206991 secs
- 2017-07-11 13:27:07.216830 I | rook-ceph-mon1: 2017-07-11 13:27:04.188114 osd.1 osd.1 10.233.76.4:6800/178 81 : cluster [WRN] slow request 30.485611 seconds old, received at 2017-07-11 13:26:33.702464: pg_notify((query:25 sent:56 0.51c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.216841 I | rook-ceph-mon1: 2017-07-11 13:27:04.188118 osd.1 osd.1 10.233.76.4:6800/178 82 : cluster [WRN] slow request 30.210146 seconds old, received at 2017-07-11 13:26:33.977929: pg_notify((query:25 sent:56 0.51e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.216851 I | rook-ceph-mon1: 2017-07-11 13:27:05.189246 osd.1 osd.1 10.233.76.4:6800/178 83 : cluster [WRN] 46 slow requests, 5 included below; oldest blocked for > 44.207349 secs
- 2017-07-11 13:27:07.216877 I | rook-ceph-mon1: 2017-07-11 13:27:05.189258 osd.1 osd.1 10.233.76.4:6800/178 84 : cluster [WRN] slow request 74.382946 seconds old, received at 2017-07-11 13:25:50.805488: osd_pg_create(e27 0.3:2 0.35:2 0.4f:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27) currently wait for new map
- 2017-07-11 13:27:07.216911 I | rook-ceph-mon1: 2017-07-11 13:27:05.189274 osd.1 osd.1 10.233.76.4:6800/178 85 : cluster [WRN] slow request 72.908815 seconds old, received at 2017-07-11 13:25:52.279618: osd_pg_create(e28 0.3:2 0.35:2 0.4f:2 0.a0:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:07.216935 I | rook-ceph-mon1: 2017-07-11 13:27:05.189279 osd.1 osd.1 10.233.76.4:6800/178 86 : cluster [WRN] slow request 71.700793 seconds old, received at 2017-07-11 13:25:53.487640: osd_pg_create(e29 0.3:2 0.35:2 0.4f:2 0.a0:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:07.216954 I | rook-ceph-mon1: 2017-07-11 13:27:05.189283 osd.1 osd.1 10.233.76.4:6800/178 87 : cluster [WRN] slow request 70.447050 seconds old, received at 2017-07-11 13:25:54.741384: osd_pg_create(e30 0.3:2 0.35:2 0.4f:2 0.a0:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30) currently wait for new map
- 2017-07-11 13:27:07.216991 I | rook-ceph-mon1: 2017-07-11 13:27:05.189303 osd.1 osd.1 10.233.76.4:6800/178 88 : cluster [WRN] slow request 68.952185 seconds old, received at 2017-07-11 13:25:56.236248: osd_pg_create(e31 0.3:2 0.35:2 0.4f:2 0.a0:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31) currently wait for new map
- 2017-07-11 13:27:07.217024 I | rook-ceph-mon1: 2017-07-11 13:27:06.198791 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 219 : cluster [INF] osdmap e81: 6 total, 6 up, 6 in
- 2017-07-11 13:27:07.434515 I | rook-ceph-mon1: 2017-07-11 13:27:07.433957 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:07.434565 I | rook-ceph-mon1: 2017-07-11 13:27:07.433981 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:07.434581 I | rook-ceph-mon1: 2017-07-11 13:27:07.434075 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:07.434596 I | rook-ceph-mon1: 2017-07-11 13:27:07.434086 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:07.434606 I | rook-ceph-mon1: 2017-07-11 13:27:07.434162 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:07.434638 I | rook-ceph-mon1: 2017-07-11 13:27:07.434172 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:07.434651 I | rook-ceph-mon1: 2017-07-11 13:27:07.434239 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:07.434677 I | rook-ceph-mon1: 2017-07-11 13:27:07.434249 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:07.435067 I | rook-ceph-mon1: 2017-07-11 13:27:07.434311 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:07.435097 I | rook-ceph-mon1: 2017-07-11 13:27:07.434321 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:07.435110 I | rook-ceph-mon1: 2017-07-11 13:27:07.434385 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:07.435121 I | rook-ceph-mon1: 2017-07-11 13:27:07.434393 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:08.692156 I | rook-ceph-mon1: 2017-07-11 13:27:08.691801 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:08.693736 I | rook-ceph-mon1: 2017-07-11 13:27:08.691825 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:08.693783 I | rook-ceph-mon1: 2017-07-11 13:27:08.691868 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:08.693813 I | rook-ceph-mon1: 2017-07-11 13:27:08.691877 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:08.693827 I | rook-ceph-mon1: 2017-07-11 13:27:08.691907 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:08.693838 I | rook-ceph-mon1: 2017-07-11 13:27:08.691915 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:08.693849 I | rook-ceph-mon1: 2017-07-11 13:27:08.691942 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:08.693860 I | rook-ceph-mon1: 2017-07-11 13:27:08.691950 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:08.693870 I | rook-ceph-mon1: 2017-07-11 13:27:08.691978 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:08.693891 I | rook-ceph-mon1: 2017-07-11 13:27:08.691986 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:08.693903 I | rook-ceph-mon1: 2017-07-11 13:27:08.692012 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:08.693914 I | rook-ceph-mon1: 2017-07-11 13:27:08.692020 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:08.790642 I | rook-ceph-mon1: 2017-07-11 13:27:07.395746 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 220 : cluster [INF] osdmap e82: 6 total, 6 up, 6 in
- 2017-07-11 13:27:09.944827 I | rook-ceph-mon1: 2017-07-11 13:27:08.580589 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 221 : cluster [INF] osdmap e83: 6 total, 6 up, 6 in
- 2017-07-11 13:27:10.912932 I | rook-ceph-mon1: 2017-07-11 13:27:10.912879 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:10.913110 I | rook-ceph-mon1: 2017-07-11 13:27:10.913025 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:10.913502 I | rook-ceph-mon1: 2017-07-11 13:27:10.913486 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:10.913676 I | rook-ceph-mon1: 2017-07-11 13:27:10.913661 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:10.914054 I | rook-ceph-mon1: 2017-07-11 13:27:10.914038 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:10.914222 I | rook-ceph-mon1: 2017-07-11 13:27:10.914193 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:10.914557 I | rook-ceph-mon1: 2017-07-11 13:27:10.914542 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:10.914777 I | rook-ceph-mon1: 2017-07-11 13:27:10.914754 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:10.915265 I | rook-ceph-mon1: 2017-07-11 13:27:10.915247 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:10.915335 I | rook-ceph-mon1: 2017-07-11 13:27:10.915321 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:10.915698 I | rook-ceph-mon1: 2017-07-11 13:27:10.915682 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:10.915878 I | rook-ceph-mon1: 2017-07-11 13:27:10.915863 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:11.184174 I | rook-ceph-mon1: 2017-07-11 13:27:10.898348 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 228 : cluster [INF] osdmap e84: 6 total, 6 up, 6 in
- 2017-07-11 13:27:15.139979 I | rook-ceph-mon1: 2017-07-11 13:27:15.139945 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:15.140077 I | rook-ceph-mon1: 2017-07-11 13:27:15.140062 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:15.140596 I | rook-ceph-mon1: 2017-07-11 13:27:15.140580 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:15.140773 I | rook-ceph-mon1: 2017-07-11 13:27:15.140742 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:15.141240 I | rook-ceph-mon1: 2017-07-11 13:27:15.141223 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:15.141415 I | rook-ceph-mon1: 2017-07-11 13:27:15.141400 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:15.157984 I | rook-ceph-mon1: 2017-07-11 13:27:15.150391 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:15.158035 I | rook-ceph-mon1: 2017-07-11 13:27:15.150414 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:15.158049 I | rook-ceph-mon1: 2017-07-11 13:27:15.150717 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:15.158061 I | rook-ceph-mon1: 2017-07-11 13:27:15.150738 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:15.158123 I | rook-ceph-mon1: 2017-07-11 13:27:15.151136 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:15.158142 I | rook-ceph-mon1: 2017-07-11 13:27:15.151160 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:16.091922 I | rook-ceph-mon1: 2017-07-11 13:27:16.090154 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:16.092039 I | rook-ceph-mon1: 2017-07-11 13:27:16.090210 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:16.092118 I | rook-ceph-mon1: 2017-07-11 13:27:16.090574 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:16.092162 I | rook-ceph-mon1: 2017-07-11 13:27:16.090601 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:16.092175 I | rook-ceph-mon1: 2017-07-11 13:27:16.090938 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:16.092186 I | rook-ceph-mon1: 2017-07-11 13:27:16.090959 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:16.092197 I | rook-ceph-mon1: 2017-07-11 13:27:16.091359 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:16.092207 I | rook-ceph-mon1: 2017-07-11 13:27:16.091381 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:16.092241 I | rook-ceph-mon1: 2017-07-11 13:27:16.091665 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:16.092466 I | rook-ceph-mon1: 2017-07-11 13:27:16.091689 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:16.092734 I | rook-ceph-mon1: 2017-07-11 13:27:16.092710 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:16.092791 I | rook-ceph-mon1: 2017-07-11 13:27:16.092778 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:16.659019 I | rook-ceph-mon1: 2017-07-11 13:27:15.111446 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 231 : cluster [INF] osdmap e85: 6 total, 6 up, 6 in
- 2017-07-11 13:27:16.662043 I | rook-ceph-mon1: 2017-07-11 13:27:15.810084 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 232 : cluster [INF] osd.2 failed (root=default,host=master-0) (4 reporters from different host after 30.282725 >= grace 24.445681)
- 2017-07-11 13:27:16.662072 I | rook-ceph-mon1: 2017-07-11 13:27:15.962202 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 233 : cluster [INF] osdmap e86: 6 total, 5 up, 6 in
- 2017-07-11 13:27:17.914624 I | rook-ceph-mon1: 2017-07-11 13:27:06.189526 osd.1 osd.1 10.233.76.4:6800/178 89 : cluster [WRN] 47 slow requests, 5 included below; oldest blocked for > 45.208403 secs
- 2017-07-11 13:27:17.923737 I | rook-ceph-mon1: 2017-07-11 13:27:06.189533 osd.1 osd.1 10.233.76.4:6800/178 90 : cluster [WRN] slow request 75.384000 seconds old, received at 2017-07-11 13:25:50.805488: osd_pg_create(e27 0.3:2 0.35:2 0.4f:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27) currently wait for new map
- 2017-07-11 13:27:17.923795 I | rook-ceph-mon1: 2017-07-11 13:27:06.189548 osd.1 osd.1 10.233.76.4:6800/178 91 : cluster [WRN] slow request 73.909869 seconds old, received at 2017-07-11 13:25:52.279618: osd_pg_create(e28 0.3:2 0.35:2 0.4f:2 0.a0:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:17.923828 I | rook-ceph-mon1: 2017-07-11 13:27:06.189552 osd.1 osd.1 10.233.76.4:6800/178 92 : cluster [WRN] slow request 72.701847 seconds old, received at 2017-07-11 13:25:53.487640: osd_pg_create(e29 0.3:2 0.35:2 0.4f:2 0.a0:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:17.923865 I | rook-ceph-mon1: 2017-07-11 13:27:06.189557 osd.1 osd.1 10.233.76.4:6800/178 93 : cluster [WRN] slow request 71.448104 seconds old, received at 2017-07-11 13:25:54.741384: osd_pg_create(e30 0.3:2 0.35:2 0.4f:2 0.a0:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30) currently wait for new map
- 2017-07-11 13:27:17.923896 I | rook-ceph-mon1: 2017-07-11 13:27:06.189568 osd.1 osd.1 10.233.76.4:6800/178 94 : cluster [WRN] slow request 69.953239 seconds old, received at 2017-07-11 13:25:56.236248: osd_pg_create(e31 0.3:2 0.35:2 0.4f:2 0.a0:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31) currently wait for new map
- 2017-07-11 13:27:17.923918 I | rook-ceph-mon1: 2017-07-11 13:27:07.190167 osd.1 osd.1 10.233.76.4:6800/178 95 : cluster [WRN] 49 slow requests, 5 included below; oldest blocked for > 46.208604 secs
- 2017-07-11 13:27:17.923946 I | rook-ceph-mon1: 2017-07-11 13:27:07.190188 osd.1 osd.1 10.233.76.4:6800/178 96 : cluster [WRN] slow request 69.675377 seconds old, received at 2017-07-11 13:25:57.514311: osd_pg_create(e32 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32) currently wait for new map
- 2017-07-11 13:27:17.924015 I | rook-ceph-mon1: 2017-07-11 13:27:07.190210 osd.1 osd.1 10.233.76.4:6800/178 97 : cluster [WRN] slow request 68.464259 seconds old, received at 2017-07-11 13:25:58.725429: osd_pg_create(e33 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33) currently wait for new map
- 2017-07-11 13:27:17.924041 I | rook-ceph-mon1: 2017-07-11 13:27:07.190214 osd.1 osd.1 10.233.76.4:6800/178 98 : cluster [WRN] slow request 67.060533 seconds old, received at 2017-07-11 13:26:00.129155: osd_pg_create(e34 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924074 I | rook-ceph-mon1: 2017-07-11 13:27:07.190219 osd.1 osd.1 10.233.76.4:6800/178 99 : cluster [WRN] slow request 65.733720 seconds old, received at 2017-07-11 13:26:01.455968: osd_pg_create(e35 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924118 I | rook-ceph-mon1: 2017-07-11 13:27:07.190228 osd.1 osd.1 10.233.76.4:6800/178 100 : cluster [WRN] slow request 64.613660 seconds old, received at 2017-07-11 13:26:02.576028: osd_pg_create(e36 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924138 I | rook-ceph-mon1: 2017-07-11 13:27:08.190465 osd.1 osd.1 10.233.76.4:6800/178 101 : cluster [WRN] 49 slow requests, 5 included below; oldest blocked for > 47.209318 secs
- 2017-07-11 13:27:17.924152 I | rook-ceph-mon1: 2017-07-11 13:27:08.190474 osd.1 osd.1 10.233.76.4:6800/178 102 : cluster [WRN] slow request 70.676092 seconds old, received at 2017-07-11 13:25:57.514311: osd_pg_create(e32 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32) currently wait for new map
- 2017-07-11 13:27:17.924196 I | rook-ceph-mon1: 2017-07-11 13:27:08.190487 osd.1 osd.1 10.233.76.4:6800/178 103 : cluster [WRN] slow request 69.464974 seconds old, received at 2017-07-11 13:25:58.725429: osd_pg_create(e33 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33) currently wait for new map
- 2017-07-11 13:27:17.924220 I | rook-ceph-mon1: 2017-07-11 13:27:08.190500 osd.1 osd.1 10.233.76.4:6800/178 104 : cluster [WRN] slow request 68.061248 seconds old, received at 2017-07-11 13:26:00.129155: osd_pg_create(e34 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924266 I | rook-ceph-mon1: 2017-07-11 13:27:08.190507 osd.1 osd.1 10.233.76.4:6800/178 105 : cluster [WRN] slow request 66.734434 seconds old, received at 2017-07-11 13:26:01.455968: osd_pg_create(e35 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924307 I | rook-ceph-mon1: 2017-07-11 13:27:08.190514 osd.1 osd.1 10.233.76.4:6800/178 106 : cluster [WRN] slow request 65.614374 seconds old, received at 2017-07-11 13:26:02.576028: osd_pg_create(e36 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924342 I | rook-ceph-mon1: 2017-07-11 13:27:09.191044 osd.1 osd.1 10.233.76.4:6800/178 107 : cluster [WRN] 50 slow requests, 5 included below; oldest blocked for > 48.209584 secs
- 2017-07-11 13:27:17.924356 I | rook-ceph-mon1: 2017-07-11 13:27:09.191054 osd.1 osd.1 10.233.76.4:6800/178 108 : cluster [WRN] slow request 65.354982 seconds old, received at 2017-07-11 13:26:03.835686: osd_pg_create(e37 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924408 I | rook-ceph-mon1: 2017-07-11 13:27:09.191060 osd.1 osd.1 10.233.76.4:6800/178 109 : cluster [WRN] slow request 64.220425 seconds old, received at 2017-07-11 13:26:04.970243: osd_pg_create(e38 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924429 I | rook-ceph-mon1: 2017-07-11 13:27:09.191065 osd.1 osd.1 10.233.76.4:6800/178 110 : cluster [WRN] slow request 62.891164 seconds old, received at 2017-07-11 13:26:06.299505: osd_pg_create(e39 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924450 I | rook-ceph-mon1: 2017-07-11 13:27:09.191073 osd.1 osd.1 10.233.76.4:6800/178 111 : cluster [WRN] slow request 61.603405 seconds old, received at 2017-07-11 13:26:07.587264: osd_pg_create(e40 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924482 I | rook-ceph-mon1: 2017-07-11 13:27:09.191076 osd.1 osd.1 10.233.76.4:6800/178 112 : cluster [WRN] slow request 60.374950 seconds old, received at 2017-07-11 13:26:08.815718: osd_pg_create(e41 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924500 I | rook-ceph-mon1: 2017-07-11 13:27:10.191362 osd.1 osd.1 10.233.76.4:6800/178 113 : cluster [WRN] 52 slow requests, 5 included below; oldest blocked for > 49.210222 secs
- 2017-07-11 13:27:17.924511 I | rook-ceph-mon1: 2017-07-11 13:27:10.191371 osd.1 osd.1 10.233.76.4:6800/178 114 : cluster [WRN] slow request 30.880335 seconds old, received at 2017-07-11 13:26:39.310971: pg_notify((query:25 sent:63 0.557( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 63) currently wait for new map
- 2017-07-11 13:27:17.924533 I | rook-ceph-mon1: 2017-07-11 13:27:10.191375 osd.1 osd.1 10.233.76.4:6800/178 115 : cluster [WRN] slow request 66.355620 seconds old, received at 2017-07-11 13:26:03.835686: osd_pg_create(e37 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924571 I | rook-ceph-mon1: 2017-07-11 13:27:10.191380 osd.1 osd.1 10.233.76.4:6800/178 116 : cluster [WRN] slow request 65.221063 seconds old, received at 2017-07-11 13:26:04.970243: osd_pg_create(e38 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924591 I | rook-ceph-mon1: 2017-07-11 13:27:10.191390 osd.1 osd.1 10.233.76.4:6800/178 117 : cluster [WRN] slow request 63.891801 seconds old, received at 2017-07-11 13:26:06.299505: osd_pg_create(e39 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924613 I | rook-ceph-mon1: 2017-07-11 13:27:10.191394 osd.1 osd.1 10.233.76.4:6800/178 118 : cluster [WRN] slow request 62.604043 seconds old, received at 2017-07-11 13:26:07.587264: osd_pg_create(e40 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924637 I | rook-ceph-mon1: 2017-07-11 13:27:11.191742 osd.1 osd.1 10.233.76.4:6800/178 119 : cluster [WRN] 54 slow requests, 5 included below; oldest blocked for > 50.210483 secs
- 2017-07-11 13:27:17.924651 I | rook-ceph-mon1: 2017-07-11 13:27:11.191745 osd.1 osd.1 10.233.76.4:6800/178 120 : cluster [WRN] slow request 30.132634 seconds old, received at 2017-07-11 13:26:41.058933: pg_notify((query:25 sent:61 0.560( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:17.924661 I | rook-ceph-mon1: 2017-07-11 13:27:11.191748 osd.1 osd.1 10.233.76.4:6800/178 121 : cluster [WRN] slow request 30.185198 seconds old, received at 2017-07-11 13:26:41.006369: pg_notify((query:25 sent:61 0.55c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:17.924677 I | rook-ceph-mon1: 2017-07-11 13:27:11.191753 osd.1 osd.1 10.233.76.4:6800/178 122 : cluster [WRN] slow request 62.375849 seconds old, received at 2017-07-11 13:26:08.815718: osd_pg_create(e41 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924699 I | rook-ceph-mon1: 2017-07-11 13:27:11.191762 osd.1 osd.1 10.233.76.4:6800/178 123 : cluster [WRN] slow request 61.048090 seconds old, received at 2017-07-11 13:26:10.143477: osd_pg_create(e42 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924733 I | rook-ceph-mon1: 2017-07-11 13:27:11.191776 osd.1 osd.1 10.233.76.4:6800/178 124 : cluster [WRN] slow request 59.606180 seconds old, received at 2017-07-11 13:26:11.585387: osd_pg_create(e43 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924750 I | rook-ceph-mon1: 2017-07-11 13:27:12.192024 osd.1 osd.1 10.233.76.4:6800/178 125 : cluster [WRN] 55 slow requests, 5 included below; oldest blocked for > 51.210888 secs
- 2017-07-11 13:27:17.924762 I | rook-ceph-mon1: 2017-07-11 13:27:12.192028 osd.1 osd.1 10.233.76.4:6800/178 126 : cluster [WRN] slow request 30.737071 seconds old, received at 2017-07-11 13:26:41.454902: pg_notify((query:25 sent:61 0.568( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:17.924791 I | rook-ceph-mon1: 2017-07-11 13:27:12.192036 osd.1 osd.1 10.233.76.4:6800/178 127 : cluster [WRN] slow request 62.048496 seconds old, received at 2017-07-11 13:26:10.143477: osd_pg_create(e42 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924810 I | rook-ceph-mon1: 2017-07-11 13:27:12.192047 osd.1 osd.1 10.233.76.4:6800/178 128 : cluster [WRN] slow request 60.606586 seconds old, received at 2017-07-11 13:26:11.585387: osd_pg_create(e43 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.924830 I | rook-ceph-mon1: 2017-07-11 13:27:12.192050 osd.1 osd.1 10.233.76.4:6800/178 129 : cluster [WRN] slow request 36.833041 seconds old, received at 2017-07-11 13:26:35.358932: pg_notify((query:25 sent:60 0.52b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:17.924842 I | rook-ceph-mon1: 2017-07-11 13:27:12.192052 osd.1 osd.1 10.233.76.4:6800/178 130 : cluster [WRN] slow request 35.974373 seconds old, received at 2017-07-11 13:26:36.217600: pg_notify((query:25 sent:60 0.539( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:17.924852 I | rook-ceph-mon1: 2017-07-11 13:27:13.192251 osd.1 osd.1 10.233.76.4:6800/178 131 : cluster [WRN] 55 slow requests, 3 included below; oldest blocked for > 52.211112 secs
- 2017-07-11 13:27:17.924874 I | rook-ceph-mon1: 2017-07-11 13:27:13.192255 osd.1 osd.1 10.233.76.4:6800/178 132 : cluster [WRN] slow request 36.549638 seconds old, received at 2017-07-11 13:26:36.642558: pg_notify((query:25 sent:61 0.53d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:17.924886 I | rook-ceph-mon1: 2017-07-11 13:27:13.192257 osd.1 osd.1 10.233.76.4:6800/178 133 : cluster [WRN] slow request 34.772839 seconds old, received at 2017-07-11 13:26:38.419357: pg_notify((query:25 sent:62 0.551( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 62) currently wait for new map
- 2017-07-11 13:27:17.924896 I | rook-ceph-mon1: 2017-07-11 13:27:13.192259 osd.1 osd.1 10.233.76.4:6800/178 134 : cluster [WRN] slow request 33.301633 seconds old, received at 2017-07-11 13:26:39.890564: pg_notify((query:25 sent:61 0.558( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:19.294096 I | rook-ceph-mon1: 2017-07-11 13:27:19.293646 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:19.294165 I | rook-ceph-mon1: 2017-07-11 13:27:19.293671 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:19.294181 I | rook-ceph-mon1: 2017-07-11 13:27:19.293783 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:19.294192 I | rook-ceph-mon1: 2017-07-11 13:27:19.293794 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:19.294202 I | rook-ceph-mon1: 2017-07-11 13:27:19.293862 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:19.294230 I | rook-ceph-mon1: 2017-07-11 13:27:19.293871 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:19.294240 I | rook-ceph-mon1: 2017-07-11 13:27:19.293932 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:19.294251 I | rook-ceph-mon1: 2017-07-11 13:27:19.293946 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:19.294261 I | rook-ceph-mon1: 2017-07-11 13:27:19.294006 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:19.294271 I | rook-ceph-mon1: 2017-07-11 13:27:19.294016 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:19.294979 I | rook-ceph-mon1: 2017-07-11 13:27:19.294963 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:19.295176 I | rook-ceph-mon1: 2017-07-11 13:27:19.295146 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:20.602840 I | rook-ceph-mon1: 2017-07-11 13:27:16.663305 osd.2 osd.2 10.233.69.0:6800/178 15 : cluster [WRN] map e86 wrongly marked me down at e86
- 2017-07-11 13:27:20.602914 I | rook-ceph-mon1: 2017-07-11 13:27:19.292801 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 234 : cluster [INF] osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:27:20.602931 I | rook-ceph-mon1: 2017-07-11 13:27:19.293185 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 235 : cluster [INF] osdmap e87: 6 total, 6 up, 6 in
- 2017-07-11 13:27:20.835072 I | rook-ceph-mon1: 2017-07-11 13:27:20.835050 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:20.835263 I | rook-ceph-mon1: 2017-07-11 13:27:20.835231 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:20.835711 I | rook-ceph-mon1: 2017-07-11 13:27:20.835687 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:20.835845 I | rook-ceph-mon1: 2017-07-11 13:27:20.835819 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:20.836214 I | rook-ceph-mon1: 2017-07-11 13:27:20.836198 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:20.836330 I | rook-ceph-mon1: 2017-07-11 13:27:20.836306 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:20.836791 I | rook-ceph-mon1: 2017-07-11 13:27:20.836775 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:20.836854 I | rook-ceph-mon1: 2017-07-11 13:27:20.836840 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:20.837241 I | rook-ceph-mon1: 2017-07-11 13:27:20.837226 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:20.837312 I | rook-ceph-mon1: 2017-07-11 13:27:20.837294 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:20.853880 I | rook-ceph-mon1: 2017-07-11 13:27:20.853843 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:20.853979 I | rook-ceph-mon1: 2017-07-11 13:27:20.853965 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:22.116761 I | rook-ceph-mon1: 2017-07-11 13:27:20.855499 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 237 : cluster [INF] osdmap e88: 6 total, 6 up, 6 in
- 2017-07-11 13:27:26.683457 I | rook-ceph-mon1: 2017-07-11 13:27:21.198479 osd.1 osd.1 10.233.76.4:6800/178 135 : cluster [WRN] 51 slow requests, 5 included below; oldest blocked for > 60.217363 secs
- 2017-07-11 13:27:26.683919 I | rook-ceph-mon1: 2017-07-11 13:27:21.198486 osd.1 osd.1 10.233.76.4:6800/178 136 : cluster [WRN] slow request 60.216860 seconds old, received at 2017-07-11 13:26:20.981588: pg_notify((query:21 sent:36 0.4a4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.683950 I | rook-ceph-mon1: 2017-07-11 13:27:21.198491 osd.1 osd.1 10.233.76.4:6800/178 137 : cluster [WRN] slow request 60.216797 seconds old, received at 2017-07-11 13:26:20.981650: pg_notify((query:21 sent:36 0.4a6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.683964 I | rook-ceph-mon1: 2017-07-11 13:27:21.198493 osd.1 osd.1 10.233.76.4:6800/178 138 : cluster [WRN] slow request 60.217363 seconds old, received at 2017-07-11 13:26:20.981085: pg_notify((query:21 sent:36 0.427( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.683976 I | rook-ceph-mon1: 2017-07-11 13:27:21.198495 osd.1 osd.1 10.233.76.4:6800/178 139 : cluster [WRN] slow request 60.217124 seconds old, received at 2017-07-11 13:26:20.981323: pg_notify((query:21 sent:36 0.434( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.684012 I | rook-ceph-mon1: 2017-07-11 13:27:21.198497 osd.1 osd.1 10.233.76.4:6800/178 140 : cluster [WRN] slow request 60.217076 seconds old, received at 2017-07-11 13:26:20.981372: pg_notify((query:21 sent:36 0.437( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.684023 I | rook-ceph-mon1: 2017-07-11 13:27:22.198684 osd.1 osd.1 10.233.76.4:6800/178 141 : cluster [WRN] 51 slow requests, 2 included below; oldest blocked for > 61.217571 secs
- 2017-07-11 13:27:26.684034 I | rook-ceph-mon1: 2017-07-11 13:27:22.198688 osd.1 osd.1 10.233.76.4:6800/178 142 : cluster [WRN] slow request 61.217133 seconds old, received at 2017-07-11 13:26:20.981522: pg_notify((query:21 sent:36 0.46a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.684045 I | rook-ceph-mon1: 2017-07-11 13:27:22.198704 osd.1 osd.1 10.233.76.4:6800/178 143 : cluster [WRN] slow request 61.217096 seconds old, received at 2017-07-11 13:26:20.981560: pg_notify((query:21 sent:36 0.474( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.684277 I | rook-ceph-mon1: 2017-07-11 13:27:25.199148 osd.1 osd.1 10.233.76.4:6800/178 144 : cluster [WRN] 51 slow requests, 1 included below; oldest blocked for > 64.218040 secs
- 2017-07-11 13:27:26.684309 I | rook-ceph-mon1: 2017-07-11 13:27:25.199152 osd.1 osd.1 10.233.76.4:6800/178 145 : cluster [WRN] slow request 60.111971 seconds old, received at 2017-07-11 13:26:25.087153: pg_notify((query:25 sent:53 0.4b2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:32.536832 I | rook-ceph-mon1: 2017-07-11 13:27:32.530377 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:32.536893 I | rook-ceph-mon1: 2017-07-11 13:27:32.530400 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:32.537357 I | rook-ceph-mon1: 2017-07-11 13:27:32.537341 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:32.546371 I | rook-ceph-mon1: 2017-07-11 13:27:32.546355 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:32.546788 I | rook-ceph-mon1: 2017-07-11 13:27:32.546772 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:32.546948 I | rook-ceph-mon1: 2017-07-11 13:27:32.546933 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:32.547331 I | rook-ceph-mon1: 2017-07-11 13:27:32.547316 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:32.547490 I | rook-ceph-mon1: 2017-07-11 13:27:32.547476 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:32.547921 I | rook-ceph-mon1: 2017-07-11 13:27:32.547881 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:32.548122 I | rook-ceph-mon1: 2017-07-11 13:27:32.548108 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:32.548490 I | rook-ceph-mon1: 2017-07-11 13:27:32.548475 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:32.548647 I | rook-ceph-mon1: 2017-07-11 13:27:32.548633 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:33.630456 I | rook-ceph-mon1: 2017-07-11 13:27:32.459644 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 238 : cluster [INF] osdmap e89: 6 total, 6 up, 6 in
- 2017-07-11 13:27:35.064736 I | rook-ceph-mon1: 2017-07-11 13:27:35.064709 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:35.064834 I | rook-ceph-mon1: 2017-07-11 13:27:35.064819 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:35.065281 I | rook-ceph-mon1: 2017-07-11 13:27:35.065265 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:35.065451 I | rook-ceph-mon1: 2017-07-11 13:27:35.065436 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:35.065983 I | rook-ceph-mon1: 2017-07-11 13:27:35.065963 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:35.066254 I | rook-ceph-mon1: 2017-07-11 13:27:35.066238 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:35.066691 I | rook-ceph-mon1: 2017-07-11 13:27:35.066662 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:35.066897 I | rook-ceph-mon1: 2017-07-11 13:27:35.066880 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:35.067376 I | rook-ceph-mon1: 2017-07-11 13:27:35.067359 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:35.067534 I | rook-ceph-mon1: 2017-07-11 13:27:35.067519 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:35.074938 I | rook-ceph-mon1: 2017-07-11 13:27:35.074921 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:35.075130 I | rook-ceph-mon1: 2017-07-11 13:27:35.075089 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:36.210966 I | rook-ceph-mon1: 2017-07-11 13:27:36.210594 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:36.211825 I | rook-ceph-mon1: 2017-07-11 13:27:36.210619 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:36.211857 I | rook-ceph-mon1: 2017-07-11 13:27:36.210662 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:36.211920 I | rook-ceph-mon1: 2017-07-11 13:27:36.210671 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:36.211937 I | rook-ceph-mon1: 2017-07-11 13:27:36.210705 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:36.211948 I | rook-ceph-mon1: 2017-07-11 13:27:36.210714 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:36.211975 I | rook-ceph-mon1: 2017-07-11 13:27:36.210742 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:36.212001 I | rook-ceph-mon1: 2017-07-11 13:27:36.210750 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:36.212012 I | rook-ceph-mon1: 2017-07-11 13:27:36.210778 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:36.212024 I | rook-ceph-mon1: 2017-07-11 13:27:36.210786 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:36.212038 I | rook-ceph-mon1: 2017-07-11 13:27:36.210814 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:36.212049 I | rook-ceph-mon1: 2017-07-11 13:27:36.210822 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:36.330263 I | rook-ceph-mon1: 2017-07-11 13:27:34.984953 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 239 : cluster [INF] osdmap e90: 6 total, 6 up, 6 in
- 2017-07-11 13:27:37.302452 I | rook-ceph-mon1: 2017-07-11 13:27:37.302429 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:37.302553 I | rook-ceph-mon1: 2017-07-11 13:27:37.302538 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:37.303077 I | rook-ceph-mon1: 2017-07-11 13:27:37.303060 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:37.303157 I | rook-ceph-mon1: 2017-07-11 13:27:37.303143 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:37.303591 I | rook-ceph-mon1: 2017-07-11 13:27:37.303557 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:37.303785 I | rook-ceph-mon1: 2017-07-11 13:27:37.303753 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:37.304236 I | rook-ceph-mon1: 2017-07-11 13:27:37.304219 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:37.304426 I | rook-ceph-mon1: 2017-07-11 13:27:37.304396 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:37.321047 I | rook-ceph-mon1: 2017-07-11 13:27:37.321029 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:37.321117 I | rook-ceph-mon1: 2017-07-11 13:27:37.321103 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:37.321508 I | rook-ceph-mon1: 2017-07-11 13:27:37.321492 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:37.321718 I | rook-ceph-mon1: 2017-07-11 13:27:37.321686 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:37.522222 I | rook-ceph-mon1: 2017-07-11 13:27:27.199539 osd.1 osd.1 10.233.76.4:6800/178 146 : cluster [WRN] 51 slow requests, 2 included below; oldest blocked for > 66.218430 secs
- 2017-07-11 13:27:37.522371 I | rook-ceph-mon1: 2017-07-11 13:27:27.199556 osd.1 osd.1 10.233.76.4:6800/178 147 : cluster [WRN] slow request 60.619029 seconds old, received at 2017-07-11 13:26:26.580485: pg_notify((query:25 sent:53 0.4d9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:37.522423 I | rook-ceph-mon1: 2017-07-11 13:27:27.199559 osd.1 osd.1 10.233.76.4:6800/178 148 : cluster [WRN] slow request 60.064519 seconds old, received at 2017-07-11 13:26:27.134996: pg_notify((query:25 sent:54 0.4dd( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 54) currently wait for new map
- 2017-07-11 13:27:37.522504 I | rook-ceph-mon1: 2017-07-11 13:27:28.200194 osd.1 osd.1 10.233.76.4:6800/178 149 : cluster [WRN] 51 slow requests, 2 included below; oldest blocked for > 67.219084 secs
- 2017-07-11 13:27:37.522530 I | rook-ceph-mon1: 2017-07-11 13:27:28.200212 osd.1 osd.1 10.233.76.4:6800/178 150 : cluster [WRN] slow request 60.724418 seconds old, received at 2017-07-11 13:26:27.475751: pg_notify((query:25 sent:53 0.4e3( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:37.522544 I | rook-ceph-mon1: 2017-07-11 13:27:28.200216 osd.1 osd.1 10.233.76.4:6800/178 151 : cluster [WRN] slow request 60.324999 seconds old, received at 2017-07-11 13:26:27.875170: pg_notify((query:25 sent:55 0.4e6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:37.522555 I | rook-ceph-mon1: 2017-07-11 13:27:29.200370 osd.1 osd.1 10.233.76.4:6800/178 152 : cluster [WRN] 51 slow requests, 1 included below; oldest blocked for > 68.219263 secs
- 2017-07-11 13:27:37.522582 I | rook-ceph-mon1: 2017-07-11 13:27:29.200374 osd.1 osd.1 10.233.76.4:6800/178 153 : cluster [WRN] slow request 60.902580 seconds old, received at 2017-07-11 13:26:28.297767: pg_notify((query:25 sent:55 0.4ec( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:37.522654 I | rook-ceph-mon1: 2017-07-11 13:27:30.204516 osd.1 osd.1 10.233.76.4:6800/178 154 : cluster [WRN] 51 slow requests, 5 included below; oldest blocked for > 69.223400 secs
- 2017-07-11 13:27:37.522666 I | rook-ceph-mon1: 2017-07-11 13:27:30.204520 osd.1 osd.1 10.233.76.4:6800/178 155 : cluster [WRN] slow request 60.185531 seconds old, received at 2017-07-11 13:26:30.018953: pg_notify((query:21 sent:42 0.486( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.522676 I | rook-ceph-mon1: 2017-07-11 13:27:30.204523 osd.1 osd.1 10.233.76.4:6800/178 156 : cluster [WRN] slow request 60.185465 seconds old, received at 2017-07-11 13:26:30.019019: pg_notify((query:21 sent:42 0.49d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.522686 I | rook-ceph-mon1: 2017-07-11 13:27:30.204525 osd.1 osd.1 10.233.76.4:6800/178 157 : cluster [WRN] slow request 60.185445 seconds old, received at 2017-07-11 13:26:30.019039: pg_notify((query:21 sent:42 0.4a5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.522696 I | rook-ceph-mon1: 2017-07-11 13:27:30.204528 osd.1 osd.1 10.233.76.4:6800/178 158 : cluster [WRN] slow request 60.891603 seconds old, received at 2017-07-11 13:26:29.312882: pg_notify((query:25 sent:56 0.4f7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.522706 I | rook-ceph-mon1: 2017-07-11 13:27:30.204530 osd.1 osd.1 10.233.76.4:6800/178 159 : cluster [WRN] slow request 60.502898 seconds old, received at 2017-07-11 13:26:29.701587: pg_notify((query:25 sent:56 0.4fb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.522733 I | rook-ceph-mon1: 2017-07-11 13:27:31.204809 osd.1 osd.1 10.233.76.4:6800/178 160 : cluster [WRN] 51 slow requests, 5 included below; oldest blocked for > 70.223681 secs
- 2017-07-11 13:27:37.522745 I | rook-ceph-mon1: 2017-07-11 13:27:31.204814 osd.1 osd.1 10.233.76.4:6800/178 161 : cluster [WRN] slow request 61.185711 seconds old, received at 2017-07-11 13:26:30.019054: pg_notify((query:25 sent:42 0.4b0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.522808 I | rook-ceph-mon1: 2017-07-11 13:27:31.204816 osd.1 osd.1 10.233.76.4:6800/178 162 : cluster [WRN] slow request 60.406144 seconds old, received at 2017-07-11 13:26:30.798622: pg_notify((query:25 sent:57 0.503( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 57) currently wait for new map
- 2017-07-11 13:27:37.522823 I | rook-ceph-mon1: 2017-07-11 13:27:31.204819 osd.1 osd.1 10.233.76.4:6800/178 163 : cluster [WRN] slow request 60.430232 seconds old, received at 2017-07-11 13:26:30.774533: pg_notify((query:25 sent:56 0.502( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.522834 I | rook-ceph-mon1: 2017-07-11 13:27:31.204821 osd.1 osd.1 10.233.76.4:6800/178 164 : cluster [WRN] slow request 61.185696 seconds old, received at 2017-07-11 13:26:30.019069: pg_notify((query:25 sent:42 0.4bb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.522844 I | rook-ceph-mon1: 2017-07-11 13:27:31.204824 osd.1 osd.1 10.233.76.4:6800/178 165 : cluster [WRN] slow request 61.185679 seconds old, received at 2017-07-11 13:26:30.019086: pg_notify((query:25 sent:42 0.4e0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.523048 I | rook-ceph-mon1: 2017-07-11 13:27:32.208023 osd.1 osd.1 10.233.76.4:6800/178 166 : cluster [WRN] 50 slow requests, 2 included below; oldest blocked for > 71.226891 secs
- 2017-07-11 13:27:37.523060 I | rook-ceph-mon1: 2017-07-11 13:27:32.208028 osd.1 osd.1 10.233.76.4:6800/178 167 : cluster [WRN] slow request 60.550061 seconds old, received at 2017-07-11 13:26:31.657915: pg_notify((query:25 sent:56 0.509( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.523071 I | rook-ceph-mon1: 2017-07-11 13:27:32.208032 osd.1 osd.1 10.233.76.4:6800/178 168 : cluster [WRN] slow request 62.188873 seconds old, received at 2017-07-11 13:26:30.019102: pg_notify((query:25 sent:42 0.4f5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.523083 I | rook-ceph-mon1: 2017-07-11 13:27:33.209659 osd.1 osd.1 10.233.76.4:6800/178 169 : cluster [WRN] 50 slow requests, 2 included below; oldest blocked for > 72.228549 secs
- 2017-07-11 13:27:37.523104 I | rook-ceph-mon1: 2017-07-11 13:27:33.209663 osd.1 osd.1 10.233.76.4:6800/178 170 : cluster [WRN] slow request 60.551891 seconds old, received at 2017-07-11 13:26:32.657742: pg_notify((query:25 sent:58 0.514( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 58) currently wait for new map
- 2017-07-11 13:27:37.523116 I | rook-ceph-mon1: 2017-07-11 13:27:33.209666 osd.1 osd.1 10.233.76.4:6800/178 171 : cluster [WRN] slow request 60.711361 seconds old, received at 2017-07-11 13:26:32.498272: pg_notify((query:25 sent:56 0.513( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.523126 I | rook-ceph-mon1: 2017-07-11 13:27:34.211396 osd.1 osd.1 10.233.76.4:6800/178 172 : cluster [WRN] 65 slow requests, 5 included below; oldest blocked for > 69.124192 secs
- 2017-07-11 13:27:37.523136 I | rook-ceph-mon1: 2017-07-11 13:27:34.211401 osd.1 osd.1 10.233.76.4:6800/178 173 : cluster [WRN] slow request 43.169587 seconds old, received at 2017-07-11 13:26:51.041759: pg_notify((query:26 sent:72 0.5bc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 72) currently wait for new map
- 2017-07-11 13:27:37.523146 I | rook-ceph-mon1: 2017-07-11 13:27:34.211403 osd.1 osd.1 10.233.76.4:6800/178 174 : cluster [WRN] slow request 50.483405 seconds old, received at 2017-07-11 13:26:43.727940: pg_notify((query:26 sent:67 0.580( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:37.523183 I | rook-ceph-mon1: 2017-07-11 13:27:34.211405 osd.1 osd.1 10.233.76.4:6800/178 175 : cluster [WRN] slow request 39.432352 seconds old, received at 2017-07-11 13:26:54.778993: pg_notify((query:26 sent:76 0.5eb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:37.523195 I | rook-ceph-mon1: 2017-07-11 13:27:34.211408 osd.1 osd.1 10.233.76.4:6800/178 176 : cluster [WRN] slow request 50.472048 seconds old, received at 2017-07-11 13:26:43.739297: pg_notify((query:26 sent:67 0.581( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:37.523257 I | rook-ceph-mon1: 2017-07-11 13:27:34.211410 osd.1 osd.1 10.233.76.4:6800/178 177 : cluster [WRN] slow request 38.991231 seconds old, received at 2017-07-11 13:26:55.220115: pg_notify((query:26 sent:76 0.5f2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:37.523269 I | rook-ceph-mon1: 2017-07-11 13:27:35.211614 osd.1 osd.1 10.233.76.4:6800/178 178 : cluster [WRN] 66 slow requests, 5 included below; oldest blocked for > 70.124410 secs
- 2017-07-11 13:27:37.523279 I | rook-ceph-mon1: 2017-07-11 13:27:35.211618 osd.1 osd.1 10.233.76.4:6800/178 179 : cluster [WRN] slow request 50.962313 seconds old, received at 2017-07-11 13:26:44.249250: pg_notify((query:26 sent:67 0.584( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:37.523289 I | rook-ceph-mon1: 2017-07-11 13:27:35.211621 osd.1 osd.1 10.233.76.4:6800/178 180 : cluster [WRN] slow request 36.391198 seconds old, received at 2017-07-11 13:26:58.820365: pg_notify((query:26 sent:77 0.60e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:37.523299 I | rook-ceph-mon1: 2017-07-11 13:27:35.211624 osd.1 osd.1 10.233.76.4:6800/178 181 : cluster [WRN] slow request 49.607724 seconds old, received at 2017-07-11 13:26:45.603838: pg_notify((query:26 sent:68 0.595( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:37.523309 I | rook-ceph-mon1: 2017-07-11 13:27:35.211626 osd.1 osd.1 10.233.76.4:6800/178 182 : cluster [WRN] slow request 35.996271 seconds old, received at 2017-07-11 13:26:59.215292: pg_notify((query:26 sent:77 0.610( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:37.523319 I | rook-ceph-mon1: 2017-07-11 13:27:35.211628 osd.1 osd.1 10.233.76.4:6800/178 183 : cluster [WRN] slow request 43.225311 seconds old, received at 2017-07-11 13:26:51.986252: pg_notify((query:26 sent:73 0.5cb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 73) currently wait for new map
- 2017-07-11 13:27:37.523506 I | rook-ceph-mon1: 2017-07-11 13:27:35.858263 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 240 : cluster [INF] osd.3 failed (root=default,host=master-2) (4 reporters from different host after 26.962517 >= grace 24.549064)
- 2017-07-11 13:27:37.523521 I | rook-ceph-mon1: 2017-07-11 13:27:36.138047 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 241 : cluster [INF] osdmap e91: 6 total, 5 up, 6 in
- 2017-07-11 13:27:37.523534 I | rook-ceph-mon1: 2017-07-11 13:27:37.223230 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 242 : cluster [INF] osdmap e92: 6 total, 5 up, 6 in
- 2017-07-11 13:27:38.534484 I | rook-ceph-mon1: 2017-07-11 13:27:38.534454 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:38.534955 I | rook-ceph-mon1: 2017-07-11 13:27:38.534929 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:38.535824 I | rook-ceph-mon1: 2017-07-11 13:27:38.535804 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:38.535887 I | rook-ceph-mon1: 2017-07-11 13:27:38.535874 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:38.536095 I | rook-ceph-mon1: 2017-07-11 13:27:38.536066 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:38.536154 I | rook-ceph-mon1: 2017-07-11 13:27:38.536141 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:38.536340 I | rook-ceph-mon1: 2017-07-11 13:27:38.536325 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:38.536412 I | rook-ceph-mon1: 2017-07-11 13:27:38.536400 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:38.537823 I | rook-ceph-mon1: 2017-07-11 13:27:38.537809 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:38.537898 I | rook-ceph-mon1: 2017-07-11 13:27:38.537886 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:38.538118 I | rook-ceph-mon1: 2017-07-11 13:27:38.538103 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:38.538177 I | rook-ceph-mon1: 2017-07-11 13:27:38.538164 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:39.622340 I | rook-ceph-mon1: 2017-07-11 13:27:38.378426 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 243 : cluster [INF] osdmap e93: 6 total, 5 up, 6 in
- 2017-07-11 13:27:39.858023 I | rook-ceph-mon1: 2017-07-11 13:27:39.857990 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:39.860802 I | rook-ceph-mon1: 2017-07-11 13:27:39.860776 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:39.861050 I | rook-ceph-mon1: 2017-07-11 13:27:39.861028 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:39.861112 I | rook-ceph-mon1: 2017-07-11 13:27:39.861099 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:39.861333 I | rook-ceph-mon1: 2017-07-11 13:27:39.861297 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:39.861396 I | rook-ceph-mon1: 2017-07-11 13:27:39.861384 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:39.861634 I | rook-ceph-mon1: 2017-07-11 13:27:39.861618 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:39.861735 I | rook-ceph-mon1: 2017-07-11 13:27:39.861677 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:39.861976 I | rook-ceph-mon1: 2017-07-11 13:27:39.861961 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:39.877989 I | rook-ceph-mon1: 2017-07-11 13:27:39.862020 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:39.878230 I | rook-ceph-mon1: 2017-07-11 13:27:39.878215 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:39.878295 I | rook-ceph-mon1: 2017-07-11 13:27:39.878282 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:40.949966 I | rook-ceph-mon1: 2017-07-11 13:27:39.754027 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 244 : cluster [INF] osdmap e94: 6 total, 5 up, 6 in
- 2017-07-11 13:27:41.266931 I | rook-ceph-mon1: 2017-07-11 13:27:41.266906 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:41.267121 I | rook-ceph-mon1: 2017-07-11 13:27:41.267035 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:41.267553 I | rook-ceph-mon1: 2017-07-11 13:27:41.267537 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:41.267715 I | rook-ceph-mon1: 2017-07-11 13:27:41.267701 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:41.268391 I | rook-ceph-mon1: 2017-07-11 13:27:41.268375 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:41.268469 I | rook-ceph-mon1: 2017-07-11 13:27:41.268452 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:41.269074 I | rook-ceph-mon1: 2017-07-11 13:27:41.269057 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:41.269144 I | rook-ceph-mon1: 2017-07-11 13:27:41.269130 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:41.269523 I | rook-ceph-mon1: 2017-07-11 13:27:41.269507 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:41.269688 I | rook-ceph-mon1: 2017-07-11 13:27:41.269658 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:41.285978 I | rook-ceph-mon1: 2017-07-11 13:27:41.285959 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:41.286054 I | rook-ceph-mon1: 2017-07-11 13:27:41.286040 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:42.385094 I | rook-ceph-mon1: 2017-07-11 13:27:41.198794 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 245 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:27:42.385305 I | rook-ceph-mon1: 2017-07-11 13:27:41.199181 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 246 : cluster [INF] osdmap e95: 6 total, 6 up, 6 in
- 2017-07-11 13:27:42.735208 I | rook-ceph-mon1: 2017-07-11 13:27:42.734611 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:42.736629 I | rook-ceph-mon1: 2017-07-11 13:27:42.734638 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:42.736669 I | rook-ceph-mon1: 2017-07-11 13:27:42.734765 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:42.736698 I | rook-ceph-mon1: 2017-07-11 13:27:42.734777 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:42.736711 I | rook-ceph-mon1: 2017-07-11 13:27:42.734847 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:42.736747 I | rook-ceph-mon1: 2017-07-11 13:27:42.734857 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:42.736761 I | rook-ceph-mon1: 2017-07-11 13:27:42.734928 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:42.736772 I | rook-ceph-mon1: 2017-07-11 13:27:42.734938 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:42.736782 I | rook-ceph-mon1: 2017-07-11 13:27:42.735000 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:42.736793 I | rook-ceph-mon1: 2017-07-11 13:27:42.735010 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:42.736804 I | rook-ceph-mon1: 2017-07-11 13:27:42.735087 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:42.736828 I | rook-ceph-mon1: 2017-07-11 13:27:42.735097 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:43.734937 I | rook-ceph-mon1: 2017-07-11 13:27:42.676001 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 248 : cluster [INF] osdmap e96: 6 total, 6 up, 6 in
- 2017-07-11 13:27:43.913946 I | rook-ceph-mon1: 2017-07-11 13:27:43.913276 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:43.914176 I | rook-ceph-mon1: 2017-07-11 13:27:43.913310 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:43.914217 I | rook-ceph-mon1: 2017-07-11 13:27:43.913434 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:43.914241 I | rook-ceph-mon1: 2017-07-11 13:27:43.913445 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:43.914255 I | rook-ceph-mon1: 2017-07-11 13:27:43.913514 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:43.914265 I | rook-ceph-mon1: 2017-07-11 13:27:43.913524 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:43.914293 I | rook-ceph-mon1: 2017-07-11 13:27:43.913593 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:43.914306 I | rook-ceph-mon1: 2017-07-11 13:27:43.913603 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:43.914316 I | rook-ceph-mon1: 2017-07-11 13:27:43.913674 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:43.914326 I | rook-ceph-mon1: 2017-07-11 13:27:43.913683 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:43.914337 I | rook-ceph-mon1: 2017-07-11 13:27:43.913793 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:43.914347 I | rook-ceph-mon1: 2017-07-11 13:27:43.913804 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:45.069306 I | rook-ceph-mon1: 2017-07-11 13:27:43.930594 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 251 : cluster [INF] osdmap e97: 6 total, 6 up, 6 in
- 2017-07-11 13:27:45.267585 I | rook-ceph-mon1: 2017-07-11 13:27:45.267565 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:45.267684 I | rook-ceph-mon1: 2017-07-11 13:27:45.267664 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:45.268104 I | rook-ceph-mon1: 2017-07-11 13:27:45.268088 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:45.268271 I | rook-ceph-mon1: 2017-07-11 13:27:45.268221 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:45.268678 I | rook-ceph-mon1: 2017-07-11 13:27:45.268661 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:45.268749 I | rook-ceph-mon1: 2017-07-11 13:27:45.268737 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:45.269129 I | rook-ceph-mon1: 2017-07-11 13:27:45.269114 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:45.269258 I | rook-ceph-mon1: 2017-07-11 13:27:45.269244 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:45.269679 I | rook-ceph-mon1: 2017-07-11 13:27:45.269662 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:45.269743 I | rook-ceph-mon1: 2017-07-11 13:27:45.269730 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:45.270112 I | rook-ceph-mon1: 2017-07-11 13:27:45.270097 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:45.270173 I | rook-ceph-mon1: 2017-07-11 13:27:45.270160 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:46.236610 I | rook-ceph-mon1: 2017-07-11 13:27:46.236582 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:46.236885 I | rook-ceph-mon1: 2017-07-11 13:27:46.236842 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:46.237312 I | rook-ceph-mon1: 2017-07-11 13:27:46.237297 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:46.237482 I | rook-ceph-mon1: 2017-07-11 13:27:46.237467 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:46.237911 I | rook-ceph-mon1: 2017-07-11 13:27:46.237893 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:46.238095 I | rook-ceph-mon1: 2017-07-11 13:27:46.238056 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:46.238467 I | rook-ceph-mon1: 2017-07-11 13:27:46.238451 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:46.238628 I | rook-ceph-mon1: 2017-07-11 13:27:46.238614 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:46.246989 I | rook-ceph-mon1: 2017-07-11 13:27:46.246972 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:46.247269 I | rook-ceph-mon1: 2017-07-11 13:27:46.247238 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:46.247679 I | rook-ceph-mon1: 2017-07-11 13:27:46.247663 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:46.247839 I | rook-ceph-mon1: 2017-07-11 13:27:46.247825 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:46.517165 I | rook-ceph-mon1: 2017-07-11 13:27:36.211828 osd.1 osd.1 10.233.76.4:6800/178 184 : cluster [WRN] 71 slow requests, 5 included below; oldest blocked for > 71.124614 secs
- 2017-07-11 13:27:46.517213 I | rook-ceph-mon1: 2017-07-11 13:27:36.211833 osd.1 osd.1 10.233.76.4:6800/178 185 : cluster [WRN] slow request 30.721337 seconds old, received at 2017-07-11 13:27:05.490431: pg_notify((query:30 sent:78 0.5e2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.5f4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.517235 I | rook-ceph-mon1: 2017-07-11 13:27:36.211837 osd.1 osd.1 10.233.76.4:6800/178 186 : cluster [WRN] slow request 35.307991 seconds old, received at 2017-07-11 13:27:00.903776: pg_notify((query:26 sent:78 0.61e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.517248 I | rook-ceph-mon1: 2017-07-11 13:27:36.211839 osd.1 osd.1 10.233.76.4:6800/178 187 : cluster [WRN] slow request 30.644354 seconds old, received at 2017-07-11 13:27:05.567414: pg_notify((query:31 sent:78 0.430( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.517259 I | rook-ceph-mon1: 2017-07-11 13:27:36.211841 osd.1 osd.1 10.233.76.4:6800/178 188 : cluster [WRN] slow request 30.027417 seconds old, received at 2017-07-11 13:27:06.184351: pg_notify((query:31 sent:78 0.45f( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.46d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.517286 I | rook-ceph-mon1: 2017-07-11 13:27:36.211844 osd.1 osd.1 10.233.76.4:6800/178 189 : cluster [WRN] slow request 30.011214 seconds old, received at 2017-07-11 13:27:06.200553: pg_notify((query:31 sent:78 0.41d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.421( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.422( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.517300 I | rook-ceph-mon1: 2017-07-11 13:27:37.212020 osd.1 osd.1 10.233.76.4:6800/178 190 : cluster [WRN] 73 slow requests, 5 included below; oldest blocked for > 72.124801 secs
- 2017-07-11 13:27:46.517313 I | rook-ceph-mon1: 2017-07-11 13:27:37.212024 osd.1 osd.1 10.233.76.4:6800/178 191 : cluster [WRN] slow request 30.831535 seconds old, received at 2017-07-11 13:27:06.380420: pg_notify((query:33 sent:81 0.489( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.49b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.4ad( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 81) currently wait for new map
- 2017-07-11 13:27:46.517324 I | rook-ceph-mon1: 2017-07-11 13:27:37.212027 osd.1 osd.1 10.233.76.4:6800/178 192 : cluster [WRN] slow request 30.022916 seconds old, received at 2017-07-11 13:27:07.189039: pg_notify((query:33 sent:81 0.4bc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.4c0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.4c1( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 81) currently wait for new map
- 2017-07-11 13:27:46.517335 I | rook-ceph-mon1: 2017-07-11 13:27:37.212030 osd.1 osd.1 10.233.76.4:6800/178 193 : cluster [WRN] slow request 33.423069 seconds old, received at 2017-07-11 13:27:03.788885: pg_notify((query:26 sent:79 0.63e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 79) currently wait for new map
- 2017-07-11 13:27:46.517359 I | rook-ceph-mon1: 2017-07-11 13:27:37.212032 osd.1 osd.1 10.233.76.4:6800/178 194 : cluster [WRN] slow request 43.439708 seconds old, received at 2017-07-11 13:26:53.772246: pg_notify((query:26 sent:75 0.5df( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 75) currently wait for new map
- 2017-07-11 13:27:46.517370 I | rook-ceph-mon1: 2017-07-11 13:27:37.212046 osd.1 osd.1 10.233.76.4:6800/178 195 : cluster [WRN] slow request 42.610629 seconds old, received at 2017-07-11 13:26:54.601325: pg_notify((query:26 sent:76 0.5e8( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:46.517381 I | rook-ceph-mon1: 2017-07-11 13:27:38.229288 osd.1 osd.1 10.233.76.4:6800/178 196 : cluster [WRN] 76 slow requests, 5 included below; oldest blocked for > 73.125544 secs
- 2017-07-11 13:27:46.517393 I | rook-ceph-mon1: 2017-07-11 13:27:38.229300 osd.1 osd.1 10.233.76.4:6800/178 197 : cluster [WRN] slow request 30.467090 seconds old, received at 2017-07-11 13:27:07.745608: pg_notify((query:33 sent:82 0.4e4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.4e7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.4fe( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.506( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.517405 I | rook-ceph-mon1: 2017-07-11 13:27:38.229304 osd.1 osd.1 10.233.76.4:6800/178 198 : cluster [WRN] slow request 30.466970 seconds old, received at 2017-07-11 13:27:07.745728: pg_notify((query:33 sent:82 0.592( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.517415 I | rook-ceph-mon1: 2017-07-11 13:27:38.229307 osd.1 osd.1 10.233.76.4:6800/178 199 : cluster [WRN] slow request 62.853766 seconds old, received at 2017-07-11 13:26:35.358932: pg_notify((query:25 sent:60 0.52b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:46.517446 I | rook-ceph-mon1: 2017-07-11 13:27:38.229319 osd.1 osd.1 10.233.76.4:6800/178 200 : cluster [WRN] slow request 85.373497 seconds old, received at 2017-07-11 13:26:12.839201: osd_pg_create(e44 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:46.517470 I | rook-ceph-mon1: 2017-07-11 13:27:38.229323 osd.1 osd.1 10.233.76.4:6800/178 201 : cluster [WRN] slow request 42.086802 seconds old, received at 2017-07-11 13:26:56.125895: pg_notify((query:26 sent:77 0.5fa( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:46.517481 I | rook-ceph-mon1: 2017-07-11 13:27:39.229559 osd.1 osd.1 10.233.76.4:6800/178 202 : cluster [WRN] 86 slow requests, 5 included below; oldest blocked for > 74.142341 secs
- 2017-07-11 13:27:46.517494 I | rook-ceph-mon1: 2017-07-11 13:27:39.229564 osd.1 osd.1 10.233.76.4:6800/178 203 : cluster [WRN] slow request 30.990371 seconds old, received at 2017-07-11 13:27:08.239123: pg_notify((query:33 sent:82 0.599( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.59d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5a2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5b1( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5b7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5b8( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.517524 I | rook-ceph-mon1: 2017-07-11 13:27:39.229569 osd.1 osd.1 10.233.76.4:6800/178 204 : cluster [WRN] slow request 30.916765 seconds old, received at 2017-07-11 13:27:08.312729: pg_notify((query:33 sent:82 0.658( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.517537 I | rook-ceph-mon1: 2017-07-11 13:27:39.229573 osd.1 osd.1 10.233.76.4:6800/178 205 : cluster [WRN] slow request 30.951168 seconds old, received at 2017-07-11 13:27:08.278327: pg_notify((query:33 sent:82 0.646( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.517559 I | rook-ceph-mon1: 2017-07-11 13:27:39.229590 osd.1 osd.1 10.233.76.4:6800/178 206 : cluster [WRN] slow request 30.905708 seconds old, received at 2017-07-11 13:27:08.323786: pg_notify((query:33 sent:82 0.660( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.517569 I | rook-ceph-mon1: 2017-07-11 13:27:39.229592 osd.1 osd.1 10.233.76.4:6800/178 207 : cluster [WRN] slow request 30.903106 seconds old, received at 2017-07-11 13:27:08.326388: pg_notify((query:33 sent:82 0.663( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.517581 I | rook-ceph-mon1: 2017-07-11 13:27:40.229798 osd.1 osd.1 10.233.76.4:6800/178 208 : cluster [WRN] 86 slow requests, 5 included below; oldest blocked for > 75.142592 secs
- 2017-07-11 13:27:46.517606 I | rook-ceph-mon1: 2017-07-11 13:27:40.229802 osd.1 osd.1 10.233.76.4:6800/178 209 : cluster [WRN] slow request 60.918775 seconds old, received at 2017-07-11 13:26:39.310971: pg_notify((query:25 sent:63 0.557( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 63) currently wait for new map
- 2017-07-11 13:27:46.517617 I | rook-ceph-mon1: 2017-07-11 13:27:40.229805 osd.1 osd.1 10.233.76.4:6800/178 210 : cluster [WRN] slow request 31.923477 seconds old, received at 2017-07-11 13:27:08.306268: pg_notify((query:33 sent:80 0.659( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 80) currently wait for new map
- 2017-07-11 13:27:46.517628 I | rook-ceph-mon1: 2017-07-11 13:27:40.229807 osd.1 osd.1 10.233.76.4:6800/178 211 : cluster [WRN] slow request 31.894077 seconds old, received at 2017-07-11 13:27:08.335668: pg_notify((query:33 sent:80 0.66d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 80) currently wait for new map
- 2017-07-11 13:27:46.517649 I | rook-ceph-mon1: 2017-07-11 13:27:40.229822 osd.1 osd.1 10.233.76.4:6800/178 212 : cluster [WRN] slow request 87.390545 seconds old, received at 2017-07-11 13:26:12.839201: osd_pg_create(e44 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:46.517703 I | rook-ceph-mon1: 2017-07-11 13:27:40.229826 osd.1 osd.1 10.233.76.4:6800/178 213 : cluster [WRN] slow request 56.953126 seconds old, received at 2017-07-11 13:26:43.276620: pg_notify((query:26 sent:61 0.572( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.517716 I | rook-ceph-mon1: 2017-07-11 13:27:41.230168 osd.1 osd.1 10.233.76.4:6800/178 214 : cluster [WRN] 88 slow requests, 5 included below; oldest blocked for > 76.142899 secs
- 2017-07-11 13:27:46.517727 I | rook-ceph-mon1: 2017-07-11 13:27:41.230173 osd.1 osd.1 10.233.76.4:6800/178 215 : cluster [WRN] slow request 60.171119 seconds old, received at 2017-07-11 13:26:41.058933: pg_notify((query:25 sent:61 0.560( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.517758 I | rook-ceph-mon1: 2017-07-11 13:27:41.230175 osd.1 osd.1 10.233.76.4:6800/178 216 : cluster [WRN] slow request 60.223683 seconds old, received at 2017-07-11 13:26:41.006369: pg_notify((query:25 sent:61 0.55c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.517770 I | rook-ceph-mon1: 2017-07-11 13:27:41.230180 osd.1 osd.1 10.233.76.4:6800/178 217 : cluster [WRN] slow request 30.592509 seconds old, received at 2017-07-11 13:27:10.637543: pg_notify((query:33 sent:83 0.69b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:46.517783 I | rook-ceph-mon1: 2017-07-11 13:27:41.230192 osd.1 osd.1 10.233.76.4:6800/178 218 : cluster [WRN] slow request 33.468466 seconds old, received at 2017-07-11 13:27:07.761587: pg_notify((query:33 sent:82 0.546( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.55a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.569( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.517794 I | rook-ceph-mon1: 2017-07-11 13:27:41.230195 osd.1 osd.1 10.233.76.4:6800/178 219 : cluster [WRN] slow request 56.124997 seconds old, received at 2017-07-11 13:26:45.105055: pg_notify((query:26 sent:68 0.58a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:46.517805 I | rook-ceph-mon1: 2017-07-11 13:27:42.230491 osd.1 osd.1 10.233.76.4:6800/178 220 : cluster [WRN] 92 slow requests, 5 included below; oldest blocked for > 77.143283 secs
- 2017-07-11 13:27:46.517827 I | rook-ceph-mon1: 2017-07-11 13:27:42.230496 osd.1 osd.1 10.233.76.4:6800/178 221 : cluster [WRN] slow request 60.775534 seconds old, received at 2017-07-11 13:26:41.454902: pg_notify((query:25 sent:61 0.568( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.517839 I | rook-ceph-mon1: 2017-07-11 13:27:42.230500 osd.1 osd.1 10.233.76.4:6800/178 222 : cluster [WRN] slow request 30.955004 seconds old, received at 2017-07-11 13:27:11.275432: pg_notify((query:33 sent:84 0.6a9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.517860 I | rook-ceph-mon1: 2017-07-11 13:27:42.230502 osd.1 osd.1 10.233.76.4:6800/178 223 : cluster [WRN] slow request 30.597711 seconds old, received at 2017-07-11 13:27:11.632725: pg_notify((query:33 sent:84 0.6af( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.517870 I | rook-ceph-mon1: 2017-07-11 13:27:42.230505 osd.1 osd.1 10.233.76.4:6800/178 224 : cluster [WRN] slow request 30.588758 seconds old, received at 2017-07-11 13:27:11.641678: pg_notify((query:33 sent:84 0.6b0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.517880 I | rook-ceph-mon1: 2017-07-11 13:27:42.230508 osd.1 osd.1 10.233.76.4:6800/178 225 : cluster [WRN] slow request 30.092767 seconds old, received at 2017-07-11 13:27:12.137669: pg_notify((query:33 sent:84 0.6b2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.517890 I | rook-ceph-mon1: 2017-07-11 13:27:43.230779 osd.1 osd.1 10.233.76.4:6800/178 226 : cluster [WRN] 93 slow requests, 5 included below; oldest blocked for > 78.143573 secs
- 2017-07-11 13:27:46.517918 I | rook-ceph-mon1: 2017-07-11 13:27:43.230784 osd.1 osd.1 10.233.76.4:6800/178 227 : cluster [WRN] slow request 30.365027 seconds old, received at 2017-07-11 13:27:12.865700: pg_notify((query:33 sent:84 0.6c5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.517930 I | rook-ceph-mon1: 2017-07-11 13:27:43.230787 osd.1 osd.1 10.233.76.4:6800/178 228 : cluster [WRN] slow request 34.456532 seconds old, received at 2017-07-11 13:27:08.774195: pg_notify((query:33 sent:80 0.67d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 80) currently wait for new map
- 2017-07-11 13:27:46.517940 I | rook-ceph-mon1: 2017-07-11 13:27:43.230789 osd.1 osd.1 10.233.76.4:6800/178 229 : cluster [WRN] slow request 67.013127 seconds old, received at 2017-07-11 13:26:36.217600: pg_notify((query:25 sent:60 0.539( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:46.517949 I | rook-ceph-mon1: 2017-07-11 13:27:43.230800 osd.1 osd.1 10.233.76.4:6800/178 230 : cluster [WRN] slow request 59.951200 seconds old, received at 2017-07-11 13:26:43.279526: pg_notify((query:26 sent:66 0.577( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 66) currently wait for new map
- 2017-07-11 13:27:46.517959 I | rook-ceph-mon1: 2017-07-11 13:27:43.230802 osd.1 osd.1 10.233.76.4:6800/178 231 : cluster [WRN] slow request 46.111899 seconds old, received at 2017-07-11 13:26:57.118827: pg_notify((query:26 sent:77 0.601( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:46.517981 I | rook-ceph-mon1: 2017-07-11 13:27:44.230992 osd.1 osd.1 10.233.76.4:6800/178 232 : cluster [WRN] 96 slow requests, 5 included below; oldest blocked for > 79.143791 secs
- 2017-07-11 13:27:46.517992 I | rook-ceph-mon1: 2017-07-11 13:27:44.230997 osd.1 osd.1 10.233.76.4:6800/178 233 : cluster [WRN] slow request 60.503004 seconds old, received at 2017-07-11 13:26:43.727940: pg_notify((query:26 sent:67 0.580( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:46.518002 I | rook-ceph-mon1: 2017-07-11 13:27:44.231000 osd.1 osd.1 10.233.76.4:6800/178 234 : cluster [WRN] slow request 30.193221 seconds old, received at 2017-07-11 13:27:14.037724: pg_notify((query:33 sent:84 0.6e4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.518012 I | rook-ceph-mon1: 2017-07-11 13:27:44.231004 osd.1 osd.1 10.233.76.4:6800/178 235 : cluster [WRN] slow request 60.491647 seconds old, received at 2017-07-11 13:26:43.739297: pg_notify((query:26 sent:67 0.581( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:46.518029 I | rook-ceph-mon1: 2017-07-11 13:27:44.231007 osd.1 osd.1 10.233.76.4:6800/178 236 : cluster [WRN] slow request 30.184016 seconds old, received at 2017-07-11 13:27:14.046928: pg_notify((query:33 sent:84 0.6dc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.518040 I | rook-ceph-mon1: 2017-07-11 13:27:44.231009 osd.1 osd.1 10.233.76.4:6800/178 237 : cluster [WRN] slow request 60.954325 seconds old, received at 2017-07-11 13:26:43.276620: pg_notify((query:26 sent:61 0.572( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.518066 I | rook-ceph-mon1: 2017-07-11 13:27:45.231175 osd.1 osd.1 10.233.76.4:6800/178 238 : cluster [WRN] 102 slow requests, 5 included below; oldest blocked for > 80.143968 secs
- 2017-07-11 13:27:46.518077 I | rook-ceph-mon1: 2017-07-11 13:27:45.231179 osd.1 osd.1 10.233.76.4:6800/178 239 : cluster [WRN] slow request 30.669061 seconds old, received at 2017-07-11 13:27:14.562060: pg_notify((query:33 sent:84 0.6eb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.518087 I | rook-ceph-mon1: 2017-07-11 13:27:45.231184 osd.1 osd.1 10.233.76.4:6800/178 240 : cluster [WRN] slow request 60.981872 seconds old, received at 2017-07-11 13:26:44.249250: pg_notify((query:26 sent:67 0.584( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:46.518097 I | rook-ceph-mon1: 2017-07-11 13:27:45.231186 osd.1 osd.1 10.233.76.4:6800/178 241 : cluster [WRN] slow request 30.579540 seconds old, received at 2017-07-11 13:27:14.651582: pg_notify((query:33 sent:84 0.6f4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.518107 I | rook-ceph-mon1: 2017-07-11 13:27:45.231188 osd.1 osd.1 10.233.76.4:6800/178 242 : cluster [WRN] slow request 30.579626 seconds old, received at 2017-07-11 13:27:14.651495: pg_notify((query:33 sent:83 0.6fb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:46.518117 I | rook-ceph-mon1: 2017-07-11 13:27:45.231190 osd.1 osd.1 10.233.76.4:6800/178 243 : cluster [WRN] slow request 30.150142 seconds old, received at 2017-07-11 13:27:15.080979: pg_notify((query:33 sent:83 0.704( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:46.518140 I | rook-ceph-mon1: 2017-07-11 13:27:45.268744 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 252 : cluster [INF] osdmap e98: 6 total, 6 up, 6 in
- 2017-07-11 13:27:46.518151 I | rook-ceph-mon1: 2017-07-11 13:27:45.978362 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 253 : cluster [INF] osd.0 failed (root=default,host=master-1) (3 reporters from different host after 33.064678 >= grace 24.401318)
- 2017-07-11 13:27:46.518162 I | rook-ceph-mon1: 2017-07-11 13:27:46.220901 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 254 : cluster [INF] osdmap e99: 6 total, 5 up, 6 in
- 2017-07-11 13:27:47.795611 I | rook-ceph-mon1: 2017-07-11 13:27:37.573529 osd.3 osd.3 10.233.86.0:6800/178 15 : cluster [WRN] map e92 wrongly marked me down at e91
- 2017-07-11 13:27:47.932193 I | rook-ceph-mon1: 2017-07-11 13:27:47.932170 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:47.932281 I | rook-ceph-mon1: 2017-07-11 13:27:47.932267 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:47.932772 I | rook-ceph-mon1: 2017-07-11 13:27:47.932755 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:47.933006 I | rook-ceph-mon1: 2017-07-11 13:27:47.932981 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:47.933460 I | rook-ceph-mon1: 2017-07-11 13:27:47.933445 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:47.933625 I | rook-ceph-mon1: 2017-07-11 13:27:47.933611 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:47.934065 I | rook-ceph-mon1: 2017-07-11 13:27:47.934049 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:47.934295 I | rook-ceph-mon1: 2017-07-11 13:27:47.934265 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:47.934724 I | rook-ceph-mon1: 2017-07-11 13:27:47.934709 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:47.941900 I | rook-ceph-mon1: 2017-07-11 13:27:47.941882 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:47.942393 I | rook-ceph-mon1: 2017-07-11 13:27:47.942377 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:47.942457 I | rook-ceph-mon1: 2017-07-11 13:27:47.942444 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:49.082192 I | rook-ceph-mon1: 2017-07-11 13:27:47.874831 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 255 : cluster [INF] osdmap e100: 6 total, 5 up, 6 in
- 2017-07-11 13:27:49.507960 I | rook-ceph-mon1: 2017-07-11 13:27:49.507940 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:49.508043 I | rook-ceph-mon1: 2017-07-11 13:27:49.508028 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:49.508455 I | rook-ceph-mon1: 2017-07-11 13:27:49.508439 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:49.508659 I | rook-ceph-mon1: 2017-07-11 13:27:49.508644 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:49.509084 I | rook-ceph-mon1: 2017-07-11 13:27:49.509068 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:49.509266 I | rook-ceph-mon1: 2017-07-11 13:27:49.509227 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:49.509716 I | rook-ceph-mon1: 2017-07-11 13:27:49.509700 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:49.563681 I | rook-ceph-mon1: 2017-07-11 13:27:49.539933 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:49.563900 I | rook-ceph-mon1: 2017-07-11 13:27:49.563251 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:49.563933 I | rook-ceph-mon1: 2017-07-11 13:27:49.563265 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:49.563953 I | rook-ceph-mon1: 2017-07-11 13:27:49.563465 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:49.563985 I | rook-ceph-mon1: 2017-07-11 13:27:49.563477 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:50.859411 I | rook-ceph-mon1: 2017-07-11 13:27:49.481726 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 256 : cluster [INF] osdmap e101: 6 total, 5 up, 6 in
- 2017-07-11 13:27:51.061450 I | rook-ceph-mon1: 2017-07-11 13:27:51.059926 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:51.061552 I | rook-ceph-mon1: 2017-07-11 13:27:51.059949 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:51.061660 I | rook-ceph-mon1: 2017-07-11 13:27:51.060174 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:51.061679 I | rook-ceph-mon1: 2017-07-11 13:27:51.060186 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:51.061709 I | rook-ceph-mon1: 2017-07-11 13:27:51.060437 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:51.061728 I | rook-ceph-mon1: 2017-07-11 13:27:51.060449 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:51.061745 I | rook-ceph-mon1: 2017-07-11 13:27:51.060650 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:51.061761 I | rook-ceph-mon1: 2017-07-11 13:27:51.060664 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:51.061790 I | rook-ceph-mon1: 2017-07-11 13:27:51.060869 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:51.061807 I | rook-ceph-mon1: 2017-07-11 13:27:51.060881 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:51.061823 I | rook-ceph-mon1: 2017-07-11 13:27:51.061092 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:51.061839 I | rook-ceph-mon1: 2017-07-11 13:27:51.061103 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:51.473906 I | rook-ceph-mon1: 2017-07-11 13:27:51.473133 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:51.473971 I | rook-ceph-mon1: 2017-07-11 13:27:51.473155 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:51.473988 I | rook-ceph-mon1: 2017-07-11 13:27:51.473252 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:51.474000 I | rook-ceph-mon1: 2017-07-11 13:27:51.473264 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:51.474010 I | rook-ceph-mon1: 2017-07-11 13:27:51.473345 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:51.474022 I | rook-ceph-mon1: 2017-07-11 13:27:51.473354 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:51.474046 I | rook-ceph-mon1: 2017-07-11 13:27:51.473414 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:51.474064 I | rook-ceph-mon1: 2017-07-11 13:27:51.473423 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:51.474082 I | rook-ceph-mon1: 2017-07-11 13:27:51.473482 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:51.474093 I | rook-ceph-mon1: 2017-07-11 13:27:51.473491 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:51.474129 I | rook-ceph-mon1: 2017-07-11 13:27:51.473551 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:51.474142 I | rook-ceph-mon1: 2017-07-11 13:27:51.473560 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:52.238123 I | rook-ceph-mon1: 2017-07-11 13:27:51.023882 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 257 : cluster [INF] osdmap e102: 6 total, 5 up, 6 in
- 2017-07-11 13:27:52.246691 I | rook-ceph-mon1: 2017-07-11 13:27:51.496114 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 258 : cluster [INF] osdmap e103: 6 total, 5 up, 6 in
- 2017-07-11 13:27:52.686796 I | rook-ceph-mon1: 2017-07-11 13:27:52.686726 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:52.686866 I | rook-ceph-mon1: 2017-07-11 13:27:52.686750 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:52.688487 I | rook-ceph-mon1: 2017-07-11 13:27:52.687253 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:52.688658 I | rook-ceph-mon1: 2017-07-11 13:27:52.687281 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:52.688787 I | rook-ceph-mon1: 2017-07-11 13:27:52.687528 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:52.688804 I | rook-ceph-mon1: 2017-07-11 13:27:52.687549 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:52.688836 I | rook-ceph-mon1: 2017-07-11 13:27:52.687799 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:52.688860 I | rook-ceph-mon1: 2017-07-11 13:27:52.687821 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:52.688898 I | rook-ceph-mon1: 2017-07-11 13:27:52.688284 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:52.688921 I | rook-ceph-mon1: 2017-07-11 13:27:52.688317 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:52.688984 I | rook-ceph-mon1: 2017-07-11 13:27:52.688954 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:52.689026 I | rook-ceph-mon1: 2017-07-11 13:27:52.689015 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:53.583933 I | rook-ceph-mon1: 2017-07-11 13:27:52.669897 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 259 : cluster [INF] osdmap e104: 6 total, 5 up, 6 in
- 2017-07-11 13:27:53.911756 I | rook-ceph-mon1: 2017-07-11 13:27:53.911726 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:53.918473 I | rook-ceph-mon1: 2017-07-11 13:27:53.918455 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:53.918819 I | rook-ceph-mon1: 2017-07-11 13:27:53.918804 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:53.918859 I | rook-ceph-mon1: 2017-07-11 13:27:53.918847 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:53.919210 I | rook-ceph-mon1: 2017-07-11 13:27:53.919194 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:53.919251 I | rook-ceph-mon1: 2017-07-11 13:27:53.919238 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:53.919582 I | rook-ceph-mon1: 2017-07-11 13:27:53.919567 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:53.919621 I | rook-ceph-mon1: 2017-07-11 13:27:53.919609 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:53.927888 I | rook-ceph-mon1: 2017-07-11 13:27:53.927854 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:53.927955 I | rook-ceph-mon1: 2017-07-11 13:27:53.927942 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:53.928341 I | rook-ceph-mon1: 2017-07-11 13:27:53.928326 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:53.928498 I | rook-ceph-mon1: 2017-07-11 13:27:53.928484 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:54.227733 I | rook-ceph-mon1: 2017-07-11 13:27:54.211608 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4682 MB, avail 94505 MB
- 2017-07-11 13:27:55.024660 I | rook-ceph-mon1: 2017-07-11 13:27:53.915602 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 260 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:27:55.024755 I | rook-ceph-mon1: 2017-07-11 13:27:53.952139 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 262 : cluster [INF] osdmap e105: 6 total, 6 up, 6 in
- 2017-07-11 13:27:55.384067 I | rook-ceph-mon1: 2017-07-11 13:27:55.384035 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:55.384277 I | rook-ceph-mon1: 2017-07-11 13:27:55.384199 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:55.384737 I | rook-ceph-mon1: 2017-07-11 13:27:55.384721 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:55.384992 I | rook-ceph-mon1: 2017-07-11 13:27:55.384976 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:55.385422 I | rook-ceph-mon1: 2017-07-11 13:27:55.385405 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:55.385593 I | rook-ceph-mon1: 2017-07-11 13:27:55.385578 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:55.386008 I | rook-ceph-mon1: 2017-07-11 13:27:55.385992 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:55.386211 I | rook-ceph-mon1: 2017-07-11 13:27:55.386179 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:55.386637 I | rook-ceph-mon1: 2017-07-11 13:27:55.386620 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:55.386830 I | rook-ceph-mon1: 2017-07-11 13:27:55.386801 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:55.387222 I | rook-ceph-mon1: 2017-07-11 13:27:55.387205 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:55.387410 I | rook-ceph-mon1: 2017-07-11 13:27:55.387374 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:56.712869 I | rook-ceph-mon1: 2017-07-11 13:27:56.712836 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:56.713899 I | rook-ceph-mon1: 2017-07-11 13:27:56.713866 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:56.714150 I | rook-ceph-mon1: 2017-07-11 13:27:56.714121 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:56.714211 I | rook-ceph-mon1: 2017-07-11 13:27:56.714198 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:56.714437 I | rook-ceph-mon1: 2017-07-11 13:27:56.714421 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:56.714635 I | rook-ceph-mon1: 2017-07-11 13:27:56.714616 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:56.714945 I | rook-ceph-mon1: 2017-07-11 13:27:56.714929 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:56.715175 I | rook-ceph-mon1: 2017-07-11 13:27:56.715161 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:56.722877 I | rook-ceph-mon1: 2017-07-11 13:27:56.722859 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:56.722951 I | rook-ceph-mon1: 2017-07-11 13:27:56.722937 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:56.723172 I | rook-ceph-mon1: 2017-07-11 13:27:56.723156 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:56.723233 I | rook-ceph-mon1: 2017-07-11 13:27:56.723220 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:56.803806 I | rook-ceph-mon1: 2017-07-11 13:27:46.231376 osd.1 osd.1 10.233.76.4:6800/178 244 : cluster [WRN] 105 slow requests, 5 included below; oldest blocked for > 81.144176 secs
- 2017-07-11 13:27:56.803851 I | rook-ceph-mon1: 2017-07-11 13:27:46.231380 osd.1 osd.1 10.233.76.4:6800/178 245 : cluster [WRN] slow request 60.627491 seconds old, received at 2017-07-11 13:26:45.603838: pg_notify((query:26 sent:68 0.595( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:56.803869 I | rook-ceph-mon1: 2017-07-11 13:27:46.231384 osd.1 osd.1 10.233.76.4:6800/178 246 : cluster [WRN] slow request 30.655197 seconds old, received at 2017-07-11 13:27:15.576133: pg_notify((query:33 sent:85 0.710( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 85) currently wait for new map
- 2017-07-11 13:27:56.803880 I | rook-ceph-mon1: 2017-07-11 13:27:46.231386 osd.1 osd.1 10.233.76.4:6800/178 247 : cluster [WRN] slow request 30.282693 seconds old, received at 2017-07-11 13:27:15.948637: pg_notify((query:33 sent:85 0.718( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 85) currently wait for new map
- 2017-07-11 13:27:56.803891 I | rook-ceph-mon1: 2017-07-11 13:27:46.231389 osd.1 osd.1 10.233.76.4:6800/178 248 : cluster [WRN] slow request 31.116766 seconds old, received at 2017-07-11 13:27:15.114563: pg_notify((query:33 sent:83 0.707( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:56.803917 I | rook-ceph-mon1: 2017-07-11 13:27:46.231391 osd.1 osd.1 10.233.76.4:6800/178 249 : cluster [WRN] slow request 31.665693 seconds old, received at 2017-07-11 13:27:14.565637: pg_notify((query:33 sent:84 0.6ec( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:56.803931 I | rook-ceph-mon1: 2017-07-11 13:27:47.231623 osd.1 osd.1 10.233.76.4:6800/178 250 : cluster [WRN] 98 slow requests, 5 included below; oldest blocked for > 82.144421 secs
- 2017-07-11 13:27:56.803942 I | rook-ceph-mon1: 2017-07-11 13:27:47.231627 osd.1 osd.1 10.233.76.4:6800/178 251 : cluster [WRN] slow request 62.126519 seconds old, received at 2017-07-11 13:26:45.105055: pg_notify((query:26 sent:68 0.58a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:56.803952 I | rook-ceph-mon1: 2017-07-11 13:27:47.231630 osd.1 osd.1 10.233.76.4:6800/178 252 : cluster [WRN] slow request 63.952048 seconds old, received at 2017-07-11 13:26:43.279526: pg_notify((query:26 sent:66 0.577( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 66) currently wait for new map
- 2017-07-11 13:27:56.803962 I | rook-ceph-mon1: 2017-07-11 13:27:47.231632 osd.1 osd.1 10.233.76.4:6800/178 253 : cluster [WRN] slow request 31.698025 seconds old, received at 2017-07-11 13:27:15.533549: pg_notify((query:33 sent:85 0.70d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 85) currently wait for new map
- 2017-07-11 13:27:56.803972 I | rook-ceph-mon1: 2017-07-11 13:27:47.231635 osd.1 osd.1 10.233.76.4:6800/178 254 : cluster [WRN] slow request 73.529111 seconds old, received at 2017-07-11 13:26:33.702464: pg_notify((query:25 sent:56 0.51c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:56.804005 I | rook-ceph-mon1: 2017-07-11 13:27:47.231638 osd.1 osd.1 10.233.76.4:6800/178 255 : cluster [WRN] slow request 62.639275 seconds old, received at 2017-07-11 13:26:44.592300: pg_notify((query:26 sent:67 0.585( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:56.804018 I | rook-ceph-mon1: 2017-07-11 13:27:48.232898 osd.1 osd.1 10.233.76.4:6800/178 256 : cluster [WRN] 91 slow requests, 5 included below; oldest blocked for > 96.647456 secs
- 2017-07-11 13:27:56.804029 I | rook-ceph-mon1: 2017-07-11 13:27:48.232904 osd.1 osd.1 10.233.76.4:6800/178 257 : cluster [WRN] slow request 63.640544 seconds old, received at 2017-07-11 13:26:44.592300: pg_notify((query:26 sent:67 0.585( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:56.804041 I | rook-ceph-mon1: 2017-07-11 13:27:48.232907 osd.1 osd.1 10.233.76.4:6800/178 258 : cluster [WRN] slow request 40.013111 seconds old, received at 2017-07-11 13:27:08.219733: pg_notify((query:33 sent:82 0.5d4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:56.804051 I | rook-ceph-mon1: 2017-07-11 13:27:48.232909 osd.1 osd.1 10.233.76.4:6800/178 259 : cluster [WRN] slow request 71.590286 seconds old, received at 2017-07-11 13:26:36.642558: pg_notify((query:25 sent:61 0.53d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:56.804077 I | rook-ceph-mon1: 2017-07-11 13:27:48.232911 osd.1 osd.1 10.233.76.4:6800/178 260 : cluster [WRN] slow request 43.246956 seconds old, received at 2017-07-11 13:27:04.985887: pg_notify((query:30 sent:78 0.5f9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:30 sent:78 0.608( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.60a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:56.804090 I | rook-ceph-mon1: 2017-07-11 13:27:48.232914 osd.1 osd.1 10.233.76.4:6800/178 261 : cluster [WRN] slow request 37.072739 seconds old, received at 2017-07-11 13:27:11.160105: pg_notify((query:33 sent:84 0.69c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:56.804101 I | rook-ceph-mon1: 2017-07-11 13:27:49.233130 osd.1 osd.1 10.233.76.4:6800/178 262 : cluster [WRN] 92 slow requests, 5 included below; oldest blocked for > 97.647688 secs
- 2017-07-11 13:27:56.804112 I | rook-ceph-mon1: 2017-07-11 13:27:49.233135 osd.1 osd.1 10.233.76.4:6800/178 263 : cluster [WRN] slow request 30.033977 seconds old, received at 2017-07-11 13:27:19.199097: pg_notify((query:33 sent:86 0.735( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:56.804123 I | rook-ceph-mon1: 2017-07-11 13:27:49.233137 osd.1 osd.1 10.233.76.4:6800/178 264 : cluster [WRN] slow request 70.813718 seconds old, received at 2017-07-11 13:26:38.419357: pg_notify((query:25 sent:62 0.551( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 62) currently wait for new map
- 2017-07-11 13:27:56.804133 I | rook-ceph-mon1: 2017-07-11 13:27:49.233140 osd.1 osd.1 10.233.76.4:6800/178 265 : cluster [WRN] slow request 60.350007 seconds old, received at 2017-07-11 13:26:48.883068: pg_notify((query:26 sent:70 0.5ab( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 70) currently wait for new map
- 2017-07-11 13:27:56.804160 I | rook-ceph-mon1: 2017-07-11 13:27:49.233142 osd.1 osd.1 10.233.76.4:6800/178 266 : cluster [WRN] slow request 51.699534 seconds old, received at 2017-07-11 13:26:57.533540: pg_notify((query:26 sent:77 0.605( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:56.804171 I | rook-ceph-mon1: 2017-07-11 13:27:49.233146 osd.1 osd.1 10.233.76.4:6800/178 267 : cluster [WRN] slow request 75.255146 seconds old, received at 2017-07-11 13:26:33.977929: pg_notify((query:25 sent:56 0.51e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:56.804187 I | rook-ceph-mon1: 2017-07-11 13:27:50.233371 osd.1 osd.1 10.233.76.4:6800/178 268 : cluster [WRN] 93 slow requests, 5 included below; oldest blocked for > 98.647930 secs
- 2017-07-11 13:27:56.804200 I | rook-ceph-mon1: 2017-07-11 13:27:50.233377 osd.1 osd.1 10.233.76.4:6800/178 269 : cluster [WRN] slow request 30.401485 seconds old, received at 2017-07-11 13:27:19.831832: pg_notify((query:33 sent:86 0.73a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:56.804211 I | rook-ceph-mon1: 2017-07-11 13:27:50.233379 osd.1 osd.1 10.233.76.4:6800/178 270 : cluster [WRN] slow request 61.350249 seconds old, received at 2017-07-11 13:26:48.883068: pg_notify((query:26 sent:70 0.5ab( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 70) currently wait for new map
- 2017-07-11 13:27:56.804235 I | rook-ceph-mon1: 2017-07-11 13:27:50.233382 osd.1 osd.1 10.233.76.4:6800/178 271 : cluster [WRN] slow request 66.953742 seconds old, received at 2017-07-11 13:26:43.279575: pg_notify((query:26 sent:66 0.57a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 66) currently wait for new map
- 2017-07-11 13:27:56.804246 I | rook-ceph-mon1: 2017-07-11 13:27:50.233384 osd.1 osd.1 10.233.76.4:6800/178 272 : cluster [WRN] slow request 42.012912 seconds old, received at 2017-07-11 13:27:08.220405: pg_notify((query:33 sent:82 0.634( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:56.804257 I | rook-ceph-mon1: 2017-07-11 13:27:50.233386 osd.1 osd.1 10.233.76.4:6800/178 273 : cluster [WRN] slow request 70.342753 seconds old, received at 2017-07-11 13:26:39.890564: pg_notify((query:25 sent:61 0.558( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:56.804267 I | rook-ceph-mon1: 2017-07-11 13:27:51.242252 osd.1 osd.1 10.233.76.4:6800/178 274 : cluster [WRN] 104 slow requests, 5 included below; oldest blocked for > 99.656573 secs
- 2017-07-11 13:27:56.804288 I | rook-ceph-mon1: 2017-07-11 13:27:51.242257 osd.1 osd.1 10.233.76.4:6800/178 275 : cluster [WRN] slow request 60.200202 seconds old, received at 2017-07-11 13:26:51.041759: pg_notify((query:26 sent:72 0.5bc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 72) currently wait for new map
- 2017-07-11 13:27:56.804316 I | rook-ceph-mon1: 2017-07-11 13:27:51.242266 osd.1 osd.1 10.233.76.4:6800/178 276 : cluster [WRN] slow request 96.978876 seconds old, received at 2017-07-11 13:26:14.263085: osd_pg_create(e45 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.804337 I | rook-ceph-mon1: 2017-07-11 13:27:51.242273 osd.1 osd.1 10.233.76.4:6800/178 277 : cluster [WRN] slow request 95.369145 seconds old, received at 2017-07-11 13:26:15.872816: osd_pg_create(e46 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.804357 I | rook-ceph-mon1: 2017-07-11 13:27:51.242278 osd.1 osd.1 10.233.76.4:6800/178 278 : cluster [WRN] slow request 94.044219 seconds old, received at 2017-07-11 13:26:17.197741: osd_pg_create(e47 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.804387 I | rook-ceph-mon1: 2017-07-11 13:27:51.242283 osd.1 osd.1 10.233.76.4:6800/178 279 : cluster [WRN] slow request 92.879030 seconds old, received at 2017-07-11 13:26:18.362931: osd_pg_create(e48 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.804404 I | rook-ceph-mon1: 2017-07-11 13:27:51.845944 osd.0 osd.0 10.233.72.0:6800/180 51 : cluster [WRN] map e103 wrongly marked me down at e99
- 2017-07-11 13:27:56.804414 I | rook-ceph-mon1: 2017-07-11 13:27:52.242645 osd.1 osd.1 10.233.76.4:6800/178 280 : cluster [WRN] 87 slow requests, 5 included below; oldest blocked for > 75.599868 secs
- 2017-07-11 13:27:56.804428 I | rook-ceph-mon1: 2017-07-11 13:27:52.242657 osd.1 osd.1 10.233.76.4:6800/178 281 : cluster [WRN] slow request 95.044685 seconds old, received at 2017-07-11 13:26:17.197741: osd_pg_create(e47 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently started
- 2017-07-11 13:27:56.804458 I | rook-ceph-mon1: 2017-07-11 13:27:52.242662 osd.1 osd.1 10.233.76.4:6800/178 282 : cluster [WRN] slow request 93.879496 seconds old, received at 2017-07-11 13:26:18.362931: osd_pg_create(e48 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.804489 I | rook-ceph-mon1: 2017-07-11 13:27:52.242667 osd.1 osd.1 10.233.76.4:6800/178 283 : cluster [WRN] slow request 92.142505 seconds old, received at 2017-07-11 13:26:20.099922: osd_pg_create(e49 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.804509 I | rook-ceph-mon1: 2017-07-11 13:27:52.242672 osd.1 osd.1 10.233.76.4:6800/178 284 : cluster [WRN] slow request 90.643368 seconds old, received at 2017-07-11 13:26:21.599058: osd_pg_create(e50 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.804539 I | rook-ceph-mon1: 2017-07-11 13:27:52.242687 osd.1 osd.1 10.233.76.4:6800/178 285 : cluster [WRN] slow request 89.306341 seconds old, received at 2017-07-11 13:26:22.936086: osd_pg_create(e51 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.804553 I | rook-ceph-mon1: 2017-07-11 13:27:53.242971 osd.1 osd.1 10.233.76.4:6800/178 286 : cluster [WRN] 85 slow requests, 5 included below; oldest blocked for > 76.600234 secs
- 2017-07-11 13:27:56.804565 I | rook-ceph-mon1: 2017-07-11 13:27:53.242975 osd.1 osd.1 10.233.76.4:6800/178 287 : cluster [WRN] slow request 30.644460 seconds old, received at 2017-07-11 13:27:22.598333: pg_notify((query:33 sent:88 0.754( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 88) currently wait for new map
- 2017-07-11 13:27:56.804576 I | rook-ceph-mon1: 2017-07-11 13:27:53.242978 osd.1 osd.1 10.233.76.4:6800/178 288 : cluster [WRN] slow request 89.851805 seconds old, received at 2017-07-11 13:26:23.390988: osd pg remove(epoch 50; pg0.4d; ) currently wait for new map
- 2017-07-11 13:27:56.804590 I | rook-ceph-mon1: 2017-07-11 13:27:53.242982 osd.1 osd.1 10.233.76.4:6800/178 289 : cluster [WRN] slow request 90.306707 seconds old, received at 2017-07-11 13:26:22.936086: osd_pg_create(e51 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently started
- 2017-07-11 13:27:56.804621 I | rook-ceph-mon1: 2017-07-11 13:27:53.242986 osd.1 osd.1 10.233.76.4:6800/178 290 : cluster [WRN] slow request 88.629480 seconds old, received at 2017-07-11 13:26:24.613312: osd_pg_create(e52 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.804638 I | rook-ceph-mon1: 2017-07-11 13:27:53.242989 osd.1 osd.1 10.233.76.4:6800/178 291 : cluster [WRN] slow request 88.254915 seconds old, received at 2017-07-11 13:26:24.987877: osd_pg_create(e53 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.804651 I | rook-ceph-mon1: 2017-07-11 13:27:54.248265 osd.1 osd.1 10.233.76.4:6800/178 292 : cluster [WRN] 77 slow requests, 5 included below; oldest blocked for > 77.605662 secs
- 2017-07-11 13:27:56.804662 I | rook-ceph-mon1: 2017-07-11 13:27:54.248269 osd.1 osd.1 10.233.76.4:6800/178 293 : cluster [WRN] slow request 62.261968 seconds old, received at 2017-07-11 13:26:51.986252: pg_notify((query:26 sent:73 0.5cb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 73) currently wait for new map
- 2017-07-11 13:27:56.804674 I | rook-ceph-mon1: 2017-07-11 13:27:54.248273 osd.1 osd.1 10.233.76.4:6800/178 294 : cluster [WRN] slow request 60.475974 seconds old, received at 2017-07-11 13:26:53.772246: pg_notify((query:26 sent:75 0.5df( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 75) currently wait for new map
- 2017-07-11 13:27:56.804699 I | rook-ceph-mon1: 2017-07-11 13:27:54.248277 osd.1 osd.1 10.233.76.4:6800/178 295 : cluster [WRN] slow request 33.326644 seconds old, received at 2017-07-11 13:27:20.921576: pg_notify((query:33 sent:86 0.743( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:56.804710 I | rook-ceph-mon1: 2017-07-11 13:27:54.248279 osd.1 osd.1 10.233.76.4:6800/178 296 : cluster [WRN] slow request 32.118362 seconds old, received at 2017-07-11 13:27:22.129859: pg_notify((query:33 sent:86 0.751( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:56.804720 I | rook-ceph-mon1: 2017-07-11 13:27:54.248282 osd.1 osd.1 10.233.76.4:6800/178 297 : cluster [WRN] slow request 33.820998 seconds old, received at 2017-07-11 13:27:20.427222: pg_notify((query:33 sent:87 0.741( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 87) currently wait for new map
- 2017-07-11 13:27:56.804730 I | rook-ceph-mon1: 2017-07-11 13:27:55.248442 osd.1 osd.1 10.233.76.4:6800/178 298 : cluster [WRN] 59 slow requests, 5 included below; oldest blocked for > 64.206642 secs
- 2017-07-11 13:27:56.804739 I | rook-ceph-mon1: 2017-07-11 13:27:55.248447 osd.1 osd.1 10.233.76.4:6800/178 299 : cluster [WRN] slow request 60.469408 seconds old, received at 2017-07-11 13:26:54.778993: pg_notify((query:26 sent:76 0.5eb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:56.804749 I | rook-ceph-mon1: 2017-07-11 13:27:55.248450 osd.1 osd.1 10.233.76.4:6800/178 300 : cluster [WRN] slow request 60.028286 seconds old, received at 2017-07-11 13:26:55.220115: pg_notify((query:26 sent:76 0.5f2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:56.804769 I | rook-ceph-mon1: 2017-07-11 13:27:55.248454 osd.1 osd.1 10.233.76.4:6800/178 301 : cluster [WRN] slow request 60.647076 seconds old, received at 2017-07-11 13:26:54.601325: pg_notify((query:26 sent:76 0.5e8( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:56.804780 I | rook-ceph-mon1: 2017-07-11 13:27:55.248457 osd.1 osd.1 10.233.76.4:6800/178 302 : cluster [WRN] slow request 33.915342 seconds old, received at 2017-07-11 13:27:21.333059: pg_notify((query:33 sent:88 0.74a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 88) currently wait for new map
- 2017-07-11 13:27:56.804792 I | rook-ceph-mon1: 2017-07-11 13:27:55.248459 osd.1 osd.1 10.233.76.4:6800/178 303 : cluster [WRN] slow request 41.837203 seconds old, received at 2017-07-11 13:27:13.411198: pg_notify((query:33 sent:84 0.6cd( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:56.804803 I | rook-ceph-mon1: 2017-07-11 13:27:55.359173 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 263 : cluster [INF] osdmap e106: 6 total, 6 up, 6 in
- 2017-07-11 13:27:57.191556 I | rook-ceph-mon1: 2017-07-11 13:27:57.191527 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:57.191827 I | rook-ceph-mon1: 2017-07-11 13:27:57.191802 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:57.192459 I | rook-ceph-mon1: 2017-07-11 13:27:57.192438 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:57.199290 I | rook-ceph-mon1: 2017-07-11 13:27:57.199270 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:57.199765 I | rook-ceph-mon1: 2017-07-11 13:27:57.199748 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:57.199842 I | rook-ceph-mon1: 2017-07-11 13:27:57.199829 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:57.200270 I | rook-ceph-mon1: 2017-07-11 13:27:57.200252 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:57.200339 I | rook-ceph-mon1: 2017-07-11 13:27:57.200325 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:57.200761 I | rook-ceph-mon1: 2017-07-11 13:27:57.200744 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:57.200827 I | rook-ceph-mon1: 2017-07-11 13:27:57.200814 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:57.201213 I | rook-ceph-mon1: 2017-07-11 13:27:57.201197 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:57.201287 I | rook-ceph-mon1: 2017-07-11 13:27:57.201274 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:57.940042 I | rook-ceph-mon1: 2017-07-11 13:27:57.940013 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:57.947477 I | rook-ceph-mon1: 2017-07-11 13:27:57.947431 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:57.948048 I | rook-ceph-mon1: 2017-07-11 13:27:57.948032 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:57.948226 I | rook-ceph-mon1: 2017-07-11 13:27:57.948195 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:57.948616 I | rook-ceph-mon1: 2017-07-11 13:27:57.948600 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:57.948783 I | rook-ceph-mon1: 2017-07-11 13:27:57.948753 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:57.949217 I | rook-ceph-mon1: 2017-07-11 13:27:57.949200 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:57.949385 I | rook-ceph-mon1: 2017-07-11 13:27:57.949355 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:57.949772 I | rook-ceph-mon1: 2017-07-11 13:27:57.949756 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:57.949937 I | rook-ceph-mon1: 2017-07-11 13:27:57.949908 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:57.950357 I | rook-ceph-mon1: 2017-07-11 13:27:57.950341 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:57.950526 I | rook-ceph-mon1: 2017-07-11 13:27:57.950496 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:58.513319 I | rook-ceph-mon1: 2017-07-11 13:27:56.470839 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 264 : cluster [INF] osdmap e107: 6 total, 6 up, 6 in
- 2017-07-11 13:27:58.513396 I | rook-ceph-mon1: 2017-07-11 13:27:57.081894 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 265 : cluster [INF] osdmap e108: 6 total, 6 up, 6 in
- 2017-07-11 13:27:59.226903 I | rook-ceph-mon1: 2017-07-11 13:27:59.226879 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:27:59.228347 I | rook-ceph-mon1: 2017-07-11 13:27:59.228330 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:27:59.228782 I | rook-ceph-mon1: 2017-07-11 13:27:59.228766 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:27:59.228850 I | rook-ceph-mon1: 2017-07-11 13:27:59.228836 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:27:59.229447 I | rook-ceph-mon1: 2017-07-11 13:27:59.229430 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:27:59.229679 I | rook-ceph-mon1: 2017-07-11 13:27:59.229664 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:27:59.246078 I | rook-ceph-mon1: 2017-07-11 13:27:59.246061 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:27:59.246146 I | rook-ceph-mon1: 2017-07-11 13:27:59.246133 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:27:59.246546 I | rook-ceph-mon1: 2017-07-11 13:27:59.246529 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:27:59.246677 I | rook-ceph-mon1: 2017-07-11 13:27:59.246662 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:27:59.247023 I | rook-ceph-mon1: 2017-07-11 13:27:59.247007 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:27:59.247084 I | rook-ceph-mon1: 2017-07-11 13:27:59.247071 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:27:59.578959 I | rook-ceph-mon1: 2017-07-11 13:27:57.891366 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 266 : cluster [INF] osdmap e109: 6 total, 6 up, 6 in
- 2017-07-11 13:27:59.579468 I | rook-ceph-mon1: 2017-07-11 13:27:59.197103 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 267 : cluster [INF] osdmap e110: 6 total, 6 up, 6 in
- 2017-07-11 13:28:01.452309 I | rook-ceph-mon1: 2017-07-11 13:28:01.452268 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:01.459065 I | rook-ceph-mon1: 2017-07-11 13:28:01.459027 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:01.459324 I | rook-ceph-mon1: 2017-07-11 13:28:01.459288 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:01.459405 I | rook-ceph-mon1: 2017-07-11 13:28:01.459368 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:01.459586 I | rook-ceph-mon1: 2017-07-11 13:28:01.459568 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:01.459649 I | rook-ceph-mon1: 2017-07-11 13:28:01.459636 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:01.459900 I | rook-ceph-mon1: 2017-07-11 13:28:01.459882 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:01.459968 I | rook-ceph-mon1: 2017-07-11 13:28:01.459955 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:01.460190 I | rook-ceph-mon1: 2017-07-11 13:28:01.460175 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:01.460248 I | rook-ceph-mon1: 2017-07-11 13:28:01.460235 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:01.460451 I | rook-ceph-mon1: 2017-07-11 13:28:01.460423 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:01.460506 I | rook-ceph-mon1: 2017-07-11 13:28:01.460493 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:01.889204 I | rook-ceph-mon1: 2017-07-11 13:28:01.871715 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:01.889408 I | rook-ceph-mon1: 2017-07-11 13:28:01.871732 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:01.889444 I | rook-ceph-mon1: 2017-07-11 13:28:01.871939 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:01.889476 I | rook-ceph-mon1: 2017-07-11 13:28:01.871951 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:01.889504 I | rook-ceph-mon1: 2017-07-11 13:28:01.872155 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:01.889520 I | rook-ceph-mon1: 2017-07-11 13:28:01.872166 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:01.889550 I | rook-ceph-mon1: 2017-07-11 13:28:01.872456 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:01.889566 I | rook-ceph-mon1: 2017-07-11 13:28:01.872468 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:01.889582 I | rook-ceph-mon1: 2017-07-11 13:28:01.872734 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:01.889597 I | rook-ceph-mon1: 2017-07-11 13:28:01.872747 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:01.889625 I | rook-ceph-mon1: 2017-07-11 13:28:01.888975 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:01.889641 I | rook-ceph-mon1: 2017-07-11 13:28:01.888989 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:02.510597 I | rook-ceph-mon1: 2017-07-11 13:28:01.375068 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 269 : cluster [INF] osdmap e111: 6 total, 6 up, 6 in
- 2017-07-11 13:28:02.519320 I | rook-ceph-mon1: 2017-07-11 13:28:01.767503 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 270 : cluster [INF] osdmap e112: 6 total, 6 up, 6 in
- 2017-07-11 13:28:03.110967 I | rook-ceph-mon1: 2017-07-11 13:28:03.110938 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:03.111119 I | rook-ceph-mon1: 2017-07-11 13:28:03.111055 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:03.111518 I | rook-ceph-mon1: 2017-07-11 13:28:03.111502 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:03.111581 I | rook-ceph-mon1: 2017-07-11 13:28:03.111567 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:03.111937 I | rook-ceph-mon1: 2017-07-11 13:28:03.111917 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:03.112096 I | rook-ceph-mon1: 2017-07-11 13:28:03.112003 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:03.112515 I | rook-ceph-mon1: 2017-07-11 13:28:03.112495 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:03.112576 I | rook-ceph-mon1: 2017-07-11 13:28:03.112564 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:03.112958 I | rook-ceph-mon1: 2017-07-11 13:28:03.112943 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:03.113019 I | rook-ceph-mon1: 2017-07-11 13:28:03.113007 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:03.113441 I | rook-ceph-mon1: 2017-07-11 13:28:03.113426 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:03.122200 I | rook-ceph-mon1: 2017-07-11 13:28:03.122176 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:04.117860 I | rook-ceph-mon1: 2017-07-11 13:28:03.045809 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 271 : cluster [INF] osdmap e113: 6 total, 6 up, 6 in
- 2017-07-11 13:28:04.539729 I | rook-ceph-mon1: 2017-07-11 13:28:04.539702 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:04.539843 I | rook-ceph-mon1: 2017-07-11 13:28:04.539828 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:04.540391 I | rook-ceph-mon1: 2017-07-11 13:28:04.540375 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:04.540624 I | rook-ceph-mon1: 2017-07-11 13:28:04.540609 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:04.541177 I | rook-ceph-mon1: 2017-07-11 13:28:04.541161 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:04.541389 I | rook-ceph-mon1: 2017-07-11 13:28:04.541373 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:04.541955 I | rook-ceph-mon1: 2017-07-11 13:28:04.541939 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:04.542116 I | rook-ceph-mon1: 2017-07-11 13:28:04.542101 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:04.542648 I | rook-ceph-mon1: 2017-07-11 13:28:04.542631 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:04.548867 I | rook-ceph-mon1: 2017-07-11 13:28:04.548847 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:04.549661 I | rook-ceph-mon1: 2017-07-11 13:28:04.549643 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:04.549708 I | rook-ceph-mon1: 2017-07-11 13:28:04.549694 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:05.648182 I | rook-ceph-mon1: 2017-07-11 13:28:04.370173 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 273 : cluster [INF] osdmap e114: 6 total, 6 up, 6 in
- 2017-07-11 13:28:05.649350 I | rook-ceph-mon1: 2017-07-11 13:28:05.281233 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 275 : cluster [INF] HEALTH_WARN; 178 pgs peering; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:28:05.950814 I | rook-ceph-mon1: 2017-07-11 13:28:05.950794 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:05.950981 I | rook-ceph-mon1: 2017-07-11 13:28:05.950962 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:05.951379 I | rook-ceph-mon1: 2017-07-11 13:28:05.951364 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:05.951541 I | rook-ceph-mon1: 2017-07-11 13:28:05.951526 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:05.951998 I | rook-ceph-mon1: 2017-07-11 13:28:05.951983 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:05.952155 I | rook-ceph-mon1: 2017-07-11 13:28:05.952141 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:05.952610 I | rook-ceph-mon1: 2017-07-11 13:28:05.952595 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:05.952786 I | rook-ceph-mon1: 2017-07-11 13:28:05.952752 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:05.953285 I | rook-ceph-mon1: 2017-07-11 13:28:05.953268 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:05.953355 I | rook-ceph-mon1: 2017-07-11 13:28:05.953341 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:05.953763 I | rook-ceph-mon1: 2017-07-11 13:28:05.953748 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:05.953931 I | rook-ceph-mon1: 2017-07-11 13:28:05.953917 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:07.280000 I | rook-ceph-mon1: 2017-07-11 13:28:07.279973 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:07.280167 I | rook-ceph-mon1: 2017-07-11 13:28:07.280107 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:07.280402 I | rook-ceph-mon1: 2017-07-11 13:28:07.280386 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:07.280463 I | rook-ceph-mon1: 2017-07-11 13:28:07.280450 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:07.280666 I | rook-ceph-mon1: 2017-07-11 13:28:07.280637 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:07.280722 I | rook-ceph-mon1: 2017-07-11 13:28:07.280709 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:07.280926 I | rook-ceph-mon1: 2017-07-11 13:28:07.280892 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:07.281012 I | rook-ceph-mon1: 2017-07-11 13:28:07.280968 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:07.281204 I | rook-ceph-mon1: 2017-07-11 13:28:07.281187 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:07.281264 I | rook-ceph-mon1: 2017-07-11 13:28:07.281252 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:07.281590 I | rook-ceph-mon1: 2017-07-11 13:28:07.281573 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:07.281829 I | rook-ceph-mon1: 2017-07-11 13:28:07.281805 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:07.399192 I | rook-ceph-mon1: 2017-07-11 13:27:56.248965 osd.1 osd.1 10.233.76.4:6800/178 304 : cluster [WRN] 51 slow requests, 5 included below; oldest blocked for > 48.503111 secs
- 2017-07-11 13:28:07.401354 I | rook-ceph-mon1: 2017-07-11 13:27:56.248970 osd.1 osd.1 10.233.76.4:6800/178 305 : cluster [WRN] slow request 48.009182 seconds old, received at 2017-07-11 13:27:08.239537: osd pg remove(epoch 82; pg0.336; ) currently wait for new map
- 2017-07-11 13:28:07.401382 I | rook-ceph-mon1: 2017-07-11 13:27:56.248972 osd.1 osd.1 10.233.76.4:6800/178 306 : cluster [WRN] slow request 47.970436 seconds old, received at 2017-07-11 13:27:08.278283: osd pg remove(epoch 82; pg0.2e6; ) currently wait for new map
- 2017-07-11 13:28:07.401396 I | rook-ceph-mon1: 2017-07-11 13:27:56.248975 osd.1 osd.1 10.233.76.4:6800/178 307 : cluster [WRN] slow request 48.009160 seconds old, received at 2017-07-11 13:27:08.239559: osd pg remove(epoch 82; pg0.199; ) currently wait for new map
- 2017-07-11 13:28:07.401406 I | rook-ceph-mon1: 2017-07-11 13:27:56.248977 osd.1 osd.1 10.233.76.4:6800/178 308 : cluster [WRN] slow request 47.970427 seconds old, received at 2017-07-11 13:27:08.278291: osd pg remove(epoch 82; pg0.3b3; ) currently wait for new map
- 2017-07-11 13:28:07.401417 I | rook-ceph-mon1: 2017-07-11 13:27:56.248980 osd.1 osd.1 10.233.76.4:6800/178 309 : cluster [WRN] slow request 48.009044 seconds old, received at 2017-07-11 13:27:08.239674: osd pg remove(epoch 82; pg0.197; ) currently wait for new map
- 2017-07-11 13:28:07.401458 I | rook-ceph-mon1: 2017-07-11 13:27:57.249520 osd.1 osd.1 10.233.76.4:6800/178 310 : cluster [WRN] 28 slow requests, 2 included below; oldest blocked for > 46.611937 secs
- 2017-07-11 13:28:07.401470 I | rook-ceph-mon1: 2017-07-11 13:27:57.249525 osd.1 osd.1 10.233.76.4:6800/178 311 : cluster [WRN] slow request 30.617720 seconds old, received at 2017-07-11 13:27:26.631760: pg_notify((query:33 sent:86 0.775( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:28:07.401480 I | rook-ceph-mon1: 2017-07-11 13:27:57.249528 osd.1 osd.1 10.233.76.4:6800/178 312 : cluster [WRN] slow request 30.041037 seconds old, received at 2017-07-11 13:27:27.208443: pg_notify((query:33 sent:86 0.77d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:28:07.401492 I | rook-ceph-mon1: 2017-07-11 13:28:05.804575 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 276 : cluster [INF] osdmap e115: 6 total, 6 up, 6 in
- 2017-07-11 13:28:08.313004 I | rook-ceph-mon1: 2017-07-11 13:28:08.312976 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:08.313168 I | rook-ceph-mon1: 2017-07-11 13:28:08.313098 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:08.313587 I | rook-ceph-mon1: 2017-07-11 13:28:08.313570 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:08.313750 I | rook-ceph-mon1: 2017-07-11 13:28:08.313736 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:08.314276 I | rook-ceph-mon1: 2017-07-11 13:28:08.314250 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:08.314456 I | rook-ceph-mon1: 2017-07-11 13:28:08.314415 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:08.314887 I | rook-ceph-mon1: 2017-07-11 13:28:08.314866 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:08.315070 I | rook-ceph-mon1: 2017-07-11 13:28:08.315039 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:08.315501 I | rook-ceph-mon1: 2017-07-11 13:28:08.315484 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:08.315669 I | rook-ceph-mon1: 2017-07-11 13:28:08.315637 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:08.316058 I | rook-ceph-mon1: 2017-07-11 13:28:08.316042 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:08.316270 I | rook-ceph-mon1: 2017-07-11 13:28:08.316255 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:08.823140 I | rook-ceph-mon1: 2017-07-11 13:28:06.907330 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 278 : cluster [INF] osdmap e116: 6 total, 6 up, 6 in
- 2017-07-11 13:28:08.823195 I | rook-ceph-mon1: 2017-07-11 13:28:08.157071 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 280 : cluster [INF] osdmap e117: 6 total, 6 up, 6 in
- 2017-07-11 13:28:09.589260 I | rook-ceph-mon1: 2017-07-11 13:28:09.589219 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:09.589528 I | rook-ceph-mon1: 2017-07-11 13:28:09.589486 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:09.589963 I | rook-ceph-mon1: 2017-07-11 13:28:09.589947 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:09.590185 I | rook-ceph-mon1: 2017-07-11 13:28:09.590169 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:09.590640 I | rook-ceph-mon1: 2017-07-11 13:28:09.590624 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:09.590971 I | rook-ceph-mon1: 2017-07-11 13:28:09.590945 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:09.591467 I | rook-ceph-mon1: 2017-07-11 13:28:09.591449 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:09.591659 I | rook-ceph-mon1: 2017-07-11 13:28:09.591632 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:09.592130 I | rook-ceph-mon1: 2017-07-11 13:28:09.592113 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:09.592309 I | rook-ceph-mon1: 2017-07-11 13:28:09.592269 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:09.592721 I | rook-ceph-mon1: 2017-07-11 13:28:09.592695 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:09.598594 I | rook-ceph-mon1: 2017-07-11 13:28:09.598577 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:09.940570 I | rook-ceph-mon1: 2017-07-11 13:28:09.528677 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 281 : cluster [INF] osdmap e118: 6 total, 6 up, 6 in
- 2017-07-11 13:28:11.076975 I | rook-ceph-mon1: 2017-07-11 13:28:11.076950 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:11.077553 I | rook-ceph-mon1: 2017-07-11 13:28:11.077537 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:11.077773 I | rook-ceph-mon1: 2017-07-11 13:28:11.077753 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:11.077993 I | rook-ceph-mon1: 2017-07-11 13:28:11.077979 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:11.079807 I | rook-ceph-mon1: 2017-07-11 13:28:11.079705 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:11.079869 I | rook-ceph-mon1: 2017-07-11 13:28:11.079856 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:11.080085 I | rook-ceph-mon1: 2017-07-11 13:28:11.080069 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:11.080143 I | rook-ceph-mon1: 2017-07-11 13:28:11.080130 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:11.080355 I | rook-ceph-mon1: 2017-07-11 13:28:11.080316 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:11.080429 I | rook-ceph-mon1: 2017-07-11 13:28:11.080402 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:11.080625 I | rook-ceph-mon1: 2017-07-11 13:28:11.080598 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:11.080685 I | rook-ceph-mon1: 2017-07-11 13:28:11.080669 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:11.857199 I | rook-ceph-mon1: 2017-07-11 13:28:10.772923 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 282 : cluster [INF] osdmap e119: 6 total, 6 up, 6 in
- 2017-07-11 13:28:12.876240 I | rook-ceph-mon1: 2017-07-11 13:28:12.876209 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:12.876422 I | rook-ceph-mon1: 2017-07-11 13:28:12.876342 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:12.876903 I | rook-ceph-mon1: 2017-07-11 13:28:12.876886 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:12.877111 I | rook-ceph-mon1: 2017-07-11 13:28:12.877076 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:12.877544 I | rook-ceph-mon1: 2017-07-11 13:28:12.877528 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:12.877702 I | rook-ceph-mon1: 2017-07-11 13:28:12.877688 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:12.878131 I | rook-ceph-mon1: 2017-07-11 13:28:12.878116 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:12.878318 I | rook-ceph-mon1: 2017-07-11 13:28:12.878283 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:12.878752 I | rook-ceph-mon1: 2017-07-11 13:28:12.878721 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:12.878911 I | rook-ceph-mon1: 2017-07-11 13:28:12.878896 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:12.889659 I | rook-ceph-mon1: 2017-07-11 13:28:12.889640 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:12.889753 I | rook-ceph-mon1: 2017-07-11 13:28:12.889738 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:13.859702 I | rook-ceph-mon1: 2017-07-11 13:28:13.859670 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:28:13.859912 I | rook-ceph-mon1: 2017-07-11 13:28:13.859879 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1314240123' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:28:14.134124 I | rook-ceph-mon1: 2017-07-11 13:28:12.744037 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 283 : cluster [INF] osdmap e120: 6 total, 6 up, 6 in
- 2017-07-11 13:28:14.398107 I | rook-ceph-mon1: 2017-07-11 13:28:14.398083 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:14.398205 I | rook-ceph-mon1: 2017-07-11 13:28:14.398191 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:14.415039 I | rook-ceph-mon1: 2017-07-11 13:28:14.414989 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:14.415108 I | rook-ceph-mon1: 2017-07-11 13:28:14.415094 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:14.415511 I | rook-ceph-mon1: 2017-07-11 13:28:14.415494 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:14.415714 I | rook-ceph-mon1: 2017-07-11 13:28:14.415683 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:14.416154 I | rook-ceph-mon1: 2017-07-11 13:28:14.416132 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:14.416323 I | rook-ceph-mon1: 2017-07-11 13:28:14.416309 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:14.416743 I | rook-ceph-mon1: 2017-07-11 13:28:14.416727 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:14.416903 I | rook-ceph-mon1: 2017-07-11 13:28:14.416888 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:14.417343 I | rook-ceph-mon1: 2017-07-11 13:28:14.417326 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:14.417537 I | rook-ceph-mon1: 2017-07-11 13:28:14.417503 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:15.356937 I | rook-ceph-mon1: 2017-07-11 13:28:14.371326 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 285 : cluster [INF] osdmap e121: 6 total, 6 up, 6 in
- 2017-07-11 13:28:15.654141 I | rook-ceph-mon1: 2017-07-11 13:28:15.654117 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:15.660595 I | rook-ceph-mon1: 2017-07-11 13:28:15.660557 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:15.661026 I | rook-ceph-mon1: 2017-07-11 13:28:15.661009 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:15.661201 I | rook-ceph-mon1: 2017-07-11 13:28:15.661186 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:15.661650 I | rook-ceph-mon1: 2017-07-11 13:28:15.661623 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:15.661831 I | rook-ceph-mon1: 2017-07-11 13:28:15.661801 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:15.662210 I | rook-ceph-mon1: 2017-07-11 13:28:15.662194 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:15.662369 I | rook-ceph-mon1: 2017-07-11 13:28:15.662354 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:15.662851 I | rook-ceph-mon1: 2017-07-11 13:28:15.662834 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:15.663010 I | rook-ceph-mon1: 2017-07-11 13:28:15.662995 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:15.663416 I | rook-ceph-mon1: 2017-07-11 13:28:15.663397 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:15.663612 I | rook-ceph-mon1: 2017-07-11 13:28:15.663597 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:16.824163 I | rook-ceph-mon1: 2017-07-11 13:28:15.650065 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 286 : cluster [INF] osdmap e122: 6 total, 6 up, 6 in
- 2017-07-11 13:28:17.133783 I | rook-ceph-mon1: 2017-07-11 13:28:17.133755 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:17.133996 I | rook-ceph-mon1: 2017-07-11 13:28:17.133979 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:17.134573 I | rook-ceph-mon1: 2017-07-11 13:28:17.134555 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:17.134784 I | rook-ceph-mon1: 2017-07-11 13:28:17.134769 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:17.135190 I | rook-ceph-mon1: 2017-07-11 13:28:17.135173 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:17.135394 I | rook-ceph-mon1: 2017-07-11 13:28:17.135362 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:17.135859 I | rook-ceph-mon1: 2017-07-11 13:28:17.135842 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:17.142024 I | rook-ceph-mon1: 2017-07-11 13:28:17.141994 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:17.142362 I | rook-ceph-mon1: 2017-07-11 13:28:17.142346 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:17.142408 I | rook-ceph-mon1: 2017-07-11 13:28:17.142396 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:17.142726 I | rook-ceph-mon1: 2017-07-11 13:28:17.142710 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:17.142766 I | rook-ceph-mon1: 2017-07-11 13:28:17.142754 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:17.375796 I | rook-ceph-mon1: 2017-07-11 13:28:17.375775 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:17.375886 I | rook-ceph-mon1: 2017-07-11 13:28:17.375868 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:17.376452 I | rook-ceph-mon1: 2017-07-11 13:28:17.376436 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:17.382995 I | rook-ceph-mon1: 2017-07-11 13:28:17.382973 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:17.383541 I | rook-ceph-mon1: 2017-07-11 13:28:17.383515 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:17.384551 I | rook-ceph-mon1: 2017-07-11 13:28:17.384536 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:17.384954 I | rook-ceph-mon1: 2017-07-11 13:28:17.384938 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:17.385021 I | rook-ceph-mon1: 2017-07-11 13:28:17.385008 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:17.385395 I | rook-ceph-mon1: 2017-07-11 13:28:17.385379 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:17.385620 I | rook-ceph-mon1: 2017-07-11 13:28:17.385602 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:17.386070 I | rook-ceph-mon1: 2017-07-11 13:28:17.386046 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:17.386218 I | rook-ceph-mon1: 2017-07-11 13:28:17.386204 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:18.223136 I | rook-ceph-mon1: 2017-07-11 13:28:17.031562 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 289 : cluster [INF] osdmap e123: 6 total, 6 up, 6 in
- 2017-07-11 13:28:18.223541 I | rook-ceph-mon1: 2017-07-11 13:28:17.239569 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 291 : cluster [INF] osdmap e124: 6 total, 6 up, 6 in
- 2017-07-11 13:28:19.656393 I | rook-ceph-mon1: 2017-07-11 13:28:19.652788 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:19.656487 I | rook-ceph-mon1: 2017-07-11 13:28:19.652810 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:19.656582 I | rook-ceph-mon1: 2017-07-11 13:28:19.652946 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:19.656617 I | rook-ceph-mon1: 2017-07-11 13:28:19.652957 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:19.656636 I | rook-ceph-mon1: 2017-07-11 13:28:19.653152 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:19.656652 I | rook-ceph-mon1: 2017-07-11 13:28:19.653163 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:19.656668 I | rook-ceph-mon1: 2017-07-11 13:28:19.653381 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:19.656696 I | rook-ceph-mon1: 2017-07-11 13:28:19.653393 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:19.656713 I | rook-ceph-mon1: 2017-07-11 13:28:19.653580 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:19.656729 I | rook-ceph-mon1: 2017-07-11 13:28:19.653591 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:19.656744 I | rook-ceph-mon1: 2017-07-11 13:28:19.653845 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:19.656772 I | rook-ceph-mon1: 2017-07-11 13:28:19.653856 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:21.047259 I | rook-ceph-mon1: 2017-07-11 13:28:21.047227 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:21.050215 I | rook-ceph-mon1: 2017-07-11 13:28:21.050198 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:21.050471 I | rook-ceph-mon1: 2017-07-11 13:28:21.050455 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:21.050540 I | rook-ceph-mon1: 2017-07-11 13:28:21.050522 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:21.050790 I | rook-ceph-mon1: 2017-07-11 13:28:21.050774 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:21.050855 I | rook-ceph-mon1: 2017-07-11 13:28:21.050842 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:21.051071 I | rook-ceph-mon1: 2017-07-11 13:28:21.051054 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:21.051132 I | rook-ceph-mon1: 2017-07-11 13:28:21.051119 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:21.067470 I | rook-ceph-mon1: 2017-07-11 13:28:21.067150 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:21.067493 I | rook-ceph-mon1: 2017-07-11 13:28:21.067185 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:21.067508 I | rook-ceph-mon1: 2017-07-11 13:28:21.067292 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:21.067520 I | rook-ceph-mon1: 2017-07-11 13:28:21.067311 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:21.147758 I | rook-ceph-mon1: 2017-07-11 13:28:19.653996 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 292 : cluster [INF] osdmap e125: 6 total, 6 up, 6 in
- 2017-07-11 13:28:22.355449 I | rook-ceph-mon1: 2017-07-11 13:28:20.915334 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 297 : cluster [INF] osdmap e126: 6 total, 6 up, 6 in
- 2017-07-11 13:28:46.345092 I | rook-ceph-mon1: 2017-07-11 13:28:46.345061 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:28:46.345286 I | rook-ceph-mon1: 2017-07-11 13:28:46.345201 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1790748315' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:28:46.731255 I | rook-ceph-mon1: 2017-07-11 13:28:46.731227 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:46.733109 I | rook-ceph-mon1: 2017-07-11 13:28:46.733091 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:46.733509 I | rook-ceph-mon1: 2017-07-11 13:28:46.733492 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:46.733715 I | rook-ceph-mon1: 2017-07-11 13:28:46.733604 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:46.733993 I | rook-ceph-mon1: 2017-07-11 13:28:46.733977 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:46.734055 I | rook-ceph-mon1: 2017-07-11 13:28:46.734042 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:46.734271 I | rook-ceph-mon1: 2017-07-11 13:28:46.734255 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:46.734330 I | rook-ceph-mon1: 2017-07-11 13:28:46.734318 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:46.734579 I | rook-ceph-mon1: 2017-07-11 13:28:46.734561 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:46.734650 I | rook-ceph-mon1: 2017-07-11 13:28:46.734636 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:46.734856 I | rook-ceph-mon1: 2017-07-11 13:28:46.734827 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:46.734909 I | rook-ceph-mon1: 2017-07-11 13:28:46.734897 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:46.855918 I | rook-ceph-mon1: 2017-07-11 13:28:46.408075 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 300 : cluster [INF] osd.0 failed (root=default,host=master-1) (5 reporters from different host after 27.149230 >= grace 25.430099)
- 2017-07-11 13:28:46.855963 I | rook-ceph-mon1: 2017-07-11 13:28:46.408119 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 301 : cluster [INF] osd.2 failed (root=default,host=master-0) (5 reporters from different host after 27.148959 >= grace 25.137665)
- 2017-07-11 13:28:46.855980 I | rook-ceph-mon1: 2017-07-11 13:28:46.408138 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 302 : cluster [INF] osd.3 failed (root=default,host=master-2) (5 reporters from different host after 27.148717 >= grace 24.383721)
- 2017-07-11 13:28:48.169534 I | rook-ceph-mon1: 2017-07-11 13:28:46.611904 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 303 : cluster [INF] osdmap e127: 6 total, 3 up, 6 in
- 2017-07-11 13:28:48.172978 I | rook-ceph-mon1: 2017-07-11 13:28:46.811742 osd.3 osd.3 10.233.86.0:6800/178 16 : cluster [WRN] map e127 wrongly marked me down at e127
- 2017-07-11 13:28:48.450907 I | rook-ceph-mon1: 2017-07-11 13:28:48.450885 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:48.450993 I | rook-ceph-mon1: 2017-07-11 13:28:48.450978 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:48.451527 I | rook-ceph-mon1: 2017-07-11 13:28:48.451504 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:48.451605 I | rook-ceph-mon1: 2017-07-11 13:28:48.451591 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:48.452036 I | rook-ceph-mon1: 2017-07-11 13:28:48.452019 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:48.452289 I | rook-ceph-mon1: 2017-07-11 13:28:48.452268 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:48.452757 I | rook-ceph-mon1: 2017-07-11 13:28:48.452740 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:48.452820 I | rook-ceph-mon1: 2017-07-11 13:28:48.452807 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:48.453227 I | rook-ceph-mon1: 2017-07-11 13:28:48.453200 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:48.453439 I | rook-ceph-mon1: 2017-07-11 13:28:48.453407 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:48.453816 I | rook-ceph-mon1: 2017-07-11 13:28:48.453801 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:48.453975 I | rook-ceph-mon1: 2017-07-11 13:28:48.453960 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:48.772856 I | rook-ceph-mon1: 2017-07-11 13:28:48.772827 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:48.772962 I | rook-ceph-mon1: 2017-07-11 13:28:48.772947 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:48.773413 I | rook-ceph-mon1: 2017-07-11 13:28:48.773397 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:48.773587 I | rook-ceph-mon1: 2017-07-11 13:28:48.773572 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:48.774098 I | rook-ceph-mon1: 2017-07-11 13:28:48.774081 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:48.774258 I | rook-ceph-mon1: 2017-07-11 13:28:48.774243 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:48.774683 I | rook-ceph-mon1: 2017-07-11 13:28:48.774666 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:48.774896 I | rook-ceph-mon1: 2017-07-11 13:28:48.774852 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:48.775463 I | rook-ceph-mon1: 2017-07-11 13:28:48.775446 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:48.775528 I | rook-ceph-mon1: 2017-07-11 13:28:48.775514 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:48.775941 I | rook-ceph-mon1: 2017-07-11 13:28:48.775924 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:48.776169 I | rook-ceph-mon1: 2017-07-11 13:28:48.776149 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:49.468669 I | rook-ceph-mon1: 2017-07-11 13:28:48.346465 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 304 : cluster [INF] osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:28:49.478490 I | rook-ceph-mon1: 2017-07-11 13:28:48.346713 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 305 : cluster [INF] osdmap e128: 6 total, 4 up, 6 in
- 2017-07-11 13:28:49.478540 I | rook-ceph-mon1: 2017-07-11 13:28:48.725338 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 306 : cluster [INF] osdmap e129: 6 total, 4 up, 6 in
- 2017-07-11 13:28:50.211929 I | rook-ceph-mon1: 2017-07-11 13:28:50.211871 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:28:50.213324 I | rook-ceph-mon1: 2017-07-11 13:28:50.213305 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:28:50.213572 I | rook-ceph-mon1: 2017-07-11 13:28:50.213557 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:28:50.213639 I | rook-ceph-mon1: 2017-07-11 13:28:50.213626 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:28:50.213856 I | rook-ceph-mon1: 2017-07-11 13:28:50.213840 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:28:50.213916 I | rook-ceph-mon1: 2017-07-11 13:28:50.213903 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:28:50.214121 I | rook-ceph-mon1: 2017-07-11 13:28:50.214092 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:28:50.214175 I | rook-ceph-mon1: 2017-07-11 13:28:50.214162 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:28:50.214405 I | rook-ceph-mon1: 2017-07-11 13:28:50.214390 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:28:50.214570 I | rook-ceph-mon1: 2017-07-11 13:28:50.214547 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:28:50.221853 I | rook-ceph-mon1: 2017-07-11 13:28:50.221798 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:28:50.221919 I | rook-ceph-mon1: 2017-07-11 13:28:50.221905 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:28:50.768105 I | rook-ceph-mon1: 2017-07-11 13:28:46.720300 osd.2 osd.2 10.233.69.0:6800/178 16 : cluster [WRN] map e127 wrongly marked me down at e127
- 2017-07-11 13:28:50.768725 I | rook-ceph-mon1: 2017-07-11 13:28:49.970181 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 307 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:28:50.768754 I | rook-ceph-mon1: 2017-07-11 13:28:49.970424 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 308 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:28:50.768768 I | rook-ceph-mon1: 2017-07-11 13:28:49.970609 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 309 : cluster [INF] osdmap e130: 6 total, 6 up, 6 in
- 2017-07-11 13:28:50.768780 I | rook-ceph-mon1: 2017-07-11 13:28:50.348085 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 310 : cluster [INF] osdmap e131: 6 total, 6 up, 6 in
- 2017-07-11 13:28:51.012827 I | rook-ceph-mon1: 2017-07-11 13:28:51.012805 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 13:28:51.012908 I | rook-ceph-mon1: 2017-07-11 13:28:51.012895 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2443609820' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 13:28:54.227806 I | rook-ceph-mon1: 2017-07-11 13:28:54.211790 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4683 MB, avail 94503 MB
- 2017-07-11 13:28:56.639288 I | rook-ceph-mon1: 2017-07-11 13:28:46.711677 osd.0 osd.0 10.233.72.0:6800/180 52 : cluster [WRN] map e127 wrongly marked me down at e127
- 2017-07-11 13:29:05.565869 I | rook-ceph-mon1: 2017-07-11 13:29:05.281261 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 312 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.057379s > max 0.05s
- 2017-07-11 13:29:05.572254 I | rook-ceph-mon1: 2017-07-11 13:29:05.281595 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 313 : cluster [INF] HEALTH_WARN; clock skew detected on mon.rook-ceph-mon2; too many PGs per OSD (341 > max 300); Monitor clock skew detected
- 2017-07-11 13:29:29.572178 I | rook-ceph-mon1: 2017-07-11 13:29:29.572151 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:29:29.572276 I | rook-ceph-mon1: 2017-07-11 13:29:29.572262 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3153558274' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:29:35.639887 I | rook-ceph-mon1: 2017-07-11 13:29:35.282978 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 332 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0567242s > max 0.05s
- 2017-07-11 13:29:36.621209 I | rook-ceph-mon1: 2017-07-11 13:29:36.621180 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:29:36.621374 I | rook-ceph-mon1: 2017-07-11 13:29:36.621298 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:29:36.621911 I | rook-ceph-mon1: 2017-07-11 13:29:36.621895 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:29:36.627943 I | rook-ceph-mon1: 2017-07-11 13:29:36.627915 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:29:36.628309 I | rook-ceph-mon1: 2017-07-11 13:29:36.628293 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:29:36.628350 I | rook-ceph-mon1: 2017-07-11 13:29:36.628337 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:29:36.628651 I | rook-ceph-mon1: 2017-07-11 13:29:36.628635 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:29:36.628690 I | rook-ceph-mon1: 2017-07-11 13:29:36.628678 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:29:36.629003 I | rook-ceph-mon1: 2017-07-11 13:29:36.628988 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:29:36.629054 I | rook-ceph-mon1: 2017-07-11 13:29:36.629042 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:29:36.629593 I | rook-ceph-mon1: 2017-07-11 13:29:36.629577 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:29:36.629637 I | rook-ceph-mon1: 2017-07-11 13:29:36.629621 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:29:36.858641 I | rook-ceph-mon1: 2017-07-11 13:29:36.441482 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 333 : cluster [INF] osd.5 failed (root=default,host=minion-1) (4 reporters from different host after 24.165733 >= grace 22.318605)
- 2017-07-11 13:29:36.860393 I | rook-ceph-mon1: 2017-07-11 13:29:36.551524 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 334 : cluster [INF] osdmap e132: 6 total, 5 up, 6 in
- 2017-07-11 13:29:42.007641 I | rook-ceph-mon1: 2017-07-11 13:29:42.007610 7f0042342700 1 heartbeat_map reset_timeout 'cpu_tp thread cpu_tp' had timed out after 0
- 2017-07-11 13:29:42.047474 I | rook-ceph-mon1: 2017-07-11 13:29:42.047455 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:29:42.047553 I | rook-ceph-mon1: 2017-07-11 13:29:42.047538 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:29:42.047787 I | rook-ceph-mon1: 2017-07-11 13:29:42.047772 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:29:42.047856 I | rook-ceph-mon1: 2017-07-11 13:29:42.047843 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:29:42.048058 I | rook-ceph-mon1: 2017-07-11 13:29:42.048028 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:29:42.048114 I | rook-ceph-mon1: 2017-07-11 13:29:42.048102 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:29:42.048368 I | rook-ceph-mon1: 2017-07-11 13:29:42.048296 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:29:42.048428 I | rook-ceph-mon1: 2017-07-11 13:29:42.048415 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:29:42.048626 I | rook-ceph-mon1: 2017-07-11 13:29:42.048597 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:29:42.048683 I | rook-ceph-mon1: 2017-07-11 13:29:42.048666 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:29:42.054918 I | rook-ceph-mon1: 2017-07-11 13:29:42.054894 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:29:42.054960 I | rook-ceph-mon1: 2017-07-11 13:29:42.054947 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:29:42.174813 I | rook-ceph-mon1: 2017-07-11 13:29:41.457270 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 337 : cluster [INF] osd.0 failed (root=default,host=master-1) (4 reporters from different host after 26.826850 >= grace 25.513242)
- 2017-07-11 13:29:42.175317 I | rook-ceph-mon1: 2017-07-11 13:29:41.457311 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 338 : cluster [INF] osd.2 failed (root=default,host=master-0) (4 reporters from different host after 27.632048 >= grace 25.128155)
- 2017-07-11 13:29:42.175359 I | rook-ceph-mon1: 2017-07-11 13:29:41.457327 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 339 : cluster [INF] osd.3 failed (root=default,host=master-2) (4 reporters from different host after 26.826716 >= grace 24.377216)
- 2017-07-11 13:29:42.175379 I | rook-ceph-mon1: 2017-07-11 13:29:41.695300 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 340 : cluster [INF] osdmap e133: 6 total, 2 up, 6 in
- 2017-07-11 13:29:46.866972 I | rook-ceph-mon1: 2017-07-11 13:29:46.866940 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:29:46.867077 I | rook-ceph-mon1: 2017-07-11 13:29:46.867062 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:29:46.867368 I | rook-ceph-mon1: 2017-07-11 13:29:46.867351 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:29:46.867431 I | rook-ceph-mon1: 2017-07-11 13:29:46.867418 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:29:46.867662 I | rook-ceph-mon1: 2017-07-11 13:29:46.867646 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:29:46.867725 I | rook-ceph-mon1: 2017-07-11 13:29:46.867709 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:29:46.867928 I | rook-ceph-mon1: 2017-07-11 13:29:46.867899 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:29:46.867982 I | rook-ceph-mon1: 2017-07-11 13:29:46.867970 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:29:46.868192 I | rook-ceph-mon1: 2017-07-11 13:29:46.868177 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:29:46.868282 I | rook-ceph-mon1: 2017-07-11 13:29:46.868234 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:29:46.868555 I | rook-ceph-mon1: 2017-07-11 13:29:46.868540 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:29:46.868723 I | rook-ceph-mon1: 2017-07-11 13:29:46.868709 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:29:47.183879 I | rook-ceph-mon1: 2017-07-11 13:29:41.780816 osd.0 osd.0 10.233.72.0:6800/180 53 : cluster [WRN] map e133 wrongly marked me down at e133
- 2017-07-11 13:29:47.192144 I | rook-ceph-mon1: 2017-07-11 13:29:46.508018 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 341 : cluster [INF] osd.4 failed (root=default,host=minion-2) (2 reporters from different host after 26.605152 >= grace 24.528981)
- 2017-07-11 13:29:47.192250 I | rook-ceph-mon1: 2017-07-11 13:29:46.835426 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 342 : cluster [INF] osdmap e134: 6 total, 1 up, 6 in
- 2017-07-11 13:29:48.347220 I | rook-ceph-mon1: 2017-07-11 13:29:41.699497 osd.3 osd.3 10.233.86.0:6800/178 17 : cluster [WRN] map e133 wrongly marked me down at e133
- 2017-07-11 13:29:49.780431 I | rook-ceph-mon1: 2017-07-11 13:29:41.877104 osd.2 osd.2 10.233.69.0:6800/178 17 : cluster [WRN] map e133 wrongly marked me down at e133
- 2017-07-11 13:29:51.790480 I | rook-ceph-mon1: 2017-07-11 13:29:51.790447 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:29:51.790673 I | rook-ceph-mon1: 2017-07-11 13:29:51.790590 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:29:51.790915 I | rook-ceph-mon1: 2017-07-11 13:29:51.790901 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:29:51.790978 I | rook-ceph-mon1: 2017-07-11 13:29:51.790965 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:29:51.791194 I | rook-ceph-mon1: 2017-07-11 13:29:51.791179 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:29:51.791252 I | rook-ceph-mon1: 2017-07-11 13:29:51.791239 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:29:51.791435 I | rook-ceph-mon1: 2017-07-11 13:29:51.791420 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:29:51.791508 I | rook-ceph-mon1: 2017-07-11 13:29:51.791495 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:29:51.791725 I | rook-ceph-mon1: 2017-07-11 13:29:51.791709 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:29:51.791789 I | rook-ceph-mon1: 2017-07-11 13:29:51.791772 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:29:51.792013 I | rook-ceph-mon1: 2017-07-11 13:29:51.791974 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:29:51.792068 I | rook-ceph-mon1: 2017-07-11 13:29:51.792056 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:29:52.957362 I | rook-ceph-mon1: 2017-07-11 13:29:51.757576 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 343 : cluster [INF] osdmap e135: 6 total, 1 up, 6 in
- 2017-07-11 13:29:54.230265 I | rook-ceph-mon1: 2017-07-11 13:29:54.230065 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4683 MB, avail 94503 MB
- 2017-07-11 13:30:05.529132 I | rook-ceph-mon1: 2017-07-11 13:30:05.281807 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 344 : cluster [INF] HEALTH_WARN; clock skew detected on mon.rook-ceph-mon2; 5 hosts (5 osds) down; 5 osds down; 1696 pgs stale; too many PGs per OSD (341 > max 300); Monitor clock skew detected
- 2017-07-11 13:30:12.824061 I | rook-ceph-mon1: 2017-07-11 13:30:12.824021 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:30:12.830193 I | rook-ceph-mon1: 2017-07-11 13:30:12.830173 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/691516283' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:30:45.228763 I | rook-ceph-mon1: 2017-07-11 13:30:45.228732 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:30:45.228859 I | rook-ceph-mon1: 2017-07-11 13:30:45.228845 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1047896822' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:30:49.354667 I | rook-ceph-mon1: 2017-07-11 13:30:48.081252 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 32 : cluster [WRN] message from mon.0 was stamped 0.051486s in the future, clocks not synchronized
- 2017-07-11 13:30:54.327128 I | rook-ceph-mon1: 2017-07-11 13:30:54.306651 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4683 MB, avail 94503 MB
- 2017-07-11 13:30:56.022533 I | rook-ceph-mon1: 2017-07-11 13:30:56.022508 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:30:56.022618 I | rook-ceph-mon1: 2017-07-11 13:30:56.022604 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/5429497' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:31:05.538425 I | rook-ceph-mon1: 2017-07-11 13:31:05.281997 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 346 : cluster [INF] HEALTH_WARN; 5 hosts (5 osds) down; 5 osds down; 1696 pgs stale; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:31:28.741582 I | rook-ceph-mon1: 2017-07-11 13:31:28.741547 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:31:28.750614 I | rook-ceph-mon1: 2017-07-11 13:31:28.750596 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/491321285' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:31:39.629607 I | rook-ceph-mon1: 2017-07-11 13:31:39.629564 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:31:39.629824 I | rook-ceph-mon1: 2017-07-11 13:31:39.629722 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1113557308' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:31:54.371171 I | rook-ceph-mon1: 2017-07-11 13:31:54.370872 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4683 MB, avail 94503 MB
- 2017-07-11 13:32:54.391339 I | rook-ceph-mon1: 2017-07-11 13:32:54.391122 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4683 MB, avail 94503 MB
- 2017-07-11 13:32:56.949120 I | rook-ceph-mon1: 2017-07-11 13:32:56.949034 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #9. Immutable memtables: 0.
- 2017-07-11 13:32:56.950384 I | rook-ceph-mon1:
- 2017-07-11 13:32:56.950610 I | rook-ceph-mon1: 2017-07-11 13:32:56.950590 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 3] Syncing log #6
- 2017-07-11 13:32:57.008467 I | rook-ceph-mon1: 2017-07-11 13:32:57.008431 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:32:56.950580) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:32:57.008626 I | rook-ceph-mon1: 2017-07-11 13:32:57.008609 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 3] Flushing memtable with next log file: 9
- 2017-07-11 13:32:57.008753 I | rook-ceph-mon1:
- 2017-07-11 13:32:57.008793 I | rook-ceph-mon1: 2017-07-11 13:32:57.008780 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977008776, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 5194, "num_deletes": 259, "memory_usage": 24623632}
- 2017-07-11 13:32:57.008839 I | rook-ceph-mon1: 2017-07-11 13:32:57.008826 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 3] Level-0 flush table #10: started
- 2017-07-11 13:32:57.611537 I | rook-ceph-mon1: 2017-07-11 13:32:57.611464 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977611455, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 10, "file_size": 13526020, "table_properties": {"data_size": 13496328, "index_size": 28872, "filter_size": 0, "raw_key_size": 28643, "raw_average_key_size": 18, "raw_value_size": 13454665, "raw_average_value_size": 8542, "num_data_blocks": 922, "num_entries": 1575, "filter_policy_name": "", "kDeletedKeys": "259", "kMergeOperands": "0"}}
- 2017-07-11 13:32:57.611609 I | rook-ceph-mon1: 2017-07-11 13:32:57.611475 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 3] Level-0 flush table #10: 13526020 bytes OK
- 2017-07-11 13:32:57.689831 I | rook-ceph-mon1: 2017-07-11 13:32:57.680019 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.640466) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #10 started
- 2017-07-11 13:32:57.689884 I | rook-ceph-mon1: 2017-07-11 13:32:57.680024 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.679981) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #10: memtable #1 done
- 2017-07-11 13:32:57.689902 I | rook-ceph-mon1: 2017-07-11 13:32:57.680026 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.679992) EVENT_LOG_v1 {"time_micros": 1499779977679989, "job": 3, "event": "flush_finished", "lsm_state": [2, 0, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:32:57.689915 I | rook-ceph-mon1: 2017-07-11 13:32:57.680027 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.680006) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[2 0 0 0 0 0 0] max score 0.50
- 2017-07-11 13:32:57.689943 I | rook-ceph-mon1:
- 2017-07-11 13:32:57.689966 I | rook-ceph-mon1: 2017-07-11 13:32:57.680032 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 3] Try to delete WAL files size 24426421, prev total WAL file size 24439185, number of live WAL files 2.
- 2017-07-11 13:32:57.689988 I | rook-ceph-mon1:
- 2017-07-11 13:32:57.690850 I | rook-ceph-mon1: 2017-07-11 13:32:57.690746 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:32:57.691093 I | rook-ceph-mon1: 2017-07-11 13:32:57.691073 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 13:32:57.691181 I | rook-ceph-mon1: 2017-07-11 13:32:57.691133 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 13:32:57.691237 I | rook-ceph-mon1: ** DB Stats **
- 2017-07-11 13:32:57.691253 I | rook-ceph-mon1: Uptime(secs): 544.0 total, 544.0 interval
- 2017-07-11 13:32:57.691280 I | rook-ceph-mon1: Cumulative writes: 1276 writes, 5201 keys, 1276 commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.04 MB/s
- 2017-07-11 13:32:57.691294 I | rook-ceph-mon1: Cumulative WAL: 1276 writes, 1276 syncs, 1.00 writes per sync, written: 0.02 GB, 0.04 MB/s
- 2017-07-11 13:32:57.691305 I | rook-ceph-mon1: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:32:57.691316 I | rook-ceph-mon1: Interval writes: 1276 writes, 5201 keys, 1276 commit groups, 1.0 writes per commit group, ingest: 23.31 MB, 0.04 MB/s
- 2017-07-11 13:32:57.691327 I | rook-ceph-mon1: Interval WAL: 1276 writes, 1276 syncs, 1.00 writes per sync, written: 0.02 MB, 0.04 MB/s
- 2017-07-11 13:32:57.691338 I | rook-ceph-mon1: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:32:57.691361 I | rook-ceph-mon1:
- 2017-07-11 13:32:57.691373 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 13:32:57.691384 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:32:57.691396 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:32:57.691407 I | rook-ceph-mon1: L0 2/2 12.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 19.1 1 2 0.338 0 0
- 2017-07-11 13:32:57.691441 I | rook-ceph-mon1: Sum 2/2 12.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 19.1 1 2 0.338 0 0
- 2017-07-11 13:32:57.691455 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 19.1 1 2 0.338 0 0
- 2017-07-11 13:32:57.691467 I | rook-ceph-mon1: Uptime(secs): 544.0 total, 544.0 interval
- 2017-07-11 13:32:57.691489 I | rook-ceph-mon1: Flush(GB): cumulative 0.013, interval 0.013
- 2017-07-11 13:32:57.691500 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:32:57.691522 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:32:57.691533 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:32:57.691544 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:32:57.691555 I | rook-ceph-mon1: Cumulative compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.7 seconds
- 2017-07-11 13:32:57.691566 I | rook-ceph-mon1: Interval compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.7 seconds
- 2017-07-11 13:32:57.691577 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:32:57.691599 I | rook-ceph-mon1:
- 2017-07-11 13:32:57.691612 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:32:57.691623 I | rook-ceph-mon1:
- 2017-07-11 13:32:57.691645 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 13:32:57.691679 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:32:57.691691 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:32:57.691703 I | rook-ceph-mon1: L0 2/2 12.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 19.1 1 2 0.338 0 0
- 2017-07-11 13:32:57.691714 I | rook-ceph-mon1: Sum 2/2 12.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 19.1 1 2 0.338 0 0
- 2017-07-11 13:32:57.691725 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 13:32:57.691736 I | rook-ceph-mon1: Uptime(secs): 544.0 total, 544.0 interval
- 2017-07-11 13:32:57.691758 I | rook-ceph-mon1: Flush(GB): cumulative 0.013, interval 0.000
- 2017-07-11 13:32:57.691788 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:32:57.691799 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:32:57.691832 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:32:57.691844 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:32:57.691855 I | rook-ceph-mon1: Cumulative compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.7 seconds
- 2017-07-11 13:32:57.691866 I | rook-ceph-mon1: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 13:32:57.691877 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:32:57.691888 I | rook-ceph-mon1:
- 2017-07-11 13:32:57.691907 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:32:57.691919 I | rook-ceph-mon1:
- 2017-07-11 13:32:57.692013 I | rook-ceph-mon1: 2017-07-11 13:32:57.691995 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.691937) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:32:57.692029 I | rook-ceph-mon1:
- 2017-07-11 13:32:57.692074 I | rook-ceph-mon1: 2017-07-11 13:32:57.692057 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 4] Compacting 2@0 files to L1, score -1.00
- 2017-07-11 13:32:57.692102 I | rook-ceph-mon1: 2017-07-11 13:32:57.692092 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 3 Base level 0, inputs: [10(12MB) 4(1634B)]
- 2017-07-11 13:32:57.692127 I | rook-ceph-mon1:
- 2017-07-11 13:32:57.692163 I | rook-ceph-mon1: 2017-07-11 13:32:57.692152 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977692143, "job": 4, "event": "compaction_started", "files_L0": [10, 4], "score": -1, "input_data_size": 13527654}
- 2017-07-11 13:32:58.066083 I | rook-ceph-mon1: 2017-07-11 13:32:58.066041 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 4] Generated table #11: 1318 keys, 13522696 bytes
- 2017-07-11 13:32:58.068032 I | rook-ceph-mon1: 2017-07-11 13:32:58.068014 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779978068006, "cf_name": "default", "job": 4, "event": "table_file_creation", "file_number": 11, "file_size": 13522696, "table_properties": {"data_size": 13493010, "index_size": 28867, "filter_size": 0, "raw_key_size": 23813, "raw_average_key_size": 18, "raw_value_size": 13454723, "raw_average_value_size": 10208, "num_data_blocks": 922, "num_entries": 1318, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:32:58.235080 I | rook-ceph-mon1: 2017-07-11 13:32:58.235058 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 4] Compacted 2@0 files to L1 => 13522696 bytes
- 2017-07-11 13:32:58.265711 I | rook-ceph-mon1: 2017-07-11 13:32:58.265689 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:32:58.265641) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 24.9 rd, 24.9 wr, level 1, files in(2, 0) out(1) MB in(12.9, 0.0) out(12.9), read-write-amplify(2.0) write-amplify(1.0) OK, records in: 1580, records dropped: 262
- 2017-07-11 13:32:58.265748 I | rook-ceph-mon1:
- 2017-07-11 13:32:58.265780 I | rook-ceph-mon1: 2017-07-11 13:32:58.265765 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:32:58.265656) EVENT_LOG_v1 {"time_micros": 1499779978265650, "job": 4, "event": "compaction_finished", "compaction_time_micros": 542868, "output_level": 1, "num_output_files": 1, "total_output_size": 13522696, "num_input_records": 1580, "num_output_records": 1318, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:32:58.267346 I | rook-ceph-mon1: 2017-07-11 13:32:58.267329 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779978267326, "job": 4, "event": "table_file_deletion", "file_number": 10}
- 2017-07-11 13:32:58.274796 I | rook-ceph-mon1: 2017-07-11 13:32:58.274777 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779978274774, "job": 4, "event": "table_file_deletion", "file_number": 4}
- 2017-07-11 13:32:58.275097 I | rook-ceph-mon1: 2017-07-11 13:32:58.275023 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #12. Immutable memtables: 0.
- 2017-07-11 13:32:58.275130 I | rook-ceph-mon1:
- 2017-07-11 13:32:58.275143 I | rook-ceph-mon1: 2017-07-11 13:32:58.275057 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 5] Syncing log #9
- 2017-07-11 13:32:58.295238 I | rook-ceph-mon1: 2017-07-11 13:32:58.294985 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:32:58.275048) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:32:58.295968 I | rook-ceph-mon1: 2017-07-11 13:32:58.294993 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 5] Flushing memtable with next log file: 12
- 2017-07-11 13:32:58.295996 I | rook-ceph-mon1:
- 2017-07-11 13:32:58.296008 I | rook-ceph-mon1: 2017-07-11 13:32:58.295001 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779978294998, "job": 5, "event": "flush_started", "num_memtables": 1, "num_entries": 7, "num_deletes": 0, "memory_usage": 15008}
- 2017-07-11 13:32:58.296020 I | rook-ceph-mon1: 2017-07-11 13:32:58.295004 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 5] Level-0 flush table #13: started
- 2017-07-11 13:32:58.414076 I | rook-ceph-mon1: 2017-07-11 13:32:58.413872 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779978413862, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 13, "file_size": 9452, "table_properties": {"data_size": 8563, "index_size": 81, "filter_size": 0, "raw_key_size": 141, "raw_average_key_size": 23, "raw_value_size": 8383, "raw_average_value_size": 1397, "num_data_blocks": 3, "num_entries": 6, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:32:58.414152 I | rook-ceph-mon1: 2017-07-11 13:32:58.413883 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 5] Level-0 flush table #13: 9452 bytes OK
- 2017-07-11 13:32:58.483831 I | rook-ceph-mon1: 2017-07-11 13:32:58.483683 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:32:58.437758) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #13 started
- 2017-07-11 13:32:58.484848 I | rook-ceph-mon1: 2017-07-11 13:32:58.483690 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:32:58.483634) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #13: memtable #1 done
- 2017-07-11 13:32:58.484872 I | rook-ceph-mon1: 2017-07-11 13:32:58.483691 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:32:58.483657) EVENT_LOG_v1 {"time_micros": 1499779978483653, "job": 5, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:32:58.484905 I | rook-ceph-mon1: 2017-07-11 13:32:58.483692 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:32:58.483671) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:32:58.484919 I | rook-ceph-mon1:
- 2017-07-11 13:32:58.484955 I | rook-ceph-mon1: 2017-07-11 13:32:58.483698 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 5] Try to delete WAL files size 12764, prev total WAL file size 12764, number of live WAL files 2.
- 2017-07-11 13:32:58.484968 I | rook-ceph-mon1:
- 2017-07-11 13:32:58.484978 I | rook-ceph-mon1: 2017-07-11 13:32:58.483799 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:32:58.485033 I | rook-ceph-mon1: 2017-07-11 13:32:58.485004 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:32:58.484998) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:32:58.485047 I | rook-ceph-mon1:
- 2017-07-11 13:32:58.485075 I | rook-ceph-mon1: 2017-07-11 13:32:58.485061 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 6] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:32:58.485128 I | rook-ceph-mon1: 2017-07-11 13:32:58.485116 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 5 Base level 0, inputs: [13(9452B)], [11(12MB)]
- 2017-07-11 13:32:58.485142 I | rook-ceph-mon1:
- 2017-07-11 13:32:58.485177 I | rook-ceph-mon1: 2017-07-11 13:32:58.485165 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779978485156, "job": 6, "event": "compaction_started", "files_L0": [13], "files_L1": [11], "score": -1, "input_data_size": 13532148}
- 2017-07-11 13:32:59.012327 I | rook-ceph-mon1: 2017-07-11 13:32:59.012195 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 6] Generated table #14: 1320 keys, 13531179 bytes
- 2017-07-11 13:32:59.012397 I | rook-ceph-mon1: 2017-07-11 13:32:59.012214 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779979012206, "cf_name": "default", "job": 6, "event": "table_file_creation", "file_number": 14, "file_size": 13531179, "table_properties": {"data_size": 13501431, "index_size": 28929, "filter_size": 0, "raw_key_size": 23849, "raw_average_key_size": 18, "raw_value_size": 13463074, "raw_average_value_size": 10199, "num_data_blocks": 924, "num_entries": 1320, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:32:59.077768 I | rook-ceph-mon1: 2017-07-11 13:32:59.075586 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 6] Compacted 1@0 + 1@1 files to L1 => 13531179 bytes
- 2017-07-11 13:32:59.125148 I | rook-ceph-mon1: 2017-07-11 13:32:59.115239 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:32:59.115187) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 22.9 rd, 22.9 wr, level 1, files in(1, 1) out(1) MB in(0.0, 12.9) out(12.9), read-write-amplify(2863.2) write-amplify(1431.6) OK, records in: 1324, records dropped: 4
- 2017-07-11 13:32:59.125187 I | rook-ceph-mon1:
- 2017-07-11 13:32:59.125202 I | rook-ceph-mon1: 2017-07-11 13:32:59.115245 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:32:59.115204) EVENT_LOG_v1 {"time_micros": 1499779979115197, "job": 6, "event": "compaction_finished", "compaction_time_micros": 590367, "output_level": 1, "num_output_files": 1, "total_output_size": 13531179, "num_input_records": 1324, "num_output_records": 1320, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:32:59.125214 I | rook-ceph-mon1: 2017-07-11 13:32:59.115303 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779979115299, "job": 6, "event": "table_file_deletion", "file_number": 13}
- 2017-07-11 13:32:59.125292 I | rook-ceph-mon1: 2017-07-11 13:32:59.125280 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779979125278, "job": 6, "event": "table_file_deletion", "file_number": 11}
- 2017-07-11 13:33:17.210257 I | rook-ceph-mon1: 2017-07-11 13:33:17.210197 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:33:17.210352 I | rook-ceph-mon1: 2017-07-11 13:33:17.210338 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1879921741' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:33:54.393169 I | rook-ceph-mon1: 2017-07-11 13:33:54.392864 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4696 MB, avail 94490 MB
- 2017-07-11 13:34:54.394649 I | rook-ceph-mon1: 2017-07-11 13:34:54.394327 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4696 MB, avail 94490 MB
- 2017-07-11 13:35:06.238154 I | rook-ceph-mon1: 2017-07-11 13:35:05.283265 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 358 : cluster [INF] HEALTH_ERR; 5 hosts (5 osds) down; 5 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:35:54.395214 I | rook-ceph-mon1: 2017-07-11 13:35:54.394857 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4696 MB, avail 94490 MB
- 2017-07-11 13:35:59.949066 I | rook-ceph-mon1: 2017-07-11 13:35:59.949015 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:35:59.949296 I | rook-ceph-mon1: 2017-07-11 13:35:59.949265 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2126113725' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:36:06.396924 I | rook-ceph-mon1: 2017-07-11 13:36:05.365801 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 361 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0732848s > max 0.05s
- 2017-07-11 13:36:54.395768 I | rook-ceph-mon1: 2017-07-11 13:36:54.395523 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4696 MB, avail 94490 MB
- 2017-07-11 13:37:06.738661 I | rook-ceph-mon1: 2017-07-11 13:37:05.429926 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 368 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0727043s > max 0.05s
- 2017-07-11 13:37:26.863640 I | rook-ceph-mon1: 2017-07-11 13:37:26.863590 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:37:26.863746 I | rook-ceph-mon1: 2017-07-11 13:37:26.863731 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1132418740' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:37:35.820297 I | rook-ceph-mon1: 2017-07-11 13:37:35.457039 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 369 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0729757s > max 0.05s
- 2017-07-11 13:37:54.403427 I | rook-ceph-mon1: 2017-07-11 13:37:54.403076 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4697 MB, avail 94490 MB
- 2017-07-11 13:37:59.862439 I | rook-ceph-mon1: 2017-07-11 13:37:59.862361 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #15. Immutable memtables: 0.
- 2017-07-11 13:37:59.862498 I | rook-ceph-mon1:
- 2017-07-11 13:37:59.862516 I | rook-ceph-mon1: 2017-07-11 13:37:59.862399 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 7] Syncing log #12
- 2017-07-11 13:37:59.902022 I | rook-ceph-mon1: 2017-07-11 13:37:59.892103 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:37:59.862393) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:37:59.902062 I | rook-ceph-mon1: 2017-07-11 13:37:59.892111 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 7] Flushing memtable with next log file: 15
- 2017-07-11 13:37:59.902077 I | rook-ceph-mon1:
- 2017-07-11 13:37:59.902089 I | rook-ceph-mon1: 2017-07-11 13:37:59.892119 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780279892115, "job": 7, "event": "flush_started", "num_memtables": 1, "num_entries": 1586, "num_deletes": 251, "memory_usage": 3764408}
- 2017-07-11 13:37:59.902099 I | rook-ceph-mon1: 2017-07-11 13:37:59.892121 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 7] Level-0 flush table #16: started
- 2017-07-11 13:37:59.971450 I | rook-ceph-mon1: 2017-07-11 13:37:59.971426 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780279971418, "cf_name": "default", "job": 7, "event": "table_file_creation", "file_number": 16, "file_size": 2482014, "table_properties": {"data_size": 2470167, "index_size": 11029, "filter_size": 0, "raw_key_size": 11435, "raw_average_key_size": 17, "raw_value_size": 2453634, "raw_average_value_size": 3763, "num_data_blocks": 365, "num_entries": 652, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:37:59.971511 I | rook-ceph-mon1: 2017-07-11 13:37:59.971496 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 7] Level-0 flush table #16: 2482014 bytes OK
- 2017-07-11 13:38:00.131529 I | rook-ceph-mon1: 2017-07-11 13:38:00.131508 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.000970) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #16 started
- 2017-07-11 13:38:00.132041 I | rook-ceph-mon1: 2017-07-11 13:38:00.132025 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.131480) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #16: memtable #1 done
- 2017-07-11 13:38:00.132089 I | rook-ceph-mon1: 2017-07-11 13:38:00.132075 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.131489) EVENT_LOG_v1 {"time_micros": 1499780280131486, "job": 7, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:38:00.132116 I | rook-ceph-mon1: 2017-07-11 13:38:00.132104 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.131500) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:38:00.132129 I | rook-ceph-mon1:
- 2017-07-11 13:38:00.132168 I | rook-ceph-mon1: 2017-07-11 13:38:00.132156 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 7] Try to delete WAL files size 3732405, prev total WAL file size 3732405, number of live WAL files 2.
- 2017-07-11 13:38:00.132180 I | rook-ceph-mon1:
- 2017-07-11 13:38:00.141880 I | rook-ceph-mon1: 2017-07-11 13:38:00.132803 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:38:00.141930 I | rook-ceph-mon1: 2017-07-11 13:38:00.132837 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.132832) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 13:38:00.141947 I | rook-ceph-mon1:
- 2017-07-11 13:38:00.141961 I | rook-ceph-mon1: 2017-07-11 13:38:00.132842 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 8] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:38:00.141973 I | rook-ceph-mon1: 2017-07-11 13:38:00.132846 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 7 Base level 0, inputs: [16(2423KB)], [14(12MB)]
- 2017-07-11 13:38:00.141996 I | rook-ceph-mon1:
- 2017-07-11 13:38:00.142008 I | rook-ceph-mon1: 2017-07-11 13:38:00.132855 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780280132848, "job": 8, "event": "compaction_started", "files_L0": [16], "files_L1": [14], "score": -1, "input_data_size": 16013193}
- 2017-07-11 13:38:00.367730 I | rook-ceph-mon1: 2017-07-11 13:38:00.367696 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 8] Generated table #17: 1463 keys, 11099120 bytes
- 2017-07-11 13:38:00.368219 I | rook-ceph-mon1: 2017-07-11 13:38:00.368200 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780280368192, "cf_name": "default", "job": 8, "event": "table_file_creation", "file_number": 17, "file_size": 11099120, "table_properties": {"data_size": 11065019, "index_size": 33282, "filter_size": 0, "raw_key_size": 26781, "raw_average_key_size": 18, "raw_value_size": 11021574, "raw_average_value_size": 7533, "num_data_blocks": 1059, "num_entries": 1463, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:38:00.471801 I | rook-ceph-mon1: 2017-07-11 13:38:00.471779 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 8] Compacted 1@0 + 1@1 files to L1 => 11099120 bytes
- 2017-07-11 13:38:00.521493 I | rook-ceph-mon1: 2017-07-11 13:38:00.521471 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.521422) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 47.2 rd, 32.7 wr, level 1, files in(1, 1) out(1) MB in(2.4, 12.9) out(10.6), read-write-amplify(10.9) write-amplify(4.5) OK, records in: 1972, records dropped: 509
- 2017-07-11 13:38:00.521696 I | rook-ceph-mon1:
- 2017-07-11 13:38:00.521738 I | rook-ceph-mon1: 2017-07-11 13:38:00.521723 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.521436) EVENT_LOG_v1 {"time_micros": 1499780280521430, "job": 8, "event": "compaction_finished", "compaction_time_micros": 338912, "output_level": 1, "num_output_files": 1, "total_output_size": 11099120, "num_input_records": 1972, "num_output_records": 1463, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:38:00.527984 I | rook-ceph-mon1: 2017-07-11 13:38:00.527969 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780280527966, "job": 8, "event": "table_file_deletion", "file_number": 16}
- 2017-07-11 13:38:00.529519 I | rook-ceph-mon1: 2017-07-11 13:38:00.529505 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780280529503, "job": 8, "event": "table_file_deletion", "file_number": 14}
- 2017-07-11 13:38:05.566585 I | rook-ceph-mon1: 2017-07-11 13:38:05.284151 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 373 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon2; 5 hosts (5 osds) down; 5 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (341 > max 300); Monitor clock skew detected
- 2017-07-11 13:38:35.665817 I | rook-ceph-mon1: 2017-07-11 13:38:35.465413 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 374 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0726208s > max 0.05s
- 2017-07-11 13:38:43.382648 I | rook-ceph-mon1: 2017-07-11 13:38:42.094921 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 375 : cluster [WRN] message from mon.1 was stamped 0.050966s in the future, clocks not synchronized
- 2017-07-11 13:38:49.384093 I | rook-ceph-mon1: 2017-07-11 13:38:48.471605 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 377 : cluster [WRN] message from mon.1 was stamped 0.052154s in the future, clocks not synchronized
- 2017-07-11 13:38:54.407343 I | rook-ceph-mon1: 2017-07-11 13:38:54.407106 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4694 MB, avail 94492 MB
- 2017-07-11 13:39:04.769274 I | rook-ceph-mon1: 2017-07-11 13:39:04.769244 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:39:04.769437 I | rook-ceph-mon1: 2017-07-11 13:39:04.769370 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4008798960' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:39:19.598066 I | rook-ceph-mon1: 2017-07-11 13:39:18.303060 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 379 : cluster [WRN] message from mon.1 was stamped 0.054269s in the future, clocks not synchronized
- 2017-07-11 13:39:37.101865 I | rook-ceph-mon1: 2017-07-11 13:39:37.101823 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:39:37.102039 I | rook-ceph-mon1: 2017-07-11 13:39:37.101957 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:39:37.102526 I | rook-ceph-mon1: 2017-07-11 13:39:37.102511 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:39:37.102682 I | rook-ceph-mon1: 2017-07-11 13:39:37.102668 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:39:37.103124 I | rook-ceph-mon1: 2017-07-11 13:39:37.103102 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:39:37.103334 I | rook-ceph-mon1: 2017-07-11 13:39:37.103320 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:39:37.103742 I | rook-ceph-mon1: 2017-07-11 13:39:37.103726 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:39:37.103891 I | rook-ceph-mon1: 2017-07-11 13:39:37.103877 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:39:37.104350 I | rook-ceph-mon1: 2017-07-11 13:39:37.104335 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:39:37.104495 I | rook-ceph-mon1: 2017-07-11 13:39:37.104481 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:39:37.104882 I | rook-ceph-mon1: 2017-07-11 13:39:37.104867 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:39:37.105034 I | rook-ceph-mon1: 2017-07-11 13:39:37.105020 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:39:37.313804 I | rook-ceph-mon1: 2017-07-11 13:39:37.313772 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:39:37.313918 I | rook-ceph-mon1: 2017-07-11 13:39:37.313904 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2318963363' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:39:37.939030 I | rook-ceph-mon1: 2017-07-11 13:39:36.776470 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 380 : cluster [INF] osd.5 out (down for 600.225244)
- 2017-07-11 13:39:37.940373 I | rook-ceph-mon1: 2017-07-11 13:39:36.927602 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 381 : cluster [INF] osdmap e136: 6 total, 1 up, 5 in
- 2017-07-11 13:39:47.026534 I | rook-ceph-mon1: 2017-07-11 13:39:47.026508 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 13:39:47.026631 I | rook-ceph-mon1: 2017-07-11 13:39:47.026616 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 13:39:47.027179 I | rook-ceph-mon1: 2017-07-11 13:39:47.027150 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 13:39:47.027422 I | rook-ceph-mon1: 2017-07-11 13:39:47.027346 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 13:39:47.043609 I | rook-ceph-mon1: 2017-07-11 13:39:47.036227 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 13:39:47.043661 I | rook-ceph-mon1: 2017-07-11 13:39:47.036242 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 13:39:47.043685 I | rook-ceph-mon1: 2017-07-11 13:39:47.036479 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 13:39:47.043704 I | rook-ceph-mon1: 2017-07-11 13:39:47.036498 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 13:39:47.043737 I | rook-ceph-mon1: 2017-07-11 13:39:47.036766 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 13:39:47.043757 I | rook-ceph-mon1: 2017-07-11 13:39:47.036779 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 13:39:47.043780 I | rook-ceph-mon1: 2017-07-11 13:39:47.036990 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 13:39:47.043819 I | rook-ceph-mon1: 2017-07-11 13:39:47.037002 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 13:39:47.703495 I | rook-ceph-mon1: 2017-07-11 13:39:46.849512 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 382 : cluster [INF] osd.0 out (down for 605.155937)
- 2017-07-11 13:39:47.709593 I | rook-ceph-mon1: 2017-07-11 13:39:46.944482 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 383 : cluster [INF] osdmap e137: 6 total, 1 up, 4 in
- 2017-07-11 13:39:54.412644 I | rook-ceph-mon1: 2017-07-11 13:39:54.412376 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4694 MB, avail 94492 MB
- 2017-07-11 13:40:05.882540 I | rook-ceph-mon1: 2017-07-11 13:40:05.284971 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 386 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 13:40:05.888724 I | rook-ceph-mon1: 2017-07-11 13:40:05.472329 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 387 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0644023s > max 0.05s
- 2017-07-11 13:40:54.419342 I | rook-ceph-mon1: 2017-07-11 13:40:54.415547 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4694 MB, avail 94492 MB
- 2017-07-11 13:41:22.185955 I | rook-ceph-mon1: 2017-07-11 13:41:22.184878 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #18. Immutable memtables: 0.
- 2017-07-11 13:41:22.186024 I | rook-ceph-mon1:
- 2017-07-11 13:41:22.186042 I | rook-ceph-mon1: 2017-07-11 13:41:22.184913 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 9] Syncing log #15
- 2017-07-11 13:41:22.217092 I | rook-ceph-mon1: 2017-07-11 13:41:22.214519 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.184908) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:41:22.217130 I | rook-ceph-mon1: 2017-07-11 13:41:22.214527 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 9] Flushing memtable with next log file: 18
- 2017-07-11 13:41:22.217145 I | rook-ceph-mon1:
- 2017-07-11 13:41:22.217156 I | rook-ceph-mon1: 2017-07-11 13:41:22.214535 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482214531, "job": 9, "event": "flush_started", "num_memtables": 1, "num_entries": 1201, "num_deletes": 252, "memory_usage": 2890432}
- 2017-07-11 13:41:22.217167 I | rook-ceph-mon1: 2017-07-11 13:41:22.214536 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 9] Level-0 flush table #19: started
- 2017-07-11 13:41:22.294374 I | rook-ceph-mon1: 2017-07-11 13:41:22.294318 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482294302, "cf_name": "default", "job": 9, "event": "table_file_creation", "file_number": 19, "file_size": 1285232, "table_properties": {"data_size": 1279694, "index_size": 4723, "filter_size": 0, "raw_key_size": 8322, "raw_average_key_size": 18, "raw_value_size": 1270283, "raw_average_value_size": 2835, "num_data_blocks": 160, "num_entries": 448, "filter_policy_name": "", "kDeletedKeys": "252", "kMergeOperands": "0"}}
- 2017-07-11 13:41:22.297972 I | rook-ceph-mon1: 2017-07-11 13:41:22.297954 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 9] Level-0 flush table #19: 1285232 bytes OK
- 2017-07-11 13:41:22.373870 I | rook-ceph-mon1: 2017-07-11 13:41:22.373849 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.333981) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #19 started
- 2017-07-11 13:41:22.374038 I | rook-ceph-mon1: 2017-07-11 13:41:22.374021 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.373822) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #19: memtable #1 done
- 2017-07-11 13:41:22.374151 I | rook-ceph-mon1: 2017-07-11 13:41:22.374118 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.373831) EVENT_LOG_v1 {"time_micros": 1499780482373827, "job": 9, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:41:22.374361 I | rook-ceph-mon1: 2017-07-11 13:41:22.374344 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.373842) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:41:22.374439 I | rook-ceph-mon1:
- 2017-07-11 13:41:22.374518 I | rook-ceph-mon1: 2017-07-11 13:41:22.374505 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 9] Try to delete WAL files size 2865962, prev total WAL file size 2865962, number of live WAL files 2.
- 2017-07-11 13:41:22.374576 I | rook-ceph-mon1:
- 2017-07-11 13:41:22.413809 I | rook-ceph-mon1: 2017-07-11 13:41:22.394218 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:41:22.414081 I | rook-ceph-mon1: 2017-07-11 13:41:22.394256 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.394251) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:41:22.414115 I | rook-ceph-mon1:
- 2017-07-11 13:41:22.414150 I | rook-ceph-mon1: 2017-07-11 13:41:22.394261 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 10] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:41:22.414179 I | rook-ceph-mon1: 2017-07-11 13:41:22.394265 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 9 Base level 0, inputs: [19(1255KB)], [17(10MB)]
- 2017-07-11 13:41:22.414190 I | rook-ceph-mon1:
- 2017-07-11 13:41:22.414201 I | rook-ceph-mon1: 2017-07-11 13:41:22.394274 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482394268, "job": 10, "event": "compaction_started", "files_L0": [19], "files_L1": [17], "score": -1, "input_data_size": 12384352}
- 2017-07-11 13:41:23.354189 I | rook-ceph-mon1: 2017-07-11 13:41:23.354152 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 10] Generated table #20: 1492 keys, 11476513 bytes
- 2017-07-11 13:41:23.354284 I | rook-ceph-mon1: 2017-07-11 13:41:23.354267 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780483354259, "cf_name": "default", "job": 10, "event": "table_file_creation", "file_number": 20, "file_size": 11476513, "table_properties": {"data_size": 11442552, "index_size": 33142, "filter_size": 0, "raw_key_size": 27058, "raw_average_key_size": 18, "raw_value_size": 11398889, "raw_average_value_size": 7640, "num_data_blocks": 1061, "num_entries": 1492, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:41:23.418103 I | rook-ceph-mon1: 2017-07-11 13:41:23.418079 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 10] Compacted 1@0 + 1@1 files to L1 => 11476513 bytes
- 2017-07-11 13:41:23.483593 I | rook-ceph-mon1: 2017-07-11 13:41:23.467372 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:41:23.467325) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 12.1 rd, 11.2 wr, level 1, files in(1, 1) out(1) MB in(1.2, 10.6) out(10.9), read-write-amplify(18.6) write-amplify(8.9) OK, records in: 1911, records dropped: 419
- 2017-07-11 13:41:23.483627 I | rook-ceph-mon1:
- 2017-07-11 13:41:23.483655 I | rook-ceph-mon1: 2017-07-11 13:41:23.467378 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:41:23.467341) EVENT_LOG_v1 {"time_micros": 1499780483467334, "job": 10, "event": "compaction_finished", "compaction_time_micros": 1023792, "output_level": 1, "num_output_files": 1, "total_output_size": 11476513, "num_input_records": 1911, "num_output_records": 1492, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:41:23.483669 I | rook-ceph-mon1: 2017-07-11 13:41:23.467617 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780483467615, "job": 10, "event": "table_file_deletion", "file_number": 19}
- 2017-07-11 13:41:23.484943 I | rook-ceph-mon1: 2017-07-11 13:41:23.484930 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780483484927, "job": 10, "event": "table_file_deletion", "file_number": 17}
- 2017-07-11 13:41:23.485217 I | rook-ceph-mon1: 2017-07-11 13:41:23.485155 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #21. Immutable memtables: 0.
- 2017-07-11 13:41:23.485256 I | rook-ceph-mon1:
- 2017-07-11 13:41:23.485271 I | rook-ceph-mon1: 2017-07-11 13:41:23.485184 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 11] Syncing log #18
- 2017-07-11 13:41:23.533335 I | rook-ceph-mon1: 2017-07-11 13:41:23.533105 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:41:23.485179) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:41:23.533941 I | rook-ceph-mon1: 2017-07-11 13:41:23.533112 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 11] Flushing memtable with next log file: 21
- 2017-07-11 13:41:23.533968 I | rook-ceph-mon1:
- 2017-07-11 13:41:23.533980 I | rook-ceph-mon1: 2017-07-11 13:41:23.533120 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780483533117, "job": 11, "event": "flush_started", "num_memtables": 1, "num_entries": 7, "num_deletes": 0, "memory_usage": 22032}
- 2017-07-11 13:41:23.533997 I | rook-ceph-mon1: 2017-07-11 13:41:23.533122 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 11] Level-0 flush table #22: started
- 2017-07-11 13:41:23.563913 I | rook-ceph-mon1: 2017-07-11 13:41:23.562732 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780483562726, "cf_name": "default", "job": 11, "event": "table_file_creation", "file_number": 22, "file_size": 14134, "table_properties": {"data_size": 13245, "index_size": 81, "filter_size": 0, "raw_key_size": 141, "raw_average_key_size": 23, "raw_value_size": 13065, "raw_average_value_size": 2177, "num_data_blocks": 3, "num_entries": 6, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:41:23.563953 I | rook-ceph-mon1: 2017-07-11 13:41:23.562740 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 11] Level-0 flush table #22: 14134 bytes OK
- 2017-07-11 13:41:23.642886 I | rook-ceph-mon1: 2017-07-11 13:41:23.642753 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:41:23.598503) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #22 started
- 2017-07-11 13:41:23.662773 I | rook-ceph-mon1: 2017-07-11 13:41:23.642761 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:41:23.642710) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #22: memtable #1 done
- 2017-07-11 13:41:23.662792 I | rook-ceph-mon1: 2017-07-11 13:41:23.642762 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:41:23.642726) EVENT_LOG_v1 {"time_micros": 1499780483642721, "job": 11, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:41:23.662804 I | rook-ceph-mon1: 2017-07-11 13:41:23.642764 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:41:23.642740) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:41:23.662847 I | rook-ceph-mon1:
- 2017-07-11 13:41:23.668492 I | rook-ceph-mon1: 2017-07-11 13:41:23.642769 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 11] Try to delete WAL files size 19787, prev total WAL file size 19787, number of live WAL files 2.
- 2017-07-11 13:41:23.668510 I | rook-ceph-mon1:
- 2017-07-11 13:41:23.668522 I | rook-ceph-mon1: 2017-07-11 13:41:23.659401 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:41:23.668529 I | rook-ceph-mon1: 2017-07-11 13:41:23.659443 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:41:23.659437) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:41:23.668534 I | rook-ceph-mon1:
- 2017-07-11 13:41:23.668540 I | rook-ceph-mon1: 2017-07-11 13:41:23.659453 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 12] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:41:23.668651 I | rook-ceph-mon1: 2017-07-11 13:41:23.659473 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 11 Base level 0, inputs: [22(13KB)], [20(10MB)]
- 2017-07-11 13:41:23.668661 I | rook-ceph-mon1:
- 2017-07-11 13:41:23.668667 I | rook-ceph-mon1: 2017-07-11 13:41:23.659490 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780483659482, "job": 12, "event": "compaction_started", "files_L0": [22], "files_L1": [20], "score": -1, "input_data_size": 11490647}
- 2017-07-11 13:41:24.764653 I | rook-ceph-mon1: 2017-07-11 13:41:24.764607 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 12] Generated table #23: 1494 keys, 11489678 bytes
- 2017-07-11 13:41:24.765559 I | rook-ceph-mon1: 2017-07-11 13:41:24.765542 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780484765532, "cf_name": "default", "job": 12, "event": "table_file_creation", "file_number": 23, "file_size": 11489678, "table_properties": {"data_size": 11455655, "index_size": 33204, "filter_size": 0, "raw_key_size": 27094, "raw_average_key_size": 18, "raw_value_size": 11411922, "raw_average_value_size": 7638, "num_data_blocks": 1063, "num_entries": 1494, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:41:24.862655 I | rook-ceph-mon1: 2017-07-11 13:41:24.862633 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 12] Compacted 1@0 + 1@1 files to L1 => 11489678 bytes
- 2017-07-11 13:41:24.888413 I | rook-ceph-mon1: 2017-07-11 13:41:24.888364 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:41:24.888278) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 9.6 rd, 9.5 wr, level 1, files in(1, 1) out(1) MB in(0.0, 10.9) out(11.0), read-write-amplify(1625.9) write-amplify(812.9) OK, records in: 1498, records dropped: 4
- 2017-07-11 13:41:24.889521 I | rook-ceph-mon1:
- 2017-07-11 13:41:24.889568 I | rook-ceph-mon1: 2017-07-11 13:41:24.889549 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:41:24.888311) EVENT_LOG_v1 {"time_micros": 1499780484888298, "job": 12, "event": "compaction_finished", "compaction_time_micros": 1203126, "output_level": 1, "num_output_files": 1, "total_output_size": 11489678, "num_input_records": 1498, "num_output_records": 1494, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:41:24.889741 I | rook-ceph-mon1: 2017-07-11 13:41:24.889722 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780484889720, "job": 12, "event": "table_file_deletion", "file_number": 22}
- 2017-07-11 13:41:24.898082 I | rook-ceph-mon1: 2017-07-11 13:41:24.898054 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780484898052, "job": 12, "event": "table_file_deletion", "file_number": 20}
- 2017-07-11 13:41:24.958167 I | rook-ceph-mon1: 2017-07-11 13:41:23.375125 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 393 : cluster [WRN] message from mon.1 was stamped 0.059033s in the future, clocks not synchronized
- 2017-07-11 13:41:30.521830 I | rook-ceph-mon1: 2017-07-11 13:41:29.150060 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 54 : cluster [WRN] message from mon.0 was stamped 0.054591s in the future, clocks not synchronized
- 2017-07-11 13:41:36.954564 I | rook-ceph-mon1: 2017-07-11 13:41:36.954445 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:41:36.954822 I | rook-ceph-mon1: 2017-07-11 13:41:36.954789 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2867446719' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:41:54.420425 I | rook-ceph-mon1: 2017-07-11 13:41:54.419671 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4695 MB, avail 94491 MB
- 2017-07-11 13:41:58.799710 I | rook-ceph-mon1: 2017-07-11 13:41:58.799663 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:41:58.799812 I | rook-ceph-mon1: 2017-07-11 13:41:58.799796 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1257099787' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:42:06.600167 I | rook-ceph-mon1: 2017-07-11 13:42:05.479708 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 396 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0654724s > max 0.05s
- 2017-07-11 13:42:31.342172 I | rook-ceph-mon1: 2017-07-11 13:42:31.342144 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:42:31.342280 I | rook-ceph-mon1: 2017-07-11 13:42:31.342266 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/626214794' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:42:54.420210 I | rook-ceph-mon1: 2017-07-11 13:42:54.419949 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4695 MB, avail 94491 MB
- 2017-07-11 13:43:54.426838 I | rook-ceph-mon1: 2017-07-11 13:43:54.426628 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4695 MB, avail 94491 MB
- 2017-07-11 13:44:30.933455 I | rook-ceph-mon1: 2017-07-11 13:44:30.933421 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:44:30.933560 I | rook-ceph-mon1: 2017-07-11 13:44:30.933544 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4130632230' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:44:35.765318 I | rook-ceph-mon1: 2017-07-11 13:44:35.488576 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 403 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0657463s > max 0.05s
- 2017-07-11 13:44:41.816876 I | rook-ceph-mon1: 2017-07-11 13:44:41.816848 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:44:41.817062 I | rook-ceph-mon1: 2017-07-11 13:44:41.816974 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3501033497' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:44:42.139254 I | rook-ceph-mon1: 2017-07-11 13:44:42.137630 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #24. Immutable memtables: 0.
- 2017-07-11 13:44:42.139338 I | rook-ceph-mon1:
- 2017-07-11 13:44:42.139357 I | rook-ceph-mon1: 2017-07-11 13:44:42.137664 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 13] Syncing log #21
- 2017-07-11 13:44:42.187004 I | rook-ceph-mon1: 2017-07-11 13:44:42.176843 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.137659) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:44:42.187041 I | rook-ceph-mon1: 2017-07-11 13:44:42.176859 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 13] Flushing memtable with next log file: 24
- 2017-07-11 13:44:42.187065 I | rook-ceph-mon1:
- 2017-07-11 13:44:42.187078 I | rook-ceph-mon1: 2017-07-11 13:44:42.176875 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682176867, "job": 13, "event": "flush_started", "num_memtables": 1, "num_entries": 1150, "num_deletes": 251, "memory_usage": 2751616}
- 2017-07-11 13:44:42.187089 I | rook-ceph-mon1: 2017-07-11 13:44:42.176879 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 13] Level-0 flush table #25: started
- 2017-07-11 13:44:42.326936 I | rook-ceph-mon1: 2017-07-11 13:44:42.326872 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682326860, "cf_name": "default", "job": 13, "event": "table_file_creation", "file_number": 25, "file_size": 1814121, "table_properties": {"data_size": 1805945, "index_size": 7361, "filter_size": 0, "raw_key_size": 9244, "raw_average_key_size": 17, "raw_value_size": 1793650, "raw_average_value_size": 3422, "num_data_blocks": 245, "num_entries": 524, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:44:42.327036 I | rook-ceph-mon1: 2017-07-11 13:44:42.327019 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 13] Level-0 flush table #25: 1814121 bytes OK
- 2017-07-11 13:44:42.393456 I | rook-ceph-mon1: 2017-07-11 13:44:42.393425 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.356692) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #25 started
- 2017-07-11 13:44:42.393525 I | rook-ceph-mon1: 2017-07-11 13:44:42.393509 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.393385) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #25: memtable #1 done
- 2017-07-11 13:44:42.393558 I | rook-ceph-mon1: 2017-07-11 13:44:42.393544 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.393397) EVENT_LOG_v1 {"time_micros": 1499780682393392, "job": 13, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:44:42.393618 I | rook-ceph-mon1: 2017-07-11 13:44:42.393604 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.393411) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:44:42.393644 I | rook-ceph-mon1:
- 2017-07-11 13:44:42.393710 I | rook-ceph-mon1: 2017-07-11 13:44:42.393697 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 13] Try to delete WAL files size 2727748, prev total WAL file size 2727748, number of live WAL files 2.
- 2017-07-11 13:44:42.393723 I | rook-ceph-mon1:
- 2017-07-11 13:44:42.394776 I | rook-ceph-mon1: 2017-07-11 13:44:42.394337 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:44:42.394857 I | rook-ceph-mon1: 2017-07-11 13:44:42.394471 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 13:44:42.394874 I | rook-ceph-mon1: 2017-07-11 13:44:42.394475 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 13:44:42.394903 I | rook-ceph-mon1: ** DB Stats **
- 2017-07-11 13:44:42.394917 I | rook-ceph-mon1: Uptime(secs): 1248.7 total, 704.7 interval
- 2017-07-11 13:44:42.394928 I | rook-ceph-mon1: Cumulative writes: 2144 writes, 9145 keys, 2144 commit groups, 1.0 writes per commit group, ingest: 0.03 GB, 0.03 MB/s
- 2017-07-11 13:44:42.394939 I | rook-ceph-mon1: Cumulative WAL: 2144 writes, 2144 syncs, 1.00 writes per sync, written: 0.03 GB, 0.03 MB/s
- 2017-07-11 13:44:42.394950 I | rook-ceph-mon1: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:44:42.394961 I | rook-ceph-mon1: Interval writes: 868 writes, 3944 keys, 868 commit groups, 1.0 writes per commit group, ingest: 8.91 MB, 0.01 MB/s
- 2017-07-11 13:44:42.394995 I | rook-ceph-mon1: Interval WAL: 868 writes, 868 syncs, 1.00 writes per sync, written: 0.01 MB, 0.01 MB/s
- 2017-07-11 13:44:42.395006 I | rook-ceph-mon1: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:44:42.395017 I | rook-ceph-mon1:
- 2017-07-11 13:44:42.395027 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 13:44:42.395037 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:44:42.395072 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:44:42.395083 I | rook-ceph-mon1: L0 1/1 1.73 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.1 1 7 0.185 0 0
- 2017-07-11 13:44:42.395093 I | rook-ceph-mon1: L1 1/1 10.96 MB 0.0 0.1 0.0 0.0 0.1 0.0 0.0 3.5 17.3 15.8 4 5 0.740 8285 1198
- 2017-07-11 13:44:42.395103 I | rook-ceph-mon1: Sum 2/2 12.69 MB 0.0 0.1 0.0 0.0 0.1 0.0 0.0 4.2 12.8 15.3 5 12 0.416 8285 1198
- 2017-07-11 13:44:42.395113 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.1 0.0 0.0 0.1 0.0 0.0 11.9 14.8 14.7 4 10 0.432 8285 1198
- 2017-07-11 13:44:42.395123 I | rook-ceph-mon1: Uptime(secs): 1248.7 total, 1248.7 interval
- 2017-07-11 13:44:42.395143 I | rook-ceph-mon1: Flush(GB): cumulative 0.018, interval 0.005
- 2017-07-11 13:44:42.395154 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:44:42.395164 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:44:42.395173 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:44:42.395183 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:44:42.395214 I | rook-ceph-mon1: Cumulative compaction: 0.07 GB write, 0.06 MB/s write, 0.06 GB read, 0.05 MB/s read, 5.0 seconds
- 2017-07-11 13:44:42.395224 I | rook-ceph-mon1: Interval compaction: 0.06 GB write, 0.05 MB/s write, 0.06 GB read, 0.05 MB/s read, 4.3 seconds
- 2017-07-11 13:44:42.395235 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:44:42.395244 I | rook-ceph-mon1:
- 2017-07-11 13:44:42.395255 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:44:42.395298 I | rook-ceph-mon1:
- 2017-07-11 13:44:42.395322 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 13:44:42.395333 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:44:42.395355 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:44:42.395373 I | rook-ceph-mon1: L0 1/1 1.73 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.1 1 7 0.185 0 0
- 2017-07-11 13:44:42.395384 I | rook-ceph-mon1: L1 1/1 10.96 MB 0.0 0.1 0.0 0.0 0.1 0.0 0.0 3.5 17.3 15.8 4 5 0.740 8285 1198
- 2017-07-11 13:44:42.395394 I | rook-ceph-mon1: Sum 2/2 12.69 MB 0.0 0.1 0.0 0.0 0.1 0.0 0.0 4.2 12.8 15.3 5 12 0.416 8285 1198
- 2017-07-11 13:44:42.395405 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 13:44:42.395416 I | rook-ceph-mon1: Uptime(secs): 1248.7 total, 1248.7 interval
- 2017-07-11 13:44:42.395440 I | rook-ceph-mon1: Flush(GB): cumulative 0.018, interval 0.000
- 2017-07-11 13:44:42.395451 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:44:42.395461 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:44:42.395471 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:44:42.395482 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:44:42.395492 I | rook-ceph-mon1: Cumulative compaction: 0.07 GB write, 0.06 MB/s write, 0.06 GB read, 0.05 MB/s read, 5.0 seconds
- 2017-07-11 13:44:42.395516 I | rook-ceph-mon1: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 13:44:42.395528 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:44:42.395540 I | rook-ceph-mon1:
- 2017-07-11 13:44:42.395551 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:44:42.395583 I | rook-ceph-mon1:
- 2017-07-11 13:44:42.395605 I | rook-ceph-mon1: 2017-07-11 13:44:42.394491 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.394486) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 13:44:42.395614 I | rook-ceph-mon1:
- 2017-07-11 13:44:42.395626 I | rook-ceph-mon1: 2017-07-11 13:44:42.394495 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 14] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:44:42.395639 I | rook-ceph-mon1: 2017-07-11 13:44:42.394498 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 13 Base level 0, inputs: [25(1771KB)], [23(10MB)]
- 2017-07-11 13:44:42.395660 I | rook-ceph-mon1:
- 2017-07-11 13:44:42.395672 I | rook-ceph-mon1: 2017-07-11 13:44:42.394526 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682394500, "job": 14, "event": "compaction_started", "files_L0": [25], "files_L1": [23], "score": -1, "input_data_size": 13303799}
- 2017-07-11 13:44:42.642404 I | rook-ceph-mon1: 2017-07-11 13:44:42.642354 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 14] Generated table #26: 1509 keys, 10417163 bytes
- 2017-07-11 13:44:42.643248 I | rook-ceph-mon1: 2017-07-11 13:44:42.643228 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682643218, "cf_name": "default", "job": 14, "event": "table_file_creation", "file_number": 26, "file_size": 10417163, "table_properties": {"data_size": 10381922, "index_size": 34422, "filter_size": 0, "raw_key_size": 27619, "raw_average_key_size": 18, "raw_value_size": 10337044, "raw_average_value_size": 6850, "num_data_blocks": 1095, "num_entries": 1509, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:44:42.701692 I | rook-ceph-mon1: 2017-07-11 13:44:42.701667 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 14] Compacted 1@0 + 1@1 files to L1 => 10417163 bytes
- 2017-07-11 13:44:42.745225 I | rook-ceph-mon1: 2017-07-11 13:44:42.745192 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.745128) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 43.3 rd, 33.9 wr, level 1, files in(1, 1) out(1) MB in(1.7, 11.0) out(9.9), read-write-amplify(13.1) write-amplify(5.7) OK, records in: 2018, records dropped: 509
- 2017-07-11 13:44:42.751016 I | rook-ceph-mon1:
- 2017-07-11 13:44:42.751056 I | rook-ceph-mon1: 2017-07-11 13:44:42.751034 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.745150) EVENT_LOG_v1 {"time_micros": 1499780682745140, "job": 14, "event": "compaction_finished", "compaction_time_micros": 307129, "output_level": 1, "num_output_files": 1, "total_output_size": 10417163, "num_input_records": 2018, "num_output_records": 1509, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:44:42.762933 I | rook-ceph-mon1: 2017-07-11 13:44:42.762916 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682762911, "job": 14, "event": "table_file_deletion", "file_number": 25}
- 2017-07-11 13:44:42.764497 I | rook-ceph-mon1: 2017-07-11 13:44:42.764482 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682764480, "job": 14, "event": "table_file_deletion", "file_number": 23}
- 2017-07-11 13:44:52.700507 I | rook-ceph-mon1: 2017-07-11 13:44:52.700480 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:44:52.700598 I | rook-ceph-mon1: 2017-07-11 13:44:52.700583 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3075221638' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:44:54.429746 I | rook-ceph-mon1: 2017-07-11 13:44:54.429487 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4694 MB, avail 94492 MB
- 2017-07-11 13:45:14.369898 I | rook-ceph-mon1: 2017-07-11 13:45:14.369865 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:45:14.369998 I | rook-ceph-mon1: 2017-07-11 13:45:14.369984 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2370829093' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:45:54.432191 I | rook-ceph-mon1: 2017-07-11 13:45:54.431946 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4694 MB, avail 94492 MB
- 2017-07-11 13:46:54.432396 I | rook-ceph-mon1: 2017-07-11 13:46:54.432163 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4694 MB, avail 94492 MB
- 2017-07-11 13:47:03.325599 I | rook-ceph-mon1: 2017-07-11 13:47:03.325569 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:47:03.325698 I | rook-ceph-mon1: 2017-07-11 13:47:03.325682 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2384621290' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:47:35.781354 I | rook-ceph-mon1: 2017-07-11 13:47:35.496735 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 413 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0652957s > max 0.05s
- 2017-07-11 13:47:54.434228 I | rook-ceph-mon1: 2017-07-11 13:47:54.433965 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4694 MB, avail 94492 MB
- 2017-07-11 13:48:08.940679 I | rook-ceph-mon1: 2017-07-11 13:48:08.940641 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:48:08.940861 I | rook-ceph-mon1: 2017-07-11 13:48:08.940782 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/971146414' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:48:19.799011 I | rook-ceph-mon1: 2017-07-11 13:48:19.798981 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:48:19.799186 I | rook-ceph-mon1: 2017-07-11 13:48:19.799118 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3741676173' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:48:30.637849 I | rook-ceph-mon1: 2017-07-11 13:48:30.637820 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:48:30.637952 I | rook-ceph-mon1: 2017-07-11 13:48:30.637937 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/43041442' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:48:54.441161 I | rook-ceph-mon1: 2017-07-11 13:48:54.440940 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4694 MB, avail 94492 MB
- 2017-07-11 13:49:35.999653 I | rook-ceph-mon1: 2017-07-11 13:49:35.999625 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:49:35.999752 I | rook-ceph-mon1: 2017-07-11 13:49:35.999737 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1634205654' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:49:46.951685 I | rook-ceph-mon1: 2017-07-11 13:49:46.951653 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:49:46.951863 I | rook-ceph-mon1: 2017-07-11 13:49:46.951787 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/480087092' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:49:47.555314 I | rook-ceph-mon1: 2017-07-11 13:49:47.535486 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #27. Immutable memtables: 0.
- 2017-07-11 13:49:47.555408 I | rook-ceph-mon1:
- 2017-07-11 13:49:47.555509 I | rook-ceph-mon1: 2017-07-11 13:49:47.555368 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 15] Syncing log #24
- 2017-07-11 13:49:47.706084 I | rook-ceph-mon1: 2017-07-11 13:49:47.578078 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.545617) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:49:47.706146 I | rook-ceph-mon1: 2017-07-11 13:49:47.578082 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 15] Flushing memtable with next log file: 27
- 2017-07-11 13:49:47.706206 I | rook-ceph-mon1:
- 2017-07-11 13:49:47.706221 I | rook-ceph-mon1: 2017-07-11 13:49:47.578089 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780987578086, "job": 15, "event": "flush_started", "num_memtables": 1, "num_entries": 1574, "num_deletes": 250, "memory_usage": 4047064}
- 2017-07-11 13:49:47.706232 I | rook-ceph-mon1: 2017-07-11 13:49:47.578103 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 15] Level-0 flush table #28: started
- 2017-07-11 13:49:47.813454 I | rook-ceph-mon1: 2017-07-11 13:49:47.813412 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780987813404, "cf_name": "default", "job": 15, "event": "table_file_creation", "file_number": 28, "file_size": 1718604, "table_properties": {"data_size": 1711192, "index_size": 6597, "filter_size": 0, "raw_key_size": 9382, "raw_average_key_size": 18, "raw_value_size": 1699702, "raw_average_value_size": 3385, "num_data_blocks": 218, "num_entries": 502, "filter_policy_name": "", "kDeletedKeys": "250", "kMergeOperands": "0"}}
- 2017-07-11 13:49:47.813538 I | rook-ceph-mon1: 2017-07-11 13:49:47.813522 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 15] Level-0 flush table #28: 1718604 bytes OK
- 2017-07-11 13:49:47.872966 I | rook-ceph-mon1: 2017-07-11 13:49:47.872940 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.836707) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #28 started
- 2017-07-11 13:49:47.873024 I | rook-ceph-mon1: 2017-07-11 13:49:47.873009 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.872906) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #28: memtable #1 done
- 2017-07-11 13:49:47.873071 I | rook-ceph-mon1: 2017-07-11 13:49:47.873044 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.872916) EVENT_LOG_v1 {"time_micros": 1499780987872912, "job": 15, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:49:47.873099 I | rook-ceph-mon1: 2017-07-11 13:49:47.873087 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.872929) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:49:47.873112 I | rook-ceph-mon1:
- 2017-07-11 13:49:47.873155 I | rook-ceph-mon1: 2017-07-11 13:49:47.873129 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 15] Try to delete WAL files size 4014689, prev total WAL file size 4014689, number of live WAL files 2.
- 2017-07-11 13:49:47.873168 I | rook-ceph-mon1:
- 2017-07-11 13:49:47.874040 I | rook-ceph-mon1: 2017-07-11 13:49:47.873838 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:49:47.874097 I | rook-ceph-mon1: 2017-07-11 13:49:47.873874 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.873869) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:49:47.874113 I | rook-ceph-mon1:
- 2017-07-11 13:49:47.874127 I | rook-ceph-mon1: 2017-07-11 13:49:47.873879 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 16] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:49:47.874152 I | rook-ceph-mon1: 2017-07-11 13:49:47.873884 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 15 Base level 0, inputs: [28(1678KB)], [26(10173KB)]
- 2017-07-11 13:49:47.874165 I | rook-ceph-mon1:
- 2017-07-11 13:49:47.874175 I | rook-ceph-mon1: 2017-07-11 13:49:47.873896 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780987873888, "job": 16, "event": "compaction_started", "files_L0": [28], "files_L1": [26], "score": -1, "input_data_size": 12135767}
- 2017-07-11 13:49:48.082615 I | rook-ceph-mon1: 2017-07-11 13:49:48.082572 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 16] Generated table #29: 1649 keys, 11446170 bytes
- 2017-07-11 13:49:48.084631 I | rook-ceph-mon1: 2017-07-11 13:49:48.084613 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780988084604, "cf_name": "default", "job": 16, "event": "table_file_creation", "file_number": 29, "file_size": 11446170, "table_properties": {"data_size": 11407454, "index_size": 37897, "filter_size": 0, "raw_key_size": 30069, "raw_average_key_size": 18, "raw_value_size": 11358285, "raw_average_value_size": 6887, "num_data_blocks": 1208, "num_entries": 1649, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:49:48.135900 I | rook-ceph-mon1: 2017-07-11 13:49:48.135877 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 16] Compacted 1@0 + 1@1 files to L1 => 11446170 bytes
- 2017-07-11 13:49:48.172157 I | rook-ceph-mon1: 2017-07-11 13:49:48.172130 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:49:48.172076) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 46.3 rd, 43.7 wr, level 1, files in(1, 1) out(1) MB in(1.6, 9.9) out(10.9), read-write-amplify(13.7) write-amplify(6.7) OK, records in: 2011, records dropped: 362
- 2017-07-11 13:49:48.172194 I | rook-ceph-mon1:
- 2017-07-11 13:49:48.172225 I | rook-ceph-mon1: 2017-07-11 13:49:48.172211 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:49:48.172092) EVENT_LOG_v1 {"time_micros": 1499780988172084, "job": 16, "event": "compaction_finished", "compaction_time_micros": 261970, "output_level": 1, "num_output_files": 1, "total_output_size": 11446170, "num_input_records": 2011, "num_output_records": 1649, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:49:48.172619 I | rook-ceph-mon1: 2017-07-11 13:49:48.172606 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780988172603, "job": 16, "event": "table_file_deletion", "file_number": 28}
- 2017-07-11 13:49:48.173818 I | rook-ceph-mon1: 2017-07-11 13:49:48.173805 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780988173803, "job": 16, "event": "table_file_deletion", "file_number": 26}
- 2017-07-11 13:49:48.173877 I | rook-ceph-mon1: 2017-07-11 13:49:48.173864 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:49:54.447680 I | rook-ceph-mon1: 2017-07-11 13:49:54.447335 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4696 MB, avail 94491 MB
- 2017-07-11 13:50:54.448876 I | rook-ceph-mon1: 2017-07-11 13:50:54.448591 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4696 MB, avail 94491 MB
- 2017-07-11 13:51:06.611812 I | rook-ceph-mon1: 2017-07-11 13:51:05.507072 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 421 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0662768s > max 0.05s
- 2017-07-11 13:51:06.614133 I | rook-ceph-mon1: 2017-07-11 13:51:05.507492 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 422 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.0569526s > max 0.05s
- 2017-07-11 13:51:25.589798 I | rook-ceph-mon1: 2017-07-11 13:51:25.589747 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:51:25.589965 I | rook-ceph-mon1: 2017-07-11 13:51:25.589891 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1536233414' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:51:43.513655 I | rook-ceph-mon1: 2017-07-11 13:51:43.512871 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #30. Immutable memtables: 0.
- 2017-07-11 13:51:43.513730 I | rook-ceph-mon1:
- 2017-07-11 13:51:43.513750 I | rook-ceph-mon1: 2017-07-11 13:51:43.512921 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 17] Syncing log #27
- 2017-07-11 13:51:43.542350 I | rook-ceph-mon1: 2017-07-11 13:51:43.532425 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.512915) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:51:43.542394 I | rook-ceph-mon1: 2017-07-11 13:51:43.532433 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 17] Flushing memtable with next log file: 30
- 2017-07-11 13:51:43.542421 I | rook-ceph-mon1:
- 2017-07-11 13:51:43.542433 I | rook-ceph-mon1: 2017-07-11 13:51:43.532443 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103532440, "job": 17, "event": "flush_started", "num_memtables": 1, "num_entries": 762, "num_deletes": 251, "memory_usage": 1570632}
- 2017-07-11 13:51:43.542488 I | rook-ceph-mon1: 2017-07-11 13:51:43.532445 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 17] Level-0 flush table #31: started
- 2017-07-11 13:51:43.662178 I | rook-ceph-mon1: 2017-07-11 13:51:43.662133 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103662124, "cf_name": "default", "job": 17, "event": "table_file_creation", "file_number": 31, "file_size": 1032781, "table_properties": {"data_size": 1027701, "index_size": 4265, "filter_size": 0, "raw_key_size": 7221, "raw_average_key_size": 17, "raw_value_size": 1019190, "raw_average_value_size": 2498, "num_data_blocks": 140, "num_entries": 408, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:51:43.662911 I | rook-ceph-mon1: 2017-07-11 13:51:43.662892 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 17] Level-0 flush table #31: 1032781 bytes OK
- 2017-07-11 13:51:43.732053 I | rook-ceph-mon1: 2017-07-11 13:51:43.732016 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.691650) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #31 started
- 2017-07-11 13:51:43.733691 I | rook-ceph-mon1: 2017-07-11 13:51:43.733674 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.731969) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #31: memtable #1 done
- 2017-07-11 13:51:43.733770 I | rook-ceph-mon1: 2017-07-11 13:51:43.733722 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.731987) EVENT_LOG_v1 {"time_micros": 1499781103731982, "job": 17, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:51:43.733806 I | rook-ceph-mon1: 2017-07-11 13:51:43.733791 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.732003) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:51:43.733835 I | rook-ceph-mon1:
- 2017-07-11 13:51:43.733866 I | rook-ceph-mon1: 2017-07-11 13:51:43.733854 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 17] Try to delete WAL files size 1552932, prev total WAL file size 1552932, number of live WAL files 2.
- 2017-07-11 13:51:43.733878 I | rook-ceph-mon1:
- 2017-07-11 13:51:43.734886 I | rook-ceph-mon1: 2017-07-11 13:51:43.734315 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:51:43.734924 I | rook-ceph-mon1: 2017-07-11 13:51:43.734347 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.734341) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 13:51:43.734940 I | rook-ceph-mon1:
- 2017-07-11 13:51:43.734955 I | rook-ceph-mon1: 2017-07-11 13:51:43.734363 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 18] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:51:43.734966 I | rook-ceph-mon1: 2017-07-11 13:51:43.734367 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 17 Base level 0, inputs: [31(1008KB)], [29(10MB)]
- 2017-07-11 13:51:43.734978 I | rook-ceph-mon1:
- 2017-07-11 13:51:43.735004 I | rook-ceph-mon1: 2017-07-11 13:51:43.734377 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103734370, "job": 18, "event": "compaction_started", "files_L0": [31], "files_L1": [29], "score": -1, "input_data_size": 12478951}
- 2017-07-11 13:51:44.144263 I | rook-ceph-mon1: 2017-07-11 13:51:44.144198 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 18] Generated table #32: 1548 keys, 10839631 bytes
- 2017-07-11 13:51:44.146903 I | rook-ceph-mon1: 2017-07-11 13:51:44.146886 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781104146877, "cf_name": "default", "job": 18, "event": "table_file_creation", "file_number": 32, "file_size": 10839631, "table_properties": {"data_size": 10804004, "index_size": 34808, "filter_size": 0, "raw_key_size": 28571, "raw_average_key_size": 18, "raw_value_size": 10758251, "raw_average_value_size": 6949, "num_data_blocks": 1097, "num_entries": 1548, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:51:44.272636 I | rook-ceph-mon1: 2017-07-11 13:51:44.272612 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 18] Compacted 1@0 + 1@1 files to L1 => 10839631 bytes
- 2017-07-11 13:51:44.321803 I | rook-ceph-mon1: 2017-07-11 13:51:44.321754 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:51:44.321657) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 23.2 rd, 20.1 wr, level 1, files in(1, 1) out(1) MB in(1.0, 10.9) out(10.3), read-write-amplify(22.6) write-amplify(10.5) OK, records in: 2057, records dropped: 509
- 2017-07-11 13:51:44.322865 I | rook-ceph-mon1:
- 2017-07-11 13:51:44.322911 I | rook-ceph-mon1: 2017-07-11 13:51:44.322895 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:51:44.321692) EVENT_LOG_v1 {"time_micros": 1499781104321677, "job": 18, "event": "compaction_finished", "compaction_time_micros": 538221, "output_level": 1, "num_output_files": 1, "total_output_size": 10839631, "num_input_records": 2057, "num_output_records": 1548, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:51:44.323214 I | rook-ceph-mon1: 2017-07-11 13:51:44.323200 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781104323198, "job": 18, "event": "table_file_deletion", "file_number": 31}
- 2017-07-11 13:51:44.331606 I | rook-ceph-mon1: 2017-07-11 13:51:44.331589 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781104331587, "job": 18, "event": "table_file_deletion", "file_number": 29}
- 2017-07-11 13:51:50.144362 I | rook-ceph-mon1: 2017-07-11 13:51:48.622941 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 424 : cluster [WRN] message from mon.1 was stamped 0.084083s in the future, clocks not synchronized
- 2017-07-11 13:51:54.455900 I | rook-ceph-mon1: 2017-07-11 13:51:54.455402 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4695 MB, avail 94491 MB
- 2017-07-11 13:52:05.691552 I | rook-ceph-mon1: 2017-07-11 13:52:05.320100 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 425 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 13:52:54.456409 I | rook-ceph-mon1: 2017-07-11 13:52:54.456209 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4695 MB, avail 94491 MB
- 2017-07-11 13:53:14.707396 I | rook-ceph-mon1: 2017-07-11 13:53:14.707367 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:53:14.707497 I | rook-ceph-mon1: 2017-07-11 13:53:14.707481 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3100529951' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:53:25.625669 I | rook-ceph-mon1: 2017-07-11 13:53:25.625634 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:53:25.626007 I | rook-ceph-mon1: 2017-07-11 13:53:25.625820 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3528212864' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:53:36.570135 I | rook-ceph-mon1: 2017-07-11 13:53:36.570102 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:53:36.570315 I | rook-ceph-mon1: 2017-07-11 13:53:36.570236 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3318287667' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:53:47.532975 I | rook-ceph-mon1: 2017-07-11 13:53:47.532945 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:53:47.549043 I | rook-ceph-mon1: 2017-07-11 13:53:47.548624 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/927738585' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:53:54.464949 I | rook-ceph-mon1: 2017-07-11 13:53:54.464731 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4695 MB, avail 94491 MB
- 2017-07-11 13:53:58.490210 I | rook-ceph-mon1: 2017-07-11 13:53:58.484433 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:53:58.492689 I | rook-ceph-mon1: 2017-07-11 13:53:58.491119 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3798396742' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:54:54.470389 I | rook-ceph-mon1: 2017-07-11 13:54:54.470128 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4695 MB, avail 94491 MB
- 2017-07-11 13:55:04.039768 I | rook-ceph-mon1: 2017-07-11 13:55:04.039735 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:55:04.039867 I | rook-ceph-mon1: 2017-07-11 13:55:04.039852 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/367378000' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:55:06.890349 I | rook-ceph-mon1: 2017-07-11 13:55:05.508559 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 434 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0663925s > max 0.05s
- 2017-07-11 13:55:06.890420 I | rook-ceph-mon1: 2017-07-11 13:55:05.512428 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 435 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.0852258s > max 0.05s
- 2017-07-11 13:55:15.231156 I | rook-ceph-mon1: 2017-07-11 13:55:15.231124 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:55:15.231262 I | rook-ceph-mon1: 2017-07-11 13:55:15.231247 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3918238466' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:55:37.260747 I | rook-ceph-mon1: 2017-07-11 13:55:37.260715 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:55:37.260846 I | rook-ceph-mon1: 2017-07-11 13:55:37.260831 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/305083950' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:55:48.206880 I | rook-ceph-mon1: 2017-07-11 13:55:48.206849 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:55:48.207042 I | rook-ceph-mon1: 2017-07-11 13:55:48.207025 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3063058863' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:55:54.471516 I | rook-ceph-mon1: 2017-07-11 13:55:54.471319 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4695 MB, avail 94491 MB
- 2017-07-11 13:56:54.478548 I | rook-ceph-mon1: 2017-07-11 13:56:54.478306 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4695 MB, avail 94491 MB
- 2017-07-11 13:57:54.486284 I | rook-ceph-mon1: 2017-07-11 13:57:54.485931 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4696 MB, avail 94491 MB
- 2017-07-11 13:58:12.617500 I | rook-ceph-mon1: 2017-07-11 13:58:12.617372 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #33. Immutable memtables: 0.
- 2017-07-11 13:58:12.617587 I | rook-ceph-mon1:
- 2017-07-11 13:58:12.617605 I | rook-ceph-mon1: 2017-07-11 13:58:12.617455 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 19] Syncing log #30
- 2017-07-11 13:58:12.648846 I | rook-ceph-mon1: 2017-07-11 13:58:12.647852 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.617448) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:58:12.648917 I | rook-ceph-mon1: 2017-07-11 13:58:12.647860 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 19] Flushing memtable with next log file: 33
- 2017-07-11 13:58:12.648933 I | rook-ceph-mon1:
- 2017-07-11 13:58:12.648958 I | rook-ceph-mon1: 2017-07-11 13:58:12.647869 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781492647865, "job": 19, "event": "flush_started", "num_memtables": 1, "num_entries": 1959, "num_deletes": 251, "memory_usage": 5259112}
- 2017-07-11 13:58:12.648971 I | rook-ceph-mon1: 2017-07-11 13:58:12.647871 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 19] Level-0 flush table #34: started
- 2017-07-11 13:58:12.760706 I | rook-ceph-mon1: 2017-07-11 13:58:12.760665 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781492760656, "cf_name": "default", "job": 19, "event": "table_file_creation", "file_number": 34, "file_size": 2237920, "table_properties": {"data_size": 2228572, "index_size": 8530, "filter_size": 0, "raw_key_size": 10717, "raw_average_key_size": 18, "raw_value_size": 2214723, "raw_average_value_size": 3851, "num_data_blocks": 281, "num_entries": 575, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:58:12.767584 I | rook-ceph-mon1: 2017-07-11 13:58:12.767552 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 19] Level-0 flush table #34: 2237920 bytes OK
- 2017-07-11 13:58:12.915741 I | rook-ceph-mon1: 2017-07-11 13:58:12.915704 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.864969) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #34 started
- 2017-07-11 13:58:12.916848 I | rook-ceph-mon1: 2017-07-11 13:58:12.916827 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.915657) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #34: memtable #1 done
- 2017-07-11 13:58:12.916907 I | rook-ceph-mon1: 2017-07-11 13:58:12.916884 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.915677) EVENT_LOG_v1 {"time_micros": 1499781492915671, "job": 19, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:58:12.916938 I | rook-ceph-mon1: 2017-07-11 13:58:12.916925 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.915693) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:58:12.916966 I | rook-ceph-mon1:
- 2017-07-11 13:58:12.917006 I | rook-ceph-mon1: 2017-07-11 13:58:12.916983 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 19] Try to delete WAL files size 5214241, prev total WAL file size 5214241, number of live WAL files 2.
- 2017-07-11 13:58:12.917031 I | rook-ceph-mon1:
- 2017-07-11 13:58:12.932806 I | rook-ceph-mon1: 2017-07-11 13:58:12.932256 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:58:12.932864 I | rook-ceph-mon1: 2017-07-11 13:58:12.932386 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 13:58:12.932881 I | rook-ceph-mon1: 2017-07-11 13:58:12.932389 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 13:58:12.932894 I | rook-ceph-mon1: ** DB Stats **
- 2017-07-11 13:58:12.932932 I | rook-ceph-mon1: Uptime(secs): 2059.2 total, 810.5 interval
- 2017-07-11 13:58:12.932945 I | rook-ceph-mon1: Cumulative writes: 3112 writes, 13K keys, 3112 commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.02 MB/s
- 2017-07-11 13:58:12.932955 I | rook-ceph-mon1: Cumulative WAL: 3112 writes, 3112 syncs, 1.00 writes per sync, written: 0.04 GB, 0.02 MB/s
- 2017-07-11 13:58:12.932967 I | rook-ceph-mon1: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:58:12.932977 I | rook-ceph-mon1: Interval writes: 968 writes, 4295 keys, 968 commit groups, 1.0 writes per commit group, ingest: 10.28 MB, 0.01 MB/s
- 2017-07-11 13:58:12.933001 I | rook-ceph-mon1: Interval WAL: 968 writes, 968 syncs, 1.00 writes per sync, written: 0.01 MB, 0.01 MB/s
- 2017-07-11 13:58:12.933023 I | rook-ceph-mon1: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:58:12.933033 I | rook-ceph-mon1:
- 2017-07-11 13:58:12.933055 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 13:58:12.933080 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:58:12.933091 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:58:12.933121 I | rook-ceph-mon1: L0 1/1 2.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 11.9 2 10 0.193 0 0
- 2017-07-11 13:58:12.933146 I | rook-ceph-mon1: L1 1/1 10.34 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 4.3 20.8 18.6 5 8 0.601 14K 2578
- 2017-07-11 13:58:12.933159 I | rook-ceph-mon1: Sum 2/2 12.47 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 4.9 14.9 16.7 7 18 0.374 14K 2578
- 2017-07-11 13:58:12.933171 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 7.6 20.8 20.6 2 6 0.290 6086 1380
- 2017-07-11 13:58:12.933182 I | rook-ceph-mon1: Uptime(secs): 2059.2 total, 2059.2 interval
- 2017-07-11 13:58:12.933213 I | rook-ceph-mon1: Flush(GB): cumulative 0.022, interval 0.005
- 2017-07-11 13:58:12.933250 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:58:12.933262 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:58:12.933272 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:58:12.933283 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:58:12.933306 I | rook-ceph-mon1: Cumulative compaction: 0.11 GB write, 0.05 MB/s write, 0.10 GB read, 0.05 MB/s read, 6.7 seconds
- 2017-07-11 13:58:12.933319 I | rook-ceph-mon1: Interval compaction: 0.04 GB write, 0.02 MB/s write, 0.04 GB read, 0.02 MB/s read, 1.7 seconds
- 2017-07-11 13:58:12.933330 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:58:12.933341 I | rook-ceph-mon1:
- 2017-07-11 13:58:12.933353 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:58:12.933382 I | rook-ceph-mon1:
- 2017-07-11 13:58:12.933395 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 13:58:12.933406 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:58:12.933417 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:58:12.933428 I | rook-ceph-mon1: L0 1/1 2.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 11.9 2 10 0.193 0 0
- 2017-07-11 13:58:12.933440 I | rook-ceph-mon1: L1 1/1 10.34 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 4.3 20.8 18.6 5 8 0.601 14K 2578
- 2017-07-11 13:58:12.933463 I | rook-ceph-mon1: Sum 2/2 12.47 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 4.9 14.9 16.7 7 18 0.374 14K 2578
- 2017-07-11 13:58:12.933479 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 13:58:12.933491 I | rook-ceph-mon1: Uptime(secs): 2059.2 total, 2059.2 interval
- 2017-07-11 13:58:12.933502 I | rook-ceph-mon1: Flush(GB): cumulative 0.022, interval 0.000
- 2017-07-11 13:58:12.933513 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:58:12.933557 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:58:12.933567 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:58:12.933577 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:58:12.933587 I | rook-ceph-mon1: Cumulative compaction: 0.11 GB write, 0.05 MB/s write, 0.10 GB read, 0.05 MB/s read, 6.7 seconds
- 2017-07-11 13:58:12.933596 I | rook-ceph-mon1: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 13:58:12.933616 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:58:12.933627 I | rook-ceph-mon1:
- 2017-07-11 13:58:12.933637 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:58:12.933646 I | rook-ceph-mon1:
- 2017-07-11 13:58:12.933656 I | rook-ceph-mon1: 2017-07-11 13:58:12.932403 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.932399) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:58:12.933665 I | rook-ceph-mon1:
- 2017-07-11 13:58:12.933678 I | rook-ceph-mon1: 2017-07-11 13:58:12.932408 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 20] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:58:12.933701 I | rook-ceph-mon1: 2017-07-11 13:58:12.932411 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 19 Base level 0, inputs: [34(2185KB)], [32(10MB)]
- 2017-07-11 13:58:12.933711 I | rook-ceph-mon1:
- 2017-07-11 13:58:12.933720 I | rook-ceph-mon1: 2017-07-11 13:58:12.932420 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781492932413, "job": 20, "event": "compaction_started", "files_L0": [34], "files_L1": [32], "score": -1, "input_data_size": 13077551}
- 2017-07-11 13:58:13.114531 I | rook-ceph-mon1: 2017-07-11 13:58:13.114488 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 20] Generated table #35: 1801 keys, 12652500 bytes
- 2017-07-11 13:58:13.115172 I | rook-ceph-mon1: 2017-07-11 13:58:13.115154 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781493115146, "cf_name": "default", "job": 20, "event": "table_file_creation", "file_number": 35, "file_size": 12652500, "table_properties": {"data_size": 12610137, "index_size": 41544, "filter_size": 0, "raw_key_size": 33112, "raw_average_key_size": 18, "raw_value_size": 12556278, "raw_average_value_size": 6971, "num_data_blocks": 1313, "num_entries": 1801, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:58:13.173624 I | rook-ceph-mon1: 2017-07-11 13:58:13.173602 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 20] Compacted 1@0 + 1@1 files to L1 => 12652500 bytes
- 2017-07-11 13:58:13.193270 I | rook-ceph-mon1: 2017-07-11 13:58:13.193238 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:58:13.193133) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 54.2 rd, 52.5 wr, level 1, files in(1, 1) out(1) MB in(2.1, 10.3) out(12.1), read-write-amplify(11.5) write-amplify(5.7) OK, records in: 2123, records dropped: 322
- 2017-07-11 13:58:13.195050 I | rook-ceph-mon1:
- 2017-07-11 13:58:13.195094 I | rook-ceph-mon1: 2017-07-11 13:58:13.195078 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:58:13.193165) EVENT_LOG_v1 {"time_micros": 1499781493193152, "job": 20, "event": "compaction_finished", "compaction_time_micros": 241170, "output_level": 1, "num_output_files": 1, "total_output_size": 12652500, "num_input_records": 2123, "num_output_records": 1801, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:58:13.195484 I | rook-ceph-mon1: 2017-07-11 13:58:13.195471 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781493195468, "job": 20, "event": "table_file_deletion", "file_number": 34}
- 2017-07-11 13:58:13.196774 I | rook-ceph-mon1: 2017-07-11 13:58:13.196761 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781493196758, "job": 20, "event": "table_file_deletion", "file_number": 32}
- 2017-07-11 13:58:13.197001 I | rook-ceph-mon1: 2017-07-11 13:58:13.196986 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:58:42.194365 I | rook-ceph-mon1: 2017-07-11 13:58:42.193355 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #36. Immutable memtables: 0.
- 2017-07-11 13:58:42.194430 I | rook-ceph-mon1:
- 2017-07-11 13:58:42.194446 I | rook-ceph-mon1: 2017-07-11 13:58:42.193389 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 21] Syncing log #33
- 2017-07-11 13:58:42.255217 I | rook-ceph-mon1: 2017-07-11 13:58:42.254674 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.193384) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:58:42.261914 I | rook-ceph-mon1: 2017-07-11 13:58:42.254682 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 21] Flushing memtable with next log file: 36
- 2017-07-11 13:58:42.261963 I | rook-ceph-mon1:
- 2017-07-11 13:58:42.261987 I | rook-ceph-mon1: 2017-07-11 13:58:42.254690 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522254686, "job": 21, "event": "flush_started", "num_memtables": 1, "num_entries": 380, "num_deletes": 251, "memory_usage": 397200}
- 2017-07-11 13:58:42.262000 I | rook-ceph-mon1: 2017-07-11 13:58:42.254692 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 21] Level-0 flush table #37: started
- 2017-07-11 13:58:42.329916 I | rook-ceph-mon1: 2017-07-11 13:58:42.324188 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522324180, "cf_name": "default", "job": 21, "event": "table_file_creation", "file_number": 37, "file_size": 257113, "table_properties": {"data_size": 255198, "index_size": 1101, "filter_size": 0, "raw_key_size": 5155, "raw_average_key_size": 17, "raw_value_size": 250502, "raw_average_value_size": 849, "num_data_blocks": 36, "num_entries": 295, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:58:42.329987 I | rook-ceph-mon1: 2017-07-11 13:58:42.324208 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 21] Level-0 flush table #37: 257113 bytes OK
- 2017-07-11 13:58:42.394385 I | rook-ceph-mon1: 2017-07-11 13:58:42.391539 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.354624) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #37 started
- 2017-07-11 13:58:42.394434 I | rook-ceph-mon1: 2017-07-11 13:58:42.391550 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.391472) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #37: memtable #1 done
- 2017-07-11 13:58:42.394449 I | rook-ceph-mon1: 2017-07-11 13:58:42.391553 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.391500) EVENT_LOG_v1 {"time_micros": 1499781522391492, "job": 21, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:58:42.394462 I | rook-ceph-mon1: 2017-07-11 13:58:42.391556 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.391522) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:58:42.394473 I | rook-ceph-mon1:
- 2017-07-11 13:58:42.394484 I | rook-ceph-mon1: 2017-07-11 13:58:42.391564 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 21] Try to delete WAL files size 386797, prev total WAL file size 386797, number of live WAL files 2.
- 2017-07-11 13:58:42.394507 I | rook-ceph-mon1:
- 2017-07-11 13:58:42.409763 I | rook-ceph-mon1: 2017-07-11 13:58:42.394773 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:58:42.409801 I | rook-ceph-mon1: 2017-07-11 13:58:42.394803 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.394798) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 13:58:42.409818 I | rook-ceph-mon1:
- 2017-07-11 13:58:42.409830 I | rook-ceph-mon1: 2017-07-11 13:58:42.394807 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 22] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:58:42.409841 I | rook-ceph-mon1: 2017-07-11 13:58:42.394811 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 21 Base level 0, inputs: [37(251KB)], [35(12MB)]
- 2017-07-11 13:58:42.409874 I | rook-ceph-mon1:
- 2017-07-11 13:58:42.409885 I | rook-ceph-mon1: 2017-07-11 13:58:42.394820 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522394813, "job": 22, "event": "compaction_started", "files_L0": [37], "files_L1": [35], "score": -1, "input_data_size": 12909613}
- 2017-07-11 13:58:42.644170 I | rook-ceph-mon1: 2017-07-11 13:58:42.644124 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 22] Generated table #38: 1587 keys, 11020226 bytes
- 2017-07-11 13:58:42.646394 I | rook-ceph-mon1: 2017-07-11 13:58:42.646377 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522646368, "cf_name": "default", "job": 22, "event": "table_file_creation", "file_number": 38, "file_size": 11020226, "table_properties": {"data_size": 10984194, "index_size": 35213, "filter_size": 0, "raw_key_size": 29538, "raw_average_key_size": 18, "raw_value_size": 10937545, "raw_average_value_size": 6891, "num_data_blocks": 1099, "num_entries": 1587, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:58:42.673703 I | rook-ceph-mon1: 2017-07-11 13:58:42.673652 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 22] Compacted 1@0 + 1@1 files to L1 => 11020226 bytes
- 2017-07-11 13:58:42.716566 I | rook-ceph-mon1: 2017-07-11 13:58:42.716542 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.716477) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 46.3 rd, 39.5 wr, level 1, files in(1, 1) out(1) MB in(0.2, 12.1) out(10.5), read-write-amplify(93.1) write-amplify(42.9) OK, records in: 2096, records dropped: 509
- 2017-07-11 13:58:42.716762 I | rook-ceph-mon1:
- 2017-07-11 13:58:42.722471 I | rook-ceph-mon1: 2017-07-11 13:58:42.722422 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.716492) EVENT_LOG_v1 {"time_micros": 1499781522716486, "job": 22, "event": "compaction_finished", "compaction_time_micros": 278810, "output_level": 1, "num_output_files": 1, "total_output_size": 11020226, "num_input_records": 2096, "num_output_records": 1587, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:58:42.722881 I | rook-ceph-mon1: 2017-07-11 13:58:42.722866 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522722863, "job": 22, "event": "table_file_deletion", "file_number": 37}
- 2017-07-11 13:58:42.724291 I | rook-ceph-mon1: 2017-07-11 13:58:42.724277 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522724275, "job": 22, "event": "table_file_deletion", "file_number": 35}
- 2017-07-11 13:58:54.488709 I | rook-ceph-mon1: 2017-07-11 13:58:54.487273 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4696 MB, avail 94490 MB
- 2017-07-11 13:59:35.944736 I | rook-ceph-mon1: 2017-07-11 13:59:35.513856 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 450 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0762522s > max 0.05s
- 2017-07-11 13:59:35.946164 I | rook-ceph-mon1: 2017-07-11 13:59:35.518886 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 451 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.112485s > max 0.05s
- 2017-07-11 13:59:54.487736 I | rook-ceph-mon1: 2017-07-11 13:59:54.487478 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4696 MB, avail 94490 MB
- 2017-07-11 14:00:00.579475 I | rook-ceph-mon1: 2017-07-11 14:00:00.000377 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 453 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:00:33.580083 I | rook-ceph-mon1: 2017-07-11 14:00:33.580053 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:00:33.580182 I | rook-ceph-mon1: 2017-07-11 14:00:33.580167 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/535894239' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:00:54.488572 I | rook-ceph-mon1: 2017-07-11 14:00:54.487913 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4696 MB, avail 94490 MB
- 2017-07-11 14:01:54.492014 I | rook-ceph-mon1: 2017-07-11 14:01:54.491731 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4696 MB, avail 94490 MB
- 2017-07-11 14:02:54.495543 I | rook-ceph-mon1: 2017-07-11 14:02:54.495198 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4696 MB, avail 94490 MB
- 2017-07-11 14:03:18.097930 I | rook-ceph-mon1: 2017-07-11 14:03:18.097900 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:03:18.098027 I | rook-ceph-mon1: 2017-07-11 14:03:18.098011 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4221500222' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:03:29.135341 I | rook-ceph-mon1: 2017-07-11 14:03:29.135310 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:03:29.135468 I | rook-ceph-mon1: 2017-07-11 14:03:29.135453 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3307634546' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:03:54.501664 I | rook-ceph-mon1: 2017-07-11 14:03:54.501354 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4696 MB, avail 94490 MB
- 2017-07-11 14:04:24.624341 I | rook-ceph-mon1: 2017-07-11 14:04:24.624301 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:04:24.624434 I | rook-ceph-mon1: 2017-07-11 14:04:24.624418 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1640131247' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:04:35.997760 I | rook-ceph-mon1: 2017-07-11 14:04:35.520533 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 467 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.077392s > max 0.05s
- 2017-07-11 14:04:35.998118 I | rook-ceph-mon1: 2017-07-11 14:04:35.520874 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 468 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.141366s > max 0.05s
- 2017-07-11 14:04:54.504272 I | rook-ceph-mon1: 2017-07-11 14:04:54.504085 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4696 MB, avail 94490 MB
- 2017-07-11 14:05:21.088995 I | rook-ceph-mon1: 2017-07-11 14:05:20.397690 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 101 : audit [INF] from='client.? 10.233.99.0:0/695457415' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:05:21.095928 I | rook-ceph-mon1: 2017-07-11 14:05:20.472654 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 474 : audit [INF] from='client.4559 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:05:31.194692 I | rook-ceph-mon1: 2017-07-11 14:05:31.193072 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #39. Immutable memtables: 0.
- 2017-07-11 14:05:31.194783 I | rook-ceph-mon1:
- 2017-07-11 14:05:31.194803 I | rook-ceph-mon1: 2017-07-11 14:05:31.193110 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 23] Syncing log #36
- 2017-07-11 14:05:31.231991 I | rook-ceph-mon1: 2017-07-11 14:05:31.222543 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.193105) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:05:31.232078 I | rook-ceph-mon1: 2017-07-11 14:05:31.222551 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 23] Flushing memtable with next log file: 39
- 2017-07-11 14:05:31.232111 I | rook-ceph-mon1:
- 2017-07-11 14:05:31.232166 I | rook-ceph-mon1: 2017-07-11 14:05:31.222559 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931222555, "job": 23, "event": "flush_started", "num_memtables": 1, "num_entries": 2105, "num_deletes": 251, "memory_usage": 5781648}
- 2017-07-11 14:05:31.232194 I | rook-ceph-mon1: 2017-07-11 14:05:31.222570 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 23] Level-0 flush table #40: started
- 2017-07-11 14:05:31.470528 I | rook-ceph-mon1: 2017-07-11 14:05:31.467769 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931467761, "cf_name": "default", "job": 23, "event": "table_file_creation", "file_number": 40, "file_size": 3814701, "table_properties": {"data_size": 3798004, "index_size": 15879, "filter_size": 0, "raw_key_size": 15057, "raw_average_key_size": 18, "raw_value_size": 3775761, "raw_average_value_size": 4672, "num_data_blocks": 506, "num_entries": 808, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:05:31.470827 I | rook-ceph-mon1: 2017-07-11 14:05:31.470757 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 23] Level-0 flush table #40: 3814701 bytes OK
- 2017-07-11 14:05:31.546612 I | rook-ceph-mon1: 2017-07-11 14:05:31.546591 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.497416) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #40 started
- 2017-07-11 14:05:31.546764 I | rook-ceph-mon1: 2017-07-11 14:05:31.546749 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.546556) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #40: memtable #1 done
- 2017-07-11 14:05:31.546908 I | rook-ceph-mon1: 2017-07-11 14:05:31.546893 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.546566) EVENT_LOG_v1 {"time_micros": 1499781931546562, "job": 23, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:05:31.546951 I | rook-ceph-mon1: 2017-07-11 14:05:31.546926 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.546579) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:05:31.547027 I | rook-ceph-mon1:
- 2017-07-11 14:05:31.547055 I | rook-ceph-mon1: 2017-07-11 14:05:31.547044 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 23] Try to delete WAL files size 5734704, prev total WAL file size 5734704, number of live WAL files 2.
- 2017-07-11 14:05:31.547067 I | rook-ceph-mon1:
- 2017-07-11 14:05:31.556370 I | rook-ceph-mon1: 2017-07-11 14:05:31.547912 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:05:31.556486 I | rook-ceph-mon1: 2017-07-11 14:05:31.547945 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.547940) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:05:31.556555 I | rook-ceph-mon1:
- 2017-07-11 14:05:31.556571 I | rook-ceph-mon1: 2017-07-11 14:05:31.547950 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 24] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:05:31.556582 I | rook-ceph-mon1: 2017-07-11 14:05:31.547954 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 23 Base level 0, inputs: [40(3725KB)], [38(10MB)]
- 2017-07-11 14:05:31.556593 I | rook-ceph-mon1:
- 2017-07-11 14:05:31.556615 I | rook-ceph-mon1: 2017-07-11 14:05:31.547962 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931547956, "job": 24, "event": "compaction_started", "files_L0": [40], "files_L1": [38], "score": -1, "input_data_size": 14834927}
- 2017-07-11 14:05:31.811382 I | rook-ceph-mon1: 2017-07-11 14:05:31.811344 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 24] Generated table #41: 1886 keys, 12960730 bytes
- 2017-07-11 14:05:31.814325 I | rook-ceph-mon1: 2017-07-11 14:05:31.814309 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931814301, "cf_name": "default", "job": 24, "event": "table_file_creation", "file_number": 41, "file_size": 12960730, "table_properties": {"data_size": 12916305, "index_size": 43606, "filter_size": 0, "raw_key_size": 35374, "raw_average_key_size": 18, "raw_value_size": 12859624, "raw_average_value_size": 6818, "num_data_blocks": 1353, "num_entries": 1886, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:05:31.948747 I | rook-ceph-mon1: 2017-07-11 14:05:31.948725 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 24] Compacted 1@0 + 1@1 files to L1 => 12960730 bytes
- 2017-07-11 14:05:32.007872 I | rook-ceph-mon1: 2017-07-11 14:05:32.007847 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:05:32.007790) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 37.0 rd, 32.3 wr, level 1, files in(1, 1) out(1) MB in(3.6, 10.5) out(12.4), read-write-amplify(7.3) write-amplify(3.4) OK, records in: 2395, records dropped: 509
- 2017-07-11 14:05:32.008066 I | rook-ceph-mon1:
- 2017-07-11 14:05:32.008346 I | rook-ceph-mon1: 2017-07-11 14:05:32.008327 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:05:32.007806) EVENT_LOG_v1 {"time_micros": 1499781932007800, "job": 24, "event": "compaction_finished", "compaction_time_micros": 400736, "output_level": 1, "num_output_files": 1, "total_output_size": 12960730, "num_input_records": 2395, "num_output_records": 1886, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:05:32.010944 I | rook-ceph-mon1: 2017-07-11 14:05:32.010929 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781932010925, "job": 24, "event": "table_file_deletion", "file_number": 40}
- 2017-07-11 14:05:32.018357 I | rook-ceph-mon1: 2017-07-11 14:05:32.018340 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781932018338, "job": 24, "event": "table_file_deletion", "file_number": 38}
- 2017-07-11 14:05:54.508467 I | rook-ceph-mon1: 2017-07-11 14:05:54.508215 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4698 MB, avail 94488 MB
- 2017-07-11 14:06:03.639249 I | rook-ceph-mon1: 2017-07-11 14:06:03.639217 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:06:03.639344 I | rook-ceph-mon1: 2017-07-11 14:06:03.639328 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1735571994' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:06:25.442871 I | rook-ceph-mon1: 2017-07-11 14:06:25.442569 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:06:25.442953 I | rook-ceph-mon1: 2017-07-11 14:06:25.442590 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1575135980' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:06:27.108472 I | rook-ceph-mon1: 2017-07-11 14:06:27.108441 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:06:27.108572 I | rook-ceph-mon1: 2017-07-11 14:06:27.108559 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/569518217' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:06:38.097401 I | rook-ceph-mon1: 2017-07-11 14:06:38.096257 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #42. Immutable memtables: 0.
- 2017-07-11 14:06:38.097469 I | rook-ceph-mon1:
- 2017-07-11 14:06:38.097489 I | rook-ceph-mon1: 2017-07-11 14:06:38.096293 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 25] Syncing log #39
- 2017-07-11 14:06:38.136845 I | rook-ceph-mon1: 2017-07-11 14:06:38.135964 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.096288) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:06:38.138519 I | rook-ceph-mon1: 2017-07-11 14:06:38.135980 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 25] Flushing memtable with next log file: 42
- 2017-07-11 14:06:38.138548 I | rook-ceph-mon1:
- 2017-07-11 14:06:38.138561 I | rook-ceph-mon1: 2017-07-11 14:06:38.136004 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998135998, "job": 25, "event": "flush_started", "num_memtables": 1, "num_entries": 588, "num_deletes": 250, "memory_usage": 1094272}
- 2017-07-11 14:06:38.138573 I | rook-ceph-mon1: 2017-07-11 14:06:38.136006 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 25] Level-0 flush table #43: started
- 2017-07-11 14:06:38.246582 I | rook-ceph-mon1: 2017-07-11 14:06:38.246555 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998246547, "cf_name": "default", "job": 25, "event": "table_file_creation", "file_number": 43, "file_size": 546989, "table_properties": {"data_size": 544226, "index_size": 1949, "filter_size": 0, "raw_key_size": 6561, "raw_average_key_size": 19, "raw_value_size": 538377, "raw_average_value_size": 1621, "num_data_blocks": 64, "num_entries": 332, "filter_policy_name": "", "kDeletedKeys": "250", "kMergeOperands": "0"}}
- 2017-07-11 14:06:38.246666 I | rook-ceph-mon1: 2017-07-11 14:06:38.246651 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 25] Level-0 flush table #43: 546989 bytes OK
- 2017-07-11 14:06:38.313027 I | rook-ceph-mon1: 2017-07-11 14:06:38.312979 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.274127) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #43 started
- 2017-07-11 14:06:38.314536 I | rook-ceph-mon1: 2017-07-11 14:06:38.314519 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.312924) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #43: memtable #1 done
- 2017-07-11 14:06:38.314623 I | rook-ceph-mon1: 2017-07-11 14:06:38.314566 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.312944) EVENT_LOG_v1 {"time_micros": 1499781998312937, "job": 25, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:06:38.314672 I | rook-ceph-mon1: 2017-07-11 14:06:38.314645 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.312964) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:06:38.314687 I | rook-ceph-mon1:
- 2017-07-11 14:06:38.314718 I | rook-ceph-mon1: 2017-07-11 14:06:38.314703 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 25] Try to delete WAL files size 1080866, prev total WAL file size 1100805, number of live WAL files 2.
- 2017-07-11 14:06:38.314730 I | rook-ceph-mon1:
- 2017-07-11 14:06:38.332412 I | rook-ceph-mon1: 2017-07-11 14:06:38.315115 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:06:38.332465 I | rook-ceph-mon1: 2017-07-11 14:06:38.315152 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.315148) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:06:38.332480 I | rook-ceph-mon1:
- 2017-07-11 14:06:38.332491 I | rook-ceph-mon1: 2017-07-11 14:06:38.315157 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 26] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:06:38.332521 I | rook-ceph-mon1: 2017-07-11 14:06:38.315162 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 25 Base level 0, inputs: [43(534KB)], [41(12MB)]
- 2017-07-11 14:06:38.332538 I | rook-ceph-mon1:
- 2017-07-11 14:06:38.332549 I | rook-ceph-mon1: 2017-07-11 14:06:38.315170 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998315164, "job": 26, "event": "compaction_started", "files_L0": [43], "files_L1": [41], "score": -1, "input_data_size": 13507719}
- 2017-07-11 14:06:38.538492 I | rook-ceph-mon1: 2017-07-11 14:06:38.538452 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 26] Generated table #44: 1737 keys, 12029606 bytes
- 2017-07-11 14:06:38.539952 I | rook-ceph-mon1: 2017-07-11 14:06:38.539933 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998539877, "cf_name": "default", "job": 26, "event": "table_file_creation", "file_number": 44, "file_size": 12029606, "table_properties": {"data_size": 11990527, "index_size": 38260, "filter_size": 0, "raw_key_size": 32268, "raw_average_key_size": 18, "raw_value_size": 11939705, "raw_average_value_size": 6873, "num_data_blocks": 1193, "num_entries": 1737, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:06:38.626046 I | rook-ceph-mon1: 2017-07-11 14:06:38.626025 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 26] Compacted 1@0 + 1@1 files to L1 => 12029606 bytes
- 2017-07-11 14:06:38.669996 I | rook-ceph-mon1: 2017-07-11 14:06:38.669969 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.669916) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 43.5 rd, 38.7 wr, level 1, files in(1, 1) out(1) MB in(0.5, 12.4) out(11.5), read-write-amplify(46.7) write-amplify(22.0) OK, records in: 2218, records dropped: 481
- 2017-07-11 14:06:38.670202 I | rook-ceph-mon1:
- 2017-07-11 14:06:38.670247 I | rook-ceph-mon1: 2017-07-11 14:06:38.670230 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.669931) EVENT_LOG_v1 {"time_micros": 1499781998669925, "job": 26, "event": "compaction_finished", "compaction_time_micros": 310844, "output_level": 1, "num_output_files": 1, "total_output_size": 12029606, "num_input_records": 2218, "num_output_records": 1737, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:06:38.686635 I | rook-ceph-mon1: 2017-07-11 14:06:38.686604 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998686600, "job": 26, "event": "table_file_deletion", "file_number": 43}
- 2017-07-11 14:06:38.688362 I | rook-ceph-mon1: 2017-07-11 14:06:38.688348 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998688346, "job": 26, "event": "table_file_deletion", "file_number": 41}
- 2017-07-11 14:06:38.688666 I | rook-ceph-mon1: 2017-07-11 14:06:38.688595 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #45. Immutable memtables: 0.
- 2017-07-11 14:06:38.688698 I | rook-ceph-mon1:
- 2017-07-11 14:06:38.688711 I | rook-ceph-mon1: 2017-07-11 14:06:38.688624 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 27] Syncing log #42
- 2017-07-11 14:06:38.848687 I | rook-ceph-mon1: 2017-07-11 14:06:38.848358 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.688619) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:06:38.849914 I | rook-ceph-mon1: 2017-07-11 14:06:38.848367 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 27] Flushing memtable with next log file: 45
- 2017-07-11 14:06:38.849943 I | rook-ceph-mon1:
- 2017-07-11 14:06:38.849956 I | rook-ceph-mon1: 2017-07-11 14:06:38.848378 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998848373, "job": 27, "event": "flush_started", "num_memtables": 1, "num_entries": 7, "num_deletes": 0, "memory_usage": 22192}
- 2017-07-11 14:06:38.849968 I | rook-ceph-mon1: 2017-07-11 14:06:38.848380 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 27] Level-0 flush table #46: started
- 2017-07-11 14:06:38.878557 I | rook-ceph-mon1: 2017-07-11 14:06:38.877531 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998877516, "cf_name": "default", "job": 27, "event": "table_file_creation", "file_number": 46, "file_size": 14235, "table_properties": {"data_size": 13346, "index_size": 81, "filter_size": 0, "raw_key_size": 143, "raw_average_key_size": 23, "raw_value_size": 13164, "raw_average_value_size": 2194, "num_data_blocks": 3, "num_entries": 6, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:06:38.878600 I | rook-ceph-mon1: 2017-07-11 14:06:38.877546 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 27] Level-0 flush table #46: 14235 bytes OK
- 2017-07-11 14:06:38.958552 I | rook-ceph-mon1: 2017-07-11 14:06:38.956098 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.906326) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #46 started
- 2017-07-11 14:06:38.958636 I | rook-ceph-mon1: 2017-07-11 14:06:38.956103 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.956065) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #46: memtable #1 done
- 2017-07-11 14:06:38.958655 I | rook-ceph-mon1: 2017-07-11 14:06:38.956105 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.956075) EVENT_LOG_v1 {"time_micros": 1499781998956071, "job": 27, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:06:38.958667 I | rook-ceph-mon1: 2017-07-11 14:06:38.956106 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.956088) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:06:38.958679 I | rook-ceph-mon1:
- 2017-07-11 14:06:38.958706 I | rook-ceph-mon1: 2017-07-11 14:06:38.956110 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 27] Try to delete WAL files size 19939, prev total WAL file size 31667, number of live WAL files 2.
- 2017-07-11 14:06:38.958718 I | rook-ceph-mon1:
- 2017-07-11 14:06:38.958729 I | rook-ceph-mon1: 2017-07-11 14:06:38.956205 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:06:38.958740 I | rook-ceph-mon1: 2017-07-11 14:06:38.956239 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.956234) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:06:38.958750 I | rook-ceph-mon1:
- 2017-07-11 14:06:38.958778 I | rook-ceph-mon1: 2017-07-11 14:06:38.956243 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 28] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:06:38.958792 I | rook-ceph-mon1: 2017-07-11 14:06:38.956247 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 27 Base level 0, inputs: [46(13KB)], [44(11MB)]
- 2017-07-11 14:06:38.958802 I | rook-ceph-mon1:
- 2017-07-11 14:06:38.958824 I | rook-ceph-mon1: 2017-07-11 14:06:38.956256 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998956249, "job": 28, "event": "compaction_started", "files_L0": [46], "files_L1": [44], "score": -1, "input_data_size": 12043841}
- 2017-07-11 14:06:40.042193 I | rook-ceph-mon1: 2017-07-11 14:06:40.042154 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 28] Generated table #47: 1739 keys, 12042873 bytes
- 2017-07-11 14:06:40.050799 I | rook-ceph-mon1: 2017-07-11 14:06:40.050775 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782000050767, "cf_name": "default", "job": 28, "event": "table_file_creation", "file_number": 47, "file_size": 12042873, "table_properties": {"data_size": 12003731, "index_size": 38323, "filter_size": 0, "raw_key_size": 32306, "raw_average_key_size": 18, "raw_value_size": 11952837, "raw_average_value_size": 6873, "num_data_blocks": 1195, "num_entries": 1739, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:06:40.110067 I | rook-ceph-mon1: 2017-07-11 14:06:40.110046 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 28] Compacted 1@0 + 1@1 files to L1 => 12042873 bytes
- 2017-07-11 14:06:40.190352 I | rook-ceph-mon1: 2017-07-11 14:06:40.190317 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:06:40.190251) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 10.4 rd, 10.4 wr, level 1, files in(1, 1) out(1) MB in(0.0, 11.5) out(11.5), read-write-amplify(1692.1) write-amplify(846.0) OK, records in: 1743, records dropped: 4
- 2017-07-11 14:06:40.190412 I | rook-ceph-mon1:
- 2017-07-11 14:06:40.190445 I | rook-ceph-mon1: 2017-07-11 14:06:40.190429 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:06:40.190268) EVENT_LOG_v1 {"time_micros": 1499782000190260, "job": 28, "event": "compaction_finished", "compaction_time_micros": 1153779, "output_level": 1, "num_output_files": 1, "total_output_size": 12042873, "num_input_records": 1743, "num_output_records": 1739, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:06:40.191368 I | rook-ceph-mon1: 2017-07-11 14:06:40.191353 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782000191350, "job": 28, "event": "table_file_deletion", "file_number": 46}
- 2017-07-11 14:06:40.200098 I | rook-ceph-mon1: 2017-07-11 14:06:40.200079 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782000200076, "job": 28, "event": "table_file_deletion", "file_number": 44}
- 2017-07-11 14:06:49.036147 I | rook-ceph-mon1: 2017-07-11 14:06:49.036112 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:06:49.036328 I | rook-ceph-mon1: 2017-07-11 14:06:49.036242 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/287536257' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:06:54.509511 I | rook-ceph-mon1: 2017-07-11 14:06:54.509231 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4697 MB, avail 94489 MB
- 2017-07-11 14:07:00.181810 I | rook-ceph-mon1: 2017-07-11 14:07:00.181783 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:07:00.183478 I | rook-ceph-mon1: 2017-07-11 14:07:00.183462 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3172403103' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:07:11.217166 I | rook-ceph-mon1: 2017-07-11 14:07:11.217143 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:07:11.217250 I | rook-ceph-mon1: 2017-07-11 14:07:11.217237 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3474169124' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:07:20.627025 I | rook-ceph-mon1: 2017-07-11 14:07:20.626993 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:07:20.627130 I | rook-ceph-mon1: 2017-07-11 14:07:20.627116 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1600875180' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:07:54.516570 I | rook-ceph-mon1: 2017-07-11 14:07:54.516516 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4698 MB, avail 94489 MB
- 2017-07-11 14:08:06.466387 I | rook-ceph-mon1: 2017-07-11 14:08:06.466339 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:08:06.482398 I | rook-ceph-mon1: 2017-07-11 14:08:06.466552 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2005232091' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:08:17.539390 I | rook-ceph-mon1: 2017-07-11 14:08:17.539351 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:08:17.539489 I | rook-ceph-mon1: 2017-07-11 14:08:17.539475 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/309248212' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:08:54.545335 I | rook-ceph-mon1: 2017-07-11 14:08:54.524787 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4698 MB, avail 94489 MB
- 2017-07-11 14:09:36.330913 I | rook-ceph-mon1: 2017-07-11 14:09:35.522281 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 496 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0783901s > max 0.05s
- 2017-07-11 14:09:36.334435 I | rook-ceph-mon1: 2017-07-11 14:09:35.531016 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 497 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.107634s > max 0.05s
- 2017-07-11 14:09:43.734388 I | rook-ceph-mon1: 2017-07-11 14:09:43.732773 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:09:43.734526 I | rook-ceph-mon1: 2017-07-11 14:09:43.732794 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3485746802' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:09:54.526435 I | rook-ceph-mon1: 2017-07-11 14:09:54.526183 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4698 MB, avail 94489 MB
- 2017-07-11 14:10:29.318636 I | rook-ceph-mon1: 2017-07-11 14:10:29.318571 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:10:29.318702 I | rook-ceph-mon1: 2017-07-11 14:10:29.318589 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/644584627' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:10:54.531939 I | rook-ceph-mon1: 2017-07-11 14:10:54.531708 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4698 MB, avail 94489 MB
- 2017-07-11 14:11:13.901484 I | rook-ceph-mon1: 2017-07-11 14:11:13.901451 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:11:13.901671 I | rook-ceph-mon1: 2017-07-11 14:11:13.901588 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2575821835' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:11:23.066407 I | rook-ceph-mon1: 2017-07-11 14:11:23.066377 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:11:23.066537 I | rook-ceph-mon1: 2017-07-11 14:11:23.066522 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3267236649' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:11:37.041915 I | rook-ceph-mon1: 2017-07-11 14:11:37.041074 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #48. Immutable memtables: 0.
- 2017-07-11 14:11:37.041991 I | rook-ceph-mon1:
- 2017-07-11 14:11:37.042009 I | rook-ceph-mon1: 2017-07-11 14:11:37.041118 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 29] Syncing log #45
- 2017-07-11 14:11:37.159149 I | rook-ceph-mon1: 2017-07-11 14:11:37.150725 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.041113) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:11:37.159188 I | rook-ceph-mon1: 2017-07-11 14:11:37.150733 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 29] Flushing memtable with next log file: 48
- 2017-07-11 14:11:37.159220 I | rook-ceph-mon1:
- 2017-07-11 14:11:37.159234 I | rook-ceph-mon1: 2017-07-11 14:11:37.150741 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782297150737, "job": 29, "event": "flush_started", "num_memtables": 1, "num_entries": 1799, "num_deletes": 251, "memory_usage": 4983584}
- 2017-07-11 14:11:37.159245 I | rook-ceph-mon1: 2017-07-11 14:11:37.150743 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 29] Level-0 flush table #49: started
- 2017-07-11 14:11:37.302469 I | rook-ceph-mon1: 2017-07-11 14:11:37.302431 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782297302422, "cf_name": "default", "job": 29, "event": "table_file_creation", "file_number": 49, "file_size": 3287836, "table_properties": {"data_size": 3274049, "index_size": 12969, "filter_size": 0, "raw_key_size": 13445, "raw_average_key_size": 18, "raw_value_size": 3255001, "raw_average_value_size": 4495, "num_data_blocks": 414, "num_entries": 724, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:11:37.304028 I | rook-ceph-mon1: 2017-07-11 14:11:37.304011 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 29] Level-0 flush table #49: 3287836 bytes OK
- 2017-07-11 14:11:37.408317 I | rook-ceph-mon1: 2017-07-11 14:11:37.408292 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.360012) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #49 started
- 2017-07-11 14:11:37.408526 I | rook-ceph-mon1: 2017-07-11 14:11:37.408509 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.408255) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #49: memtable #1 done
- 2017-07-11 14:11:37.408694 I | rook-ceph-mon1: 2017-07-11 14:11:37.408678 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.408267) EVENT_LOG_v1 {"time_micros": 1499782297408262, "job": 29, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:11:37.408759 I | rook-ceph-mon1: 2017-07-11 14:11:37.408727 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.408280) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:11:37.408899 I | rook-ceph-mon1:
- 2017-07-11 14:11:37.408935 I | rook-ceph-mon1: 2017-07-11 14:11:37.408922 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 29] Try to delete WAL files size 4943070, prev total WAL file size 4943070, number of live WAL files 2.
- 2017-07-11 14:11:37.408962 I | rook-ceph-mon1:
- 2017-07-11 14:11:37.412001 I | rook-ceph-mon1: 2017-07-11 14:11:37.411842 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:11:37.412058 I | rook-ceph-mon1: 2017-07-11 14:11:37.411959 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:11:37.412074 I | rook-ceph-mon1: 2017-07-11 14:11:37.411963 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:11:37.412086 I | rook-ceph-mon1: ** DB Stats **
- 2017-07-11 14:11:37.412110 I | rook-ceph-mon1: Uptime(secs): 2863.7 total, 804.5 interval
- 2017-07-11 14:11:37.412122 I | rook-ceph-mon1: Cumulative writes: 4152 writes, 18K keys, 4152 commit groups, 1.0 writes per commit group, ingest: 0.05 GB, 0.02 MB/s
- 2017-07-11 14:11:37.412132 I | rook-ceph-mon1: Cumulative WAL: 4152 writes, 4152 syncs, 1.00 writes per sync, written: 0.05 GB, 0.02 MB/s
- 2017-07-11 14:11:37.412143 I | rook-ceph-mon1: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:11:37.412153 I | rook-ceph-mon1: Interval writes: 1040 writes, 4879 keys, 1040 commit groups, 1.0 writes per commit group, ingest: 11.60 MB, 0.01 MB/s
- 2017-07-11 14:11:37.412162 I | rook-ceph-mon1: Interval WAL: 1040 writes, 1040 syncs, 1.00 writes per sync, written: 0.01 MB, 0.01 MB/s
- 2017-07-11 14:11:37.412183 I | rook-ceph-mon1: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:11:37.412194 I | rook-ceph-mon1:
- 2017-07-11 14:11:37.412204 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 14:11:37.412213 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:11:37.412224 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:11:37.412238 I | rook-ceph-mon1: L0 1/1 3.14 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 11.3 3 15 0.180 0 0
- 2017-07-11 14:11:37.412282 I | rook-ceph-mon1: L1 1/1 11.48 MB 0.0 0.2 0.0 0.1 0.1 0.0 0.0 5.4 22.7 20.5 7 13 0.553 24K 4403
- 2017-07-11 14:11:37.412513 I | rook-ceph-mon1: Sum 2/2 14.62 MB 0.0 0.2 0.0 0.1 0.2 0.0 0.0 5.8 16.5 18.0 10 28 0.354 24K 4403
- 2017-07-11 14:11:37.412563 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 8.7 20.0 20.7 3 10 0.317 10K 1825
- 2017-07-11 14:11:37.412585 I | rook-ceph-mon1: Uptime(secs): 2863.7 total, 2863.7 interval
- 2017-07-11 14:11:37.412597 I | rook-ceph-mon1: Flush(GB): cumulative 0.030, interval 0.007
- 2017-07-11 14:11:37.412608 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:11:37.412619 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:11:37.418423 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:11:37.418432 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:11:37.418435 I | rook-ceph-mon1: Cumulative compaction: 0.17 GB write, 0.06 MB/s write, 0.16 GB read, 0.06 MB/s read, 9.9 seconds
- 2017-07-11 14:11:37.418438 I | rook-ceph-mon1: Interval compaction: 0.06 GB write, 0.02 MB/s write, 0.06 GB read, 0.02 MB/s read, 3.2 seconds
- 2017-07-11 14:11:37.418441 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:11:37.418444 I | rook-ceph-mon1:
- 2017-07-11 14:11:37.418447 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:11:37.418449 I | rook-ceph-mon1:
- 2017-07-11 14:11:37.418451 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 14:11:37.418454 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:11:37.418460 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:11:37.418462 I | rook-ceph-mon1: L0 1/1 3.14 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 11.3 3 15 0.180 0 0
- 2017-07-11 14:11:37.418464 I | rook-ceph-mon1: L1 1/1 11.48 MB 0.0 0.2 0.0 0.1 0.1 0.0 0.0 5.4 22.7 20.5 7 13 0.553 24K 4403
- 2017-07-11 14:11:37.418471 I | rook-ceph-mon1: Sum 2/2 14.62 MB 0.0 0.2 0.0 0.1 0.2 0.0 0.0 5.8 16.5 18.0 10 28 0.354 24K 4403
- 2017-07-11 14:11:37.418474 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:11:37.418476 I | rook-ceph-mon1: Uptime(secs): 2863.7 total, 2863.7 interval
- 2017-07-11 14:11:37.418478 I | rook-ceph-mon1: Flush(GB): cumulative 0.030, interval 0.000
- 2017-07-11 14:11:37.418480 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:11:37.418483 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:11:37.418485 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:11:37.418486 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:11:37.418489 I | rook-ceph-mon1: Cumulative compaction: 0.17 GB write, 0.06 MB/s write, 0.16 GB read, 0.06 MB/s read, 9.9 seconds
- 2017-07-11 14:11:37.418491 I | rook-ceph-mon1: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:11:37.418494 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:11:37.418496 I | rook-ceph-mon1:
- 2017-07-11 14:11:37.418499 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:11:37.418500 I | rook-ceph-mon1:
- 2017-07-11 14:11:37.418505 I | rook-ceph-mon1: 2017-07-11 14:11:37.411980 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.411972) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:11:37.418507 I | rook-ceph-mon1:
- 2017-07-11 14:11:37.418511 I | rook-ceph-mon1: 2017-07-11 14:11:37.411991 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 30] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:11:37.418515 I | rook-ceph-mon1: 2017-07-11 14:11:37.412303 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 29 Base level 0, inputs: [49(3210KB)], [47(11MB)]
- 2017-07-11 14:11:37.418517 I | rook-ceph-mon1:
- 2017-07-11 14:11:37.418519 I | rook-ceph-mon1: 2017-07-11 14:11:37.412312 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782297412305, "job": 30, "event": "compaction_started", "files_L0": [49], "files_L1": [47], "score": -1, "input_data_size": 15330709}
- 2017-07-11 14:11:37.597862 I | rook-ceph-mon1: 2017-07-11 14:11:37.595935 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 30] Generated table #50: 1954 keys, 13445289 bytes
- 2017-07-11 14:11:37.598492 I | rook-ceph-mon1: 2017-07-11 14:11:37.598378 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782297598368, "cf_name": "default", "job": 30, "event": "table_file_creation", "file_number": 50, "file_size": 13445289, "table_properties": {"data_size": 13400705, "index_size": 43765, "filter_size": 0, "raw_key_size": 36530, "raw_average_key_size": 18, "raw_value_size": 13342997, "raw_average_value_size": 6828, "num_data_blocks": 1356, "num_entries": 1954, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:11:37.636642 I | rook-ceph-mon1: 2017-07-11 14:11:37.636619 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 30] Compacted 1@0 + 1@1 files to L1 => 13445289 bytes
- 2017-07-11 14:11:37.685022 I | rook-ceph-mon1: 2017-07-11 14:11:37.684818 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.684724) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 68.4 rd, 59.9 wr, level 1, files in(1, 1) out(1) MB in(3.1, 11.5) out(12.8), read-write-amplify(8.8) write-amplify(4.1) OK, records in: 2463, records dropped: 509
- 2017-07-11 14:11:37.685062 I | rook-ceph-mon1:
- 2017-07-11 14:11:37.685094 I | rook-ceph-mon1: 2017-07-11 14:11:37.685079 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.684755) EVENT_LOG_v1 {"time_micros": 1499782297684742, "job": 30, "event": "compaction_finished", "compaction_time_micros": 224295, "output_level": 1, "num_output_files": 1, "total_output_size": 13445289, "num_input_records": 2463, "num_output_records": 1954, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:11:37.685584 I | rook-ceph-mon1: 2017-07-11 14:11:37.685570 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782297685568, "job": 30, "event": "table_file_deletion", "file_number": 49}
- 2017-07-11 14:11:37.688019 I | rook-ceph-mon1: 2017-07-11 14:11:37.688004 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782297688002, "job": 30, "event": "table_file_deletion", "file_number": 47}
- 2017-07-11 14:11:54.539017 I | rook-ceph-mon1: 2017-07-11 14:11:54.538735 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4699 MB, avail 94487 MB
- 2017-07-11 14:12:18.241111 I | rook-ceph-mon1: 2017-07-11 14:12:18.241077 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:12:18.241216 I | rook-ceph-mon1: 2017-07-11 14:12:18.241200 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3155747488' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:12:40.332165 I | rook-ceph-mon1: 2017-07-11 14:12:40.332136 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:12:40.339168 I | rook-ceph-mon1: 2017-07-11 14:12:40.339148 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2243753136' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:12:54.540756 I | rook-ceph-mon1: 2017-07-11 14:12:54.540495 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4699 MB, avail 94487 MB
- 2017-07-11 14:13:54.545718 I | rook-ceph-mon1: 2017-07-11 14:13:54.545383 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4699 MB, avail 94487 MB
- 2017-07-11 14:14:35.861901 I | rook-ceph-mon1: 2017-07-11 14:14:35.532643 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 530 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0690982s > max 0.05s
- 2017-07-11 14:14:35.861965 I | rook-ceph-mon1: 2017-07-11 14:14:35.539479 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 531 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.127837s > max 0.05s
- 2017-07-11 14:14:54.565002 I | rook-ceph-mon1: 2017-07-11 14:14:54.551383 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4699 MB, avail 94487 MB
- 2017-07-11 14:14:54.724055 I | rook-ceph-mon1: 2017-07-11 14:14:54.724024 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:14:54.724157 I | rook-ceph-mon1: 2017-07-11 14:14:54.724141 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/42893249' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:15:03.088420 I | rook-ceph-mon1: 2017-07-11 14:15:03.088348 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #51. Immutable memtables: 0.
- 2017-07-11 14:15:03.088490 I | rook-ceph-mon1:
- 2017-07-11 14:15:03.088533 I | rook-ceph-mon1: 2017-07-11 14:15:03.088384 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 31] Syncing log #48
- 2017-07-11 14:15:03.146594 I | rook-ceph-mon1: 2017-07-11 14:15:03.136792 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.088379) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:15:03.146656 I | rook-ceph-mon1: 2017-07-11 14:15:03.136809 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 31] Flushing memtable with next log file: 51
- 2017-07-11 14:15:03.146671 I | rook-ceph-mon1:
- 2017-07-11 14:15:03.146683 I | rook-ceph-mon1: 2017-07-11 14:15:03.136825 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782503136817, "job": 31, "event": "flush_started", "num_memtables": 1, "num_entries": 1359, "num_deletes": 252, "memory_usage": 3570664}
- 2017-07-11 14:15:03.146694 I | rook-ceph-mon1: 2017-07-11 14:15:03.136828 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 31] Level-0 flush table #52: started
- 2017-07-11 14:15:03.225279 I | rook-ceph-mon1: 2017-07-11 14:15:03.225248 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782503225240, "cf_name": "default", "job": 31, "event": "table_file_creation", "file_number": 52, "file_size": 1724021, "table_properties": {"data_size": 1717164, "index_size": 6042, "filter_size": 0, "raw_key_size": 9566, "raw_average_key_size": 19, "raw_value_size": 1706109, "raw_average_value_size": 3432, "num_data_blocks": 198, "num_entries": 497, "filter_policy_name": "", "kDeletedKeys": "252", "kMergeOperands": "0"}}
- 2017-07-11 14:15:03.225338 I | rook-ceph-mon1: 2017-07-11 14:15:03.225322 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 31] Level-0 flush table #52: 1724021 bytes OK
- 2017-07-11 14:15:03.323220 I | rook-ceph-mon1: 2017-07-11 14:15:03.323170 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.274183) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #52 started
- 2017-07-11 14:15:03.324572 I | rook-ceph-mon1: 2017-07-11 14:15:03.324554 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.323107) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #52: memtable #1 done
- 2017-07-11 14:15:03.324652 I | rook-ceph-mon1: 2017-07-11 14:15:03.324602 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.323127) EVENT_LOG_v1 {"time_micros": 1499782503323119, "job": 31, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:15:03.324701 I | rook-ceph-mon1: 2017-07-11 14:15:03.324686 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.323147) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:15:03.324716 I | rook-ceph-mon1:
- 2017-07-11 14:15:03.324743 I | rook-ceph-mon1: 2017-07-11 14:15:03.324732 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 31] Try to delete WAL files size 3542711, prev total WAL file size 3542711, number of live WAL files 2.
- 2017-07-11 14:15:03.324770 I | rook-ceph-mon1:
- 2017-07-11 14:15:03.333417 I | rook-ceph-mon1: 2017-07-11 14:15:03.325434 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:15:03.333471 I | rook-ceph-mon1: 2017-07-11 14:15:03.325506 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.325501) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:15:03.333487 I | rook-ceph-mon1:
- 2017-07-11 14:15:03.333501 I | rook-ceph-mon1: 2017-07-11 14:15:03.325522 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 32] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:15:03.333512 I | rook-ceph-mon1: 2017-07-11 14:15:03.325527 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 31 Base level 0, inputs: [52(1683KB)], [50(12MB)]
- 2017-07-11 14:15:03.333540 I | rook-ceph-mon1:
- 2017-07-11 14:15:03.333550 I | rook-ceph-mon1: 2017-07-11 14:15:03.325536 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782503325529, "job": 32, "event": "compaction_started", "files_L0": [52], "files_L1": [50], "score": -1, "input_data_size": 15169310}
- 2017-07-11 14:15:03.521864 I | rook-ceph-mon1: 2017-07-11 14:15:03.521829 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 32] Generated table #53: 2036 keys, 14138670 bytes
- 2017-07-11 14:15:03.524574 I | rook-ceph-mon1: 2017-07-11 14:15:03.524555 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782503524547, "cf_name": "default", "job": 32, "event": "table_file_creation", "file_number": 53, "file_size": 14138670, "table_properties": {"data_size": 14092994, "index_size": 44857, "filter_size": 0, "raw_key_size": 37749, "raw_average_key_size": 18, "raw_value_size": 14033490, "raw_average_value_size": 6892, "num_data_blocks": 1397, "num_entries": 2036, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:15:03.638594 I | rook-ceph-mon1: 2017-07-11 14:15:03.638574 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 32] Compacted 1@0 + 1@1 files to L1 => 14138670 bytes
- 2017-07-11 14:15:03.687389 I | rook-ceph-mon1: 2017-07-11 14:15:03.687365 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.687316) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 48.5 rd, 45.2 wr, level 1, files in(1, 1) out(1) MB in(1.6, 12.8) out(13.5), read-write-amplify(17.0) write-amplify(8.2) OK, records in: 2451, records dropped: 415
- 2017-07-11 14:15:03.687585 I | rook-ceph-mon1:
- 2017-07-11 14:15:03.687630 I | rook-ceph-mon1: 2017-07-11 14:15:03.687614 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.687330) EVENT_LOG_v1 {"time_micros": 1499782503687324, "job": 32, "event": "compaction_finished", "compaction_time_micros": 313028, "output_level": 1, "num_output_files": 1, "total_output_size": 14138670, "num_input_records": 2451, "num_output_records": 2036, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:15:03.688731 I | rook-ceph-mon1: 2017-07-11 14:15:03.688717 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782503688715, "job": 32, "event": "table_file_deletion", "file_number": 52}
- 2017-07-11 14:15:03.697545 I | rook-ceph-mon1: 2017-07-11 14:15:03.697528 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782503697526, "job": 32, "event": "table_file_deletion", "file_number": 50}
- 2017-07-11 14:15:03.697611 I | rook-ceph-mon1: 2017-07-11 14:15:03.697597 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:15:05.888970 I | rook-ceph-mon1: 2017-07-11 14:15:05.888938 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:15:05.889128 I | rook-ceph-mon1: 2017-07-11 14:15:05.889059 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2932767962' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:15:26.516048 I | rook-ceph-mon1: 2017-07-11 14:15:26.515939 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:15:26.522132 I | rook-ceph-mon1: 2017-07-11 14:15:26.515956 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/383443119' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:15:54.123301 I | rook-ceph-mon1: 2017-07-11 14:15:54.123265 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:15:54.123534 I | rook-ceph-mon1: 2017-07-11 14:15:54.123419 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3565269860' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:15:54.573339 I | rook-ceph-mon1: 2017-07-11 14:15:54.573116 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4747 MB, avail 94439 MB
- 2017-07-11 14:16:20.835504 I | rook-ceph-mon1: 2017-07-11 14:16:20.835466 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:20.836152 I | rook-ceph-mon1: 2017-07-11 14:16:20.836136 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1265791924' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:22.315890 I | rook-ceph-mon1: 2017-07-11 14:16:22.315845 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:16:22.315985 I | rook-ceph-mon1: 2017-07-11 14:16:22.315968 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/930197658' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:16:28.499716 I | rook-ceph-mon1: 2017-07-11 14:16:28.499596 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:28.499790 I | rook-ceph-mon1: 2017-07-11 14:16:28.499620 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3867840551' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:35.207350 I | rook-ceph-mon1: 2017-07-11 14:16:35.207322 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:16:35.207508 I | rook-ceph-mon1: 2017-07-11 14:16:35.207492 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4237923889' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:16:47.907258 I | rook-ceph-mon1: 2017-07-11 14:16:47.904935 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #54. Immutable memtables: 0.
- 2017-07-11 14:16:47.907324 I | rook-ceph-mon1:
- 2017-07-11 14:16:47.907372 I | rook-ceph-mon1: 2017-07-11 14:16:47.905019 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 33] Syncing log #51
- 2017-07-11 14:16:47.935377 I | rook-ceph-mon1: 2017-07-11 14:16:47.934426 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:16:47.905013) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:16:47.935415 I | rook-ceph-mon1: 2017-07-11 14:16:47.934441 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 33] Flushing memtable with next log file: 54
- 2017-07-11 14:16:47.935430 I | rook-ceph-mon1:
- 2017-07-11 14:16:47.935442 I | rook-ceph-mon1: 2017-07-11 14:16:47.934457 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782607934450, "job": 33, "event": "flush_started", "num_memtables": 1, "num_entries": 1089, "num_deletes": 251, "memory_usage": 2949192}
- 2017-07-11 14:16:47.935453 I | rook-ceph-mon1: 2017-07-11 14:16:47.934460 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 33] Level-0 flush table #55: started
- 2017-07-11 14:16:48.012947 I | rook-ceph-mon1: 2017-07-11 14:16:48.012901 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782608012894, "cf_name": "default", "job": 33, "event": "table_file_creation", "file_number": 55, "file_size": 1945599, "table_properties": {"data_size": 1938092, "index_size": 6692, "filter_size": 0, "raw_key_size": 9557, "raw_average_key_size": 18, "raw_value_size": 1926293, "raw_average_value_size": 3711, "num_data_blocks": 216, "num_entries": 519, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:16:48.013020 I | rook-ceph-mon1: 2017-07-11 14:16:48.013005 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 33] Level-0 flush table #55: 1945599 bytes OK
- 2017-07-11 14:16:48.090782 I | rook-ceph-mon1: 2017-07-11 14:16:48.090735 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:16:48.042255) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #55 started
- 2017-07-11 14:16:48.091906 I | rook-ceph-mon1: 2017-07-11 14:16:48.091890 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:16:48.090682) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #55: memtable #1 done
- 2017-07-11 14:16:48.091964 I | rook-ceph-mon1: 2017-07-11 14:16:48.091934 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:16:48.090702) EVENT_LOG_v1 {"time_micros": 1499782608090695, "job": 33, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:16:48.091995 I | rook-ceph-mon1: 2017-07-11 14:16:48.091981 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:16:48.090721) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:16:48.092020 I | rook-ceph-mon1:
- 2017-07-11 14:16:48.092047 I | rook-ceph-mon1: 2017-07-11 14:16:48.092036 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 33] Try to delete WAL files size 2925520, prev total WAL file size 2925520, number of live WAL files 2.
- 2017-07-11 14:16:48.092061 I | rook-ceph-mon1:
- 2017-07-11 14:16:48.110199 I | rook-ceph-mon1: 2017-07-11 14:16:48.092547 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:16:48.110434 I | rook-ceph-mon1: 2017-07-11 14:16:48.092580 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:16:48.092576) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:16:48.110507 I | rook-ceph-mon1:
- 2017-07-11 14:16:48.110536 I | rook-ceph-mon1: 2017-07-11 14:16:48.092585 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 34] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:16:48.110595 I | rook-ceph-mon1: 2017-07-11 14:16:48.092597 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 33 Base level 0, inputs: [55(1899KB)], [53(13MB)]
- 2017-07-11 14:16:48.110607 I | rook-ceph-mon1:
- 2017-07-11 14:16:48.110617 I | rook-ceph-mon1: 2017-07-11 14:16:48.092606 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782608092599, "job": 34, "event": "compaction_started", "files_L0": [55], "files_L1": [53], "score": -1, "input_data_size": 16084269}
- 2017-07-11 14:16:48.297831 I | rook-ceph-mon1: 2017-07-11 14:16:48.297501 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 34] Generated table #56: 2046 keys, 14155888 bytes
- 2017-07-11 14:16:48.297929 I | rook-ceph-mon1: 2017-07-11 14:16:48.297911 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782608297902, "cf_name": "default", "job": 34, "event": "table_file_creation", "file_number": 56, "file_size": 14155888, "table_properties": {"data_size": 14111074, "index_size": 43995, "filter_size": 0, "raw_key_size": 38085, "raw_average_key_size": 18, "raw_value_size": 14051983, "raw_average_value_size": 6868, "num_data_blocks": 1361, "num_entries": 2046, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:16:48.405145 I | rook-ceph-mon1: 2017-07-11 14:16:48.405125 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 34] Compacted 1@0 + 1@1 files to L1 => 14155888 bytes
- 2017-07-11 14:16:48.437508 I | rook-ceph-mon1: 2017-07-11 14:16:48.435410 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:16:48.435364) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 51.5 rd, 45.3 wr, level 1, files in(1, 1) out(1) MB in(1.9, 13.5) out(13.5), read-write-amplify(15.5) write-amplify(7.3) OK, records in: 2555, records dropped: 509
- 2017-07-11 14:16:48.437544 I | rook-ceph-mon1:
- 2017-07-11 14:16:48.437577 I | rook-ceph-mon1: 2017-07-11 14:16:48.437561 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:16:48.435378) EVENT_LOG_v1 {"time_micros": 1499782608435372, "job": 34, "event": "compaction_finished", "compaction_time_micros": 312508, "output_level": 1, "num_output_files": 1, "total_output_size": 14155888, "num_input_records": 2555, "num_output_records": 2046, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:16:48.437930 I | rook-ceph-mon1: 2017-07-11 14:16:48.437917 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782608437914, "job": 34, "event": "table_file_deletion", "file_number": 55}
- 2017-07-11 14:16:48.454955 I | rook-ceph-mon1: 2017-07-11 14:16:48.454940 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782608454938, "job": 34, "event": "table_file_deletion", "file_number": 53}
- 2017-07-11 14:16:54.578571 I | rook-ceph-mon1: 2017-07-11 14:16:54.578334 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4747 MB, avail 94439 MB
- 2017-07-11 14:16:57.290986 I | rook-ceph-mon1: 2017-07-11 14:16:57.290953 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:16:57.291046 I | rook-ceph-mon1: 2017-07-11 14:16:57.291032 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2255935616' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:16:59.250976 I | rook-ceph-mon1: 2017-07-11 14:16:59.250923 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:59.251086 I | rook-ceph-mon1: 2017-07-11 14:16:59.251070 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1290767286' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:19.484596 I | rook-ceph-mon1: 2017-07-11 14:17:19.484567 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:17:19.486886 I | rook-ceph-mon1: 2017-07-11 14:17:19.486863 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3449818736' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:17:39.630409 I | rook-ceph-mon1: 2017-07-11 14:17:39.630376 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:39.630638 I | rook-ceph-mon1: 2017-07-11 14:17:39.630621 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1399158897' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:50.806073 I | rook-ceph-mon1: 2017-07-11 14:17:50.806044 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:17:50.806171 I | rook-ceph-mon1: 2017-07-11 14:17:50.806157 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/287896766' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:17:54.586150 I | rook-ceph-mon1: 2017-07-11 14:17:54.585867 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4747 MB, avail 94439 MB
- 2017-07-11 14:18:13.135825 I | rook-ceph-mon1: 2017-07-11 14:18:13.135788 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:18:13.136032 I | rook-ceph-mon1: 2017-07-11 14:18:13.135956 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1457929642' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:18:14.882976 I | rook-ceph-mon1: 2017-07-11 14:18:14.882948 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:18:14.883066 I | rook-ceph-mon1: 2017-07-11 14:18:14.883052 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2972685998' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:18:29.996960 I | rook-ceph-mon1: 2017-07-11 14:18:29.996586 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:18:29.998929 I | rook-ceph-mon1: 2017-07-11 14:18:29.996609 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2486077636' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:18:37.980584 I | rook-ceph-mon1: 2017-07-11 14:18:37.980503 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:37.980818 I | rook-ceph-mon1: 2017-07-11 14:18:37.980782 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2824375911' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:46.417224 I | rook-ceph-mon1: 2017-07-11 14:18:46.417196 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:18:46.417315 I | rook-ceph-mon1: 2017-07-11 14:18:46.417301 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2549646363' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:18:54.602160 I | rook-ceph-mon1: 2017-07-11 14:18:54.586087 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4747 MB, avail 94439 MB
- 2017-07-11 14:19:10.455335 I | rook-ceph-mon1: 2017-07-11 14:19:10.455300 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:10.455523 I | rook-ceph-mon1: 2017-07-11 14:19:10.455445 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/616501674' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:15.442370 I | rook-ceph-mon1: 2017-07-11 14:19:15.442343 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:15.442456 I | rook-ceph-mon1: 2017-07-11 14:19:15.442443 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/94590645' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:26.838833 I | rook-ceph-mon1: 2017-07-11 14:19:26.838799 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:26.839013 I | rook-ceph-mon1: 2017-07-11 14:19:26.838933 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4079514206' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:27.741423 I | rook-ceph-mon1: 2017-07-11 14:19:27.741387 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:19:27.741657 I | rook-ceph-mon1: 2017-07-11 14:19:27.741639 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4032367684' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:19:30.487151 I | rook-ceph-mon1: 2017-07-11 14:19:30.486978 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:19:30.488294 I | rook-ceph-mon1: 2017-07-11 14:19:30.486996 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1137635504' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:19:36.675243 I | rook-ceph-mon1: 2017-07-11 14:19:35.543148 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 675 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.156382s > max 0.05s
- 2017-07-11 14:19:36.681539 I | rook-ceph-mon1: 2017-07-11 14:19:35.551965 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 676 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0675102s > max 0.05s
- 2017-07-11 14:19:41.739226 I | rook-ceph-mon1: 2017-07-11 14:19:41.739069 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:19:41.739299 I | rook-ceph-mon1: 2017-07-11 14:19:41.739089 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1739499139' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:19:50.557430 I | rook-ceph-mon1: 2017-07-11 14:19:50.557402 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:50.557519 I | rook-ceph-mon1: 2017-07-11 14:19:50.557506 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1841008556' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:52.800689 I | rook-ceph-mon1: 2017-07-11 14:19:52.800638 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:19:52.800908 I | rook-ceph-mon1: 2017-07-11 14:19:52.800878 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/282152332' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:19:54.590079 I | rook-ceph-mon1: 2017-07-11 14:19:54.587812 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4748 MB, avail 94439 MB
- 2017-07-11 14:20:03.234260 I | rook-ceph-mon1: 2017-07-11 14:20:03.234130 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #57. Immutable memtables: 0.
- 2017-07-11 14:20:03.234327 I | rook-ceph-mon1:
- 2017-07-11 14:20:03.234345 I | rook-ceph-mon1: 2017-07-11 14:20:03.234192 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 35] Syncing log #54
- 2017-07-11 14:20:03.272809 I | rook-ceph-mon1: 2017-07-11 14:20:03.263195 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.234168) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:20:03.272855 I | rook-ceph-mon1: 2017-07-11 14:20:03.263202 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 35] Flushing memtable with next log file: 57
- 2017-07-11 14:20:03.272870 I | rook-ceph-mon1:
- 2017-07-11 14:20:03.272881 I | rook-ceph-mon1: 2017-07-11 14:20:03.263210 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803263206, "job": 35, "event": "flush_started", "num_memtables": 1, "num_entries": 2313, "num_deletes": 251, "memory_usage": 7640616}
- 2017-07-11 14:20:03.272891 I | rook-ceph-mon1: 2017-07-11 14:20:03.263220 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 35] Level-0 flush table #58: started
- 2017-07-11 14:20:03.418117 I | rook-ceph-mon1: 2017-07-11 14:20:03.418080 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803418073, "cf_name": "default", "job": 35, "event": "table_file_creation", "file_number": 58, "file_size": 5047328, "table_properties": {"data_size": 5030022, "index_size": 16486, "filter_size": 0, "raw_key_size": 16822, "raw_average_key_size": 18, "raw_value_size": 5006021, "raw_average_value_size": 5489, "num_data_blocks": 521, "num_entries": 912, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:20:03.418202 I | rook-ceph-mon1: 2017-07-11 14:20:03.418187 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 35] Level-0 flush table #58: 5047328 bytes OK
- 2017-07-11 14:20:03.525076 I | rook-ceph-mon1: 2017-07-11 14:20:03.525028 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.498640) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #58 started
- 2017-07-11 14:20:03.527768 I | rook-ceph-mon1: 2017-07-11 14:20:03.527749 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.524971) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #58: memtable #1 done
- 2017-07-11 14:20:03.527898 I | rook-ceph-mon1: 2017-07-11 14:20:03.527847 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.524992) EVENT_LOG_v1 {"time_micros": 1499782803524985, "job": 35, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:20:03.527937 I | rook-ceph-mon1: 2017-07-11 14:20:03.527922 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.525013) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:20:03.527968 I | rook-ceph-mon1:
- 2017-07-11 14:20:03.528007 I | rook-ceph-mon1: 2017-07-11 14:20:03.527985 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 35] Try to delete WAL files size 7587772, prev total WAL file size 7587772, number of live WAL files 2.
- 2017-07-11 14:20:03.528031 I | rook-ceph-mon1:
- 2017-07-11 14:20:03.544481 I | rook-ceph-mon1: 2017-07-11 14:20:03.528983 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:20:03.544628 I | rook-ceph-mon1: 2017-07-11 14:20:03.544561 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.544555) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:20:03.544648 I | rook-ceph-mon1:
- 2017-07-11 14:20:03.544673 I | rook-ceph-mon1: 2017-07-11 14:20:03.544568 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 36] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:20:03.544685 I | rook-ceph-mon1: 2017-07-11 14:20:03.544572 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 35 Base level 0, inputs: [58(4929KB)], [56(13MB)]
- 2017-07-11 14:20:03.544695 I | rook-ceph-mon1:
- 2017-07-11 14:20:03.544758 I | rook-ceph-mon1: 2017-07-11 14:20:03.544713 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803544574, "job": 36, "event": "compaction_started", "files_L0": [58], "files_L1": [56], "score": -1, "input_data_size": 19203216}
- 2017-07-11 14:20:03.793005 I | rook-ceph-mon1: 2017-07-11 14:20:03.792979 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 36] Generated table #59: 2449 keys, 17169871 bytes
- 2017-07-11 14:20:03.793087 I | rook-ceph-mon1: 2017-07-11 14:20:03.793072 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803793065, "cf_name": "default", "job": 36, "event": "table_file_creation", "file_number": 59, "file_size": 17169871, "table_properties": {"data_size": 17116098, "index_size": 52954, "filter_size": 0, "raw_key_size": 45686, "raw_average_key_size": 18, "raw_value_size": 17045211, "raw_average_value_size": 6960, "num_data_blocks": 1631, "num_entries": 2449, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:20:03.815472 I | rook-ceph-mon1: 2017-07-11 14:20:03.815454 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:20:03.815542 I | rook-ceph-mon1: 2017-07-11 14:20:03.815529 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2406461278' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:20:03.863075 I | rook-ceph-mon1: 2017-07-11 14:20:03.863004 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 36] Compacted 1@0 + 1@1 files to L1 => 17169871 bytes
- 2017-07-11 14:20:03.910798 I | rook-ceph-mon1: 2017-07-11 14:20:03.908884 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.908823) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 60.3 rd, 53.9 wr, level 1, files in(1, 1) out(1) MB in(4.8, 13.5) out(16.4), read-write-amplify(7.2) write-amplify(3.4) OK, records in: 2958, records dropped: 509
- 2017-07-11 14:20:03.910837 I | rook-ceph-mon1:
- 2017-07-11 14:20:03.910853 I | rook-ceph-mon1: 2017-07-11 14:20:03.908889 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.908838) EVENT_LOG_v1 {"time_micros": 1499782803908831, "job": 36, "event": "compaction_finished", "compaction_time_micros": 318276, "output_level": 1, "num_output_files": 1, "total_output_size": 17169871, "num_input_records": 2958, "num_output_records": 2449, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:20:03.910866 I | rook-ceph-mon1: 2017-07-11 14:20:03.909445 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803909442, "job": 36, "event": "table_file_deletion", "file_number": 58}
- 2017-07-11 14:20:03.910877 I | rook-ceph-mon1: 2017-07-11 14:20:03.910762 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803910760, "job": 36, "event": "table_file_deletion", "file_number": 56}
- 2017-07-11 14:20:14.908390 I | rook-ceph-mon1: 2017-07-11 14:20:14.908283 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:20:14.908443 I | rook-ceph-mon1: 2017-07-11 14:20:14.908300 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/659224529' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:20:27.693914 I | rook-ceph-mon1: 2017-07-11 14:20:27.693866 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:20:27.694153 I | rook-ceph-mon1: 2017-07-11 14:20:27.694136 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1865686563' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:20:38.713752 I | rook-ceph-mon1: 2017-07-11 14:20:38.713722 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:20:38.713847 I | rook-ceph-mon1: 2017-07-11 14:20:38.713833 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3945445681' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:20:40.113771 I | rook-ceph-mon1: 2017-07-11 14:20:40.113740 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:20:40.113871 I | rook-ceph-mon1: 2017-07-11 14:20:40.113856 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2704635985' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:20:51.119919 I | rook-ceph-mon1: 2017-07-11 14:20:51.119887 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:20:51.120018 I | rook-ceph-mon1: 2017-07-11 14:20:51.120004 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2545944948' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:20:54.590011 I | rook-ceph-mon1: 2017-07-11 14:20:54.589461 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4751 MB, avail 94436 MB
- 2017-07-11 14:20:59.806580 I | rook-ceph-mon1: 2017-07-11 14:20:59.806538 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:20:59.806682 I | rook-ceph-mon1: 2017-07-11 14:20:59.806668 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4272722966' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:21:02.214042 I | rook-ceph-mon1: 2017-07-11 14:21:02.214017 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:21:02.214129 I | rook-ceph-mon1: 2017-07-11 14:21:02.214115 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/394296290' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:21:08.272068 I | rook-ceph-mon1: 2017-07-11 14:21:08.272001 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #60. Immutable memtables: 0.
- 2017-07-11 14:21:08.272125 I | rook-ceph-mon1:
- 2017-07-11 14:21:08.272159 I | rook-ceph-mon1: 2017-07-11 14:21:08.272035 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 37] Syncing log #57
- 2017-07-11 14:21:08.375973 I | rook-ceph-mon1: 2017-07-11 14:21:08.360180 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.272029) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:21:08.376011 I | rook-ceph-mon1: 2017-07-11 14:21:08.360187 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 37] Flushing memtable with next log file: 60
- 2017-07-11 14:21:08.376067 I | rook-ceph-mon1:
- 2017-07-11 14:21:08.376093 I | rook-ceph-mon1: 2017-07-11 14:21:08.360195 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868360192, "job": 37, "event": "flush_started", "num_memtables": 1, "num_entries": 937, "num_deletes": 500, "memory_usage": 1540976}
- 2017-07-11 14:21:08.376106 I | rook-ceph-mon1: 2017-07-11 14:21:08.360197 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 37] Level-0 flush table #61: started
- 2017-07-11 14:21:08.503292 I | rook-ceph-mon1: 2017-07-11 14:21:08.503261 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868503254, "cf_name": "default", "job": 37, "event": "table_file_creation", "file_number": 61, "file_size": 1008999, "table_properties": {"data_size": 1004597, "index_size": 3588, "filter_size": 0, "raw_key_size": 11717, "raw_average_key_size": 18, "raw_value_size": 993652, "raw_average_value_size": 1550, "num_data_blocks": 116, "num_entries": 641, "filter_policy_name": "", "kDeletedKeys": "500", "kMergeOperands": "0"}}
- 2017-07-11 14:21:08.504661 I | rook-ceph-mon1: 2017-07-11 14:21:08.504644 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 37] Level-0 flush table #61: 1008999 bytes OK
- 2017-07-11 14:21:08.561694 I | rook-ceph-mon1: 2017-07-11 14:21:08.561647 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.533055) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #61 started
- 2017-07-11 14:21:08.564631 I | rook-ceph-mon1: 2017-07-11 14:21:08.564616 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.561591) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #61: memtable #1 done
- 2017-07-11 14:21:08.564672 I | rook-ceph-mon1: 2017-07-11 14:21:08.564660 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.561611) EVENT_LOG_v1 {"time_micros": 1499782868561604, "job": 37, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:21:08.564712 I | rook-ceph-mon1: 2017-07-11 14:21:08.564700 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.561633) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:21:08.564725 I | rook-ceph-mon1:
- 2017-07-11 14:21:08.564750 I | rook-ceph-mon1: 2017-07-11 14:21:08.564739 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 37] Try to delete WAL files size 1519643, prev total WAL file size 1526344, number of live WAL files 2.
- 2017-07-11 14:21:08.564773 I | rook-ceph-mon1:
- 2017-07-11 14:21:08.581027 I | rook-ceph-mon1: 2017-07-11 14:21:08.565153 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:21:08.581076 I | rook-ceph-mon1: 2017-07-11 14:21:08.565187 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.565182) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:21:08.581092 I | rook-ceph-mon1:
- 2017-07-11 14:21:08.581103 I | rook-ceph-mon1: 2017-07-11 14:21:08.565192 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 38] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:21:08.581113 I | rook-ceph-mon1: 2017-07-11 14:21:08.565196 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 37 Base level 0, inputs: [61(985KB)], [59(16MB)]
- 2017-07-11 14:21:08.581136 I | rook-ceph-mon1:
- 2017-07-11 14:21:08.581148 I | rook-ceph-mon1: 2017-07-11 14:21:08.565206 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868565198, "job": 38, "event": "compaction_started", "files_L0": [61], "files_L1": [59], "score": -1, "input_data_size": 18178870}
- 2017-07-11 14:21:08.772877 I | rook-ceph-mon1: 2017-07-11 14:21:08.772839 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 38] Generated table #62: 2083 keys, 13680688 bytes
- 2017-07-11 14:21:08.772931 I | rook-ceph-mon1: 2017-07-11 14:21:08.772915 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868772907, "cf_name": "default", "job": 38, "event": "table_file_creation", "file_number": 62, "file_size": 13680688, "table_properties": {"data_size": 13633500, "index_size": 46369, "filter_size": 0, "raw_key_size": 39151, "raw_average_key_size": 18, "raw_value_size": 13571975, "raw_average_value_size": 6515, "num_data_blocks": 1435, "num_entries": 2083, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:21:08.808139 I | rook-ceph-mon1: 2017-07-11 14:21:08.808112 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 38] Compacted 1@0 + 1@1 files to L1 => 13680688 bytes
- 2017-07-11 14:21:08.886556 I | rook-ceph-mon1: 2017-07-11 14:21:08.886534 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.886474) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 74.8 rd, 56.3 wr, level 1, files in(1, 1) out(1) MB in(1.0, 16.4) out(13.0), read-write-amplify(31.6) write-amplify(13.6) OK, records in: 3090, records dropped: 1007
- 2017-07-11 14:21:08.886776 I | rook-ceph-mon1:
- 2017-07-11 14:21:08.886837 I | rook-ceph-mon1: 2017-07-11 14:21:08.886802 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.886491) EVENT_LOG_v1 {"time_micros": 1499782868886484, "job": 38, "event": "compaction_finished", "compaction_time_micros": 242893, "output_level": 1, "num_output_files": 1, "total_output_size": 13680688, "num_input_records": 3090, "num_output_records": 2083, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:21:08.888367 I | rook-ceph-mon1: 2017-07-11 14:21:08.888352 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868888348, "job": 38, "event": "table_file_deletion", "file_number": 61}
- 2017-07-11 14:21:08.905614 I | rook-ceph-mon1: 2017-07-11 14:21:08.905598 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868905596, "job": 38, "event": "table_file_deletion", "file_number": 59}
- 2017-07-11 14:21:08.905920 I | rook-ceph-mon1: 2017-07-11 14:21:08.905844 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #63. Immutable memtables: 0.
- 2017-07-11 14:21:08.905955 I | rook-ceph-mon1:
- 2017-07-11 14:21:08.905968 I | rook-ceph-mon1: 2017-07-11 14:21:08.905881 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 39] Syncing log #60
- 2017-07-11 14:21:08.954237 I | rook-ceph-mon1: 2017-07-11 14:21:08.953985 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.905875) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:21:08.955184 I | rook-ceph-mon1: 2017-07-11 14:21:08.953992 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 39] Flushing memtable with next log file: 63
- 2017-07-11 14:21:08.955216 I | rook-ceph-mon1:
- 2017-07-11 14:21:08.955229 I | rook-ceph-mon1: 2017-07-11 14:21:08.954000 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868953997, "job": 39, "event": "flush_started", "num_memtables": 1, "num_entries": 7, "num_deletes": 0, "memory_usage": 22168}
- 2017-07-11 14:21:08.955239 I | rook-ceph-mon1: 2017-07-11 14:21:08.954002 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 39] Level-0 flush table #64: started
- 2017-07-11 14:21:09.112702 I | rook-ceph-mon1: 2017-07-11 14:21:09.112629 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782869112599, "cf_name": "default", "job": 39, "event": "table_file_creation", "file_number": 64, "file_size": 14235, "table_properties": {"data_size": 13346, "index_size": 81, "filter_size": 0, "raw_key_size": 143, "raw_average_key_size": 23, "raw_value_size": 13164, "raw_average_value_size": 2194, "num_data_blocks": 3, "num_entries": 6, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:21:09.112767 I | rook-ceph-mon1: 2017-07-11 14:21:09.112638 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 39] Level-0 flush table #64: 14235 bytes OK
- 2017-07-11 14:21:09.267142 I | rook-ceph-mon1: 2017-07-11 14:21:09.267033 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:21:09.178159) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #64 started
- 2017-07-11 14:21:09.267225 I | rook-ceph-mon1: 2017-07-11 14:21:09.267040 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:21:09.267000) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #64: memtable #1 done
- 2017-07-11 14:21:09.267256 I | rook-ceph-mon1: 2017-07-11 14:21:09.267041 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:21:09.267011) EVENT_LOG_v1 {"time_micros": 1499782869267007, "job": 39, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:21:09.267270 I | rook-ceph-mon1: 2017-07-11 14:21:09.267043 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:21:09.267024) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:21:09.267282 I | rook-ceph-mon1:
- 2017-07-11 14:21:09.267292 I | rook-ceph-mon1: 2017-07-11 14:21:09.267047 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 39] Try to delete WAL files size 19939, prev total WAL file size 19939, number of live WAL files 2.
- 2017-07-11 14:21:09.267301 I | rook-ceph-mon1:
- 2017-07-11 14:21:09.267312 I | rook-ceph-mon1: 2017-07-11 14:21:09.267209 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:21:11.084477 I | rook-ceph-mon1: 2017-07-11 14:21:11.084446 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:21:11.084578 I | rook-ceph-mon1: 2017-07-11 14:21:11.084564 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1430493609' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:21:13.475942 I | rook-ceph-mon1: 2017-07-11 14:21:13.475912 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:21:13.476102 I | rook-ceph-mon1: 2017-07-11 14:21:13.476085 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1151813744' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:21:33.231772 I | rook-ceph-mon1: 2017-07-11 14:21:33.231749 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:21:33.233686 I | rook-ceph-mon1: 2017-07-11 14:21:33.233671 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3707160129' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:21:35.884883 I | rook-ceph-mon1: 2017-07-11 14:21:35.884852 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:21:35.885062 I | rook-ceph-mon1: 2017-07-11 14:21:35.884992 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1845523813' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:21:54.592043 I | rook-ceph-mon1: 2017-07-11 14:21:54.591836 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4747 MB, avail 94439 MB
- 2017-07-11 14:21:55.574837 I | rook-ceph-mon1: 2017-07-11 14:21:55.574805 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:21:55.575023 I | rook-ceph-mon1: 2017-07-11 14:21:55.574938 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3636871410' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:22:11.628564 I | rook-ceph-mon1: 2017-07-11 14:22:11.628526 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:11.628753 I | rook-ceph-mon1: 2017-07-11 14:22:11.628663 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1169775318' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:27.987223 I | rook-ceph-mon1: 2017-07-11 14:22:27.987188 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:27.987404 I | rook-ceph-mon1: 2017-07-11 14:22:27.987321 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3378179413' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:28.590722 I | rook-ceph-mon1: 2017-07-11 14:22:28.590691 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:22:28.598492 I | rook-ceph-mon1: 2017-07-11 14:22:28.598474 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2144655479' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:22:31.009710 I | rook-ceph-mon1: 2017-07-11 14:22:31.009680 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:22:31.009808 I | rook-ceph-mon1: 2017-07-11 14:22:31.009793 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/217248001' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:22:50.556989 I | rook-ceph-mon1: 2017-07-11 14:22:50.556960 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:22:50.557085 I | rook-ceph-mon1: 2017-07-11 14:22:50.557072 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1483851435' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:22:54.615686 I | rook-ceph-mon1: 2017-07-11 14:22:54.595990 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4747 MB, avail 94439 MB
- 2017-07-11 14:23:01.594608 I | rook-ceph-mon1: 2017-07-11 14:23:01.594570 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:01.595017 I | rook-ceph-mon1: 2017-07-11 14:23:01.595000 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1344184963' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:01.776664 I | rook-ceph-mon1: 2017-07-11 14:23:01.776644 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:23:01.776737 I | rook-ceph-mon1: 2017-07-11 14:23:01.776723 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2858343333' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:23:04.339406 I | rook-ceph-mon1: 2017-07-11 14:23:04.339374 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:23:04.339512 I | rook-ceph-mon1: 2017-07-11 14:23:04.339498 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/254456236' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:23:07.869733 I | rook-ceph-mon1: 2017-07-11 14:23:07.869703 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:23:07.871497 I | rook-ceph-mon1: 2017-07-11 14:23:07.871480 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/544107555' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:23:12.880852 I | rook-ceph-mon1: 2017-07-11 14:23:12.880824 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:23:12.881007 I | rook-ceph-mon1: 2017-07-11 14:23:12.880938 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3078294819' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:23:23.885263 I | rook-ceph-mon1: 2017-07-11 14:23:23.884994 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:23:23.885645 I | rook-ceph-mon1: 2017-07-11 14:23:23.885014 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3610209460' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:23:27.786020 I | rook-ceph-mon1: 2017-07-11 14:23:27.785872 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:23:27.786185 I | rook-ceph-mon1: 2017-07-11 14:23:27.785894 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/352265633' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:23:28.419874 I | rook-ceph-mon1: 2017-07-11 14:23:28.418274 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #65. Immutable memtables: 0.
- 2017-07-11 14:23:28.419933 I | rook-ceph-mon1:
- 2017-07-11 14:23:28.419959 I | rook-ceph-mon1: 2017-07-11 14:23:28.418300 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 40] Syncing log #63
- 2017-07-11 14:23:28.476573 I | rook-ceph-mon1: 2017-07-11 14:23:28.457099 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.418295) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:23:28.476612 I | rook-ceph-mon1: 2017-07-11 14:23:28.457115 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 40] Flushing memtable with next log file: 65
- 2017-07-11 14:23:28.476626 I | rook-ceph-mon1:
- 2017-07-11 14:23:28.476638 I | rook-ceph-mon1: 2017-07-11 14:23:28.457132 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008457125, "job": 40, "event": "flush_started", "num_memtables": 1, "num_entries": 1586, "num_deletes": 251, "memory_usage": 4924184}
- 2017-07-11 14:23:28.476648 I | rook-ceph-mon1: 2017-07-11 14:23:28.457136 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 40] Level-0 flush table #66: started
- 2017-07-11 14:23:29.070768 I | rook-ceph-mon1: 2017-07-11 14:23:29.070730 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783009070720, "cf_name": "default", "job": 40, "event": "table_file_creation", "file_number": 66, "file_size": 2832397, "table_properties": {"data_size": 2822942, "index_size": 8637, "filter_size": 0, "raw_key_size": 11757, "raw_average_key_size": 19, "raw_value_size": 2808467, "raw_average_value_size": 4559, "num_data_blocks": 278, "num_entries": 616, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:23:29.073195 I | rook-ceph-mon1: 2017-07-11 14:23:29.073178 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 40] Level-0 flush table #66: 2832397 bytes OK
- 2017-07-11 14:23:29.168165 I | rook-ceph-mon1: 2017-07-11 14:23:29.168130 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.109490) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #66 started
- 2017-07-11 14:23:29.169188 I | rook-ceph-mon1: 2017-07-11 14:23:29.169172 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.168085) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #66: memtable #1 done
- 2017-07-11 14:23:29.169230 I | rook-ceph-mon1: 2017-07-11 14:23:29.169216 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.168102) EVENT_LOG_v1 {"time_micros": 1499783009168097, "job": 40, "event": "flush_finished", "lsm_state": [2, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:23:29.169295 I | rook-ceph-mon1: 2017-07-11 14:23:29.169280 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.168117) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[2 1 0 0 0 0 0] max score 0.50
- 2017-07-11 14:23:29.169309 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.169352 I | rook-ceph-mon1: 2017-07-11 14:23:29.169341 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 40] Try to delete WAL files size 4882084, prev total WAL file size 4882084, number of live WAL files 2.
- 2017-07-11 14:23:29.169364 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.187641 I | rook-ceph-mon1: 2017-07-11 14:23:29.170116 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:23:29.187725 I | rook-ceph-mon1: 2017-07-11 14:23:29.170258 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:23:29.187759 I | rook-ceph-mon1: 2017-07-11 14:23:29.170261 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:23:29.187774 I | rook-ceph-mon1: ** DB Stats **
- 2017-07-11 14:23:29.187786 I | rook-ceph-mon1: Uptime(secs): 3575.5 total, 711.8 interval
- 2017-07-11 14:23:29.187797 I | rook-ceph-mon1: Cumulative writes: 5598 writes, 25K keys, 5598 commit groups, 1.0 writes per commit group, ingest: 0.07 GB, 0.02 MB/s
- 2017-07-11 14:23:29.187807 I | rook-ceph-mon1: Cumulative WAL: 5598 writes, 5598 syncs, 1.00 writes per sync, written: 0.07 GB, 0.02 MB/s
- 2017-07-11 14:23:29.187819 I | rook-ceph-mon1: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:23:29.187844 I | rook-ceph-mon1: Interval writes: 1446 writes, 7291 keys, 1446 commit groups, 1.0 writes per commit group, ingest: 19.53 MB, 0.03 MB/s
- 2017-07-11 14:23:29.187854 I | rook-ceph-mon1: Interval WAL: 1446 writes, 1446 syncs, 1.00 writes per sync, written: 0.02 MB, 0.03 MB/s
- 2017-07-11 14:23:29.187865 I | rook-ceph-mon1: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:23:29.187875 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.187885 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 14:23:29.187908 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:23:29.187920 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:23:29.187941 I | rook-ceph-mon1: L0 2/2 2.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 10.0 4 21 0.202 0 0
- 2017-07-11 14:23:29.187951 I | rook-ceph-mon1: L1 1/1 13.05 MB 0.0 0.2 0.0 0.2 0.2 0.0 0.0 5.4 28.3 25.2 9 18 0.478 38K 7352
- 2017-07-11 14:23:29.187961 I | rook-ceph-mon1: Sum 3/3 15.76 MB 0.0 0.2 0.0 0.2 0.3 0.1 0.0 6.1 19.0 20.2 13 39 0.329 38K 7352
- 2017-07-11 14:23:29.187982 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 6.8 27.2 27.6 3 11 0.267 13K 2949
- 2017-07-11 14:23:29.187994 I | rook-ceph-mon1: Uptime(secs): 3575.5 total, 3575.5 interval
- 2017-07-11 14:23:29.188004 I | rook-ceph-mon1: Flush(GB): cumulative 0.042, interval 0.012
- 2017-07-11 14:23:29.188013 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:23:29.188023 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:23:29.188033 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:23:29.188042 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:23:29.188065 I | rook-ceph-mon1: Cumulative compaction: 0.25 GB write, 0.07 MB/s write, 0.24 GB read, 0.07 MB/s read, 12.8 seconds
- 2017-07-11 14:23:29.188076 I | rook-ceph-mon1: Interval compaction: 0.08 GB write, 0.02 MB/s write, 0.08 GB read, 0.02 MB/s read, 2.9 seconds
- 2017-07-11 14:23:29.188086 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:23:29.188098 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.188136 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:23:29.188171 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.188182 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 14:23:29.188193 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:23:29.188215 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:23:29.188227 I | rook-ceph-mon1: L0 2/2 2.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 10.0 4 21 0.202 0 0
- 2017-07-11 14:23:29.188252 I | rook-ceph-mon1: L1 1/1 13.05 MB 0.0 0.2 0.0 0.2 0.2 0.0 0.0 5.4 28.3 25.2 9 18 0.478 38K 7352
- 2017-07-11 14:23:29.188265 I | rook-ceph-mon1: Sum 3/3 15.76 MB 0.0 0.2 0.0 0.2 0.3 0.1 0.0 6.1 19.0 20.2 13 39 0.329 38K 7352
- 2017-07-11 14:23:29.188288 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:23:29.188300 I | rook-ceph-mon1: Uptime(secs): 3575.5 total, 3575.5 interval
- 2017-07-11 14:23:29.188311 I | rook-ceph-mon1: Flush(GB): cumulative 0.042, interval 0.000
- 2017-07-11 14:23:29.188672 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:23:29.188688 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:23:29.188709 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:23:29.188718 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:23:29.188728 I | rook-ceph-mon1: Cumulative compaction: 0.25 GB write, 0.07 MB/s write, 0.24 GB read, 0.07 MB/s read, 12.8 seconds
- 2017-07-11 14:23:29.188751 I | rook-ceph-mon1: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:23:29.188774 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:23:29.188785 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.188795 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:23:29.188806 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.189284 I | rook-ceph-mon1: 2017-07-11 14:23:29.170276 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.170271) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:23:29.189300 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.189340 I | rook-ceph-mon1: 2017-07-11 14:23:29.170279 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 41] Compacting 2@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:23:29.189355 I | rook-ceph-mon1: 2017-07-11 14:23:29.170282 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 40 Base level 0, inputs: [66(2766KB) 64(13KB)], [62(13MB)]
- 2017-07-11 14:23:29.189366 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.189377 I | rook-ceph-mon1: 2017-07-11 14:23:29.170292 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783009170284, "job": 41, "event": "compaction_started", "files_L0": [66, 64], "files_L1": [62], "score": -1, "input_data_size": 16527320}
- 2017-07-11 14:23:29.403874 I | rook-ceph-mon1: 2017-07-11 14:23:29.403838 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 41] Generated table #67: 2255 keys, 15285188 bytes
- 2017-07-11 14:23:29.405206 I | rook-ceph-mon1: 2017-07-11 14:23:29.405188 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783009405180, "cf_name": "default", "job": 41, "event": "table_file_creation", "file_number": 67, "file_size": 15285188, "table_properties": {"data_size": 15235304, "index_size": 49065, "filter_size": 0, "raw_key_size": 41979, "raw_average_key_size": 18, "raw_value_size": 15169638, "raw_average_value_size": 6727, "num_data_blocks": 1526, "num_entries": 2255, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:23:29.470329 I | rook-ceph-mon1: 2017-07-11 14:23:29.470298 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 41] Compacted 2@0 + 1@1 files to L1 => 15285188 bytes
- 2017-07-11 14:23:29.509110 I | rook-ceph-mon1: 2017-07-11 14:23:29.508663 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.508592) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 55.1 rd, 51.0 wr, level 1, files in(2, 1) out(1) MB in(2.7, 13.0) out(14.6), read-write-amplify(11.2) write-amplify(5.4) OK, records in: 2705, records dropped: 450
- 2017-07-11 14:23:29.509153 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.509203 I | rook-ceph-mon1: 2017-07-11 14:23:29.509188 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.508606) EVENT_LOG_v1 {"time_micros": 1499783009508600, "job": 41, "event": "compaction_finished", "compaction_time_micros": 299995, "output_level": 1, "num_output_files": 1, "total_output_size": 15285188, "num_input_records": 2705, "num_output_records": 2255, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:23:29.510227 I | rook-ceph-mon1: 2017-07-11 14:23:29.510213 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783009510211, "job": 41, "event": "table_file_deletion", "file_number": 66}
- 2017-07-11 14:23:29.512338 I | rook-ceph-mon1: 2017-07-11 14:23:29.512326 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783009512325, "job": 41, "event": "table_file_deletion", "file_number": 64}
- 2017-07-11 14:23:29.529375 I | rook-ceph-mon1: 2017-07-11 14:23:29.529359 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783009529357, "job": 41, "event": "table_file_deletion", "file_number": 62}
- 2017-07-11 14:23:29.538276 I | rook-ceph-mon1: 2017-07-11 14:23:29.538218 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #68. Immutable memtables: 0.
- 2017-07-11 14:23:29.538315 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.538330 I | rook-ceph-mon1: 2017-07-11 14:23:29.538240 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 42] Syncing log #65
- 2017-07-11 14:23:29.567831 I | rook-ceph-mon1: 2017-07-11 14:23:29.567622 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.538236) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:23:29.568183 I | rook-ceph-mon1: 2017-07-11 14:23:29.567630 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 42] Flushing memtable with next log file: 68
- 2017-07-11 14:23:29.568649 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.568679 I | rook-ceph-mon1: 2017-07-11 14:23:29.567637 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783009567634, "job": 42, "event": "flush_started", "num_memtables": 1, "num_entries": 7, "num_deletes": 0, "memory_usage": 22184}
- 2017-07-11 14:23:29.568701 I | rook-ceph-mon1: 2017-07-11 14:23:29.567639 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 42] Level-0 flush table #69: started
- 2017-07-11 14:23:29.616146 I | rook-ceph-mon1: 2017-07-11 14:23:29.616095 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783009616086, "cf_name": "default", "job": 42, "event": "table_file_creation", "file_number": 69, "file_size": 14235, "table_properties": {"data_size": 13346, "index_size": 81, "filter_size": 0, "raw_key_size": 143, "raw_average_key_size": 23, "raw_value_size": 13164, "raw_average_value_size": 2194, "num_data_blocks": 3, "num_entries": 6, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:23:29.616186 I | rook-ceph-mon1: 2017-07-11 14:23:29.616102 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 42] Level-0 flush table #69: 14235 bytes OK
- 2017-07-11 14:23:29.718313 I | rook-ceph-mon1: 2017-07-11 14:23:29.711291 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.659571) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #69 started
- 2017-07-11 14:23:29.718353 I | rook-ceph-mon1: 2017-07-11 14:23:29.711297 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.709117) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #69: memtable #1 done
- 2017-07-11 14:23:29.718368 I | rook-ceph-mon1: 2017-07-11 14:23:29.711299 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.709126) EVENT_LOG_v1 {"time_micros": 1499783009709123, "job": 42, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:23:29.718379 I | rook-ceph-mon1: 2017-07-11 14:23:29.711300 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.711283) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:23:29.718536 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.718576 I | rook-ceph-mon1: 2017-07-11 14:23:29.711303 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 42] Try to delete WAL files size 19939, prev total WAL file size 19939, number of live WAL files 2.
- 2017-07-11 14:23:29.718588 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.718642 I | rook-ceph-mon1: 2017-07-11 14:23:29.718617 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:23:29.718695 I | rook-ceph-mon1: 2017-07-11 14:23:29.718668 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.718664) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:23:29.718708 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.718733 I | rook-ceph-mon1: 2017-07-11 14:23:29.718720 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 43] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:23:29.718769 I | rook-ceph-mon1: 2017-07-11 14:23:29.718748 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 42 Base level 0, inputs: [69(13KB)], [67(14MB)]
- 2017-07-11 14:23:29.718781 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.718811 I | rook-ceph-mon1: 2017-07-11 14:23:29.718801 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783009718794, "job": 43, "event": "compaction_started", "files_L0": [69], "files_L1": [67], "score": -1, "input_data_size": 15299423}
- 2017-07-11 14:23:29.890914 I | rook-ceph-mon1: 2017-07-11 14:23:29.890870 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 43] Generated table #70: 2257 keys, 15298456 bytes
- 2017-07-11 14:23:29.893058 I | rook-ceph-mon1: 2017-07-11 14:23:29.893042 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783009893033, "cf_name": "default", "job": 43, "event": "table_file_creation", "file_number": 70, "file_size": 15298456, "table_properties": {"data_size": 15248508, "index_size": 49129, "filter_size": 0, "raw_key_size": 42017, "raw_average_key_size": 18, "raw_value_size": 15182770, "raw_average_value_size": 6726, "num_data_blocks": 1528, "num_entries": 2257, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:23:29.939264 I | rook-ceph-mon1: 2017-07-11 14:23:29.939243 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 43] Compacted 1@0 + 1@1 files to L1 => 15298456 bytes
- 2017-07-11 14:23:29.997373 I | rook-ceph-mon1: 2017-07-11 14:23:29.997309 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.997085) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 69.4 rd, 69.4 wr, level 1, files in(1, 1) out(1) MB in(0.0, 14.6) out(14.6), read-write-amplify(2149.5) write-amplify(1074.7) OK, records in: 2261, records dropped: 4
- 2017-07-11 14:23:29.997414 I | rook-ceph-mon1:
- 2017-07-11 14:23:29.997447 I | rook-ceph-mon1: 2017-07-11 14:23:29.997430 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:23:29.997266) EVENT_LOG_v1 {"time_micros": 1499783009997106, "job": 43, "event": "compaction_finished", "compaction_time_micros": 220409, "output_level": 1, "num_output_files": 1, "total_output_size": 15298456, "num_input_records": 2261, "num_output_records": 2257, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:23:29.997594 I | rook-ceph-mon1: 2017-07-11 14:23:29.997540 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783009997538, "job": 43, "event": "table_file_deletion", "file_number": 69}
- 2017-07-11 14:23:29.999241 I | rook-ceph-mon1: 2017-07-11 14:23:29.999227 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783009999225, "job": 43, "event": "table_file_deletion", "file_number": 67}
- 2017-07-11 14:23:34.881131 I | rook-ceph-mon1: 2017-07-11 14:23:34.881096 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:23:34.881224 I | rook-ceph-mon1: 2017-07-11 14:23:34.881210 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/978076909' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:23:52.953416 I | rook-ceph-mon1: 2017-07-11 14:23:52.953187 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:23:52.953480 I | rook-ceph-mon1: 2017-07-11 14:23:52.953204 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4221405865' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:23:54.602218 I | rook-ceph-mon1: 2017-07-11 14:23:54.601943 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4749 MB, avail 94437 MB
- 2017-07-11 14:24:00.278848 I | rook-ceph-mon1: 2017-07-11 14:24:00.277602 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #71. Immutable memtables: 0.
- 2017-07-11 14:24:00.279546 I | rook-ceph-mon1:
- 2017-07-11 14:24:00.279578 I | rook-ceph-mon1: 2017-07-11 14:24:00.277651 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 44] Syncing log #68
- 2017-07-11 14:24:00.334326 I | rook-ceph-mon1: 2017-07-11 14:24:00.318232 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.277635) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:24:00.334586 I | rook-ceph-mon1: 2017-07-11 14:24:00.318241 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 44] Flushing memtable with next log file: 71
- 2017-07-11 14:24:00.334616 I | rook-ceph-mon1:
- 2017-07-11 14:24:00.334683 I | rook-ceph-mon1: 2017-07-11 14:24:00.318252 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040318248, "job": 44, "event": "flush_started", "num_memtables": 1, "num_entries": 483, "num_deletes": 251, "memory_usage": 842720}
- 2017-07-11 14:24:00.334697 I | rook-ceph-mon1: 2017-07-11 14:24:00.318254 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 44] Level-0 flush table #72: started
- 2017-07-11 14:24:00.481920 I | rook-ceph-mon1: 2017-07-11 14:24:00.481882 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040481874, "cf_name": "default", "job": 44, "event": "table_file_creation", "file_number": 72, "file_size": 552108, "table_properties": {"data_size": 549440, "index_size": 1854, "filter_size": 0, "raw_key_size": 6043, "raw_average_key_size": 18, "raw_value_size": 543713, "raw_average_value_size": 1647, "num_data_blocks": 60, "num_entries": 330, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:24:00.488209 I | rook-ceph-mon1: 2017-07-11 14:24:00.488189 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 44] Level-0 flush table #72: 552108 bytes OK
- 2017-07-11 14:24:00.547231 I | rook-ceph-mon1: 2017-07-11 14:24:00.547182 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.517590) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #72 started
- 2017-07-11 14:24:00.547333 I | rook-ceph-mon1: 2017-07-11 14:24:00.547318 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.547110) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #72: memtable #1 done
- 2017-07-11 14:24:00.547361 I | rook-ceph-mon1: 2017-07-11 14:24:00.547350 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.547130) EVENT_LOG_v1 {"time_micros": 1499783040547123, "job": 44, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:24:00.547399 I | rook-ceph-mon1: 2017-07-11 14:24:00.547388 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.547150) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:24:00.547413 I | rook-ceph-mon1:
- 2017-07-11 14:24:00.547438 I | rook-ceph-mon1: 2017-07-11 14:24:00.547428 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 44] Try to delete WAL files size 830614, prev total WAL file size 830614, number of live WAL files 2.
- 2017-07-11 14:24:00.547463 I | rook-ceph-mon1:
- 2017-07-11 14:24:00.548821 I | rook-ceph-mon1: 2017-07-11 14:24:00.547752 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:24:00.548870 I | rook-ceph-mon1: 2017-07-11 14:24:00.547786 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.547781) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:24:00.548886 I | rook-ceph-mon1:
- 2017-07-11 14:24:00.548897 I | rook-ceph-mon1: 2017-07-11 14:24:00.547790 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 45] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:24:00.548908 I | rook-ceph-mon1: 2017-07-11 14:24:00.547794 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 44 Base level 0, inputs: [72(539KB)], [70(14MB)]
- 2017-07-11 14:24:00.548932 I | rook-ceph-mon1:
- 2017-07-11 14:24:00.548944 I | rook-ceph-mon1: 2017-07-11 14:24:00.547803 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040547796, "job": 45, "event": "compaction_started", "files_L0": [72], "files_L1": [70], "score": -1, "input_data_size": 15850564}
- 2017-07-11 14:24:00.706540 I | rook-ceph-mon1: 2017-07-11 14:24:00.706498 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 45] Generated table #73: 2078 keys, 13675299 bytes
- 2017-07-11 14:24:00.708859 I | rook-ceph-mon1: 2017-07-11 14:24:00.708839 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040708830, "cf_name": "default", "job": 45, "event": "table_file_creation", "file_number": 73, "file_size": 13675299, "table_properties": {"data_size": 13631182, "index_size": 43298, "filter_size": 0, "raw_key_size": 38839, "raw_average_key_size": 18, "raw_value_size": 13571904, "raw_average_value_size": 6531, "num_data_blocks": 1337, "num_entries": 2078, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:24:00.765017 I | rook-ceph-mon1: 2017-07-11 14:24:00.764898 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:24:00.767673 I | rook-ceph-mon1: 2017-07-11 14:24:00.764918 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1122702113' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:24:01.180416 I | rook-ceph-mon1: 2017-07-11 14:24:01.180387 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 45] Compacted 1@0 + 1@1 files to L1 => 13675299 bytes
- 2017-07-11 14:24:01.265683 I | rook-ceph-mon1: 2017-07-11 14:24:01.265661 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:24:01.265590) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 25.1 rd, 21.6 wr, level 1, files in(1, 1) out(1) MB in(0.5, 14.6) out(13.0), read-write-amplify(53.5) write-amplify(24.8) OK, records in: 2587, records dropped: 509
- 2017-07-11 14:24:01.267513 I | rook-ceph-mon1:
- 2017-07-11 14:24:01.267572 I | rook-ceph-mon1: 2017-07-11 14:24:01.267555 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:24:01.265605) EVENT_LOG_v1 {"time_micros": 1499783041265598, "job": 45, "event": "compaction_finished", "compaction_time_micros": 632570, "output_level": 1, "num_output_files": 1, "total_output_size": 13675299, "num_input_records": 2587, "num_output_records": 2078, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:24:01.267831 I | rook-ceph-mon1: 2017-07-11 14:24:01.267818 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783041267815, "job": 45, "event": "table_file_deletion", "file_number": 72}
- 2017-07-11 14:24:01.269558 I | rook-ceph-mon1: 2017-07-11 14:24:01.269543 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783041269541, "job": 45, "event": "table_file_deletion", "file_number": 70}
- 2017-07-11 14:24:08.097842 I | rook-ceph-mon1: 2017-07-11 14:24:08.097810 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:24:08.097934 I | rook-ceph-mon1: 2017-07-11 14:24:08.097918 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/472595371' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:24:18.086698 I | rook-ceph-mon1: 2017-07-11 14:24:18.086662 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:18.086880 I | rook-ceph-mon1: 2017-07-11 14:24:18.086803 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/148035425' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:23.077359 I | rook-ceph-mon1: 2017-07-11 14:24:23.077330 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:23.077514 I | rook-ceph-mon1: 2017-07-11 14:24:23.077450 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2865697108' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:34.013773 I | rook-ceph-mon1: 2017-07-11 14:24:34.013724 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:24:34.013880 I | rook-ceph-mon1: 2017-07-11 14:24:34.013866 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2239229869' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:24:37.060291 I | rook-ceph-mon1: 2017-07-11 14:24:35.562760 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 823 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0706579s > max 0.05s
- 2017-07-11 14:24:37.060352 I | rook-ceph-mon1: 2017-07-11 14:24:35.578916 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 824 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.137923s > max 0.05s
- 2017-07-11 14:24:54.604522 I | rook-ceph-mon1: 2017-07-11 14:24:54.604134 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4748 MB, avail 94438 MB
- 2017-07-11 14:24:58.916782 I | rook-ceph-mon1: 2017-07-11 14:24:58.916658 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:58.916860 I | rook-ceph-mon1: 2017-07-11 14:24:58.916681 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/474310959' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:07.416034 I | rook-ceph-mon1: 2017-07-11 14:25:07.415982 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:25:07.416204 I | rook-ceph-mon1: 2017-07-11 14:25:07.416129 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3850758542' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:25:32.266272 I | rook-ceph-mon1: 2017-07-11 14:25:32.266240 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:32.266373 I | rook-ceph-mon1: 2017-07-11 14:25:32.266359 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2824644879' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:35.110343 I | rook-ceph-mon1: 2017-07-11 14:25:35.110309 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:35.116159 I | rook-ceph-mon1: 2017-07-11 14:25:35.116141 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1888297106' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:37.260013 I | rook-ceph-mon1: 2017-07-11 14:25:37.259979 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:25:37.260324 I | rook-ceph-mon1: 2017-07-11 14:25:37.260309 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4273793899' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:25:48.277947 I | rook-ceph-mon1: 2017-07-11 14:25:48.277918 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:25:48.278038 I | rook-ceph-mon1: 2017-07-11 14:25:48.278025 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3927532074' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:25:51.694223 I | rook-ceph-mon1: 2017-07-11 14:25:51.694195 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:25:51.694322 I | rook-ceph-mon1: 2017-07-11 14:25:51.694308 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1869880803' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:25:54.629028 I | rook-ceph-mon1: 2017-07-11 14:25:54.628839 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4748 MB, avail 94438 MB
- 2017-07-11 14:26:11.412974 I | rook-ceph-mon1: 2017-07-11 14:26:11.412936 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:11.413069 I | rook-ceph-mon1: 2017-07-11 14:26:11.413054 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/637781627' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:24.714364 I | rook-ceph-mon1: 2017-07-11 14:26:24.714326 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:26:24.714549 I | rook-ceph-mon1: 2017-07-11 14:26:24.714465 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/194820531' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:26:32.071472 I | rook-ceph-mon1: 2017-07-11 14:26:32.071440 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:32.071559 I | rook-ceph-mon1: 2017-07-11 14:26:32.071545 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1934348593' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:34.777534 I | rook-ceph-mon1: 2017-07-11 14:26:34.777507 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:34.779653 I | rook-ceph-mon1: 2017-07-11 14:26:34.779622 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3812883498' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:54.634052 I | rook-ceph-mon1: 2017-07-11 14:26:54.633728 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4748 MB, avail 94438 MB
- 2017-07-11 14:26:55.171674 I | rook-ceph-mon1: 2017-07-11 14:26:55.171609 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:26:55.171744 I | rook-ceph-mon1: 2017-07-11 14:26:55.171627 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/829467667' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:26:57.040319 I | rook-ceph-mon1: 2017-07-11 14:26:57.040268 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:57.040416 I | rook-ceph-mon1: 2017-07-11 14:26:57.040401 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1345507582' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:57.898032 I | rook-ceph-mon1: 2017-07-11 14:26:57.898002 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:26:57.898227 I | rook-ceph-mon1: 2017-07-11 14:26:57.898129 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/115816509' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:26:58.398442 I | rook-ceph-mon1: 2017-07-11 14:26:58.398384 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #74. Immutable memtables: 0.
- 2017-07-11 14:26:58.398510 I | rook-ceph-mon1:
- 2017-07-11 14:26:58.398540 I | rook-ceph-mon1: 2017-07-11 14:26:58.398421 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 46] Syncing log #71
- 2017-07-11 14:26:58.469589 I | rook-ceph-mon1: 2017-07-11 14:26:58.467961 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.398416) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:26:58.469640 I | rook-ceph-mon1: 2017-07-11 14:26:58.467969 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 46] Flushing memtable with next log file: 74
- 2017-07-11 14:26:58.469657 I | rook-ceph-mon1:
- 2017-07-11 14:26:58.469670 I | rook-ceph-mon1: 2017-07-11 14:26:58.467977 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218467974, "job": 46, "event": "flush_started", "num_memtables": 1, "num_entries": 2400, "num_deletes": 500, "memory_usage": 7122624}
- 2017-07-11 14:26:58.469682 I | rook-ceph-mon1: 2017-07-11 14:26:58.467979 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 46] Level-0 flush table #75: started
- 2017-07-11 14:26:58.621668 I | rook-ceph-mon1: 2017-07-11 14:26:58.621630 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218621621, "cf_name": "default", "job": 46, "event": "table_file_creation", "file_number": 75, "file_size": 4702775, "table_properties": {"data_size": 4686679, "index_size": 15277, "filter_size": 0, "raw_key_size": 20609, "raw_average_key_size": 18, "raw_value_size": 4660985, "raw_average_value_size": 4199, "num_data_blocks": 484, "num_entries": 1110, "filter_policy_name": "", "kDeletedKeys": "500", "kMergeOperands": "0"}}
- 2017-07-11 14:26:58.621766 I | rook-ceph-mon1: 2017-07-11 14:26:58.621750 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 46] Level-0 flush table #75: 4702775 bytes OK
- 2017-07-11 14:26:58.724181 I | rook-ceph-mon1: 2017-07-11 14:26:58.715956 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.667044) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #75 started
- 2017-07-11 14:26:58.724307 I | rook-ceph-mon1: 2017-07-11 14:26:58.724287 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.715919) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #75: memtable #1 done
- 2017-07-11 14:26:58.724363 I | rook-ceph-mon1: 2017-07-11 14:26:58.724345 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.715931) EVENT_LOG_v1 {"time_micros": 1499783218715927, "job": 46, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:26:58.724395 I | rook-ceph-mon1: 2017-07-11 14:26:58.724381 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.715945) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:26:58.724440 I | rook-ceph-mon1:
- 2017-07-11 14:26:58.724494 I | rook-ceph-mon1: 2017-07-11 14:26:58.724461 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 46] Try to delete WAL files size 7071956, prev total WAL file size 7071956, number of live WAL files 2.
- 2017-07-11 14:26:58.724536 I | rook-ceph-mon1:
- 2017-07-11 14:26:58.753090 I | rook-ceph-mon1: 2017-07-11 14:26:58.725573 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:26:58.753146 I | rook-ceph-mon1: 2017-07-11 14:26:58.725610 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.725604) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:26:58.753164 I | rook-ceph-mon1:
- 2017-07-11 14:26:58.753175 I | rook-ceph-mon1: 2017-07-11 14:26:58.725615 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 47] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:26:58.753201 I | rook-ceph-mon1: 2017-07-11 14:26:58.725619 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 46 Base level 0, inputs: [75(4592KB)], [73(13MB)]
- 2017-07-11 14:26:58.753214 I | rook-ceph-mon1:
- 2017-07-11 14:26:58.753225 I | rook-ceph-mon1: 2017-07-11 14:26:58.725631 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218725621, "job": 47, "event": "compaction_started", "files_L0": [75], "files_L1": [73], "score": -1, "input_data_size": 18378074}
- 2017-07-11 14:26:59.013204 I | rook-ceph-mon1: 2017-07-11 14:26:59.013159 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 47] Generated table #76: 2181 keys, 15523429 bytes
- 2017-07-11 14:26:59.022437 I | rook-ceph-mon1: 2017-07-11 14:26:59.022415 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783219022406, "cf_name": "default", "job": 47, "event": "table_file_creation", "file_number": 76, "file_size": 15523429, "table_properties": {"data_size": 15472733, "index_size": 49877, "filter_size": 0, "raw_key_size": 40764, "raw_average_key_size": 18, "raw_value_size": 15407597, "raw_average_value_size": 7064, "num_data_blocks": 1555, "num_entries": 2181, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:26:59.083505 I | rook-ceph-mon1: 2017-07-11 14:26:59.083440 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 47] Compacted 1@0 + 1@1 files to L1 => 15523429 bytes
- 2017-07-11 14:26:59.139424 I | rook-ceph-mon1: 2017-07-11 14:26:59.139389 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:26:59.139306) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 51.4 rd, 43.4 wr, level 1, files in(1, 1) out(1) MB in(4.5, 13.0) out(14.8), read-write-amplify(7.2) write-amplify(3.3) OK, records in: 3188, records dropped: 1007
- 2017-07-11 14:26:59.139492 I | rook-ceph-mon1:
- 2017-07-11 14:26:59.139527 I | rook-ceph-mon1: 2017-07-11 14:26:59.139511 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:26:59.139324) EVENT_LOG_v1 {"time_micros": 1499783219139316, "job": 47, "event": "compaction_finished", "compaction_time_micros": 357728, "output_level": 1, "num_output_files": 1, "total_output_size": 15523429, "num_input_records": 3188, "num_output_records": 2181, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:26:59.140355 I | rook-ceph-mon1: 2017-07-11 14:26:59.140340 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783219140337, "job": 47, "event": "table_file_deletion", "file_number": 75}
- 2017-07-11 14:26:59.141997 I | rook-ceph-mon1: 2017-07-11 14:26:59.141982 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783219141980, "job": 47, "event": "table_file_deletion", "file_number": 73}
- 2017-07-11 14:26:59.142332 I | rook-ceph-mon1: 2017-07-11 14:26:59.142270 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #77. Immutable memtables: 0.
- 2017-07-11 14:26:59.142376 I | rook-ceph-mon1:
- 2017-07-11 14:26:59.142393 I | rook-ceph-mon1: 2017-07-11 14:26:59.142300 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 48] Syncing log #74
- 2017-07-11 14:26:59.161907 I | rook-ceph-mon1: 2017-07-11 14:26:59.161612 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:26:59.142295) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:26:59.178016 I | rook-ceph-mon1: 2017-07-11 14:26:59.161624 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 48] Flushing memtable with next log file: 77
- 2017-07-11 14:26:59.178053 I | rook-ceph-mon1:
- 2017-07-11 14:26:59.178241 I | rook-ceph-mon1: 2017-07-11 14:26:59.161634 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783219161630, "job": 48, "event": "flush_started", "num_memtables": 1, "num_entries": 3, "num_deletes": 0, "memory_usage": 14680}
- 2017-07-11 14:26:59.181839 I | rook-ceph-mon1: 2017-07-11 14:26:59.161637 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 48] Level-0 flush table #78: started
- 2017-07-11 14:26:59.228542 I | rook-ceph-mon1: 2017-07-11 14:26:59.228479 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783219228470, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 78, "file_size": 13386, "table_properties": {"data_size": 12526, "index_size": 53, "filter_size": 0, "raw_key_size": 65, "raw_average_key_size": 21, "raw_value_size": 12439, "raw_average_value_size": 4146, "num_data_blocks": 2, "num_entries": 3, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:26:59.228692 I | rook-ceph-mon1: 2017-07-11 14:26:59.228498 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 48] Level-0 flush table #78: 13386 bytes OK
- 2017-07-11 14:26:59.320327 I | rook-ceph-mon1: 2017-07-11 14:26:59.320215 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:26:59.301113) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #78 started
- 2017-07-11 14:26:59.321583 I | rook-ceph-mon1: 2017-07-11 14:26:59.320220 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:26:59.320185) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #78: memtable #1 done
- 2017-07-11 14:26:59.321612 I | rook-ceph-mon1: 2017-07-11 14:26:59.320222 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:26:59.320195) EVENT_LOG_v1 {"time_micros": 1499783219320191, "job": 48, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:26:59.321627 I | rook-ceph-mon1: 2017-07-11 14:26:59.320223 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:26:59.320207) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:26:59.321637 I | rook-ceph-mon1:
- 2017-07-11 14:26:59.321665 I | rook-ceph-mon1: 2017-07-11 14:26:59.320228 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 48] Try to delete WAL files size 12502, prev total WAL file size 44006, number of live WAL files 2.
- 2017-07-11 14:26:59.321677 I | rook-ceph-mon1:
- 2017-07-11 14:26:59.321693 I | rook-ceph-mon1: 2017-07-11 14:26:59.320314 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:27:09.227721 I | rook-ceph-mon1: 2017-07-11 14:27:09.227671 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:27:09.237387 I | rook-ceph-mon1: 2017-07-11 14:27:09.237332 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2570922221' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:27:13.086887 I | rook-ceph-mon1: 2017-07-11 14:27:13.085377 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #79. Immutable memtables: 0.
- 2017-07-11 14:27:13.086956 I | rook-ceph-mon1:
- 2017-07-11 14:27:13.086972 I | rook-ceph-mon1: 2017-07-11 14:27:13.085410 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 49] Syncing log #77
- 2017-07-11 14:27:13.123621 I | rook-ceph-mon1: 2017-07-11 14:27:13.108139 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.085406) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:27:13.123706 I | rook-ceph-mon1: 2017-07-11 14:27:13.108146 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 49] Flushing memtable with next log file: 79
- 2017-07-11 14:27:13.123732 I | rook-ceph-mon1:
- 2017-07-11 14:27:13.123742 I | rook-ceph-mon1: 2017-07-11 14:27:13.108155 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233108151, "job": 49, "event": "flush_started", "num_memtables": 1, "num_entries": 413, "num_deletes": 251, "memory_usage": 622840}
- 2017-07-11 14:27:13.123764 I | rook-ceph-mon1: 2017-07-11 14:27:13.108156 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 49] Level-0 flush table #80: started
- 2017-07-11 14:27:13.195065 I | rook-ceph-mon1: 2017-07-11 14:27:13.195040 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233195024, "cf_name": "default", "job": 49, "event": "table_file_creation", "file_number": 80, "file_size": 415056, "table_properties": {"data_size": 412936, "index_size": 1306, "filter_size": 0, "raw_key_size": 5691, "raw_average_key_size": 18, "raw_value_size": 407865, "raw_average_value_size": 1315, "num_data_blocks": 42, "num_entries": 310, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:27:13.195126 I | rook-ceph-mon1: 2017-07-11 14:27:13.195110 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 49] Level-0 flush table #80: 415056 bytes OK
- 2017-07-11 14:27:13.298977 I | rook-ceph-mon1: 2017-07-11 14:27:13.298957 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.250107) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #80 started
- 2017-07-11 14:27:13.299036 I | rook-ceph-mon1: 2017-07-11 14:27:13.299022 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.298929) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #80: memtable #1 done
- 2017-07-11 14:27:13.299064 I | rook-ceph-mon1: 2017-07-11 14:27:13.299053 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.298938) EVENT_LOG_v1 {"time_micros": 1499783233298935, "job": 49, "event": "flush_finished", "lsm_state": [2, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:27:13.299102 I | rook-ceph-mon1: 2017-07-11 14:27:13.299090 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.298948) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[2 1 0 0 0 0 0] max score 0.50
- 2017-07-11 14:27:13.299116 I | rook-ceph-mon1:
- 2017-07-11 14:27:13.299141 I | rook-ceph-mon1: 2017-07-11 14:27:13.299131 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 49] Try to delete WAL files size 612061, prev total WAL file size 612061, number of live WAL files 2.
- 2017-07-11 14:27:13.299164 I | rook-ceph-mon1:
- 2017-07-11 14:27:13.302868 I | rook-ceph-mon1: 2017-07-11 14:27:13.299428 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:27:13.302916 I | rook-ceph-mon1: 2017-07-11 14:27:13.299464 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.299460) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:27:13.302931 I | rook-ceph-mon1:
- 2017-07-11 14:27:13.302942 I | rook-ceph-mon1: 2017-07-11 14:27:13.299469 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 50] Compacting 2@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:27:13.320942 I | rook-ceph-mon1: 2017-07-11 14:27:13.299473 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 49 Base level 0, inputs: [80(405KB) 78(13KB)], [76(14MB)]
- 2017-07-11 14:27:13.320981 I | rook-ceph-mon1:
- 2017-07-11 14:27:13.321019 I | rook-ceph-mon1: 2017-07-11 14:27:13.299482 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233299475, "job": 50, "event": "compaction_started", "files_L0": [80, 78], "files_L1": [76], "score": -1, "input_data_size": 15951871}
- 2017-07-11 14:27:13.681058 I | rook-ceph-mon1: 2017-07-11 14:27:13.681008 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 50] Generated table #81: 1982 keys, 13391002 bytes
- 2017-07-11 14:27:13.682921 I | rook-ceph-mon1: 2017-07-11 14:27:13.682901 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233682882, "cf_name": "default", "job": 50, "event": "table_file_creation", "file_number": 81, "file_size": 13391002, "table_properties": {"data_size": 13346704, "index_size": 43479, "filter_size": 0, "raw_key_size": 37234, "raw_average_key_size": 18, "raw_value_size": 13288690, "raw_average_value_size": 6704, "num_data_blocks": 1346, "num_entries": 1982, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:27:13.776943 I | rook-ceph-mon1: 2017-07-11 14:27:13.776786 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 50] Compacted 2@0 + 1@1 files to L1 => 13391002 bytes
- 2017-07-11 14:27:13.815990 I | rook-ceph-mon1: 2017-07-11 14:27:13.815965 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.815910) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 33.4 rd, 28.1 wr, level 1, files in(2, 1) out(1) MB in(0.4, 14.8) out(12.8), read-write-amplify(68.5) write-amplify(31.3) OK, records in: 2494, records dropped: 512
- 2017-07-11 14:27:13.816185 I | rook-ceph-mon1:
- 2017-07-11 14:27:13.816230 I | rook-ceph-mon1: 2017-07-11 14:27:13.816213 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.815924) EVENT_LOG_v1 {"time_micros": 1499783233815918, "job": 50, "event": "compaction_finished", "compaction_time_micros": 477285, "output_level": 1, "num_output_files": 1, "total_output_size": 13391002, "num_input_records": 2494, "num_output_records": 1982, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:27:13.817759 I | rook-ceph-mon1: 2017-07-11 14:27:13.817746 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233817743, "job": 50, "event": "table_file_deletion", "file_number": 80}
- 2017-07-11 14:27:13.817853 I | rook-ceph-mon1: 2017-07-11 14:27:13.817842 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233817840, "job": 50, "event": "table_file_deletion", "file_number": 78}
- 2017-07-11 14:27:13.833666 I | rook-ceph-mon1: 2017-07-11 14:27:13.833646 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233833643, "job": 50, "event": "table_file_deletion", "file_number": 76}
- 2017-07-11 14:27:17.360153 I | rook-ceph-mon1: 2017-07-11 14:27:17.360124 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:27:17.360251 I | rook-ceph-mon1: 2017-07-11 14:27:17.360237 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2284568241' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:27:25.906983 I | rook-ceph-mon1: 2017-07-11 14:27:25.906932 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:25.907183 I | rook-ceph-mon1: 2017-07-11 14:27:25.907088 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3015883205' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:28.283722 I | rook-ceph-mon1: 2017-07-11 14:27:28.283690 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:28.283949 I | rook-ceph-mon1: 2017-07-11 14:27:28.283934 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4071540711' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:28.459951 I | rook-ceph-mon1: 2017-07-11 14:27:28.459933 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:27:28.460035 I | rook-ceph-mon1: 2017-07-11 14:27:28.460018 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2266459040' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:27:44.995083 I | rook-ceph-mon1: 2017-07-11 14:27:44.995052 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:45.005417 I | rook-ceph-mon1: 2017-07-11 14:27:45.004773 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/312832359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:48.985588 I | rook-ceph-mon1: 2017-07-11 14:27:48.985341 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:48.985650 I | rook-ceph-mon1: 2017-07-11 14:27:48.985365 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4073724230' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:51.330655 I | rook-ceph-mon1: 2017-07-11 14:27:51.330595 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:51.330746 I | rook-ceph-mon1: 2017-07-11 14:27:51.330731 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3670831964' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:54.635574 I | rook-ceph-mon1: 2017-07-11 14:27:54.635407 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4748 MB, avail 94438 MB
- 2017-07-11 14:27:56.256316 I | rook-ceph-mon1: 2017-07-11 14:27:56.256281 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:56.256482 I | rook-ceph-mon1: 2017-07-11 14:27:56.256407 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/987951870' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:17.645722 I | rook-ceph-mon1: 2017-07-11 14:28:17.645679 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:17.645968 I | rook-ceph-mon1: 2017-07-11 14:28:17.645886 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2232308112' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:24.205874 I | rook-ceph-mon1: 2017-07-11 14:28:24.205841 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:28:24.205973 I | rook-ceph-mon1: 2017-07-11 14:28:24.205959 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1323694343' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:28:48.844835 I | rook-ceph-mon1: 2017-07-11 14:28:48.844810 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:28:48.844925 I | rook-ceph-mon1: 2017-07-11 14:28:48.844911 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1457600467' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:28:54.637917 I | rook-ceph-mon1: 2017-07-11 14:28:54.637627 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4748 MB, avail 94438 MB
- 2017-07-11 14:28:57.404387 I | rook-ceph-mon1: 2017-07-11 14:28:57.404334 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:28:57.404629 I | rook-ceph-mon1: 2017-07-11 14:28:57.404593 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4103414257' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:29:04.553503 I | rook-ceph-mon1: 2017-07-11 14:29:04.553377 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:29:04.555070 I | rook-ceph-mon1: 2017-07-11 14:29:04.555055 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/667080466' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:29:11.277881 I | rook-ceph-mon1: 2017-07-11 14:29:11.277851 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:29:11.278034 I | rook-ceph-mon1: 2017-07-11 14:29:11.277974 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/781067836' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:29:23.369971 I | rook-ceph-mon1: 2017-07-11 14:29:23.369943 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:23.370066 I | rook-ceph-mon1: 2017-07-11 14:29:23.370053 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2026909188' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:34.127377 I | rook-ceph-mon1: 2017-07-11 14:29:34.127352 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:29:34.127474 I | rook-ceph-mon1: 2017-07-11 14:29:34.127459 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/506573137' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:29:36.187394 I | rook-ceph-mon1: 2017-07-11 14:29:35.582160 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1036 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.174452s > max 0.05s
- 2017-07-11 14:29:41.492092 I | rook-ceph-mon1: 2017-07-11 14:29:41.492067 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:29:41.492177 I | rook-ceph-mon1: 2017-07-11 14:29:41.492163 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2189367438' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:29:54.642799 I | rook-ceph-mon1: 2017-07-11 14:29:54.642511 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4748 MB, avail 94438 MB
- 2017-07-11 14:29:55.534126 I | rook-ceph-mon1: 2017-07-11 14:29:55.534072 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:29:55.534237 I | rook-ceph-mon1: 2017-07-11 14:29:55.534222 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/291044611' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:30:03.511814 I | rook-ceph-mon1: 2017-07-11 14:30:03.511780 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:30:03.511900 I | rook-ceph-mon1: 2017-07-11 14:30:03.511887 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1305333155' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:30:06.053453 I | rook-ceph-mon1: 2017-07-11 14:30:05.330496 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1054 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:30:06.575833 I | rook-ceph-mon1: 2017-07-11 14:30:06.575798 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:30:06.582578 I | rook-ceph-mon1: 2017-07-11 14:30:06.576018 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1358451864' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:30:15.172338 I | rook-ceph-mon1: 2017-07-11 14:30:15.172308 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:30:15.172435 I | rook-ceph-mon1: 2017-07-11 14:30:15.172422 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3729833189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:30:17.685276 I | rook-ceph-mon1: 2017-07-11 14:30:17.685249 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:30:17.685382 I | rook-ceph-mon1: 2017-07-11 14:30:17.685367 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/333902119' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:30:31.501122 I | rook-ceph-mon1: 2017-07-11 14:30:31.501046 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #82. Immutable memtables: 0.
- 2017-07-11 14:30:31.501133 I | rook-ceph-mon1:
- 2017-07-11 14:30:31.501156 I | rook-ceph-mon1: 2017-07-11 14:30:31.501085 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 51] Syncing log #79
- 2017-07-11 14:30:31.552623 I | rook-ceph-mon1: 2017-07-11 14:30:31.530076 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.501080) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:30:31.552672 I | rook-ceph-mon1: 2017-07-11 14:30:31.530085 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 51] Flushing memtable with next log file: 82
- 2017-07-11 14:30:31.552687 I | rook-ceph-mon1:
- 2017-07-11 14:30:31.552699 I | rook-ceph-mon1: 2017-07-11 14:30:31.530093 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783431530089, "job": 51, "event": "flush_started", "num_memtables": 1, "num_entries": 2311, "num_deletes": 251, "memory_usage": 7655600}
- 2017-07-11 14:30:31.552710 I | rook-ceph-mon1: 2017-07-11 14:30:31.530095 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 51] Level-0 flush table #83: started
- 2017-07-11 14:30:31.779263 I | rook-ceph-mon1: 2017-07-11 14:30:31.779223 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783431779213, "cf_name": "default", "job": 51, "event": "table_file_creation", "file_number": 83, "file_size": 5060213, "table_properties": {"data_size": 5042677, "index_size": 16716, "filter_size": 0, "raw_key_size": 17109, "raw_average_key_size": 18, "raw_value_size": 5018483, "raw_average_value_size": 5508, "num_data_blocks": 523, "num_entries": 911, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:30:31.782808 I | rook-ceph-mon1: 2017-07-11 14:30:31.782778 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 51] Level-0 flush table #83: 5060213 bytes OK
- 2017-07-11 14:30:31.842167 I | rook-ceph-mon1: 2017-07-11 14:30:31.842123 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.798775) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #83 started
- 2017-07-11 14:30:31.842386 I | rook-ceph-mon1: 2017-07-11 14:30:31.842369 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.842090) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #83: memtable #1 done
- 2017-07-11 14:30:31.842480 I | rook-ceph-mon1: 2017-07-11 14:30:31.842465 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.842100) EVENT_LOG_v1 {"time_micros": 1499783431842097, "job": 51, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:30:31.858237 I | rook-ceph-mon1: 2017-07-11 14:30:31.858217 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.842114) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:30:31.858271 I | rook-ceph-mon1:
- 2017-07-11 14:30:31.858326 I | rook-ceph-mon1: 2017-07-11 14:30:31.858301 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 51] Try to delete WAL files size 7606847, prev total WAL file size 7606847, number of live WAL files 2.
- 2017-07-11 14:30:31.858351 I | rook-ceph-mon1:
- 2017-07-11 14:30:31.877961 I | rook-ceph-mon1: 2017-07-11 14:30:31.859370 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:30:31.878014 I | rook-ceph-mon1: 2017-07-11 14:30:31.859404 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.859399) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:30:31.878029 I | rook-ceph-mon1:
- 2017-07-11 14:30:31.878041 I | rook-ceph-mon1: 2017-07-11 14:30:31.859409 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 52] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:30:31.878055 I | rook-ceph-mon1: 2017-07-11 14:30:31.859414 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 51 Base level 0, inputs: [83(4941KB)], [81(12MB)]
- 2017-07-11 14:30:31.878079 I | rook-ceph-mon1:
- 2017-07-11 14:30:31.878102 I | rook-ceph-mon1: 2017-07-11 14:30:31.859423 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783431859416, "job": 52, "event": "compaction_started", "files_L0": [83], "files_L1": [81], "score": -1, "input_data_size": 18451215}
- 2017-07-11 14:30:32.213085 I | rook-ceph-mon1: 2017-07-11 14:30:32.213047 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 52] Generated table #84: 2384 keys, 16004284 bytes
- 2017-07-11 14:30:32.214792 I | rook-ceph-mon1: 2017-07-11 14:30:32.214775 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783432214767, "cf_name": "default", "job": 52, "event": "table_file_creation", "file_number": 84, "file_size": 16004284, "table_properties": {"data_size": 15950815, "index_size": 52650, "filter_size": 0, "raw_key_size": 45122, "raw_average_key_size": 18, "raw_value_size": 15880797, "raw_average_value_size": 6661, "num_data_blocks": 1618, "num_entries": 2384, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:30:32.252304 I | rook-ceph-mon1: 2017-07-11 14:30:32.252282 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 52] Compacted 1@0 + 1@1 files to L1 => 16004284 bytes
- 2017-07-11 14:30:32.290150 I | rook-ceph-mon1: 2017-07-11 14:30:32.290119 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:30:32.290040) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 47.0 rd, 40.7 wr, level 1, files in(1, 1) out(1) MB in(4.8, 12.8) out(15.3), read-write-amplify(6.8) write-amplify(3.2) OK, records in: 2893, records dropped: 509
- 2017-07-11 14:30:32.290193 I | rook-ceph-mon1:
- 2017-07-11 14:30:32.290225 I | rook-ceph-mon1: 2017-07-11 14:30:32.290210 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:30:32.290055) EVENT_LOG_v1 {"time_micros": 1499783432290048, "job": 52, "event": "compaction_finished", "compaction_time_micros": 392848, "output_level": 1, "num_output_files": 1, "total_output_size": 16004284, "num_input_records": 2893, "num_output_records": 2384, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:30:32.291011 I | rook-ceph-mon1: 2017-07-11 14:30:32.290987 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783432290984, "job": 52, "event": "table_file_deletion", "file_number": 83}
- 2017-07-11 14:30:32.292516 I | rook-ceph-mon1: 2017-07-11 14:30:32.292502 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783432292500, "job": 52, "event": "table_file_deletion", "file_number": 81}
- 2017-07-11 14:30:39.849997 I | rook-ceph-mon1: 2017-07-11 14:30:39.849966 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:30:39.850209 I | rook-ceph-mon1: 2017-07-11 14:30:39.850107 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/258445793' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:30:53.229540 I | rook-ceph-mon1: 2017-07-11 14:30:53.229512 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:30:53.229633 I | rook-ceph-mon1: 2017-07-11 14:30:53.229619 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2011076694' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:30:54.649436 I | rook-ceph-mon1: 2017-07-11 14:30:54.649155 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4751 MB, avail 94436 MB
- 2017-07-11 14:30:58.189259 I | rook-ceph-mon1: 2017-07-11 14:30:58.189216 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:30:58.197295 I | rook-ceph-mon1: 2017-07-11 14:30:58.197246 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1069201701' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:30:59.343088 I | rook-ceph-mon1: 2017-07-11 14:30:59.343060 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:30:59.343325 I | rook-ceph-mon1: 2017-07-11 14:30:59.343310 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1587565101' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:31:10.598203 I | rook-ceph-mon1: 2017-07-11 14:31:10.598168 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:31:10.600438 I | rook-ceph-mon1: 2017-07-11 14:31:10.600421 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1288568583' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:31:12.344561 I | rook-ceph-mon1: 2017-07-11 14:31:12.344527 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:12.346864 I | rook-ceph-mon1: 2017-07-11 14:31:12.346848 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3053698248' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:14.239542 I | rook-ceph-mon1: 2017-07-11 14:31:14.239512 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:31:14.246468 I | rook-ceph-mon1: 2017-07-11 14:31:14.246449 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3662536700' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:31:21.624399 I | rook-ceph-mon1: 2017-07-11 14:31:21.624372 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:31:21.624485 I | rook-ceph-mon1: 2017-07-11 14:31:21.624472 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3031637877' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:31:23.812671 I | rook-ceph-mon1: 2017-07-11 14:31:23.812638 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:31:23.812864 I | rook-ceph-mon1: 2017-07-11 14:31:23.812785 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/72043245' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:31:42.328353 I | rook-ceph-mon1: 2017-07-11 14:31:42.328299 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:31:42.330627 I | rook-ceph-mon1: 2017-07-11 14:31:42.330611 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1473516298' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:31:43.733323 I | rook-ceph-mon1: 2017-07-11 14:31:43.733291 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:31:43.733508 I | rook-ceph-mon1: 2017-07-11 14:31:43.733430 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4263525256' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:31:53.599042 I | rook-ceph-mon1: 2017-07-11 14:31:53.597838 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #85. Immutable memtables: 0.
- 2017-07-11 14:31:53.599114 I | rook-ceph-mon1:
- 2017-07-11 14:31:53.599132 I | rook-ceph-mon1: 2017-07-11 14:31:53.597870 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 53] Syncing log #82
- 2017-07-11 14:31:53.629418 I | rook-ceph-mon1: 2017-07-11 14:31:53.626533 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.597865) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:31:53.629555 I | rook-ceph-mon1: 2017-07-11 14:31:53.626540 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 53] Flushing memtable with next log file: 85
- 2017-07-11 14:31:53.629575 I | rook-ceph-mon1:
- 2017-07-11 14:31:53.629588 I | rook-ceph-mon1: 2017-07-11 14:31:53.626548 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513626544, "job": 53, "event": "flush_started", "num_memtables": 1, "num_entries": 1084, "num_deletes": 251, "memory_usage": 3083704}
- 2017-07-11 14:31:53.629612 I | rook-ceph-mon1: 2017-07-11 14:31:53.626550 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 53] Level-0 flush table #86: started
- 2017-07-11 14:31:53.724004 I | rook-ceph-mon1: 2017-07-11 14:31:53.723980 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513723959, "cf_name": "default", "job": 53, "event": "table_file_creation", "file_number": 86, "file_size": 1804705, "table_properties": {"data_size": 1798374, "index_size": 5516, "filter_size": 0, "raw_key_size": 9503, "raw_average_key_size": 19, "raw_value_size": 1787833, "raw_average_value_size": 3678, "num_data_blocks": 177, "num_entries": 486, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:31:53.725595 I | rook-ceph-mon1: 2017-07-11 14:31:53.725579 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 53] Level-0 flush table #86: 1804705 bytes OK
- 2017-07-11 14:31:53.777473 I | rook-ceph-mon1: 2017-07-11 14:31:53.777402 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.752832) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #86 started
- 2017-07-11 14:31:53.777531 I | rook-ceph-mon1: 2017-07-11 14:31:53.777517 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.777371) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #86: memtable #1 done
- 2017-07-11 14:31:53.777558 I | rook-ceph-mon1: 2017-07-11 14:31:53.777547 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.777381) EVENT_LOG_v1 {"time_micros": 1499783513777377, "job": 53, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:31:53.777596 I | rook-ceph-mon1: 2017-07-11 14:31:53.777571 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.777394) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:31:53.777613 I | rook-ceph-mon1:
- 2017-07-11 14:31:53.777640 I | rook-ceph-mon1: 2017-07-11 14:31:53.777629 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 53] Try to delete WAL files size 3060435, prev total WAL file size 3060435, number of live WAL files 2.
- 2017-07-11 14:31:53.814136 I | rook-ceph-mon1:
- 2017-07-11 14:31:53.814155 I | rook-ceph-mon1: 2017-07-11 14:31:53.793821 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:31:53.814193 I | rook-ceph-mon1: 2017-07-11 14:31:53.793856 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.793851) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:31:53.814215 I | rook-ceph-mon1:
- 2017-07-11 14:31:53.814226 I | rook-ceph-mon1: 2017-07-11 14:31:53.793861 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 54] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:31:53.814240 I | rook-ceph-mon1: 2017-07-11 14:31:53.793865 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 53 Base level 0, inputs: [86(1762KB)], [84(15MB)]
- 2017-07-11 14:31:53.814251 I | rook-ceph-mon1:
- 2017-07-11 14:31:53.814306 I | rook-ceph-mon1: 2017-07-11 14:31:53.793876 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513793869, "job": 54, "event": "compaction_started", "files_L0": [86], "files_L1": [84], "score": -1, "input_data_size": 17808989}
- 2017-07-11 14:31:54.151980 I | rook-ceph-mon1: 2017-07-11 14:31:54.151938 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 54] Generated table #87: 2396 keys, 16383568 bytes
- 2017-07-11 14:31:54.152089 I | rook-ceph-mon1: 2017-07-11 14:31:54.152072 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783514152065, "cf_name": "default", "job": 54, "event": "table_file_creation", "file_number": 87, "file_size": 16383568, "table_properties": {"data_size": 16331527, "index_size": 51222, "filter_size": 0, "raw_key_size": 45098, "raw_average_key_size": 18, "raw_value_size": 16262414, "raw_average_value_size": 6787, "num_data_blocks": 1578, "num_entries": 2396, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:31:54.355412 I | rook-ceph-mon1: 2017-07-11 14:31:54.355320 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 54] Compacted 1@0 + 1@1 files to L1 => 16383568 bytes
- 2017-07-11 14:31:54.394735 I | rook-ceph-mon1: 2017-07-11 14:31:54.394712 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:31:54.394644) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 31.7 rd, 29.2 wr, level 1, files in(1, 1) out(1) MB in(1.7, 15.3) out(15.6), read-write-amplify(18.9) write-amplify(9.1) OK, records in: 2870, records dropped: 474
- 2017-07-11 14:31:54.394774 I | rook-ceph-mon1:
- 2017-07-11 14:31:54.394805 I | rook-ceph-mon1: 2017-07-11 14:31:54.394791 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:31:54.394659) EVENT_LOG_v1 {"time_micros": 1499783514394653, "job": 54, "event": "compaction_finished", "compaction_time_micros": 561431, "output_level": 1, "num_output_files": 1, "total_output_size": 16383568, "num_input_records": 2870, "num_output_records": 2396, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:31:54.395164 I | rook-ceph-mon1: 2017-07-11 14:31:54.395151 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783514395148, "job": 54, "event": "table_file_deletion", "file_number": 86}
- 2017-07-11 14:31:54.396985 I | rook-ceph-mon1: 2017-07-11 14:31:54.396971 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783514396969, "job": 54, "event": "table_file_deletion", "file_number": 84}
- 2017-07-11 14:31:54.432535 I | rook-ceph-mon1: 2017-07-11 14:31:54.423451 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #88. Immutable memtables: 0.
- 2017-07-11 14:31:54.432579 I | rook-ceph-mon1:
- 2017-07-11 14:31:54.432842 I | rook-ceph-mon1: 2017-07-11 14:31:54.432790 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 55] Syncing log #85
- 2017-07-11 14:31:54.482158 I | rook-ceph-mon1: 2017-07-11 14:31:54.481914 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:31:54.432782) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:31:54.483479 I | rook-ceph-mon1: 2017-07-11 14:31:54.481922 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 55] Flushing memtable with next log file: 88
- 2017-07-11 14:31:54.483518 I | rook-ceph-mon1:
- 2017-07-11 14:31:54.483531 I | rook-ceph-mon1: 2017-07-11 14:31:54.481929 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783514481926, "job": 55, "event": "flush_started", "num_memtables": 1, "num_entries": 9, "num_deletes": 0, "memory_usage": 41856}
- 2017-07-11 14:31:54.483542 I | rook-ceph-mon1: 2017-07-11 14:31:54.481931 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 55] Level-0 flush table #89: started
- 2017-07-11 14:31:54.570944 I | rook-ceph-mon1: 2017-07-11 14:31:54.570912 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783514570903, "cf_name": "default", "job": 55, "event": "table_file_creation", "file_number": 89, "file_size": 27310, "table_properties": {"data_size": 26415, "index_size": 84, "filter_size": 0, "raw_key_size": 183, "raw_average_key_size": 22, "raw_value_size": 26196, "raw_average_value_size": 3274, "num_data_blocks": 3, "num_entries": 8, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:31:54.571134 I | rook-ceph-mon1: 2017-07-11 14:31:54.570919 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 55] Level-0 flush table #89: 27310 bytes OK
- 2017-07-11 14:31:54.737232 I | rook-ceph-mon1: 2017-07-11 14:31:54.736990 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4786 MB, avail 94400 MB
- 2017-07-11 14:31:54.792914 I | rook-ceph-mon1: 2017-07-11 14:31:54.792763 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:31:54.735313) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #89 started
- 2017-07-11 14:31:54.794246 I | rook-ceph-mon1: 2017-07-11 14:31:54.792769 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:31:54.792719) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #89: memtable #1 done
- 2017-07-11 14:31:54.794280 I | rook-ceph-mon1: 2017-07-11 14:31:54.792770 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:31:54.792741) EVENT_LOG_v1 {"time_micros": 1499783514792726, "job": 55, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:31:54.794296 I | rook-ceph-mon1: 2017-07-11 14:31:54.792772 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:31:54.792753) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:31:54.794323 I | rook-ceph-mon1:
- 2017-07-11 14:31:54.794336 I | rook-ceph-mon1: 2017-07-11 14:31:54.792777 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 55] Try to delete WAL files size 39552, prev total WAL file size 59491, number of live WAL files 2.
- 2017-07-11 14:31:54.794348 I | rook-ceph-mon1:
- 2017-07-11 14:31:54.794410 I | rook-ceph-mon1: 2017-07-11 14:31:54.794365 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:31:54.794481 I | rook-ceph-mon1: 2017-07-11 14:31:54.794452 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:31:54.794446) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:31:54.794495 I | rook-ceph-mon1:
- 2017-07-11 14:31:54.794523 I | rook-ceph-mon1: 2017-07-11 14:31:54.794510 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 56] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:31:54.794577 I | rook-ceph-mon1: 2017-07-11 14:31:54.794565 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 55 Base level 0, inputs: [89(26KB)], [87(15MB)]
- 2017-07-11 14:31:54.794596 I | rook-ceph-mon1:
- 2017-07-11 14:31:54.794642 I | rook-ceph-mon1: 2017-07-11 14:31:54.794617 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783514794609, "job": 56, "event": "compaction_started", "files_L0": [89], "files_L1": [87], "score": -1, "input_data_size": 16410878}
- 2017-07-11 14:31:54.982692 I | rook-ceph-mon1: 2017-07-11 14:31:54.982652 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 56] Generated table #90: 2399 keys, 16409886 bytes
- 2017-07-11 14:31:54.983524 I | rook-ceph-mon1: 2017-07-11 14:31:54.983506 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783514983498, "cf_name": "default", "job": 56, "event": "table_file_creation", "file_number": 90, "file_size": 16409886, "table_properties": {"data_size": 16357780, "index_size": 51287, "filter_size": 0, "raw_key_size": 45155, "raw_average_key_size": 18, "raw_value_size": 16288570, "raw_average_value_size": 6789, "num_data_blocks": 1580, "num_entries": 2399, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:31:55.031847 I | rook-ceph-mon1: 2017-07-11 14:31:55.031824 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 56] Compacted 1@0 + 1@1 files to L1 => 16409886 bytes
- 2017-07-11 14:31:55.069956 I | rook-ceph-mon1: 2017-07-11 14:31:55.069934 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:31:55.069883) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 69.2 rd, 69.2 wr, level 1, files in(1, 1) out(1) MB in(0.0, 15.6) out(15.6), read-write-amplify(1201.8) write-amplify(600.9) OK, records in: 2404, records dropped: 5
- 2017-07-11 14:31:55.070149 I | rook-ceph-mon1:
- 2017-07-11 14:31:55.070190 I | rook-ceph-mon1: 2017-07-11 14:31:55.070175 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:31:55.069898) EVENT_LOG_v1 {"time_micros": 1499783515069892, "job": 56, "event": "compaction_finished", "compaction_time_micros": 237155, "output_level": 1, "num_output_files": 1, "total_output_size": 16409886, "num_input_records": 2404, "num_output_records": 2399, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:31:55.071484 I | rook-ceph-mon1: 2017-07-11 14:31:55.070284 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783515070282, "job": 56, "event": "table_file_deletion", "file_number": 89}
- 2017-07-11 14:31:55.079547 I | rook-ceph-mon1: 2017-07-11 14:31:55.079523 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783515079521, "job": 56, "event": "table_file_deletion", "file_number": 87}
- 2017-07-11 14:31:57.970038 I | rook-ceph-mon1: 2017-07-11 14:31:57.970008 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:57.970130 I | rook-ceph-mon1: 2017-07-11 14:31:57.970116 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3250508689' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:06.075360 I | rook-ceph-mon1: 2017-07-11 14:32:06.075332 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:32:06.077397 I | rook-ceph-mon1: 2017-07-11 14:32:06.077380 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1362033745' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:32:28.323788 I | rook-ceph-mon1: 2017-07-11 14:32:28.323756 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:32:28.323877 I | rook-ceph-mon1: 2017-07-11 14:32:28.323862 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3587420809' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:32:33.634258 I | rook-ceph-mon1: 2017-07-11 14:32:33.634181 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #91. Immutable memtables: 0.
- 2017-07-11 14:32:33.634316 I | rook-ceph-mon1:
- 2017-07-11 14:32:33.634334 I | rook-ceph-mon1: 2017-07-11 14:32:33.634223 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 57] Syncing log #88
- 2017-07-11 14:32:33.664634 I | rook-ceph-mon1: 2017-07-11 14:32:33.662395 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.634218) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:32:33.666268 I | rook-ceph-mon1: 2017-07-11 14:32:33.662402 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 57] Flushing memtable with next log file: 91
- 2017-07-11 14:32:33.666293 I | rook-ceph-mon1:
- 2017-07-11 14:32:33.666329 I | rook-ceph-mon1: 2017-07-11 14:32:33.662409 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553662406, "job": 57, "event": "flush_started", "num_memtables": 1, "num_entries": 904, "num_deletes": 506, "memory_usage": 1495656}
- 2017-07-11 14:32:33.666467 I | rook-ceph-mon1: 2017-07-11 14:32:33.662412 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 57] Level-0 flush table #92: started
- 2017-07-11 14:32:33.793106 I | rook-ceph-mon1: 2017-07-11 14:32:33.793081 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553793073, "cf_name": "default", "job": 57, "event": "table_file_creation", "file_number": 92, "file_size": 979015, "table_properties": {"data_size": 975020, "index_size": 3181, "filter_size": 0, "raw_key_size": 11919, "raw_average_key_size": 18, "raw_value_size": 964301, "raw_average_value_size": 1511, "num_data_blocks": 102, "num_entries": 638, "filter_policy_name": "", "kDeletedKeys": "506", "kMergeOperands": "0"}}
- 2017-07-11 14:32:33.800661 I | rook-ceph-mon1: 2017-07-11 14:32:33.800631 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 57] Level-0 flush table #92: 979015 bytes OK
- 2017-07-11 14:32:33.847478 I | rook-ceph-mon1: 2017-07-11 14:32:33.847457 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.828109) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #92 started
- 2017-07-11 14:32:33.847678 I | rook-ceph-mon1: 2017-07-11 14:32:33.847663 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.847429) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #92: memtable #1 done
- 2017-07-11 14:32:33.847715 I | rook-ceph-mon1: 2017-07-11 14:32:33.847703 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.847438) EVENT_LOG_v1 {"time_micros": 1499783553847434, "job": 57, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:32:33.847826 I | rook-ceph-mon1: 2017-07-11 14:32:33.847812 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.847448) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:32:33.847841 I | rook-ceph-mon1:
- 2017-07-11 14:32:33.847868 I | rook-ceph-mon1: 2017-07-11 14:32:33.847857 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 57] Try to delete WAL files size 1474884, prev total WAL file size 1474884, number of live WAL files 2.
- 2017-07-11 14:32:33.848001 I | rook-ceph-mon1:
- 2017-07-11 14:32:33.860628 I | rook-ceph-mon1: 2017-07-11 14:32:33.848393 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:32:33.860672 I | rook-ceph-mon1: 2017-07-11 14:32:33.848420 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.848416) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:32:33.860687 I | rook-ceph-mon1:
- 2017-07-11 14:32:33.860698 I | rook-ceph-mon1: 2017-07-11 14:32:33.848425 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 58] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:32:33.860714 I | rook-ceph-mon1: 2017-07-11 14:32:33.848428 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 57 Base level 0, inputs: [92(956KB)], [90(15MB)]
- 2017-07-11 14:32:33.860741 I | rook-ceph-mon1:
- 2017-07-11 14:32:33.860752 I | rook-ceph-mon1: 2017-07-11 14:32:33.848437 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553848430, "job": 58, "event": "compaction_started", "files_L0": [92], "files_L1": [90], "score": -1, "input_data_size": 17388901}
- 2017-07-11 14:32:34.092848 I | rook-ceph-mon1: 2017-07-11 14:32:34.092806 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 58] Generated table #93: 2018 keys, 14336247 bytes
- 2017-07-11 14:32:34.095684 I | rook-ceph-mon1: 2017-07-11 14:32:34.095666 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783554095659, "cf_name": "default", "job": 58, "event": "table_file_creation", "file_number": 93, "file_size": 14336247, "table_properties": {"data_size": 14290295, "index_size": 45133, "filter_size": 0, "raw_key_size": 38168, "raw_average_key_size": 18, "raw_value_size": 14230622, "raw_average_value_size": 7051, "num_data_blocks": 1398, "num_entries": 2018, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:32:34.158160 I | rook-ceph-mon1: 2017-07-11 14:32:34.155938 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 58] Compacted 1@0 + 1@1 files to L1 => 14336247 bytes
- 2017-07-11 14:32:34.204586 I | rook-ceph-mon1: 2017-07-11 14:32:34.204553 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:32:34.204467) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 56.6 rd, 46.6 wr, level 1, files in(1, 1) out(1) MB in(0.9, 15.6) out(13.7), read-write-amplify(32.4) write-amplify(14.6) OK, records in: 3037, records dropped: 1019
- 2017-07-11 14:32:34.204650 I | rook-ceph-mon1:
- 2017-07-11 14:32:34.204687 I | rook-ceph-mon1: 2017-07-11 14:32:34.204670 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:32:34.204493) EVENT_LOG_v1 {"time_micros": 1499783554204476, "job": 58, "event": "compaction_finished", "compaction_time_micros": 307489, "output_level": 1, "num_output_files": 1, "total_output_size": 14336247, "num_input_records": 3037, "num_output_records": 2018, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:32:34.205036 I | rook-ceph-mon1: 2017-07-11 14:32:34.205021 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783554205017, "job": 58, "event": "table_file_deletion", "file_number": 92}
- 2017-07-11 14:32:34.206794 I | rook-ceph-mon1: 2017-07-11 14:32:34.206781 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783554206779, "job": 58, "event": "table_file_deletion", "file_number": 90}
- 2017-07-11 14:32:34.206867 I | rook-ceph-mon1: 2017-07-11 14:32:34.206854 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:32:41.981047 I | rook-ceph-mon1: 2017-07-11 14:32:41.981016 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:32:41.981155 I | rook-ceph-mon1: 2017-07-11 14:32:41.981141 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3555122146' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:32:50.380222 I | rook-ceph-mon1: 2017-07-11 14:32:50.380197 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:32:50.388346 I | rook-ceph-mon1: 2017-07-11 14:32:50.388328 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/717507966' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:32:54.741453 I | rook-ceph-mon1: 2017-07-11 14:32:54.741158 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4749 MB, avail 94437 MB
- 2017-07-11 14:33:01.410761 I | rook-ceph-mon1: 2017-07-11 14:33:01.410735 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:33:01.410922 I | rook-ceph-mon1: 2017-07-11 14:33:01.410856 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3089868046' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:33:12.567333 I | rook-ceph-mon1: 2017-07-11 14:33:12.567303 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:33:12.567572 I | rook-ceph-mon1: 2017-07-11 14:33:12.567556 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/682908283' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:33:23.079508 I | rook-ceph-mon1: 2017-07-11 14:33:23.079476 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:23.081178 I | rook-ceph-mon1: 2017-07-11 14:33:23.081161 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3101132345' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:26.557251 I | rook-ceph-mon1: 2017-07-11 14:33:26.557222 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:33:26.557349 I | rook-ceph-mon1: 2017-07-11 14:33:26.557334 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/708671420' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:33:34.610504 I | rook-ceph-mon1: 2017-07-11 14:33:34.610454 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:34.610592 I | rook-ceph-mon1: 2017-07-11 14:33:34.610578 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1745141036' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:52.426041 I | rook-ceph-mon1: 2017-07-11 14:33:52.425969 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #94. Immutable memtables: 0.
- 2017-07-11 14:33:52.426109 I | rook-ceph-mon1:
- 2017-07-11 14:33:52.426126 I | rook-ceph-mon1: 2017-07-11 14:33:52.426003 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 59] Syncing log #91
- 2017-07-11 14:33:52.468480 I | rook-ceph-mon1: 2017-07-11 14:33:52.464473 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.425998) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:33:52.476898 I | rook-ceph-mon1: 2017-07-11 14:33:52.464481 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 59] Flushing memtable with next log file: 94
- 2017-07-11 14:33:52.476933 I | rook-ceph-mon1:
- 2017-07-11 14:33:52.476947 I | rook-ceph-mon1: 2017-07-11 14:33:52.464491 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632464487, "job": 59, "event": "flush_started", "num_memtables": 1, "num_entries": 1061, "num_deletes": 251, "memory_usage": 3002456}
- 2017-07-11 14:33:52.476962 I | rook-ceph-mon1: 2017-07-11 14:33:52.464502 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 59] Level-0 flush table #95: started
- 2017-07-11 14:33:52.572135 I | rook-ceph-mon1: 2017-07-11 14:33:52.572113 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632572105, "cf_name": "default", "job": 59, "event": "table_file_creation", "file_number": 95, "file_size": 1981484, "table_properties": {"data_size": 1974219, "index_size": 6450, "filter_size": 0, "raw_key_size": 9566, "raw_average_key_size": 18, "raw_value_size": 1962639, "raw_average_value_size": 3818, "num_data_blocks": 206, "num_entries": 514, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:33:52.572194 I | rook-ceph-mon1: 2017-07-11 14:33:52.572180 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 59] Level-0 flush table #95: 1981484 bytes OK
- 2017-07-11 14:33:52.760122 I | rook-ceph-mon1: 2017-07-11 14:33:52.760103 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.610109) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #95 started
- 2017-07-11 14:33:52.760176 I | rook-ceph-mon1: 2017-07-11 14:33:52.760163 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.760073) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #95: memtable #1 done
- 2017-07-11 14:33:52.760203 I | rook-ceph-mon1: 2017-07-11 14:33:52.760193 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.760083) EVENT_LOG_v1 {"time_micros": 1499783632760079, "job": 59, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:33:52.760242 I | rook-ceph-mon1: 2017-07-11 14:33:52.760216 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.760095) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:33:52.760260 I | rook-ceph-mon1:
- 2017-07-11 14:33:52.760289 I | rook-ceph-mon1: 2017-07-11 14:33:52.760278 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 59] Try to delete WAL files size 2979288, prev total WAL file size 2979288, number of live WAL files 2.
- 2017-07-11 14:33:52.760312 I | rook-ceph-mon1:
- 2017-07-11 14:33:52.788892 I | rook-ceph-mon1: 2017-07-11 14:33:52.779038 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:33:52.788949 I | rook-ceph-mon1: 2017-07-11 14:33:52.779171 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:33:52.788965 I | rook-ceph-mon1: 2017-07-11 14:33:52.779174 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:33:52.788977 I | rook-ceph-mon1: ** DB Stats **
- 2017-07-11 14:33:52.789002 I | rook-ceph-mon1: Uptime(secs): 4199.1 total, 623.6 interval
- 2017-07-11 14:33:52.789012 I | rook-ceph-mon1: Cumulative writes: 7164 writes, 34K keys, 7164 commit groups, 1.0 writes per commit group, ingest: 0.09 GB, 0.02 MB/s
- 2017-07-11 14:33:52.789022 I | rook-ceph-mon1: Cumulative WAL: 7164 writes, 7164 syncs, 1.00 writes per sync, written: 0.09 GB, 0.02 MB/s
- 2017-07-11 14:33:52.789032 I | rook-ceph-mon1: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:33:52.789041 I | rook-ceph-mon1: Interval writes: 1566 writes, 8675 keys, 1566 commit groups, 1.0 writes per commit group, ingest: 22.61 MB, 0.04 MB/s
- 2017-07-11 14:33:52.794820 I | rook-ceph-mon1: Interval WAL: 1566 writes, 1566 syncs, 1.00 writes per sync, written: 0.02 MB, 0.04 MB/s
- 2017-07-11 14:33:52.794909 I | rook-ceph-mon1: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:33:52.794967 I | rook-ceph-mon1:
- 2017-07-11 14:33:52.794994 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 14:33:52.795019 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:33:52.795077 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:33:52.795126 I | rook-ceph-mon1: L0 1/1 1.89 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 9.6 6 31 0.193 0 0
- 2017-07-11 14:33:52.795138 I | rook-ceph-mon1: L1 1/1 13.67 MB 0.0 0.4 0.1 0.3 0.3 0.0 0.0 6.2 32.1 28.7 12 27 0.448 62K 11K
- 2017-07-11 14:33:52.795148 I | rook-ceph-mon1: Sum 2/2 15.56 MB 0.0 0.4 0.1 0.3 0.4 0.1 0.0 7.0 21.5 22.4 18 58 0.311 62K 11K
- 2017-07-11 14:33:52.795158 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 9.8 27.8 27.8 5 19 0.275 24K 4489
- 2017-07-11 14:33:52.795168 I | rook-ceph-mon1: Uptime(secs): 4199.1 total, 4199.1 interval
- 2017-07-11 14:33:52.795177 I | rook-ceph-mon1: Flush(GB): cumulative 0.056, interval 0.014
- 2017-07-11 14:33:52.795187 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:33:52.795208 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:33:52.795218 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:33:52.795230 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:33:52.795241 I | rook-ceph-mon1: Cumulative compaction: 0.39 GB write, 0.10 MB/s write, 0.38 GB read, 0.09 MB/s read, 18.1 seconds
- 2017-07-11 14:33:52.795251 I | rook-ceph-mon1: Interval compaction: 0.14 GB write, 0.03 MB/s write, 0.14 GB read, 0.03 MB/s read, 5.2 seconds
- 2017-07-11 14:33:52.795261 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:33:52.795282 I | rook-ceph-mon1:
- 2017-07-11 14:33:52.795293 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:33:52.795302 I | rook-ceph-mon1:
- 2017-07-11 14:33:52.795312 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 14:33:52.795322 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:33:52.795332 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:33:52.795341 I | rook-ceph-mon1: L0 1/1 1.89 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 9.6 6 31 0.193 0 0
- 2017-07-11 14:33:52.795362 I | rook-ceph-mon1: L1 1/1 13.67 MB 0.0 0.4 0.1 0.3 0.3 0.0 0.0 6.2 32.1 28.7 12 27 0.448 62K 11K
- 2017-07-11 14:33:52.795373 I | rook-ceph-mon1: Sum 2/2 15.56 MB 0.0 0.4 0.1 0.3 0.4 0.1 0.0 7.0 21.5 22.4 18 58 0.311 62K 11K
- 2017-07-11 14:33:52.795382 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:33:52.795396 I | rook-ceph-mon1: Uptime(secs): 4199.1 total, 4199.1 interval
- 2017-07-11 14:33:52.795405 I | rook-ceph-mon1: Flush(GB): cumulative 0.056, interval 0.000
- 2017-07-11 14:33:52.795415 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:33:52.795436 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:33:52.795446 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:33:52.795455 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:33:52.795464 I | rook-ceph-mon1: Cumulative compaction: 0.39 GB write, 0.10 MB/s write, 0.38 GB read, 0.09 MB/s read, 18.1 seconds
- 2017-07-11 14:33:52.795474 I | rook-ceph-mon1: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:33:52.795484 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:33:52.795503 I | rook-ceph-mon1:
- 2017-07-11 14:33:52.795513 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:33:52.795523 I | rook-ceph-mon1:
- 2017-07-11 14:33:52.795532 I | rook-ceph-mon1: 2017-07-11 14:33:52.779189 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.779184) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:33:52.795541 I | rook-ceph-mon1:
- 2017-07-11 14:33:52.795553 I | rook-ceph-mon1: 2017-07-11 14:33:52.779202 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 60] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:33:52.795563 I | rook-ceph-mon1: 2017-07-11 14:33:52.779205 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 59 Base level 0, inputs: [95(1935KB)], [93(13MB)]
- 2017-07-11 14:33:52.795583 I | rook-ceph-mon1:
- 2017-07-11 14:33:52.795593 I | rook-ceph-mon1: 2017-07-11 14:33:52.779224 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632779208, "job": 60, "event": "compaction_started", "files_L0": [95], "files_L1": [93], "score": -1, "input_data_size": 16317731}
- 2017-07-11 14:33:53.038590 I | rook-ceph-mon1: 2017-07-11 14:33:53.038547 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 60] Generated table #96: 2023 keys, 13730731 bytes
- 2017-07-11 14:33:53.040927 I | rook-ceph-mon1: 2017-07-11 14:33:53.040911 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783633040901, "cf_name": "default", "job": 60, "event": "table_file_creation", "file_number": 96, "file_size": 13730731, "table_properties": {"data_size": 13685900, "index_size": 44012, "filter_size": 0, "raw_key_size": 38513, "raw_average_key_size": 19, "raw_value_size": 13626864, "raw_average_value_size": 6735, "num_data_blocks": 1352, "num_entries": 2023, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:33:53.085911 I | rook-ceph-mon1: 2017-07-11 14:33:53.085890 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 60] Compacted 1@0 + 1@1 files to L1 => 13730731 bytes
- 2017-07-11 14:33:53.114265 I | rook-ceph-mon1: 2017-07-11 14:33:53.114243 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:33:53.114180) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 53.2 rd, 44.8 wr, level 1, files in(1, 1) out(1) MB in(1.9, 13.7) out(13.1), read-write-amplify(15.2) write-amplify(6.9) OK, records in: 2532, records dropped: 509
- 2017-07-11 14:33:53.114445 I | rook-ceph-mon1:
- 2017-07-11 14:33:53.114557 I | rook-ceph-mon1: 2017-07-11 14:33:53.114540 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:33:53.114195) EVENT_LOG_v1 {"time_micros": 1499783633114188, "job": 60, "event": "compaction_finished", "compaction_time_micros": 306655, "output_level": 1, "num_output_files": 1, "total_output_size": 13730731, "num_input_records": 2532, "num_output_records": 2023, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:33:53.114974 I | rook-ceph-mon1: 2017-07-11 14:33:53.114960 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783633114958, "job": 60, "event": "table_file_deletion", "file_number": 95}
- 2017-07-11 14:33:53.124200 I | rook-ceph-mon1: 2017-07-11 14:33:53.124184 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783633124182, "job": 60, "event": "table_file_deletion", "file_number": 93}
- 2017-07-11 14:33:54.746110 I | rook-ceph-mon1: 2017-07-11 14:33:54.745666 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4749 MB, avail 94438 MB
- 2017-07-11 14:33:59.700343 I | rook-ceph-mon1: 2017-07-11 14:33:59.700080 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:33:59.700424 I | rook-ceph-mon1: 2017-07-11 14:33:59.700104 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2721028415' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:34:01.429626 I | rook-ceph-mon1: 2017-07-11 14:34:01.429599 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:34:01.429782 I | rook-ceph-mon1: 2017-07-11 14:34:01.429705 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3180242674' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:34:06.551731 I | rook-ceph-mon1: 2017-07-11 14:34:06.551699 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:34:06.551821 I | rook-ceph-mon1: 2017-07-11 14:34:06.551806 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/519480434' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:34:07.691622 I | rook-ceph-mon1: 2017-07-11 14:34:07.691592 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:07.691713 I | rook-ceph-mon1: 2017-07-11 14:34:07.691699 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1763666780' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:10.772344 I | rook-ceph-mon1: 2017-07-11 14:34:10.772317 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:34:10.772486 I | rook-ceph-mon1: 2017-07-11 14:34:10.772415 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2525464577' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:34:15.326406 I | rook-ceph-mon1: 2017-07-11 14:34:15.320640 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:15.328595 I | rook-ceph-mon1: 2017-07-11 14:34:15.326498 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1202847903' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:19.410853 I | rook-ceph-mon1: 2017-07-11 14:34:19.410823 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:34:19.416899 I | rook-ceph-mon1: 2017-07-11 14:34:19.416842 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1377525431' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:34:37.055073 I | rook-ceph-mon1: 2017-07-11 14:34:35.588917 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1208 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.179707s > max 0.05s
- 2017-07-11 14:34:44.043249 I | rook-ceph-mon1: 2017-07-11 14:34:44.043193 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:34:44.043421 I | rook-ceph-mon1: 2017-07-11 14:34:44.043346 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3331361963' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:34:54.764227 I | rook-ceph-mon1: 2017-07-11 14:34:54.764008 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4749 MB, avail 94437 MB
- 2017-07-11 14:35:00.563102 I | rook-ceph-mon1: 2017-07-11 14:35:00.563073 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:35:00.563201 I | rook-ceph-mon1: 2017-07-11 14:35:00.563186 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3321697068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:35:03.866991 I | rook-ceph-mon1: 2017-07-11 14:35:03.866960 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:35:03.867100 I | rook-ceph-mon1: 2017-07-11 14:35:03.867086 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4016865017' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:35:12.961819 I | rook-ceph-mon1: 2017-07-11 14:35:11.518246 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 950 : cluster [WRN] message from mon.0 was stamped 0.051743s in the future, clocks not synchronized
- 2017-07-11 14:35:14.424868 I | rook-ceph-mon1: 2017-07-11 14:35:14.424840 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:14.424961 I | rook-ceph-mon1: 2017-07-11 14:35:14.424948 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2230646453' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:25.192754 I | rook-ceph-mon1: 2017-07-11 14:35:25.192720 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:35:25.192854 I | rook-ceph-mon1: 2017-07-11 14:35:25.192840 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2241528618' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:35:47.850769 I | rook-ceph-mon1: 2017-07-11 14:35:47.850706 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:35:47.851071 I | rook-ceph-mon1: 2017-07-11 14:35:47.851031 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1655039175' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:35:50.568312 I | rook-ceph-mon1: 2017-07-11 14:35:50.568283 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:35:50.568479 I | rook-ceph-mon1: 2017-07-11 14:35:50.568465 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1164722654' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:35:54.764807 I | rook-ceph-mon1: 2017-07-11 14:35:54.764548 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4749 MB, avail 94437 MB
- 2017-07-11 14:35:58.812545 I | rook-ceph-mon1: 2017-07-11 14:35:58.812512 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:58.812746 I | rook-ceph-mon1: 2017-07-11 14:35:58.812646 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1209400753' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:03.772953 I | rook-ceph-mon1: 2017-07-11 14:36:03.772924 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:03.773053 I | rook-ceph-mon1: 2017-07-11 14:36:03.773039 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2244508420' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:10.320347 I | rook-ceph-mon1: 2017-07-11 14:36:10.319968 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:36:10.321602 I | rook-ceph-mon1: 2017-07-11 14:36:10.319988 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/553484974' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:36:54.717174 I | rook-ceph-mon1: 2017-07-11 14:36:54.717146 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:36:54.717343 I | rook-ceph-mon1: 2017-07-11 14:36:54.717274 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1876041272' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:36:54.765261 I | rook-ceph-mon1: 2017-07-11 14:36:54.765054 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4749 MB, avail 94437 MB
- 2017-07-11 14:36:57.176570 I | rook-ceph-mon1: 2017-07-11 14:36:57.176543 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:36:57.176672 I | rook-ceph-mon1: 2017-07-11 14:36:57.176658 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2418066621' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:37:03.126906 I | rook-ceph-mon1: 2017-07-11 14:37:03.126878 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:37:03.126988 I | rook-ceph-mon1: 2017-07-11 14:37:03.126974 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/685280156' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:37:05.757178 I | rook-ceph-mon1: 2017-07-11 14:37:05.757125 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:05.759926 I | rook-ceph-mon1: 2017-07-11 14:37:05.759910 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2546655192' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:09.495117 I | rook-ceph-mon1: 2017-07-11 14:37:09.495089 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:37:09.495224 I | rook-ceph-mon1: 2017-07-11 14:37:09.495210 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3735416763' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:37:12.474300 I | rook-ceph-mon1: 2017-07-11 14:37:12.474212 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #97. Immutable memtables: 0.
- 2017-07-11 14:37:12.474376 I | rook-ceph-mon1:
- 2017-07-11 14:37:12.474395 I | rook-ceph-mon1: 2017-07-11 14:37:12.474249 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 61] Syncing log #94
- 2017-07-11 14:37:12.516511 I | rook-ceph-mon1: 2017-07-11 14:37:12.507185 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.474244) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:37:12.516582 I | rook-ceph-mon1: 2017-07-11 14:37:12.507195 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 61] Flushing memtable with next log file: 97
- 2017-07-11 14:37:12.516608 I | rook-ceph-mon1:
- 2017-07-11 14:37:12.516620 I | rook-ceph-mon1: 2017-07-11 14:37:12.507205 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832507201, "job": 61, "event": "flush_started", "num_memtables": 1, "num_entries": 2307, "num_deletes": 251, "memory_usage": 7604208}
- 2017-07-11 14:37:12.516631 I | rook-ceph-mon1: 2017-07-11 14:37:12.507207 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 61] Level-0 flush table #98: started
- 2017-07-11 14:37:12.636730 I | rook-ceph-mon1: 2017-07-11 14:37:12.636676 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832636667, "cf_name": "default", "job": 61, "event": "table_file_creation", "file_number": 98, "file_size": 5023914, "table_properties": {"data_size": 5006413, "index_size": 16681, "filter_size": 0, "raw_key_size": 17071, "raw_average_key_size": 18, "raw_value_size": 4982269, "raw_average_value_size": 5481, "num_data_blocks": 522, "num_entries": 909, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:37:12.639034 I | rook-ceph-mon1: 2017-07-11 14:37:12.639017 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 61] Level-0 flush table #98: 5023914 bytes OK
- 2017-07-11 14:37:12.850581 I | rook-ceph-mon1: 2017-07-11 14:37:12.850541 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.654250) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #98 started
- 2017-07-11 14:37:12.851991 I | rook-ceph-mon1: 2017-07-11 14:37:12.851974 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.850484) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #98: memtable #1 done
- 2017-07-11 14:37:12.852066 I | rook-ceph-mon1: 2017-07-11 14:37:12.852021 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.850507) EVENT_LOG_v1 {"time_micros": 1499783832850501, "job": 61, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:37:12.852101 I | rook-ceph-mon1: 2017-07-11 14:37:12.852087 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.850524) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:37:12.852128 I | rook-ceph-mon1:
- 2017-07-11 14:37:12.852160 I | rook-ceph-mon1: 2017-07-11 14:37:12.852148 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 61] Try to delete WAL files size 7552372, prev total WAL file size 7552372, number of live WAL files 2.
- 2017-07-11 14:37:12.852183 I | rook-ceph-mon1:
- 2017-07-11 14:37:12.853631 I | rook-ceph-mon1: 2017-07-11 14:37:12.853244 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:37:12.853776 I | rook-ceph-mon1: 2017-07-11 14:37:12.853291 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.853286) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:37:12.853795 I | rook-ceph-mon1:
- 2017-07-11 14:37:12.853819 I | rook-ceph-mon1: 2017-07-11 14:37:12.853684 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 62] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:37:12.853832 I | rook-ceph-mon1: 2017-07-11 14:37:12.853690 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 61 Base level 0, inputs: [98(4906KB)], [96(13MB)]
- 2017-07-11 14:37:12.853842 I | rook-ceph-mon1:
- 2017-07-11 14:37:12.853852 I | rook-ceph-mon1: 2017-07-11 14:37:12.853699 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832853692, "job": 62, "event": "compaction_started", "files_L0": [98], "files_L1": [96], "score": -1, "input_data_size": 18754645}
- 2017-07-11 14:37:13.134054 I | rook-ceph-mon1: 2017-07-11 14:37:13.134012 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 62] Generated table #99: 2423 keys, 16200924 bytes
- 2017-07-11 14:37:13.136006 I | rook-ceph-mon1: 2017-07-11 14:37:13.135989 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783833135980, "cf_name": "default", "job": 62, "event": "table_file_creation", "file_number": 99, "file_size": 16200924, "table_properties": {"data_size": 16146985, "index_size": 53120, "filter_size": 0, "raw_key_size": 46363, "raw_average_key_size": 19, "raw_value_size": 16076015, "raw_average_value_size": 6634, "num_data_blocks": 1622, "num_entries": 2423, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:37:13.171549 I | rook-ceph-mon1: 2017-07-11 14:37:13.171526 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 62] Compacted 1@0 + 1@1 files to L1 => 16200924 bytes
- 2017-07-11 14:37:13.232688 I | rook-ceph-mon1: 2017-07-11 14:37:13.232652 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:37:13.232600) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 59.0 rd, 51.0 wr, level 1, files in(1, 1) out(1) MB in(4.8, 13.1) out(15.5), read-write-amplify(7.0) write-amplify(3.2) OK, records in: 2932, records dropped: 509
- 2017-07-11 14:37:13.239970 I | rook-ceph-mon1:
- 2017-07-11 14:37:13.240003 I | rook-ceph-mon1: 2017-07-11 14:37:13.239983 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:37:13.232614) EVENT_LOG_v1 {"time_micros": 1499783833232608, "job": 62, "event": "compaction_finished", "compaction_time_micros": 317814, "output_level": 1, "num_output_files": 1, "total_output_size": 16200924, "num_input_records": 2932, "num_output_records": 2423, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:37:13.240635 I | rook-ceph-mon1: 2017-07-11 14:37:13.240621 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783833240619, "job": 62, "event": "table_file_deletion", "file_number": 98}
- 2017-07-11 14:37:13.242134 I | rook-ceph-mon1: 2017-07-11 14:37:13.242120 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783833242118, "job": 62, "event": "table_file_deletion", "file_number": 96}
- 2017-07-11 14:37:19.410598 I | rook-ceph-mon1: 2017-07-11 14:37:19.410570 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:37:19.410695 I | rook-ceph-mon1: 2017-07-11 14:37:19.410682 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1519764880' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:37:39.046418 I | rook-ceph-mon1: 2017-07-11 14:37:39.046386 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:37:39.046521 I | rook-ceph-mon1: 2017-07-11 14:37:39.046507 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/71164669' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:37:41.347702 I | rook-ceph-mon1: 2017-07-11 14:37:41.347669 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:41.347916 I | rook-ceph-mon1: 2017-07-11 14:37:41.347806 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2309551667' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:41.762522 I | rook-ceph-mon1: 2017-07-11 14:37:41.762498 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:37:41.762609 I | rook-ceph-mon1: 2017-07-11 14:37:41.762595 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3663175148' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:37:54.797286 I | rook-ceph-mon1: 2017-07-11 14:37:54.797087 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4751 MB, avail 94435 MB
- 2017-07-11 14:38:01.099938 I | rook-ceph-mon1: 2017-07-11 14:38:01.099908 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:01.100105 I | rook-ceph-mon1: 2017-07-11 14:38:01.100032 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2352791962' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:01.293684 I | rook-ceph-mon1: 2017-07-11 14:38:01.293639 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:38:01.293878 I | rook-ceph-mon1: 2017-07-11 14:38:01.293864 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/219068794' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:38:13.924823 I | rook-ceph-mon1: 2017-07-11 14:38:13.923355 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #100. Immutable memtables: 0.
- 2017-07-11 14:38:13.924879 I | rook-ceph-mon1:
- 2017-07-11 14:38:13.924896 I | rook-ceph-mon1: 2017-07-11 14:38:13.923395 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 63] Syncing log #97
- 2017-07-11 14:38:13.959012 I | rook-ceph-mon1: 2017-07-11 14:38:13.951293 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:38:13.923379) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:38:13.959063 I | rook-ceph-mon1: 2017-07-11 14:38:13.951303 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 63] Flushing memtable with next log file: 100
- 2017-07-11 14:38:13.959085 I | rook-ceph-mon1:
- 2017-07-11 14:38:13.959096 I | rook-ceph-mon1: 2017-07-11 14:38:13.951312 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783893951308, "job": 63, "event": "flush_started", "num_memtables": 1, "num_entries": 1118, "num_deletes": 506, "memory_usage": 2294016}
- 2017-07-11 14:38:13.959106 I | rook-ceph-mon1: 2017-07-11 14:38:13.951314 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 63] Level-0 flush table #101: started
- 2017-07-11 14:38:14.026458 I | rook-ceph-mon1: 2017-07-11 14:38:14.026433 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783894026426, "cf_name": "default", "job": 63, "event": "table_file_creation", "file_number": 101, "file_size": 1507508, "table_properties": {"data_size": 1501788, "index_size": 4905, "filter_size": 0, "raw_key_size": 13225, "raw_average_key_size": 18, "raw_value_size": 1488887, "raw_average_value_size": 2108, "num_data_blocks": 157, "num_entries": 706, "filter_policy_name": "", "kDeletedKeys": "506", "kMergeOperands": "0"}}
- 2017-07-11 14:38:14.026518 I | rook-ceph-mon1: 2017-07-11 14:38:14.026503 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 63] Level-0 flush table #101: 1507508 bytes OK
- 2017-07-11 14:38:14.165816 I | rook-ceph-mon1: 2017-07-11 14:38:14.165752 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:38:14.051617) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #101 started
- 2017-07-11 14:38:14.175416 I | rook-ceph-mon1: 2017-07-11 14:38:14.175384 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:38:14.165678) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #101: memtable #1 done
- 2017-07-11 14:38:14.175473 I | rook-ceph-mon1: 2017-07-11 14:38:14.175458 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:38:14.165709) EVENT_LOG_v1 {"time_micros": 1499783894165699, "job": 63, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:38:14.175502 I | rook-ceph-mon1: 2017-07-11 14:38:14.175490 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:38:14.165734) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:38:14.175529 I | rook-ceph-mon1:
- 2017-07-11 14:38:14.175562 I | rook-ceph-mon1: 2017-07-11 14:38:14.175550 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 63] Try to delete WAL files size 2269283, prev total WAL file size 2269283, number of live WAL files 2.
- 2017-07-11 14:38:14.175576 I | rook-ceph-mon1:
- 2017-07-11 14:38:14.178437 I | rook-ceph-mon1: 2017-07-11 14:38:14.176106 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:38:14.178474 I | rook-ceph-mon1: 2017-07-11 14:38:14.176143 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:38:14.176138) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:38:14.178489 I | rook-ceph-mon1:
- 2017-07-11 14:38:14.178501 I | rook-ceph-mon1: 2017-07-11 14:38:14.176148 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 64] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:38:14.178512 I | rook-ceph-mon1: 2017-07-11 14:38:14.176152 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 63 Base level 0, inputs: [101(1472KB)], [99(15MB)]
- 2017-07-11 14:38:14.178522 I | rook-ceph-mon1:
- 2017-07-11 14:38:14.178548 I | rook-ceph-mon1: 2017-07-11 14:38:14.176162 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783894176154, "job": 64, "event": "compaction_started", "files_L0": [101], "files_L1": [99], "score": -1, "input_data_size": 17708432}
- 2017-07-11 14:38:14.350278 I | rook-ceph-mon1: 2017-07-11 14:38:14.350236 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 64] Generated table #102: 2110 keys, 14597081 bytes
- 2017-07-11 14:38:14.351875 I | rook-ceph-mon1: 2017-07-11 14:38:14.351857 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783894351847, "cf_name": "default", "job": 64, "event": "table_file_creation", "file_number": 102, "file_size": 14597081, "table_properties": {"data_size": 14547815, "index_size": 48447, "filter_size": 0, "raw_key_size": 40654, "raw_average_key_size": 19, "raw_value_size": 14484408, "raw_average_value_size": 6864, "num_data_blocks": 1485, "num_entries": 2110, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:38:14.495548 I | rook-ceph-mon1: 2017-07-11 14:38:14.495516 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 64] Compacted 1@0 + 1@1 files to L1 => 14597081 bytes
- 2017-07-11 14:38:14.573622 I | rook-ceph-mon1: 2017-07-11 14:38:14.573596 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:38:14.573541) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 55.5 rd, 45.7 wr, level 1, files in(1, 1) out(1) MB in(1.4, 15.5) out(13.9), read-write-amplify(21.4) write-amplify(9.7) OK, records in: 3129, records dropped: 1019
- 2017-07-11 14:38:14.573905 I | rook-ceph-mon1:
- 2017-07-11 14:38:14.573956 I | rook-ceph-mon1: 2017-07-11 14:38:14.573938 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:38:14.573556) EVENT_LOG_v1 {"time_micros": 1499783894573550, "job": 64, "event": "compaction_finished", "compaction_time_micros": 319340, "output_level": 1, "num_output_files": 1, "total_output_size": 14597081, "num_input_records": 3129, "num_output_records": 2110, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:38:14.574291 I | rook-ceph-mon1: 2017-07-11 14:38:14.574277 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783894574274, "job": 64, "event": "table_file_deletion", "file_number": 101}
- 2017-07-11 14:38:14.576398 I | rook-ceph-mon1: 2017-07-11 14:38:14.576377 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783894576374, "job": 64, "event": "table_file_deletion", "file_number": 99}
- 2017-07-11 14:38:14.576464 I | rook-ceph-mon1: 2017-07-11 14:38:14.576451 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:38:54.820968 I | rook-ceph-mon1: 2017-07-11 14:38:54.820737 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4750 MB, avail 94436 MB
- 2017-07-11 14:39:07.736862 I | rook-ceph-mon1: 2017-07-11 14:39:07.736834 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:39:07.736953 I | rook-ceph-mon1: 2017-07-11 14:39:07.736939 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3596764877' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:39:10.802623 I | rook-ceph-mon1: 2017-07-11 14:39:10.802593 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:39:10.804639 I | rook-ceph-mon1: 2017-07-11 14:39:10.804623 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1854147795' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:39:20.014783 I | rook-ceph-mon1: 2017-07-11 14:39:20.014599 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:20.017198 I | rook-ceph-mon1: 2017-07-11 14:39:20.017178 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3833648519' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:25.654007 I | rook-ceph-mon1: 2017-07-11 14:39:25.653971 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:25.654290 I | rook-ceph-mon1: 2017-07-11 14:39:25.654252 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3983507110' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:29.862255 I | rook-ceph-mon1: 2017-07-11 14:39:29.862210 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:29.862432 I | rook-ceph-mon1: 2017-07-11 14:39:29.862360 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/565684756' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:36.579639 I | rook-ceph-mon1: 2017-07-11 14:39:35.602815 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1379 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0541632s > max 0.05s
- 2017-07-11 14:39:36.579883 I | rook-ceph-mon1: 2017-07-11 14:39:35.606906 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1380 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.155999s > max 0.05s
- 2017-07-11 14:39:39.748060 I | rook-ceph-mon1: 2017-07-11 14:39:39.748027 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:39.749145 I | rook-ceph-mon1: 2017-07-11 14:39:39.749129 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4241684251' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:51.875742 I | rook-ceph-mon1: 2017-07-11 14:39:51.875693 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:39:51.875964 I | rook-ceph-mon1: 2017-07-11 14:39:51.875891 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3961655978' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:39:54.823078 I | rook-ceph-mon1: 2017-07-11 14:39:54.821602 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4750 MB, avail 94436 MB
- 2017-07-11 14:40:06.736384 I | rook-ceph-mon1: 2017-07-11 14:40:05.332750 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1397 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:40:09.415560 I | rook-ceph-mon1: 2017-07-11 14:40:09.415491 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:09.415727 I | rook-ceph-mon1: 2017-07-11 14:40:09.415652 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/307861787' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:14.139060 I | rook-ceph-mon1: 2017-07-11 14:40:14.139027 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:40:14.139245 I | rook-ceph-mon1: 2017-07-11 14:40:14.139229 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3736452220' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:40:23.973578 I | rook-ceph-mon1: 2017-07-11 14:40:23.973369 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #103. Immutable memtables: 0.
- 2017-07-11 14:40:23.973650 I | rook-ceph-mon1:
- 2017-07-11 14:40:23.973666 I | rook-ceph-mon1: 2017-07-11 14:40:23.973516 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 65] Syncing log #100
- 2017-07-11 14:40:23.990102 I | rook-ceph-mon1: 2017-07-11 14:40:23.989405 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:40:23.973511) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:40:23.990144 I | rook-ceph-mon1: 2017-07-11 14:40:23.989412 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 65] Flushing memtable with next log file: 103
- 2017-07-11 14:40:23.990164 I | rook-ceph-mon1:
- 2017-07-11 14:40:23.990186 I | rook-ceph-mon1: 2017-07-11 14:40:23.989419 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784023989416, "job": 65, "event": "flush_started", "num_memtables": 1, "num_entries": 1606, "num_deletes": 254, "memory_usage": 5006440}
- 2017-07-11 14:40:23.990208 I | rook-ceph-mon1: 2017-07-11 14:40:23.989421 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 65] Level-0 flush table #104: started
- 2017-07-11 14:40:24.115466 I | rook-ceph-mon1: 2017-07-11 14:40:24.115433 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784024115425, "cf_name": "default", "job": 65, "event": "table_file_creation", "file_number": 104, "file_size": 2919306, "table_properties": {"data_size": 2909539, "index_size": 8949, "filter_size": 0, "raw_key_size": 12218, "raw_average_key_size": 19, "raw_value_size": 2894607, "raw_average_value_size": 4594, "num_data_blocks": 284, "num_entries": 630, "filter_policy_name": "", "kDeletedKeys": "254", "kMergeOperands": "0"}}
- 2017-07-11 14:40:24.118093 I | rook-ceph-mon1: 2017-07-11 14:40:24.118075 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 65] Level-0 flush table #104: 2919306 bytes OK
- 2017-07-11 14:40:24.172390 I | rook-ceph-mon1: 2017-07-11 14:40:24.172368 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:40:24.143433) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #104 started
- 2017-07-11 14:40:24.172543 I | rook-ceph-mon1: 2017-07-11 14:40:24.172527 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:40:24.172337) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #104: memtable #1 done
- 2017-07-11 14:40:24.172698 I | rook-ceph-mon1: 2017-07-11 14:40:24.172682 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:40:24.172346) EVENT_LOG_v1 {"time_micros": 1499784024172343, "job": 65, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:40:24.172745 I | rook-ceph-mon1: 2017-07-11 14:40:24.172731 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:40:24.172359) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:40:24.172805 I | rook-ceph-mon1:
- 2017-07-11 14:40:24.172836 I | rook-ceph-mon1: 2017-07-11 14:40:24.172823 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 65] Try to delete WAL files size 4973235, prev total WAL file size 4973235, number of live WAL files 2.
- 2017-07-11 14:40:24.172879 I | rook-ceph-mon1:
- 2017-07-11 14:40:24.182165 I | rook-ceph-mon1: 2017-07-11 14:40:24.174620 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:40:24.182215 I | rook-ceph-mon1: 2017-07-11 14:40:24.174655 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:40:24.174650) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:40:24.182276 I | rook-ceph-mon1:
- 2017-07-11 14:40:24.182292 I | rook-ceph-mon1: 2017-07-11 14:40:24.174660 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 66] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:40:24.182318 I | rook-ceph-mon1: 2017-07-11 14:40:24.174664 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 65 Base level 0, inputs: [104(2850KB)], [102(13MB)]
- 2017-07-11 14:40:24.182329 I | rook-ceph-mon1:
- 2017-07-11 14:40:24.182339 I | rook-ceph-mon1: 2017-07-11 14:40:24.174672 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784024174666, "job": 66, "event": "compaction_started", "files_L0": [104], "files_L1": [102], "score": -1, "input_data_size": 17516387}
- 2017-07-11 14:40:24.428941 I | rook-ceph-mon1: 2017-07-11 14:40:24.428906 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 66] Generated table #105: 2284 keys, 16229111 bytes
- 2017-07-11 14:40:24.429021 I | rook-ceph-mon1: 2017-07-11 14:40:24.429006 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784024428998, "cf_name": "default", "job": 66, "event": "table_file_creation", "file_number": 105, "file_size": 16229111, "table_properties": {"data_size": 16177129, "index_size": 51163, "filter_size": 0, "raw_key_size": 43705, "raw_average_key_size": 19, "raw_value_size": 16109509, "raw_average_value_size": 7053, "num_data_blocks": 1573, "num_entries": 2284, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:40:24.558601 I | rook-ceph-mon1: 2017-07-11 14:40:24.558573 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 66] Compacted 1@0 + 1@1 files to L1 => 16229111 bytes
- 2017-07-11 14:40:24.614011 I | rook-ceph-mon1: 2017-07-11 14:40:24.603631 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:40:24.603569) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 45.6 rd, 42.3 wr, level 1, files in(1, 1) out(1) MB in(2.8, 13.9) out(15.5), read-write-amplify(11.6) write-amplify(5.6) OK, records in: 2740, records dropped: 456
- 2017-07-11 14:40:24.614064 I | rook-ceph-mon1:
- 2017-07-11 14:40:24.614081 I | rook-ceph-mon1: 2017-07-11 14:40:24.603636 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:40:24.603586) EVENT_LOG_v1 {"time_micros": 1499784024603578, "job": 66, "event": "compaction_finished", "compaction_time_micros": 383888, "output_level": 1, "num_output_files": 1, "total_output_size": 16229111, "num_input_records": 2740, "num_output_records": 2284, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:40:24.614094 I | rook-ceph-mon1: 2017-07-11 14:40:24.604003 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784024604001, "job": 66, "event": "table_file_deletion", "file_number": 104}
- 2017-07-11 14:40:24.614117 I | rook-ceph-mon1: 2017-07-11 14:40:24.605409 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784024605408, "job": 66, "event": "table_file_deletion", "file_number": 102}
- 2017-07-11 14:40:24.614129 I | rook-ceph-mon1: 2017-07-11 14:40:24.613978 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:40:25.218247 I | rook-ceph-mon1: 2017-07-11 14:40:25.218116 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:40:25.218312 I | rook-ceph-mon1: 2017-07-11 14:40:25.218135 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2159303475' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:40:31.949205 I | rook-ceph-mon1: 2017-07-11 14:40:31.949115 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #106. Immutable memtables: 0.
- 2017-07-11 14:40:31.949271 I | rook-ceph-mon1:
- 2017-07-11 14:40:31.949287 I | rook-ceph-mon1: 2017-07-11 14:40:31.949142 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 67] Syncing log #103
- 2017-07-11 14:40:32.040157 I | rook-ceph-mon1: 2017-07-11 14:40:32.037033 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:40:31.949136) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:40:32.040202 I | rook-ceph-mon1: 2017-07-11 14:40:32.037041 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 67] Flushing memtable with next log file: 106
- 2017-07-11 14:40:32.040217 I | rook-ceph-mon1:
- 2017-07-11 14:40:32.040228 I | rook-ceph-mon1: 2017-07-11 14:40:32.037048 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784032037045, "job": 67, "event": "flush_started", "num_memtables": 1, "num_entries": 339, "num_deletes": 251, "memory_usage": 334368}
- 2017-07-11 14:40:32.040238 I | rook-ceph-mon1: 2017-07-11 14:40:32.037050 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 67] Level-0 flush table #107: started
- 2017-07-11 14:40:32.250944 I | rook-ceph-mon1: 2017-07-11 14:40:32.250914 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784032250905, "cf_name": "default", "job": 67, "event": "table_file_creation", "file_number": 107, "file_size": 215737, "table_properties": {"data_size": 214220, "index_size": 703, "filter_size": 0, "raw_key_size": 5215, "raw_average_key_size": 18, "raw_value_size": 209927, "raw_average_value_size": 736, "num_data_blocks": 23, "num_entries": 285, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:40:32.251103 I | rook-ceph-mon1: 2017-07-11 14:40:32.251025 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 67] Level-0 flush table #107: 215737 bytes OK
- 2017-07-11 14:40:32.296399 I | rook-ceph-mon1: 2017-07-11 14:40:32.296342 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:40:32.266764) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #107 started
- 2017-07-11 14:40:32.296481 I | rook-ceph-mon1: 2017-07-11 14:40:32.296467 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:40:32.296268) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #107: memtable #1 done
- 2017-07-11 14:40:32.296512 I | rook-ceph-mon1: 2017-07-11 14:40:32.296501 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:40:32.296289) EVENT_LOG_v1 {"time_micros": 1499784032296281, "job": 67, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:40:32.296552 I | rook-ceph-mon1: 2017-07-11 14:40:32.296540 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:40:32.296326) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:40:32.296566 I | rook-ceph-mon1:
- 2017-07-11 14:40:32.296597 I | rook-ceph-mon1: 2017-07-11 14:40:32.296586 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 67] Try to delete WAL files size 324931, prev total WAL file size 324931, number of live WAL files 2.
- 2017-07-11 14:40:32.296621 I | rook-ceph-mon1:
- 2017-07-11 14:40:32.296864 I | rook-ceph-mon1: 2017-07-11 14:40:32.296832 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:40:32.297003 I | rook-ceph-mon1: 2017-07-11 14:40:32.296919 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:40:32.296913) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:40:32.297021 I | rook-ceph-mon1:
- 2017-07-11 14:40:32.297032 I | rook-ceph-mon1: 2017-07-11 14:40:32.296924 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 68] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:40:32.297060 I | rook-ceph-mon1: 2017-07-11 14:40:32.296928 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 67 Base level 0, inputs: [107(210KB)], [105(15MB)]
- 2017-07-11 14:40:32.297070 I | rook-ceph-mon1:
- 2017-07-11 14:40:32.297080 I | rook-ceph-mon1: 2017-07-11 14:40:32.296938 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784032296930, "job": 68, "event": "compaction_started", "files_L0": [107], "files_L1": [105], "score": -1, "input_data_size": 16444848}
- 2017-07-11 14:40:32.487445 I | rook-ceph-mon1: 2017-07-11 14:40:32.487401 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 68] Generated table #108: 2060 keys, 13903481 bytes
- 2017-07-11 14:40:32.488357 I | rook-ceph-mon1: 2017-07-11 14:40:32.488338 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784032488329, "cf_name": "default", "job": 68, "event": "table_file_creation", "file_number": 108, "file_size": 13903481, "table_properties": {"data_size": 13858543, "index_size": 44119, "filter_size": 0, "raw_key_size": 39699, "raw_average_key_size": 19, "raw_value_size": 13798842, "raw_average_value_size": 6698, "num_data_blocks": 1344, "num_entries": 2060, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:40:32.584061 I | rook-ceph-mon1: 2017-07-11 14:40:32.584040 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 68] Compacted 1@0 + 1@1 files to L1 => 13903481 bytes
- 2017-07-11 14:40:32.612633 I | rook-ceph-mon1: 2017-07-11 14:40:32.612610 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:40:32.612553) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 57.3 rd, 48.4 wr, level 1, files in(1, 1) out(1) MB in(0.2, 15.5) out(13.3), read-write-amplify(140.7) write-amplify(64.4) OK, records in: 2569, records dropped: 509
- 2017-07-11 14:40:32.615574 I | rook-ceph-mon1:
- 2017-07-11 14:40:32.615621 I | rook-ceph-mon1: 2017-07-11 14:40:32.615605 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:40:32.612569) EVENT_LOG_v1 {"time_micros": 1499784032612562, "job": 68, "event": "compaction_finished", "compaction_time_micros": 287090, "output_level": 1, "num_output_files": 1, "total_output_size": 13903481, "num_input_records": 2569, "num_output_records": 2060, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:40:32.615822 I | rook-ceph-mon1: 2017-07-11 14:40:32.615793 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784032615791, "job": 68, "event": "table_file_deletion", "file_number": 107}
- 2017-07-11 14:40:32.633788 I | rook-ceph-mon1: 2017-07-11 14:40:32.633769 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784032633766, "job": 68, "event": "table_file_deletion", "file_number": 105}
- 2017-07-11 14:40:36.324430 I | rook-ceph-mon1: 2017-07-11 14:40:36.324399 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:40:36.324594 I | rook-ceph-mon1: 2017-07-11 14:40:36.324528 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3969001289' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:40:39.941547 I | rook-ceph-mon1: 2017-07-11 14:40:39.941503 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:39.941747 I | rook-ceph-mon1: 2017-07-11 14:40:39.941647 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3625342847' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:40.119702 I | rook-ceph-mon1: 2017-07-11 14:40:40.119671 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:40:40.119871 I | rook-ceph-mon1: 2017-07-11 14:40:40.119796 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3272465850' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:40:47.461216 I | rook-ceph-mon1: 2017-07-11 14:40:47.461177 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:40:47.462960 I | rook-ceph-mon1: 2017-07-11 14:40:47.462935 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2440598545' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:40:50.106823 I | rook-ceph-mon1: 2017-07-11 14:40:50.106782 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:50.106914 I | rook-ceph-mon1: 2017-07-11 14:40:50.106900 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3235450341' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:51.081279 I | rook-ceph-mon1: 2017-07-11 14:40:51.081254 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:40:51.081367 I | rook-ceph-mon1: 2017-07-11 14:40:51.081353 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4189759672' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:40:54.823702 I | rook-ceph-mon1: 2017-07-11 14:40:54.823381 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4750 MB, avail 94437 MB
- 2017-07-11 14:40:56.975908 I | rook-ceph-mon1: 2017-07-11 14:40:56.975885 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:56.975991 I | rook-ceph-mon1: 2017-07-11 14:40:56.975977 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2979005844' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:05.856202 I | rook-ceph-mon1: 2017-07-11 14:41:05.856166 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"} v 0) v1
- 2017-07-11 14:41:05.856452 I | rook-ceph-mon1: 2017-07-11 14:41:05.856425 7f0040b3f700 0 log_channel(audit) log [INF] : from='client.? 10.233.99.0:0/2415758692' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:41:06.752976 I | rook-ceph-mon1: 2017-07-11 14:41:05.711585 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1429 : audit [INF] from='client.5776 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:41:06.753248 I | rook-ceph-mon1: 2017-07-11 14:41:05.856584 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 1016 : audit [INF] from='client.? 10.233.99.0:0/2415758692' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:41:20.771099 I | rook-ceph-mon1: 2017-07-11 14:41:20.771047 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:20.772510 I | rook-ceph-mon1: 2017-07-11 14:41:20.772464 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/176397836' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:29.093758 I | rook-ceph-mon1: 2017-07-11 14:41:29.093724 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:41:29.093931 I | rook-ceph-mon1: 2017-07-11 14:41:29.093854 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/545352079' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:41:43.158465 I | rook-ceph-mon1: 2017-07-11 14:41:43.158435 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:43.158648 I | rook-ceph-mon1: 2017-07-11 14:41:43.158562 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/712375191' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:52.393271 I | rook-ceph-mon1: 2017-07-11 14:41:52.393229 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:41:52.393485 I | rook-ceph-mon1: 2017-07-11 14:41:52.393436 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3077772157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:41:54.824474 I | rook-ceph-mon1: 2017-07-11 14:41:54.824250 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4750 MB, avail 94437 MB
- 2017-07-11 14:41:57.754758 I | rook-ceph-mon1: 2017-07-11 14:41:57.754725 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:57.754978 I | rook-ceph-mon1: 2017-07-11 14:41:57.754949 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/14538922' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:11.266459 I | rook-ceph-mon1: 2017-07-11 14:42:11.266421 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:11.266514 I | rook-ceph-mon1: 2017-07-11 14:42:11.266499 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4095674885' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:27.663968 I | rook-ceph-mon1: 2017-07-11 14:42:27.663929 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:27.664131 I | rook-ceph-mon1: 2017-07-11 14:42:27.664057 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3180411951' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:35.292503 I | rook-ceph-mon1: 2017-07-11 14:42:35.292475 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:42:35.292586 I | rook-ceph-mon1: 2017-07-11 14:42:35.292573 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2571686361' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:42:38.321839 I | rook-ceph-mon1: 2017-07-11 14:42:38.321799 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:38.321932 I | rook-ceph-mon1: 2017-07-11 14:42:38.321919 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2720202951' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:46.605409 I | rook-ceph-mon1: 2017-07-11 14:42:46.605090 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:42:46.605472 I | rook-ceph-mon1: 2017-07-11 14:42:46.605110 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1908628633' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:42:54.828926 I | rook-ceph-mon1: 2017-07-11 14:42:54.828729 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4750 MB, avail 94436 MB
- 2017-07-11 14:42:57.011511 I | rook-ceph-mon1: 2017-07-11 14:42:57.011383 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:57.011582 I | rook-ceph-mon1: 2017-07-11 14:42:57.011403 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2953788999' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:15.289718 I | rook-ceph-mon1: 2017-07-11 14:43:15.286327 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:15.315677 I | rook-ceph-mon1: 2017-07-11 14:43:15.315647 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3519282116' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:19.207524 I | rook-ceph-mon1: 2017-07-11 14:43:19.207493 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:19.207703 I | rook-ceph-mon1: 2017-07-11 14:43:19.207618 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3559225377' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:22.849184 I | rook-ceph-mon1: 2017-07-11 14:43:22.849155 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:22.849424 I | rook-ceph-mon1: 2017-07-11 14:43:22.849410 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1414077518' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:30.501213 I | rook-ceph-mon1: 2017-07-11 14:43:30.501186 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:30.501306 I | rook-ceph-mon1: 2017-07-11 14:43:30.501292 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1869963160' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:44.296773 I | rook-ceph-mon1: 2017-07-11 14:43:44.296720 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #109. Immutable memtables: 0.
- 2017-07-11 14:43:44.297380 I | rook-ceph-mon1:
- 2017-07-11 14:43:44.297412 I | rook-ceph-mon1: 2017-07-11 14:43:44.296753 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 69] Syncing log #106
- 2017-07-11 14:43:44.354180 I | rook-ceph-mon1: 2017-07-11 14:43:44.344027 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.296748) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:43:44.354226 I | rook-ceph-mon1: 2017-07-11 14:43:44.344035 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 69] Flushing memtable with next log file: 109
- 2017-07-11 14:43:44.354242 I | rook-ceph-mon1:
- 2017-07-11 14:43:44.354253 I | rook-ceph-mon1: 2017-07-11 14:43:44.344043 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224344040, "job": 69, "event": "flush_started", "num_memtables": 1, "num_entries": 2520, "num_deletes": 508, "memory_usage": 7502048}
- 2017-07-11 14:43:44.354264 I | rook-ceph-mon1: 2017-07-11 14:43:44.344045 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 69] Level-0 flush table #110: started
- 2017-07-11 14:43:44.442802 I | rook-ceph-mon1: 2017-07-11 14:43:44.442763 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224442753, "cf_name": "default", "job": 69, "event": "table_file_creation", "file_number": 110, "file_size": 4952867, "table_properties": {"data_size": 4935718, "index_size": 16330, "filter_size": 0, "raw_key_size": 22211, "raw_average_key_size": 19, "raw_value_size": 4908620, "raw_average_value_size": 4257, "num_data_blocks": 511, "num_entries": 1153, "filter_policy_name": "", "kDeletedKeys": "508", "kMergeOperands": "0"}}
- 2017-07-11 14:43:44.442904 I | rook-ceph-mon1: 2017-07-11 14:43:44.442888 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 69] Level-0 flush table #110: 4952867 bytes OK
- 2017-07-11 14:43:44.530265 I | rook-ceph-mon1: 2017-07-11 14:43:44.530242 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.490488) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #110 started
- 2017-07-11 14:43:44.530476 I | rook-ceph-mon1: 2017-07-11 14:43:44.530459 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.530210) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #110: memtable #1 done
- 2017-07-11 14:43:44.530519 I | rook-ceph-mon1: 2017-07-11 14:43:44.530505 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.530220) EVENT_LOG_v1 {"time_micros": 1499784224530216, "job": 69, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:43:44.530656 I | rook-ceph-mon1: 2017-07-11 14:43:44.530641 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.530233) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:43:44.530693 I | rook-ceph-mon1:
- 2017-07-11 14:43:44.530873 I | rook-ceph-mon1: 2017-07-11 14:43:44.530712 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 69] Try to delete WAL files size 7448737, prev total WAL file size 7448737, number of live WAL files 2.
- 2017-07-11 14:43:44.530892 I | rook-ceph-mon1:
- 2017-07-11 14:43:44.539958 I | rook-ceph-mon1: 2017-07-11 14:43:44.531903 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:43:44.540015 I | rook-ceph-mon1: 2017-07-11 14:43:44.531936 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.531931) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:43:44.540030 I | rook-ceph-mon1:
- 2017-07-11 14:43:44.540044 I | rook-ceph-mon1: 2017-07-11 14:43:44.531941 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 70] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:43:44.540056 I | rook-ceph-mon1: 2017-07-11 14:43:44.531945 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 69 Base level 0, inputs: [110(4836KB)], [108(13MB)]
- 2017-07-11 14:43:44.540082 I | rook-ceph-mon1:
- 2017-07-11 14:43:44.540092 I | rook-ceph-mon1: 2017-07-11 14:43:44.531953 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224531947, "job": 70, "event": "compaction_started", "files_L0": [110], "files_L1": [108], "score": -1, "input_data_size": 18856348}
- 2017-07-11 14:43:44.872367 I | rook-ceph-mon1: 2017-07-11 14:43:44.872324 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 70] Generated table #111: 2190 keys, 15738958 bytes
- 2017-07-11 14:43:44.873380 I | rook-ceph-mon1: 2017-07-11 14:43:44.873363 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224873355, "cf_name": "default", "job": 70, "event": "table_file_creation", "file_number": 111, "file_size": 15738958, "table_properties": {"data_size": 15687425, "index_size": 50714, "filter_size": 0, "raw_key_size": 41914, "raw_average_key_size": 19, "raw_value_size": 15621416, "raw_average_value_size": 7133, "num_data_blocks": 1564, "num_entries": 2190, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:43:44.908853 I | rook-ceph-mon1: 2017-07-11 14:43:44.908832 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 70] Compacted 1@0 + 1@1 files to L1 => 15738958 bytes
- 2017-07-11 14:43:44.968443 I | rook-ceph-mon1: 2017-07-11 14:43:44.968335 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:44.968483 I | rook-ceph-mon1: 2017-07-11 14:43:44.968354 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2216265299' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:45.005870 I | rook-ceph-mon1: 2017-07-11 14:43:45.005844 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:43:45.005783) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 50.0 rd, 41.8 wr, level 1, files in(1, 1) out(1) MB in(4.7, 13.3) out(15.0), read-write-amplify(7.0) write-amplify(3.2) OK, records in: 3213, records dropped: 1023
- 2017-07-11 14:43:45.006135 I | rook-ceph-mon1:
- 2017-07-11 14:43:45.006176 I | rook-ceph-mon1: 2017-07-11 14:43:45.006160 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:43:45.005797) EVENT_LOG_v1 {"time_micros": 1499784225005791, "job": 70, "event": "compaction_finished", "compaction_time_micros": 376869, "output_level": 1, "num_output_files": 1, "total_output_size": 15738958, "num_input_records": 3213, "num_output_records": 2190, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:43:45.007851 I | rook-ceph-mon1: 2017-07-11 14:43:45.007778 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784225007775, "job": 70, "event": "table_file_deletion", "file_number": 110}
- 2017-07-11 14:43:45.025844 I | rook-ceph-mon1: 2017-07-11 14:43:45.025817 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784225025815, "job": 70, "event": "table_file_deletion", "file_number": 108}
- 2017-07-11 14:43:45.025919 I | rook-ceph-mon1: 2017-07-11 14:43:45.025902 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:43:48.125847 I | rook-ceph-mon1: 2017-07-11 14:43:48.125689 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #112. Immutable memtables: 0.
- 2017-07-11 14:43:48.125912 I | rook-ceph-mon1:
- 2017-07-11 14:43:48.125937 I | rook-ceph-mon1: 2017-07-11 14:43:48.125761 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 71] Syncing log #109
- 2017-07-11 14:43:48.183761 I | rook-ceph-mon1: 2017-07-11 14:43:48.183148 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:43:48.125755) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:43:48.183810 I | rook-ceph-mon1: 2017-07-11 14:43:48.183164 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 71] Flushing memtable with next log file: 112
- 2017-07-11 14:43:48.183825 I | rook-ceph-mon1:
- 2017-07-11 14:43:48.183836 I | rook-ceph-mon1: 2017-07-11 14:43:48.183190 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784228183173, "job": 71, "event": "flush_started", "num_memtables": 1, "num_entries": 298, "num_deletes": 251, "memory_usage": 180176}
- 2017-07-11 14:43:48.183846 I | rook-ceph-mon1: 2017-07-11 14:43:48.183191 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 71] Level-0 flush table #113: started
- 2017-07-11 14:43:48.244973 I | rook-ceph-mon1: 2017-07-11 14:43:48.244932 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784228244925, "cf_name": "default", "job": 71, "event": "table_file_creation", "file_number": 113, "file_size": 113634, "table_properties": {"data_size": 112456, "index_size": 364, "filter_size": 0, "raw_key_size": 4968, "raw_average_key_size": 18, "raw_value_size": 108591, "raw_average_value_size": 399, "num_data_blocks": 12, "num_entries": 272, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:43:48.245011 I | rook-ceph-mon1: 2017-07-11 14:43:48.244939 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 71] Level-0 flush table #113: 113634 bytes OK
- 2017-07-11 14:43:48.313225 I | rook-ceph-mon1: 2017-07-11 14:43:48.309502 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:43:48.260851) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #113 started
- 2017-07-11 14:43:48.313266 I | rook-ceph-mon1: 2017-07-11 14:43:48.309507 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:43:48.309471) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #113: memtable #1 done
- 2017-07-11 14:43:48.313282 I | rook-ceph-mon1: 2017-07-11 14:43:48.309508 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:43:48.309481) EVENT_LOG_v1 {"time_micros": 1499784228309477, "job": 71, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:43:48.313303 I | rook-ceph-mon1: 2017-07-11 14:43:48.309512 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:43:48.309491) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:43:48.313318 I | rook-ceph-mon1:
- 2017-07-11 14:43:48.313338 I | rook-ceph-mon1: 2017-07-11 14:43:48.309516 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 71] Try to delete WAL files size 171491, prev total WAL file size 171491, number of live WAL files 2.
- 2017-07-11 14:43:48.313348 I | rook-ceph-mon1:
- 2017-07-11 14:43:48.313357 I | rook-ceph-mon1: 2017-07-11 14:43:48.309599 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:43:48.313367 I | rook-ceph-mon1: 2017-07-11 14:43:48.309625 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:43:48.309620) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:43:48.313377 I | rook-ceph-mon1:
- 2017-07-11 14:43:48.313387 I | rook-ceph-mon1: 2017-07-11 14:43:48.309629 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 72] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:43:48.313408 I | rook-ceph-mon1: 2017-07-11 14:43:48.309633 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 71 Base level 0, inputs: [113(110KB)], [111(15MB)]
- 2017-07-11 14:43:48.313418 I | rook-ceph-mon1:
- 2017-07-11 14:43:48.313428 I | rook-ceph-mon1: 2017-07-11 14:43:48.309641 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784228309635, "job": 72, "event": "compaction_started", "files_L0": [113], "files_L1": [111], "score": -1, "input_data_size": 15852592}
- 2017-07-11 14:43:48.544281 I | rook-ceph-mon1: 2017-07-11 14:43:48.544236 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 72] Generated table #114: 1953 keys, 13316922 bytes
- 2017-07-11 14:43:48.545250 I | rook-ceph-mon1: 2017-07-11 14:43:48.545229 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784228545220, "cf_name": "default", "job": 72, "event": "table_file_creation", "file_number": 114, "file_size": 13316922, "table_properties": {"data_size": 13272757, "index_size": 43346, "filter_size": 0, "raw_key_size": 37661, "raw_average_key_size": 19, "raw_value_size": 13215072, "raw_average_value_size": 6766, "num_data_blocks": 1325, "num_entries": 1953, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:43:48.659760 I | rook-ceph-mon1: 2017-07-11 14:43:48.659738 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 72] Compacted 1@0 + 1@1 files to L1 => 13316922 bytes
- 2017-07-11 14:43:48.698527 I | rook-ceph-mon1: 2017-07-11 14:43:48.698484 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:43:48.698417) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 45.3 rd, 38.0 wr, level 1, files in(1, 1) out(1) MB in(0.1, 15.0) out(12.7), read-write-amplify(256.7) write-amplify(117.2) OK, records in: 2462, records dropped: 509
- 2017-07-11 14:43:48.698583 I | rook-ceph-mon1:
- 2017-07-11 14:43:48.698615 I | rook-ceph-mon1: 2017-07-11 14:43:48.698600 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:43:48.698432) EVENT_LOG_v1 {"time_micros": 1499784228698426, "job": 72, "event": "compaction_finished", "compaction_time_micros": 350085, "output_level": 1, "num_output_files": 1, "total_output_size": 13316922, "num_input_records": 2462, "num_output_records": 1953, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:43:48.698777 I | rook-ceph-mon1: 2017-07-11 14:43:48.698763 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784228698760, "job": 72, "event": "table_file_deletion", "file_number": 113}
- 2017-07-11 14:43:48.700479 I | rook-ceph-mon1: 2017-07-11 14:43:48.700465 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784228700463, "job": 72, "event": "table_file_deletion", "file_number": 111}
- 2017-07-11 14:43:54.837092 I | rook-ceph-mon1: 2017-07-11 14:43:54.836867 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4749 MB, avail 94437 MB
- 2017-07-11 14:43:55.411942 I | rook-ceph-mon1: 2017-07-11 14:43:54.197025 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1526 : cluster [WRN] message from mon.1 was stamped 0.213162s in the future, clocks not synchronized
- 2017-07-11 14:43:56.082153 I | rook-ceph-mon1: 2017-07-11 14:43:56.082120 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:56.082325 I | rook-ceph-mon1: 2017-07-11 14:43:56.082241 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3573206905' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:56.771165 I | rook-ceph-mon1: 2017-07-11 14:43:56.771125 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:56.777211 I | rook-ceph-mon1: 2017-07-11 14:43:56.777192 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2078542845' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:03.900245 I | rook-ceph-mon1: 2017-07-11 14:44:03.900218 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:03.900332 I | rook-ceph-mon1: 2017-07-11 14:44:03.900318 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2701546754' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:09.199534 I | rook-ceph-mon1: 2017-07-11 14:44:09.199502 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:44:09.199635 I | rook-ceph-mon1: 2017-07-11 14:44:09.199621 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/65520725' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:44:11.026632 I | rook-ceph-mon1: 2017-07-11 14:44:11.026601 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:11.026813 I | rook-ceph-mon1: 2017-07-11 14:44:11.026732 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1251036518' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:36.460205 I | rook-ceph-mon1: 2017-07-11 14:44:35.622703 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1554 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.159445s > max 0.05s
- 2017-07-11 14:44:44.653339 I | rook-ceph-mon1: 2017-07-11 14:44:44.653311 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:44.653429 I | rook-ceph-mon1: 2017-07-11 14:44:44.653415 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1124285525' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:48.544825 I | rook-ceph-mon1: 2017-07-11 14:44:48.544801 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:48.544915 I | rook-ceph-mon1: 2017-07-11 14:44:48.544901 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/160845732' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:51.605512 I | rook-ceph-mon1: 2017-07-11 14:44:51.605484 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:51.605685 I | rook-ceph-mon1: 2017-07-11 14:44:51.605605 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4032926526' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:54.871528 I | rook-ceph-mon1: 2017-07-11 14:44:54.871348 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4749 MB, avail 94437 MB
- 2017-07-11 14:45:02.780500 I | rook-ceph-mon1: 2017-07-11 14:45:02.780450 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:02.780734 I | rook-ceph-mon1: 2017-07-11 14:45:02.780703 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/998364352' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:05.915276 I | rook-ceph-mon1: 2017-07-11 14:45:05.334218 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1567 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:45:06.739601 I | rook-ceph-mon1: 2017-07-11 14:45:06.739559 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:06.739694 I | rook-ceph-mon1: 2017-07-11 14:45:06.739679 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/143182610' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:08.562418 I | rook-ceph-mon1: 2017-07-11 14:45:08.562386 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:08.568082 I | rook-ceph-mon1: 2017-07-11 14:45:08.568064 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1964629379' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:10.730456 I | rook-ceph-mon1: 2017-07-11 14:45:10.730424 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:10.730556 I | rook-ceph-mon1: 2017-07-11 14:45:10.730542 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1343691471' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:14.137442 I | rook-ceph-mon1: 2017-07-11 14:45:14.137415 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:14.137676 I | rook-ceph-mon1: 2017-07-11 14:45:14.137662 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1002584155' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:19.553634 I | rook-ceph-mon1: 2017-07-11 14:45:19.553288 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:45:19.554408 I | rook-ceph-mon1: 2017-07-11 14:45:19.553311 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/378860256' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:45:23.329603 I | rook-ceph-mon1: 2017-07-11 14:45:23.329575 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:23.329689 I | rook-ceph-mon1: 2017-07-11 14:45:23.329676 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3270749666' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:29.126562 I | rook-ceph-mon1: 2017-07-11 14:45:29.126530 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:29.128374 I | rook-ceph-mon1: 2017-07-11 14:45:29.128352 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/195513423' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:36.224903 I | rook-ceph-mon1: 2017-07-11 14:45:36.224870 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:36.225002 I | rook-ceph-mon1: 2017-07-11 14:45:36.224989 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2083629779' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:43.995602 I | rook-ceph-mon1: 2017-07-11 14:45:43.995573 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:43.997674 I | rook-ceph-mon1: 2017-07-11 14:45:43.997658 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/934692096' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:49.845089 I | rook-ceph-mon1: 2017-07-11 14:45:49.845063 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:49.851760 I | rook-ceph-mon1: 2017-07-11 14:45:49.845269 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3040420943' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:51.344702 I | rook-ceph-mon1: 2017-07-11 14:45:51.344669 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:51.344921 I | rook-ceph-mon1: 2017-07-11 14:45:51.344875 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1909896900' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:54.082862 I | rook-ceph-mon1: 2017-07-11 14:45:54.082832 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:45:54.083053 I | rook-ceph-mon1: 2017-07-11 14:45:54.082961 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2616585455' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:45:54.893277 I | rook-ceph-mon1: 2017-07-11 14:45:54.874748 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4750 MB, avail 94437 MB
- 2017-07-11 14:45:58.073099 I | rook-ceph-mon1: 2017-07-11 14:45:58.073070 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:58.073273 I | rook-ceph-mon1: 2017-07-11 14:45:58.073198 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2628049189' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:02.442034 I | rook-ceph-mon1: 2017-07-11 14:46:02.442007 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:02.442125 I | rook-ceph-mon1: 2017-07-11 14:46:02.442110 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1708112515' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:06.084664 I | rook-ceph-mon1: 2017-07-11 14:46:06.084634 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:06.084765 I | rook-ceph-mon1: 2017-07-11 14:46:06.084751 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3327979267' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:24.684172 I | rook-ceph-mon1: 2017-07-11 14:46:24.684129 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:24.684348 I | rook-ceph-mon1: 2017-07-11 14:46:24.684270 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2716586558' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:28.689086 I | rook-ceph-mon1: 2017-07-11 14:46:28.689053 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:46:28.698438 I | rook-ceph-mon1: 2017-07-11 14:46:28.691285 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3482259215' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:46:31.745789 I | rook-ceph-mon1: 2017-07-11 14:46:31.745757 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:31.745886 I | rook-ceph-mon1: 2017-07-11 14:46:31.745873 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/798804631' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:35.734204 I | rook-ceph-mon1: 2017-07-11 14:46:35.734171 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:35.734396 I | rook-ceph-mon1: 2017-07-11 14:46:35.734312 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2497596321' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:46.894076 I | rook-ceph-mon1: 2017-07-11 14:46:46.894014 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:46.894259 I | rook-ceph-mon1: 2017-07-11 14:46:46.894164 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3972755417' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:51.220060 I | rook-ceph-mon1: 2017-07-11 14:46:51.220027 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:51.220159 I | rook-ceph-mon1: 2017-07-11 14:46:51.220145 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1425605944' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:54.876000 I | rook-ceph-mon1: 2017-07-11 14:46:54.875788 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4750 MB, avail 94437 MB
- 2017-07-11 14:47:03.822162 I | rook-ceph-mon1: 2017-07-11 14:47:03.822136 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:03.822251 I | rook-ceph-mon1: 2017-07-11 14:47:03.822238 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2022742102' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:08.118364 I | rook-ceph-mon1: 2017-07-11 14:47:08.118290 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #115. Immutable memtables: 0.
- 2017-07-11 14:47:08.118437 I | rook-ceph-mon1:
- 2017-07-11 14:47:08.118455 I | rook-ceph-mon1: 2017-07-11 14:47:08.118329 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 73] Syncing log #112
- 2017-07-11 14:47:08.237395 I | rook-ceph-mon1: 2017-07-11 14:47:08.234257 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.118324) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:47:08.237437 I | rook-ceph-mon1: 2017-07-11 14:47:08.234265 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 73] Flushing memtable with next log file: 115
- 2017-07-11 14:47:08.237452 I | rook-ceph-mon1:
- 2017-07-11 14:47:08.237464 I | rook-ceph-mon1: 2017-07-11 14:47:08.234273 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784428234270, "job": 73, "event": "flush_started", "num_memtables": 1, "num_entries": 2311, "num_deletes": 251, "memory_usage": 7653544}
- 2017-07-11 14:47:08.237474 I | rook-ceph-mon1: 2017-07-11 14:47:08.234275 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 73] Level-0 flush table #116: started
- 2017-07-11 14:47:08.415847 I | rook-ceph-mon1: 2017-07-11 14:47:08.415809 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784428415800, "cf_name": "default", "job": 73, "event": "table_file_creation", "file_number": 116, "file_size": 5058867, "table_properties": {"data_size": 5041332, "index_size": 16715, "filter_size": 0, "raw_key_size": 17110, "raw_average_key_size": 18, "raw_value_size": 5017131, "raw_average_value_size": 5507, "num_data_blocks": 523, "num_entries": 911, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:47:08.416514 I | rook-ceph-mon1: 2017-07-11 14:47:08.416498 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 73] Level-0 flush table #116: 5058867 bytes OK
- 2017-07-11 14:47:08.648245 I | rook-ceph-mon1: 2017-07-11 14:47:08.648188 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.609548) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #116 started
- 2017-07-11 14:47:08.648354 I | rook-ceph-mon1: 2017-07-11 14:47:08.648341 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.648124) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #116: memtable #1 done
- 2017-07-11 14:47:08.648399 I | rook-ceph-mon1: 2017-07-11 14:47:08.648385 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.648146) EVENT_LOG_v1 {"time_micros": 1499784428648138, "job": 73, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:47:08.648444 I | rook-ceph-mon1: 2017-07-11 14:47:08.648414 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.648167) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:47:08.648483 I | rook-ceph-mon1:
- 2017-07-11 14:47:08.648514 I | rook-ceph-mon1: 2017-07-11 14:47:08.648501 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 73] Try to delete WAL files size 7604834, prev total WAL file size 7604834, number of live WAL files 2.
- 2017-07-11 14:47:08.648558 I | rook-ceph-mon1:
- 2017-07-11 14:47:08.661396 I | rook-ceph-mon1: 2017-07-11 14:47:08.649899 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:47:08.661456 I | rook-ceph-mon1: 2017-07-11 14:47:08.650011 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:47:08.661473 I | rook-ceph-mon1: 2017-07-11 14:47:08.650014 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:47:08.661486 I | rook-ceph-mon1: ** DB Stats **
- 2017-07-11 14:47:08.661511 I | rook-ceph-mon1: Uptime(secs): 4994.9 total, 795.9 interval
- 2017-07-11 14:47:08.661523 I | rook-ceph-mon1: Cumulative writes: 9172 writes, 44K keys, 9172 commit groups, 1.0 writes per commit group, ingest: 0.12 GB, 0.03 MB/s
- 2017-07-11 14:47:08.661533 I | rook-ceph-mon1: Cumulative WAL: 9172 writes, 9172 syncs, 1.00 writes per sync, written: 0.12 GB, 0.03 MB/s
- 2017-07-11 14:47:08.661544 I | rook-ceph-mon1: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:47:08.661554 I | rook-ceph-mon1: Interval writes: 2008 writes, 10K keys, 2008 commit groups, 1.0 writes per commit group, ingest: 28.94 MB, 0.04 MB/s
- 2017-07-11 14:47:08.661564 I | rook-ceph-mon1: Interval WAL: 2008 writes, 2008 syncs, 1.00 writes per sync, written: 0.03 MB, 0.04 MB/s
- 2017-07-11 14:47:08.661585 I | rook-ceph-mon1: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:47:08.661596 I | rook-ceph-mon1:
- 2017-07-11 14:47:08.661606 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 14:47:08.661617 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:47:08.661627 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:47:08.661642 I | rook-ceph-mon1: L0 1/1 4.82 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 10.6 7 38 0.189 0 0
- 2017-07-11 14:47:08.661663 I | rook-ceph-mon1: L1 1/1 12.70 MB 0.0 0.5 0.1 0.4 0.4 0.0 0.0 6.2 34.9 30.9 14 34 0.424 82K 16K
- 2017-07-11 14:47:08.661688 I | rook-ceph-mon1: Sum 2/2 17.52 MB 0.0 0.5 0.1 0.4 0.5 0.1 0.0 6.8 23.3 24.1 22 72 0.300 82K 16K
- 2017-07-11 14:47:08.661698 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 6.2 32.4 33.0 4 14 0.255 19K 4534
- 2017-07-11 14:47:08.661708 I | rook-ceph-mon1: Uptime(secs): 4994.9 total, 4994.9 interval
- 2017-07-11 14:47:08.661718 I | rook-ceph-mon1: Flush(GB): cumulative 0.074, interval 0.018
- 2017-07-11 14:47:08.667363 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:47:08.667370 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:47:08.667373 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:47:08.667375 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:47:08.667378 I | rook-ceph-mon1: Cumulative compaction: 0.51 GB write, 0.10 MB/s write, 0.49 GB read, 0.10 MB/s read, 21.6 seconds
- 2017-07-11 14:47:08.667381 I | rook-ceph-mon1: Interval compaction: 0.12 GB write, 0.02 MB/s write, 0.11 GB read, 0.02 MB/s read, 3.6 seconds
- 2017-07-11 14:47:08.667384 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:47:08.667386 I | rook-ceph-mon1:
- 2017-07-11 14:47:08.667389 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:47:08.667391 I | rook-ceph-mon1:
- 2017-07-11 14:47:08.667393 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 14:47:08.667395 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:47:08.667398 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:47:08.667400 I | rook-ceph-mon1: L0 1/1 4.82 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 10.6 7 38 0.189 0 0
- 2017-07-11 14:47:08.667402 I | rook-ceph-mon1: L1 1/1 12.70 MB 0.0 0.5 0.1 0.4 0.4 0.0 0.0 6.2 34.9 30.9 14 34 0.424 82K 16K
- 2017-07-11 14:47:08.667405 I | rook-ceph-mon1: Sum 2/2 17.52 MB 0.0 0.5 0.1 0.4 0.5 0.1 0.0 6.8 23.3 24.1 22 72 0.300 82K 16K
- 2017-07-11 14:47:08.667406 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:47:08.667409 I | rook-ceph-mon1: Uptime(secs): 4994.9 total, 4994.9 interval
- 2017-07-11 14:47:08.667411 I | rook-ceph-mon1: Flush(GB): cumulative 0.074, interval 0.000
- 2017-07-11 14:47:08.667413 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:47:08.667415 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:47:08.667417 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:47:08.667419 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:47:08.667421 I | rook-ceph-mon1: Cumulative compaction: 0.51 GB write, 0.10 MB/s write, 0.49 GB read, 0.10 MB/s read, 21.6 seconds
- 2017-07-11 14:47:08.667423 I | rook-ceph-mon1: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:47:08.667430 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:47:08.667432 I | rook-ceph-mon1:
- 2017-07-11 14:47:08.667434 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:47:08.667436 I | rook-ceph-mon1:
- 2017-07-11 14:47:08.667438 I | rook-ceph-mon1: 2017-07-11 14:47:08.650027 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.650023) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:47:08.667441 I | rook-ceph-mon1:
- 2017-07-11 14:47:08.667446 I | rook-ceph-mon1: 2017-07-11 14:47:08.650031 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 74] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:47:08.667448 I | rook-ceph-mon1: 2017-07-11 14:47:08.650034 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 73 Base level 0, inputs: [116(4940KB)], [114(12MB)]
- 2017-07-11 14:47:08.667450 I | rook-ceph-mon1:
- 2017-07-11 14:47:08.667452 I | rook-ceph-mon1: 2017-07-11 14:47:08.650042 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784428650036, "job": 74, "event": "compaction_started", "files_L0": [116], "files_L1": [114], "score": -1, "input_data_size": 18375789}
- 2017-07-11 14:47:08.843244 I | rook-ceph-mon1: 2017-07-11 14:47:08.843211 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 74] Generated table #117: 2355 keys, 15830125 bytes
- 2017-07-11 14:47:08.845406 I | rook-ceph-mon1: 2017-07-11 14:47:08.845389 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784428845381, "cf_name": "default", "job": 74, "event": "table_file_creation", "file_number": 117, "file_size": 15830125, "table_properties": {"data_size": 15776817, "index_size": 52489, "filter_size": 0, "raw_key_size": 45550, "raw_average_key_size": 19, "raw_value_size": 15707146, "raw_average_value_size": 6669, "num_data_blocks": 1596, "num_entries": 2355, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:47:08.862775 I | rook-ceph-mon1: 2017-07-11 14:47:08.862751 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 74] Compacted 1@0 + 1@1 files to L1 => 15830125 bytes
- 2017-07-11 14:47:08.891365 I | rook-ceph-mon1: 2017-07-11 14:47:08.891333 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.891225) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 86.4 rd, 74.4 wr, level 1, files in(1, 1) out(1) MB in(4.8, 12.7) out(15.1), read-write-amplify(6.8) write-amplify(3.1) OK, records in: 2864, records dropped: 509
- 2017-07-11 14:47:08.891418 I | rook-ceph-mon1:
- 2017-07-11 14:47:08.891479 I | rook-ceph-mon1: 2017-07-11 14:47:08.891447 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.891266) EVENT_LOG_v1 {"time_micros": 1499784428891243, "job": 74, "event": "compaction_finished", "compaction_time_micros": 212697, "output_level": 1, "num_output_files": 1, "total_output_size": 15830125, "num_input_records": 2864, "num_output_records": 2355, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:47:08.892226 I | rook-ceph-mon1: 2017-07-11 14:47:08.892212 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784428892210, "job": 74, "event": "table_file_deletion", "file_number": 116}
- 2017-07-11 14:47:08.894936 I | rook-ceph-mon1: 2017-07-11 14:47:08.894920 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784428894918, "job": 74, "event": "table_file_deletion", "file_number": 114}
- 2017-07-11 14:47:09.205568 I | rook-ceph-mon1: 2017-07-11 14:47:09.205448 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:09.205734 I | rook-ceph-mon1: 2017-07-11 14:47:09.205466 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3753463118' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:15.348047 I | rook-ceph-mon1: 2017-07-11 14:47:15.348019 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:15.348210 I | rook-ceph-mon1: 2017-07-11 14:47:15.348137 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/649366680' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:16.206925 I | rook-ceph-mon1: 2017-07-11 14:47:16.206895 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:16.207027 I | rook-ceph-mon1: 2017-07-11 14:47:16.207013 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/238755759' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:17.901330 I | rook-ceph-mon1: 2017-07-11 14:47:17.901304 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:47:17.902402 I | rook-ceph-mon1: 2017-07-11 14:47:17.902385 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1499271603' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:47:20.273388 I | rook-ceph-mon1: 2017-07-11 14:47:20.273357 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:20.273558 I | rook-ceph-mon1: 2017-07-11 14:47:20.273485 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/324094711' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:31.358074 I | rook-ceph-mon1: 2017-07-11 14:47:31.358031 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:31.358174 I | rook-ceph-mon1: 2017-07-11 14:47:31.358160 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4280785956' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:35.007056 I | rook-ceph-mon1: 2017-07-11 14:47:35.007029 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:35.013058 I | rook-ceph-mon1: 2017-07-11 14:47:35.013039 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/288838694' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:37.735131 I | rook-ceph-mon1: 2017-07-11 14:47:37.735104 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:47:37.735405 I | rook-ceph-mon1: 2017-07-11 14:47:37.735376 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1742636635' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:47:46.038332 I | rook-ceph-mon1: 2017-07-11 14:47:46.038307 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:46.038419 I | rook-ceph-mon1: 2017-07-11 14:47:46.038405 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2593327002' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:53.487552 I | rook-ceph-mon1: 2017-07-11 14:47:53.487526 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:53.487657 I | rook-ceph-mon1: 2017-07-11 14:47:53.487643 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2246469084' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:47:54.877502 I | rook-ceph-mon1: 2017-07-11 14:47:54.877227 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4752 MB, avail 94434 MB
- 2017-07-11 14:47:57.078906 I | rook-ceph-mon1: 2017-07-11 14:47:57.078865 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:47:57.079004 I | rook-ceph-mon1: 2017-07-11 14:47:57.078990 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/378623661' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:11.671935 I | rook-ceph-mon1: 2017-07-11 14:48:11.671897 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:11.672173 I | rook-ceph-mon1: 2017-07-11 14:48:11.672052 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1725991728' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:11.884640 I | rook-ceph-mon1: 2017-07-11 14:48:11.884614 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:48:11.884733 I | rook-ceph-mon1: 2017-07-11 14:48:11.884719 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4161161962' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:48:15.637401 I | rook-ceph-mon1: 2017-07-11 14:48:15.637366 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:15.637493 I | rook-ceph-mon1: 2017-07-11 14:48:15.637479 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3008386122' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:22.831465 I | rook-ceph-mon1: 2017-07-11 14:48:22.831437 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:22.831645 I | rook-ceph-mon1: 2017-07-11 14:48:22.831570 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2682897650' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:26.799662 I | rook-ceph-mon1: 2017-07-11 14:48:26.799625 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:26.799833 I | rook-ceph-mon1: 2017-07-11 14:48:26.799758 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3132687323' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:31.715672 I | rook-ceph-mon1: 2017-07-11 14:48:31.715645 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:48:31.715762 I | rook-ceph-mon1: 2017-07-11 14:48:31.715748 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3938066400' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:48:34.029524 I | rook-ceph-mon1: 2017-07-11 14:48:34.029493 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:34.037061 I | rook-ceph-mon1: 2017-07-11 14:48:34.037043 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1752908051' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:41.580854 I | rook-ceph-mon1: 2017-07-11 14:48:41.580824 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:41.580995 I | rook-ceph-mon1: 2017-07-11 14:48:41.580980 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3711536692' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:45.468818 I | rook-ceph-mon1: 2017-07-11 14:48:45.468791 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:45.468912 I | rook-ceph-mon1: 2017-07-11 14:48:45.468899 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2924753874' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:49.645940 I | rook-ceph-mon1: 2017-07-11 14:48:49.644153 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #118. Immutable memtables: 0.
- 2017-07-11 14:48:49.646028 I | rook-ceph-mon1:
- 2017-07-11 14:48:49.646063 I | rook-ceph-mon1: 2017-07-11 14:48:49.644202 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 75] Syncing log #115
- 2017-07-11 14:48:49.675463 I | rook-ceph-mon1: 2017-07-11 14:48:49.673145 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.644196) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:48:49.675502 I | rook-ceph-mon1: 2017-07-11 14:48:49.673162 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 75] Flushing memtable with next log file: 118
- 2017-07-11 14:48:49.675518 I | rook-ceph-mon1:
- 2017-07-11 14:48:49.675530 I | rook-ceph-mon1: 2017-07-11 14:48:49.673178 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784529673170, "job": 75, "event": "flush_started", "num_memtables": 1, "num_entries": 1327, "num_deletes": 251, "memory_usage": 3999168}
- 2017-07-11 14:48:49.675574 I | rook-ceph-mon1: 2017-07-11 14:48:49.673184 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 75] Level-0 flush table #119: started
- 2017-07-11 14:48:49.752564 I | rook-ceph-mon1: 2017-07-11 14:48:49.752537 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784529752530, "cf_name": "default", "job": 75, "event": "table_file_creation", "file_number": 119, "file_size": 2351746, "table_properties": {"data_size": 2343780, "index_size": 7148, "filter_size": 0, "raw_key_size": 10805, "raw_average_key_size": 19, "raw_value_size": 2331145, "raw_average_value_size": 4200, "num_data_blocks": 228, "num_entries": 555, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:48:49.754561 I | rook-ceph-mon1: 2017-07-11 14:48:49.754545 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 75] Level-0 flush table #119: 2351746 bytes OK
- 2017-07-11 14:48:49.805104 I | rook-ceph-mon1: 2017-07-11 14:48:49.805082 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.771446) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #119 started
- 2017-07-11 14:48:49.805158 I | rook-ceph-mon1: 2017-07-11 14:48:49.805145 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.805055) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #119: memtable #1 done
- 2017-07-11 14:48:49.805188 I | rook-ceph-mon1: 2017-07-11 14:48:49.805176 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.805065) EVENT_LOG_v1 {"time_micros": 1499784529805061, "job": 75, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:48:49.805231 I | rook-ceph-mon1: 2017-07-11 14:48:49.805218 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.805075) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:48:49.805246 I | rook-ceph-mon1:
- 2017-07-11 14:48:49.805296 I | rook-ceph-mon1: 2017-07-11 14:48:49.805261 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 75] Try to delete WAL files size 3971817, prev total WAL file size 3971817, number of live WAL files 2.
- 2017-07-11 14:48:49.805310 I | rook-ceph-mon1:
- 2017-07-11 14:48:49.807381 I | rook-ceph-mon1: 2017-07-11 14:48:49.805940 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:48:49.807429 I | rook-ceph-mon1: 2017-07-11 14:48:49.805976 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.805971) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:48:49.807445 I | rook-ceph-mon1:
- 2017-07-11 14:48:49.807456 I | rook-ceph-mon1: 2017-07-11 14:48:49.805981 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 76] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:48:49.807466 I | rook-ceph-mon1: 2017-07-11 14:48:49.805985 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 75 Base level 0, inputs: [119(2296KB)], [117(15MB)]
- 2017-07-11 14:48:49.807500 I | rook-ceph-mon1:
- 2017-07-11 14:48:49.807512 I | rook-ceph-mon1: 2017-07-11 14:48:49.805993 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784529805987, "job": 76, "event": "compaction_started", "files_L0": [119], "files_L1": [117], "score": -1, "input_data_size": 18181871}
- 2017-07-11 14:48:50.195208 I | rook-ceph-mon1: 2017-07-11 14:48:50.195176 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 76] Generated table #120: 2445 keys, 16815688 bytes
- 2017-07-11 14:48:50.195293 I | rook-ceph-mon1: 2017-07-11 14:48:50.195279 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784530195271, "cf_name": "default", "job": 76, "event": "table_file_creation", "file_number": 120, "file_size": 16815688, "table_properties": {"data_size": 16761860, "index_size": 53009, "filter_size": 0, "raw_key_size": 47008, "raw_average_key_size": 19, "raw_value_size": 16690665, "raw_average_value_size": 6826, "num_data_blocks": 1616, "num_entries": 2445, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:48:50.259369 I | rook-ceph-mon1: 2017-07-11 14:48:50.257531 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 76] Compacted 1@0 + 1@1 files to L1 => 16815688 bytes
- 2017-07-11 14:48:50.305097 I | rook-ceph-mon1: 2017-07-11 14:48:50.295522 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:48:50.295437) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 40.3 rd, 37.2 wr, level 1, files in(1, 1) out(1) MB in(2.2, 15.1) out(16.0), read-write-amplify(14.9) write-amplify(7.2) OK, records in: 2910, records dropped: 465
- 2017-07-11 14:48:50.305135 I | rook-ceph-mon1:
- 2017-07-11 14:48:50.305167 I | rook-ceph-mon1: 2017-07-11 14:48:50.305152 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:48:50.295469) EVENT_LOG_v1 {"time_micros": 1499784530295455, "job": 76, "event": "compaction_finished", "compaction_time_micros": 451526, "output_level": 1, "num_output_files": 1, "total_output_size": 16815688, "num_input_records": 2910, "num_output_records": 2445, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:48:50.334460 I | rook-ceph-mon1: 2017-07-11 14:48:50.334439 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784530334433, "job": 76, "event": "table_file_deletion", "file_number": 119}
- 2017-07-11 14:48:50.336236 I | rook-ceph-mon1: 2017-07-11 14:48:50.336212 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784530336210, "job": 76, "event": "table_file_deletion", "file_number": 117}
- 2017-07-11 14:48:50.336280 I | rook-ceph-mon1: 2017-07-11 14:48:50.336266 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:48:54.879359 I | rook-ceph-mon1: 2017-07-11 14:48:54.879200 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4753 MB, avail 94433 MB
- 2017-07-11 14:49:00.339759 I | rook-ceph-mon1: 2017-07-11 14:49:00.339728 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:00.339816 I | rook-ceph-mon1: 2017-07-11 14:49:00.339802 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3061995495' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:11.048729 I | rook-ceph-mon1: 2017-07-11 14:49:11.048696 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:49:11.048889 I | rook-ceph-mon1: 2017-07-11 14:49:11.048874 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/183916655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:49:14.662151 I | rook-ceph-mon1: 2017-07-11 14:49:14.662082 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #121. Immutable memtables: 0.
- 2017-07-11 14:49:14.662217 I | rook-ceph-mon1:
- 2017-07-11 14:49:14.662234 I | rook-ceph-mon1: 2017-07-11 14:49:14.662113 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 77] Syncing log #118
- 2017-07-11 14:49:14.700470 I | rook-ceph-mon1: 2017-07-11 14:49:14.691247 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.662109) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:49:14.700520 I | rook-ceph-mon1: 2017-07-11 14:49:14.691255 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 77] Flushing memtable with next log file: 121
- 2017-07-11 14:49:14.700535 I | rook-ceph-mon1:
- 2017-07-11 14:49:14.700546 I | rook-ceph-mon1: 2017-07-11 14:49:14.691263 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554691259, "job": 77, "event": "flush_started", "num_memtables": 1, "num_entries": 759, "num_deletes": 504, "memory_usage": 982352}
- 2017-07-11 14:49:14.700556 I | rook-ceph-mon1: 2017-07-11 14:49:14.691265 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 77] Level-0 flush table #122: started
- 2017-07-11 14:49:14.758718 I | rook-ceph-mon1: 2017-07-11 14:49:14.758691 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554758684, "cf_name": "default", "job": 77, "event": "table_file_creation", "file_number": 122, "file_size": 645848, "table_properties": {"data_size": 642950, "index_size": 2084, "filter_size": 0, "raw_key_size": 11530, "raw_average_key_size": 19, "raw_value_size": 633622, "raw_average_value_size": 1072, "num_data_blocks": 67, "num_entries": 591, "filter_policy_name": "", "kDeletedKeys": "504", "kMergeOperands": "0"}}
- 2017-07-11 14:49:14.758775 I | rook-ceph-mon1: 2017-07-11 14:49:14.758760 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 77] Level-0 flush table #122: 645848 bytes OK
- 2017-07-11 14:49:14.817146 I | rook-ceph-mon1: 2017-07-11 14:49:14.817127 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.787785) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #122 started
- 2017-07-11 14:49:14.817200 I | rook-ceph-mon1: 2017-07-11 14:49:14.817187 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.817104) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #122: memtable #1 done
- 2017-07-11 14:49:14.817228 I | rook-ceph-mon1: 2017-07-11 14:49:14.817217 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.817111) EVENT_LOG_v1 {"time_micros": 1499784554817108, "job": 77, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:49:14.817268 I | rook-ceph-mon1: 2017-07-11 14:49:14.817241 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.817121) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:49:14.817282 I | rook-ceph-mon1:
- 2017-07-11 14:49:14.817307 I | rook-ceph-mon1: 2017-07-11 14:49:14.817297 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 77] Try to delete WAL files size 964670, prev total WAL file size 964670, number of live WAL files 2.
- 2017-07-11 14:49:14.817331 I | rook-ceph-mon1:
- 2017-07-11 14:49:14.819038 I | rook-ceph-mon1: 2017-07-11 14:49:14.817607 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:49:14.819071 I | rook-ceph-mon1: 2017-07-11 14:49:14.817656 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.817647) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:49:14.819086 I | rook-ceph-mon1:
- 2017-07-11 14:49:14.819096 I | rook-ceph-mon1: 2017-07-11 14:49:14.817660 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 78] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:49:14.819107 I | rook-ceph-mon1: 2017-07-11 14:49:14.817664 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 77 Base level 0, inputs: [122(630KB)], [120(16MB)]
- 2017-07-11 14:49:14.819117 I | rook-ceph-mon1:
- 2017-07-11 14:49:14.819127 I | rook-ceph-mon1: 2017-07-11 14:49:14.817673 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554817666, "job": 78, "event": "compaction_started", "files_L0": [122], "files_L1": [120], "score": -1, "input_data_size": 17461536}
- 2017-07-11 14:49:15.062547 I | rook-ceph-mon1: 2017-07-11 14:49:15.062514 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 78] Generated table #123: 2021 keys, 14374788 bytes
- 2017-07-11 14:49:15.070557 I | rook-ceph-mon1: 2017-07-11 14:49:15.070537 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555070529, "cf_name": "default", "job": 78, "event": "table_file_creation", "file_number": 123, "file_size": 14374788, "table_properties": {"data_size": 14328685, "index_size": 45284, "filter_size": 0, "raw_key_size": 38698, "raw_average_key_size": 19, "raw_value_size": 14268790, "raw_average_value_size": 7060, "num_data_blocks": 1394, "num_entries": 2021, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:49:15.150991 I | rook-ceph-mon1: 2017-07-11 14:49:15.150949 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 78] Compacted 1@0 + 1@1 files to L1 => 14374788 bytes
- 2017-07-11 14:49:15.226076 I | rook-ceph-mon1: 2017-07-11 14:49:15.226054 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.225991) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 52.6 rd, 43.3 wr, level 1, files in(1, 1) out(1) MB in(0.6, 16.0) out(13.7), read-write-amplify(49.3) write-amplify(22.3) OK, records in: 3036, records dropped: 1015
- 2017-07-11 14:49:15.226266 I | rook-ceph-mon1:
- 2017-07-11 14:49:15.226308 I | rook-ceph-mon1: 2017-07-11 14:49:15.226293 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.226007) EVENT_LOG_v1 {"time_micros": 1499784555226000, "job": 78, "event": "compaction_finished", "compaction_time_micros": 331768, "output_level": 1, "num_output_files": 1, "total_output_size": 14374788, "num_input_records": 3036, "num_output_records": 2021, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:49:15.227150 I | rook-ceph-mon1: 2017-07-11 14:49:15.227136 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555227134, "job": 78, "event": "table_file_deletion", "file_number": 122}
- 2017-07-11 14:49:15.235581 I | rook-ceph-mon1: 2017-07-11 14:49:15.235560 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555235558, "job": 78, "event": "table_file_deletion", "file_number": 120}
- 2017-07-11 14:49:15.235938 I | rook-ceph-mon1: 2017-07-11 14:49:15.235864 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #124. Immutable memtables: 0.
- 2017-07-11 14:49:15.235971 I | rook-ceph-mon1:
- 2017-07-11 14:49:15.235986 I | rook-ceph-mon1: 2017-07-11 14:49:15.235900 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 79] Syncing log #121
- 2017-07-11 14:49:15.297708 I | rook-ceph-mon1: 2017-07-11 14:49:15.297444 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.235895) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:49:15.303711 I | rook-ceph-mon1: 2017-07-11 14:49:15.297452 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 79] Flushing memtable with next log file: 124
- 2017-07-11 14:49:15.303807 I | rook-ceph-mon1:
- 2017-07-11 14:49:15.303891 I | rook-ceph-mon1: 2017-07-11 14:49:15.297460 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555297457, "job": 79, "event": "flush_started", "num_memtables": 1, "num_entries": 8, "num_deletes": 0, "memory_usage": 41608}
- 2017-07-11 14:49:15.303923 I | rook-ceph-mon1: 2017-07-11 14:49:15.297462 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 79] Level-0 flush table #125: started
- 2017-07-11 14:49:15.404289 I | rook-ceph-mon1: 2017-07-11 14:49:15.404245 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555404238, "cf_name": "default", "job": 79, "event": "table_file_creation", "file_number": 125, "file_size": 40412, "table_properties": {"data_size": 39487, "index_size": 114, "filter_size": 0, "raw_key_size": 186, "raw_average_key_size": 23, "raw_value_size": 39230, "raw_average_value_size": 4903, "num_data_blocks": 4, "num_entries": 8, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:49:15.404331 I | rook-ceph-mon1: 2017-07-11 14:49:15.404252 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 79] Level-0 flush table #125: 40412 bytes OK
- 2017-07-11 14:49:15.469334 I | rook-ceph-mon1: 2017-07-11 14:49:15.469311 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.424364) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #125 started
- 2017-07-11 14:49:15.471068 I | rook-ceph-mon1: 2017-07-11 14:49:15.471052 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.469277) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #125: memtable #1 done
- 2017-07-11 14:49:15.471112 I | rook-ceph-mon1: 2017-07-11 14:49:15.471100 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.469286) EVENT_LOG_v1 {"time_micros": 1499784555469282, "job": 79, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:49:15.471137 I | rook-ceph-mon1: 2017-07-11 14:49:15.471127 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.469305) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:49:15.471150 I | rook-ceph-mon1:
- 2017-07-11 14:49:15.471189 I | rook-ceph-mon1: 2017-07-11 14:49:15.471177 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 79] Try to delete WAL files size 39393, prev total WAL file size 39393, number of live WAL files 2.
- 2017-07-11 14:49:15.471202 I | rook-ceph-mon1:
- 2017-07-11 14:49:15.471384 I | rook-ceph-mon1: 2017-07-11 14:49:15.471299 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:49:15.471501 I | rook-ceph-mon1: 2017-07-11 14:49:15.471426 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.471422) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:49:15.471520 I | rook-ceph-mon1:
- 2017-07-11 14:49:15.471531 I | rook-ceph-mon1: 2017-07-11 14:49:15.471432 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 80] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:49:15.471557 I | rook-ceph-mon1: 2017-07-11 14:49:15.471436 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 79 Base level 0, inputs: [125(39KB)], [123(13MB)]
- 2017-07-11 14:49:15.471634 I | rook-ceph-mon1:
- 2017-07-11 14:49:15.471650 I | rook-ceph-mon1: 2017-07-11 14:49:15.471568 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555471438, "job": 80, "event": "compaction_started", "files_L0": [125], "files_L1": [123], "score": -1, "input_data_size": 14415200}
- 2017-07-11 14:49:15.771503 I | rook-ceph-mon1: 2017-07-11 14:49:15.771460 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 80] Generated table #126: 2024 keys, 14394452 bytes
- 2017-07-11 14:49:15.780807 I | rook-ceph-mon1: 2017-07-11 14:49:15.780773 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555780764, "cf_name": "default", "job": 80, "event": "table_file_creation", "file_number": 126, "file_size": 14394452, "table_properties": {"data_size": 14348254, "index_size": 45379, "filter_size": 0, "raw_key_size": 38757, "raw_average_key_size": 19, "raw_value_size": 14288252, "raw_average_value_size": 7059, "num_data_blocks": 1397, "num_entries": 2024, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:49:15.829556 I | rook-ceph-mon1: 2017-07-11 14:49:15.829536 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 80] Compacted 1@0 + 1@1 files to L1 => 14394452 bytes
- 2017-07-11 14:49:15.918364 I | rook-ceph-mon1: 2017-07-11 14:49:15.918342 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.918284) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 40.3 rd, 40.2 wr, level 1, files in(1, 1) out(1) MB in(0.0, 13.7) out(13.7), read-write-amplify(712.9) write-amplify(356.2) OK, records in: 2029, records dropped: 5
- 2017-07-11 14:49:15.918554 I | rook-ceph-mon1:
- 2017-07-11 14:49:15.918663 I | rook-ceph-mon1: 2017-07-11 14:49:15.918648 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.918299) EVENT_LOG_v1 {"time_micros": 1499784555918293, "job": 80, "event": "compaction_finished", "compaction_time_micros": 357953, "output_level": 1, "num_output_files": 1, "total_output_size": 14394452, "num_input_records": 2029, "num_output_records": 2024, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:49:15.918886 I | rook-ceph-mon1: 2017-07-11 14:49:15.918874 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555918871, "job": 80, "event": "table_file_deletion", "file_number": 125}
- 2017-07-11 14:49:15.928215 I | rook-ceph-mon1: 2017-07-11 14:49:15.928200 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555928198, "job": 80, "event": "table_file_deletion", "file_number": 123}
- 2017-07-11 14:49:16.383977 I | rook-ceph-mon1: 2017-07-11 14:49:16.383932 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:49:16.384193 I | rook-ceph-mon1: 2017-07-11 14:49:16.384169 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/839991287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:49:21.757426 I | rook-ceph-mon1: 2017-07-11 14:49:21.757376 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:21.757570 I | rook-ceph-mon1: 2017-07-11 14:49:21.757504 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1334659786' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:36.815365 I | rook-ceph-mon1: 2017-07-11 14:49:35.633293 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1719 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.1693s > max 0.05s
- 2017-07-11 14:49:54.883352 I | rook-ceph-mon1: 2017-07-11 14:49:54.883150 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4751 MB, avail 94435 MB
- 2017-07-11 14:49:55.800941 I | rook-ceph-mon1: 2017-07-11 14:49:55.800875 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:49:55.803187 I | rook-ceph-mon1: 2017-07-11 14:49:55.803169 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1867025397' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:50:13.311045 I | rook-ceph-mon1: 2017-07-11 14:50:13.311009 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:13.311140 I | rook-ceph-mon1: 2017-07-11 14:50:13.311126 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1399722673' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:24.222375 I | rook-ceph-mon1: 2017-07-11 14:50:24.222292 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #127. Immutable memtables: 0.
- 2017-07-11 14:50:24.222455 I | rook-ceph-mon1:
- 2017-07-11 14:50:24.222473 I | rook-ceph-mon1: 2017-07-11 14:50:24.222340 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 81] Syncing log #124
- 2017-07-11 14:50:24.280823 I | rook-ceph-mon1: 2017-07-11 14:50:24.268930 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.222334) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:50:24.280835 I | rook-ceph-mon1: 2017-07-11 14:50:24.268939 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 81] Flushing memtable with next log file: 127
- 2017-07-11 14:50:24.280837 I | rook-ceph-mon1:
- 2017-07-11 14:50:24.280841 I | rook-ceph-mon1: 2017-07-11 14:50:24.268950 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624268947, "job": 81, "event": "flush_started", "num_memtables": 1, "num_entries": 972, "num_deletes": 251, "memory_usage": 2672640}
- 2017-07-11 14:50:24.280844 I | rook-ceph-mon1: 2017-07-11 14:50:24.268953 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 81] Level-0 flush table #128: started
- 2017-07-11 14:50:24.328823 I | rook-ceph-mon1: 2017-07-11 14:50:24.316089 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624316081, "cf_name": "default", "job": 81, "event": "table_file_creation", "file_number": 128, "file_size": 1763004, "table_properties": {"data_size": 1756486, "index_size": 5703, "filter_size": 0, "raw_key_size": 9034, "raw_average_key_size": 18, "raw_value_size": 1745837, "raw_average_value_size": 3592, "num_data_blocks": 182, "num_entries": 486, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:50:24.334952 I | rook-ceph-mon1: 2017-07-11 14:50:24.328865 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 81] Level-0 flush table #128: 1763004 bytes OK
- 2017-07-11 14:50:24.393281 I | rook-ceph-mon1: 2017-07-11 14:50:24.393259 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.364136) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #128 started
- 2017-07-11 14:50:24.393439 I | rook-ceph-mon1: 2017-07-11 14:50:24.393422 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.393227) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #128: memtable #1 done
- 2017-07-11 14:50:24.393582 I | rook-ceph-mon1: 2017-07-11 14:50:24.393567 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.393237) EVENT_LOG_v1 {"time_micros": 1499784624393233, "job": 81, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:50:24.393723 I | rook-ceph-mon1: 2017-07-11 14:50:24.393602 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.393249) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:50:24.393742 I | rook-ceph-mon1:
- 2017-07-11 14:50:24.393787 I | rook-ceph-mon1: 2017-07-11 14:50:24.393759 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 81] Try to delete WAL files size 2650972, prev total WAL file size 2650972, number of live WAL files 2.
- 2017-07-11 14:50:24.393801 I | rook-ceph-mon1:
- 2017-07-11 14:50:24.396815 I | rook-ceph-mon1: 2017-07-11 14:50:24.396462 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:50:24.396852 I | rook-ceph-mon1: 2017-07-11 14:50:24.396491 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.396486) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:50:24.396867 I | rook-ceph-mon1:
- 2017-07-11 14:50:24.396878 I | rook-ceph-mon1: 2017-07-11 14:50:24.396496 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 82] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:50:24.396889 I | rook-ceph-mon1: 2017-07-11 14:50:24.396499 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 81 Base level 0, inputs: [128(1721KB)], [126(13MB)]
- 2017-07-11 14:50:24.396900 I | rook-ceph-mon1:
- 2017-07-11 14:50:24.396924 I | rook-ceph-mon1: 2017-07-11 14:50:24.396508 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624396501, "job": 82, "event": "compaction_started", "files_L0": [128], "files_L1": [126], "score": -1, "input_data_size": 16157456}
- 2017-07-11 14:50:24.576921 I | rook-ceph-mon1: 2017-07-11 14:50:24.576882 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 82] Generated table #129: 2001 keys, 13595858 bytes
- 2017-07-11 14:50:24.577004 I | rook-ceph-mon1: 2017-07-11 14:50:24.576989 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624576982, "cf_name": "default", "job": 82, "event": "table_file_creation", "file_number": 129, "file_size": 13595858, "table_properties": {"data_size": 13551548, "index_size": 43491, "filter_size": 0, "raw_key_size": 38570, "raw_average_key_size": 19, "raw_value_size": 13493104, "raw_average_value_size": 6743, "num_data_blocks": 1327, "num_entries": 2001, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:50:24.614961 I | rook-ceph-mon1: 2017-07-11 14:50:24.604973 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 82] Compacted 1@0 + 1@1 files to L1 => 13595858 bytes
- 2017-07-11 14:50:24.643781 I | rook-ceph-mon1: 2017-07-11 14:50:24.643738 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.643663) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 77.5 rd, 65.2 wr, level 1, files in(1, 1) out(1) MB in(1.7, 13.7) out(13.0), read-write-amplify(16.9) write-amplify(7.7) OK, records in: 2510, records dropped: 509
- 2017-07-11 14:50:24.643822 I | rook-ceph-mon1:
- 2017-07-11 14:50:24.643867 I | rook-ceph-mon1: 2017-07-11 14:50:24.643841 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.643684) EVENT_LOG_v1 {"time_micros": 1499784624643678, "job": 82, "event": "compaction_finished", "compaction_time_micros": 208454, "output_level": 1, "num_output_files": 1, "total_output_size": 13595858, "num_input_records": 2510, "num_output_records": 2001, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:50:24.644325 I | rook-ceph-mon1: 2017-07-11 14:50:24.644310 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624644307, "job": 82, "event": "table_file_deletion", "file_number": 128}
- 2017-07-11 14:50:24.646100 I | rook-ceph-mon1: 2017-07-11 14:50:24.646065 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624646063, "job": 82, "event": "table_file_deletion", "file_number": 126}
- 2017-07-11 14:50:25.816925 I | rook-ceph-mon1: 2017-07-11 14:50:25.816898 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:25.817080 I | rook-ceph-mon1: 2017-07-11 14:50:25.817018 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1262620411' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:33.185093 I | rook-ceph-mon1: 2017-07-11 14:50:33.185062 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:33.185192 I | rook-ceph-mon1: 2017-07-11 14:50:33.185179 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3728208734' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:40.509177 I | rook-ceph-mon1: 2017-07-11 14:50:40.509144 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:40.509404 I | rook-ceph-mon1: 2017-07-11 14:50:40.509347 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2079427388' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:48.028170 I | rook-ceph-mon1: 2017-07-11 14:50:48.028142 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:48.028268 I | rook-ceph-mon1: 2017-07-11 14:50:48.028253 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/619223844' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:54.911838 I | rook-ceph-mon1: 2017-07-11 14:50:54.911633 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4750 MB, avail 94436 MB
- 2017-07-11 14:51:21.800499 I | rook-ceph-mon1: 2017-07-11 14:51:21.800470 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:21.800630 I | rook-ceph-mon1: 2017-07-11 14:51:21.800616 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1268114260' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:25.585830 I | rook-ceph-mon1: 2017-07-11 14:51:25.585799 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:25.586538 I | rook-ceph-mon1: 2017-07-11 14:51:25.586511 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1618802110' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:29.151029 I | rook-ceph-mon1: 2017-07-11 14:51:29.150988 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:29.151277 I | rook-ceph-mon1: 2017-07-11 14:51:29.151261 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1443968336' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:42.824229 I | rook-ceph-mon1: 2017-07-11 14:51:42.824195 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:42.824857 I | rook-ceph-mon1: 2017-07-11 14:51:42.824838 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1262935652' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:54.918454 I | rook-ceph-mon1: 2017-07-11 14:51:54.918193 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4751 MB, avail 94436 MB
- 2017-07-11 14:51:59.135708 I | rook-ceph-mon1: 2017-07-11 14:51:59.135580 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:59.136080 I | rook-ceph-mon1: 2017-07-11 14:51:59.135600 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/86506089' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:08.359436 I | rook-ceph-mon1: 2017-07-11 14:52:08.359378 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:52:08.359500 I | rook-ceph-mon1: 2017-07-11 14:52:08.359397 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4204757382' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:52:16.972956 I | rook-ceph-mon1: 2017-07-11 14:52:16.972893 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:16.973217 I | rook-ceph-mon1: 2017-07-11 14:52:16.973199 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/558153147' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:28.291718 I | rook-ceph-mon1: 2017-07-11 14:52:28.291690 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:28.291881 I | rook-ceph-mon1: 2017-07-11 14:52:28.291811 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3176191145' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:32.331115 I | rook-ceph-mon1: 2017-07-11 14:52:32.331080 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:32.331273 I | rook-ceph-mon1: 2017-07-11 14:52:32.331209 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2410689599' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:47.197664 I | rook-ceph-mon1: 2017-07-11 14:52:47.197587 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:47.197771 I | rook-ceph-mon1: 2017-07-11 14:52:47.197757 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2215074998' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:54.929031 I | rook-ceph-mon1: 2017-07-11 14:52:54.928730 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4751 MB, avail 94436 MB
- 2017-07-11 14:52:58.513749 I | rook-ceph-mon1: 2017-07-11 14:52:58.513699 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:58.513968 I | rook-ceph-mon1: 2017-07-11 14:52:58.513940 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/982522976' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:05.800919 I | rook-ceph-mon1: 2017-07-11 14:53:05.800889 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:05.801025 I | rook-ceph-mon1: 2017-07-11 14:53:05.801011 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/797435186' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:12.747571 I | rook-ceph-mon1: 2017-07-11 14:53:12.747540 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:12.747671 I | rook-ceph-mon1: 2017-07-11 14:53:12.747657 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1817355528' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:18.332659 I | rook-ceph-mon1: 2017-07-11 14:53:18.332618 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:18.332745 I | rook-ceph-mon1: 2017-07-11 14:53:18.332731 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/464335613' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:31.856251 I | rook-ceph-mon1: 2017-07-11 14:53:31.856036 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:31.856421 I | rook-ceph-mon1: 2017-07-11 14:53:31.856052 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2479235751' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:35.078887 I | rook-ceph-mon1: 2017-07-11 14:53:35.078856 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:35.079050 I | rook-ceph-mon1: 2017-07-11 14:53:35.078980 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2091481473' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:40.494634 I | rook-ceph-mon1: 2017-07-11 14:53:40.494494 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:53:40.495989 I | rook-ceph-mon1: 2017-07-11 14:53:40.494510 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3710938022' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:53:40.809620 I | rook-ceph-mon1: 2017-07-11 14:53:40.808004 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #130. Immutable memtables: 0.
- 2017-07-11 14:53:40.809724 I | rook-ceph-mon1:
- 2017-07-11 14:53:40.809800 I | rook-ceph-mon1: 2017-07-11 14:53:40.808049 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 83] Syncing log #127
- 2017-07-11 14:53:40.835552 I | rook-ceph-mon1: 2017-07-11 14:53:40.835477 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.808044) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:53:40.835594 I | rook-ceph-mon1: 2017-07-11 14:53:40.835483 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 83] Flushing memtable with next log file: 130
- 2017-07-11 14:53:40.835609 I | rook-ceph-mon1:
- 2017-07-11 14:53:40.835656 I | rook-ceph-mon1: 2017-07-11 14:53:40.835491 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784820835487, "job": 83, "event": "flush_started", "num_memtables": 1, "num_entries": 2311, "num_deletes": 251, "memory_usage": 7653800}
- 2017-07-11 14:53:40.835671 I | rook-ceph-mon1: 2017-07-11 14:53:40.835492 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 83] Level-0 flush table #131: started
- 2017-07-11 14:53:40.914433 I | rook-ceph-mon1: 2017-07-11 14:53:40.914394 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784820914385, "cf_name": "default", "job": 83, "event": "table_file_creation", "file_number": 131, "file_size": 5054475, "table_properties": {"data_size": 5036974, "index_size": 16681, "filter_size": 0, "raw_key_size": 17109, "raw_average_key_size": 18, "raw_value_size": 5012797, "raw_average_value_size": 5502, "num_data_blocks": 522, "num_entries": 911, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:53:40.914598 I | rook-ceph-mon1: 2017-07-11 14:53:40.914528 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 83] Level-0 flush table #131: 5054475 bytes OK
- 2017-07-11 14:53:40.973597 I | rook-ceph-mon1: 2017-07-11 14:53:40.973506 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.944839) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #131 started
- 2017-07-11 14:53:40.973657 I | rook-ceph-mon1: 2017-07-11 14:53:40.973643 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.973473) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #131: memtable #1 done
- 2017-07-11 14:53:40.973686 I | rook-ceph-mon1: 2017-07-11 14:53:40.973674 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.973483) EVENT_LOG_v1 {"time_micros": 1499784820973480, "job": 83, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:53:40.973729 I | rook-ceph-mon1: 2017-07-11 14:53:40.973716 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.973497) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:53:40.973742 I | rook-ceph-mon1:
- 2017-07-11 14:53:40.973782 I | rook-ceph-mon1: 2017-07-11 14:53:40.973757 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 83] Try to delete WAL files size 7598318, prev total WAL file size 7598318, number of live WAL files 2.
- 2017-07-11 14:53:40.973794 I | rook-ceph-mon1:
- 2017-07-11 14:53:40.975020 I | rook-ceph-mon1: 2017-07-11 14:53:40.974870 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:53:40.975064 I | rook-ceph-mon1: 2017-07-11 14:53:40.974903 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.974898) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:53:40.975079 I | rook-ceph-mon1:
- 2017-07-11 14:53:40.975092 I | rook-ceph-mon1: 2017-07-11 14:53:40.974908 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 84] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:53:40.975103 I | rook-ceph-mon1: 2017-07-11 14:53:40.974912 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 83 Base level 0, inputs: [131(4936KB)], [129(12MB)]
- 2017-07-11 14:53:40.975128 I | rook-ceph-mon1:
- 2017-07-11 14:53:40.975138 I | rook-ceph-mon1: 2017-07-11 14:53:40.974920 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784820974914, "job": 84, "event": "compaction_started", "files_L0": [131], "files_L1": [129], "score": -1, "input_data_size": 18650333}
- 2017-07-11 14:53:41.297067 I | rook-ceph-mon1: 2017-07-11 14:53:41.297027 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 84] Generated table #132: 2403 keys, 16097277 bytes
- 2017-07-11 14:53:41.299057 I | rook-ceph-mon1: 2017-07-11 14:53:41.299038 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784821299029, "cf_name": "default", "job": 84, "event": "table_file_creation", "file_number": 132, "file_size": 16097277, "table_properties": {"data_size": 16043860, "index_size": 52598, "filter_size": 0, "raw_key_size": 46458, "raw_average_key_size": 19, "raw_value_size": 15973454, "raw_average_value_size": 6647, "num_data_blocks": 1597, "num_entries": 2403, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:53:41.434701 I | rook-ceph-mon1: 2017-07-11 14:53:41.434680 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 84] Compacted 1@0 + 1@1 files to L1 => 16097277 bytes
- 2017-07-11 14:53:41.481391 I | rook-ceph-mon1: 2017-07-11 14:53:41.481339 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:53:41.481241) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 40.6 rd, 35.0 wr, level 1, files in(1, 1) out(1) MB in(4.8, 13.0) out(15.4), read-write-amplify(6.9) write-amplify(3.2) OK, records in: 2912, records dropped: 509
- 2017-07-11 14:53:41.481478 I | rook-ceph-mon1:
- 2017-07-11 14:53:41.481509 I | rook-ceph-mon1: 2017-07-11 14:53:41.481494 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:53:41.481272) EVENT_LOG_v1 {"time_micros": 1499784821481259, "job": 84, "event": "compaction_finished", "compaction_time_micros": 459748, "output_level": 1, "num_output_files": 1, "total_output_size": 16097277, "num_input_records": 2912, "num_output_records": 2403, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:53:41.482209 I | rook-ceph-mon1: 2017-07-11 14:53:41.482195 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784821482192, "job": 84, "event": "table_file_deletion", "file_number": 131}
- 2017-07-11 14:53:41.483710 I | rook-ceph-mon1: 2017-07-11 14:53:41.483697 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784821483695, "job": 84, "event": "table_file_deletion", "file_number": 129}
- 2017-07-11 14:53:44.487977 I | rook-ceph-mon1: 2017-07-11 14:53:44.487867 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:44.488034 I | rook-ceph-mon1: 2017-07-11 14:53:44.487885 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1535445665' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:50.503887 I | rook-ceph-mon1: 2017-07-11 14:53:50.503854 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:50.504857 I | rook-ceph-mon1: 2017-07-11 14:53:50.504841 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2473162621' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:51.887132 I | rook-ceph-mon1: 2017-07-11 14:53:51.887096 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:53:51.888899 I | rook-ceph-mon1: 2017-07-11 14:53:51.888870 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4199716442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:53:54.932148 I | rook-ceph-mon1: 2017-07-11 14:53:54.931779 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4753 MB, avail 94433 MB
- 2017-07-11 14:54:04.155177 I | rook-ceph-mon1: 2017-07-11 14:54:04.155144 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:04.155342 I | rook-ceph-mon1: 2017-07-11 14:54:04.155270 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/606475817' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:04.752711 I | rook-ceph-mon1: 2017-07-11 14:54:04.752680 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:04.752812 I | rook-ceph-mon1: 2017-07-11 14:54:04.752798 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/629244878' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:05.168382 I | rook-ceph-mon1: 2017-07-11 14:54:05.168351 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:05.168545 I | rook-ceph-mon1: 2017-07-11 14:54:05.168473 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2875374276' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:08.633476 I | rook-ceph-mon1: 2017-07-11 14:54:08.633447 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:08.633576 I | rook-ceph-mon1: 2017-07-11 14:54:08.633562 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2019950842' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:12.727650 I | rook-ceph-mon1: 2017-07-11 14:54:12.727619 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:12.729431 I | rook-ceph-mon1: 2017-07-11 14:54:12.729413 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3712412974' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:16.267232 I | rook-ceph-mon1: 2017-07-11 14:54:16.267205 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:16.267321 I | rook-ceph-mon1: 2017-07-11 14:54:16.267307 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3111786673' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:23.901823 I | rook-ceph-mon1: 2017-07-11 14:54:23.901781 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:23.908117 I | rook-ceph-mon1: 2017-07-11 14:54:23.907580 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3039253281' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:31.319883 I | rook-ceph-mon1: 2017-07-11 14:54:31.319856 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:54:31.321718 I | rook-ceph-mon1: 2017-07-11 14:54:31.321704 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1262566980' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:54:36.624046 I | rook-ceph-mon1: 2017-07-11 14:54:35.635715 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1900 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0516715s > max 0.05s
- 2017-07-11 14:54:36.629886 I | rook-ceph-mon1: 2017-07-11 14:54:35.636147 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1901 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.184127s > max 0.05s
- 2017-07-11 14:54:39.778384 I | rook-ceph-mon1: 2017-07-11 14:54:39.778312 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #133. Immutable memtables: 0.
- 2017-07-11 14:54:39.778454 I | rook-ceph-mon1:
- 2017-07-11 14:54:39.778470 I | rook-ceph-mon1: 2017-07-11 14:54:39.778337 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 85] Syncing log #130
- 2017-07-11 14:54:39.805120 I | rook-ceph-mon1: 2017-07-11 14:54:39.804933 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.778333) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:54:39.805158 I | rook-ceph-mon1: 2017-07-11 14:54:39.804940 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 85] Flushing memtable with next log file: 133
- 2017-07-11 14:54:39.805173 I | rook-ceph-mon1:
- 2017-07-11 14:54:39.805225 I | rook-ceph-mon1: 2017-07-11 14:54:39.804947 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784879804944, "job": 85, "event": "flush_started", "num_memtables": 1, "num_entries": 1116, "num_deletes": 502, "memory_usage": 2307752}
- 2017-07-11 14:54:39.805239 I | rook-ceph-mon1: 2017-07-11 14:54:39.804949 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 85] Level-0 flush table #134: started
- 2017-07-11 14:54:39.880246 I | rook-ceph-mon1: 2017-07-11 14:54:39.880182 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784879880173, "cf_name": "default", "job": 85, "event": "table_file_creation", "file_number": 134, "file_size": 1516529, "table_properties": {"data_size": 1510769, "index_size": 4945, "filter_size": 0, "raw_key_size": 13658, "raw_average_key_size": 19, "raw_value_size": 1497845, "raw_average_value_size": 2130, "num_data_blocks": 158, "num_entries": 703, "filter_policy_name": "", "kDeletedKeys": "502", "kMergeOperands": "0"}}
- 2017-07-11 14:54:39.880330 I | rook-ceph-mon1: 2017-07-11 14:54:39.880314 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 85] Level-0 flush table #134: 1516529 bytes OK
- 2017-07-11 14:54:39.928696 I | rook-ceph-mon1: 2017-07-11 14:54:39.928643 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.909240) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #134 started
- 2017-07-11 14:54:39.930187 I | rook-ceph-mon1: 2017-07-11 14:54:39.930171 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.928581) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #134: memtable #1 done
- 2017-07-11 14:54:39.930263 I | rook-ceph-mon1: 2017-07-11 14:54:39.930216 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.928604) EVENT_LOG_v1 {"time_micros": 1499784879928596, "job": 85, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:54:39.930299 I | rook-ceph-mon1: 2017-07-11 14:54:39.930285 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.928626) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:54:39.930326 I | rook-ceph-mon1:
- 2017-07-11 14:54:39.930371 I | rook-ceph-mon1: 2017-07-11 14:54:39.930348 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 85] Try to delete WAL files size 2283415, prev total WAL file size 2283415, number of live WAL files 2.
- 2017-07-11 14:54:39.930384 I | rook-ceph-mon1:
- 2017-07-11 14:54:39.938391 I | rook-ceph-mon1: 2017-07-11 14:54:39.930881 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:54:39.938431 I | rook-ceph-mon1: 2017-07-11 14:54:39.930908 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.930903) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:54:39.938446 I | rook-ceph-mon1:
- 2017-07-11 14:54:39.938457 I | rook-ceph-mon1: 2017-07-11 14:54:39.930912 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 86] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:54:39.938468 I | rook-ceph-mon1: 2017-07-11 14:54:39.930917 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 85 Base level 0, inputs: [134(1480KB)], [132(15MB)]
- 2017-07-11 14:54:39.938479 I | rook-ceph-mon1:
- 2017-07-11 14:54:39.938503 I | rook-ceph-mon1: 2017-07-11 14:54:39.930925 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784879930919, "job": 86, "event": "compaction_started", "files_L0": [134], "files_L1": [132], "score": -1, "input_data_size": 17613806}
- 2017-07-11 14:54:40.180012 I | rook-ceph-mon1: 2017-07-11 14:54:40.179980 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 86] Generated table #135: 2095 keys, 14538036 bytes
- 2017-07-11 14:54:40.186236 I | rook-ceph-mon1: 2017-07-11 14:54:40.186211 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784880186203, "cf_name": "default", "job": 86, "event": "table_file_creation", "file_number": 135, "file_size": 14538036, "table_properties": {"data_size": 14489326, "index_size": 47891, "filter_size": 0, "raw_key_size": 40354, "raw_average_key_size": 19, "raw_value_size": 14426520, "raw_average_value_size": 6886, "num_data_blocks": 1468, "num_entries": 2095, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:54:40.252583 I | rook-ceph-mon1: 2017-07-11 14:54:40.252560 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 86] Compacted 1@0 + 1@1 files to L1 => 14538036 bytes
- 2017-07-11 14:54:40.274218 I | rook-ceph-mon1: 2017-07-11 14:54:40.274181 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:54:40.271545) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 54.8 rd, 45.2 wr, level 1, files in(1, 1) out(1) MB in(1.4, 15.4) out(13.9), read-write-amplify(21.2) write-amplify(9.6) OK, records in: 3106, records dropped: 1011
- 2017-07-11 14:54:40.274258 I | rook-ceph-mon1:
- 2017-07-11 14:54:40.274290 I | rook-ceph-mon1: 2017-07-11 14:54:40.274275 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:54:40.271559) EVENT_LOG_v1 {"time_micros": 1499784880271553, "job": 86, "event": "compaction_finished", "compaction_time_micros": 321624, "output_level": 1, "num_output_files": 1, "total_output_size": 14538036, "num_input_records": 3106, "num_output_records": 2095, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:54:40.274642 I | rook-ceph-mon1: 2017-07-11 14:54:40.274629 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784880274622, "job": 86, "event": "table_file_deletion", "file_number": 134}
- 2017-07-11 14:54:40.292008 I | rook-ceph-mon1: 2017-07-11 14:54:40.291991 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784880291989, "job": 86, "event": "table_file_deletion", "file_number": 132}
- 2017-07-11 14:54:40.292086 I | rook-ceph-mon1: 2017-07-11 14:54:40.292071 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:54:49.876180 I | rook-ceph-mon1: 2017-07-11 14:54:49.876147 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:54:49.876277 I | rook-ceph-mon1: 2017-07-11 14:54:49.876263 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4031894879' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:54:54.937344 I | rook-ceph-mon1: 2017-07-11 14:54:54.937066 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4752 MB, avail 94435 MB
- 2017-07-11 14:55:00.225921 I | rook-ceph-mon1: 2017-07-11 14:55:00.225872 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:00.226043 I | rook-ceph-mon1: 2017-07-11 14:55:00.226030 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3946196923' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:06.172169 I | rook-ceph-mon1: 2017-07-11 14:55:05.336568 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1919 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:55:15.925278 I | rook-ceph-mon1: 2017-07-11 14:55:15.925242 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:55:15.925370 I | rook-ceph-mon1: 2017-07-11 14:55:15.925356 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2896920933' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:55:23.784847 I | rook-ceph-mon1: 2017-07-11 14:55:23.784719 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:23.784922 I | rook-ceph-mon1: 2017-07-11 14:55:23.784738 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3871142492' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:25.547135 I | rook-ceph-mon1: 2017-07-11 14:55:25.547105 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:55:25.548698 I | rook-ceph-mon1: 2017-07-11 14:55:25.548683 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3949234565' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:55:30.363631 I | rook-ceph-mon1: 2017-07-11 14:55:30.363601 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:30.363858 I | rook-ceph-mon1: 2017-07-11 14:55:30.363843 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2148941080' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:41.721987 I | rook-ceph-mon1: 2017-07-11 14:55:41.721957 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:41.722258 I | rook-ceph-mon1: 2017-07-11 14:55:41.722243 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2772395767' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:50.151166 I | rook-ceph-mon1: 2017-07-11 14:55:50.151137 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:55:50.151261 I | rook-ceph-mon1: 2017-07-11 14:55:50.151247 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3787682836' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:55:52.747317 I | rook-ceph-mon1: 2017-07-11 14:55:52.747287 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:52.747493 I | rook-ceph-mon1: 2017-07-11 14:55:52.747420 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3262022703' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:54.942508 I | rook-ceph-mon1: 2017-07-11 14:55:54.942245 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4752 MB, avail 94434 MB
- 2017-07-11 14:55:59.956441 I | rook-ceph-mon1: 2017-07-11 14:55:59.956416 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:59.956541 I | rook-ceph-mon1: 2017-07-11 14:55:59.956528 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3138048949' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:56:08.155477 I | rook-ceph-mon1: 2017-07-11 14:56:08.155451 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:56:08.156862 I | rook-ceph-mon1: 2017-07-11 14:56:08.156844 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1904393072' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:56:11.264996 I | rook-ceph-mon1: 2017-07-11 14:56:11.264591 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:56:11.265068 I | rook-ceph-mon1: 2017-07-11 14:56:11.264626 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2534028265' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:56:27.748579 I | rook-ceph-mon1: 2017-07-11 14:56:27.748544 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:27.748772 I | rook-ceph-mon1: 2017-07-11 14:56:27.748692 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1554938510' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:33.524534 I | rook-ceph-mon1: 2017-07-11 14:56:33.524502 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:56:33.524632 I | rook-ceph-mon1: 2017-07-11 14:56:33.524618 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/77536819' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:56:39.678683 I | rook-ceph-mon1: 2017-07-11 14:56:39.678656 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:56:39.684389 I | rook-ceph-mon1: 2017-07-11 14:56:39.678772 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3138960118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:56:48.264571 I | rook-ceph-mon1: 2017-07-11 14:56:48.264537 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:56:48.264671 I | rook-ceph-mon1: 2017-07-11 14:56:48.264656 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2554429052' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:56:54.957966 I | rook-ceph-mon1: 2017-07-11 14:56:54.957724 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4752 MB, avail 94434 MB
- 2017-07-11 14:56:55.788438 I | rook-ceph-mon1: 2017-07-11 14:56:55.788409 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:56:55.788609 I | rook-ceph-mon1: 2017-07-11 14:56:55.788536 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1488296056' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:57:07.961297 I | rook-ceph-mon1: 2017-07-11 14:57:07.961221 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #136. Immutable memtables: 0.
- 2017-07-11 14:57:07.961361 I | rook-ceph-mon1:
- 2017-07-11 14:57:07.961379 I | rook-ceph-mon1: 2017-07-11 14:57:07.961261 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 87] Syncing log #133
- 2017-07-11 14:57:08.095339 I | rook-ceph-mon1: 2017-07-11 14:57:08.091683 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:57:07.961256) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:57:08.095417 I | rook-ceph-mon1: 2017-07-11 14:57:08.091709 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 87] Flushing memtable with next log file: 136
- 2017-07-11 14:57:08.095446 I | rook-ceph-mon1:
- 2017-07-11 14:57:08.095478 I | rook-ceph-mon1: 2017-07-11 14:57:08.091718 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785028091714, "job": 87, "event": "flush_started", "num_memtables": 1, "num_entries": 1688, "num_deletes": 251, "memory_usage": 5313312}
- 2017-07-11 14:57:08.095590 I | rook-ceph-mon1: 2017-07-11 14:57:08.091720 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 87] Level-0 flush table #137: started
- 2017-07-11 14:57:08.152536 I | rook-ceph-mon1: 2017-07-11 14:57:08.152465 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785028152457, "cf_name": "default", "job": 87, "event": "table_file_creation", "file_number": 137, "file_size": 3504920, "table_properties": {"data_size": 3492491, "index_size": 11611, "filter_size": 0, "raw_key_size": 13329, "raw_average_key_size": 18, "raw_value_size": 3474579, "raw_average_value_size": 4880, "num_data_blocks": 366, "num_entries": 712, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:57:08.152593 I | rook-ceph-mon1: 2017-07-11 14:57:08.152475 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 87] Level-0 flush table #137: 3504920 bytes OK
- 2017-07-11 14:57:08.289255 I | rook-ceph-mon1: 2017-07-11 14:57:08.288483 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:57:08.219444) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #137 started
- 2017-07-11 14:57:08.291566 I | rook-ceph-mon1: 2017-07-11 14:57:08.288494 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:57:08.288418) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #137: memtable #1 done
- 2017-07-11 14:57:08.291596 I | rook-ceph-mon1: 2017-07-11 14:57:08.288497 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:57:08.288439) EVENT_LOG_v1 {"time_micros": 1499785028288431, "job": 87, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:57:08.291611 I | rook-ceph-mon1: 2017-07-11 14:57:08.288512 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:57:08.288461) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:57:08.291621 I | rook-ceph-mon1:
- 2017-07-11 14:57:08.291644 I | rook-ceph-mon1: 2017-07-11 14:57:08.288517 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 87] Try to delete WAL files size 5269160, prev total WAL file size 5269160, number of live WAL files 2.
- 2017-07-11 14:57:08.291656 I | rook-ceph-mon1:
- 2017-07-11 14:57:08.319171 I | rook-ceph-mon1: 2017-07-11 14:57:08.291674 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:57:08.319216 I | rook-ceph-mon1: 2017-07-11 14:57:08.291731 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:57:08.291726) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:57:08.319242 I | rook-ceph-mon1:
- 2017-07-11 14:57:08.319253 I | rook-ceph-mon1: 2017-07-11 14:57:08.291738 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 88] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:57:08.319275 I | rook-ceph-mon1: 2017-07-11 14:57:08.291742 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 87 Base level 0, inputs: [137(3422KB)], [135(13MB)]
- 2017-07-11 14:57:08.319287 I | rook-ceph-mon1:
- 2017-07-11 14:57:08.319297 I | rook-ceph-mon1: 2017-07-11 14:57:08.291751 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785028291744, "job": 88, "event": "compaction_started", "files_L0": [137], "files_L1": [135], "score": -1, "input_data_size": 18042956}
- 2017-07-11 14:57:08.488847 I | rook-ceph-mon1: 2017-07-11 14:57:08.488797 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 88] Generated table #138: 2298 keys, 15477496 bytes
- 2017-07-11 14:57:08.491617 I | rook-ceph-mon1: 2017-07-11 14:57:08.491588 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785028491578, "cf_name": "default", "job": 88, "event": "table_file_creation", "file_number": 138, "file_size": 15477496, "table_properties": {"data_size": 15424730, "index_size": 51947, "filter_size": 0, "raw_key_size": 44462, "raw_average_key_size": 19, "raw_value_size": 15356225, "raw_average_value_size": 6682, "num_data_blocks": 1582, "num_entries": 2298, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:57:08.539753 I | rook-ceph-mon1: 2017-07-11 14:57:08.539642 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:57:08.539792 I | rook-ceph-mon1: 2017-07-11 14:57:08.539662 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3535841365' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:57:08.577292 I | rook-ceph-mon1: 2017-07-11 14:57:08.577268 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 88] Compacted 1@0 + 1@1 files to L1 => 15477496 bytes
- 2017-07-11 14:57:08.645512 I | rook-ceph-mon1: 2017-07-11 14:57:08.645459 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:57:08.645368) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 63.2 rd, 54.2 wr, level 1, files in(1, 1) out(1) MB in(3.3, 13.9) out(14.8), read-write-amplify(9.6) write-amplify(4.4) OK, records in: 2807, records dropped: 509
- 2017-07-11 14:57:08.645564 I | rook-ceph-mon1:
- 2017-07-11 14:57:08.645595 I | rook-ceph-mon1: 2017-07-11 14:57:08.645580 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:57:08.645400) EVENT_LOG_v1 {"time_micros": 1499785028645387, "job": 88, "event": "compaction_finished", "compaction_time_micros": 285504, "output_level": 1, "num_output_files": 1, "total_output_size": 15477496, "num_input_records": 2807, "num_output_records": 2298, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:57:08.646174 I | rook-ceph-mon1: 2017-07-11 14:57:08.646161 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785028646158, "job": 88, "event": "table_file_deletion", "file_number": 137}
- 2017-07-11 14:57:08.647737 I | rook-ceph-mon1: 2017-07-11 14:57:08.647723 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785028647721, "job": 88, "event": "table_file_deletion", "file_number": 135}
- 2017-07-11 14:57:09.442261 I | rook-ceph-mon1: 2017-07-11 14:57:09.442237 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:57:09.442345 I | rook-ceph-mon1: 2017-07-11 14:57:09.442332 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2517921798' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:57:14.865554 I | rook-ceph-mon1: 2017-07-11 14:57:14.864849 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #139. Immutable memtables: 0.
- 2017-07-11 14:57:14.865615 I | rook-ceph-mon1:
- 2017-07-11 14:57:14.865632 I | rook-ceph-mon1: 2017-07-11 14:57:14.864892 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 89] Syncing log #136
- 2017-07-11 14:57:14.882936 I | rook-ceph-mon1: 2017-07-11 14:57:14.882599 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.864887) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:57:14.885546 I | rook-ceph-mon1: 2017-07-11 14:57:14.882607 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 89] Flushing memtable with next log file: 139
- 2017-07-11 14:57:14.885575 I | rook-ceph-mon1:
- 2017-07-11 14:57:14.885587 I | rook-ceph-mon1: 2017-07-11 14:57:14.882614 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785034882611, "job": 89, "event": "flush_started", "num_memtables": 1, "num_entries": 296, "num_deletes": 251, "memory_usage": 161728}
- 2017-07-11 14:57:14.885598 I | rook-ceph-mon1: 2017-07-11 14:57:14.882617 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 89] Level-0 flush table #140: started
- 2017-07-11 14:57:14.931177 I | rook-ceph-mon1: 2017-07-11 14:57:14.931129 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785034931122, "cf_name": "default", "job": 89, "event": "table_file_creation", "file_number": 140, "file_size": 101274, "table_properties": {"data_size": 100099, "index_size": 361, "filter_size": 0, "raw_key_size": 5453, "raw_average_key_size": 20, "raw_value_size": 96219, "raw_average_value_size": 355, "num_data_blocks": 12, "num_entries": 271, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:57:14.931224 I | rook-ceph-mon1: 2017-07-11 14:57:14.931135 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 89] Level-0 flush table #140: 101274 bytes OK
- 2017-07-11 14:57:15.067465 I | rook-ceph-mon1: 2017-07-11 14:57:15.067344 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:57:15.036846) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #140 started
- 2017-07-11 14:57:15.067504 I | rook-ceph-mon1: 2017-07-11 14:57:15.067349 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:57:15.067318) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #140: memtable #1 done
- 2017-07-11 14:57:15.067744 I | rook-ceph-mon1: 2017-07-11 14:57:15.067353 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:57:15.067328) EVENT_LOG_v1 {"time_micros": 1499785035067324, "job": 89, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:57:15.067772 I | rook-ceph-mon1: 2017-07-11 14:57:15.067354 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-14:57:15.067337) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:57:15.067784 I | rook-ceph-mon1:
- 2017-07-11 14:57:15.067795 I | rook-ceph-mon1: 2017-07-11 14:57:15.067358 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 89] Try to delete WAL files size 153637, prev total WAL file size 153637, number of live WAL files 2.
- 2017-07-11 14:57:15.067951 I | rook-ceph-mon1:
- 2017-07-11 14:57:15.067980 I | rook-ceph-mon1: 2017-07-11 14:57:15.067523 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:57:15.067993 I | rook-ceph-mon1: 2017-07-11 14:57:15.067696 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:57:15.068004 I | rook-ceph-mon1: 2017-07-11 14:57:15.067700 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:57:15.068014 I | rook-ceph-mon1: ** DB Stats **
- 2017-07-11 14:57:15.068024 I | rook-ceph-mon1: Uptime(secs): 5601.4 total, 606.4 interval
- 2017-07-11 14:57:15.068047 I | rook-ceph-mon1: Cumulative writes: 10K writes, 53K keys, 10K commit groups, 1.0 writes per commit group, ingest: 0.14 GB, 0.03 MB/s
- 2017-07-11 14:57:15.068058 I | rook-ceph-mon1: Cumulative WAL: 10K writes, 10K syncs, 1.00 writes per sync, written: 0.14 GB, 0.03 MB/s
- 2017-07-11 14:57:15.068123 I | rook-ceph-mon1: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:57:15.068136 I | rook-ceph-mon1: Interval writes: 1518 writes, 8477 keys, 1518 commit groups, 1.0 writes per commit group, ingest: 21.87 MB, 0.04 MB/s
- 2017-07-11 14:57:15.068146 I | rook-ceph-mon1: Interval WAL: 1518 writes, 1518 syncs, 1.00 writes per sync, written: 0.02 MB, 0.04 MB/s
- 2017-07-11 14:57:15.068156 I | rook-ceph-mon1: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:57:15.068166 I | rook-ceph-mon1:
- 2017-07-11 14:57:15.068175 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 14:57:15.068195 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:57:15.068207 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:57:15.068217 I | rook-ceph-mon1: L0 1/1 98.90 KB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 11.2 8 46 0.176 0 0
- 2017-07-11 14:57:15.068274 I | rook-ceph-mon1: L1 1/1 14.76 MB 0.0 0.6 0.1 0.5 0.5 0.0 0.0 6.2 37.3 32.9 17 42 0.406 104K 20K
- 2017-07-11 14:57:15.068289 I | rook-ceph-mon1: Sum 2/2 14.86 MB 0.0 0.6 0.1 0.5 0.6 0.1 0.0 7.2 25.3 25.9 25 88 0.286 104K 20K
- 2017-07-11 14:57:15.068299 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 9.1 37.4 36.6 4 16 0.221 22K 4532
- 2017-07-11 14:57:15.068309 I | rook-ceph-mon1: Uptime(secs): 5601.4 total, 5601.4 interval
- 2017-07-11 14:57:15.068318 I | rook-ceph-mon1: Flush(GB): cumulative 0.088, interval 0.014
- 2017-07-11 14:57:15.068327 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:57:15.068513 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:57:15.068534 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:57:15.068545 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:57:15.068556 I | rook-ceph-mon1: Cumulative compaction: 0.64 GB write, 0.12 MB/s write, 0.62 GB read, 0.11 MB/s read, 25.2 seconds
- 2017-07-11 14:57:15.068566 I | rook-ceph-mon1: Interval compaction: 0.13 GB write, 0.02 MB/s write, 0.13 GB read, 0.02 MB/s read, 3.5 seconds
- 2017-07-11 14:57:15.068589 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:57:15.068600 I | rook-ceph-mon1:
- 2017-07-11 14:57:15.068610 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:57:15.068620 I | rook-ceph-mon1:
- 2017-07-11 14:57:15.068641 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 14:57:15.068662 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:57:15.068674 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:57:15.068740 I | rook-ceph-mon1: L0 1/1 98.90 KB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 11.2 8 46 0.176 0 0
- 2017-07-11 14:57:15.068754 I | rook-ceph-mon1: L1 1/1 14.76 MB 0.0 0.6 0.1 0.5 0.5 0.0 0.0 6.2 37.3 32.9 17 42 0.406 104K 20K
- 2017-07-11 14:57:15.068765 I | rook-ceph-mon1: Sum 2/2 14.86 MB 0.0 0.6 0.1 0.5 0.6 0.1 0.0 7.2 25.3 25.9 25 88 0.286 104K 20K
- 2017-07-11 14:57:15.068775 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:57:15.068786 I | rook-ceph-mon1: Uptime(secs): 5601.4 total, 5601.4 interval
- 2017-07-11 14:57:15.068795 I | rook-ceph-mon1: Flush(GB): cumulative 0.088, interval 0.000
- 2017-07-11 14:57:15.068817 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:57:15.068837 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:57:15.068893 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:57:15.068905 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:57:15.068915 I | rook-ceph-mon1: Cumulative compaction: 0.64 GB write, 0.12 MB/s write, 0.62 GB read, 0.11 MB/s read, 25.2 seconds
- 2017-07-11 14:57:15.068924 I | rook-ceph-mon1: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:57:15.068934 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:57:15.068944 I | rook-ceph-mon1:
- 2017-07-11 14:57:15.068964 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:57:15.069043 I | rook-ceph-mon1:
- 2017-07-11 14:57:15.069059 I | rook-ceph-mon1: 2017-07-11 14:57:15.067712 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:57:15.067707) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:57:15.069069 I | rook-ceph-mon1:
- 2017-07-11 14:57:15.069080 I | rook-ceph-mon1: 2017-07-11 14:57:15.067813 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 90] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:57:15.069090 I | rook-ceph-mon1: 2017-07-11 14:57:15.067818 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 89 Base level 0, inputs: [140(98KB)], [138(14MB)]
- 2017-07-11 14:57:15.069100 I | rook-ceph-mon1:
- 2017-07-11 14:57:15.069120 I | rook-ceph-mon1: 2017-07-11 14:57:15.067826 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785035067820, "job": 90, "event": "compaction_started", "files_L0": [140], "files_L1": [138], "score": -1, "input_data_size": 15578770}
- 2017-07-11 14:57:15.288923 I | rook-ceph-mon1: 2017-07-11 14:57:15.288892 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 90] Generated table #141: 2060 keys, 13922886 bytes
- 2017-07-11 14:57:15.290291 I | rook-ceph-mon1: 2017-07-11 14:57:15.290277 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785035290269, "cf_name": "default", "job": 90, "event": "table_file_creation", "file_number": 141, "file_size": 13922886, "table_properties": {"data_size": 13878021, "index_size": 44046, "filter_size": 0, "raw_key_size": 39688, "raw_average_key_size": 19, "raw_value_size": 13818378, "raw_average_value_size": 6707, "num_data_blocks": 1342, "num_entries": 2060, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:57:15.347403 I | rook-ceph-mon1: 2017-07-11 14:57:15.347383 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 90] Compacted 1@0 + 1@1 files to L1 => 13922886 bytes
- 2017-07-11 14:57:15.397300 I | rook-ceph-mon1: 2017-07-11 14:57:15.397277 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:57:15.397197) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 55.7 rd, 49.8 wr, level 1, files in(1, 1) out(1) MB in(0.1, 14.8) out(13.3), read-write-amplify(291.3) write-amplify(137.5) OK, records in: 2569, records dropped: 509
- 2017-07-11 14:57:15.397350 I | rook-ceph-mon1:
- 2017-07-11 14:57:15.397380 I | rook-ceph-mon1: 2017-07-11 14:57:15.397366 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-14:57:15.397213) EVENT_LOG_v1 {"time_micros": 1499785035397207, "job": 90, "event": "compaction_finished", "compaction_time_micros": 279546, "output_level": 1, "num_output_files": 1, "total_output_size": 13922886, "num_input_records": 2569, "num_output_records": 2060, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:57:15.397562 I | rook-ceph-mon1: 2017-07-11 14:57:15.397546 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785035397480, "job": 90, "event": "table_file_deletion", "file_number": 140}
- 2017-07-11 14:57:15.405826 I | rook-ceph-mon1: 2017-07-11 14:57:15.405803 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785035405801, "job": 90, "event": "table_file_deletion", "file_number": 138}
- 2017-07-11 14:57:15.405896 I | rook-ceph-mon1: 2017-07-11 14:57:15.405882 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:57:20.268417 I | rook-ceph-mon1: 2017-07-11 14:57:20.268374 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:57:20.268603 I | rook-ceph-mon1: 2017-07-11 14:57:20.268522 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1214827476' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:57:20.710406 I | rook-ceph-mon1: 2017-07-11 14:57:20.710371 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:57:20.710505 I | rook-ceph-mon1: 2017-07-11 14:57:20.710490 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3673104472' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:57:31.556830 I | rook-ceph-mon1: 2017-07-11 14:57:31.556771 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:57:31.557434 I | rook-ceph-mon1: 2017-07-11 14:57:31.557413 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2944835279' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:57:32.604266 I | rook-ceph-mon1: 2017-07-11 14:57:32.604218 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:57:32.604362 I | rook-ceph-mon1: 2017-07-11 14:57:32.604347 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1907352723' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:57:42.354879 I | rook-ceph-mon1: 2017-07-11 14:57:42.354846 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:57:42.357016 I | rook-ceph-mon1: 2017-07-11 14:57:42.356999 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4040886125' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:57:43.168112 I | rook-ceph-mon1: 2017-07-11 14:57:43.167819 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:57:43.168281 I | rook-ceph-mon1: 2017-07-11 14:57:43.168213 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/972259836' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:57:53.473410 I | rook-ceph-mon1: 2017-07-11 14:57:53.473380 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:57:53.473573 I | rook-ceph-mon1: 2017-07-11 14:57:53.473507 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1941668497' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:57:54.966425 I | rook-ceph-mon1: 2017-07-11 14:57:54.966159 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4751 MB, avail 94435 MB
- 2017-07-11 14:58:03.001408 I | rook-ceph-mon1: 2017-07-11 14:58:03.001376 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:03.001663 I | rook-ceph-mon1: 2017-07-11 14:58:03.001648 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2706486742' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:11.695031 I | rook-ceph-mon1: 2017-07-11 14:58:11.694958 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:11.695687 I | rook-ceph-mon1: 2017-07-11 14:58:11.695604 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/87333681' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:14.216252 I | rook-ceph-mon1: 2017-07-11 14:58:14.216196 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:14.216509 I | rook-ceph-mon1: 2017-07-11 14:58:14.216495 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3805679593' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:15.829026 I | rook-ceph-mon1: 2017-07-11 14:58:15.829000 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:15.829171 I | rook-ceph-mon1: 2017-07-11 14:58:15.829110 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3527059313' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:22.551912 I | rook-ceph-mon1: 2017-07-11 14:58:22.551886 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:22.552005 I | rook-ceph-mon1: 2017-07-11 14:58:22.551991 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/642138986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:33.243817 I | rook-ceph-mon1: 2017-07-11 14:58:33.243759 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:33.243886 I | rook-ceph-mon1: 2017-07-11 14:58:33.243773 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/209581481' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:35.727894 I | rook-ceph-mon1: 2017-07-11 14:58:35.727861 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:35.727992 I | rook-ceph-mon1: 2017-07-11 14:58:35.727978 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1539576546' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:38.865182 I | rook-ceph-mon1: 2017-07-11 14:58:38.865148 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:38.865362 I | rook-ceph-mon1: 2017-07-11 14:58:38.865278 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/628624013' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:39.384544 I | rook-ceph-mon1: 2017-07-11 14:58:39.384518 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:39.384632 I | rook-ceph-mon1: 2017-07-11 14:58:39.384618 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1029977491' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:54.972120 I | rook-ceph-mon1: 2017-07-11 14:58:54.971821 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4752 MB, avail 94435 MB
- 2017-07-11 14:59:07.540250 I | rook-ceph-mon1: 2017-07-11 14:59:07.540025 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:07.540323 I | rook-ceph-mon1: 2017-07-11 14:59:07.540040 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/498024113' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:21.218655 I | rook-ceph-mon1: 2017-07-11 14:59:21.218627 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:21.218753 I | rook-ceph-mon1: 2017-07-11 14:59:21.218740 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1564415374' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:32.222149 I | rook-ceph-mon1: 2017-07-11 14:59:32.222027 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:32.223988 I | rook-ceph-mon1: 2017-07-11 14:59:32.222054 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4036925191' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:36.396635 I | rook-ceph-mon1: 2017-07-11 14:59:36.396610 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:36.396719 I | rook-ceph-mon1: 2017-07-11 14:59:36.396705 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2356497014' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:36.947785 I | rook-ceph-mon1: 2017-07-11 14:59:35.637306 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2061 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0654328s > max 0.05s
- 2017-07-11 14:59:36.947839 I | rook-ceph-mon1: 2017-07-11 14:59:35.637769 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2062 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.212449s > max 0.05s
- 2017-07-11 14:59:43.597825 I | rook-ceph-mon1: 2017-07-11 14:59:43.597798 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:43.597913 I | rook-ceph-mon1: 2017-07-11 14:59:43.597899 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/159247028' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:47.414959 I | rook-ceph-mon1: 2017-07-11 14:59:47.414922 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:47.415127 I | rook-ceph-mon1: 2017-07-11 14:59:47.415055 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1383458333' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:54.769994 I | rook-ceph-mon1: 2017-07-11 14:59:54.769681 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:54.770095 I | rook-ceph-mon1: 2017-07-11 14:59:54.769702 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2510412203' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:59:54.973337 I | rook-ceph-mon1: 2017-07-11 14:59:54.972532 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4752 MB, avail 94435 MB
- 2017-07-11 14:59:58.874940 I | rook-ceph-mon1: 2017-07-11 14:59:58.874903 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:59:58.875039 I | rook-ceph-mon1: 2017-07-11 14:59:58.875024 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/47727764' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:01.337184 I | rook-ceph-mon1: 2017-07-11 15:00:00.000329 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2084 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 15:00:10.477102 I | rook-ceph-mon1: 2017-07-11 15:00:10.477033 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:10.477369 I | rook-ceph-mon1: 2017-07-11 15:00:10.477207 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/100747049' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:10.485842 I | rook-ceph-mon1: 2017-07-11 15:00:10.485824 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:10.486097 I | rook-ceph-mon1: 2017-07-11 15:00:10.486083 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2446478330' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:10.788524 I | rook-ceph-mon1: 2017-07-11 15:00:10.788492 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:10.790089 I | rook-ceph-mon1: 2017-07-11 15:00:10.790071 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/29808654' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:21.807671 I | rook-ceph-mon1: 2017-07-11 15:00:21.807636 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:21.807769 I | rook-ceph-mon1: 2017-07-11 15:00:21.807754 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4018757182' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:22.019703 I | rook-ceph-mon1: 2017-07-11 15:00:22.019672 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:22.019809 I | rook-ceph-mon1: 2017-07-11 15:00:22.019795 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/28219013' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:28.315392 I | rook-ceph-mon1: 2017-07-11 15:00:28.315359 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:28.317868 I | rook-ceph-mon1: 2017-07-11 15:00:28.317851 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1775154031' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:32.121903 I | rook-ceph-mon1: 2017-07-11 15:00:32.121876 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:32.122002 I | rook-ceph-mon1: 2017-07-11 15:00:32.121989 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/868873960' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:35.843939 I | rook-ceph-mon1: 2017-07-11 15:00:35.843906 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:35.844038 I | rook-ceph-mon1: 2017-07-11 15:00:35.844023 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3586055649' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:46.236787 I | rook-ceph-mon1: 2017-07-11 15:00:46.236697 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #142. Immutable memtables: 0.
- 2017-07-11 15:00:46.236860 I | rook-ceph-mon1:
- 2017-07-11 15:00:46.236878 I | rook-ceph-mon1: 2017-07-11 15:00:46.236750 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 91] Syncing log #139
- 2017-07-11 15:00:46.285342 I | rook-ceph-mon1: 2017-07-11 15:00:46.275940 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.236745) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:00:46.285381 I | rook-ceph-mon1: 2017-07-11 15:00:46.275946 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 91] Flushing memtable with next log file: 142
- 2017-07-11 15:00:46.285396 I | rook-ceph-mon1:
- 2017-07-11 15:00:46.285407 I | rook-ceph-mon1: 2017-07-11 15:00:46.275954 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246275951, "job": 91, "event": "flush_started", "num_memtables": 1, "num_entries": 2243, "num_deletes": 251, "memory_usage": 7338848}
- 2017-07-11 15:00:46.285417 I | rook-ceph-mon1: 2017-07-11 15:00:46.275956 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 91] Level-0 flush table #143: started
- 2017-07-11 15:00:46.383354 I | rook-ceph-mon1: 2017-07-11 15:00:46.383297 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246383282, "cf_name": "default", "job": 91, "event": "table_file_creation", "file_number": 143, "file_size": 4846034, "table_properties": {"data_size": 4828922, "index_size": 16293, "filter_size": 0, "raw_key_size": 16634, "raw_average_key_size": 18, "raw_value_size": 4805351, "raw_average_value_size": 5423, "num_data_blocks": 511, "num_entries": 886, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 15:00:46.383451 I | rook-ceph-mon1: 2017-07-11 15:00:46.383437 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 91] Level-0 flush table #143: 4846034 bytes OK
- 2017-07-11 15:00:46.499937 I | rook-ceph-mon1: 2017-07-11 15:00:46.499888 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.460909) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #143 started
- 2017-07-11 15:00:46.501621 I | rook-ceph-mon1: 2017-07-11 15:00:46.501606 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.499827) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #143: memtable #1 done
- 2017-07-11 15:00:46.501661 I | rook-ceph-mon1: 2017-07-11 15:00:46.501648 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.499847) EVENT_LOG_v1 {"time_micros": 1499785246499840, "job": 91, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:00:46.501703 I | rook-ceph-mon1: 2017-07-11 15:00:46.501691 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.499867) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:00:46.501716 I | rook-ceph-mon1:
- 2017-07-11 15:00:46.501741 I | rook-ceph-mon1: 2017-07-11 15:00:46.501731 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 91] Try to delete WAL files size 7284702, prev total WAL file size 7284702, number of live WAL files 2.
- 2017-07-11 15:00:46.501765 I | rook-ceph-mon1:
- 2017-07-11 15:00:46.519315 I | rook-ceph-mon1: 2017-07-11 15:00:46.502695 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:00:46.519372 I | rook-ceph-mon1: 2017-07-11 15:00:46.502727 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.502723) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 15:00:46.519388 I | rook-ceph-mon1:
- 2017-07-11 15:00:46.519399 I | rook-ceph-mon1: 2017-07-11 15:00:46.502733 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 92] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:00:46.519410 I | rook-ceph-mon1: 2017-07-11 15:00:46.502736 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 91 Base level 0, inputs: [143(4732KB)], [141(13MB)]
- 2017-07-11 15:00:46.519433 I | rook-ceph-mon1:
- 2017-07-11 15:00:46.519445 I | rook-ceph-mon1: 2017-07-11 15:00:46.502745 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246502739, "job": 92, "event": "compaction_started", "files_L0": [143], "files_L1": [141], "score": -1, "input_data_size": 18768920}
- 2017-07-11 15:00:46.666469 I | rook-ceph-mon1: 2017-07-11 15:00:46.666423 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 92] Generated table #144: 2437 keys, 16218051 bytes
- 2017-07-11 15:00:46.668030 I | rook-ceph-mon1: 2017-07-11 15:00:46.668013 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246668005, "cf_name": "default", "job": 92, "event": "table_file_creation", "file_number": 144, "file_size": 16218051, "table_properties": {"data_size": 16164454, "index_size": 52778, "filter_size": 0, "raw_key_size": 47101, "raw_average_key_size": 19, "raw_value_size": 16093454, "raw_average_value_size": 6603, "num_data_blocks": 1601, "num_entries": 2437, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:00:46.800840 I | rook-ceph-mon1: 2017-07-11 15:00:46.800781 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 92] Compacted 1@0 + 1@1 files to L1 => 16218051 bytes
- 2017-07-11 15:00:46.888363 I | rook-ceph-mon1: 2017-07-11 15:00:46.888337 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.888267) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 76.8 rd, 66.4 wr, level 1, files in(1, 1) out(1) MB in(4.6, 13.3) out(15.5), read-write-amplify(7.2) write-amplify(3.3) OK, records in: 2946, records dropped: 509
- 2017-07-11 15:00:46.889606 I | rook-ceph-mon1:
- 2017-07-11 15:00:46.889654 I | rook-ceph-mon1: 2017-07-11 15:00:46.889637 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.888282) EVENT_LOG_v1 {"time_micros": 1499785246888275, "job": 92, "event": "compaction_finished", "compaction_time_micros": 244389, "output_level": 1, "num_output_files": 1, "total_output_size": 16218051, "num_input_records": 2946, "num_output_records": 2437, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:00:46.890429 I | rook-ceph-mon1: 2017-07-11 15:00:46.890395 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246890392, "job": 92, "event": "table_file_deletion", "file_number": 143}
- 2017-07-11 15:00:46.898049 I | rook-ceph-mon1: 2017-07-11 15:00:46.898008 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246897999, "job": 92, "event": "table_file_deletion", "file_number": 141}
- 2017-07-11 15:00:50.387926 I | rook-ceph-mon1: 2017-07-11 15:00:50.387896 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:50.403637 I | rook-ceph-mon1: 2017-07-11 15:00:50.403319 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2384621513' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:54.254022 I | rook-ceph-mon1: 2017-07-11 15:00:54.253989 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:54.254121 I | rook-ceph-mon1: 2017-07-11 15:00:54.254107 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/79163556' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:54.980881 I | rook-ceph-mon1: 2017-07-11 15:00:54.980523 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4754 MB, avail 94432 MB
- 2017-07-11 15:00:56.106038 I | rook-ceph-mon1: 2017-07-11 15:00:56.106008 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:56.106141 I | rook-ceph-mon1: 2017-07-11 15:00:56.106126 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3358804080' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:56.797488 I | rook-ceph-mon1: 2017-07-11 15:00:56.797464 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:56.797569 I | rook-ceph-mon1: 2017-07-11 15:00:56.797555 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2324502488' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:59.988778 I | rook-ceph-mon1: 2017-07-11 15:00:59.988707 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #145. Immutable memtables: 0.
- 2017-07-11 15:00:59.988847 I | rook-ceph-mon1:
- 2017-07-11 15:00:59.988863 I | rook-ceph-mon1: 2017-07-11 15:00:59.988739 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 93] Syncing log #142
- 2017-07-11 15:00:59.989234 I | rook-ceph-mon1: 2017-07-11 15:00:59.989218 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:59.989299 I | rook-ceph-mon1: 2017-07-11 15:00:59.989286 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2120117489' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:00.029956 I | rook-ceph-mon1: 2017-07-11 15:01:00.026692 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:00:59.988734) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:01:00.029994 I | rook-ceph-mon1: 2017-07-11 15:01:00.026699 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 93] Flushing memtable with next log file: 145
- 2017-07-11 15:01:00.030008 I | rook-ceph-mon1:
- 2017-07-11 15:01:00.030019 I | rook-ceph-mon1: 2017-07-11 15:01:00.026707 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785260026703, "job": 93, "event": "flush_started", "num_memtables": 1, "num_entries": 651, "num_deletes": 506, "memory_usage": 567400}
- 2017-07-11 15:01:00.030033 I | rook-ceph-mon1: 2017-07-11 15:01:00.026709 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 93] Level-0 flush table #146: started
- 2017-07-11 15:01:00.085083 I | rook-ceph-mon1: 2017-07-11 15:01:00.085032 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785260085017, "cf_name": "default", "job": 93, "event": "table_file_creation", "file_number": 146, "file_size": 364544, "table_properties": {"data_size": 362525, "index_size": 1205, "filter_size": 0, "raw_key_size": 10905, "raw_average_key_size": 19, "raw_value_size": 354293, "raw_average_value_size": 634, "num_data_blocks": 39, "num_entries": 558, "filter_policy_name": "", "kDeletedKeys": "506", "kMergeOperands": "0"}}
- 2017-07-11 15:01:00.085959 I | rook-ceph-mon1: 2017-07-11 15:01:00.085943 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 93] Level-0 flush table #146: 364544 bytes OK
- 2017-07-11 15:01:00.161901 I | rook-ceph-mon1: 2017-07-11 15:01:00.161870 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:01:00.113687) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #146 started
- 2017-07-11 15:01:00.163528 I | rook-ceph-mon1: 2017-07-11 15:01:00.163514 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:01:00.161845) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #146: memtable #1 done
- 2017-07-11 15:01:00.163570 I | rook-ceph-mon1: 2017-07-11 15:01:00.163545 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:01:00.161854) EVENT_LOG_v1 {"time_micros": 1499785260161851, "job": 93, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:01:00.163595 I | rook-ceph-mon1: 2017-07-11 15:01:00.163584 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:01:00.161863) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:01:00.163607 I | rook-ceph-mon1:
- 2017-07-11 15:01:00.163645 I | rook-ceph-mon1: 2017-07-11 15:01:00.163633 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 93] Try to delete WAL files size 551776, prev total WAL file size 551776, number of live WAL files 2.
- 2017-07-11 15:01:00.163657 I | rook-ceph-mon1:
- 2017-07-11 15:01:00.173202 I | rook-ceph-mon1: 2017-07-11 15:01:00.163936 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:01:00.173240 I | rook-ceph-mon1: 2017-07-11 15:01:00.163963 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:01:00.163958) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 15:01:00.173255 I | rook-ceph-mon1:
- 2017-07-11 15:01:00.173266 I | rook-ceph-mon1: 2017-07-11 15:01:00.163968 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 94] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:01:00.173276 I | rook-ceph-mon1: 2017-07-11 15:01:00.163972 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 93 Base level 0, inputs: [146(356KB)], [144(15MB)]
- 2017-07-11 15:01:00.173285 I | rook-ceph-mon1:
- 2017-07-11 15:01:00.173295 I | rook-ceph-mon1: 2017-07-11 15:01:00.163981 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785260163975, "job": 94, "event": "compaction_started", "files_L0": [146], "files_L1": [144], "score": -1, "input_data_size": 16582595}
- 2017-07-11 15:01:00.416883 I | rook-ceph-mon1: 2017-07-11 15:01:00.416844 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 94] Generated table #147: 1976 keys, 13481943 bytes
- 2017-07-11 15:01:00.417971 I | rook-ceph-mon1: 2017-07-11 15:01:00.417956 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785260417948, "cf_name": "default", "job": 94, "event": "table_file_creation", "file_number": 147, "file_size": 13481943, "table_properties": {"data_size": 13436970, "index_size": 44154, "filter_size": 0, "raw_key_size": 38088, "raw_average_key_size": 19, "raw_value_size": 13378409, "raw_average_value_size": 6770, "num_data_blocks": 1351, "num_entries": 1976, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:01:00.465949 I | rook-ceph-mon1: 2017-07-11 15:01:00.462319 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 94] Compacted 1@0 + 1@1 files to L1 => 13481943 bytes
- 2017-07-11 15:01:00.597468 I | rook-ceph-mon1: 2017-07-11 15:01:00.597414 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:01:00.597314) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 55.6 rd, 45.2 wr, level 1, files in(1, 1) out(1) MB in(0.3, 15.5) out(12.9), read-write-amplify(82.5) write-amplify(37.0) OK, records in: 2995, records dropped: 1019
- 2017-07-11 15:01:00.597955 I | rook-ceph-mon1:
- 2017-07-11 15:01:00.598039 I | rook-ceph-mon1: 2017-07-11 15:01:00.597992 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:01:00.597345) EVENT_LOG_v1 {"time_micros": 1499785260597332, "job": 94, "event": "compaction_finished", "compaction_time_micros": 298317, "output_level": 1, "num_output_files": 1, "total_output_size": 13481943, "num_input_records": 2995, "num_output_records": 1976, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:01:00.598219 I | rook-ceph-mon1: 2017-07-11 15:01:00.598205 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785260598201, "job": 94, "event": "table_file_deletion", "file_number": 146}
- 2017-07-11 15:01:00.607697 I | rook-ceph-mon1: 2017-07-11 15:01:00.607676 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785260607607, "job": 94, "event": "table_file_deletion", "file_number": 144}
- 2017-07-11 15:01:00.607840 I | rook-ceph-mon1: 2017-07-11 15:01:00.607824 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:01:07.472413 I | rook-ceph-mon1: 2017-07-11 15:01:07.472386 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:07.472508 I | rook-ceph-mon1: 2017-07-11 15:01:07.472495 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3007157354' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:18.782425 I | rook-ceph-mon1: 2017-07-11 15:01:18.782397 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:18.782620 I | rook-ceph-mon1: 2017-07-11 15:01:18.782510 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3721293029' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:30.274096 I | rook-ceph-mon1: 2017-07-11 15:01:30.274069 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:30.280377 I | rook-ceph-mon1: 2017-07-11 15:01:30.280360 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/207295718' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:35.211395 I | rook-ceph-mon1: 2017-07-11 15:01:35.211367 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:35.213135 I | rook-ceph-mon1: 2017-07-11 15:01:35.213117 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1025615273' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:38.136989 I | rook-ceph-mon1: 2017-07-11 15:01:38.136959 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:38.137172 I | rook-ceph-mon1: 2017-07-11 15:01:38.137138 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/920891175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:01:46.481859 I | rook-ceph-mon1: 2017-07-11 15:01:46.481828 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:46.485680 I | rook-ceph-mon1: 2017-07-11 15:01:46.485657 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2837005340' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:48.294357 I | rook-ceph-mon1: 2017-07-11 15:01:48.294319 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:48.294467 I | rook-ceph-mon1: 2017-07-11 15:01:48.294453 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/568510532' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:50.576463 I | rook-ceph-mon1: 2017-07-11 15:01:50.576434 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:50.583874 I | rook-ceph-mon1: 2017-07-11 15:01:50.576537 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3267454681' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:53.317230 I | rook-ceph-mon1: 2017-07-11 15:01:53.317202 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:53.317392 I | rook-ceph-mon1: 2017-07-11 15:01:53.317309 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/482300964' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:53.444426 I | rook-ceph-mon1: 2017-07-11 15:01:53.444406 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:53.444501 I | rook-ceph-mon1: 2017-07-11 15:01:53.444488 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3265299996' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:54.981586 I | rook-ceph-mon1: 2017-07-11 15:01:54.981308 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4751 MB, avail 94435 MB
- 2017-07-11 15:01:55.925594 I | rook-ceph-mon1: 2017-07-11 15:01:55.925538 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:55.925700 I | rook-ceph-mon1: 2017-07-11 15:01:55.925685 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/209560638' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:57.645038 I | rook-ceph-mon1: 2017-07-11 15:01:57.645009 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:57.645345 I | rook-ceph-mon1: 2017-07-11 15:01:57.645137 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2630852744' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:12.257394 I | rook-ceph-mon1: 2017-07-11 15:02:12.257358 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:02:12.257506 I | rook-ceph-mon1: 2017-07-11 15:02:12.257484 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/223126984' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:02:14.610133 I | rook-ceph-mon1: 2017-07-11 15:02:14.594632 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:02:14.610223 I | rook-ceph-mon1: 2017-07-11 15:02:14.610209 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1880228048' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:02:16.402134 I | rook-ceph-mon1: 2017-07-11 15:02:16.402102 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:16.402237 I | rook-ceph-mon1: 2017-07-11 15:02:16.402223 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/771417943' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:19.905891 I | rook-ceph-mon1: 2017-07-11 15:02:19.905731 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:19.905953 I | rook-ceph-mon1: 2017-07-11 15:02:19.905764 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/411123972' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:21.825950 I | rook-ceph-mon1: 2017-07-11 15:02:21.825914 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:21.826048 I | rook-ceph-mon1: 2017-07-11 15:02:21.826034 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3767130548' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:27.458586 I | rook-ceph-mon1: 2017-07-11 15:02:27.458317 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:27.458680 I | rook-ceph-mon1: 2017-07-11 15:02:27.458338 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/600806947' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:27.549968 I | rook-ceph-mon1: 2017-07-11 15:02:27.549833 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:27.550078 I | rook-ceph-mon1: 2017-07-11 15:02:27.549855 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2366981224' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:33.935208 I | rook-ceph-mon1: 2017-07-11 15:02:33.935184 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:02:33.935295 I | rook-ceph-mon1: 2017-07-11 15:02:33.935281 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3493203516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:02:38.970606 I | rook-ceph-mon1: 2017-07-11 15:02:38.970574 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:38.976739 I | rook-ceph-mon1: 2017-07-11 15:02:38.976721 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/192943656' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:53.065039 I | rook-ceph-mon1: 2017-07-11 15:02:53.065013 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:53.065136 I | rook-ceph-mon1: 2017-07-11 15:02:53.065123 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/217527050' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:55.012082 I | rook-ceph-mon1: 2017-07-11 15:02:54.982783 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4751 MB, avail 94435 MB
- 2017-07-11 15:03:13.193010 I | rook-ceph-mon1: 2017-07-11 15:03:13.192978 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:13.193181 I | rook-ceph-mon1: 2017-07-11 15:03:13.193112 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3919642376' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:47.120826 I | rook-ceph-mon1: 2017-07-11 15:03:47.120798 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:47.120919 I | rook-ceph-mon1: 2017-07-11 15:03:47.120905 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1641928808' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:54.989714 I | rook-ceph-mon1: 2017-07-11 15:03:54.989234 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4751 MB, avail 94435 MB
- 2017-07-11 15:03:58.578434 I | rook-ceph-mon1: 2017-07-11 15:03:58.578403 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:58.578529 I | rook-ceph-mon1: 2017-07-11 15:03:58.578516 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2925352074' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:59.014480 I | rook-ceph-mon1: 2017-07-11 15:03:59.014447 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:59.014691 I | rook-ceph-mon1: 2017-07-11 15:03:59.014656 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/772574129' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:09.899577 I | rook-ceph-mon1: 2017-07-11 15:04:09.899546 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:04:09.899683 I | rook-ceph-mon1: 2017-07-11 15:04:09.899669 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3008918236' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:12.803318 I | rook-ceph-mon1: 2017-07-11 15:04:12.803186 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:04:12.803414 I | rook-ceph-mon1: 2017-07-11 15:04:12.803207 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/324171369' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:20.364110 I | rook-ceph-mon1: 2017-07-11 15:04:20.364083 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:04:20.364200 I | rook-ceph-mon1: 2017-07-11 15:04:20.364186 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3803042482' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:21.024865 I | rook-ceph-mon1: 2017-07-11 15:04:21.024834 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:04:21.025593 I | rook-ceph-mon1: 2017-07-11 15:04:21.025576 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3664737626' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:24.012067 I | rook-ceph-mon1: 2017-07-11 15:04:24.012034 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:04:24.012171 I | rook-ceph-mon1: 2017-07-11 15:04:24.012157 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/690829347' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:31.481623 I | rook-ceph-mon1: 2017-07-11 15:04:31.481589 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:04:31.481721 I | rook-ceph-mon1: 2017-07-11 15:04:31.481707 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2244063913' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:32.272537 I | rook-ceph-mon1: 2017-07-11 15:04:32.272506 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:04:32.272706 I | rook-ceph-mon1: 2017-07-11 15:04:32.272634 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3938640515' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:36.987975 I | rook-ceph-mon1: 2017-07-11 15:04:35.639122 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2193 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0585989s > max 0.05s
- 2017-07-11 15:04:36.989536 I | rook-ceph-mon1: 2017-07-11 15:04:35.639389 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2194 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.224719s > max 0.05s
- 2017-07-11 15:04:54.990742 I | rook-ceph-mon1: 2017-07-11 15:04:54.990439 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4751 MB, avail 94435 MB
- 2017-07-11 15:05:04.642304 I | rook-ceph-mon1: 2017-07-11 15:05:04.642277 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:04.642469 I | rook-ceph-mon1: 2017-07-11 15:05:04.642408 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3292353818' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:09.749282 I | rook-ceph-mon1: 2017-07-11 15:05:09.748268 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #148. Immutable memtables: 0.
- 2017-07-11 15:05:09.749352 I | rook-ceph-mon1:
- 2017-07-11 15:05:09.749368 I | rook-ceph-mon1: 2017-07-11 15:05:09.748293 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 95] Syncing log #145
- 2017-07-11 15:05:09.827617 I | rook-ceph-mon1: 2017-07-11 15:05:09.818177 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.748288) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:05:09.827675 I | rook-ceph-mon1: 2017-07-11 15:05:09.818186 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 95] Flushing memtable with next log file: 148
- 2017-07-11 15:05:09.827690 I | rook-ceph-mon1:
- 2017-07-11 15:05:09.827702 I | rook-ceph-mon1: 2017-07-11 15:05:09.818196 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785509818190, "job": 95, "event": "flush_started", "num_memtables": 1, "num_entries": 2097, "num_deletes": 251, "memory_usage": 6525352}
- 2017-07-11 15:05:09.827713 I | rook-ceph-mon1: 2017-07-11 15:05:09.818198 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 95] Level-0 flush table #149: started
- 2017-07-11 15:05:09.938442 I | rook-ceph-mon1: 2017-07-11 15:05:09.938396 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785509938386, "cf_name": "default", "job": 95, "event": "table_file_creation", "file_number": 149, "file_size": 4305368, "table_properties": {"data_size": 4289285, "index_size": 15265, "filter_size": 0, "raw_key_size": 15589, "raw_average_key_size": 18, "raw_value_size": 4267177, "raw_average_value_size": 5134, "num_data_blocks": 481, "num_entries": 831, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 15:05:09.938529 I | rook-ceph-mon1: 2017-07-11 15:05:09.938514 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 95] Level-0 flush table #149: 4305368 bytes OK
- 2017-07-11 15:05:10.067246 I | rook-ceph-mon1: 2017-07-11 15:05:10.067212 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.977258) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #149 started
- 2017-07-11 15:05:10.067328 I | rook-ceph-mon1: 2017-07-11 15:05:10.067314 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:05:10.067170) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #149: memtable #1 done
- 2017-07-11 15:05:10.067357 I | rook-ceph-mon1: 2017-07-11 15:05:10.067344 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:05:10.067187) EVENT_LOG_v1 {"time_micros": 1499785510067182, "job": 95, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:05:10.067399 I | rook-ceph-mon1: 2017-07-11 15:05:10.067387 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:05:10.067202) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:05:10.067413 I | rook-ceph-mon1:
- 2017-07-11 15:05:10.067440 I | rook-ceph-mon1: 2017-07-11 15:05:10.067430 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 95] Try to delete WAL files size 6472162, prev total WAL file size 6472162, number of live WAL files 2.
- 2017-07-11 15:05:10.067465 I | rook-ceph-mon1:
- 2017-07-11 15:05:10.069265 I | rook-ceph-mon1: 2017-07-11 15:05:10.068413 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:05:10.069326 I | rook-ceph-mon1: 2017-07-11 15:05:10.068448 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:05:10.068443) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 15:05:10.069341 I | rook-ceph-mon1:
- 2017-07-11 15:05:10.069365 I | rook-ceph-mon1: 2017-07-11 15:05:10.068453 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 96] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:05:10.069377 I | rook-ceph-mon1: 2017-07-11 15:05:10.068457 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 95 Base level 0, inputs: [149(4204KB)], [147(12MB)]
- 2017-07-11 15:05:10.069387 I | rook-ceph-mon1:
- 2017-07-11 15:05:10.069396 I | rook-ceph-mon1: 2017-07-11 15:05:10.068465 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785510068459, "job": 96, "event": "compaction_started", "files_L0": [149], "files_L1": [147], "score": -1, "input_data_size": 17787311}
- 2017-07-11 15:05:10.278954 I | rook-ceph-mon1: 2017-07-11 15:05:10.278906 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 96] Generated table #150: 2298 keys, 15248399 bytes
- 2017-07-11 15:05:10.281299 I | rook-ceph-mon1: 2017-07-11 15:05:10.281282 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785510281272, "cf_name": "default", "job": 96, "event": "table_file_creation", "file_number": 150, "file_size": 15248399, "table_properties": {"data_size": 15195700, "index_size": 51880, "filter_size": 0, "raw_key_size": 44456, "raw_average_key_size": 19, "raw_value_size": 15127242, "raw_average_value_size": 6582, "num_data_blocks": 1580, "num_entries": 2298, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:05:10.307960 I | rook-ceph-mon1: 2017-07-11 15:05:10.307938 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 96] Compacted 1@0 + 1@1 files to L1 => 15248399 bytes
- 2017-07-11 15:05:10.348945 I | rook-ceph-mon1: 2017-07-11 15:05:10.348922 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:05:10.348870) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 74.3 rd, 63.7 wr, level 1, files in(1, 1) out(1) MB in(4.1, 12.9) out(14.5), read-write-amplify(7.7) write-amplify(3.5) OK, records in: 2807, records dropped: 509
- 2017-07-11 15:05:10.349132 I | rook-ceph-mon1:
- 2017-07-11 15:05:10.349276 I | rook-ceph-mon1: 2017-07-11 15:05:10.349227 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:05:10.348883) EVENT_LOG_v1 {"time_micros": 1499785510348878, "job": 96, "event": "compaction_finished", "compaction_time_micros": 239460, "output_level": 1, "num_output_files": 1, "total_output_size": 15248399, "num_input_records": 2807, "num_output_records": 2298, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:05:10.355998 I | rook-ceph-mon1: 2017-07-11 15:05:10.355982 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785510355980, "job": 96, "event": "table_file_deletion", "file_number": 149}
- 2017-07-11 15:05:10.357462 I | rook-ceph-mon1: 2017-07-11 15:05:10.357449 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785510357447, "job": 96, "event": "table_file_deletion", "file_number": 147}
- 2017-07-11 15:05:37.912463 I | rook-ceph-mon1: 2017-07-11 15:05:37.912433 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:37.912636 I | rook-ceph-mon1: 2017-07-11 15:05:37.912561 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3595943141' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:40.297569 I | rook-ceph-mon1: 2017-07-11 15:05:40.296025 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #151. Immutable memtables: 0.
- 2017-07-11 15:05:40.297632 I | rook-ceph-mon1:
- 2017-07-11 15:05:40.297649 I | rook-ceph-mon1: 2017-07-11 15:05:40.296065 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 97] Syncing log #148
- 2017-07-11 15:05:40.326899 I | rook-ceph-mon1: 2017-07-11 15:05:40.326340 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.296060) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:05:40.326945 I | rook-ceph-mon1: 2017-07-11 15:05:40.326347 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 97] Flushing memtable with next log file: 151
- 2017-07-11 15:05:40.326962 I | rook-ceph-mon1:
- 2017-07-11 15:05:40.326983 I | rook-ceph-mon1: 2017-07-11 15:05:40.326355 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785540326351, "job": 97, "event": "flush_started", "num_memtables": 1, "num_entries": 425, "num_deletes": 251, "memory_usage": 574592}
- 2017-07-11 15:05:40.326993 I | rook-ceph-mon1: 2017-07-11 15:05:40.326357 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 97] Level-0 flush table #152: started
- 2017-07-11 15:05:40.394170 I | rook-ceph-mon1: 2017-07-11 15:05:40.392709 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785540392702, "cf_name": "default", "job": 97, "event": "table_file_creation", "file_number": 152, "file_size": 315036, "table_properties": {"data_size": 313089, "index_size": 1133, "filter_size": 0, "raw_key_size": 6014, "raw_average_key_size": 19, "raw_value_size": 308243, "raw_average_value_size": 1024, "num_data_blocks": 37, "num_entries": 301, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 15:05:40.394239 I | rook-ceph-mon1: 2017-07-11 15:05:40.392718 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 97] Level-0 flush table #152: 315036 bytes OK
- 2017-07-11 15:05:40.501568 I | rook-ceph-mon1: 2017-07-11 15:05:40.501307 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.422742) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #152 started
- 2017-07-11 15:05:40.508499 I | rook-ceph-mon1: 2017-07-11 15:05:40.501315 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.501262) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #152: memtable #1 done
- 2017-07-11 15:05:40.508594 I | rook-ceph-mon1: 2017-07-11 15:05:40.501316 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.501281) EVENT_LOG_v1 {"time_micros": 1499785540501276, "job": 97, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:05:40.508628 I | rook-ceph-mon1: 2017-07-11 15:05:40.501317 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.501296) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:05:40.508678 I | rook-ceph-mon1:
- 2017-07-11 15:05:40.508705 I | rook-ceph-mon1: 2017-07-11 15:05:40.501322 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 97] Try to delete WAL files size 564040, prev total WAL file size 564040, number of live WAL files 2.
- 2017-07-11 15:05:40.508757 I | rook-ceph-mon1:
- 2017-07-11 15:05:40.510028 I | rook-ceph-mon1: 2017-07-11 15:05:40.508800 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:05:40.510064 I | rook-ceph-mon1: 2017-07-11 15:05:40.508884 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.508875) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 15:05:40.510084 I | rook-ceph-mon1:
- 2017-07-11 15:05:40.510096 I | rook-ceph-mon1: 2017-07-11 15:05:40.508966 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 98] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:05:40.510107 I | rook-ceph-mon1: 2017-07-11 15:05:40.508970 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 97 Base level 0, inputs: [152(307KB)], [150(14MB)]
- 2017-07-11 15:05:40.510117 I | rook-ceph-mon1:
- 2017-07-11 15:05:40.510140 I | rook-ceph-mon1: 2017-07-11 15:05:40.508994 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785540508984, "job": 98, "event": "compaction_started", "files_L0": [152], "files_L1": [150], "score": -1, "input_data_size": 15563435}
- 2017-07-11 15:05:40.810214 I | rook-ceph-mon1: 2017-07-11 15:05:40.810177 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 98] Generated table #153: 2099 keys, 13966798 bytes
- 2017-07-11 15:05:40.817082 I | rook-ceph-mon1: 2017-07-11 15:05:40.817063 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785540817055, "cf_name": "default", "job": 98, "event": "table_file_creation", "file_number": 153, "file_size": 13966798, "table_properties": {"data_size": 13920905, "index_size": 45074, "filter_size": 0, "raw_key_size": 40423, "raw_average_key_size": 19, "raw_value_size": 13860009, "raw_average_value_size": 6603, "num_data_blocks": 1374, "num_entries": 2099, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:05:40.841200 I | rook-ceph-mon1: 2017-07-11 15:05:40.841175 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 98] Compacted 1@0 + 1@1 files to L1 => 13966798 bytes
- 2017-07-11 15:05:41.022134 I | rook-ceph-mon1: 2017-07-11 15:05:41.022085 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:05:41.022004) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 46.9 rd, 42.0 wr, level 1, files in(1, 1) out(1) MB in(0.3, 14.5) out(13.3), read-write-amplify(93.7) write-amplify(44.3) OK, records in: 2599, records dropped: 500
- 2017-07-11 15:05:41.022151 I | rook-ceph-mon1:
- 2017-07-11 15:05:41.022191 I | rook-ceph-mon1: 2017-07-11 15:05:41.022176 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:05:41.022027) EVENT_LOG_v1 {"time_micros": 1499785541022018, "job": 98, "event": "compaction_finished", "compaction_time_micros": 332169, "output_level": 1, "num_output_files": 1, "total_output_size": 13966798, "num_input_records": 2599, "num_output_records": 2099, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:05:41.022358 I | rook-ceph-mon1: 2017-07-11 15:05:41.022345 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785541022343, "job": 98, "event": "table_file_deletion", "file_number": 152}
- 2017-07-11 15:05:41.031657 I | rook-ceph-mon1: 2017-07-11 15:05:41.031590 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785541031587, "job": 98, "event": "table_file_deletion", "file_number": 150}
- 2017-07-11 15:05:41.031722 I | rook-ceph-mon1: 2017-07-11 15:05:41.031709 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:05:55.122121 I | rook-ceph-mon1: 2017-07-11 15:05:55.075814 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4752 MB, avail 94434 MB
- 2017-07-11 15:06:03.665740 I | rook-ceph-mon1: 2017-07-11 15:06:03.665703 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:03.665842 I | rook-ceph-mon1: 2017-07-11 15:06:03.665827 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2128642073' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:11.903699 I | rook-ceph-mon1: 2017-07-11 15:06:11.903667 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:11.903868 I | rook-ceph-mon1: 2017-07-11 15:06:11.903797 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1715791548' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:25.801732 I | rook-ceph-mon1: 2017-07-11 15:06:25.801692 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:25.801940 I | rook-ceph-mon1: 2017-07-11 15:06:25.801834 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4199089319' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:36.863581 I | rook-ceph-mon1: 2017-07-11 15:06:36.863299 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:36.864714 I | rook-ceph-mon1: 2017-07-11 15:06:36.863320 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1157426699' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:55.126362 I | rook-ceph-mon1: 2017-07-11 15:06:55.126135 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4752 MB, avail 94434 MB
- 2017-07-11 15:07:06.866097 I | rook-ceph-mon1: 2017-07-11 15:07:06.866065 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:06.866279 I | rook-ceph-mon1: 2017-07-11 15:07:06.866196 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/280833574' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.517473 I | rook-ceph-mon1: 2017-07-11 15:07:22.116874 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 2218 : audit [INF] from='client.? 10.233.124.5:0/6333933' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.517746 I | rook-ceph-mon1: 2017-07-11 15:07:22.118898 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 2219 : audit [INF] from='client.? 10.233.124.0:0/842394772' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.517776 I | rook-ceph-mon1: 2017-07-11 15:07:22.144880 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 2220 : audit [INF] from='client.? 10.233.124.0:0/2650355890' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.517791 I | rook-ceph-mon1: 2017-07-11 15:07:22.511073 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2225 : audit [INF] from='client.13433 -' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.517805 I | rook-ceph-mon1: 2017-07-11 15:07:23.374621 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2226 : audit [INF] from='client.13430 -' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.517956 I | rook-ceph-mon1: 2017-07-11 15:07:23.641539 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2227 : audit [INF] from='client.13436 -' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.825470 I | rook-ceph-mon1: 2017-07-11 15:07:24.825439 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 15:07:24.825571 I | rook-ceph-mon1: 2017-07-11 15:07:24.825558 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 15:07:24.826082 I | rook-ceph-mon1: 2017-07-11 15:07:24.826065 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 15:07:24.826250 I | rook-ceph-mon1: 2017-07-11 15:07:24.826221 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 15:07:24.826660 I | rook-ceph-mon1: 2017-07-11 15:07:24.826644 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 15:07:24.826859 I | rook-ceph-mon1: 2017-07-11 15:07:24.826796 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 15:07:24.827314 I | rook-ceph-mon1: 2017-07-11 15:07:24.827299 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 15:07:24.827476 I | rook-ceph-mon1: 2017-07-11 15:07:24.827447 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 15:07:24.827865 I | rook-ceph-mon1: 2017-07-11 15:07:24.827850 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 15:07:24.828052 I | rook-ceph-mon1: 2017-07-11 15:07:24.828022 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 15:07:24.834159 I | rook-ceph-mon1: 2017-07-11 15:07:24.834143 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 15:07:24.834202 I | rook-ceph-mon1: 2017-07-11 15:07:24.834190 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 15:07:25.958062 I | rook-ceph-mon1: 2017-07-11 15:07:24.442863 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2228 : audit [INF] from='client.13433 -' entity='client.admin' cmd='[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]': finished
- 2017-07-11 15:07:25.967204 I | rook-ceph-mon1: 2017-07-11 15:07:24.443270 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2229 : audit [INF] from='client.13430 -' entity='client.admin' cmd='[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]': finished
- 2017-07-11 15:07:25.967300 I | rook-ceph-mon1: 2017-07-11 15:07:24.443542 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2230 : audit [INF] from='client.13436 -' entity='client.admin' cmd='[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]': finished
- 2017-07-11 15:07:25.967381 I | rook-ceph-mon1: 2017-07-11 15:07:24.443817 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2231 : cluster [INF] osdmap e138: 6 total, 1 up, 4 in
- 2017-07-11 15:07:27.462716 I | rook-ceph-mon1: 2017-07-11 15:07:26.031513 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2232 : audit [INF] from='client.? 10.233.124.0:0/210354122' entity='client.admin' cmd=[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]: dispatch
- 2017-07-11 15:07:27.462946 I | rook-ceph-mon1: 2017-07-11 15:07:26.083167 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2233 : audit [INF] from='client.? 10.233.124.0:0/2191274531' entity='client.admin' cmd=[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]: dispatch
- 2017-07-11 15:07:27.463054 I | rook-ceph-mon1: 2017-07-11 15:07:26.117235 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2234 : audit [INF] from='client.? 10.233.124.5:0/3838214036' entity='client.admin' cmd=[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]: dispatch
- 2017-07-11 15:07:27.601477 I | rook-ceph-mon1: 2017-07-11 15:07:27.601442 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 0} v 0) v1
- 2017-07-11 15:07:27.601598 I | rook-ceph-mon1: 2017-07-11 15:07:27.601577 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch
- 2017-07-11 15:07:27.602083 I | rook-ceph-mon1: 2017-07-11 15:07:27.602067 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 1} v 0) v1
- 2017-07-11 15:07:27.602254 I | rook-ceph-mon1: 2017-07-11 15:07:27.602224 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch
- 2017-07-11 15:07:27.602682 I | rook-ceph-mon1: 2017-07-11 15:07:27.602666 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 2} v 0) v1
- 2017-07-11 15:07:27.602844 I | rook-ceph-mon1: 2017-07-11 15:07:27.602815 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch
- 2017-07-11 15:07:27.603235 I | rook-ceph-mon1: 2017-07-11 15:07:27.603220 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 3} v 0) v1
- 2017-07-11 15:07:27.603397 I | rook-ceph-mon1: 2017-07-11 15:07:27.603368 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch
- 2017-07-11 15:07:27.603829 I | rook-ceph-mon1: 2017-07-11 15:07:27.603812 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 4} v 0) v1
- 2017-07-11 15:07:27.603978 I | rook-ceph-mon1: 2017-07-11 15:07:27.603964 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch
- 2017-07-11 15:07:27.604519 I | rook-ceph-mon1: 2017-07-11 15:07:27.604503 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "osd metadata", "id": 5} v 0) v1
- 2017-07-11 15:07:27.604682 I | rook-ceph-mon1: 2017-07-11 15:07:27.604653 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.4115 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch
- 2017-07-11 15:07:28.894000 I | rook-ceph-mon1: 2017-07-11 15:07:27.316834 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2235 : audit [INF] from='client.? 10.233.124.0:0/210354122' entity='client.admin' cmd='[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]': finished
- 2017-07-11 15:07:28.894100 I | rook-ceph-mon1: 2017-07-11 15:07:27.316872 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2236 : audit [INF] from='client.? 10.233.124.0:0/2191274531' entity='client.admin' cmd='[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]': finished
- 2017-07-11 15:07:28.894117 I | rook-ceph-mon1: 2017-07-11 15:07:27.316899 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2237 : audit [INF] from='client.? 10.233.124.5:0/3838214036' entity='client.admin' cmd='[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]': finished
- 2017-07-11 15:07:28.894165 I | rook-ceph-mon1: 2017-07-11 15:07:27.316919 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2238 : cluster [INF] osdmap e139: 6 total, 1 up, 4 in
- 2017-07-11 15:07:29.083964 I | rook-ceph-mon1: 2017-07-11 15:07:29.083934 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:29.084071 I | rook-ceph-mon1: 2017-07-11 15:07:29.084056 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/358651193' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:29.878165 I | rook-ceph-mon1: 2017-07-11 15:07:29.878138 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:29.879892 I | rook-ceph-mon1: 2017-07-11 15:07:29.879876 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/442950479' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:41.016010 I | rook-ceph-mon1: 2017-07-11 15:07:41.015979 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:41.016067 I | rook-ceph-mon1: 2017-07-11 15:07:41.016055 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3695793829' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:52.070803 I | rook-ceph-mon1: 2017-07-11 15:07:52.070775 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:52.070893 I | rook-ceph-mon1: 2017-07-11 15:07:52.070880 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1991320494' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:55.137027 I | rook-ceph-mon1: 2017-07-11 15:07:55.129166 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4752 MB, avail 94434 MB
- 2017-07-11 15:08:01.910973 I | rook-ceph-mon1: 2017-07-11 15:08:01.910941 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:08:01.911157 I | rook-ceph-mon1: 2017-07-11 15:08:01.911073 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2930937558' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:08:02.716004 I | rook-ceph-mon1: 2017-07-11 15:08:02.715972 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:08:02.716213 I | rook-ceph-mon1: 2017-07-11 15:08:02.716107 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1090223323' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:08:04.900453 I | rook-ceph-mon1: 2017-07-11 15:08:04.900423 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:08:04.900625 I | rook-ceph-mon1: 2017-07-11 15:08:04.900557 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/745273946' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:08:06.795049 I | rook-ceph-mon1: 2017-07-11 15:08:05.359607 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2243 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (537 > max 300); Monitor clock skew detected
- 2017-07-11 15:08:13.623191 I | rook-ceph-mon1: 2017-07-11 15:08:13.623164 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:08:13.623282 I | rook-ceph-mon1: 2017-07-11 15:08:13.623266 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1889632658' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:08:23.089699 I | rook-ceph-mon1: 2017-07-11 15:08:23.089665 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:08:23.089800 I | rook-ceph-mon1: 2017-07-11 15:08:23.089784 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3370657533' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:08:24.220035 I | rook-ceph-mon1: 2017-07-11 15:08:24.220003 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:08:24.220137 I | rook-ceph-mon1: 2017-07-11 15:08:24.220123 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/223853344' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:08:31.466446 I | rook-ceph-mon1: 2017-07-11 15:08:31.466420 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:08:31.466590 I | rook-ceph-mon1: 2017-07-11 15:08:31.466531 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1268339947' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:08:42.261611 I | rook-ceph-mon1: 2017-07-11 15:08:42.261582 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:08:42.261717 I | rook-ceph-mon1: 2017-07-11 15:08:42.261701 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1940188430' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:08:43.887772 I | rook-ceph-mon1: 2017-07-11 15:08:43.887739 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:08:43.887952 I | rook-ceph-mon1: 2017-07-11 15:08:43.887873 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1100660091' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:08:47.846863 I | rook-ceph-mon1: 2017-07-11 15:08:47.846828 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:08:47.847083 I | rook-ceph-mon1: 2017-07-11 15:08:47.847048 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2170811551' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:08:55.129545 I | rook-ceph-mon1: 2017-07-11 15:08:55.129369 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4752 MB, avail 94434 MB
- 2017-07-11 15:09:09.373733 I | rook-ceph-mon1: 2017-07-11 15:09:09.373619 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:09.373794 I | rook-ceph-mon1: 2017-07-11 15:09:09.373637 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3887162677' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:16.188992 I | rook-ceph-mon1: 2017-07-11 15:09:16.188961 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:16.189098 I | rook-ceph-mon1: 2017-07-11 15:09:16.189083 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3997268661' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:16.838269 I | rook-ceph-mon1: 2017-07-11 15:09:16.838239 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:16.838368 I | rook-ceph-mon1: 2017-07-11 15:09:16.838355 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1989450398' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:19.949137 I | rook-ceph-mon1: 2017-07-11 15:09:19.949107 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:19.949314 I | rook-ceph-mon1: 2017-07-11 15:09:19.949298 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/968678819' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:26.779761 I | rook-ceph-mon1: 2017-07-11 15:09:26.779728 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:26.779980 I | rook-ceph-mon1: 2017-07-11 15:09:26.779883 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3967766923' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:30.518654 I | rook-ceph-mon1: 2017-07-11 15:09:30.518625 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:30.518751 I | rook-ceph-mon1: 2017-07-11 15:09:30.518738 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2213617020' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:36.182784 I | rook-ceph-mon1: 2017-07-11 15:09:35.640393 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2248 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0597843s > max 0.05s
- 2017-07-11 15:09:36.182854 I | rook-ceph-mon1: 2017-07-11 15:09:35.646000 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2249 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.227679s > max 0.05s
- 2017-07-11 15:09:37.384996 I | rook-ceph-mon1: 2017-07-11 15:09:37.384957 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:37.385178 I | rook-ceph-mon1: 2017-07-11 15:09:37.385094 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3327189288' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:38.047028 I | rook-ceph-mon1: 2017-07-11 15:09:38.046997 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:38.047194 I | rook-ceph-mon1: 2017-07-11 15:09:38.047122 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3216202935' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:48.067576 I | rook-ceph-mon1: 2017-07-11 15:09:48.067537 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:48.067839 I | rook-ceph-mon1: 2017-07-11 15:09:48.067819 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4035639146' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:51.710434 I | rook-ceph-mon1: 2017-07-11 15:09:51.710397 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:51.710644 I | rook-ceph-mon1: 2017-07-11 15:09:51.710545 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1695910039' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:55.129977 I | rook-ceph-mon1: 2017-07-11 15:09:55.129620 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4752 MB, avail 94434 MB
- 2017-07-11 15:10:02.291846 I | rook-ceph-mon1: 2017-07-11 15:10:02.291816 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:02.298333 I | rook-ceph-mon1: 2017-07-11 15:10:02.297798 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4175881059' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:10.000666 I | rook-ceph-mon1: 2017-07-11 15:10:10.000636 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:10.000837 I | rook-ceph-mon1: 2017-07-11 15:10:10.000765 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2952605716' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:20.092367 I | rook-ceph-mon1: 2017-07-11 15:10:20.092329 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:20.092571 I | rook-ceph-mon1: 2017-07-11 15:10:20.092467 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2508112478' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:20.581715 I | rook-ceph-mon1: 2017-07-11 15:10:20.581690 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:20.581805 I | rook-ceph-mon1: 2017-07-11 15:10:20.581792 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1149855288' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:30.670453 I | rook-ceph-mon1: 2017-07-11 15:10:30.670423 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:30.670551 I | rook-ceph-mon1: 2017-07-11 15:10:30.670538 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1122220197' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:31.157434 I | rook-ceph-mon1: 2017-07-11 15:10:31.157405 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:31.157537 I | rook-ceph-mon1: 2017-07-11 15:10:31.157523 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2943528626' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:34.286986 I | rook-ceph-mon1: 2017-07-11 15:10:34.286945 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:34.287151 I | rook-ceph-mon1: 2017-07-11 15:10:34.287079 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2791519094' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:35.456161 I | rook-ceph-mon1: 2017-07-11 15:10:35.456086 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #154. Immutable memtables: 0.
- 2017-07-11 15:10:35.456243 I | rook-ceph-mon1:
- 2017-07-11 15:10:35.456263 I | rook-ceph-mon1: 2017-07-11 15:10:35.456122 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 99] Syncing log #151
- 2017-07-11 15:10:35.555876 I | rook-ceph-mon1: 2017-07-11 15:10:35.554675 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.456116) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:10:35.555924 I | rook-ceph-mon1: 2017-07-11 15:10:35.554686 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 99] Flushing memtable with next log file: 154
- 2017-07-11 15:10:35.555941 I | rook-ceph-mon1:
- 2017-07-11 15:10:35.555953 I | rook-ceph-mon1: 2017-07-11 15:10:35.554694 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835554690, "job": 99, "event": "flush_started", "num_memtables": 1, "num_entries": 2016, "num_deletes": 251, "memory_usage": 6123536}
- 2017-07-11 15:10:35.555963 I | rook-ceph-mon1: 2017-07-11 15:10:35.554696 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 99] Level-0 flush table #155: started
- 2017-07-11 15:10:35.714879 I | rook-ceph-mon1: 2017-07-11 15:10:35.714808 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835714791, "cf_name": "default", "job": 99, "event": "table_file_creation", "file_number": 155, "file_size": 4037792, "table_properties": {"data_size": 4022270, "index_size": 14704, "filter_size": 0, "raw_key_size": 15036, "raw_average_key_size": 18, "raw_value_size": 4000925, "raw_average_value_size": 5001, "num_data_blocks": 465, "num_entries": 800, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 15:10:35.714959 I | rook-ceph-mon1: 2017-07-11 15:10:35.714943 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 99] Level-0 flush table #155: 4037792 bytes OK
- 2017-07-11 15:10:35.777793 I | rook-ceph-mon1: 2017-07-11 15:10:35.777744 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.744856) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #155 started
- 2017-07-11 15:10:35.777916 I | rook-ceph-mon1: 2017-07-11 15:10:35.777885 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.777687) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #155: memtable #1 done
- 2017-07-11 15:10:35.778108 I | rook-ceph-mon1: 2017-07-11 15:10:35.778061 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.777707) EVENT_LOG_v1 {"time_micros": 1499785835777700, "job": 99, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:10:35.778145 I | rook-ceph-mon1: 2017-07-11 15:10:35.778130 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.777728) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:10:35.778173 I | rook-ceph-mon1:
- 2017-07-11 15:10:35.778203 I | rook-ceph-mon1: 2017-07-11 15:10:35.778191 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 99] Try to delete WAL files size 6074240, prev total WAL file size 6074240, number of live WAL files 2.
- 2017-07-11 15:10:35.778215 I | rook-ceph-mon1:
- 2017-07-11 15:10:35.779860 I | rook-ceph-mon1: 2017-07-11 15:10:35.779069 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:10:35.779919 I | rook-ceph-mon1: 2017-07-11 15:10:35.779191 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 15:10:35.779935 I | rook-ceph-mon1: 2017-07-11 15:10:35.779194 7f003ab33700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 15:10:35.779947 I | rook-ceph-mon1: ** DB Stats **
- 2017-07-11 15:10:35.779972 I | rook-ceph-mon1: Uptime(secs): 6402.1 total, 800.7 interval
- 2017-07-11 15:10:35.779984 I | rook-ceph-mon1: Cumulative writes: 12K writes, 60K keys, 12K commit groups, 1.0 writes per commit group, ingest: 0.16 GB, 0.03 MB/s
- 2017-07-11 15:10:35.779994 I | rook-ceph-mon1: Cumulative WAL: 12K writes, 12K syncs, 1.00 writes per sync, written: 0.16 GB, 0.03 MB/s
- 2017-07-11 15:10:35.780005 I | rook-ceph-mon1: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 15:10:35.780015 I | rook-ceph-mon1: Interval writes: 1496 writes, 7432 keys, 1496 commit groups, 1.0 writes per commit group, ingest: 19.98 MB, 0.02 MB/s
- 2017-07-11 15:10:35.780025 I | rook-ceph-mon1: Interval WAL: 1496 writes, 1496 syncs, 1.00 writes per sync, written: 0.02 MB, 0.02 MB/s
- 2017-07-11 15:10:35.780045 I | rook-ceph-mon1: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 15:10:35.780056 I | rook-ceph-mon1:
- 2017-07-11 15:10:35.780066 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 15:10:35.780075 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 15:10:35.780086 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 15:10:35.780104 I | rook-ceph-mon1: L0 1/1 3.85 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 11.8 9 51 0.173 0 0
- 2017-07-11 15:10:35.780129 I | rook-ceph-mon1: L1 1/1 13.32 MB 0.0 0.7 0.1 0.6 0.6 0.0 0.0 6.3 38.9 34.2 18 47 0.393 118K 23K
- 2017-07-11 15:10:35.780139 I | rook-ceph-mon1: Sum 2/2 17.17 MB 0.0 0.7 0.1 0.6 0.7 0.1 0.0 7.1 26.3 26.9 27 98 0.278 118K 23K
- 2017-07-11 15:10:35.780149 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 6.3 38.1 39.2 2 10 0.211 13K 3046
- 2017-07-11 15:10:35.780163 I | rook-ceph-mon1: Uptime(secs): 6402.1 total, 6402.1 interval
- 2017-07-11 15:10:35.780173 I | rook-ceph-mon1: Flush(GB): cumulative 0.101, interval 0.013
- 2017-07-11 15:10:35.780194 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 15:10:35.780205 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 15:10:35.780214 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 15:10:35.780224 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 15:10:35.780234 I | rook-ceph-mon1: Cumulative compaction: 0.72 GB write, 0.11 MB/s write, 0.70 GB read, 0.11 MB/s read, 27.3 seconds
- 2017-07-11 15:10:35.780244 I | rook-ceph-mon1: Interval compaction: 0.08 GB write, 0.01 MB/s write, 0.08 GB read, 0.01 MB/s read, 2.1 seconds
- 2017-07-11 15:10:35.780310 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 15:10:35.780335 I | rook-ceph-mon1:
- 2017-07-11 15:10:35.780347 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 15:10:35.780379 I | rook-ceph-mon1:
- 2017-07-11 15:10:35.780392 I | rook-ceph-mon1: ** Compaction Stats [default] **
- 2017-07-11 15:10:35.780403 I | rook-ceph-mon1: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 15:10:35.780413 I | rook-ceph-mon1: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 15:10:35.780423 I | rook-ceph-mon1: L0 1/1 3.85 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 11.8 9 51 0.173 0 0
- 2017-07-11 15:10:35.780433 I | rook-ceph-mon1: L1 1/1 13.32 MB 0.0 0.7 0.1 0.6 0.6 0.0 0.0 6.3 38.9 34.2 18 47 0.393 118K 23K
- 2017-07-11 15:10:35.780455 I | rook-ceph-mon1: Sum 2/2 17.17 MB 0.0 0.7 0.1 0.6 0.7 0.1 0.0 7.1 26.3 26.9 27 98 0.278 118K 23K
- 2017-07-11 15:10:35.780466 I | rook-ceph-mon1: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 15:10:35.780476 I | rook-ceph-mon1: Uptime(secs): 6402.1 total, 6402.1 interval
- 2017-07-11 15:10:35.780486 I | rook-ceph-mon1: Flush(GB): cumulative 0.101, interval 0.000
- 2017-07-11 15:10:35.780496 I | rook-ceph-mon1: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 15:10:35.780506 I | rook-ceph-mon1: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 15:10:35.780529 I | rook-ceph-mon1: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 15:10:35.780540 I | rook-ceph-mon1: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 15:10:35.780550 I | rook-ceph-mon1: Cumulative compaction: 0.72 GB write, 0.11 MB/s write, 0.70 GB read, 0.11 MB/s read, 27.3 seconds
- 2017-07-11 15:10:35.780560 I | rook-ceph-mon1: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 15:10:35.780581 I | rook-ceph-mon1: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 15:10:35.780601 I | rook-ceph-mon1:
- 2017-07-11 15:10:35.780612 I | rook-ceph-mon1: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 15:10:35.780621 I | rook-ceph-mon1:
- 2017-07-11 15:10:35.780631 I | rook-ceph-mon1: 2017-07-11 15:10:35.779207 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.779202) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 15:10:35.780640 I | rook-ceph-mon1:
- 2017-07-11 15:10:35.780650 I | rook-ceph-mon1: 2017-07-11 15:10:35.779210 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 100] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:10:35.780661 I | rook-ceph-mon1: 2017-07-11 15:10:35.779213 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 99 Base level 0, inputs: [155(3943KB)], [153(13MB)]
- 2017-07-11 15:10:35.780685 I | rook-ceph-mon1:
- 2017-07-11 15:10:35.780695 I | rook-ceph-mon1: 2017-07-11 15:10:35.779222 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835779216, "job": 100, "event": "compaction_started", "files_L0": [155], "files_L1": [153], "score": -1, "input_data_size": 18004590}
- 2017-07-11 15:10:35.912173 I | rook-ceph-mon1: 2017-07-11 15:10:35.912142 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 100] Generated table #156: 2387 keys, 15505412 bytes
- 2017-07-11 15:10:35.912328 I | rook-ceph-mon1: 2017-07-11 15:10:35.912248 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835912234, "cf_name": "default", "job": 100, "event": "table_file_creation", "file_number": 156, "file_size": 15505412, "table_properties": {"data_size": 15452336, "index_size": 52257, "filter_size": 0, "raw_key_size": 46151, "raw_average_key_size": 19, "raw_value_size": 15382379, "raw_average_value_size": 6444, "num_data_blocks": 1587, "num_entries": 2387, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:10:35.973988 I | rook-ceph-mon1: 2017-07-11 15:10:35.973965 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 100] Compacted 1@0 + 1@1 files to L1 => 15505412 bytes
- 2017-07-11 15:10:36.003961 I | rook-ceph-mon1: 2017-07-11 15:10:36.003904 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:10:36.003791) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 92.5 rd, 79.6 wr, level 1, files in(1, 1) out(1) MB in(3.9, 13.3) out(14.8), read-write-amplify(8.3) write-amplify(3.8) OK, records in: 2899, records dropped: 512
- 2017-07-11 15:10:36.004009 I | rook-ceph-mon1:
- 2017-07-11 15:10:36.004040 I | rook-ceph-mon1: 2017-07-11 15:10:36.004026 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:10:36.003823) EVENT_LOG_v1 {"time_micros": 1499785836003810, "job": 100, "event": "compaction_finished", "compaction_time_micros": 194731, "output_level": 1, "num_output_files": 1, "total_output_size": 15505412, "num_input_records": 2899, "num_output_records": 2387, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:10:36.004617 I | rook-ceph-mon1: 2017-07-11 15:10:36.004603 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785836004601, "job": 100, "event": "table_file_deletion", "file_number": 155}
- 2017-07-11 15:10:36.006079 I | rook-ceph-mon1: 2017-07-11 15:10:36.006055 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785836006053, "job": 100, "event": "table_file_deletion", "file_number": 153}
- 2017-07-11 15:10:41.263304 I | rook-ceph-mon1: 2017-07-11 15:10:41.263275 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:41.263402 I | rook-ceph-mon1: 2017-07-11 15:10:41.263389 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3910865748' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:41.844556 I | rook-ceph-mon1: 2017-07-11 15:10:41.844513 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:41.844734 I | rook-ceph-mon1: 2017-07-11 15:10:41.844658 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1043235243' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:44.885808 I | rook-ceph-mon1: 2017-07-11 15:10:44.885778 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:44.885907 I | rook-ceph-mon1: 2017-07-11 15:10:44.885893 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3044549358' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:55.130312 I | rook-ceph-mon1: 2017-07-11 15:10:55.129999 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4754 MB, avail 94432 MB
- 2017-07-11 15:10:55.494760 I | rook-ceph-mon1: 2017-07-11 15:10:55.494728 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:55.494922 I | rook-ceph-mon1: 2017-07-11 15:10:55.494856 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/837292269' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:03.083199 I | rook-ceph-mon1: 2017-07-11 15:11:03.083170 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:03.083292 I | rook-ceph-mon1: 2017-07-11 15:11:03.083278 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2044393932' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:06.255362 I | rook-ceph-mon1: 2017-07-11 15:11:06.255329 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:06.255467 I | rook-ceph-mon1: 2017-07-11 15:11:06.255453 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2898816425' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:13.282609 I | rook-ceph-mon1: 2017-07-11 15:11:13.282578 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:13.282785 I | rook-ceph-mon1: 2017-07-11 15:11:13.282708 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3331475940' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:13.946274 I | rook-ceph-mon1: 2017-07-11 15:11:13.946153 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:13.946327 I | rook-ceph-mon1: 2017-07-11 15:11:13.946174 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3749160389' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:15.246829 I | rook-ceph-mon1: 2017-07-11 15:11:15.246799 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"} v 0) v1
- 2017-07-11 15:11:15.246976 I | rook-ceph-mon1: 2017-07-11 15:11:15.246907 7f0040b3f700 0 log_channel(audit) log [INF] : from='client.? 10.233.99.2:0/211370252' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 15:11:16.151939 I | rook-ceph-mon1: 2017-07-11 15:11:14.988878 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2258 : audit [INF] from='client.7123 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 15:11:16.151952 I | rook-ceph-mon1: 2017-07-11 15:11:15.246998 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 1269 : audit [INF] from='client.? 10.233.99.2:0/211370252' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 15:11:16.884533 I | rook-ceph-mon1: 2017-07-11 15:11:16.884503 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:16.884701 I | rook-ceph-mon1: 2017-07-11 15:11:16.884626 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3555274858' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:38.086594 I | rook-ceph-mon1: 2017-07-11 15:11:38.086567 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:38.086691 I | rook-ceph-mon1: 2017-07-11 15:11:38.086677 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/498266749' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:55.130500 I | rook-ceph-mon1: 2017-07-11 15:11:55.130245 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4754 MB, avail 94432 MB
- 2017-07-11 15:11:57.384283 I | rook-ceph-mon1: 2017-07-11 15:11:57.384245 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:57.384390 I | rook-ceph-mon1: 2017-07-11 15:11:57.384376 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3247163246' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:57.597442 I | rook-ceph-mon1: 2017-07-11 15:11:57.597413 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:57.597622 I | rook-ceph-mon1: 2017-07-11 15:11:57.597607 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1747242313' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:59.394019 I | rook-ceph-mon1: 2017-07-11 15:11:59.393969 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:59.394209 I | rook-ceph-mon1: 2017-07-11 15:11:59.394131 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3667592593' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:10.017920 I | rook-ceph-mon1: 2017-07-11 15:12:10.017891 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:10.018120 I | rook-ceph-mon1: 2017-07-11 15:12:10.018017 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3472330387' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:19.207742 I | rook-ceph-mon1: 2017-07-11 15:12:19.207540 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:19.207815 I | rook-ceph-mon1: 2017-07-11 15:12:19.207570 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1687783490' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:19.391074 I | rook-ceph-mon1: 2017-07-11 15:12:19.390960 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:19.391137 I | rook-ceph-mon1: 2017-07-11 15:12:19.390978 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1542821780' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:20.614742 I | rook-ceph-mon1: 2017-07-11 15:12:20.614712 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:20.614894 I | rook-ceph-mon1: 2017-07-11 15:12:20.614832 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2676332828' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:30.331037 I | rook-ceph-mon1: 2017-07-11 15:12:30.331004 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:30.332575 I | rook-ceph-mon1: 2017-07-11 15:12:30.332559 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1616802703' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:30.526848 I | rook-ceph-mon1: 2017-07-11 15:12:30.526826 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:30.526934 I | rook-ceph-mon1: 2017-07-11 15:12:30.526921 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2653187564' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:31.207052 I | rook-ceph-mon1: 2017-07-11 15:12:31.207024 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:31.207140 I | rook-ceph-mon1: 2017-07-11 15:12:31.207127 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3017049121' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:41.121679 I | rook-ceph-mon1: 2017-07-11 15:12:41.121645 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:41.121777 I | rook-ceph-mon1: 2017-07-11 15:12:41.121762 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2833316263' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:51.210330 I | rook-ceph-mon1: 2017-07-11 15:12:51.210298 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:51.210440 I | rook-ceph-mon1: 2017-07-11 15:12:51.210424 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4050104246' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:51.832914 I | rook-ceph-mon1: 2017-07-11 15:12:51.832863 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:51.833164 I | rook-ceph-mon1: 2017-07-11 15:12:51.833147 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1300567659' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:52.554197 I | rook-ceph-mon1: 2017-07-11 15:12:52.554165 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:52.554360 I | rook-ceph-mon1: 2017-07-11 15:12:52.554291 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3963988237' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:55.130686 I | rook-ceph-mon1: 2017-07-11 15:12:55.130478 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4754 MB, avail 94432 MB
- 2017-07-11 15:13:01.808759 I | rook-ceph-mon1: 2017-07-11 15:13:01.808731 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:01.808864 I | rook-ceph-mon1: 2017-07-11 15:13:01.808850 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2222546475' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:05.931587 I | rook-ceph-mon1: 2017-07-11 15:13:05.367470 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2272 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1796 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 100 pgs stuck inactive; 1696 pgs stuck stale; 100 pgs stuck unclean; too many PGs per OSD (537 > max 300); Monitor clock skew detected
- 2017-07-11 15:13:14.861745 I | rook-ceph-mon1: 2017-07-11 15:13:14.861717 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:14.861844 I | rook-ceph-mon1: 2017-07-11 15:13:14.861830 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2108082560' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:36.777847 I | rook-ceph-mon1: 2017-07-11 15:13:36.777815 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:36.778027 I | rook-ceph-mon1: 2017-07-11 15:13:36.778010 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2680084643' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:37.310987 I | rook-ceph-mon1: 2017-07-11 15:13:37.310953 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:37.311087 I | rook-ceph-mon1: 2017-07-11 15:13:37.311073 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/198555855' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:48.345727 I | rook-ceph-mon1: 2017-07-11 15:13:48.345692 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:48.345916 I | rook-ceph-mon1: 2017-07-11 15:13:48.345819 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/597902420' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:55.130965 I | rook-ceph-mon1: 2017-07-11 15:13:55.130679 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4754 MB, avail 94432 MB
- 2017-07-11 15:13:58.029816 I | rook-ceph-mon1: 2017-07-11 15:13:58.029785 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:58.030027 I | rook-ceph-mon1: 2017-07-11 15:13:58.029991 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/504349982' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:59.662409 I | rook-ceph-mon1: 2017-07-11 15:13:59.662385 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:59.662506 I | rook-ceph-mon1: 2017-07-11 15:13:59.662492 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/934460072' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:05.172761 I | rook-ceph-mon1: 2017-07-11 15:14:05.172675 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #157. Immutable memtables: 0.
- 2017-07-11 15:14:05.172832 I | rook-ceph-mon1:
- 2017-07-11 15:14:05.172850 I | rook-ceph-mon1: 2017-07-11 15:14:05.172712 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 101] Syncing log #154
- 2017-07-11 15:14:05.209130 I | rook-ceph-mon1: 2017-07-11 15:14:05.206506 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.172706) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:14:05.209172 I | rook-ceph-mon1: 2017-07-11 15:14:05.206514 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 101] Flushing memtable with next log file: 157
- 2017-07-11 15:14:05.209187 I | rook-ceph-mon1:
- 2017-07-11 15:14:05.209200 I | rook-ceph-mon1: 2017-07-11 15:14:05.206521 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045206518, "job": 101, "event": "flush_started", "num_memtables": 1, "num_entries": 1461, "num_deletes": 252, "memory_usage": 5489248}
- 2017-07-11 15:14:05.209210 I | rook-ceph-mon1: 2017-07-11 15:14:05.206523 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 101] Level-0 flush table #158: started
- 2017-07-11 15:14:05.385563 I | rook-ceph-mon1: 2017-07-11 15:14:05.385518 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045385508, "cf_name": "default", "job": 101, "event": "table_file_creation", "file_number": 158, "file_size": 2540781, "table_properties": {"data_size": 2533124, "index_size": 6839, "filter_size": 0, "raw_key_size": 10219, "raw_average_key_size": 19, "raw_value_size": 2521112, "raw_average_value_size": 4783, "num_data_blocks": 221, "num_entries": 527, "filter_policy_name": "", "kDeletedKeys": "252", "kMergeOperands": "0"}}
- 2017-07-11 15:14:05.385670 I | rook-ceph-mon1: 2017-07-11 15:14:05.385654 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 101] Level-0 flush table #158: 2540781 bytes OK
- 2017-07-11 15:14:05.463406 I | rook-ceph-mon1: 2017-07-11 15:14:05.463383 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.414136) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #158 started
- 2017-07-11 15:14:05.463461 I | rook-ceph-mon1: 2017-07-11 15:14:05.463447 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.463337) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #158: memtable #1 done
- 2017-07-11 15:14:05.463491 I | rook-ceph-mon1: 2017-07-11 15:14:05.463478 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.463357) EVENT_LOG_v1 {"time_micros": 1499786045463354, "job": 101, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:14:05.463538 I | rook-ceph-mon1: 2017-07-11 15:14:05.463525 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.463371) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:14:05.463551 I | rook-ceph-mon1:
- 2017-07-11 15:14:05.463603 I | rook-ceph-mon1: 2017-07-11 15:14:05.463591 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 101] Try to delete WAL files size 5459387, prev total WAL file size 5459387, number of live WAL files 2.
- 2017-07-11 15:14:05.463615 I | rook-ceph-mon1:
- 2017-07-11 15:14:05.466345 I | rook-ceph-mon1: 2017-07-11 15:14:05.464388 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:14:05.466390 I | rook-ceph-mon1: 2017-07-11 15:14:05.464421 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.464416) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 15:14:05.466422 I | rook-ceph-mon1:
- 2017-07-11 15:14:05.466439 I | rook-ceph-mon1: 2017-07-11 15:14:05.464426 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 102] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:14:05.466450 I | rook-ceph-mon1: 2017-07-11 15:14:05.464430 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 101 Base level 0, inputs: [158(2481KB)], [156(14MB)]
- 2017-07-11 15:14:05.466460 I | rook-ceph-mon1:
- 2017-07-11 15:14:05.466470 I | rook-ceph-mon1: 2017-07-11 15:14:05.464439 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045464432, "job": 102, "event": "compaction_started", "files_L0": [158], "files_L1": [156], "score": -1, "input_data_size": 18046193}
- 2017-07-11 15:14:05.629292 I | rook-ceph-mon1: 2017-07-11 15:14:05.629235 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 102] Generated table #159: 2502 keys, 16970700 bytes
- 2017-07-11 15:14:05.629352 I | rook-ceph-mon1: 2017-07-11 15:14:05.629334 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045629326, "cf_name": "default", "job": 102, "event": "table_file_creation", "file_number": 159, "file_size": 16970700, "table_properties": {"data_size": 16915646, "index_size": 54235, "filter_size": 0, "raw_key_size": 48083, "raw_average_key_size": 19, "raw_value_size": 16842805, "raw_average_value_size": 6731, "num_data_blocks": 1654, "num_entries": 2502, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:14:05.699658 I | rook-ceph-mon1: 2017-07-11 15:14:05.699634 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 102] Compacted 1@0 + 1@1 files to L1 => 16970700 bytes
- 2017-07-11 15:14:05.808364 I | rook-ceph-mon1: 2017-07-11 15:14:05.808323 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.808258) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 76.7 rd, 72.2 wr, level 1, files in(1, 1) out(1) MB in(2.4, 14.8) out(16.2), read-write-amplify(13.8) write-amplify(6.7) OK, records in: 2914, records dropped: 412
- 2017-07-11 15:14:05.808373 I | rook-ceph-mon1:
- 2017-07-11 15:14:05.808408 I | rook-ceph-mon1: 2017-07-11 15:14:05.808394 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.808275) EVENT_LOG_v1 {"time_micros": 1499786045808268, "job": 102, "event": "compaction_finished", "compaction_time_micros": 235184, "output_level": 1, "num_output_files": 1, "total_output_size": 16970700, "num_input_records": 2914, "num_output_records": 2502, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:14:05.808804 I | rook-ceph-mon1: 2017-07-11 15:14:05.808792 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045808789, "job": 102, "event": "table_file_deletion", "file_number": 158}
- 2017-07-11 15:14:05.810525 I | rook-ceph-mon1: 2017-07-11 15:14:05.810512 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045810510, "job": 102, "event": "table_file_deletion", "file_number": 156}
- 2017-07-11 15:14:05.810585 I | rook-ceph-mon1: 2017-07-11 15:14:05.810572 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:14:07.164880 I | rook-ceph-mon1: 2017-07-11 15:14:07.164851 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:07.165077 I | rook-ceph-mon1: 2017-07-11 15:14:07.164982 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3015775422' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:10.712861 I | rook-ceph-mon1: 2017-07-11 15:14:10.712830 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:10.713201 I | rook-ceph-mon1: 2017-07-11 15:14:10.713167 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3218114997' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:15.343551 I | rook-ceph-mon1: 2017-07-11 15:14:15.343479 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #160. Immutable memtables: 0.
- 2017-07-11 15:14:15.343622 I | rook-ceph-mon1:
- 2017-07-11 15:14:15.343638 I | rook-ceph-mon1: 2017-07-11 15:14:15.343514 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 103] Syncing log #157
- 2017-07-11 15:14:15.374306 I | rook-ceph-mon1: 2017-07-11 15:14:15.373750 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.343509) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:14:15.374347 I | rook-ceph-mon1: 2017-07-11 15:14:15.373758 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 103] Flushing memtable with next log file: 160
- 2017-07-11 15:14:15.374362 I | rook-ceph-mon1:
- 2017-07-11 15:14:15.374373 I | rook-ceph-mon1: 2017-07-11 15:14:15.373765 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055373762, "job": 103, "event": "flush_started", "num_memtables": 1, "num_entries": 579, "num_deletes": 502, "memory_usage": 431352}
- 2017-07-11 15:14:15.374383 I | rook-ceph-mon1: 2017-07-11 15:14:15.373767 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 103] Level-0 flush table #161: started
- 2017-07-11 15:14:15.419443 I | rook-ceph-mon1: 2017-07-11 15:14:15.419394 7f003b334700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055419387, "cf_name": "default", "job": 103, "event": "table_file_creation", "file_number": 161, "file_size": 275195, "table_properties": {"data_size": 273739, "index_size": 642, "filter_size": 0, "raw_key_size": 10409, "raw_average_key_size": 19, "raw_value_size": 266267, "raw_average_value_size": 500, "num_data_blocks": 21, "num_entries": 532, "filter_policy_name": "", "kDeletedKeys": "502", "kMergeOperands": "0"}}
- 2017-07-11 15:14:15.419483 I | rook-ceph-mon1: 2017-07-11 15:14:15.419401 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 103] Level-0 flush table #161: 275195 bytes OK
- 2017-07-11 15:14:15.486860 I | rook-ceph-mon1: 2017-07-11 15:14:15.485679 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.455070) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #161 started
- 2017-07-11 15:14:15.486900 I | rook-ceph-mon1: 2017-07-11 15:14:15.485685 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.485648) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #161: memtable #1 done
- 2017-07-11 15:14:15.486916 I | rook-ceph-mon1: 2017-07-11 15:14:15.485686 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.485659) EVENT_LOG_v1 {"time_micros": 1499786055485655, "job": 103, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:14:15.486929 I | rook-ceph-mon1: 2017-07-11 15:14:15.485688 7f003b334700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.485671) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:14:15.486940 I | rook-ceph-mon1:
- 2017-07-11 15:14:15.486951 I | rook-ceph-mon1: 2017-07-11 15:14:15.485693 7f003b334700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 103] Try to delete WAL files size 417226, prev total WAL file size 417226, number of live WAL files 2.
- 2017-07-11 15:14:15.486974 I | rook-ceph-mon1:
- 2017-07-11 15:14:15.486986 I | rook-ceph-mon1: 2017-07-11 15:14:15.485826 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:14:15.487016 I | rook-ceph-mon1: 2017-07-11 15:14:15.485854 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.485849) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 15:14:15.487029 I | rook-ceph-mon1:
- 2017-07-11 15:14:15.487054 I | rook-ceph-mon1: 2017-07-11 15:14:15.485858 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 104] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:14:15.487065 I | rook-ceph-mon1: 2017-07-11 15:14:15.485862 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 103 Base level 0, inputs: [161(268KB)], [159(16MB)]
- 2017-07-11 15:14:15.487076 I | rook-ceph-mon1:
- 2017-07-11 15:14:15.487086 I | rook-ceph-mon1: 2017-07-11 15:14:15.485871 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055485864, "job": 104, "event": "compaction_started", "files_L0": [161], "files_L1": [159], "score": -1, "input_data_size": 17245895}
- 2017-07-11 15:14:15.663649 I | rook-ceph-mon1: 2017-07-11 15:14:15.663593 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 104] Generated table #162: 2023 keys, 14172972 bytes
- 2017-07-11 15:14:15.663825 I | rook-ceph-mon1: 2017-07-11 15:14:15.663744 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055663735, "cf_name": "default", "job": 104, "event": "table_file_creation", "file_number": 162, "file_size": 14172972, "table_properties": {"data_size": 14126966, "index_size": 45187, "filter_size": 0, "raw_key_size": 38730, "raw_average_key_size": 19, "raw_value_size": 14067104, "raw_average_value_size": 6953, "num_data_blocks": 1391, "num_entries": 2023, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:14:15.708746 I | rook-ceph-mon1: 2017-07-11 15:14:15.708711 7f003ab33700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 104] Compacted 1@0 + 1@1 files to L1 => 14172972 bytes
- 2017-07-11 15:14:15.738278 I | rook-ceph-mon1: 2017-07-11 15:14:15.738253 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.738201) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 77.4 rd, 63.6 wr, level 1, files in(1, 1) out(1) MB in(0.3, 16.2) out(13.5), read-write-amplify(114.2) write-amplify(51.5) OK, records in: 3034, records dropped: 1011
- 2017-07-11 15:14:15.738317 I | rook-ceph-mon1:
- 2017-07-11 15:14:15.738348 I | rook-ceph-mon1: 2017-07-11 15:14:15.738334 7f003ab33700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.738216) EVENT_LOG_v1 {"time_micros": 1499786055738210, "job": 104, "event": "compaction_finished", "compaction_time_micros": 222828, "output_level": 1, "num_output_files": 1, "total_output_size": 14172972, "num_input_records": 3034, "num_output_records": 2023, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:14:15.738557 I | rook-ceph-mon1: 2017-07-11 15:14:15.738544 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055738541, "job": 104, "event": "table_file_deletion", "file_number": 161}
- 2017-07-11 15:14:15.740491 I | rook-ceph-mon1: 2017-07-11 15:14:15.740478 7f003ab33700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055740476, "job": 104, "event": "table_file_deletion", "file_number": 159}
- 2017-07-11 15:14:15.740548 I | rook-ceph-mon1: 2017-07-11 15:14:15.740536 7f003bb35700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:14:28.404277 I | rook-ceph-mon1: 2017-07-11 15:14:28.404163 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:28.404329 I | rook-ceph-mon1: 2017-07-11 15:14:28.404181 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3370546344' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:31.950162 I | rook-ceph-mon1: 2017-07-11 15:14:31.950129 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:31.950338 I | rook-ceph-mon1: 2017-07-11 15:14:31.950257 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2956501167' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:36.169983 I | rook-ceph-mon1: 2017-07-11 15:14:35.647435 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2286 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0763369s > max 0.05s
- 2017-07-11 15:14:36.170068 I | rook-ceph-mon1: 2017-07-11 15:14:35.647668 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2287 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.240121s > max 0.05s
- 2017-07-11 15:14:40.705594 I | rook-ceph-mon1: 2017-07-11 15:14:40.705561 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:40.705787 I | rook-ceph-mon1: 2017-07-11 15:14:40.705700 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/516435086' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:41.798042 I | rook-ceph-mon1: 2017-07-11 15:14:41.798008 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:41.798141 I | rook-ceph-mon1: 2017-07-11 15:14:41.798127 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3958329413' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:42.547160 I | rook-ceph-mon1: 2017-07-11 15:14:42.547127 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:42.547328 I | rook-ceph-mon1: 2017-07-11 15:14:42.547256 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/745332239' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:51.363342 I | rook-ceph-mon1: 2017-07-11 15:14:51.363312 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:51.363509 I | rook-ceph-mon1: 2017-07-11 15:14:51.363438 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/229589818' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:55.131040 I | rook-ceph-mon1: 2017-07-11 15:14:55.130909 7f0043344700 0 mon.rook-ceph-mon1@1(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4753 MB, avail 94433 MB
- 2017-07-11 15:15:03.206930 I | rook-ceph-mon1: 2017-07-11 15:15:03.206901 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:15:03.207107 I | rook-ceph-mon1: 2017-07-11 15:15:03.207015 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/238403064' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:15:11.149603 I | rook-ceph-mon1: 2017-07-11 15:15:11.149572 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:15:11.149700 I | rook-ceph-mon1: 2017-07-11 15:15:11.149686 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2311534511' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:15:12.630530 I | rook-ceph-mon1: 2017-07-11 15:15:12.630498 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:15:12.630693 I | rook-ceph-mon1: 2017-07-11 15:15:12.630622 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4087443340' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:15:13.934193 I | rook-ceph-mon1: 2017-07-11 15:15:13.934160 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:15:13.934382 I | rook-ceph-mon1: 2017-07-11 15:15:13.934297 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1380070646' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:15:21.757985 I | rook-ceph-mon1: 2017-07-11 15:15:21.757955 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:15:21.758427 I | rook-ceph-mon1: 2017-07-11 15:15:21.758409 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3605746960' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:15:25.395454 I | rook-ceph-mon1: 2017-07-11 15:15:25.395426 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:15:25.395728 I | rook-ceph-mon1: 2017-07-11 15:15:25.395633 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2686535524' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:15:32.352369 I | rook-ceph-mon1: 2017-07-11 15:15:32.352339 7f0040b3f700 0 mon.rook-ceph-mon1@1(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:15:32.352543 I | rook-ceph-mon1: 2017-07-11 15:15:32.352467 7f0040b3f700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/733121979' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- END logs from pod: rook-ceph-mon1-ktck0
- BEGIN logs from pod: rook-ceph-mon2-zf8zr
- 2017-07-11 13:23:56.873369 I | cephmon: parsing mon endpoints: rook-ceph-mon0=10.233.76.3:6790,rook-ceph-mon1=10.233.99.4:6790
- 2017-07-11 13:23:56.873788 I | cephmon: writing config file /var/lib/rook/rook/rook.config
- 2017-07-11 13:23:56.873954 I | cephmon: generated admin config in /var/lib/rook/rook
- 2017-07-11 13:23:56.874262 I | cephmon: writing config file /var/lib/rook/rook-ceph-mon2/rook.config
- 2017-07-11 13:23:56.874474 I | cephmon: initializing mon
- 2017-07-11 13:23:56.874537 I | proc: Running process ceph-mon with args: [--mkfs --name=mon.rook-ceph-mon2 --cluster=rook --mon-data=/var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2 --conf=/var/lib/rook/rook-ceph-mon2/rook.config --keyring=/var/lib/rook/rook-ceph-mon2/keyring]
- 2017-07-11 13:23:56.874556 I | exec: Running command: ceph-mon --mkfs --name=mon.rook-ceph-mon2 --cluster=rook --mon-data=/var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2 --conf=/var/lib/rook/rook-ceph-mon2/rook.config --keyring=/var/lib/rook/rook-ceph-mon2/keyring
- 2017-07-11 13:23:56.920388 I | mkfs-rook-ceph-mon2: ceph-mon: set fsid to 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:23:56.926799 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.920607 7fccd434dc40 0 set rocksdb option compression = kNoCompression
- 2017-07-11 13:23:56.926849 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926351 7fccd434dc40 0 set rocksdb option write_buffer_size = 33554432
- 2017-07-11 13:23:56.926870 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926432 7fccd434dc40 0 set rocksdb option compression = kNoCompression
- 2017-07-11 13:23:56.926886 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926436 7fccd434dc40 0 set rocksdb option write_buffer_size = 33554432
- 2017-07-11 13:23:56.926931 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926514 7fccd434dc40 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:23:56.926944 I | mkfs-rook-ceph-mon2:
- 2017-07-11 13:23:56.926961 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926518 7fccd434dc40 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:23:56.926978 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926519 7fccd434dc40 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:23:56.927018 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926520 7fccd434dc40 4 rocksdb: DB SUMMARY
- 2017-07-11 13:23:56.927031 I | mkfs-rook-ceph-mon2:
- 2017-07-11 13:23:56.927048 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926536 7fccd434dc40 4 rocksdb: SST files in /var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2/store.db dir, Total Num: 0, files:
- 2017-07-11 13:23:56.927059 I | mkfs-rook-ceph-mon2:
- 2017-07-11 13:23:56.927088 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926538 7fccd434dc40 4 rocksdb: Write Ahead Log file in /var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2/store.db:
- 2017-07-11 13:23:56.927100 I | mkfs-rook-ceph-mon2:
- 2017-07-11 13:23:56.927118 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926539 7fccd434dc40 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:23:56.927134 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926540 7fccd434dc40 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:23:56.927149 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926540 7fccd434dc40 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:23:56.927178 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926541 7fccd434dc40 4 rocksdb: Options.env: 0x560037813dc0
- 2017-07-11 13:23:56.927194 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926542 7fccd434dc40 4 rocksdb: Options.info_log: 0x56003876a780
- 2017-07-11 13:23:56.927209 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926542 7fccd434dc40 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:23:56.927223 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926543 7fccd434dc40 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:23:56.927251 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926543 7fccd434dc40 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:23:56.927267 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926544 7fccd434dc40 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:23:56.927282 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926544 7fccd434dc40 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:23:56.927297 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926545 7fccd434dc40 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:23:56.927338 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926546 7fccd434dc40 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:23:56.927368 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926546 7fccd434dc40 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:23:56.927409 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926547 7fccd434dc40 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:23:56.927427 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926547 7fccd434dc40 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:23:56.927445 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926548 7fccd434dc40 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:23:56.927462 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926548 7fccd434dc40 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:23:56.927493 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926549 7fccd434dc40 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:23:56.927514 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926549 7fccd434dc40 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:23:56.927531 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926550 7fccd434dc40 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:23:56.927561 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926550 7fccd434dc40 4 rocksdb: Options.wal_dir: /var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2/store.db
- 2017-07-11 13:23:56.927581 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926551 7fccd434dc40 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:23:56.927598 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926551 7fccd434dc40 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:23:56.927615 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926552 7fccd434dc40 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:23:56.927645 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926552 7fccd434dc40 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:23:56.927663 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926553 7fccd434dc40 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:23:56.927679 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926554 7fccd434dc40 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:23:56.927699 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926554 7fccd434dc40 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:23:56.927730 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926555 7fccd434dc40 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:23:56.927747 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926555 7fccd434dc40 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:23:56.927764 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926562 7fccd434dc40 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:23:56.927793 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926562 7fccd434dc40 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:23:56.927812 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926563 7fccd434dc40 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:23:56.927829 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926563 7fccd434dc40 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:23:56.927845 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926564 7fccd434dc40 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:23:56.927875 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926564 7fccd434dc40 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:23:56.927893 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926565 7fccd434dc40 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:23:56.927910 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926566 7fccd434dc40 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:23:56.927926 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926566 7fccd434dc40 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:23:56.927957 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926567 7fccd434dc40 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:23:56.927975 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926567 7fccd434dc40 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:23:56.928006 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926568 7fccd434dc40 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:23:56.928038 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926569 7fccd434dc40 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:23:56.928056 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926569 7fccd434dc40 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:23:56.928073 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926570 7fccd434dc40 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:23:56.928152 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926570 7fccd434dc40 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:23:56.928190 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926571 7fccd434dc40 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:23:56.928211 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926571 7fccd434dc40 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:23:56.928228 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926572 7fccd434dc40 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:23:56.928244 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926572 7fccd434dc40 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:23:56.928278 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926573 7fccd434dc40 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:23:56.928296 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926573 7fccd434dc40 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:23:56.928313 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926574 7fccd434dc40 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:23:56.928344 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926574 7fccd434dc40 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:23:56.928363 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926575 7fccd434dc40 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:23:56.928380 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926576 7fccd434dc40 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:23:56.928396 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926576 7fccd434dc40 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:23:56.928426 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926577 7fccd434dc40 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:23:56.928444 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926578 7fccd434dc40 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:23:56.928461 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926578 7fccd434dc40 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:23:56.928516 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926579 7fccd434dc40 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:23:56.928536 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926579 7fccd434dc40 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:23:56.928553 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926581 7fccd434dc40 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:23:56.928569 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:56.926619 7fccd434dc40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:192] Creating manifest 1
- 2017-07-11 13:23:56.928596 I | mkfs-rook-ceph-mon2:
- 2017-07-11 13:23:57.101662 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101133 7fccd434dc40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001
- 2017-07-11 13:23:57.101757 I | mkfs-rook-ceph-mon2:
- 2017-07-11 13:23:57.101782 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101251 7fccd434dc40 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:23:57.101830 I | mkfs-rook-ceph-mon2:
- 2017-07-11 13:23:57.101850 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101254 7fccd434dc40 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:23:57.101868 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101256 7fccd434dc40 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:23:57.101901 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101257 7fccd434dc40 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:23:57.101919 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101258 7fccd434dc40 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:23:57.101939 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101259 7fccd434dc40 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:23:57.101956 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101260 7fccd434dc40 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:23:57.102007 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101318 7fccd434dc40 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560038590150)
- 2017-07-11 13:23:57.102019 I | mkfs-rook-ceph-mon2: cache_index_and_filter_blocks: 0
- 2017-07-11 13:23:57.102030 I | mkfs-rook-ceph-mon2: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:23:57.102055 I | mkfs-rook-ceph-mon2: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:23:57.102068 I | mkfs-rook-ceph-mon2: index_type: 0
- 2017-07-11 13:23:57.102092 I | mkfs-rook-ceph-mon2: hash_index_allow_collision: 1
- 2017-07-11 13:23:57.102114 I | mkfs-rook-ceph-mon2: checksum: 1
- 2017-07-11 13:23:57.102135 I | mkfs-rook-ceph-mon2: no_block_cache: 0
- 2017-07-11 13:23:57.102145 I | mkfs-rook-ceph-mon2: block_cache: 0x5600385c28c0
- 2017-07-11 13:23:57.102154 I | mkfs-rook-ceph-mon2: block_cache_name: LRUCache
- 2017-07-11 13:23:57.102164 I | mkfs-rook-ceph-mon2: block_cache_options:
- 2017-07-11 13:23:57.102174 I | mkfs-rook-ceph-mon2: capacity : 107374182
- 2017-07-11 13:23:57.102183 I | mkfs-rook-ceph-mon2: num_shard_bits : 4
- 2017-07-11 13:23:57.102192 I | mkfs-rook-ceph-mon2: strict_capacity_limit : 0
- 2017-07-11 13:23:57.102212 I | mkfs-rook-ceph-mon2: high_pri_pool_ratio: 0.000
- 2017-07-11 13:23:57.102222 I | mkfs-rook-ceph-mon2: block_cache_compressed: (nil)
- 2017-07-11 13:23:57.102231 I | mkfs-rook-ceph-mon2: persistent_cache: (nil)
- 2017-07-11 13:23:57.102240 I | mkfs-rook-ceph-mon2: block_size: 4096
- 2017-07-11 13:23:57.102250 I | mkfs-rook-ceph-mon2: block_size_deviation: 10
- 2017-07-11 13:23:57.102259 I | mkfs-rook-ceph-mon2: block_restart_interval: 16
- 2017-07-11 13:23:57.102269 I | mkfs-rook-ceph-mon2: index_block_restart_interval: 1
- 2017-07-11 13:23:57.102289 I | mkfs-rook-ceph-mon2: filter_policy: nullptr
- 2017-07-11 13:23:57.102299 I | mkfs-rook-ceph-mon2: whole_key_filtering: 1
- 2017-07-11 13:23:57.102309 I | mkfs-rook-ceph-mon2: format_version: 2
- 2017-07-11 13:23:57.102319 I | mkfs-rook-ceph-mon2:
- 2017-07-11 13:23:57.102334 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101322 7fccd434dc40 4 rocksdb: Options.write_buffer_size: 33554432
- 2017-07-11 13:23:57.102349 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101323 7fccd434dc40 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:23:57.102381 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101324 7fccd434dc40 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:23:57.102396 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101325 7fccd434dc40 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:23:57.102413 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101326 7fccd434dc40 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:23:57.102427 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101327 7fccd434dc40 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:23:57.102456 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101328 7fccd434dc40 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:23:57.102471 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101328 7fccd434dc40 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:23:57.102486 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101329 7fccd434dc40 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:23:57.102501 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101330 7fccd434dc40 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:23:57.102528 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101330 7fccd434dc40 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:23:57.102544 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101331 7fccd434dc40 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:23:57.102558 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101332 7fccd434dc40 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:23:57.102573 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101333 7fccd434dc40 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:23:57.102600 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101333 7fccd434dc40 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:23:57.102617 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101334 7fccd434dc40 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:23:57.102632 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101335 7fccd434dc40 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:23:57.102646 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101347 7fccd434dc40 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:23:57.102675 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101348 7fccd434dc40 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:23:57.102692 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101348 7fccd434dc40 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:23:57.102707 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101349 7fccd434dc40 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:23:57.102721 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101351 7fccd434dc40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:23:57.102736 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101352 7fccd434dc40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:23:57.102765 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101352 7fccd434dc40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:23:57.102780 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101353 7fccd434dc40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:23:57.102795 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101354 7fccd434dc40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:23:57.102809 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101354 7fccd434dc40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:23:57.102837 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101355 7fccd434dc40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:23:57.102854 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101357 7fccd434dc40 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:23:57.102869 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101357 7fccd434dc40 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:23:57.102919 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101358 7fccd434dc40 4 rocksdb: Options.arena_block_size: 4194304
- 2017-07-11 13:23:57.102949 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101358 7fccd434dc40 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:23:57.103009 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101359 7fccd434dc40 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:23:57.103030 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101360 7fccd434dc40 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:23:57.103047 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101360 7fccd434dc40 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:23:57.103081 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101362 7fccd434dc40 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:23:57.103100 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101363 7fccd434dc40 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:23:57.103117 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101363 7fccd434dc40 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:23:57.103150 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101364 7fccd434dc40 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:23:57.103168 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101369 7fccd434dc40 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:23:57.103186 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101370 7fccd434dc40 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:23:57.103202 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101370 7fccd434dc40 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:23:57.103232 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101371 7fccd434dc40 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:23:57.103260 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101372 7fccd434dc40 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:23:57.103276 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101372 7fccd434dc40 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:23:57.103318 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101373 7fccd434dc40 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:23:57.103335 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101373 7fccd434dc40 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:23:57.103353 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101374 7fccd434dc40 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:23:57.103392 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101375 7fccd434dc40 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:23:57.103408 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101375 7fccd434dc40 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:23:57.103423 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101376 7fccd434dc40 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:23:57.103437 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101377 7fccd434dc40 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:23:57.103464 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101377 7fccd434dc40 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:23:57.103480 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.101378 7fccd434dc40 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:23:57.104165 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.103980 7fccd434dc40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:23:57.104201 I | mkfs-rook-ceph-mon2:
- 2017-07-11 13:23:57.104222 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.103989 7fccd434dc40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 0
- 2017-07-11 13:23:57.104235 I | mkfs-rook-ceph-mon2:
- 2017-07-11 13:23:57.168472 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.168012 7fccd434dc40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x5600387b0000
- 2017-07-11 13:23:57.259060 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.258881 7fccd434dc40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:217] Shutdown: canceling all background work
- 2017-07-11 13:23:57.259257 I | mkfs-rook-ceph-mon2: 2017-07-11 13:23:57.259144 7fccd434dc40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:343] Shutdown complete
- 2017-07-11 13:23:57.259340 I | mkfs-rook-ceph-mon2: ceph-mon: created monfs at /var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2 for mon.rook-ceph-mon2
- 2017-07-11 13:23:57.261469 I | cephmon: starting mon
- 2017-07-11 13:23:57.261540 I | cephmon: Config file /var/lib/rook/rook-ceph-mon2/rook.config:
- [global]
- enable experimental unrecoverable data corrupting features =
- fsid = 14d33745-7e28-4202-a25a-906da8bffbcf
- run dir = /var/lib/rook/rook-ceph-mon2
- mon initial members = rook-ceph-mon0 rook-ceph-mon1 rook-ceph-mon2
- log file = /dev/stdout
- mon cluster log file = /dev/stdout
- mon keyvaluedb = rocksdb
- debug default = 0
- debug rados = 0
- debug mon = 0
- debug osd = 0
- debug bluestore = 0
- debug filestore = 0
- debug journal = 0
- debug leveldb = 0
- filestore_omap_backend = rocksdb
- osd pg bits = 11
- osd pgp bits = 11
- osd pool default size = 1
- osd pool default min size = 1
- osd pool default pg num = 100
- osd pool default pgp num = 100
- osd objectstore = filestore
- rbd_default_features = 3
- fatal signal handlers = false
- [client.admin]
- keyring = /var/lib/rook/rook-ceph-mon2/keyring
- [mon.rook-ceph-mon2]
- name = rook-ceph-mon2
- mon addr = 10.233.124.3:6790
- [mon.rook-ceph-mon0]
- name = rook-ceph-mon0
- mon addr = 10.233.76.3:6790
- [mon.rook-ceph-mon1]
- name = rook-ceph-mon1
- mon addr = 10.233.99.4:6790
- 2017-07-11 13:23:57.261592 I | proc: Running process ceph-mon with args: [--foreground --name=mon.rook-ceph-mon2 --cluster=rook --mon-data=/var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2 --conf=/var/lib/rook/rook-ceph-mon2/rook.config --keyring=/var/lib/rook/rook-ceph-mon2/keyring]
- 2017-07-11 13:23:57.261611 I | exec: Running command: ceph-mon --foreground --name=mon.rook-ceph-mon2 --cluster=rook --mon-data=/var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2 --conf=/var/lib/rook/rook-ceph-mon2/rook.config --keyring=/var/lib/rook/rook-ceph-mon2/keyring
- 2017-07-11 13:23:57.291246 I | rook-ceph-mon2: 2017-07-11 13:23:57.284743 7f0c90846c40 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 32
- 2017-07-11 13:23:57.291306 I | rook-ceph-mon2: 2017-07-11 13:23:57.284796 7f0c90846c40 0 pidfile_write: ignore empty --pid-file
- 2017-07-11 13:23:57.238327 I | rook-ceph-mon2: 2017-07-11 13:23:57.238287 7f0c90846c40 0 load: jerasure load: lrc load: isa
- 2017-07-11 13:23:57.238551 I | rook-ceph-mon2: 2017-07-11 13:23:57.238527 7f0c90846c40 0 set rocksdb option compression = kNoCompression
- 2017-07-11 13:23:57.238608 I | rook-ceph-mon2: 2017-07-11 13:23:57.238587 7f0c90846c40 0 set rocksdb option write_buffer_size = 33554432
- 2017-07-11 13:23:57.238711 I | rook-ceph-mon2: 2017-07-11 13:23:57.238696 7f0c90846c40 0 set rocksdb option compression = kNoCompression
- 2017-07-11 13:23:57.238761 I | rook-ceph-mon2: 2017-07-11 13:23:57.238736 7f0c90846c40 0 set rocksdb option write_buffer_size = 33554432
- 2017-07-11 13:23:57.238899 I | rook-ceph-mon2: 2017-07-11 13:23:57.238861 7f0c90846c40 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:23:57.238976 I | rook-ceph-mon2:
- 2017-07-11 13:23:57.239055 I | rook-ceph-mon2: 2017-07-11 13:23:57.239004 7f0c90846c40 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:23:57.239104 I | rook-ceph-mon2: 2017-07-11 13:23:57.239091 7f0c90846c40 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:23:57.239147 I | rook-ceph-mon2: 2017-07-11 13:23:57.239122 7f0c90846c40 4 rocksdb: DB SUMMARY
- 2017-07-11 13:23:57.239179 I | rook-ceph-mon2:
- 2017-07-11 13:23:57.239255 I | rook-ceph-mon2: 2017-07-11 13:23:57.239221 7f0c90846c40 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:23:57.239271 I | rook-ceph-mon2:
- 2017-07-11 13:23:57.239295 I | rook-ceph-mon2: 2017-07-11 13:23:57.239284 7f0c90846c40 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:23:57.244093 I | rook-ceph-mon2:
- 2017-07-11 13:23:57.244170 I | rook-ceph-mon2: 2017-07-11 13:23:57.244137 7f0c90846c40 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes
- 2017-07-11 13:23:57.244176 I | rook-ceph-mon2:
- 2017-07-11 13:23:57.244197 I | rook-ceph-mon2: 2017-07-11 13:23:57.244183 7f0c90846c40 4 rocksdb: SST files in /var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2/store.db dir, Total Num: 0, files:
- 2017-07-11 13:23:57.244201 I | rook-ceph-mon2:
- 2017-07-11 13:23:57.244217 I | rook-ceph-mon2: 2017-07-11 13:23:57.244206 7f0c90846c40 4 rocksdb: Write Ahead Log file in /var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2/store.db: 000003.log size: 917 ;
- 2017-07-11 13:23:57.244221 I | rook-ceph-mon2:
- 2017-07-11 13:23:57.244249 I | rook-ceph-mon2: 2017-07-11 13:23:57.244228 7f0c90846c40 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:23:57.244265 I | rook-ceph-mon2: 2017-07-11 13:23:57.244255 7f0c90846c40 4 rocksdb: Options.create_if_missing: 0
- 2017-07-11 13:23:57.244280 I | rook-ceph-mon2: 2017-07-11 13:23:57.244270 7f0c90846c40 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:23:57.244295 I | rook-ceph-mon2: 2017-07-11 13:23:57.244285 7f0c90846c40 4 rocksdb: Options.env: 0x55d6fb108dc0
- 2017-07-11 13:23:57.244314 I | rook-ceph-mon2: 2017-07-11 13:23:57.244300 7f0c90846c40 4 rocksdb: Options.info_log: 0x55d6fd1368a0
- 2017-07-11 13:23:57.244334 I | rook-ceph-mon2: 2017-07-11 13:23:57.244323 7f0c90846c40 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:23:57.244349 I | rook-ceph-mon2: 2017-07-11 13:23:57.244339 7f0c90846c40 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:23:57.244364 I | rook-ceph-mon2: 2017-07-11 13:23:57.244354 7f0c90846c40 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:23:57.244378 I | rook-ceph-mon2: 2017-07-11 13:23:57.244369 7f0c90846c40 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:23:57.244405 I | rook-ceph-mon2: 2017-07-11 13:23:57.244386 7f0c90846c40 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:23:57.244423 I | rook-ceph-mon2: 2017-07-11 13:23:57.244413 7f0c90846c40 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:23:57.244451 I | rook-ceph-mon2: 2017-07-11 13:23:57.244429 7f0c90846c40 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:23:57.244476 I | rook-ceph-mon2: 2017-07-11 13:23:57.244458 7f0c90846c40 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:23:57.244497 I | rook-ceph-mon2: 2017-07-11 13:23:57.244485 7f0c90846c40 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:23:57.244512 I | rook-ceph-mon2: 2017-07-11 13:23:57.244502 7f0c90846c40 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:23:57.244527 I | rook-ceph-mon2: 2017-07-11 13:23:57.244517 7f0c90846c40 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:23:57.244543 I | rook-ceph-mon2: 2017-07-11 13:23:57.244532 7f0c90846c40 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:23:57.244567 I | rook-ceph-mon2: 2017-07-11 13:23:57.244548 7f0c90846c40 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:23:57.244583 I | rook-ceph-mon2: 2017-07-11 13:23:57.244573 7f0c90846c40 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:23:57.244598 I | rook-ceph-mon2: 2017-07-11 13:23:57.244588 7f0c90846c40 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:23:57.244613 I | rook-ceph-mon2: 2017-07-11 13:23:57.244603 7f0c90846c40 4 rocksdb: Options.wal_dir: /var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2/store.db
- 2017-07-11 13:23:57.244628 I | rook-ceph-mon2: 2017-07-11 13:23:57.244619 7f0c90846c40 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:23:57.244655 I | rook-ceph-mon2: 2017-07-11 13:23:57.244644 7f0c90846c40 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:23:57.244670 I | rook-ceph-mon2: 2017-07-11 13:23:57.244661 7f0c90846c40 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:23:57.244685 I | rook-ceph-mon2: 2017-07-11 13:23:57.244676 7f0c90846c40 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:23:57.244700 I | rook-ceph-mon2: 2017-07-11 13:23:57.244690 7f0c90846c40 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:23:57.244722 I | rook-ceph-mon2: 2017-07-11 13:23:57.244705 7f0c90846c40 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:23:57.244739 I | rook-ceph-mon2: 2017-07-11 13:23:57.244728 7f0c90846c40 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:23:57.244753 I | rook-ceph-mon2: 2017-07-11 13:23:57.244744 7f0c90846c40 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:23:57.244768 I | rook-ceph-mon2: 2017-07-11 13:23:57.244759 7f0c90846c40 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:23:57.244783 I | rook-ceph-mon2: 2017-07-11 13:23:57.244773 7f0c90846c40 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:23:57.244806 I | rook-ceph-mon2: 2017-07-11 13:23:57.244796 7f0c90846c40 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:23:57.244821 I | rook-ceph-mon2: 2017-07-11 13:23:57.244812 7f0c90846c40 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:23:57.244836 I | rook-ceph-mon2: 2017-07-11 13:23:57.244827 7f0c90846c40 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:23:57.244852 I | rook-ceph-mon2: 2017-07-11 13:23:57.244842 7f0c90846c40 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:23:57.244874 I | rook-ceph-mon2: 2017-07-11 13:23:57.244857 7f0c90846c40 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:23:57.244890 I | rook-ceph-mon2: 2017-07-11 13:23:57.244880 7f0c90846c40 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:23:57.244905 I | rook-ceph-mon2: 2017-07-11 13:23:57.244895 7f0c90846c40 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:23:57.244920 I | rook-ceph-mon2: 2017-07-11 13:23:57.244910 7f0c90846c40 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:23:57.244934 I | rook-ceph-mon2: 2017-07-11 13:23:57.244925 7f0c90846c40 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:23:57.244957 I | rook-ceph-mon2: 2017-07-11 13:23:57.244939 7f0c90846c40 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:23:57.244997 I | rook-ceph-mon2: 2017-07-11 13:23:57.244963 7f0c90846c40 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:23:57.245013 I | rook-ceph-mon2: 2017-07-11 13:23:57.245003 7f0c90846c40 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:23:57.245036 I | rook-ceph-mon2: 2017-07-11 13:23:57.245025 7f0c90846c40 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:23:57.245054 I | rook-ceph-mon2: 2017-07-11 13:23:57.245044 7f0c90846c40 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:23:57.245069 I | rook-ceph-mon2: 2017-07-11 13:23:57.245059 7f0c90846c40 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:23:57.245101 I | rook-ceph-mon2: 2017-07-11 13:23:57.245076 7f0c90846c40 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:23:57.245120 I | rook-ceph-mon2: 2017-07-11 13:23:57.245110 7f0c90846c40 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:23:57.245145 I | rook-ceph-mon2: 2017-07-11 13:23:57.245125 7f0c90846c40 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:23:57.245160 I | rook-ceph-mon2: 2017-07-11 13:23:57.245151 7f0c90846c40 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:23:57.245174 I | rook-ceph-mon2: 2017-07-11 13:23:57.245165 7f0c90846c40 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:23:57.245196 I | rook-ceph-mon2: 2017-07-11 13:23:57.245186 7f0c90846c40 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:23:57.245211 I | rook-ceph-mon2: 2017-07-11 13:23:57.245201 7f0c90846c40 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:23:57.245225 I | rook-ceph-mon2: 2017-07-11 13:23:57.245216 7f0c90846c40 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:23:57.245240 I | rook-ceph-mon2: 2017-07-11 13:23:57.245230 7f0c90846c40 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:23:57.245257 I | rook-ceph-mon2: 2017-07-11 13:23:57.245245 7f0c90846c40 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:23:57.245276 I | rook-ceph-mon2: 2017-07-11 13:23:57.245266 7f0c90846c40 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:23:57.245291 I | rook-ceph-mon2: 2017-07-11 13:23:57.245281 7f0c90846c40 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:23:57.245305 I | rook-ceph-mon2: 2017-07-11 13:23:57.245296 7f0c90846c40 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:23:57.245319 I | rook-ceph-mon2: 2017-07-11 13:23:57.245310 7f0c90846c40 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:23:57.245352 I | rook-ceph-mon2: 2017-07-11 13:23:57.245324 7f0c90846c40 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:23:57.245366 I | rook-ceph-mon2: 2017-07-11 13:23:57.245357 7f0c90846c40 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:23:57.245382 I | rook-ceph-mon2: 2017-07-11 13:23:57.245373 7f0c90846c40 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:23:57.246163 I | rook-ceph-mon2: 2017-07-11 13:23:57.246142 7f0c90846c40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001
- 2017-07-11 13:23:57.246173 I | rook-ceph-mon2:
- 2017-07-11 13:23:57.246355 I | rook-ceph-mon2: 2017-07-11 13:23:57.246328 7f0c90846c40 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:23:57.246362 I | rook-ceph-mon2:
- 2017-07-11 13:23:57.246404 I | rook-ceph-mon2: 2017-07-11 13:23:57.246383 7f0c90846c40 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:23:57.246442 I | rook-ceph-mon2: 2017-07-11 13:23:57.246431 7f0c90846c40 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:23:57.246465 I | rook-ceph-mon2: 2017-07-11 13:23:57.246448 7f0c90846c40 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:23:57.246480 I | rook-ceph-mon2: 2017-07-11 13:23:57.246471 7f0c90846c40 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:23:57.246494 I | rook-ceph-mon2: 2017-07-11 13:23:57.246485 7f0c90846c40 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:23:57.246509 I | rook-ceph-mon2: 2017-07-11 13:23:57.246499 7f0c90846c40 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:23:57.246567 I | rook-ceph-mon2: 2017-07-11 13:23:57.246539 7f0c90846c40 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d6fcf60140)
- 2017-07-11 13:23:57.246572 I | rook-ceph-mon2: cache_index_and_filter_blocks: 0
- 2017-07-11 13:23:57.246575 I | rook-ceph-mon2: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:23:57.246577 I | rook-ceph-mon2: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:23:57.246580 I | rook-ceph-mon2: index_type: 0
- 2017-07-11 13:23:57.246582 I | rook-ceph-mon2: hash_index_allow_collision: 1
- 2017-07-11 13:23:57.246584 I | rook-ceph-mon2: checksum: 1
- 2017-07-11 13:23:57.246587 I | rook-ceph-mon2: no_block_cache: 0
- 2017-07-11 13:23:57.246590 I | rook-ceph-mon2: block_cache: 0x55d6fcf92a10
- 2017-07-11 13:23:57.246592 I | rook-ceph-mon2: block_cache_name: LRUCache
- 2017-07-11 13:23:57.246594 I | rook-ceph-mon2: block_cache_options:
- 2017-07-11 13:23:57.246596 I | rook-ceph-mon2: capacity : 107374182
- 2017-07-11 13:23:57.246599 I | rook-ceph-mon2: num_shard_bits : 4
- 2017-07-11 13:23:57.246605 I | rook-ceph-mon2: strict_capacity_limit : 0
- 2017-07-11 13:23:57.246607 I | rook-ceph-mon2: high_pri_pool_ratio: 0.000
- 2017-07-11 13:23:57.246610 I | rook-ceph-mon2: block_cache_compressed: (nil)
- 2017-07-11 13:23:57.246614 I | rook-ceph-mon2: persistent_cache: (nil)
- 2017-07-11 13:23:57.246638 I | rook-ceph-mon2: block_size: 4096
- 2017-07-11 13:23:57.246640 I | rook-ceph-mon2: block_size_deviation: 10
- 2017-07-11 13:23:57.246643 I | rook-ceph-mon2: block_restart_interval: 16
- 2017-07-11 13:23:57.246645 I | rook-ceph-mon2: index_block_restart_interval: 1
- 2017-07-11 13:23:57.246647 I | rook-ceph-mon2: filter_policy: nullptr
- 2017-07-11 13:23:57.246650 I | rook-ceph-mon2: whole_key_filtering: 1
- 2017-07-11 13:23:57.246652 I | rook-ceph-mon2: format_version: 2
- 2017-07-11 13:23:57.246654 I | rook-ceph-mon2:
- 2017-07-11 13:23:57.246673 I | rook-ceph-mon2: 2017-07-11 13:23:57.246660 7f0c90846c40 4 rocksdb: Options.write_buffer_size: 33554432
- 2017-07-11 13:23:57.246688 I | rook-ceph-mon2: 2017-07-11 13:23:57.246678 7f0c90846c40 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:23:57.246724 I | rook-ceph-mon2: 2017-07-11 13:23:57.246694 7f0c90846c40 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:23:57.246739 I | rook-ceph-mon2: 2017-07-11 13:23:57.246729 7f0c90846c40 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:23:57.246753 I | rook-ceph-mon2: 2017-07-11 13:23:57.246744 7f0c90846c40 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:23:57.246766 I | rook-ceph-mon2: 2017-07-11 13:23:57.246758 7f0c90846c40 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:23:57.246794 I | rook-ceph-mon2: 2017-07-11 13:23:57.246780 7f0c90846c40 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:23:57.246813 I | rook-ceph-mon2: 2017-07-11 13:23:57.246803 7f0c90846c40 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:23:57.246827 I | rook-ceph-mon2: 2017-07-11 13:23:57.246818 7f0c90846c40 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:23:57.246858 I | rook-ceph-mon2: 2017-07-11 13:23:57.246838 7f0c90846c40 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:23:57.246875 I | rook-ceph-mon2: 2017-07-11 13:23:57.246863 7f0c90846c40 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:23:57.246892 I | rook-ceph-mon2: 2017-07-11 13:23:57.246883 7f0c90846c40 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:23:57.246905 I | rook-ceph-mon2: 2017-07-11 13:23:57.246897 7f0c90846c40 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:23:57.246918 I | rook-ceph-mon2: 2017-07-11 13:23:57.246910 7f0c90846c40 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:23:57.246931 I | rook-ceph-mon2: 2017-07-11 13:23:57.246923 7f0c90846c40 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:23:57.246944 I | rook-ceph-mon2: 2017-07-11 13:23:57.246936 7f0c90846c40 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:23:57.246967 I | rook-ceph-mon2: 2017-07-11 13:23:57.246958 7f0c90846c40 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:23:57.246981 I | rook-ceph-mon2: 2017-07-11 13:23:57.246972 7f0c90846c40 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:23:57.246996 I | rook-ceph-mon2: 2017-07-11 13:23:57.246987 7f0c90846c40 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:23:57.247008 I | rook-ceph-mon2: 2017-07-11 13:23:57.247000 7f0c90846c40 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:23:57.247023 I | rook-ceph-mon2: 2017-07-11 13:23:57.247013 7f0c90846c40 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:23:57.247044 I | rook-ceph-mon2: 2017-07-11 13:23:57.247034 7f0c90846c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:23:57.247057 I | rook-ceph-mon2: 2017-07-11 13:23:57.247049 7f0c90846c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:23:57.247070 I | rook-ceph-mon2: 2017-07-11 13:23:57.247062 7f0c90846c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:23:57.247083 I | rook-ceph-mon2: 2017-07-11 13:23:57.247075 7f0c90846c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:23:57.247096 I | rook-ceph-mon2: 2017-07-11 13:23:57.247088 7f0c90846c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:23:57.247116 I | rook-ceph-mon2: 2017-07-11 13:23:57.247100 7f0c90846c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:23:57.247129 I | rook-ceph-mon2: 2017-07-11 13:23:57.247121 7f0c90846c40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:23:57.247142 I | rook-ceph-mon2: 2017-07-11 13:23:57.247134 7f0c90846c40 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:23:57.247155 I | rook-ceph-mon2: 2017-07-11 13:23:57.247147 7f0c90846c40 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:23:57.247168 I | rook-ceph-mon2: 2017-07-11 13:23:57.247160 7f0c90846c40 4 rocksdb: Options.arena_block_size: 4194304
- 2017-07-11 13:23:57.247189 I | rook-ceph-mon2: 2017-07-11 13:23:57.247173 7f0c90846c40 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:23:57.247203 I | rook-ceph-mon2: 2017-07-11 13:23:57.247195 7f0c90846c40 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:23:57.247217 I | rook-ceph-mon2: 2017-07-11 13:23:57.247208 7f0c90846c40 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:23:57.247229 I | rook-ceph-mon2: 2017-07-11 13:23:57.247221 7f0c90846c40 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:23:57.247244 I | rook-ceph-mon2: 2017-07-11 13:23:57.247234 7f0c90846c40 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:23:57.247265 I | rook-ceph-mon2: 2017-07-11 13:23:57.247249 7f0c90846c40 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:23:57.247278 I | rook-ceph-mon2: 2017-07-11 13:23:57.247270 7f0c90846c40 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:23:57.247291 I | rook-ceph-mon2: 2017-07-11 13:23:57.247283 7f0c90846c40 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:23:57.247304 I | rook-ceph-mon2: 2017-07-11 13:23:57.247296 7f0c90846c40 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:23:57.247317 I | rook-ceph-mon2: 2017-07-11 13:23:57.247309 7f0c90846c40 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:23:57.247337 I | rook-ceph-mon2: 2017-07-11 13:23:57.247322 7f0c90846c40 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:23:57.247352 I | rook-ceph-mon2: 2017-07-11 13:23:57.247343 7f0c90846c40 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:23:57.247365 I | rook-ceph-mon2: 2017-07-11 13:23:57.247357 7f0c90846c40 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:23:57.247378 I | rook-ceph-mon2: 2017-07-11 13:23:57.247370 7f0c90846c40 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:23:57.247391 I | rook-ceph-mon2: 2017-07-11 13:23:57.247382 7f0c90846c40 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:23:57.247408 I | rook-ceph-mon2: 2017-07-11 13:23:57.247395 7f0c90846c40 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:23:57.247425 I | rook-ceph-mon2: 2017-07-11 13:23:57.247416 7f0c90846c40 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:23:57.247438 I | rook-ceph-mon2: 2017-07-11 13:23:57.247430 7f0c90846c40 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:23:57.247454 I | rook-ceph-mon2: 2017-07-11 13:23:57.247443 7f0c90846c40 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:23:57.247467 I | rook-ceph-mon2: 2017-07-11 13:23:57.247459 7f0c90846c40 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:23:57.247480 I | rook-ceph-mon2: 2017-07-11 13:23:57.247472 7f0c90846c40 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:23:57.247500 I | rook-ceph-mon2: 2017-07-11 13:23:57.247491 7f0c90846c40 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:23:57.247514 I | rook-ceph-mon2: 2017-07-11 13:23:57.247506 7f0c90846c40 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:23:57.252897 I | rook-ceph-mon2: 2017-07-11 13:23:57.252868 7f0c90846c40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:23:57.252908 I | rook-ceph-mon2:
- 2017-07-11 13:23:57.252935 I | rook-ceph-mon2: 2017-07-11 13:23:57.252921 7f0c90846c40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 0
- 2017-07-11 13:23:57.252940 I | rook-ceph-mon2:
- 2017-07-11 13:23:57.253018 I | rook-ceph-mon2: 2017-07-11 13:23:57.253002 7f0c90846c40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779437252982, "job": 1, "event": "recovery_started", "log_files": [3]}
- 2017-07-11 13:23:57.253044 I | rook-ceph-mon2: 2017-07-11 13:23:57.253032 7f0c90846c40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #3 mode 2
- 2017-07-11 13:23:57.303698 I | rook-ceph-mon2: 2017-07-11 13:23:57.303668 7f0c90846c40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779437303660, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1764, "table_properties": {"data_size": 929, "index_size": 28, "filter_size": 0, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 806, "raw_average_value_size": 161, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:23:57.303757 I | rook-ceph-mon2: 2017-07-11 13:23:57.303743 7f0c90846c40 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 5
- 2017-07-11 13:23:57.303762 I | rook-ceph-mon2:
- 2017-07-11 13:23:57.428159 I | rook-ceph-mon2: 2017-07-11 13:23:57.428108 7f0c90846c40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779437428103, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:23:57.507709 I | rook-ceph-mon2: 2017-07-11 13:23:57.507671 7f0c90846c40 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55d6fd22e000
- 2017-07-11 13:23:57.508453 I | rook-ceph-mon2: 2017-07-11 13:23:57.508428 7f0c90846c40 0 starting mon.rook-ceph-mon2 rank 2 at 10.233.124.3:6790/0 mon_data /var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:23:57.508588 I | rook-ceph-mon2: starting mon.rook-ceph-mon2 rank 2 at 10.233.124.3:6790/0 mon_data /var/lib/rook/rook-ceph-mon2/mon.rook-ceph-mon2 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:23:57.509601 I | rook-ceph-mon2: 2017-07-11 13:23:57.509582 7f0c90846c40 0 mon.rook-ceph-mon2@-1(probing) e0 my rank is now 2 (was -1)
- 2017-07-11 13:23:57.512567 I | rook-ceph-mon2: 2017-07-11 13:23:57.512473 7f0c84e17700 0 mon.rook-ceph-mon2@2(probing) e2 my rank is now -1 (was 2)
- 2017-07-11 13:23:57.516424 I | rook-ceph-mon2: 2017-07-11 13:23:57.516360 7f0c81e11700 0 -- 10.233.124.3:6790/0 >> 10.233.76.3:6790/0 conn(0x55d6fd36f800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=5 cs=1 l=0).process missed message? skipped from seq 0 to 1817399251
- 2017-07-11 13:24:01.513849 I | rook-ceph-mon2: 2017-07-11 13:24:01.513801 7f0c84e17700 0 mon.rook-ceph-mon2@-1(probing) e3 my rank is now 2 (was -1)
- 2017-07-11 13:24:01.517348 I | rook-ceph-mon2: 2017-07-11 13:24:01.517319 7f0c80e0f700 0 -- 10.233.124.3:6790/0 >> 10.233.76.3:6790/0 conn(0x55d6fd372800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6 cs=1 l=0).process missed message? skipped from seq 0 to 457788829
- 2017-07-11 13:24:01.517478 I | rook-ceph-mon2: 2017-07-11 13:24:01.517462 7f0c84e17700 0 log_channel(cluster) log [INF] : mon.rook-ceph-mon2 calling new monitor election
- 2017-07-11 13:24:01.537422 I | rook-ceph-mon2: 2017-07-11 13:24:01.537291 7f0c81610700 0 -- 10.233.124.3:6790/0 >> 10.233.99.4:6790/0 conn(0x55d6fd380800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=9 cs=1 l=0).process missed message? skipped from seq 0 to 119657042
- 2017-07-11 13:24:05.440239 I | rook-ceph-mon2: 2017-07-11 13:24:05.440186 7f0c84e17700 1 mon.rook-ceph-mon2@2(peon).paxosservice(pgmap 1..2) refresh upgraded, format 0 -> 1
- 2017-07-11 13:24:05.440503 I | rook-ceph-mon2: 2017-07-11 13:24:05.440469 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon).mds e1 print_map
- 2017-07-11 13:24:05.440539 I | rook-ceph-mon2: e1
- 2017-07-11 13:24:05.440553 I | rook-ceph-mon2: enable_multiple, ever_enabled_multiple: 0,0
- 2017-07-11 13:24:05.440569 I | rook-ceph-mon2: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=file layout v2}
- 2017-07-11 13:24:05.440581 I | rook-ceph-mon2: legacy client fscid: -1
- 2017-07-11 13:24:05.440591 I | rook-ceph-mon2:
- 2017-07-11 13:24:05.440614 I | rook-ceph-mon2: No filesystems configured
- 2017-07-11 13:24:05.440626 I | rook-ceph-mon2:
- 2017-07-11 13:24:05.471114 I | rook-ceph-mon2: 2017-07-11 13:24:05.471087 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon).osd e1 crush map has features 288514051259236352, adjusting msgr requires
- 2017-07-11 13:24:05.471179 I | rook-ceph-mon2: 2017-07-11 13:24:05.471163 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon).osd e1 crush map has features 288514051259236352, adjusting msgr requires
- 2017-07-11 13:24:05.471255 I | rook-ceph-mon2: 2017-07-11 13:24:05.471211 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon).osd e1 crush map has features 1009089991638532096, adjusting msgr requires
- 2017-07-11 13:24:05.471286 I | rook-ceph-mon2: 2017-07-11 13:24:05.471273 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon).osd e1 crush map has features 288514051259236352, adjusting msgr requires
- 2017-07-11 13:24:05.471948 I | rook-ceph-mon2: 2017-07-11 13:23:45.483848 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2 : cluster [INF] mon.rook-ceph-mon0@0 won leader election with quorum 0
- 2017-07-11 13:24:05.471983 I | rook-ceph-mon2: 2017-07-11 13:23:45.499259 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 3 : cluster [INF] monmap e1: 1 mons at {rook-ceph-mon0=10.233.76.3:6790/0}
- 2017-07-11 13:24:05.471998 I | rook-ceph-mon2: 2017-07-11 13:23:45.610357 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 4 : cluster [INF] pgmap 0 pgs: ; 0 bytes data, 0 kB used, 0 kB / 0 kB avail
- 2017-07-11 13:24:05.472010 I | rook-ceph-mon2: 2017-07-11 13:23:45.688565 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 5 : cluster [INF] fsmap
- 2017-07-11 13:24:05.472021 I | rook-ceph-mon2: 2017-07-11 13:23:45.704448 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 6 : cluster [INF] osdmap e1: 0 total, 0 up, 0 in
- 2017-07-11 13:24:05.472062 I | rook-ceph-mon2: 2017-07-11 13:23:45.705260 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 7 : cluster [INF] mgrmap e1: no daemons active
- 2017-07-11 13:24:05.472120 I | rook-ceph-mon2: 2017-07-11 13:24:05.472102 7f0c84e17700 1 mon.rook-ceph-mon2@2(peon).paxosservice(auth 1..1) refresh upgraded, format 0 -> 2
- 2017-07-11 13:24:05.938399 I | rook-ceph-mon2: 2017-07-11 13:23:56.211454 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 1 : cluster [INF] mon.rook-ceph-mon1 calling new monitor election
- 2017-07-11 13:24:05.938417 I | rook-ceph-mon2: 2017-07-11 13:24:00.108593 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 15 : cluster [INF] mon.rook-ceph-mon0 calling new monitor election
- 2017-07-11 13:24:05.938420 I | rook-ceph-mon2: 2017-07-11 13:24:05.263887 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 16 : cluster [INF] mon.rook-ceph-mon0@0 won leader election with quorum 0,1,2
- 2017-07-11 13:24:05.938423 I | rook-ceph-mon2: 2017-07-11 13:24:05.280481 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 17 : cluster [INF] HEALTH_ERR; no osds
- 2017-07-11 13:24:07.110284 I | rook-ceph-mon2: 2017-07-11 13:24:00.170561 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 2 : cluster [INF] mon.rook-ceph-mon1 calling new monitor election
- 2017-07-11 13:24:07.110356 I | rook-ceph-mon2: 2017-07-11 13:24:01.517487 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 1 : cluster [INF] mon.rook-ceph-mon2 calling new monitor election
- 2017-07-11 13:24:07.110376 I | rook-ceph-mon2: 2017-07-11 13:24:05.448242 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 18 : cluster [INF] monmap e3: 3 mons at {rook-ceph-mon0=10.233.76.3:6790/0,rook-ceph-mon1=10.233.99.4:6790/0,rook-ceph-mon2=10.233.124.3:6790/0}
- 2017-07-11 13:24:07.110389 I | rook-ceph-mon2: 2017-07-11 13:24:05.448482 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 19 : cluster [INF] fsmap
- 2017-07-11 13:24:07.110414 I | rook-ceph-mon2: 2017-07-11 13:24:05.448744 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 20 : cluster [INF] osdmap e1: 0 total, 0 up, 0 in
- 2017-07-11 13:24:07.110426 I | rook-ceph-mon2: 2017-07-11 13:24:05.449703 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 21 : cluster [INF] mgrmap e1: no daemons active
- 2017-07-11 13:24:07.309102 I | rook-ceph-mon2: 2017-07-11 13:24:07.309058 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon).osd e2 crush map has features 283675107524608, adjusting msgr requires
- 2017-07-11 13:24:07.309197 I | rook-ceph-mon2: 2017-07-11 13:24:07.309181 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon).osd e2 crush map has features 283675107524608, adjusting msgr requires
- 2017-07-11 13:24:07.309278 I | rook-ceph-mon2: 2017-07-11 13:24:07.309265 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon).osd e2 crush map has features 720859615486820352, adjusting msgr requires
- 2017-07-11 13:24:07.309310 I | rook-ceph-mon2: 2017-07-11 13:24:07.309298 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon).osd e2 crush map has features 283675107524608, adjusting msgr requires
- 2017-07-11 13:24:08.185234 I | rook-ceph-mon2: 2017-07-11 13:24:07.012032 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 23 : audit [INF] from='client.? 10.233.99.0:0/3047177237' entity='client.admin' cmd=[{"profile": "firefly", "prefix": "osd crush tunables", "format": "plain"}]: dispatch
- 2017-07-11 13:24:08.185334 I | rook-ceph-mon2: 2017-07-11 13:24:07.302815 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 24 : audit [INF] from='client.? 10.233.99.0:0/3047177237' entity='client.admin' cmd='[{"profile": "firefly", "prefix": "osd crush tunables", "format": "plain"}]': finished
- 2017-07-11 13:24:08.185389 I | rook-ceph-mon2: 2017-07-11 13:24:07.303065 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 25 : cluster [INF] osdmap e2: 0 total, 0 up, 0 in
- 2017-07-11 13:24:09.353947 I | rook-ceph-mon2: 2017-07-11 13:24:08.278326 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 3 : audit [INF] from='client.? 10.233.99.2:0/1924409' entity='client.admin' cmd=[{"prefix": "osd setcrushmap", "format": "json"}]: dispatch
- 2017-07-11 13:24:09.353966 I | rook-ceph-mon2: 2017-07-11 13:24:08.339350 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 26 : audit [INF] from='client.4102 -' entity='client.admin' cmd=[{"prefix": "osd setcrushmap", "format": "json"}]: dispatch
- 2017-07-11 13:24:09.646405 I | rook-ceph-mon2: 2017-07-11 13:24:09.646328 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon).osd e3 crush map has features 2200130813952, adjusting msgr requires
- 2017-07-11 13:24:09.646493 I | rook-ceph-mon2: 2017-07-11 13:24:09.646477 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon).osd e3 crush map has features 2200130813952, adjusting msgr requires
- 2017-07-11 13:24:09.646547 I | rook-ceph-mon2: 2017-07-11 13:24:09.646515 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon).osd e3 crush map has features 720578140510109696, adjusting msgr requires
- 2017-07-11 13:24:09.646588 I | rook-ceph-mon2: 2017-07-11 13:24:09.646576 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon).osd e3 crush map has features 2200130813952, adjusting msgr requires
- 2017-07-11 13:24:10.628854 I | rook-ceph-mon2: 2017-07-11 13:24:09.590922 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 27 : audit [INF] from='client.4102 -' entity='client.admin' cmd='[{"prefix": "osd setcrushmap", "format": "json"}]': finished
- 2017-07-11 13:24:10.629103 I | rook-ceph-mon2: 2017-07-11 13:24:09.591245 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 28 : cluster [INF] osdmap e3: 0 total, 0 up, 0 in
- 2017-07-11 13:24:10.844419 I | rook-ceph-mon2: 2017-07-11 13:24:10.844379 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"entity": "mgr.rook-ceph-mgr0", "prefix": "auth get-or-create-key", "caps": ["mon", "allow *"], "format": "json"} v 0) v1
- 2017-07-11 13:24:10.844631 I | rook-ceph-mon2: 2017-07-11 13:24:10.844526 7f0c84e17700 0 log_channel(audit) log [INF] : from='client.? 10.233.99.0:0/1815105145' entity='client.admin' cmd=[{"entity": "mgr.rook-ceph-mgr0", "prefix": "auth get-or-create-key", "caps": ["mon", "allow *"], "format": "json"}]: dispatch
- 2017-07-11 13:24:11.866838 I | rook-ceph-mon2: 2017-07-11 13:24:10.844669 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 2 : audit [INF] from='client.? 10.233.99.0:0/1815105145' entity='client.admin' cmd=[{"entity": "mgr.rook-ceph-mgr0", "prefix": "auth get-or-create-key", "caps": ["mon", "allow *"], "format": "json"}]: dispatch
- 2017-07-11 13:24:11.866941 I | rook-ceph-mon2: 2017-07-11 13:24:10.897838 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 29 : audit [INF] from='client.4103 -' entity='client.admin' cmd=[{"entity": "mgr.rook-ceph-mgr0", "prefix": "auth get-or-create-key", "caps": ["mon", "allow *"], "format": "json"}]: dispatch
- 2017-07-11 13:24:11.867296 I | rook-ceph-mon2: 2017-07-11 13:24:11.020381 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 30 : audit [INF] from='client.4103 -' entity='client.admin' cmd='[{"entity": "mgr.rook-ceph-mgr0", "prefix": "auth get-or-create-key", "caps": ["mon", "allow *"], "format": "json"}]': finished
- 2017-07-11 13:24:13.877939 I | rook-ceph-mon2: 2017-07-11 13:24:13.364737 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 31 : audit [INF] from='client.4105 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 13:24:13.877965 I | rook-ceph-mon2: 2017-07-11 13:24:13.371310 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 4 : audit [INF] from='client.? 10.233.99.0:0/329149194' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 13:24:15.091708 I | rook-ceph-mon2: 2017-07-11 13:24:13.703951 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 32 : audit [INF] from='client.4105 -' entity='client.admin' cmd='[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]': finished
- 2017-07-11 13:24:18.018367 I | rook-ceph-mon2: 2017-07-11 13:24:18.018313 7f0c84e17700 0 log_channel(cluster) log [WRN] : message from mon.0 was stamped 0.073977s in the future, clocks not synchronized
- 2017-07-11 13:24:18.985867 I | rook-ceph-mon2: 2017-07-11 13:24:18.018558 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 3 : cluster [WRN] message from mon.0 was stamped 0.073977s in the future, clocks not synchronized
- 2017-07-11 13:24:20.363193 I | rook-ceph-mon2: 2017-07-11 13:24:20.363156 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd create", "uuid": "87446daf-adb9-4330-b384-dc39dca0e7d4", "format": "json"} v 0) v1
- 2017-07-11 13:24:20.363432 I | rook-ceph-mon2: 2017-07-11 13:24:20.363415 7f0c84e17700 0 log_channel(audit) log [INF] : from='client.? 10.233.72.0:0/3023866456' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "87446daf-adb9-4330-b384-dc39dca0e7d4", "format": "json"}]: dispatch
- 2017-07-11 13:24:20.671236 I | rook-ceph-mon2: 2017-07-11 13:24:20.363489 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 4 : audit [INF] from='client.? 10.233.72.0:0/3023866456' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "87446daf-adb9-4330-b384-dc39dca0e7d4", "format": "json"}]: dispatch
- 2017-07-11 13:24:20.672665 I | rook-ceph-mon2: 2017-07-11 13:24:20.426137 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 33 : audit [INF] from='client.4106 -' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "87446daf-adb9-4330-b384-dc39dca0e7d4", "format": "json"}]: dispatch
- 2017-07-11 13:24:20.672707 I | rook-ceph-mon2: 2017-07-11 13:24:20.460061 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 34 : audit [INF] from='client.? 10.233.76.4:0/3208763407' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "73875ada-81e5-484d-a5cb-4fd39d3ea97f", "format": "json"}]: dispatch
- 2017-07-11 13:24:21.844814 I | rook-ceph-mon2: 2017-07-11 13:24:21.844778 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd create", "uuid": "7fa3db3b-e42c-44ec-ac2c-d78a63760e1b", "format": "json"} v 0) v1
- 2017-07-11 13:24:21.845044 I | rook-ceph-mon2: 2017-07-11 13:24:21.845026 7f0c84e17700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.4:0/2258242595' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "7fa3db3b-e42c-44ec-ac2c-d78a63760e1b", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.213113 I | rook-ceph-mon2: 2017-07-11 13:24:20.862019 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 35 : audit [INF] from='client.4106 -' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "87446daf-adb9-4330-b384-dc39dca0e7d4", "format": "json"}]': finished
- 2017-07-11 13:24:22.213239 I | rook-ceph-mon2: 2017-07-11 13:24:20.862058 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 36 : audit [INF] from='client.? 10.233.76.4:0/3208763407' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "73875ada-81e5-484d-a5cb-4fd39d3ea97f", "format": "json"}]': finished
- 2017-07-11 13:24:22.213317 I | rook-ceph-mon2: 2017-07-11 13:24:21.059934 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 38 : audit [INF] from='client.? 10.233.69.0:0/2353069969' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "0623e5ff-56df-42b2-b682-76e1b77cba81", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.213352 I | rook-ceph-mon2: 2017-07-11 13:24:21.332571 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 39 : audit [INF] from='client.? 10.233.86.0:0/4247247533' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "cd112926-e214-4caa-9506-6797fb79af42", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.213366 I | rook-ceph-mon2: 2017-07-11 13:24:21.845081 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 5 : audit [INF] from='client.? 10.233.124.4:0/2258242595' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "7fa3db3b-e42c-44ec-ac2c-d78a63760e1b", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.213422 I | rook-ceph-mon2: 2017-07-11 13:24:20.862083 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 37 : cluster [INF] osdmap e4: 2 total, 0 up, 0 in
- 2017-07-11 13:24:22.714589 I | rook-ceph-mon2: 2017-07-11 13:24:22.714547 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon getmap", "format": "json"} v 0) v1
- 2017-07-11 13:24:22.714784 I | rook-ceph-mon2: 2017-07-11 13:24:22.714696 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.86.0:0/1541154081' entity='client.admin' cmd=[{"prefix": "mon getmap", "format": "json"}]: dispatch
- 2017-07-11 13:24:22.743062 I | rook-ceph-mon2: 2017-07-11 13:24:22.743031 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mds metadata"} v 0) v1
- 2017-07-11 13:24:22.743172 I | rook-ceph-mon2: 2017-07-11 13:24:22.743156 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "mds metadata"}]: dispatch
- 2017-07-11 13:24:22.743667 I | rook-ceph-mon2: 2017-07-11 13:24:22.743640 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd metadata"} v 0) v1
- 2017-07-11 13:24:22.743835 I | rook-ceph-mon2: 2017-07-11 13:24:22.743779 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "osd metadata"}]: dispatch
- 2017-07-11 13:24:22.744329 I | rook-ceph-mon2: 2017-07-11 13:24:22.744312 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon metadata"} v 0) v1
- 2017-07-11 13:24:22.744399 I | rook-ceph-mon2: 2017-07-11 13:24:22.744380 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.5:0/2802472275' entity='mgr.rook-ceph-mgr0' cmd=[{"prefix": "mon metadata"}]: dispatch
- 2017-07-11 13:24:22.744922 I | rook-ceph-mon2: 2017-07-11 13:24:22.744905 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon getmap", "format": "json"} v 0) v1
- 2017-07-11 13:24:22.744995 I | rook-ceph-mon2: 2017-07-11 13:24:22.744979 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.69.0:0/4036361764' entity='client.admin' cmd=[{"prefix": "mon getmap", "format": "json"}]: dispatch
- 2017-07-11 13:24:23.133258 I | rook-ceph-mon2: 2017-07-11 13:24:21.846875 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 41 : audit [INF] from='client.4112 -' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "7fa3db3b-e42c-44ec-ac2c-d78a63760e1b", "format": "json"}]: dispatch
- 2017-07-11 13:24:23.133372 I | rook-ceph-mon2: 2017-07-11 13:24:22.307936 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 42 : audit [INF] from='client.? 10.233.69.0:0/2353069969' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "0623e5ff-56df-42b2-b682-76e1b77cba81", "format": "json"}]': finished
- 2017-07-11 13:24:23.133402 I | rook-ceph-mon2: 2017-07-11 13:24:22.308241 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 43 : audit [INF] from='client.? 10.233.86.0:0/4247247533' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "cd112926-e214-4caa-9506-6797fb79af42", "format": "json"}]': finished
- 2017-07-11 13:24:23.133414 I | rook-ceph-mon2: 2017-07-11 13:24:22.308455 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 44 : audit [INF] from='client.4112 -' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "7fa3db3b-e42c-44ec-ac2c-d78a63760e1b", "format": "json"}]': finished
- 2017-07-11 13:24:23.133461 I | rook-ceph-mon2: 2017-07-11 13:24:22.895280 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 47 : audit [INF] from='client.4111 -' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "9771b2a8-0591-4ce0-ba50-846d5c052724", "format": "json"}]: dispatch
- 2017-07-11 13:24:23.133474 I | rook-ceph-mon2: 2017-07-11 13:24:22.901821 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 6 : audit [INF] from='client.? 10.233.99.6:0/1526158553' entity='client.admin' cmd=[{"prefix": "osd create", "uuid": "9771b2a8-0591-4ce0-ba50-846d5c052724", "format": "json"}]: dispatch
- 2017-07-11 13:24:23.133520 I | rook-ceph-mon2: 2017-07-11 13:24:22.309218 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 45 : cluster [INF] osdmap e5: 5 total, 0 up, 0 in
- 2017-07-11 13:24:23.133535 I | rook-ceph-mon2: 2017-07-11 13:24:22.738947 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 46 : cluster [INF] mgrmap e2: rook-ceph-mgr0(active, starting)
- 2017-07-11 13:24:23.373609 I | rook-ceph-mon2: 2017-07-11 13:24:23.373579 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"entity": "osd.1", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"} v 0) v1
- 2017-07-11 13:24:23.373718 I | rook-ceph-mon2: 2017-07-11 13:24:23.373704 7f0c84e17700 0 log_channel(audit) log [INF] : from='client.? 10.233.76.0:0/1251607715' entity='client.admin' cmd=[{"entity": "osd.1", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:24.725668 I | rook-ceph-mon2: 2017-07-11 13:24:23.247532 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 49 : audit [INF] from='client.? 10.233.72.0:0/3883659066' entity='client.admin' cmd=[{"entity": "osd.0", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:24.725752 I | rook-ceph-mon2: 2017-07-11 13:24:23.373766 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 11 : audit [INF] from='client.? 10.233.76.0:0/1251607715' entity='client.admin' cmd=[{"entity": "osd.1", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:24.725771 I | rook-ceph-mon2: 2017-07-11 13:24:23.376712 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 50 : audit [INF] from='client.? 10.233.72.0:0/3883659066' entity='client.admin' cmd='[{"entity": "osd.0", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:24.725790 I | rook-ceph-mon2: 2017-07-11 13:24:23.447026 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 51 : audit [INF] from='client.4127 -' entity='client.admin' cmd=[{"entity": "osd.1", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:24.725832 I | rook-ceph-mon2: 2017-07-11 13:24:23.624355 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 52 : audit [INF] from='client.4127 -' entity='client.admin' cmd='[{"entity": "osd.1", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:24.725876 I | rook-ceph-mon2: 2017-07-11 13:24:23.826405 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 53 : audit [INF] from='client.? 10.233.72.0:0/3273515169' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 0, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:24.725911 I | rook-ceph-mon2: 2017-07-11 13:24:24.097956 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 54 : audit [INF] from='client.4111 -' entity='client.admin' cmd='[{"prefix": "osd create", "uuid": "9771b2a8-0591-4ce0-ba50-846d5c052724", "format": "json"}]': finished
- 2017-07-11 13:24:24.725948 I | rook-ceph-mon2: 2017-07-11 13:24:24.098133 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 55 : cluster [INF] osdmap e6: 6 total, 0 up, 0 in
- 2017-07-11 13:24:26.216548 I | rook-ceph-mon2: 2017-07-11 13:24:24.414311 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 14 : audit [INF] from='client.? 10.233.76.0:0/3770583375' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 1, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:26.216658 I | rook-ceph-mon2: 2017-07-11 13:24:24.653786 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 56 : audit [INF] from='client.4117 -' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 1, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:26.216691 I | rook-ceph-mon2: 2017-07-11 13:24:24.854871 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 15 : audit [INF] from='client.? 10.233.86.0:0/2946127837' entity='client.admin' cmd=[{"entity": "osd.3", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:26.216717 I | rook-ceph-mon2: 2017-07-11 13:24:25.064304 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 57 : audit [INF] from='client.4120 -' entity='client.admin' cmd=[{"entity": "osd.3", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:26.216731 I | rook-ceph-mon2: 2017-07-11 13:24:25.168891 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 58 : audit [INF] from='client.4120 -' entity='client.admin' cmd='[{"entity": "osd.3", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:26.216743 I | rook-ceph-mon2: 2017-07-11 13:24:25.427547 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 59 : audit [INF] from='client.? 10.233.72.0:0/3273515169' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 0, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:26.216769 I | rook-ceph-mon2: 2017-07-11 13:24:25.427850 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 60 : audit [INF] from='client.4117 -' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 1, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:26.216804 I | rook-ceph-mon2: 2017-07-11 13:24:25.428027 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 61 : cluster [INF] osdmap e7: 6 total, 0 up, 0 in
- 2017-07-11 13:24:29.055176 I | rook-ceph-mon2: 2017-07-11 13:24:25.686214 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 23 : audit [INF] from='client.? 10.233.86.0:0/4142784513' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 3, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:29.061153 I | rook-ceph-mon2: 2017-07-11 13:24:25.752141 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 62 : audit [INF] from='client.4129 -' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 3, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:29.061255 I | rook-ceph-mon2: 2017-07-11 13:24:25.864248 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 63 : audit [INF] from='osd.0 10.233.72.0:6800/180' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0946, "args": ["host=master-1", "root=default"]}]: dispatch
- 2017-07-11 13:24:29.061295 I | rook-ceph-mon2: 2017-07-11 13:24:25.968277 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 65 : audit [INF] from='client.? 10.233.69.0:0/1725450048' entity='client.admin' cmd=[{"entity": "osd.2", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:29.061332 I | rook-ceph-mon2: 2017-07-11 13:24:26.155792 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 66 : audit [INF] from='osd.1 10.233.76.4:6800/178' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0946, "args": ["host=minion-0", "root=default"]}]: dispatch
- 2017-07-11 13:24:29.061390 I | rook-ceph-mon2: 2017-07-11 13:24:26.340949 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 67 : audit [INF] from='client.? 10.233.69.0:0/1725450048' entity='client.admin' cmd='[{"entity": "osd.2", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:29.061403 I | rook-ceph-mon2: 2017-07-11 13:24:26.623119 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 68 : audit [INF] from='client.4129 -' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 3, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:29.061415 I | rook-ceph-mon2: 2017-07-11 13:24:26.623588 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 69 : audit [INF] from='osd.0 10.233.72.0:6800/180' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0946, "args": ["host=master-1", "root=default"]}]': finished
- 2017-07-11 13:24:29.061429 I | rook-ceph-mon2: 2017-07-11 13:24:26.623745 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 70 : audit [INF] from='osd.1 10.233.76.4:6800/178' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0946, "args": ["host=minion-0", "root=default"]}]': finished
- 2017-07-11 13:24:29.061441 I | rook-ceph-mon2: 2017-07-11 13:24:26.832567 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 72 : audit [INF] from='client.? 10.233.69.0:0/1655086740' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 2, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:29.061466 I | rook-ceph-mon2: 2017-07-11 13:24:26.969323 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 73 : audit [INF] from='client.? 10.233.124.0:0/354492821' entity='client.admin' cmd=[{"entity": "osd.4", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:29.061479 I | rook-ceph-mon2: 2017-07-11 13:24:25.896041 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 64 : cluster [INF] mgrmap e3: rook-ceph-mgr0(active)
- 2017-07-11 13:24:29.061492 I | rook-ceph-mon2: 2017-07-11 13:24:26.623871 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 71 : cluster [INF] osdmap e8: 6 total, 0 up, 0 in
- 2017-07-11 13:24:29.504645 I | rook-ceph-mon2: 2017-07-11 13:24:29.504613 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "id": 2, "weight":0.0946, "args": ["host=master-0", "root=default"]} v 0) v1
- 2017-07-11 13:24:29.504899 I | rook-ceph-mon2: 2017-07-11 13:24:29.504883 7f0c84e17700 0 log_channel(audit) log [INF] : from='osd.2 10.233.69.0:6800/178' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0946, "args": ["host=master-0", "root=default"]}]: dispatch
- 2017-07-11 13:24:30.354103 I | rook-ceph-mon2: 2017-07-11 13:24:27.151038 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 74 : audit [INF] from='osd.3 10.233.86.0:6800/178' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0946, "args": ["host=master-2", "root=default"]}]: dispatch
- 2017-07-11 13:24:30.354169 I | rook-ceph-mon2: 2017-07-11 13:24:28.719165 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 75 : audit [INF] from='client.? 10.233.124.0:0/354492821' entity='client.admin' cmd='[{"entity": "osd.4", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:30.354189 I | rook-ceph-mon2: 2017-07-11 13:24:29.044553 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 78 : audit [INF] from='client.? 10.233.69.0:0/1655086740' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 2, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:30.354203 I | rook-ceph-mon2: 2017-07-11 13:24:29.044957 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 79 : audit [INF] from='osd.3 10.233.86.0:6800/178' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0946, "args": ["host=master-2", "root=default"]}]': finished
- 2017-07-11 13:24:30.354231 I | rook-ceph-mon2: 2017-07-11 13:24:29.280696 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 81 : audit [INF] from='client.? 10.233.124.0:0/3518883843' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 4, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:30.354244 I | rook-ceph-mon2: 2017-07-11 13:24:29.504937 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 12 : audit [INF] from='osd.2 10.233.69.0:6800/178' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0946, "args": ["host=master-0", "root=default"]}]: dispatch
- 2017-07-11 13:24:30.354255 I | rook-ceph-mon2: 2017-07-11 13:24:29.568221 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 82 : audit [INF] from='osd.2 -' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0946, "args": ["host=master-0", "root=default"]}]: dispatch
- 2017-07-11 13:24:30.354266 I | rook-ceph-mon2: 2017-07-11 13:24:29.043632 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 76 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:24:30.354278 I | rook-ceph-mon2: 2017-07-11 13:24:29.044061 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 77 : cluster [INF] osd.1 10.233.76.4:6800/178 boot
- 2017-07-11 13:24:30.354305 I | rook-ceph-mon2: 2017-07-11 13:24:29.045183 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 80 : cluster [INF] osdmap e9: 6 total, 2 up, 2 in
- 2017-07-11 13:24:31.439332 I | rook-ceph-mon2: 2017-07-11 13:24:31.439305 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd crush create-or-move", "id": 4, "weight":0.0946, "args": ["host=minion-2", "root=default"]} v 0) v1
- 2017-07-11 13:24:31.439498 I | rook-ceph-mon2: 2017-07-11 13:24:31.439427 7f0c84e17700 0 log_channel(audit) log [INF] : from='osd.4 10.233.124.4:6800/178' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0946, "args": ["host=minion-2", "root=default"]}]: dispatch
- 2017-07-11 13:24:31.801200 I | rook-ceph-mon2: 2017-07-11 13:24:30.375600 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 84 : audit [INF] from='client.? 10.233.124.0:0/3518883843' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 4, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:31.801289 I | rook-ceph-mon2: 2017-07-11 13:24:30.375796 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 85 : audit [INF] from='osd.2 -' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0946, "args": ["host=master-0", "root=default"]}]': finished
- 2017-07-11 13:24:31.801328 I | rook-ceph-mon2: 2017-07-11 13:24:30.375331 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 83 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:24:31.801361 I | rook-ceph-mon2: 2017-07-11 13:24:30.376299 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 86 : cluster [INF] osdmap e10: 6 total, 3 up, 3 in
- 2017-07-11 13:24:31.801375 I | rook-ceph-mon2: 2017-07-11 13:24:30.980570 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 87 : cluster [INF] osdmap e11: 6 total, 3 up, 3 in
- 2017-07-11 13:24:32.614409 I | rook-ceph-mon2: 2017-07-11 13:24:32.614365 7f0c84e17700 0 log_channel(cluster) log [WRN] : message from mon.0 was stamped 0.071119s in the future, clocks not synchronized
- 2017-07-11 13:24:32.898152 I | rook-ceph-mon2: 2017-07-11 13:24:31.439537 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 13 : audit [INF] from='osd.4 10.233.124.4:6800/178' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0946, "args": ["host=minion-2", "root=default"]}]: dispatch
- 2017-07-11 13:24:32.898196 I | rook-ceph-mon2: 2017-07-11 13:24:31.621753 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 88 : audit [INF] from='client.? 10.233.99.0:0/3135454564' entity='client.admin' cmd=[{"entity": "osd.5", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]: dispatch
- 2017-07-11 13:24:32.898200 I | rook-ceph-mon2: 2017-07-11 13:24:31.622367 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 89 : audit [INF] from='osd.4 -' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0946, "args": ["host=minion-2", "root=default"]}]: dispatch
- 2017-07-11 13:24:32.898204 I | rook-ceph-mon2: 2017-07-11 13:24:31.918962 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 90 : audit [INF] from='client.? 10.233.99.0:0/3135454564' entity='client.admin' cmd='[{"entity": "osd.5", "prefix": "auth add", "caps": ["osd", "allow *", "mon", "allow profile osd"], "format": "json"}]': finished
- 2017-07-11 13:24:32.898217 I | rook-ceph-mon2: 2017-07-11 13:24:32.203458 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 92 : audit [INF] from='osd.4 -' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0946, "args": ["host=minion-2", "root=default"]}]': finished
- 2017-07-11 13:24:32.898261 I | rook-ceph-mon2: 2017-07-11 13:24:32.203129 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 91 : cluster [INF] osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:24:32.898266 I | rook-ceph-mon2: 2017-07-11 13:24:32.203799 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 93 : cluster [INF] osdmap e12: 6 total, 4 up, 4 in
- 2017-07-11 13:24:32.898269 I | rook-ceph-mon2: 2017-07-11 13:24:32.614491 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 14 : cluster [WRN] message from mon.0 was stamped 0.071119s in the future, clocks not synchronized
- 2017-07-11 13:24:32.898272 I | rook-ceph-mon2: 2017-07-11 13:24:32.686410 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 94 : cluster [INF] osdmap e13: 6 total, 4 up, 4 in
- 2017-07-11 13:24:34.106667 I | rook-ceph-mon2: 2017-07-11 13:24:32.852788 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 95 : audit [INF] from='client.? 10.233.99.0:0/4057176481' entity='client.admin' cmd=[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 5, "weight": 0.0946, "format": "json"}]: dispatch
- 2017-07-11 13:24:34.106786 I | rook-ceph-mon2: 2017-07-11 13:24:33.849151 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 97 : audit [INF] from='client.? 10.233.99.0:0/4057176481' entity='client.admin' cmd='[{"prefix": "osd crush create-or-move", "args": ["root=default"], "id": 5, "weight": 0.0946, "format": "json"}]': finished
- 2017-07-11 13:24:34.106929 I | rook-ceph-mon2: 2017-07-11 13:24:33.848800 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 96 : cluster [INF] osd.4 10.233.124.4:6800/178 boot
- 2017-07-11 13:24:34.106963 I | rook-ceph-mon2: 2017-07-11 13:24:33.849364 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 98 : cluster [INF] osdmap e14: 6 total, 5 up, 5 in
- 2017-07-11 13:24:36.818681 I | rook-ceph-mon2: 2017-07-11 13:24:36.818647 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:24:36.818920 I | rook-ceph-mon2: 2017-07-11 13:24:36.818881 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2775499332' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:24:36.950438 I | rook-ceph-mon2: 2017-07-11 13:24:35.461554 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 61 : audit [INF] from='osd.5 10.233.99.6:6800/179' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0946, "args": ["host=minion-1", "root=default"]}]: dispatch
- 2017-07-11 13:24:36.950540 I | rook-ceph-mon2: 2017-07-11 13:24:35.505800 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 99 : audit [INF] from='osd.5 -' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0946, "args": ["host=minion-1", "root=default"]}]: dispatch
- 2017-07-11 13:24:37.942165 I | rook-ceph-mon2: 2017-07-11 13:24:36.592631 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 100 : audit [INF] from='osd.5 -' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0946, "args": ["host=minion-1", "root=default"]}]': finished
- 2017-07-11 13:24:37.942412 I | rook-ceph-mon2: 2017-07-11 13:24:36.592944 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 101 : cluster [INF] osdmap e15: 6 total, 5 up, 5 in
- 2017-07-11 13:24:37.942477 I | rook-ceph-mon2: 2017-07-11 13:24:37.266277 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 102 : cluster [INF] osd.5 10.233.99.6:6800/179 boot
- 2017-07-11 13:24:37.942494 I | rook-ceph-mon2: 2017-07-11 13:24:37.266651 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 103 : cluster [INF] osdmap e16: 6 total, 6 up, 6 in
- 2017-07-11 13:24:42.603344 I | rook-ceph-mon2: 2017-07-11 13:24:41.556133 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 104 : cluster [INF] osdmap e17: 6 total, 6 up, 6 in
- 2017-07-11 13:24:57.509339 I | rook-ceph-mon2: 2017-07-11 13:24:57.509145 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4799 MB, avail 94387 MB
- 2017-07-11 13:25:06.027079 I | rook-ceph-mon2: 2017-07-11 13:25:05.280508 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 116 : cluster [INF] HEALTH_WARN; 614 pgs peering; 6 requests are blocked > 32 sec; 6 osds have slow requests; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:25:07.185383 I | rook-ceph-mon2: 2017-07-11 13:24:59.141639 osd.1 osd.1 10.233.76.4:6800/178 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.086934 secs
- 2017-07-11 13:25:07.185659 I | rook-ceph-mon2: 2017-07-11 13:24:59.141653 osd.1 osd.1 10.233.76.4:6800/178 2 : cluster [WRN] slow request 30.086934 seconds old, received at 2017-07-11 13:24:29.054610: osd_pg_create(e9 0.1:2 0.4:2 0.8:2 0.c:2 0.11:2 0.12:2 0.13:2 0.16:2 0.1a:2 0.1b:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.2b:2 0.33:2 0.34:2 0.36:2 0.37:2 0.38:2 0.39:2 0.3c:2 0.40:2 0.41:2 0.43:2 0.4b:2 0.4d:2 0.4e:2 0.52:2 0.57:2 0.5a:2 0.5f:2 0.62:2 0.67:2 0.6d:2 0.74:2 0.75:2 0.80:2 0.81:2 0.84:2 0.86:2 0.87:2 0.8c:2 0.8d:2 0.8f:2 0.92:2 0.93:2 0.96:2 0.99:2 0.9a:2 0.9b:2 0.9c:2 0.a4:2 0.a9:2 0.aa:2 0.ae:2 0.af:2 0.b1:2 0.b2:2 0.b7:2 0.b9:2 0.be:2 0.c1:2 0.c7:2 0.c9:2 0.cf:2 0.db:2 0.df:2 0.e6:2 0.f0:2 0.f1:2 0.f2:2 0.f3:2 0.f5:2 0.f6:2 0.fa:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.106:2 0.109:2 0.10b:2 0.10d:2 0.113:2 0.114:2 0.115:2 0.11a:2 0.121:2 0.124:2 0.125:2 0.12b:2 0.130:2 0.136:2 0.137:2 0.139:2 0.13a:2 0.13b:2 0.13c:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14b:2 0.14d:2 0.155:2 0.156:2 0.158:2 0.159:2 0.15b:2 0.15d:2 0.161:2 0.164:2 0.165:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.178:2 0.17d:2 0.184:2 0.187:2 0.18c:2 0.18e:2 0.18f:2 0.190:2 0.191:2 0.193:2 0.197:2 0.199:2 0.19a:2 0.19b:2 0.19d:2 0.1a1:2 0.1a2:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b2:2 0.1b3:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1c9:2 0.1d1:2 0.1d3:2 0.1d9:2 0.1da:2 0.1dd:2 0.1e0:2 0.1e3:2 0.1e5:2 0.1e7:2 0.1e8:2 0.1ea:2 0.1ee:2 0.1f1:2 0.1f2:2 0.1f3:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fb:2 0.1fc:2 0.1fd:2 0.1ff:2 0.202:2 0.208:2 0.209:2 0.20c:2 0.210:2 0.213:2 0.215:2 0.219:2 0.21b:2 0.220:2 0.221:2 0.225:2 0.229:2 0.22e:2 0.230:2 0.233:2 0.234:2 0.236:2 0.238:2 0.240:2 0.241:2 0.244:2 0.245:2 0.24b:2 0.24f:2 0.256:2 0.257:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.268:2 0.26c:2 0.26f:2 0.274:2 0.275:2 0.278:2 0.27b:2 0.27c:2 0.27d:2 0.27e:2 0.281:2 0.284:2 0.287:2 0.288:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.293:2 0.29b:2 0.29c:2 0.29f:2 0.2a2:2 0.2a3:2 0.2a5:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ad:2 0.2b0:2 0.2b6:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2bd:2 0.2c0:2 0.2c3:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2cf:2 0.2d4:2 0.2d6:2 0.2d8:2 0.2da:2 0.2dc:2 0.2e6:2 0.2e8:2 0.2f2:2 0.2f4:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2fd:2 0.2ff:2 0.301:2 0.302:2 0.303:2 0.305:2 0.307:2 0.30b:2 0.30d:2 0.30f:2 0.311:2 0.314:2 0.315:2 0.318:2 0.319:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.336:2 0.339:2 0.33a:2 0.33d:2 0.347:2 0.348:2 0.34a:2 0.34e:2 0.34f:2 0.350:2 0.353:2 0.357:2 0.35b:2 0.35d:2 0.35e:2 0.35f:2 0.361:2 0.366:2 0.368:2 0.369:2 0.36f:2 0.370:2 0.371:2 0.375:2 0.376:2 0.37c:2 0.37e:2 0.380:2 0.384:2 0.387:2 0.38a:2 0.38e:2 0.390:2 0.392:2 0.395:2 0.39a:2 0.39b:2 0.39c:2 0.39d:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b3:2 0.3b4:2 0.3b5:2 0.3ba:2 0.3c1:2 0.3c3:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cc:2 0.3cd:2 0.3d1:2 0.3d2:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3da:2 0.3db:2 0.3dc:2 0.3dd:2 0.3df:2 0.3e0:2 0.3e2:2 0.3e3:2 0.3e5:2 0.3e7:2 0.3ea:2 0.3ec:2 0.3f0:2 0.3f1:2 0.3f4:2 0.3f8:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:07.185695 I | rook-ceph-mon2: 2017-07-11 13:24:59.815551 osd.0 osd.0 10.233.72.0:6800/180 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.826397 secs
- 2017-07-11 13:25:07.185713 I | rook-ceph-mon2: 2017-07-11 13:24:59.815574 osd.0 osd.0 10.233.72.0:6800/180 2 : cluster [WRN] slow request 30.826397 seconds old, received at 2017-07-11 13:24:28.989049: osd_pg_create(e9 0.6:2 0.7:2 0.9:2 0.b:2 0.10:2 0.14:2 0.18:2 0.19:2 0.27:2 0.28:2 0.29:2 0.2c:2 0.31:2 0.3b:2 0.3d:2 0.42:2 0.44:2 0.46:2 0.49:2 0.50:2 0.53:2 0.55:2 0.59:2 0.5b:2 0.5d:2 0.5e:2 0.61:2 0.63:2 0.64:2 0.65:2 0.66:2 0.69:2 0.6b:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.82:2 0.83:2 0.90:2 0.9d:2 0.9f:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.a7:2 0.a8:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.ba:2 0.bb:2 0.bd:2 0.bf:2 0.c6:2 0.cd:2 0.d0:2 0.d3:2 0.d4:2 0.d6:2 0.d7:2 0.da:2 0.dd:2 0.e1:2 0.e3:2 0.e4:2 0.e5:2 0.e7:2 0.e8:2 0.e9:2 0.ed:2 0.ee:2 0.f4:2 0.f8:2 0.fc:2 0.fd:2 0.10c:2 0.10e:2 0.110:2 0.116:2 0.117:2 0.118:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.128:2 0.12a:2 0.12c:2 0.12f:2 0.132:2 0.135:2 0.140:2 0.141:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.160:2 0.163:2 0.166:2 0.16a:2 0.170:2 0.179:2 0.17b:2 0.17c:2 0.17e:2 0.17f:2 0.180:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.192:2 0.194:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b0:2 0.1b1:2 0.1b4:2 0.1b7:2 0.1b8:2 0.1b9:2 0.1ba:2 0.1be:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1ce:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1de:2 0.1e1:2 0.1e2:2 0.1e4:2 0.1e6:2 0.1eb:2 0.1ed:2 0.1f5:2 0.1f7:2 0.1f8:2 0.1fe:2 0.200:2 0.204:2 0.206:2 0.207:2 0.20a:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.214:2 0.216:2 0.21c:2 0.21e:2 0.227:2 0.228:2 0.22a:2 0.22b:2 0.22c:2 0.22d:2 0.231:2 0.23c:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.250:2 0.252:2 0.255:2 0.25b:2 0.25e:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26d:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.277:2 0.279:2 0.27f:2 0.282:2 0.286:2 0.28c:2 0.28f:2 0.292:2 0.294:2 0.295:2 0.296:2 0.298:2 0.299:2 0.29d:2 0.2a1:2 0.2a4:2 0.2ab:2 0.2ae:2 0.2b2:2 0.2b3:2 0.2b4:2 0.2b5:2 0.2bb:2 0.2bc:2 0.2be:2 0.2c1:2 0.2c4:2 0.2c5:2 0.2cb:2 0.2cd:2 0.2ce:2 0.2d2:2 0.2d3:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e7:2 0.2ee:2 0.2ef:2 0.2f0:2 0.2f6:2 0.2fa:2 0.2fb:2 0.304:2 0.306:2 0.309:2 0.30c:2 0.310:2 0.312:2 0.316:2 0.317:2 0.31a:2 0.31d:2 0.31e:2 0.31f:2 0.323:2 0.324:2 0.328:2 0.32b:2 0.32d:2 0.331:2 0.332:2 0.338:2 0.33b:2 0.33e:2 0.340:2 0.343:2 0.346:2 0.349:2 0.34d:2 0.351:2 0.352:2 0.355:2 0.356:2 0.358:2 0.35c:2 0.362:2 0.363:2 0.36b:2 0.372:2 0.373:2 0.374:2 0.377:2 0.378:2 0.37b:2 0.381:2 0.382:2 0.385:2 0.386:2 0.389:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.396:2 0.399:2 0.3a5:2 0.3a6:2 0.3a7:2 0.3a9:2 0.3ac:2 0.3af:2 0.3b6:2 0.3b7:2 0.3b8:2 0.3b9:2 0.3bc:2 0.3bd:2 0.3be:2 0.3c0:2 0.3c2:2 0.3c7:2 0.3ce:2 0.3cf:2 0.3d4:2 0.3d7:2 0.3d8:2 0.3de:2 0.3e6:2 0.3eb:2 0.3ed:2 0.3ee:2 0.3ef:2 0.3f3:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2) currently started
- 2017-07-11 13:25:08.293557 I | rook-ceph-mon2: 2017-07-11 13:25:01.102920 osd.3 osd.3 10.233.86.0:6800/178 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.754338 secs
- 2017-07-11 13:25:08.293647 I | rook-ceph-mon2: 2017-07-11 13:25:01.102935 osd.3 osd.3 10.233.86.0:6800/178 2 : cluster [WRN] slow request 30.754338 seconds old, received at 2017-07-11 13:24:30.348500: osd_pg_create(e10 0.7:2 0.a:2 0.12:2 0.13:2 0.15:2 0.18:2 0.1b:2 0.1f:2 0.22:2 0.23:2 0.24:2 0.2c:2 0.30:2 0.33:2 0.34:2 0.3d:2 0.3e:2 0.42:2 0.45:2 0.4a:2 0.4c:2 0.50:2 0.51:2 0.54:2 0.57:2 0.58:2 0.59:2 0.66:2 0.67:2 0.68:2 0.6a:2 0.6b:2 0.6c:2 0.6f:2 0.71:2 0.7c:2 0.82:2 0.85:2 0.89:2 0.90:2 0.95:2 0.9e:2 0.9f:2 0.a3:2 0.aa:2 0.af:2 0.b3:2 0.b7:2 0.ba:2 0.bd:2 0.c0:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e0:2 0.e2:2 0.e5:2 0.e9:2 0.ea:2 0.ed:2 0.ef:2 0.f7:2 0.fc:2 0.fd:2 0.fe:2 0.ff:2 0.106:2 0.107:2 0.108:2 0.10a:2 0.10c:2 0.10d:2 0.10e:2 0.10f:2 0.110:2 0.11a:2 0.123:2 0.127:2 0.128:2 0.130:2 0.132:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.143:2 0.152:2 0.153:2 0.156:2 0.15c:2 0.15f:2 0.162:2 0.163:2 0.16f:2 0.173:2 0.176:2 0.177:2 0.17e:2 0.181:2 0.187:2 0.188:2 0.18b:2 0.18c:2 0.191:2 0.192:2 0.194:2 0.195:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b0:2 0.1b1:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c2:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1dc:2 0.1de:2 0.1df:2 0.1e2:2 0.1e3:2 0.1ec:2 0.1f3:2 0.1fb:2 0.1fe:2 0.201:2 0.204:2 0.205:2 0.20a:2 0.213:2 0.21c:2 0.21e:2 0.221:2 0.224:2 0.229:2 0.232:2 0.235:2 0.237:2 0.238:2 0.23a:2 0.23f:2 0.242:2 0.245:2 0.24b:2 0.250:2 0.256:2 0.257:2 0.25e:2 0.264:2 0.267:2 0.268:2 0.26a:2 0.278:2 0.27e:2 0.280:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.29e:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ae:2 0.2b0:2 0.2c1:2 0.2c8:2 0.2cb:2 0.2d5:2 0.2d6:2 0.2da:2 0.2db:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ea:2 0.2ec:2 0.2ef:2 0.2f0:2 0.2f2:2 0.2f4:2 0.2f9:2 0.2fb:2 0.305:2 0.306:2 0.308:2 0.309:2 0.30a:2 0.30c:2 0.310:2 0.314:2 0.319:2 0.31d:2 0.322:2 0.327:2 0.329:2 0.331:2 0.334:2 0.335:2 0.337:2 0.33e:2 0.340:2 0.344:2 0.348:2 0.349:2 0.34a:2 0.34c:2 0.350:2 0.354:2 0.355:2 0.357:2 0.359:2 0.35a:2 0.35e:2 0.365:2 0.367:2 0.369:2 0.36a:2 0.36e:2 0.37d:2 0.382:2 0.389:2 0.38c:2 0.38f:2 0.390:2 0.394:2 0.398:2 0.399:2 0.39a:2 0.3a0:2 0.3a7:2 0.3af:2 0.3b0:2 0.3b7:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c5:2 0.3c6:2 0.3cf:2 0.3d2:2 0.3d4:2 0.3d5:2 0.3db:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3e5:2 0.3e7:2 0.3f0:2 0.3f6:2 0.3f9:2) currently started
- 2017-07-11 13:25:11.455640 I | rook-ceph-mon2: 2017-07-11 13:25:02.581395 osd.2 osd.2 10.233.69.0:6800/178 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.293208 secs
- 2017-07-11 13:25:11.455935 I | rook-ceph-mon2: 2017-07-11 13:25:02.581413 osd.2 osd.2 10.233.69.0:6800/178 2 : cluster [WRN] slow request 30.293208 seconds old, received at 2017-07-11 13:24:32.288034: osd_pg_create(e12 0.5:2 0.7:2 0.9:2 0.12:2 0.13:2 0.14:2 0.15:2 0.16:2 0.17:2 0.1b:2 0.21:2 0.27:2 0.29:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.39:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5b:2 0.5f:2 0.60:2 0.63:2 0.6e:2 0.72:2 0.7a:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.95:2 0.98:2 0.9a:2 0.9d:2 0.9e:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.b8:2 0.ba:2 0.c0:2 0.c2:2 0.c5:2 0.cb:2 0.ce:2 0.d2:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.fe:2 0.100:2 0.106:2 0.107:2 0.10c:2 0.10d:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.127:2 0.128:2 0.12c:2 0.12f:2 0.131:2 0.133:2 0.134:2 0.141:2 0.142:2 0.14b:2 0.14d:2 0.159:2 0.15a:2 0.15c:2 0.160:2 0.161:2 0.166:2 0.169:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.17f:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1db:2 0.1e1:2 0.1e4:2 0.1e9:2 0.1ee:2 0.1f2:2 0.1f3:2 0.1f6:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.21d:2 0.21f:2 0.223:2 0.224:2 0.228:2 0.229:2 0.22b:2 0.22e:2 0.233:2 0.235:2 0.237:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.251:2 0.252:2 0.253:2 0.254:2 0.25c:2 0.265:2 0.267:2 0.269:2 0.26b:2 0.26c:2 0.26d:2 0.276:2 0.278:2 0.279:2 0.27b:2 0.27f:2 0.280:2 0.284:2 0.286:2 0.288:2 0.290:2 0.298:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b3:2 0.2b8:2 0.2b9:2 0.2bf:2 0.2c8:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2df:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ea:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30b:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32d:2 0.32f:2 0.330:2 0.334:2 0.336:2 0.33a:2 0.344:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.359:2 0.363:2 0.364:2 0.366:2 0.369:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b0:2 0.3b2:2 0.3b3:2 0.3b5:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3ed:2 0.3f4:2) currently started
- 2017-07-11 13:25:12.554762 I | rook-ceph-mon2: 2017-07-11 13:25:04.442289 osd.4 osd.4 10.233.124.4:6800/178 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.644850 secs
- 2017-07-11 13:25:12.554850 I | rook-ceph-mon2: 2017-07-11 13:25:04.442463 osd.4 osd.4 10.233.124.4:6800/178 2 : cluster [WRN] slow request 30.644850 seconds old, received at 2017-07-11 13:24:33.797300: osd_pg_create(e14 0.0:2 0.14:2 0.17:2 0.23:2 0.29:2 0.2d:2 0.37:2 0.39:2 0.3d:2 0.40:2 0.41:2 0.42:2 0.45:2 0.46:2 0.48:2 0.4a:2 0.55:2 0.5a:2 0.5c:2 0.62:2 0.65:2 0.66:2 0.68:2 0.6d:2 0.78:2 0.83:2 0.88:2 0.95:2 0.9c:2 0.a1:2 0.b0:2 0.b5:2 0.b8:2 0.bc:2 0.bd:2 0.c0:2 0.c1:2 0.c8:2 0.cb:2 0.e6:2 0.e7:2 0.f0:2 0.fe:2 0.100:2 0.101:2 0.10a:2 0.10d:2 0.10f:2 0.114:2 0.128:2 0.12a:2 0.12f:2 0.134:2 0.138:2 0.143:2 0.148:2 0.149:2 0.14c:2 0.14f:2 0.160:2 0.162:2 0.163:2 0.164:2 0.169:2 0.16b:2 0.17f:2 0.182:2 0.185:2 0.18f:2 0.190:2 0.19b:2 0.1a5:2 0.1b6:2 0.1bc:2 0.1c7:2 0.1d8:2 0.1d9:2 0.1db:2 0.1dd:2 0.1e4:2 0.1ee:2 0.1f0:2 0.1f6:2 0.1f7:2 0.204:2 0.208:2 0.210:2 0.217:2 0.219:2 0.21d:2 0.226:2 0.229:2 0.22a:2 0.22b:2 0.230:2 0.235:2 0.237:2 0.23a:2 0.23b:2 0.241:2 0.243:2 0.24d:2 0.25b:2 0.25e:2 0.261:2 0.265:2 0.267:2 0.26c:2 0.27b:2 0.27d:2 0.27f:2 0.283:2 0.284:2 0.288:2 0.28e:2 0.29e:2 0.2a6:2 0.2ae:2 0.2b1:2 0.2b4:2 0.2b6:2 0.2bb:2 0.2bf:2 0.2c0:2 0.2c3:2 0.2c5:2 0.2c6:2 0.2cd:2 0.2cf:2 0.2d5:2 0.2d8:2 0.2df:2 0.2e0:2 0.2e9:2 0.2ea:2 0.2f9:2 0.303:2 0.309:2 0.30a:2 0.30b:2 0.30d:2 0.312:2 0.325:2 0.32b:2 0.32c:2 0.32d:2 0.333:2 0.334:2 0.335:2 0.339:2 0.33a:2 0.342:2 0.359:2 0.362:2 0.368:2 0.36f:2 0.37a:2 0.384:2 0.38f:2 0.3a2:2 0.3a8:2 0.3a9:2 0.3b1:2 0.3b4:2 0.3b5:2 0.3be:2 0.3c5:2 0.3d1:2 0.3d5:2 0.3da:2 0.3e0:2 0.3e9:2 0.3eb:2 0.3ed:2 0.3ef:2 0.3f6:2 0.3f7:2 0.3f9:2 0.3fc:2) currently started
- 2017-07-11 13:25:16.697305 I | rook-ceph-mon2: 2017-07-11 13:25:08.359890 osd.5 osd.5 10.233.99.6:6800/179 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.964326 secs
- 2017-07-11 13:25:16.697396 I | rook-ceph-mon2: 2017-07-11 13:25:08.359905 osd.5 osd.5 10.233.99.6:6800/179 2 : cluster [WRN] slow request 30.964326 seconds old, received at 2017-07-11 13:24:37.395485: osd_pg_create(e16 0.0:2 0.2:2 0.f:2 0.13:2 0.22:2 0.23:2 0.25:2 0.26:2 0.2a:2 0.39:2 0.41:2 0.4d:2 0.50:2 0.5b:2 0.60:2 0.66:2 0.70:2 0.72:2 0.76:2 0.77:2 0.7e:2 0.7f:2 0.88:2 0.89:2 0.8c:2 0.91:2 0.97:2 0.a1:2 0.a7:2 0.a8:2 0.ac:2 0.b9:2 0.c1:2 0.c3:2 0.c9:2 0.ca:2 0.cd:2 0.d2:2 0.d5:2 0.de:2 0.e1:2 0.e2:2 0.e8:2 0.ec:2 0.ed:2 0.f0:2 0.fc:2 0.103:2 0.10d:2 0.10e:2 0.115:2 0.11b:2 0.125:2 0.127:2 0.129:2 0.131:2 0.133:2 0.134:2 0.135:2 0.138:2 0.13d:2 0.143:2 0.146:2 0.148:2 0.14b:2 0.154:2 0.157:2 0.159:2 0.15a:2 0.16c:2 0.175:2 0.176:2 0.177:2 0.17b:2 0.184:2 0.187:2 0.18d:2 0.190:2 0.191:2 0.195:2 0.198:2 0.19a:2 0.1a0:2 0.1a7:2 0.1a8:2 0.1ab:2 0.1b5:2 0.1b6:2 0.1bf:2 0.1c4:2 0.1d2:2 0.1d7:2 0.1d8:2 0.1e3:2 0.1f0:2 0.1f8:2 0.1fd:2 0.1fe:2 0.202:2 0.203:2 0.20a:2 0.219:2 0.21f:2 0.228:2 0.22a:2 0.239:2 0.23d:2 0.24e:2 0.24f:2 0.251:2 0.267:2 0.26a:2 0.274:2 0.278:2 0.27a:2 0.28b:2 0.28e:2 0.294:2 0.298:2 0.29e:2 0.2a6:2 0.2b3:2 0.2b6:2 0.2ba:2 0.2c6:2 0.2c8:2 0.2ca:2 0.2d5:2 0.2d8:2 0.2dd:2 0.2e0:2 0.2ed:2 0.2f4:2 0.2f8:2 0.2ff:2 0.311:2 0.314:2 0.315:2 0.316:2 0.31f:2 0.322:2 0.326:2 0.32a:2 0.335:2 0.33c:2 0.343:2 0.34b:2 0.35a:2 0.35e:2 0.363:2 0.369:2 0.36f:2 0.37f:2 0.384:2 0.386:2 0.39a:2 0.39c:2 0.3a7:2 0.3ac:2 0.3ae:2 0.3b0:2 0.3ba:2 0.3d2:2 0.3d6:2 0.3dd:2 0.3e3:2 0.3ea:2 0.3f1:2 0.3f5:2 0.3fc:2 0.3fe:2) currently started
- 2017-07-11 13:25:21.739235 I | rook-ceph-mon2: 2017-07-11 13:25:20.610722 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 118 : cluster [INF] osd.0 failed (root=default,host=master-1) (5 reporters from different host after 22.086509 >= grace 20.000000)
- 2017-07-11 13:25:21.739447 I | rook-ceph-mon2: 2017-07-11 13:25:20.610763 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 119 : cluster [INF] osd.2 failed (root=default,host=master-0) (2 reporters from different host after 22.085972 >= grace 20.000000)
- 2017-07-11 13:25:21.739477 I | rook-ceph-mon2: 2017-07-11 13:25:20.610783 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 120 : cluster [INF] osd.3 failed (root=default,host=master-2) (3 reporters from different host after 22.085702 >= grace 20.000000)
- 2017-07-11 13:25:21.739496 I | rook-ceph-mon2: 2017-07-11 13:25:20.942180 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 121 : cluster [INF] osdmap e18: 6 total, 3 up, 6 in
- 2017-07-11 13:25:23.325310 I | rook-ceph-mon2: 2017-07-11 13:25:22.186747 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 123 : cluster [INF] osd.4 failed (root=default,host=minion-2) (connection refused reported by osd.5)
- 2017-07-11 13:25:24.948209 I | rook-ceph-mon2: 2017-07-11 13:25:23.792859 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 129 : cluster [INF] osdmap e19: 6 total, 2 up, 6 in
- 2017-07-11 13:25:26.426881 I | rook-ceph-mon2: 2017-07-11 13:25:24.354685 osd.5 osd.5 10.233.99.6:6800/179 3 : cluster [ERR] map e17 had wrong cluster addr (10.233.99.6:6801/179 != my 10.233.99.0:6801/179)
- 2017-07-11 13:25:32.410370 I | rook-ceph-mon2: 2017-07-11 13:25:21.991262 osd.4 osd.4 10.233.124.4:6800/178 3 : cluster [ERR] map e16 had wrong cluster addr (10.233.124.4:6801/178 != my 10.233.124.0:6801/178)
- 2017-07-11 13:25:32.410454 I | rook-ceph-mon2: 2017-07-11 13:25:22.446168 osd.4 osd.4 10.233.124.4:6800/178 4 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 45.667737 secs
- 2017-07-11 13:25:32.410471 I | rook-ceph-mon2: 2017-07-11 13:25:22.446172 osd.4 osd.4 10.233.124.4:6800/178 5 : cluster [WRN] slow request 45.667737 seconds old, received at 2017-07-11 13:24:36.778345: osd_pg_create(e15 0.10:2 0.13:2 0.1d:2 0.24:2 0.4d:2 0.5b:2 0.6c:2 0.77:2 0.7e:2 0.90:2 0.9e:2 0.ac:2 0.b7:2 0.cd:2 0.ce:2 0.d1:2 0.ed:2 0.f2:2 0.116:2 0.11b:2 0.129:2 0.12e:2 0.133:2 0.13d:2 0.13e:2 0.142:2 0.146:2 0.15e:2 0.176:2 0.187:2 0.1c4:2 0.1dc:2 0.1e8:2 0.203:2 0.23e:2 0.251:2 0.254:2 0.274:2 0.28b:2 0.2b0:2 0.2b3:2 0.2c8:2 0.2f4:2 0.311:2 0.326:2 0.33f:2 0.343:2 0.344:2 0.35e:2 0.36c:2 0.379:2 0.395:2 0.39c:2 0.3a7:2 0.3b0:2 0.3c3:2 0.3e3:2) currently wait for new map
- 2017-07-11 13:25:32.410506 I | rook-ceph-mon2: 2017-07-11 13:25:22.446234 osd.4 osd.4 10.233.124.4:6800/178 6 : cluster [WRN] slow request 40.751310 seconds old, received at 2017-07-11 13:24:41.694773: osd_pg_create(e17 0.10:2 0.14:2 0.17:2 0.1d:2 0.24:2 0.29:2 0.2d:2 0.37:2 0.3d:2 0.40:2 0.42:2 0.45:2 0.46:2 0.48:2 0.4a:2 0.55:2 0.5a:2 0.5c:2 0.62:2 0.65:2 0.68:2 0.6c:2 0.6d:2 0.78:2 0.83:2 0.90:2 0.95:2 0.9c:2 0.9e:2 0.b0:2 0.b5:2 0.b7:2 0.b8:2 0.bc:2 0.bd:2 0.c0:2 0.c8:2 0.cb:2 0.ce:2 0.d1:2 0.e6:2 0.e7:2 0.f2:2 0.fe:2 0.100:2 0.101:2 0.10a:2 0.10f:2 0.114:2 0.116:2 0.128:2 0.12a:2 0.12e:2 0.12f:2 0.13e:2 0.142:2 0.149:2 0.14c:2 0.14f:2 0.15e:2 0.160:2 0.162:2 0.163:2 0.164:2 0.169:2 0.16b:2 0.17f:2 0.182:2 0.185:2 0.18f:2 0.19b:2 0.1a5:2 0.1bc:2 0.1c7:2 0.1d9:2 0.1db:2 0.1dc:2 0.1dd:2 0.1e4:2 0.1e8:2 0.1ee:2 0.1f6:2 0.1f7:2 0.204:2 0.208:2 0.210:2 0.217:2 0.21d:2 0.226:2 0.229:2 0.22b:2 0.230:2 0.235:2 0.237:2 0.23a:2 0.23b:2 0.23e:2 0.241:2 0.243:2 0.24d:2 0.254:2 0.25b:2 0.25e:2 0.261:2 0.265:2 0.26c:2 0.27b:2 0.27d:2 0.27f:2 0.283:2 0.284:2 0.288:2 0.2ae:2 0.2b0:2 0.2b1:2 0.2b4:2 0.2bb:2 0.2bf:2 0.2c0:2 0.2c3:2 0.2c5:2 0.2cd:2 0.2cf:2 0.2df:2 0.2e9:2 0.2ea:2 0.2f9:2 0.303:2 0.309:2 0.30a:2 0.30b:2 0.30d:2 0.312:2 0.325:2 0.32b:2 0.32c:2 0.32d:2 0.333:2 0.334:2 0.339:2 0.33a:2 0.33f:2 0.342:2 0.344:2 0.359:2 0.362:2 0.368:2 0.36c:2 0.379:2 0.37a:2 0.38f:2 0.395:2 0.3a2:2 0.3a8:2 0.3a9:2 0.3b1:2 0.3b4:2 0.3b5:2 0.3be:2 0.3c3:2 0.3c5:2 0.3d1:2 0.3d5:2 0.3da:2 0.3e0:2 0.3e9:2 0.3eb:2 0.3ed:2 0.3ef:2 0.3f6:2 0.3f7:2 0.3f9:2) currently wait for new map
- 2017-07-11 13:25:36.188903 I | rook-ceph-mon2: 2017-07-11 13:25:29.820925 osd.0 osd.0 10.233.72.0:6800/180 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.831826 secs
- 2017-07-11 13:25:36.188990 I | rook-ceph-mon2: 2017-07-11 13:25:29.820936 osd.0 osd.0 10.233.72.0:6800/180 4 : cluster [WRN] slow request 60.831826 seconds old, received at 2017-07-11 13:24:28.989049: osd_pg_create(e9 0.6:2 0.7:2 0.9:2 0.b:2 0.10:2 0.14:2 0.18:2 0.19:2 0.27:2 0.28:2 0.29:2 0.2c:2 0.31:2 0.3b:2 0.3d:2 0.42:2 0.44:2 0.46:2 0.49:2 0.50:2 0.53:2 0.55:2 0.59:2 0.5b:2 0.5d:2 0.5e:2 0.61:2 0.63:2 0.64:2 0.65:2 0.66:2 0.69:2 0.6b:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.82:2 0.83:2 0.90:2 0.9d:2 0.9f:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.a7:2 0.a8:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.ba:2 0.bb:2 0.bd:2 0.bf:2 0.c6:2 0.cd:2 0.d0:2 0.d3:2 0.d4:2 0.d6:2 0.d7:2 0.da:2 0.dd:2 0.e1:2 0.e3:2 0.e4:2 0.e5:2 0.e7:2 0.e8:2 0.e9:2 0.ed:2 0.ee:2 0.f4:2 0.f8:2 0.fc:2 0.fd:2 0.10c:2 0.10e:2 0.110:2 0.116:2 0.117:2 0.118:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.128:2 0.12a:2 0.12c:2 0.12f:2 0.132:2 0.135:2 0.140:2 0.141:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.160:2 0.163:2 0.166:2 0.16a:2 0.170:2 0.179:2 0.17b:2 0.17c:2 0.17e:2 0.17f:2 0.180:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.192:2 0.194:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b0:2 0.1b1:2 0.1b4:2 0.1b7:2 0.1b8:2 0.1b9:2 0.1ba:2 0.1be:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1ce:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1de:2 0.1e1:2 0.1e2:2 0.1e4:2 0.1e6:2 0.1eb:2 0.1ed:2 0.1f5:2 0.1f7:2 0.1f8:2 0.1fe:2 0.200:2 0.204:2 0.206:2 0.207:2 0.20a:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.214:2 0.216:2 0.21c:2 0.21e:2 0.227:2 0.228:2 0.22a:2 0.22b:2 0.22c:2 0.22d:2 0.231:2 0.23c:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.250:2 0.252:2 0.255:2 0.25b:2 0.25e:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26d:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.277:2 0.279:2 0.27f:2 0.282:2 0.286:2 0.28c:2 0.28f:2 0.292:2 0.294:2 0.295:2 0.296:2 0.298:2 0.299:2 0.29d:2 0.2a1:2 0.2a4:2 0.2ab:2 0.2ae:2 0.2b2:2 0.2b3:2 0.2b4:2 0.2b5:2 0.2bb:2 0.2bc:2 0.2be:2 0.2c1:2 0.2c4:2 0.2c5:2 0.2cb:2 0.2cd:2 0.2ce:2 0.2d2:2 0.2d3:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e7:2 0.2ee:2 0.2ef:2 0.2f0:2 0.2f6:2 0.2fa:2 0.2fb:2 0.304:2 0.306:2 0.309:2 0.30c:2 0.310:2 0.312:2 0.316:2 0.317:2 0.31a:2 0.31d:2 0.31e:2 0.31f:2 0.323:2 0.324:2 0.328:2 0.32b:2 0.32d:2 0.331:2 0.332:2 0.338:2 0.33b:2 0.33e:2 0.340:2 0.343:2 0.346:2 0.349:2 0.34d:2 0.351:2 0.352:2 0.355:2 0.356:2 0.358:2 0.35c:2 0.362:2 0.363:2 0.36b:2 0.372:2 0.373:2 0.374:2 0.377:2 0.378:2 0.37b:2 0.381:2 0.382:2 0.385:2 0.386:2 0.389:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.396:2 0.399:2 0.3a5:2 0.3a6:2 0.3a7:2 0.3a9:2 0.3ac:2 0.3af:2 0.3b6:2 0.3b7:2 0.3b8:2 0.3b9:2 0.3bc:2 0.3bd:2 0.3be:2 0.3c0:2 0.3c2:2 0.3c7:2 0.3ce:2 0.3cf:2 0.3d4:2 0.3d7:2 0.3d8:2 0.3de:2 0.3e6:2 0.3eb:2 0.3ed:2 0.3ee:2 0.3ef:2 0.3f3:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2) currently started
- 2017-07-11 13:25:36.189080 I | rook-ceph-mon2: 2017-07-11 13:25:32.821643 osd.0 osd.0 10.233.72.0:6800/180 5 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 62.492130 secs
- 2017-07-11 13:25:36.189138 I | rook-ceph-mon2: 2017-07-11 13:25:32.821648 osd.0 osd.0 10.233.72.0:6800/180 6 : cluster [WRN] slow request 62.492130 seconds old, received at 2017-07-11 13:24:30.329295: osd_pg_create(e10 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.189183 I | rook-ceph-mon2: 2017-07-11 13:25:32.821663 osd.0 osd.0 10.233.72.0:6800/180 7 : cluster [WRN] slow request 61.883204 seconds old, received at 2017-07-11 13:24:30.938221: osd_pg_create(e11 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.189215 I | rook-ceph-mon2: 2017-07-11 13:25:32.821665 osd.0 osd.0 10.233.72.0:6800/180 8 : cluster [WRN] slow request 60.602348 seconds old, received at 2017-07-11 13:24:32.219078: osd_pg_create(e12 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.189246 I | rook-ceph-mon2: 2017-07-11 13:25:32.821668 osd.0 osd.0 10.233.72.0:6800/180 9 : cluster [WRN] slow request 60.120760 seconds old, received at 2017-07-11 13:24:32.700666: osd_pg_create(e13 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.189265 I | rook-ceph-mon2: 2017-07-11 13:25:32.821670 osd.0 osd.0 10.233.72.0:6800/180 10 : cluster [WRN] slow request 59.026349 seconds old, received at 2017-07-11 13:24:33.795077: osd_pg_create(e14 0.6:2 0.b:2 0.f:2 0.26:2 0.28:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f4:2 0.f8:2 0.112:2 0.117:2 0.119:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.154:2 0.16a:2 0.170:2 0.179:2 0.183:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f8:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24e:2 0.25f:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e5:2 0.2ee:2 0.2f3:2 0.2fa:2 0.304:2 0.316:2 0.317:2 0.31e:2 0.31f:2 0.320:2 0.324:2 0.328:2 0.332:2 0.343:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3e6:2 0.3f3:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.189326 I | rook-ceph-mon2: 2017-07-11 13:25:33.077046 osd.0 osd.0 10.233.72.0:6800/180 11 : cluster [WRN] map e19 wrongly marked me down at e18
- 2017-07-11 13:25:36.189353 I | rook-ceph-mon2: 2017-07-11 13:25:33.821853 osd.0 osd.0 10.233.72.0:6800/180 12 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 63.492492 secs
- 2017-07-11 13:25:36.189378 I | rook-ceph-mon2: 2017-07-11 13:25:33.821865 osd.0 osd.0 10.233.72.0:6800/180 13 : cluster [WRN] slow request 63.492492 seconds old, received at 2017-07-11 13:24:30.329295: osd_pg_create(e10 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.189403 I | rook-ceph-mon2: 2017-07-11 13:25:33.821871 osd.0 osd.0 10.233.72.0:6800/180 14 : cluster [WRN] slow request 62.883566 seconds old, received at 2017-07-11 13:24:30.938221: osd_pg_create(e11 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.189465 I | rook-ceph-mon2: 2017-07-11 13:25:33.821880 osd.0 osd.0 10.233.72.0:6800/180 15 : cluster [WRN] slow request 61.602710 seconds old, received at 2017-07-11 13:24:32.219078: osd_pg_create(e12 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.189481 I | rook-ceph-mon2: 2017-07-11 13:25:33.821885 osd.0 osd.0 10.233.72.0:6800/180 16 : cluster [WRN] slow request 61.121121 seconds old, received at 2017-07-11 13:24:32.700666: osd_pg_create(e13 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.189496 I | rook-ceph-mon2: 2017-07-11 13:25:33.821891 osd.0 osd.0 10.233.72.0:6800/180 17 : cluster [WRN] slow request 60.026710 seconds old, received at 2017-07-11 13:24:33.795077: osd_pg_create(e14 0.6:2 0.b:2 0.f:2 0.26:2 0.28:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f4:2 0.f8:2 0.112:2 0.117:2 0.119:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.154:2 0.16a:2 0.170:2 0.179:2 0.183:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f8:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24e:2 0.25f:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e5:2 0.2ee:2 0.2f3:2 0.2fa:2 0.304:2 0.316:2 0.317:2 0.31e:2 0.31f:2 0.320:2 0.324:2 0.328:2 0.332:2 0.343:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3e6:2 0.3f3:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:36.189507 I | rook-ceph-mon2: 2017-07-11 13:25:34.822145 osd.0 osd.0 10.233.72.0:6800/180 18 : cluster [WRN] 8 slow requests, 3 included below; oldest blocked for > 64.492734 secs
- 2017-07-11 13:25:36.189550 I | rook-ceph-mon2: 2017-07-11 13:25:34.822151 osd.0 osd.0 10.233.72.0:6800/180 19 : cluster [WRN] slow request 58.219143 seconds old, received at 2017-07-11 13:24:36.602887: osd_pg_create(e15 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.7f:2 0.8b:2 0.a1:2 0.a2:2 0.a6:2 0.a7:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.125:2 0.135:2 0.147:2 0.150:2 0.151:2 0.15a:2 0.16a:2 0.170:2 0.171:2 0.175:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.190:2 0.196:2 0.19c:2 0.1a0:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.21f:2 0.227:2 0.228:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.239:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.32a:2 0.332:2 0.338:2 0.346:2 0.34b:2 0.34d:2 0.35a:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39a:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:36.189565 I | rook-ceph-mon2: 2017-07-11 13:25:34.822159 osd.0 osd.0 10.233.72.0:6800/180 20 : cluster [WRN] slow request 57.546311 seconds old, received at 2017-07-11 13:24:37.275719: osd_pg_create(e16 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:36.189620 I | rook-ceph-mon2: 2017-07-11 13:25:34.822164 osd.0 osd.0 10.233.72.0:6800/180 21 : cluster [WRN] slow request 53.261450 seconds old, received at 2017-07-11 13:24:41.560579: osd_pg_create(e17 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:37.542079 I | rook-ceph-mon2: 2017-07-11 13:25:29.147192 osd.1 osd.1 10.233.76.4:6800/178 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.092556 secs
- 2017-07-11 13:25:37.542166 I | rook-ceph-mon2: 2017-07-11 13:25:29.147198 osd.1 osd.1 10.233.76.4:6800/178 4 : cluster [WRN] slow request 60.092556 seconds old, received at 2017-07-11 13:24:29.054610: osd_pg_create(e9 0.1:2 0.4:2 0.8:2 0.c:2 0.11:2 0.12:2 0.13:2 0.16:2 0.1a:2 0.1b:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.2b:2 0.33:2 0.34:2 0.36:2 0.37:2 0.38:2 0.39:2 0.3c:2 0.40:2 0.41:2 0.43:2 0.4b:2 0.4d:2 0.4e:2 0.52:2 0.57:2 0.5a:2 0.5f:2 0.62:2 0.67:2 0.6d:2 0.74:2 0.75:2 0.80:2 0.81:2 0.84:2 0.86:2 0.87:2 0.8c:2 0.8d:2 0.8f:2 0.92:2 0.93:2 0.96:2 0.99:2 0.9a:2 0.9b:2 0.9c:2 0.a4:2 0.a9:2 0.aa:2 0.ae:2 0.af:2 0.b1:2 0.b2:2 0.b7:2 0.b9:2 0.be:2 0.c1:2 0.c7:2 0.c9:2 0.cf:2 0.db:2 0.df:2 0.e6:2 0.f0:2 0.f1:2 0.f2:2 0.f3:2 0.f5:2 0.f6:2 0.fa:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.106:2 0.109:2 0.10b:2 0.10d:2 0.113:2 0.114:2 0.115:2 0.11a:2 0.121:2 0.124:2 0.125:2 0.12b:2 0.130:2 0.136:2 0.137:2 0.139:2 0.13a:2 0.13b:2 0.13c:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14b:2 0.14d:2 0.155:2 0.156:2 0.158:2 0.159:2 0.15b:2 0.15d:2 0.161:2 0.164:2 0.165:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.178:2 0.17d:2 0.184:2 0.187:2 0.18c:2 0.18e:2 0.18f:2 0.190:2 0.191:2 0.193:2 0.197:2 0.199:2 0.19a:2 0.19b:2 0.19d:2 0.1a1:2 0.1a2:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b2:2 0.1b3:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1c9:2 0.1d1:2 0.1d3:2 0.1d9:2 0.1da:2 0.1dd:2 0.1e0:2 0.1e3:2 0.1e5:2 0.1e7:2 0.1e8:2 0.1ea:2 0.1ee:2 0.1f1:2 0.1f2:2 0.1f3:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fb:2 0.1fc:2 0.1fd:2 0.1ff:2 0.202:2 0.208:2 0.209:2 0.20c:2 0.210:2 0.213:2 0.215:2 0.219:2 0.21b:2 0.220:2 0.221:2 0.225:2 0.229:2 0.22e:2 0.230:2 0.233:2 0.234:2 0.236:2 0.238:2 0.240:2 0.241:2 0.244:2 0.245:2 0.24b:2 0.24f:2 0.256:2 0.257:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.268:2 0.26c:2 0.26f:2 0.274:2 0.275:2 0.278:2 0.27b:2 0.27c:2 0.27d:2 0.27e:2 0.281:2 0.284:2 0.287:2 0.288:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.293:2 0.29b:2 0.29c:2 0.29f:2 0.2a2:2 0.2a3:2 0.2a5:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ad:2 0.2b0:2 0.2b6:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2bd:2 0.2c0:2 0.2c3:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2cf:2 0.2d4:2 0.2d6:2 0.2d8:2 0.2da:2 0.2dc:2 0.2e6:2 0.2e8:2 0.2f2:2 0.2f4:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2fd:2 0.2ff:2 0.301:2 0.302:2 0.303:2 0.305:2 0.307:2 0.30b:2 0.30d:2 0.30f:2 0.311:2 0.314:2 0.315:2 0.318:2 0.319:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.336:2 0.339:2 0.33a:2 0.33d:2 0.347:2 0.348:2 0.34a:2 0.34e:2 0.34f:2 0.350:2 0.353:2 0.357:2 0.35b:2 0.35d:2 0.35e:2 0.35f:2 0.361:2 0.366:2 0.368:2 0.369:2 0.36f:2 0.370:2 0.371:2 0.375:2 0.376:2 0.37c:2 0.37e:2 0.380:2 0.384:2 0.387:2 0.38a:2 0.38e:2 0.390:2 0.392:2 0.395:2 0.39a:2 0.39b:2 0.39c:2 0.39d:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b3:2 0.3b4:2 0.3b5:2 0.3ba:2 0.3c1:2 0.3c3:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cc:2 0.3cd:2 0.3d1:2 0.3d2:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3da:2 0.3db:2 0.3dc:2 0.3dd:2 0.3df:2 0.3e0:2 0.3e2:2 0.3e3:2 0.3e5:2 0.3e7:2 0.3ea:2 0.3ec:2 0.3f0:2 0.3f1:2 0.3f4:2 0.3f8:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:37.542215 I | rook-ceph-mon2: 2017-07-11 13:25:33.108430 osd.3 osd.3 10.233.86.0:6800/178 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 56.563008 secs
- 2017-07-11 13:25:37.542238 I | rook-ceph-mon2: 2017-07-11 13:25:33.108435 osd.3 osd.3 10.233.86.0:6800/178 4 : cluster [WRN] slow request 56.563008 seconds old, received at 2017-07-11 13:24:36.545354: osd_pg_create(e15 0.a:2 0.d:2 0.18:2 0.1f:2 0.23:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.72:2 0.7c:2 0.88:2 0.89:2 0.8d:2 0.91:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.b9:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e2:2 0.e9:2 0.ea:2 0.ef:2 0.fc:2 0.ff:2 0.108:2 0.10e:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.127:2 0.12d:2 0.130:2 0.131:2 0.132:2 0.136:2 0.138:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.154:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.184:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.195:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1d7:2 0.1de:2 0.1df:2 0.1e2:2 0.1e3:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1f8:2 0.1fb:2 0.202:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.24e:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.278:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.298:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2ed:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.2ff:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.314:2 0.316:2 0.319:2 0.31d:2 0.31f:2 0.329:2 0.331:2 0.335:2 0.337:2 0.33b:2 0.33c:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.369:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3ba:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3d2:2 0.3d6:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2 0.3f1:2) currently started
- 2017-07-11 13:25:40.206388 I | rook-ceph-mon2: 2017-07-11 13:25:32.591136 osd.2 osd.2 10.233.69.0:6800/178 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.303083 secs
- 2017-07-11 13:25:40.206609 I | rook-ceph-mon2: 2017-07-11 13:25:32.591150 osd.2 osd.2 10.233.69.0:6800/178 4 : cluster [WRN] slow request 60.303083 seconds old, received at 2017-07-11 13:24:32.288034: osd_pg_create(e12 0.5:2 0.7:2 0.9:2 0.12:2 0.13:2 0.14:2 0.15:2 0.16:2 0.17:2 0.1b:2 0.21:2 0.27:2 0.29:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.39:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5b:2 0.5f:2 0.60:2 0.63:2 0.6e:2 0.72:2 0.7a:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.95:2 0.98:2 0.9a:2 0.9d:2 0.9e:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.b8:2 0.ba:2 0.c0:2 0.c2:2 0.c5:2 0.cb:2 0.ce:2 0.d2:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.fe:2 0.100:2 0.106:2 0.107:2 0.10c:2 0.10d:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.127:2 0.128:2 0.12c:2 0.12f:2 0.131:2 0.133:2 0.134:2 0.141:2 0.142:2 0.14b:2 0.14d:2 0.159:2 0.15a:2 0.15c:2 0.160:2 0.161:2 0.166:2 0.169:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.17f:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1db:2 0.1e1:2 0.1e4:2 0.1e9:2 0.1ee:2 0.1f2:2 0.1f3:2 0.1f6:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.21d:2 0.21f:2 0.223:2 0.224:2 0.228:2 0.229:2 0.22b:2 0.22e:2 0.233:2 0.235:2 0.237:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.251:2 0.252:2 0.253:2 0.254:2 0.25c:2 0.265:2 0.267:2 0.269:2 0.26b:2 0.26c:2 0.26d:2 0.276:2 0.278:2 0.279:2 0.27b:2 0.27f:2 0.280:2 0.284:2 0.286:2 0.288:2 0.290:2 0.298:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b3:2 0.2b8:2 0.2b9:2 0.2bf:2 0.2c8:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2df:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ea:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30b:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32d:2 0.32f:2 0.330:2 0.334:2 0.336:2 0.33a:2 0.344:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.359:2 0.363:2 0.364:2 0.366:2 0.369:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b0:2 0.3b2:2 0.3b3:2 0.3b5:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3ed:2 0.3f4:2) currently started
- 2017-07-11 13:25:40.206649 I | rook-ceph-mon2: 2017-07-11 13:25:38.595704 osd.2 osd.2 10.233.69.0:6800/178 5 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 65.997406 secs
- 2017-07-11 13:25:40.206665 I | rook-ceph-mon2: 2017-07-11 13:25:38.595710 osd.2 osd.2 10.233.69.0:6800/178 6 : cluster [WRN] slow request 65.997406 seconds old, received at 2017-07-11 13:24:32.598200: osd_pg_create(e13 0.5:2 0.7:2 0.9:2 0.12:2 0.13:2 0.14:2 0.15:2 0.16:2 0.17:2 0.1b:2 0.21:2 0.27:2 0.29:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.39:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5b:2 0.5f:2 0.60:2 0.63:2 0.6e:2 0.72:2 0.7a:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.95:2 0.98:2 0.9a:2 0.9d:2 0.9e:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.b8:2 0.ba:2 0.c0:2 0.c2:2 0.c5:2 0.cb:2 0.ce:2 0.d2:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.fe:2 0.100:2 0.106:2 0.107:2 0.10c:2 0.10d:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.127:2 0.128:2 0.12c:2 0.12f:2 0.131:2 0.133:2 0.134:2 0.141:2 0.142:2 0.14b:2 0.14d:2 0.159:2 0.15a:2 0.15c:2 0.160:2 0.161:2 0.166:2 0.169:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.17f:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1db:2 0.1e1:2 0.1e4:2 0.1e9:2 0.1ee:2 0.1f2:2 0.1f3:2 0.1f6:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.21d:2 0.21f:2 0.223:2 0.224:2 0.228:2 0.229:2 0.22b:2 0.22e:2 0.233:2 0.235:2 0.237:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.251:2 0.252:2 0.253:2 0.254:2 0.25c:2 0.265:2 0.267:2 0.269:2 0.26b:2 0.26c:2 0.26d:2 0.276:2 0.278:2 0.279:2 0.27b:2 0.27f:2 0.280:2 0.284:2 0.286:2 0.288:2 0.290:2 0.298:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b3:2 0.2b8:2 0.2b9:2 0.2bf:2 0.2c8:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2df:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ea:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30b:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32d:2 0.32f:2 0.330:2 0.334:2 0.336:2 0.33a:2 0.344:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.359:2 0.363:2 0.364:2 0.366:2 0.369:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b0:2 0.3b2:2 0.3b3:2 0.3b5:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3ed:2 0.3f4:2) currently wait for new map
- 2017-07-11 13:25:40.206679 I | rook-ceph-mon2: 2017-07-11 13:25:38.595723 osd.2 osd.2 10.233.69.0:6800/178 7 : cluster [WRN] slow request 64.714804 seconds old, received at 2017-07-11 13:24:33.880802: osd_pg_create(e14 0.5:2 0.7:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.72:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.9a:2 0.9d:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.c2:2 0.c5:2 0.d8:2 0.e0:2 0.e5:2 0.eb:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.127:2 0.12c:2 0.131:2 0.133:2 0.141:2 0.14d:2 0.159:2 0.15c:2 0.161:2 0.166:2 0.16f:2 0.17a:2 0.17b:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.198:2 0.199:2 0.1b7:2 0.1c2:2 0.1c9:2 0.1ce:2 0.1d2:2 0.1da:2 0.1e1:2 0.1f2:2 0.1f3:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.213:2 0.218:2 0.21a:2 0.21f:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26b:2 0.26d:2 0.278:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2cb:2 0.2ce:2 0.2d3:2 0.2d7:2 0.2da:2 0.2db:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f6:2 0.2fd:2 0.306:2 0.30e:2 0.31b:2 0.32f:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.356:2 0.363:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2) currently wait for new map
- 2017-07-11 13:25:42.838444 I | rook-ceph-mon2: 2017-07-11 13:25:37.449548 osd.4 osd.4 10.233.124.4:6800/178 7 : cluster [WRN] 2 slow requests, 1 included below; oldest blocked for > 60.671172 secs
- 2017-07-11 13:25:42.838463 I | rook-ceph-mon2: 2017-07-11 13:25:37.449554 osd.4 osd.4 10.233.124.4:6800/178 8 : cluster [WRN] slow request 60.671172 seconds old, received at 2017-07-11 13:24:36.778345: osd_pg_create(e15 0.10:2 0.13:2 0.1d:2 0.24:2 0.4d:2 0.5b:2 0.6c:2 0.77:2 0.7e:2 0.90:2 0.9e:2 0.ac:2 0.b7:2 0.cd:2 0.ce:2 0.d1:2 0.ed:2 0.f2:2 0.116:2 0.11b:2 0.129:2 0.12e:2 0.133:2 0.13d:2 0.13e:2 0.142:2 0.146:2 0.15e:2 0.176:2 0.187:2 0.1c4:2 0.1dc:2 0.1e8:2 0.203:2 0.23e:2 0.251:2 0.254:2 0.274:2 0.28b:2 0.2b0:2 0.2b3:2 0.2c8:2 0.2f4:2 0.311:2 0.326:2 0.33f:2 0.343:2 0.344:2 0.35e:2 0.36c:2 0.379:2 0.395:2 0.39c:2 0.3a7:2 0.3b0:2 0.3c3:2 0.3e3:2) currently wait for new map
- 2017-07-11 13:25:42.838467 I | rook-ceph-mon2: 2017-07-11 13:25:41.691126 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 131 : cluster [INF] osdmap e20: 6 total, 1 up, 6 in
- 2017-07-11 13:25:44.447074 I | rook-ceph-mon2: 2017-07-11 13:25:43.184296 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 133 : cluster [INF] osd.5 10.233.99.6:6800/179 boot
- 2017-07-11 13:25:44.447364 I | rook-ceph-mon2: 2017-07-11 13:25:43.184645 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 134 : cluster [INF] osd.4 10.233.124.4:6800/178 boot
- 2017-07-11 13:25:44.447395 I | rook-ceph-mon2: 2017-07-11 13:25:43.184928 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 135 : cluster [INF] osdmap e21: 6 total, 3 up, 6 in
- 2017-07-11 13:25:44.447410 I | rook-ceph-mon2: 2017-07-11 13:25:43.610372 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 136 : cluster [INF] osdmap e22: 6 total, 3 up, 6 in
- 2017-07-11 13:25:46.428718 I | rook-ceph-mon2: 2017-07-11 13:25:44.690576 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 113 : audit [INF] from='client.? 10.233.124.5:0/4091151238' entity='client.admin' cmd=[{"prefix": "auth get-key", "entity": "client.admin", "format": "json"}]: dispatch
- 2017-07-11 13:25:46.428939 I | rook-ceph-mon2: 2017-07-11 13:25:44.824113 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 137 : cluster [INF] osdmap e23: 6 total, 3 up, 6 in
- 2017-07-11 13:25:47.494713 I | rook-ceph-mon2: 2017-07-11 13:25:36.822488 osd.0 osd.0 10.233.72.0:6800/180 22 : cluster [WRN] 8 slow requests, 1 included below; oldest blocked for > 66.493134 secs
- 2017-07-11 13:25:47.494925 I | rook-ceph-mon2: 2017-07-11 13:25:36.822497 osd.0 osd.0 10.233.72.0:6800/180 23 : cluster [WRN] slow request 60.219543 seconds old, received at 2017-07-11 13:24:36.602887: osd_pg_create(e15 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.7f:2 0.8b:2 0.a1:2 0.a2:2 0.a6:2 0.a7:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.125:2 0.135:2 0.147:2 0.150:2 0.151:2 0.15a:2 0.16a:2 0.170:2 0.171:2 0.175:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.190:2 0.196:2 0.19c:2 0.1a0:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.21f:2 0.227:2 0.228:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.239:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.32a:2 0.332:2 0.338:2 0.346:2 0.34b:2 0.34d:2 0.35a:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39a:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:47.494969 I | rook-ceph-mon2: 2017-07-11 13:25:37.109010 osd.3 osd.3 10.233.86.0:6800/178 5 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.563637 secs
- 2017-07-11 13:25:47.495012 I | rook-ceph-mon2: 2017-07-11 13:25:37.109016 osd.3 osd.3 10.233.86.0:6800/178 6 : cluster [WRN] slow request 60.563637 seconds old, received at 2017-07-11 13:24:36.545354: osd_pg_create(e15 0.a:2 0.d:2 0.18:2 0.1f:2 0.23:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.72:2 0.7c:2 0.88:2 0.89:2 0.8d:2 0.91:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.b9:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e2:2 0.e9:2 0.ea:2 0.ef:2 0.fc:2 0.ff:2 0.108:2 0.10e:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.127:2 0.12d:2 0.130:2 0.131:2 0.132:2 0.136:2 0.138:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.154:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.184:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.195:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1d7:2 0.1de:2 0.1df:2 0.1e2:2 0.1e3:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1f8:2 0.1fb:2 0.202:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.24e:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.278:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.298:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2ed:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.2ff:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.314:2 0.316:2 0.319:2 0.31d:2 0.31f:2 0.329:2 0.331:2 0.335:2 0.337:2 0.33b:2 0.33c:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.369:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3ba:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3d2:2 0.3d6:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2 0.3f1:2) currently started
- 2017-07-11 13:25:47.495028 I | rook-ceph-mon2: 2017-07-11 13:25:37.822707 osd.0 osd.0 10.233.72.0:6800/180 24 : cluster [WRN] 8 slow requests, 1 included below; oldest blocked for > 67.493358 secs
- 2017-07-11 13:25:47.495045 I | rook-ceph-mon2: 2017-07-11 13:25:37.822725 osd.0 osd.0 10.233.72.0:6800/180 25 : cluster [WRN] slow request 60.546935 seconds old, received at 2017-07-11 13:24:37.275719: osd_pg_create(e16 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:47.495059 I | rook-ceph-mon2: 2017-07-11 13:25:41.823480 osd.0 osd.0 10.233.72.0:6800/180 26 : cluster [WRN] 8 slow requests, 1 included below; oldest blocked for > 71.494159 secs
- 2017-07-11 13:25:47.495087 I | rook-ceph-mon2: 2017-07-11 13:25:41.823485 osd.0 osd.0 10.233.72.0:6800/180 27 : cluster [WRN] slow request 60.262875 seconds old, received at 2017-07-11 13:24:41.560579: osd_pg_create(e17 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:47.495106 I | rook-ceph-mon2: 2017-07-11 13:25:42.116011 osd.3 osd.3 10.233.86.0:6800/178 7 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 64.892901 secs
- 2017-07-11 13:25:47.495119 I | rook-ceph-mon2: 2017-07-11 13:25:42.116021 osd.3 osd.3 10.233.86.0:6800/178 8 : cluster [WRN] slow request 64.892901 seconds old, received at 2017-07-11 13:24:37.222959: osd_pg_create(e16 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:47.495137 I | rook-ceph-mon2: 2017-07-11 13:25:42.116031 osd.3 osd.3 10.233.86.0:6800/178 9 : cluster [WRN] slow request 60.607081 seconds old, received at 2017-07-11 13:24:41.508779: osd_pg_create(e17 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:47.495162 I | rook-ceph-mon2: 2017-07-11 13:25:43.116354 osd.3 osd.3 10.233.86.0:6800/178 10 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 65.893370 secs
- 2017-07-11 13:25:47.495176 I | rook-ceph-mon2: 2017-07-11 13:25:43.116360 osd.3 osd.3 10.233.86.0:6800/178 11 : cluster [WRN] slow request 65.893370 seconds old, received at 2017-07-11 13:24:37.222959: osd_pg_create(e16 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:47.495194 I | rook-ceph-mon2: 2017-07-11 13:25:43.116363 osd.3 osd.3 10.233.86.0:6800/178 12 : cluster [WRN] slow request 61.607550 seconds old, received at 2017-07-11 13:24:41.508779: osd_pg_create(e17 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:47.495207 I | rook-ceph-mon2: 2017-07-11 13:25:44.152154 osd.1 osd.1 10.233.76.4:6800/178 5 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 73.772555 secs
- 2017-07-11 13:25:47.495221 I | rook-ceph-mon2: 2017-07-11 13:25:44.152167 osd.1 osd.1 10.233.76.4:6800/178 6 : cluster [WRN] slow request 73.772555 seconds old, received at 2017-07-11 13:24:30.379551: osd_pg_create(e10 0.3:2 0.9:2 0.2a:2 0.2d:2 0.35:2 0.60:2 0.63:2 0.6e:2 0.76:2 0.7a:2 0.7d:2 0.8a:2 0.ab:2 0.b6:2 0.bc:2 0.ca:2 0.ce:2 0.d2:2 0.eb:2 0.11f:2 0.133:2 0.13e:2 0.141:2 0.148:2 0.14c:2 0.14e:2 0.166:2 0.167:2 0.180:2 0.198:2 0.19e:2 0.1a5:2 0.1a6:2 0.1b6:2 0.1bc:2 0.1d8:2 0.1ef:2 0.21a:2 0.222:2 0.223:2 0.226:2 0.24a:2 0.25c:2 0.25d:2 0.29a:2 0.2a0:2 0.2a6:2 0.2af:2 0.2b1:2 0.2b3:2 0.2c6:2 0.2f6:2 0.300:2 0.325:2 0.32c:2 0.330:2 0.33c:2 0.342:2 0.34b:2 0.363:2 0.36c:2 0.378:2 0.379:2 0.37f:2 0.388:2 0.396:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3e8:2 0.3eb:2) currently wait for new map
- 2017-07-11 13:25:47.495257 I | rook-ceph-mon2: 2017-07-11 13:25:44.491846 osd.3 osd.3 10.233.86.0:6800/178 13 : cluster [WRN] map e18 wrongly marked me down at e18
- 2017-07-11 13:25:47.495268 I | rook-ceph-mon2: 2017-07-11 13:25:45.152387 osd.1 osd.1 10.233.76.4:6800/178 7 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 74.772758 secs
- 2017-07-11 13:25:47.495280 I | rook-ceph-mon2: 2017-07-11 13:25:45.152616 osd.1 osd.1 10.233.76.4:6800/178 8 : cluster [WRN] slow request 74.772758 seconds old, received at 2017-07-11 13:24:30.379551: osd_pg_create(e10 0.3:2 0.9:2 0.2a:2 0.2d:2 0.35:2 0.60:2 0.63:2 0.6e:2 0.76:2 0.7a:2 0.7d:2 0.8a:2 0.ab:2 0.b6:2 0.bc:2 0.ca:2 0.ce:2 0.d2:2 0.eb:2 0.11f:2 0.133:2 0.13e:2 0.141:2 0.148:2 0.14c:2 0.14e:2 0.166:2 0.167:2 0.180:2 0.198:2 0.19e:2 0.1a5:2 0.1a6:2 0.1b6:2 0.1bc:2 0.1d8:2 0.1ef:2 0.21a:2 0.222:2 0.223:2 0.226:2 0.24a:2 0.25c:2 0.25d:2 0.29a:2 0.2a0:2 0.2a6:2 0.2af:2 0.2b1:2 0.2b3:2 0.2c6:2 0.2f6:2 0.300:2 0.325:2 0.32c:2 0.330:2 0.33c:2 0.342:2 0.34b:2 0.363:2 0.36c:2 0.378:2 0.379:2 0.37f:2 0.388:2 0.396:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3e8:2 0.3eb:2) currently wait for new map
- 2017-07-11 13:25:47.495298 I | rook-ceph-mon2: 2017-07-11 13:25:45.152638 osd.1 osd.1 10.233.76.4:6800/178 9 : cluster [WRN] slow request 74.168544 seconds old, received at 2017-07-11 13:24:30.983765: osd_pg_create(e11 0.1:2 0.3:2 0.4:2 0.8:2 0.9:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2a:2 0.2b:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.39:2 0.3c:2 0.40:2 0.41:2 0.43:2 0.4b:2 0.4d:2 0.4e:2 0.52:2 0.5a:2 0.5f:2 0.60:2 0.62:2 0.63:2 0.6d:2 0.6e:2 0.75:2 0.76:2 0.7a:2 0.7d:2 0.80:2 0.81:2 0.87:2 0.8a:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.9a:2 0.9b:2 0.9c:2 0.a9:2 0.ab:2 0.b1:2 0.b2:2 0.b6:2 0.bc:2 0.be:2 0.c9:2 0.ca:2 0.ce:2 0.cf:2 0.d2:2 0.db:2 0.df:2 0.e6:2 0.eb:2 0.f1:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.133:2 0.139:2 0.13b:2 0.13e:2 0.141:2 0.144:2 0.145:2 0.148:2 0.14a:2 0.14b:2 0.14c:2 0.14d:2 0.14e:2 0.155:2 0.158:2 0.159:2 0.15d:2 0.164:2 0.165:2 0.166:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.180:2 0.18e:2 0.18f:2 0.193:2 0.198:2 0.199:2 0.19a:2 0.19b:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d3:2 0.1d8:2 0.1d9:2 0.1dd:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f9:2 0.1fa:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21a:2 0.21b:2 0.220:2 0.222:2 0.223:2 0.225:2 0.226:2 0.230:2 0.233:2 0.234:2 0.236:2 0.240:2 0.241:2 0.244:2 0.24a:2 0.24f:2 0.258:2 0.25a:2 0.25c:2 0.25d:2 0.262:2 0.266:2 0.26c:2 0.274:2 0.275:2 0.27d:2 0.281:2 0.288:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.2a0:2 0.2a3:2 0.2a5:2 0.2a6:2 0.2ad:2 0.2af:2 0.2b1:2 0.2b3:2 0.2ba:2 0.2bd:2 0.2c3:2 0.2c6:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cf:2 0.2d8:2 0.2f6:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.303:2 0.307:2 0.30d:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.325:2 0.32a:2 0.32c:2 0.32e:2 0.330:2 0.336:2 0.339:2 0.33c:2 0.33d:2 0.342:2 0.347:2 0.34b:2 0.34e:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.363:2 0.36c:2 0.370:2 0.375:2 0.376:2 0.378:2 0.379:2 0.37c:2 0.37f:2 0.380:2 0.384:2 0.387:2 0.388:2 0.38a:2 0.38e:2 0.392:2 0.396:2 0.39b:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c3:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cc:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3e0:2 0.3e3:2 0.3e8:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f4:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:25:47.495328 I | rook-ceph-mon2: 2017-07-11 13:25:46.304297 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 138 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:25:47.495342 I | rook-ceph-mon2: 2017-07-11 13:25:46.304832 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 139 : cluster [INF] osdmap e24: 6 total, 4 up, 6 in
- 2017-07-11 13:25:49.022744 I | rook-ceph-mon2: 2017-07-11 13:25:47.816193 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 140 : cluster [INF] osdmap e25: 6 total, 4 up, 6 in
- 2017-07-11 13:25:50.509815 I | rook-ceph-mon2: 2017-07-11 13:25:39.596040 osd.2 osd.2 10.233.69.0:6800/178 8 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 62.798606 secs
- 2017-07-11 13:25:50.509906 I | rook-ceph-mon2: 2017-07-11 13:25:39.596070 osd.2 osd.2 10.233.69.0:6800/178 9 : cluster [WRN] slow request 62.798606 seconds old, received at 2017-07-11 13:24:36.797317: osd_pg_create(e15 0.5:2 0.7:2 0.9:2 0.f:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.70:2 0.7a:2 0.7d:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.92:2 0.94:2 0.97:2 0.98:2 0.9a:2 0.9d:2 0.a5:2 0.a8:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.ba:2 0.c2:2 0.c5:2 0.c9:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.12c:2 0.134:2 0.141:2 0.143:2 0.14b:2 0.14d:2 0.15c:2 0.161:2 0.166:2 0.16c:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19a:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b5:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1e1:2 0.1e9:2 0.1f2:2 0.1f3:2 0.1fd:2 0.1fe:2 0.1ff:2 0.200:2 0.201:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.248:2 0.24a:2 0.24b:2 0.24f:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26a:2 0.26b:2 0.26d:2 0.276:2 0.279:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2f8:2 0.2fd:2 0.306:2 0.30e:2 0.313:2 0.315:2 0.31b:2 0.322:2 0.327:2 0.32f:2 0.330:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.386:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d4:2 0.3d8:2 0.3db:2 0.3dd:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:50.509927 I | rook-ceph-mon2: 2017-07-11 13:25:40.596214 osd.2 osd.2 10.233.69.0:6800/178 10 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 63.798877 secs
- 2017-07-11 13:25:50.509980 I | rook-ceph-mon2: 2017-07-11 13:25:40.596220 osd.2 osd.2 10.233.69.0:6800/178 11 : cluster [WRN] slow request 63.798877 seconds old, received at 2017-07-11 13:24:36.797317: osd_pg_create(e15 0.5:2 0.7:2 0.9:2 0.f:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.70:2 0.7a:2 0.7d:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.92:2 0.94:2 0.97:2 0.98:2 0.9a:2 0.9d:2 0.a5:2 0.a8:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.ba:2 0.c2:2 0.c5:2 0.c9:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.12c:2 0.134:2 0.141:2 0.143:2 0.14b:2 0.14d:2 0.15c:2 0.161:2 0.166:2 0.16c:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19a:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b5:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1e1:2 0.1e9:2 0.1f2:2 0.1f3:2 0.1fd:2 0.1fe:2 0.1ff:2 0.200:2 0.201:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.248:2 0.24a:2 0.24b:2 0.24f:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26a:2 0.26b:2 0.26d:2 0.276:2 0.279:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2f8:2 0.2fd:2 0.306:2 0.30e:2 0.313:2 0.315:2 0.31b:2 0.322:2 0.327:2 0.32f:2 0.330:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.386:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d4:2 0.3d8:2 0.3db:2 0.3dd:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:50.510009 I | rook-ceph-mon2: 2017-07-11 13:25:49.415298 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 141 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:25:50.510022 I | rook-ceph-mon2: 2017-07-11 13:25:49.415718 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 142 : cluster [INF] osdmap e26: 6 total, 5 up, 6 in
- 2017-07-11 13:25:51.015033 I | rook-ceph-mon2: 2017-07-11 13:25:51.014999 7f0c86e1b700 1 heartbeat_map reset_timeout 'cpu_tp thread cpu_tp' had timed out after 0
- 2017-07-11 13:25:51.934383 I | rook-ceph-mon2: 2017-07-11 13:25:42.450433 osd.4 osd.4 10.233.124.4:6800/178 9 : cluster [WRN] 2 slow requests, 1 included below; oldest blocked for > 65.672029 secs
- 2017-07-11 13:25:51.934539 I | rook-ceph-mon2: 2017-07-11 13:25:42.450446 osd.4 osd.4 10.233.124.4:6800/178 10 : cluster [WRN] slow request 60.755602 seconds old, received at 2017-07-11 13:24:41.694773: osd_pg_create(e17 0.10:2 0.14:2 0.17:2 0.1d:2 0.24:2 0.29:2 0.2d:2 0.37:2 0.3d:2 0.40:2 0.42:2 0.45:2 0.46:2 0.48:2 0.4a:2 0.55:2 0.5a:2 0.5c:2 0.62:2 0.65:2 0.68:2 0.6c:2 0.6d:2 0.78:2 0.83:2 0.90:2 0.95:2 0.9c:2 0.9e:2 0.b0:2 0.b5:2 0.b7:2 0.b8:2 0.bc:2 0.bd:2 0.c0:2 0.c8:2 0.cb:2 0.ce:2 0.d1:2 0.e6:2 0.e7:2 0.f2:2 0.fe:2 0.100:2 0.101:2 0.10a:2 0.10f:2 0.114:2 0.116:2 0.128:2 0.12a:2 0.12e:2 0.12f:2 0.13e:2 0.142:2 0.149:2 0.14c:2 0.14f:2 0.15e:2 0.160:2 0.162:2 0.163:2 0.164:2 0.169:2 0.16b:2 0.17f:2 0.182:2 0.185:2 0.18f:2 0.19b:2 0.1a5:2 0.1bc:2 0.1c7:2 0.1d9:2 0.1db:2 0.1dc:2 0.1dd:2 0.1e4:2 0.1e8:2 0.1ee:2 0.1f6:2 0.1f7:2 0.204:2 0.208:2 0.210:2 0.217:2 0.21d:2 0.226:2 0.229:2 0.22b:2 0.230:2 0.235:2 0.237:2 0.23a:2 0.23b:2 0.23e:2 0.241:2 0.243:2 0.24d:2 0.254:2 0.25b:2 0.25e:2 0.261:2 0.265:2 0.26c:2 0.27b:2 0.27d:2 0.27f:2 0.283:2 0.284:2 0.288:2 0.2ae:2 0.2b0:2 0.2b1:2 0.2b4:2 0.2bb:2 0.2bf:2 0.2c0:2 0.2c3:2 0.2c5:2 0.2cd:2 0.2cf:2 0.2df:2 0.2e9:2 0.2ea:2 0.2f9:2 0.303:2 0.309:2 0.30a:2 0.30b:2 0.30d:2 0.312:2 0.325:2 0.32b:2 0.32c:2 0.32d:2 0.333:2 0.334:2 0.339:2 0.33a:2 0.33f:2 0.342:2 0.344:2 0.359:2 0.362:2 0.368:2 0.36c:2 0.379:2 0.37a:2 0.38f:2 0.395:2 0.3a2:2 0.3a8:2 0.3a9:2 0.3b1:2 0.3b4:2 0.3b5:2 0.3be:2 0.3c3:2 0.3c5:2 0.3d1:2 0.3d5:2 0.3da:2 0.3e0:2 0.3e9:2 0.3eb:2 0.3ed:2 0.3ef:2 0.3f6:2 0.3f7:2 0.3f9:2) currently wait for new map
- 2017-07-11 13:25:51.934573 I | rook-ceph-mon2: 2017-07-11 13:25:50.802127 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 143 : cluster [INF] osdmap e27: 6 total, 5 up, 6 in
- 2017-07-11 13:25:52.620840 I | rook-ceph-mon2: 2017-07-11 13:25:52.620803 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:25:52.621032 I | rook-ceph-mon2: 2017-07-11 13:25:52.621010 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3888696618' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:25:53.282907 I | rook-ceph-mon2: 2017-07-11 13:25:52.276339 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 144 : cluster [INF] osdmap e28: 6 total, 5 up, 6 in
- 2017-07-11 13:25:55.088791 I | rook-ceph-mon2: 2017-07-11 13:25:53.484257 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 145 : cluster [INF] osdmap e29: 6 total, 5 up, 6 in
- 2017-07-11 13:25:56.913493 I | rook-ceph-mon2: 2017-07-11 13:25:54.731782 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 146 : cluster [INF] osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:25:56.913749 I | rook-ceph-mon2: 2017-07-11 13:25:54.732341 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 147 : cluster [INF] osdmap e30: 6 total, 6 up, 6 in
- 2017-07-11 13:25:57.621738 I | rook-ceph-mon2: 2017-07-11 13:25:57.621547 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4802 MB, avail 94384 MB
- 2017-07-11 13:25:57.884930 I | rook-ceph-mon2: 2017-07-11 13:25:46.152882 osd.1 osd.1 10.233.76.4:6800/178 10 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 73.939919 secs
- 2017-07-11 13:25:57.885026 I | rook-ceph-mon2: 2017-07-11 13:25:46.152889 osd.1 osd.1 10.233.76.4:6800/178 11 : cluster [WRN] slow request 73.939919 seconds old, received at 2017-07-11 13:24:32.212896: osd_pg_create(e12 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:57.885052 I | rook-ceph-mon2: 2017-07-11 13:25:47.153164 osd.1 osd.1 10.233.76.4:6800/178 12 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 74.940232 secs
- 2017-07-11 13:25:57.885089 I | rook-ceph-mon2: 2017-07-11 13:25:47.153170 osd.1 osd.1 10.233.76.4:6800/178 13 : cluster [WRN] slow request 74.940232 seconds old, received at 2017-07-11 13:24:32.212896: osd_pg_create(e12 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:57.885108 I | rook-ceph-mon2: 2017-07-11 13:25:56.232388 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 148 : cluster [INF] osdmap e31: 6 total, 6 up, 6 in
- 2017-07-11 13:25:57.885120 I | rook-ceph-mon2: 2017-07-11 13:25:57.505311 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 149 : cluster [INF] osdmap e32: 6 total, 6 up, 6 in
- 2017-07-11 13:25:59.093233 I | rook-ceph-mon2: 2017-07-11 13:25:58.721953 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 150 : cluster [INF] osdmap e33: 6 total, 6 up, 6 in
- 2017-07-11 13:26:00.413826 I | rook-ceph-mon2: 2017-07-11 13:25:52.187081 osd.2 osd.2 10.233.69.0:6800/178 12 : cluster [WRN] map e18 wrongly marked me down at e18
- 2017-07-11 13:26:00.414069 I | rook-ceph-mon2: 2017-07-11 13:25:52.604404 osd.2 osd.2 10.233.69.0:6800/178 13 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 70.890580 secs
- 2017-07-11 13:26:00.414103 I | rook-ceph-mon2: 2017-07-11 13:25:52.604411 osd.2 osd.2 10.233.69.0:6800/178 14 : cluster [WRN] slow request 70.890580 seconds old, received at 2017-07-11 13:24:41.713752: osd_pg_create(e17 0.5:2 0.7:2 0.9:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.7a:2 0.7d:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.92:2 0.94:2 0.98:2 0.9a:2 0.9d:2 0.a5:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.ba:2 0.c2:2 0.c5:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.12c:2 0.141:2 0.14d:2 0.15c:2 0.161:2 0.166:2 0.16f:2 0.178:2 0.17a:2 0.180:2 0.189:2 0.18c:2 0.197:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1da:2 0.1e1:2 0.1e9:2 0.1f2:2 0.1f3:2 0.1ff:2 0.200:2 0.201:2 0.213:2 0.218:2 0.21a:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.248:2 0.24a:2 0.24b:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26b:2 0.26d:2 0.276:2 0.279:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b8:2 0.2b9:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d7:2 0.2da:2 0.2db:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32f:2 0.330:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2) currently wait for new map
- 2017-07-11 13:26:01.678925 I | rook-ceph-mon2: 2017-07-11 13:26:00.125232 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 151 : cluster [INF] osdmap e34: 6 total, 6 up, 6 in
- 2017-07-11 13:26:02.701370 I | rook-ceph-mon2: 2017-07-11 13:26:01.452352 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 152 : cluster [INF] osdmap e35: 6 total, 6 up, 6 in
- 2017-07-11 13:26:02.701454 I | rook-ceph-mon2: 2017-07-11 13:26:02.568175 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 153 : cluster [INF] osdmap e36: 6 total, 6 up, 6 in
- 2017-07-11 13:26:05.034582 I | rook-ceph-mon2: 2017-07-11 13:26:05.034520 7f0c85e19700 1 heartbeat_map reset_timeout 'cpu_tp thread cpu_tp' had timed out after 0
- 2017-07-11 13:26:05.283498 I | rook-ceph-mon2: 2017-07-11 13:26:03.831913 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 155 : cluster [INF] osdmap e37: 6 total, 6 up, 6 in
- 2017-07-11 13:26:05.283630 I | rook-ceph-mon2: 2017-07-11 13:26:04.966217 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 156 : cluster [INF] osdmap e38: 6 total, 6 up, 6 in
- 2017-07-11 13:26:07.169394 I | rook-ceph-mon2: 2017-07-11 13:26:03.158303 osd.1 osd.1 10.233.76.4:6800/178 14 : cluster [WRN] 3 slow requests, 2 included below; oldest blocked for > 90.945374 secs
- 2017-07-11 13:26:07.169642 I | rook-ceph-mon2: 2017-07-11 13:26:03.158308 osd.1 osd.1 10.233.76.4:6800/178 15 : cluster [WRN] slow request 30.315376 seconds old, received at 2017-07-11 13:25:32.842895: pg_notify((query:13 sent:13 0.10a( empty local-lis/les=0/0 n=0 ec=2/2 lis/c 0/0 les/c/f 0/0/0 12/12/12))=([2,11] intervals=) epoch 13) currently wait for new map
- 2017-07-11 13:26:07.169674 I | rook-ceph-mon2: 2017-07-11 13:26:03.158311 osd.1 osd.1 10.233.76.4:6800/178 16 : cluster [WRN] slow request 30.095310 seconds old, received at 2017-07-11 13:25:33.062960: pg_notify((query:13 sent:13 0.187( empty local-lis/les=0/0 n=0 ec=2/2 lis/c 0/0 les/c/f 0/0/0 12/12/12))=([2,11] intervals=) epoch 15) currently wait for new map
- 2017-07-11 13:26:07.169729 I | rook-ceph-mon2: 2017-07-11 13:26:05.280675 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 157 : cluster [INF] HEALTH_WARN; 750 pgs peering; 4 requests are blocked > 32 sec; 1 osds have slow requests; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:26:08.264991 I | rook-ceph-mon2: 2017-07-11 13:26:06.296015 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 158 : cluster [INF] osdmap e39: 6 total, 6 up, 6 in
- 2017-07-11 13:26:08.265215 I | rook-ceph-mon2: 2017-07-11 13:26:07.583646 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 159 : cluster [INF] osdmap e40: 6 total, 6 up, 6 in
- 2017-07-11 13:26:09.807849 I | rook-ceph-mon2: 2017-07-11 13:26:08.812100 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 161 : cluster [INF] osdmap e41: 6 total, 6 up, 6 in
- 2017-07-11 13:26:11.284693 I | rook-ceph-mon2: 2017-07-11 13:26:10.140233 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 162 : cluster [INF] osdmap e42: 6 total, 6 up, 6 in
- 2017-07-11 13:26:12.633977 I | rook-ceph-mon2: 2017-07-11 13:26:11.581302 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 163 : cluster [INF] osdmap e43: 6 total, 6 up, 6 in
- 2017-07-11 13:26:14.066670 I | rook-ceph-mon2: 2017-07-11 13:26:12.836360 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 164 : cluster [INF] osdmap e44: 6 total, 6 up, 6 in
- 2017-07-11 13:26:15.409837 I | rook-ceph-mon2: 2017-07-11 13:26:14.259921 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 165 : cluster [INF] osdmap e45: 6 total, 6 up, 6 in
- 2017-07-11 13:26:17.011632 I | rook-ceph-mon2: 2017-07-11 13:26:07.159298 osd.1 osd.1 10.233.76.4:6800/178 17 : cluster [WRN] 9 slow requests, 5 included below; oldest blocked for > 94.465619 secs
- 2017-07-11 13:26:17.012293 I | rook-ceph-mon2: 2017-07-11 13:26:07.159317 osd.1 osd.1 10.233.76.4:6800/178 18 : cluster [WRN] slow request 94.465619 seconds old, received at 2017-07-11 13:24:32.693479: osd_pg_create(e13 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.012379 I | rook-ceph-mon2: 2017-07-11 13:26:07.159321 osd.1 osd.1 10.233.76.4:6800/178 19 : cluster [WRN] slow request 93.307052 seconds old, received at 2017-07-11 13:24:33.852047: osd_pg_create(e14 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.35:2 0.36:2 0.38:2 0.4d:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.76:2 0.80:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a9:2 0.b1:2 0.b2:2 0.b9:2 0.be:2 0.c9:2 0.ca:2 0.cf:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.209:2 0.215:2 0.21b:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.274:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2ed:2 0.2f7:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cd:2 0.3d3:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.012401 I | rook-ceph-mon2: 2017-07-11 13:26:07.159324 osd.1 osd.1 10.233.76.4:6800/178 20 : cluster [WRN] slow request 90.557336 seconds old, received at 2017-07-11 13:24:36.601763: osd_pg_create(e15 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.26:2 0.2a:2 0.35:2 0.36:2 0.38:2 0.41:2 0.4e:2 0.4f:2 0.50:2 0.52:2 0.60:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.c3:2 0.ca:2 0.cf:2 0.d2:2 0.db:2 0.df:2 0.e8:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.115:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.157:2 0.158:2 0.159:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.177:2 0.17d:2 0.18d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ab:2 0.1ae:2 0.1af:2 0.1b6:2 0.1bb:2 0.1bd:2 0.1bf:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.23d:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28e:2 0.291:2 0.294:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2a6:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2dd:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.363:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ac:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ea:2 0.3ec:2 0.3f5:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.012419 I | rook-ceph-mon2: 2017-07-11 13:26:07.159327 osd.1 osd.1 10.233.76.4:6800/178 21 : cluster [WRN] slow request 89.889977 seconds old, received at 2017-07-11 13:24:37.269122: osd_pg_create(e16 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.012464 I | rook-ceph-mon2: 2017-07-11 13:26:07.159329 osd.1 osd.1 10.233.76.4:6800/178 22 : cluster [WRN] slow request 85.594176 seconds old, received at 2017-07-11 13:24:41.564923: osd_pg_create(e17 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.012482 I | rook-ceph-mon2: 2017-07-11 13:26:08.159690 osd.1 osd.1 10.233.76.4:6800/178 23 : cluster [WRN] 9 slow requests, 5 included below; oldest blocked for > 95.466107 secs
- 2017-07-11 13:26:17.012498 I | rook-ceph-mon2: 2017-07-11 13:26:08.159695 osd.1 osd.1 10.233.76.4:6800/178 24 : cluster [WRN] slow request 95.466107 seconds old, received at 2017-07-11 13:24:32.693479: osd_pg_create(e13 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.012528 I | rook-ceph-mon2: 2017-07-11 13:26:08.159700 osd.1 osd.1 10.233.76.4:6800/178 25 : cluster [WRN] slow request 94.307540 seconds old, received at 2017-07-11 13:24:33.852047: osd_pg_create(e14 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.35:2 0.36:2 0.38:2 0.4d:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.76:2 0.80:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a9:2 0.b1:2 0.b2:2 0.b9:2 0.be:2 0.c9:2 0.ca:2 0.cf:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.209:2 0.215:2 0.21b:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.274:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2ed:2 0.2f7:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cd:2 0.3d3:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.012546 I | rook-ceph-mon2: 2017-07-11 13:26:08.159703 osd.1 osd.1 10.233.76.4:6800/178 26 : cluster [WRN] slow request 91.557823 seconds old, received at 2017-07-11 13:24:36.601763: osd_pg_create(e15 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.26:2 0.2a:2 0.35:2 0.36:2 0.38:2 0.41:2 0.4e:2 0.4f:2 0.50:2 0.52:2 0.60:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.c3:2 0.ca:2 0.cf:2 0.d2:2 0.db:2 0.df:2 0.e8:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.115:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.157:2 0.158:2 0.159:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.177:2 0.17d:2 0.18d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ab:2 0.1ae:2 0.1af:2 0.1b6:2 0.1bb:2 0.1bd:2 0.1bf:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.23d:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28e:2 0.291:2 0.294:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2a6:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2dd:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.363:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ac:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ea:2 0.3ec:2 0.3f5:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.012559 I | rook-ceph-mon2: 2017-07-11 13:26:08.159713 osd.1 osd.1 10.233.76.4:6800/178 27 : cluster [WRN] slow request 90.890464 seconds old, received at 2017-07-11 13:24:37.269122: osd_pg_create(e16 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.012578 I | rook-ceph-mon2: 2017-07-11 13:26:08.159722 osd.1 osd.1 10.233.76.4:6800/178 28 : cluster [WRN] slow request 86.594663 seconds old, received at 2017-07-11 13:24:41.564923: osd_pg_create(e17 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:17.012642 I | rook-ceph-mon2: 2017-07-11 13:26:12.160449 osd.1 osd.1 10.233.76.4:6800/178 29 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.466879 secs
- 2017-07-11 13:26:17.012660 I | rook-ceph-mon2: 2017-07-11 13:26:12.160455 osd.1 osd.1 10.233.76.4:6800/178 30 : cluster [WRN] slow request 30.466879 seconds old, received at 2017-07-11 13:25:41.693498: osd_pg_create(e20 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20) currently started
- 2017-07-11 13:26:17.012700 I | rook-ceph-mon2: 2017-07-11 13:26:14.161571 osd.1 osd.1 10.233.76.4:6800/178 31 : cluster [WRN] 2 slow requests, 1 included below; oldest blocked for > 32.468001 secs
- 2017-07-11 13:26:17.012719 I | rook-ceph-mon2: 2017-07-11 13:26:14.161591 osd.1 osd.1 10.233.76.4:6800/178 32 : cluster [WRN] slow request 30.543300 seconds old, received at 2017-07-11 13:25:43.618199: osd_pg_create(e22 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22) currently wait for new map
- 2017-07-11 13:26:17.012733 I | rook-ceph-mon2: 2017-07-11 13:26:15.161812 osd.1 osd.1 10.233.76.4:6800/178 33 : cluster [WRN] 3 slow requests, 1 included below; oldest blocked for > 33.468212 secs
- 2017-07-11 13:26:17.012752 I | rook-ceph-mon2: 2017-07-11 13:26:15.161819 osd.1 osd.1 10.233.76.4:6800/178 34 : cluster [WRN] slow request 30.327390 seconds old, received at 2017-07-11 13:25:44.834321: osd_pg_create(e23 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23) currently wait for new map
- 2017-07-11 13:26:17.012780 I | rook-ceph-mon2: 2017-07-11 13:26:15.869629 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 167 : cluster [INF] osdmap e46: 6 total, 6 up, 6 in
- 2017-07-11 13:26:18.551238 I | rook-ceph-mon2: 2017-07-11 13:26:17.194839 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 170 : cluster [INF] osdmap e47: 6 total, 6 up, 6 in
- 2017-07-11 13:26:20.159952 I | rook-ceph-mon2: 2017-07-11 13:26:18.359917 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 171 : cluster [INF] osdmap e48: 6 total, 6 up, 6 in
- 2017-07-11 13:26:21.414497 I | rook-ceph-mon2: 2017-07-11 13:26:20.095975 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 174 : cluster [INF] osdmap e49: 6 total, 6 up, 6 in
- 2017-07-11 13:26:22.745161 I | rook-ceph-mon2: 2017-07-11 13:26:21.595157 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 176 : cluster [INF] osdmap e50: 6 total, 6 up, 6 in
- 2017-07-11 13:26:24.189301 I | rook-ceph-mon2: 2017-07-11 13:26:22.933159 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 177 : cluster [INF] osdmap e51: 6 total, 6 up, 6 in
- 2017-07-11 13:26:24.544913 I | rook-ceph-mon2: 2017-07-11 13:26:24.544864 7f0c84e17700 0 log_channel(cluster) log [WRN] : message from mon.0 was stamped 0.061434s in the future, clocks not synchronized
- 2017-07-11 13:26:25.650202 I | rook-ceph-mon2: 2017-07-11 13:26:24.544978 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 17 : cluster [WRN] message from mon.0 was stamped 0.061434s in the future, clocks not synchronized
- 2017-07-11 13:26:25.650461 I | rook-ceph-mon2: 2017-07-11 13:26:24.607488 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 181 : cluster [INF] osdmap e52: 6 total, 6 up, 6 in
- 2017-07-11 13:26:25.650491 I | rook-ceph-mon2: 2017-07-11 13:26:24.984666 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 182 : cluster [INF] osdmap e53: 6 total, 6 up, 6 in
- 2017-07-11 13:26:27.061236 I | rook-ceph-mon2: 2017-07-11 13:26:17.162225 osd.1 osd.1 10.233.76.4:6800/178 35 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 35.468642 secs
- 2017-07-11 13:26:27.061439 I | rook-ceph-mon2: 2017-07-11 13:26:17.162232 osd.1 osd.1 10.233.76.4:6800/178 36 : cluster [WRN] slow request 30.848726 seconds old, received at 2017-07-11 13:25:46.313414: osd_pg_create(e24 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24) currently wait for new map
- 2017-07-11 13:26:27.061494 I | rook-ceph-mon2: 2017-07-11 13:26:20.829370 osd.0 osd.0 10.233.72.0:6800/180 28 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.071046 secs
- 2017-07-11 13:26:27.061520 I | rook-ceph-mon2: 2017-07-11 13:26:20.829376 osd.0 osd.0 10.233.72.0:6800/180 29 : cluster [WRN] slow request 30.071046 seconds old, received at 2017-07-11 13:25:50.758281: osd_pg_create(e27 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27) currently started
- 2017-07-11 13:26:27.061591 I | rook-ceph-mon2: 2017-07-11 13:26:22.829661 osd.0 osd.0 10.233.72.0:6800/180 30 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.543594 secs
- 2017-07-11 13:26:27.061616 I | rook-ceph-mon2: 2017-07-11 13:26:22.829679 osd.0 osd.0 10.233.72.0:6800/180 31 : cluster [WRN] slow request 30.543594 seconds old, received at 2017-07-11 13:25:52.286024: osd_pg_create(e28 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28) currently started
- 2017-07-11 13:26:27.061629 I | rook-ceph-mon2: 2017-07-11 13:26:24.830147 osd.0 osd.0 10.233.72.0:6800/180 32 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.142821 secs
- 2017-07-11 13:26:27.061666 I | rook-ceph-mon2: 2017-07-11 13:26:24.830158 osd.0 osd.0 10.233.72.0:6800/180 33 : cluster [WRN] slow request 30.142821 seconds old, received at 2017-07-11 13:25:54.687199: osd_pg_create(e30 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30) currently started
- 2017-07-11 13:26:27.061689 I | rook-ceph-mon2: 2017-07-11 13:26:26.249529 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 183 : cluster [INF] osdmap e54: 6 total, 6 up, 6 in
- 2017-07-11 13:26:28.662162 I | rook-ceph-mon2: 2017-07-11 13:26:27.534845 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 184 : cluster [INF] osdmap e55: 6 total, 6 up, 6 in
- 2017-07-11 13:26:30.269934 I | rook-ceph-mon2: 2017-07-11 13:26:28.974868 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 185 : cluster [INF] osdmap e56: 6 total, 6 up, 6 in
- 2017-07-11 13:26:32.237125 I | rook-ceph-mon2: 2017-07-11 13:26:30.479527 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 186 : cluster [INF] osdmap e57: 6 total, 6 up, 6 in
- 2017-07-11 13:26:33.046348 I | rook-ceph-mon2: 2017-07-11 13:26:31.970396 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 187 : cluster [INF] osdmap e58: 6 total, 6 up, 6 in
- 2017-07-11 13:26:34.412243 I | rook-ceph-mon2: 2017-07-11 13:26:33.376719 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 188 : cluster [INF] osdmap e59: 6 total, 6 up, 6 in
- 2017-07-11 13:26:35.858373 I | rook-ceph-mon2: 2017-07-11 13:26:34.780390 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 190 : cluster [INF] osdmap e60: 6 total, 6 up, 6 in
- 2017-07-11 13:26:37.284055 I | rook-ceph-mon2: 2017-07-11 13:26:26.830562 osd.0 osd.0 10.233.72.0:6800/180 34 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.597081 secs
- 2017-07-11 13:26:37.284144 I | rook-ceph-mon2: 2017-07-11 13:26:26.830569 osd.0 osd.0 10.233.72.0:6800/180 35 : cluster [WRN] slow request 30.597081 seconds old, received at 2017-07-11 13:25:56.233433: osd_pg_create(e31 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31) currently started
- 2017-07-11 13:26:37.284164 I | rook-ceph-mon2: 2017-07-11 13:26:27.830893 osd.0 osd.0 10.233.72.0:6800/180 36 : cluster [WRN] 2 slow requests, 1 included below; oldest blocked for > 31.597350 secs
- 2017-07-11 13:26:37.284195 I | rook-ceph-mon2: 2017-07-11 13:26:27.830902 osd.0 osd.0 10.233.72.0:6800/180 37 : cluster [WRN] slow request 30.309489 seconds old, received at 2017-07-11 13:25:57.521293: osd_pg_create(e32 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32) currently wait for new map
- 2017-07-11 13:26:37.284213 I | rook-ceph-mon2: 2017-07-11 13:26:28.831009 osd.0 osd.0 10.233.72.0:6800/180 38 : cluster [WRN] 3 slow requests, 1 included below; oldest blocked for > 32.597519 secs
- 2017-07-11 13:26:37.284225 I | rook-ceph-mon2: 2017-07-11 13:26:28.831014 osd.0 osd.0 10.233.72.0:6800/180 39 : cluster [WRN] slow request 30.100007 seconds old, received at 2017-07-11 13:25:58.730944: osd_pg_create(e33 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33) currently wait for new map
- 2017-07-11 13:26:37.284238 I | rook-ceph-mon2: 2017-07-11 13:26:30.831460 osd.0 osd.0 10.233.72.0:6800/180 40 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 34.597969 secs
- 2017-07-11 13:26:37.284265 I | rook-ceph-mon2: 2017-07-11 13:26:30.831466 osd.0 osd.0 10.233.72.0:6800/180 41 : cluster [WRN] slow request 30.753834 seconds old, received at 2017-07-11 13:26:00.077568: osd_pg_create(e34 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:37.284280 I | rook-ceph-mon2: 2017-07-11 13:26:31.831824 osd.0 osd.0 10.233.72.0:6800/180 42 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 34.310429 secs
- 2017-07-11 13:26:37.284297 I | rook-ceph-mon2: 2017-07-11 13:26:31.831833 osd.0 osd.0 10.233.72.0:6800/180 43 : cluster [WRN] slow request 30.375894 seconds old, received at 2017-07-11 13:26:01.455829: osd_pg_create(e35 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:37.284309 I | rook-ceph-mon2: 2017-07-11 13:26:32.832209 osd.0 osd.0 10.233.72.0:6800/180 44 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 34.101149 secs
- 2017-07-11 13:26:37.284320 I | rook-ceph-mon2: 2017-07-11 13:26:32.832221 osd.0 osd.0 10.233.72.0:6800/180 45 : cluster [WRN] slow request 30.254009 seconds old, received at 2017-07-11 13:26:02.578084: osd_pg_create(e36 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:37.284350 I | rook-ceph-mon2: 2017-07-11 13:26:33.832455 osd.0 osd.0 10.233.72.0:6800/180 46 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 33.754838 secs
- 2017-07-11 13:26:37.284362 I | rook-ceph-mon2: 2017-07-11 13:26:33.832460 osd.0 osd.0 10.233.72.0:6800/180 47 : cluster [WRN] slow request 30.052972 seconds old, received at 2017-07-11 13:26:03.779434: osd_pg_create(e37 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:37.284373 I | rook-ceph-mon2: 2017-07-11 13:26:36.091120 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 191 : cluster [INF] osdmap e61: 6 total, 6 up, 6 in
- 2017-07-11 13:26:38.322106 I | rook-ceph-mon2: 2017-07-11 13:26:38.322063 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 13:26:38.322325 I | rook-ceph-mon2: 2017-07-11 13:26:38.322216 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3790781481' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 13:26:38.871474 I | rook-ceph-mon2: 2017-07-11 13:26:37.593638 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 193 : cluster [INF] osdmap e62: 6 total, 6 up, 6 in
- 2017-07-11 13:26:40.101006 I | rook-ceph-mon2: 2017-07-11 13:26:38.748128 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 194 : cluster [INF] osdmap e63: 6 total, 6 up, 6 in
- 2017-07-11 13:26:40.101081 I | rook-ceph-mon2: 2017-07-11 13:26:39.827594 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 195 : cluster [INF] osdmap e64: 6 total, 6 up, 6 in
- 2017-07-11 13:26:42.045815 I | rook-ceph-mon2: 2017-07-11 13:26:40.946120 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 196 : cluster [INF] osdmap e65: 6 total, 6 up, 6 in
- 2017-07-11 13:26:43.298295 I | rook-ceph-mon2: 2017-07-11 13:26:42.221963 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 197 : cluster [INF] osdmap e66: 6 total, 6 up, 6 in
- 2017-07-11 13:26:44.695905 I | rook-ceph-mon2: 2017-07-11 13:26:43.554323 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 199 : cluster [INF] osdmap e67: 6 total, 6 up, 6 in
- 2017-07-11 13:26:45.887838 I | rook-ceph-mon2: 2017-07-11 13:26:44.559618 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 200 : cluster [INF] osdmap e68: 6 total, 6 up, 6 in
- 2017-07-11 13:26:45.887868 I | rook-ceph-mon2: 2017-07-11 13:26:45.713969 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 202 : cluster [INF] osdmap e69: 6 total, 6 up, 6 in
- 2017-07-11 13:26:46.479966 I | rook-ceph-mon2: 2017-07-11 13:26:46.479939 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 13:26:46.486261 I | rook-ceph-mon2: 2017-07-11 13:26:46.480053 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1553959667' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 13:26:47.142982 I | rook-ceph-mon2: 2017-07-11 13:26:47.142945 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:26:47.143231 I | rook-ceph-mon2: 2017-07-11 13:26:47.143210 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4071857183' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:26:47.172749 I | rook-ceph-mon2: 2017-07-11 13:26:38.835307 osd.0 osd.0 10.233.72.0:6800/180 48 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.076084 secs
- 2017-07-11 13:26:47.172799 I | rook-ceph-mon2: 2017-07-11 13:26:38.835318 osd.0 osd.0 10.233.72.0:6800/180 49 : cluster [WRN] slow request 30.076084 seconds old, received at 2017-07-11 13:26:08.759104: osd_pg_create(e41 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:47.172819 I | rook-ceph-mon2: 2017-07-11 13:26:43.166749 osd.1 osd.1 10.233.76.4:6800/178 37 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 55.346405 secs
- 2017-07-11 13:26:47.172839 I | rook-ceph-mon2: 2017-07-11 13:26:43.166758 osd.1 osd.1 10.233.76.4:6800/178 38 : cluster [WRN] slow request 55.346405 seconds old, received at 2017-07-11 13:25:47.820229: osd_pg_create(e25 0.3:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25) currently started
- 2017-07-11 13:26:47.172873 I | rook-ceph-mon2: 2017-07-11 13:26:45.805588 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 203 : cluster [INF] osd.0 failed (root=default,host=master-1) (4 reporters from different host after 26.267545 >= grace 23.937452)
- 2017-07-11 13:26:47.172884 I | rook-ceph-mon2: 2017-07-11 13:26:45.805620 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 204 : cluster [INF] osd.3 failed (root=default,host=master-2) (4 reporters from different host after 26.267504 >= grace 23.712746)
- 2017-07-11 13:26:47.172894 I | rook-ceph-mon2: 2017-07-11 13:26:46.134972 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 205 : cluster [INF] osdmap e70: 6 total, 4 up, 6 in
- 2017-07-11 13:26:48.585718 I | rook-ceph-mon2: 2017-07-11 13:26:46.043420 osd.3 osd.3 10.233.86.0:6800/178 14 : cluster [WRN] map e70 wrongly marked me down at e70
- 2017-07-11 13:26:48.585735 I | rook-ceph-mon2: 2017-07-11 13:26:47.543925 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 206 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:26:48.585739 I | rook-ceph-mon2: 2017-07-11 13:26:47.544312 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 207 : cluster [INF] osdmap e71: 6 total, 5 up, 6 in
- 2017-07-11 13:26:49.983015 I | rook-ceph-mon2: 2017-07-11 13:26:48.833016 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 208 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:26:49.983123 I | rook-ceph-mon2: 2017-07-11 13:26:48.833386 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 209 : cluster [INF] osdmap e72: 6 total, 6 up, 6 in
- 2017-07-11 13:26:51.411960 I | rook-ceph-mon2: 2017-07-11 13:26:50.173078 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 210 : cluster [INF] osdmap e73: 6 total, 6 up, 6 in
- 2017-07-11 13:26:52.948204 I | rook-ceph-mon2: 2017-07-11 13:26:51.878798 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 211 : cluster [INF] osdmap e74: 6 total, 6 up, 6 in
- 2017-07-11 13:26:54.510002 I | rook-ceph-mon2: 2017-07-11 13:26:53.234203 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 212 : cluster [INF] osdmap e75: 6 total, 6 up, 6 in
- 2017-07-11 13:26:55.683091 I | rook-ceph-mon2: 2017-07-11 13:26:54.323052 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 213 : cluster [INF] osdmap e76: 6 total, 6 up, 6 in
- 2017-07-11 13:26:55.683174 I | rook-ceph-mon2: 2017-07-11 13:26:55.490453 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 214 : cluster [INF] osdmap e77: 6 total, 6 up, 6 in
- 2017-07-11 13:26:57.091408 I | rook-ceph-mon2: 2017-07-11 13:26:46.164978 osd.0 osd.0 10.233.72.0:6800/180 50 : cluster [WRN] map e70 wrongly marked me down at e70
- 2017-07-11 13:26:57.091506 I | rook-ceph-mon2: 2017-07-11 13:26:48.170150 osd.1 osd.1 10.233.76.4:6800/178 39 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 60.349894 secs
- 2017-07-11 13:26:57.091555 I | rook-ceph-mon2: 2017-07-11 13:26:48.170157 osd.1 osd.1 10.233.76.4:6800/178 40 : cluster [WRN] slow request 60.349894 seconds old, received at 2017-07-11 13:25:47.820229: osd_pg_create(e25 0.3:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25) currently started
- 2017-07-11 13:26:57.091577 I | rook-ceph-mon2: 2017-07-11 13:26:51.170943 osd.1 osd.1 10.233.76.4:6800/178 41 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 63.350666 secs
- 2017-07-11 13:26:57.091612 I | rook-ceph-mon2: 2017-07-11 13:26:51.170947 osd.1 osd.1 10.233.76.4:6800/178 42 : cluster [WRN] slow request 30.189307 seconds old, received at 2017-07-11 13:26:20.981588: pg_notify((query:21 sent:36 0.4a4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.091638 I | rook-ceph-mon2: 2017-07-11 13:26:51.170951 osd.1 osd.1 10.233.76.4:6800/178 43 : cluster [WRN] slow request 30.189245 seconds old, received at 2017-07-11 13:26:20.981650: pg_notify((query:21 sent:36 0.4a6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.091650 I | rook-ceph-mon2: 2017-07-11 13:26:51.170954 osd.1 osd.1 10.233.76.4:6800/178 44 : cluster [WRN] slow request 30.189811 seconds old, received at 2017-07-11 13:26:20.981085: pg_notify((query:21 sent:36 0.427( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.091660 I | rook-ceph-mon2: 2017-07-11 13:26:51.170956 osd.1 osd.1 10.233.76.4:6800/178 45 : cluster [WRN] slow request 30.189572 seconds old, received at 2017-07-11 13:26:20.981323: pg_notify((query:21 sent:36 0.434( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.091670 I | rook-ceph-mon2: 2017-07-11 13:26:51.170958 osd.1 osd.1 10.233.76.4:6800/178 46 : cluster [WRN] slow request 30.189524 seconds old, received at 2017-07-11 13:26:20.981372: pg_notify((query:21 sent:36 0.437( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.091680 I | rook-ceph-mon2: 2017-07-11 13:26:52.171148 osd.1 osd.1 10.233.76.4:6800/178 47 : cluster [WRN] 8 slow requests, 2 included below; oldest blocked for > 64.350875 secs
- 2017-07-11 13:26:57.091691 I | rook-ceph-mon2: 2017-07-11 13:26:52.171151 osd.1 osd.1 10.233.76.4:6800/178 48 : cluster [WRN] slow request 31.189582 seconds old, received at 2017-07-11 13:26:20.981522: pg_notify((query:21 sent:36 0.46a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.091714 I | rook-ceph-mon2: 2017-07-11 13:26:52.171154 osd.1 osd.1 10.233.76.4:6800/178 49 : cluster [WRN] slow request 31.189544 seconds old, received at 2017-07-11 13:26:20.981560: pg_notify((query:21 sent:36 0.474( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:57.091726 I | rook-ceph-mon2: 2017-07-11 13:26:55.179725 osd.1 osd.1 10.233.76.4:6800/178 50 : cluster [WRN] 9 slow requests, 1 included below; oldest blocked for > 67.359467 secs
- 2017-07-11 13:26:57.091738 I | rook-ceph-mon2: 2017-07-11 13:26:55.179746 osd.1 osd.1 10.233.76.4:6800/178 51 : cluster [WRN] slow request 30.092543 seconds old, received at 2017-07-11 13:26:25.087153: pg_notify((query:25 sent:53 0.4b2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:26:57.621959 I | rook-ceph-mon2: 2017-07-11 13:26:57.621728 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4805 MB, avail 94382 MB
- 2017-07-11 13:26:57.874724 I | rook-ceph-mon2: 2017-07-11 13:26:57.874681 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:26:57.874916 I | rook-ceph-mon2: 2017-07-11 13:26:57.874898 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1514196107' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:27:01.919611 I | rook-ceph-mon2: 2017-07-11 13:27:00.630736 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 215 : cluster [INF] osdmap e78: 6 total, 6 up, 6 in
- 2017-07-11 13:27:03.408468 I | rook-ceph-mon2: 2017-07-11 13:27:02.106320 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 216 : cluster [INF] osdmap e79: 6 total, 6 up, 6 in
- 2017-07-11 13:27:05.952560 I | rook-ceph-mon2: 2017-07-11 13:27:04.826723 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 217 : cluster [INF] osdmap e80: 6 total, 6 up, 6 in
- 2017-07-11 13:27:05.952579 I | rook-ceph-mon2: 2017-07-11 13:27:05.281025 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 218 : cluster [INF] HEALTH_WARN; 275 pgs peering; 39 requests are blocked > 32 sec; 1 osds have slow requests; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:27:07.186349 I | rook-ceph-mon2: 2017-07-11 13:26:57.180313 osd.1 osd.1 10.233.76.4:6800/178 52 : cluster [WRN] 11 slow requests, 2 included below; oldest blocked for > 69.360050 secs
- 2017-07-11 13:27:07.186427 I | rook-ceph-mon2: 2017-07-11 13:26:57.180319 osd.1 osd.1 10.233.76.4:6800/178 53 : cluster [WRN] slow request 30.599795 seconds old, received at 2017-07-11 13:26:26.580485: pg_notify((query:25 sent:53 0.4d9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:07.186443 I | rook-ceph-mon2: 2017-07-11 13:26:57.180322 osd.1 osd.1 10.233.76.4:6800/178 54 : cluster [WRN] slow request 30.045284 seconds old, received at 2017-07-11 13:26:27.134996: pg_notify((query:25 sent:54 0.4dd( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 54) currently wait for new map
- 2017-07-11 13:27:07.186455 I | rook-ceph-mon2: 2017-07-11 13:26:58.180539 osd.1 osd.1 10.233.76.4:6800/178 55 : cluster [WRN] 13 slow requests, 2 included below; oldest blocked for > 70.360263 secs
- 2017-07-11 13:27:07.186482 I | rook-ceph-mon2: 2017-07-11 13:26:58.180543 osd.1 osd.1 10.233.76.4:6800/178 56 : cluster [WRN] slow request 30.704741 seconds old, received at 2017-07-11 13:26:27.475751: pg_notify((query:25 sent:53 0.4e3( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:07.186498 I | rook-ceph-mon2: 2017-07-11 13:26:58.180545 osd.1 osd.1 10.233.76.4:6800/178 57 : cluster [WRN] slow request 30.305323 seconds old, received at 2017-07-11 13:26:27.875170: pg_notify((query:25 sent:55 0.4e6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:07.186509 I | rook-ceph-mon2: 2017-07-11 13:26:59.186774 osd.1 osd.1 10.233.76.4:6800/178 58 : cluster [WRN] 14 slow requests, 1 included below; oldest blocked for > 71.366516 secs
- 2017-07-11 13:27:07.186519 I | rook-ceph-mon2: 2017-07-11 13:26:59.186778 osd.1 osd.1 10.233.76.4:6800/178 59 : cluster [WRN] slow request 30.888978 seconds old, received at 2017-07-11 13:26:28.297767: pg_notify((query:25 sent:55 0.4ec( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:07.186530 I | rook-ceph-mon2: 2017-07-11 13:27:00.187024 osd.1 osd.1 10.233.76.4:6800/178 60 : cluster [WRN] 23 slow requests, 5 included below; oldest blocked for > 72.366735 secs
- 2017-07-11 13:27:07.186554 I | rook-ceph-mon2: 2017-07-11 13:27:00.187028 osd.1 osd.1 10.233.76.4:6800/178 61 : cluster [WRN] slow request 30.168011 seconds old, received at 2017-07-11 13:26:30.018953: pg_notify((query:21 sent:42 0.486( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.186566 I | rook-ceph-mon2: 2017-07-11 13:27:00.187045 osd.1 osd.1 10.233.76.4:6800/178 62 : cluster [WRN] slow request 30.167945 seconds old, received at 2017-07-11 13:26:30.019019: pg_notify((query:21 sent:42 0.49d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.186579 I | rook-ceph-mon2: 2017-07-11 13:27:00.187053 osd.1 osd.1 10.233.76.4:6800/178 63 : cluster [WRN] slow request 30.167925 seconds old, received at 2017-07-11 13:26:30.019039: pg_notify((query:21 sent:42 0.4a5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.186589 I | rook-ceph-mon2: 2017-07-11 13:27:00.187055 osd.1 osd.1 10.233.76.4:6800/178 64 : cluster [WRN] slow request 30.874083 seconds old, received at 2017-07-11 13:26:29.312882: pg_notify((query:25 sent:56 0.4f7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.186604 I | rook-ceph-mon2: 2017-07-11 13:27:00.187057 osd.1 osd.1 10.233.76.4:6800/178 65 : cluster [WRN] slow request 30.485377 seconds old, received at 2017-07-11 13:26:29.701587: pg_notify((query:25 sent:56 0.4fb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.186614 I | rook-ceph-mon2: 2017-07-11 13:27:01.187328 osd.1 osd.1 10.233.76.4:6800/178 66 : cluster [WRN] 25 slow requests, 5 included below; oldest blocked for > 40.206130 secs
- 2017-07-11 13:27:07.186644 I | rook-ceph-mon2: 2017-07-11 13:27:01.187340 osd.1 osd.1 10.233.76.4:6800/178 67 : cluster [WRN] slow request 71.768138 seconds old, received at 2017-07-11 13:25:49.419076: osd_pg_create(e26 0.3:2 0.35:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26) currently started
- 2017-07-11 13:27:07.186662 I | rook-ceph-mon2: 2017-07-11 13:27:01.187362 osd.1 osd.1 10.233.76.4:6800/178 68 : cluster [WRN] slow request 31.168161 seconds old, received at 2017-07-11 13:26:30.019054: pg_notify((query:25 sent:42 0.4b0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.186674 I | rook-ceph-mon2: 2017-07-11 13:27:01.187364 osd.1 osd.1 10.233.76.4:6800/178 69 : cluster [WRN] slow request 30.388593 seconds old, received at 2017-07-11 13:26:30.798622: pg_notify((query:25 sent:57 0.503( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 57) currently wait for new map
- 2017-07-11 13:27:07.186684 I | rook-ceph-mon2: 2017-07-11 13:27:01.187366 osd.1 osd.1 10.233.76.4:6800/178 70 : cluster [WRN] slow request 30.412681 seconds old, received at 2017-07-11 13:26:30.774533: pg_notify((query:25 sent:56 0.502( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.186693 I | rook-ceph-mon2: 2017-07-11 13:27:01.187368 osd.1 osd.1 10.233.76.4:6800/178 71 : cluster [WRN] slow request 31.168146 seconds old, received at 2017-07-11 13:26:30.019069: pg_notify((query:25 sent:42 0.4bb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.186715 I | rook-ceph-mon2: 2017-07-11 13:27:02.187617 osd.1 osd.1 10.233.76.4:6800/178 72 : cluster [WRN] 26 slow requests, 4 included below; oldest blocked for > 41.206484 secs
- 2017-07-11 13:27:07.186731 I | rook-ceph-mon2: 2017-07-11 13:27:02.187642 osd.1 osd.1 10.233.76.4:6800/178 73 : cluster [WRN] slow request 72.768492 seconds old, received at 2017-07-11 13:25:49.419076: osd_pg_create(e26 0.3:2 0.35:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26) currently started
- 2017-07-11 13:27:07.186746 I | rook-ceph-mon2: 2017-07-11 13:27:02.187646 osd.1 osd.1 10.233.76.4:6800/178 74 : cluster [WRN] slow request 30.529653 seconds old, received at 2017-07-11 13:26:31.657915: pg_notify((query:25 sent:56 0.509( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.186757 I | rook-ceph-mon2: 2017-07-11 13:27:02.187648 osd.1 osd.1 10.233.76.4:6800/178 75 : cluster [WRN] slow request 32.168482 seconds old, received at 2017-07-11 13:26:30.019086: pg_notify((query:25 sent:42 0.4e0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.186767 I | rook-ceph-mon2: 2017-07-11 13:27:02.187650 osd.1 osd.1 10.233.76.4:6800/178 76 : cluster [WRN] slow request 32.168466 seconds old, received at 2017-07-11 13:26:30.019102: pg_notify((query:25 sent:42 0.4f5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:07.186789 I | rook-ceph-mon2: 2017-07-11 13:27:03.187912 osd.1 osd.1 10.233.76.4:6800/178 77 : cluster [WRN] 28 slow requests, 2 included below; oldest blocked for > 42.206789 secs
- 2017-07-11 13:27:07.186803 I | rook-ceph-mon2: 2017-07-11 13:27:03.187916 osd.1 osd.1 10.233.76.4:6800/178 78 : cluster [WRN] slow request 30.530131 seconds old, received at 2017-07-11 13:26:32.657742: pg_notify((query:25 sent:58 0.514( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 58) currently wait for new map
- 2017-07-11 13:27:07.186814 I | rook-ceph-mon2: 2017-07-11 13:27:03.187933 osd.1 osd.1 10.233.76.4:6800/178 79 : cluster [WRN] slow request 30.689602 seconds old, received at 2017-07-11 13:26:32.498272: pg_notify((query:25 sent:56 0.513( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.186825 I | rook-ceph-mon2: 2017-07-11 13:27:04.188110 osd.1 osd.1 10.233.76.4:6800/178 80 : cluster [WRN] 30 slow requests, 2 included below; oldest blocked for > 43.206991 secs
- 2017-07-11 13:27:07.186835 I | rook-ceph-mon2: 2017-07-11 13:27:04.188114 osd.1 osd.1 10.233.76.4:6800/178 81 : cluster [WRN] slow request 30.485611 seconds old, received at 2017-07-11 13:26:33.702464: pg_notify((query:25 sent:56 0.51c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.186844 I | rook-ceph-mon2: 2017-07-11 13:27:04.188118 osd.1 osd.1 10.233.76.4:6800/178 82 : cluster [WRN] slow request 30.210146 seconds old, received at 2017-07-11 13:26:33.977929: pg_notify((query:25 sent:56 0.51e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:07.186876 I | rook-ceph-mon2: 2017-07-11 13:27:05.189246 osd.1 osd.1 10.233.76.4:6800/178 83 : cluster [WRN] 46 slow requests, 5 included below; oldest blocked for > 44.207349 secs
- 2017-07-11 13:27:07.186927 I | rook-ceph-mon2: 2017-07-11 13:27:05.189258 osd.1 osd.1 10.233.76.4:6800/178 84 : cluster [WRN] slow request 74.382946 seconds old, received at 2017-07-11 13:25:50.805488: osd_pg_create(e27 0.3:2 0.35:2 0.4f:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27) currently wait for new map
- 2017-07-11 13:27:07.186961 I | rook-ceph-mon2: 2017-07-11 13:27:05.189274 osd.1 osd.1 10.233.76.4:6800/178 85 : cluster [WRN] slow request 72.908815 seconds old, received at 2017-07-11 13:25:52.279618: osd_pg_create(e28 0.3:2 0.35:2 0.4f:2 0.a0:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:07.186981 I | rook-ceph-mon2: 2017-07-11 13:27:05.189279 osd.1 osd.1 10.233.76.4:6800/178 86 : cluster [WRN] slow request 71.700793 seconds old, received at 2017-07-11 13:25:53.487640: osd_pg_create(e29 0.3:2 0.35:2 0.4f:2 0.a0:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:07.186999 I | rook-ceph-mon2: 2017-07-11 13:27:05.189283 osd.1 osd.1 10.233.76.4:6800/178 87 : cluster [WRN] slow request 70.447050 seconds old, received at 2017-07-11 13:25:54.741384: osd_pg_create(e30 0.3:2 0.35:2 0.4f:2 0.a0:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30) currently wait for new map
- 2017-07-11 13:27:07.187053 I | rook-ceph-mon2: 2017-07-11 13:27:05.189303 osd.1 osd.1 10.233.76.4:6800/178 88 : cluster [WRN] slow request 68.952185 seconds old, received at 2017-07-11 13:25:56.236248: osd_pg_create(e31 0.3:2 0.35:2 0.4f:2 0.a0:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31) currently wait for new map
- 2017-07-11 13:27:07.187140 I | rook-ceph-mon2: 2017-07-11 13:27:06.198791 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 219 : cluster [INF] osdmap e81: 6 total, 6 up, 6 in
- 2017-07-11 13:27:08.733540 I | rook-ceph-mon2: 2017-07-11 13:27:07.395746 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 220 : cluster [INF] osdmap e82: 6 total, 6 up, 6 in
- 2017-07-11 13:27:09.905637 I | rook-ceph-mon2: 2017-07-11 13:27:08.580589 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 221 : cluster [INF] osdmap e83: 6 total, 6 up, 6 in
- 2017-07-11 13:27:11.151297 I | rook-ceph-mon2: 2017-07-11 13:27:10.898348 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 228 : cluster [INF] osdmap e84: 6 total, 6 up, 6 in
- 2017-07-11 13:27:16.618701 I | rook-ceph-mon2: 2017-07-11 13:27:15.111446 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 231 : cluster [INF] osdmap e85: 6 total, 6 up, 6 in
- 2017-07-11 13:27:16.618767 I | rook-ceph-mon2: 2017-07-11 13:27:15.810084 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 232 : cluster [INF] osd.2 failed (root=default,host=master-0) (4 reporters from different host after 30.282725 >= grace 24.445681)
- 2017-07-11 13:27:16.618785 I | rook-ceph-mon2: 2017-07-11 13:27:15.962202 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 233 : cluster [INF] osdmap e86: 6 total, 5 up, 6 in
- 2017-07-11 13:27:17.810037 I | rook-ceph-mon2: 2017-07-11 13:27:06.189526 osd.1 osd.1 10.233.76.4:6800/178 89 : cluster [WRN] 47 slow requests, 5 included below; oldest blocked for > 45.208403 secs
- 2017-07-11 13:27:17.810134 I | rook-ceph-mon2: 2017-07-11 13:27:06.189533 osd.1 osd.1 10.233.76.4:6800/178 90 : cluster [WRN] slow request 75.384000 seconds old, received at 2017-07-11 13:25:50.805488: osd_pg_create(e27 0.3:2 0.35:2 0.4f:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27) currently wait for new map
- 2017-07-11 13:27:17.810180 I | rook-ceph-mon2: 2017-07-11 13:27:06.189548 osd.1 osd.1 10.233.76.4:6800/178 91 : cluster [WRN] slow request 73.909869 seconds old, received at 2017-07-11 13:25:52.279618: osd_pg_create(e28 0.3:2 0.35:2 0.4f:2 0.a0:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:17.810206 I | rook-ceph-mon2: 2017-07-11 13:27:06.189552 osd.1 osd.1 10.233.76.4:6800/178 92 : cluster [WRN] slow request 72.701847 seconds old, received at 2017-07-11 13:25:53.487640: osd_pg_create(e29 0.3:2 0.35:2 0.4f:2 0.a0:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:17.810226 I | rook-ceph-mon2: 2017-07-11 13:27:06.189557 osd.1 osd.1 10.233.76.4:6800/178 93 : cluster [WRN] slow request 71.448104 seconds old, received at 2017-07-11 13:25:54.741384: osd_pg_create(e30 0.3:2 0.35:2 0.4f:2 0.a0:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30) currently wait for new map
- 2017-07-11 13:27:17.810279 I | rook-ceph-mon2: 2017-07-11 13:27:06.189568 osd.1 osd.1 10.233.76.4:6800/178 94 : cluster [WRN] slow request 69.953239 seconds old, received at 2017-07-11 13:25:56.236248: osd_pg_create(e31 0.3:2 0.35:2 0.4f:2 0.a0:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31) currently wait for new map
- 2017-07-11 13:27:17.810304 I | rook-ceph-mon2: 2017-07-11 13:27:07.190167 osd.1 osd.1 10.233.76.4:6800/178 95 : cluster [WRN] 49 slow requests, 5 included below; oldest blocked for > 46.208604 secs
- 2017-07-11 13:27:17.810333 I | rook-ceph-mon2: 2017-07-11 13:27:07.190188 osd.1 osd.1 10.233.76.4:6800/178 96 : cluster [WRN] slow request 69.675377 seconds old, received at 2017-07-11 13:25:57.514311: osd_pg_create(e32 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32) currently wait for new map
- 2017-07-11 13:27:17.810365 I | rook-ceph-mon2: 2017-07-11 13:27:07.190210 osd.1 osd.1 10.233.76.4:6800/178 97 : cluster [WRN] slow request 68.464259 seconds old, received at 2017-07-11 13:25:58.725429: osd_pg_create(e33 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33) currently wait for new map
- 2017-07-11 13:27:17.810389 I | rook-ceph-mon2: 2017-07-11 13:27:07.190214 osd.1 osd.1 10.233.76.4:6800/178 98 : cluster [WRN] slow request 67.060533 seconds old, received at 2017-07-11 13:26:00.129155: osd_pg_create(e34 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.810438 I | rook-ceph-mon2: 2017-07-11 13:27:07.190219 osd.1 osd.1 10.233.76.4:6800/178 99 : cluster [WRN] slow request 65.733720 seconds old, received at 2017-07-11 13:26:01.455968: osd_pg_create(e35 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.810484 I | rook-ceph-mon2: 2017-07-11 13:27:07.190228 osd.1 osd.1 10.233.76.4:6800/178 100 : cluster [WRN] slow request 64.613660 seconds old, received at 2017-07-11 13:26:02.576028: osd_pg_create(e36 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.810506 I | rook-ceph-mon2: 2017-07-11 13:27:08.190465 osd.1 osd.1 10.233.76.4:6800/178 101 : cluster [WRN] 49 slow requests, 5 included below; oldest blocked for > 47.209318 secs
- 2017-07-11 13:27:17.810532 I | rook-ceph-mon2: 2017-07-11 13:27:08.190474 osd.1 osd.1 10.233.76.4:6800/178 102 : cluster [WRN] slow request 70.676092 seconds old, received at 2017-07-11 13:25:57.514311: osd_pg_create(e32 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32) currently wait for new map
- 2017-07-11 13:27:17.810577 I | rook-ceph-mon2: 2017-07-11 13:27:08.190487 osd.1 osd.1 10.233.76.4:6800/178 103 : cluster [WRN] slow request 69.464974 seconds old, received at 2017-07-11 13:25:58.725429: osd_pg_create(e33 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33) currently wait for new map
- 2017-07-11 13:27:17.810603 I | rook-ceph-mon2: 2017-07-11 13:27:08.190500 osd.1 osd.1 10.233.76.4:6800/178 104 : cluster [WRN] slow request 68.061248 seconds old, received at 2017-07-11 13:26:00.129155: osd_pg_create(e34 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.810650 I | rook-ceph-mon2: 2017-07-11 13:27:08.190507 osd.1 osd.1 10.233.76.4:6800/178 105 : cluster [WRN] slow request 66.734434 seconds old, received at 2017-07-11 13:26:01.455968: osd_pg_create(e35 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.810693 I | rook-ceph-mon2: 2017-07-11 13:27:08.190514 osd.1 osd.1 10.233.76.4:6800/178 106 : cluster [WRN] slow request 65.614374 seconds old, received at 2017-07-11 13:26:02.576028: osd_pg_create(e36 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.810729 I | rook-ceph-mon2: 2017-07-11 13:27:09.191044 osd.1 osd.1 10.233.76.4:6800/178 107 : cluster [WRN] 50 slow requests, 5 included below; oldest blocked for > 48.209584 secs
- 2017-07-11 13:27:17.810745 I | rook-ceph-mon2: 2017-07-11 13:27:09.191054 osd.1 osd.1 10.233.76.4:6800/178 108 : cluster [WRN] slow request 65.354982 seconds old, received at 2017-07-11 13:26:03.835686: osd_pg_create(e37 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.810818 I | rook-ceph-mon2: 2017-07-11 13:27:09.191060 osd.1 osd.1 10.233.76.4:6800/178 109 : cluster [WRN] slow request 64.220425 seconds old, received at 2017-07-11 13:26:04.970243: osd_pg_create(e38 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.810849 I | rook-ceph-mon2: 2017-07-11 13:27:09.191065 osd.1 osd.1 10.233.76.4:6800/178 110 : cluster [WRN] slow request 62.891164 seconds old, received at 2017-07-11 13:26:06.299505: osd_pg_create(e39 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.810884 I | rook-ceph-mon2: 2017-07-11 13:27:09.191073 osd.1 osd.1 10.233.76.4:6800/178 111 : cluster [WRN] slow request 61.603405 seconds old, received at 2017-07-11 13:26:07.587264: osd_pg_create(e40 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.810906 I | rook-ceph-mon2: 2017-07-11 13:27:09.191076 osd.1 osd.1 10.233.76.4:6800/178 112 : cluster [WRN] slow request 60.374950 seconds old, received at 2017-07-11 13:26:08.815718: osd_pg_create(e41 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.810923 I | rook-ceph-mon2: 2017-07-11 13:27:10.191362 osd.1 osd.1 10.233.76.4:6800/178 113 : cluster [WRN] 52 slow requests, 5 included below; oldest blocked for > 49.210222 secs
- 2017-07-11 13:27:17.810935 I | rook-ceph-mon2: 2017-07-11 13:27:10.191371 osd.1 osd.1 10.233.76.4:6800/178 114 : cluster [WRN] slow request 30.880335 seconds old, received at 2017-07-11 13:26:39.310971: pg_notify((query:25 sent:63 0.557( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 63) currently wait for new map
- 2017-07-11 13:27:17.810971 I | rook-ceph-mon2: 2017-07-11 13:27:10.191375 osd.1 osd.1 10.233.76.4:6800/178 115 : cluster [WRN] slow request 66.355620 seconds old, received at 2017-07-11 13:26:03.835686: osd_pg_create(e37 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.810998 I | rook-ceph-mon2: 2017-07-11 13:27:10.191380 osd.1 osd.1 10.233.76.4:6800/178 116 : cluster [WRN] slow request 65.221063 seconds old, received at 2017-07-11 13:26:04.970243: osd_pg_create(e38 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.811033 I | rook-ceph-mon2: 2017-07-11 13:27:10.191390 osd.1 osd.1 10.233.76.4:6800/178 117 : cluster [WRN] slow request 63.891801 seconds old, received at 2017-07-11 13:26:06.299505: osd_pg_create(e39 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.811058 I | rook-ceph-mon2: 2017-07-11 13:27:10.191394 osd.1 osd.1 10.233.76.4:6800/178 118 : cluster [WRN] slow request 62.604043 seconds old, received at 2017-07-11 13:26:07.587264: osd_pg_create(e40 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.811082 I | rook-ceph-mon2: 2017-07-11 13:27:11.191742 osd.1 osd.1 10.233.76.4:6800/178 119 : cluster [WRN] 54 slow requests, 5 included below; oldest blocked for > 50.210483 secs
- 2017-07-11 13:27:17.811118 I | rook-ceph-mon2: 2017-07-11 13:27:11.191745 osd.1 osd.1 10.233.76.4:6800/178 120 : cluster [WRN] slow request 30.132634 seconds old, received at 2017-07-11 13:26:41.058933: pg_notify((query:25 sent:61 0.560( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:17.811131 I | rook-ceph-mon2: 2017-07-11 13:27:11.191748 osd.1 osd.1 10.233.76.4:6800/178 121 : cluster [WRN] slow request 30.185198 seconds old, received at 2017-07-11 13:26:41.006369: pg_notify((query:25 sent:61 0.55c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:17.811149 I | rook-ceph-mon2: 2017-07-11 13:27:11.191753 osd.1 osd.1 10.233.76.4:6800/178 122 : cluster [WRN] slow request 62.375849 seconds old, received at 2017-07-11 13:26:08.815718: osd_pg_create(e41 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.811170 I | rook-ceph-mon2: 2017-07-11 13:27:11.191762 osd.1 osd.1 10.233.76.4:6800/178 123 : cluster [WRN] slow request 61.048090 seconds old, received at 2017-07-11 13:26:10.143477: osd_pg_create(e42 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.811214 I | rook-ceph-mon2: 2017-07-11 13:27:11.191776 osd.1 osd.1 10.233.76.4:6800/178 124 : cluster [WRN] slow request 59.606180 seconds old, received at 2017-07-11 13:26:11.585387: osd_pg_create(e43 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.811228 I | rook-ceph-mon2: 2017-07-11 13:27:12.192024 osd.1 osd.1 10.233.76.4:6800/178 125 : cluster [WRN] 55 slow requests, 5 included below; oldest blocked for > 51.210888 secs
- 2017-07-11 13:27:17.811241 I | rook-ceph-mon2: 2017-07-11 13:27:12.192028 osd.1 osd.1 10.233.76.4:6800/178 126 : cluster [WRN] slow request 30.737071 seconds old, received at 2017-07-11 13:26:41.454902: pg_notify((query:25 sent:61 0.568( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:17.811256 I | rook-ceph-mon2: 2017-07-11 13:27:12.192036 osd.1 osd.1 10.233.76.4:6800/178 127 : cluster [WRN] slow request 62.048496 seconds old, received at 2017-07-11 13:26:10.143477: osd_pg_create(e42 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.811296 I | rook-ceph-mon2: 2017-07-11 13:27:12.192047 osd.1 osd.1 10.233.76.4:6800/178 128 : cluster [WRN] slow request 60.606586 seconds old, received at 2017-07-11 13:26:11.585387: osd_pg_create(e43 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:17.811315 I | rook-ceph-mon2: 2017-07-11 13:27:12.192050 osd.1 osd.1 10.233.76.4:6800/178 129 : cluster [WRN] slow request 36.833041 seconds old, received at 2017-07-11 13:26:35.358932: pg_notify((query:25 sent:60 0.52b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:17.811327 I | rook-ceph-mon2: 2017-07-11 13:27:12.192052 osd.1 osd.1 10.233.76.4:6800/178 130 : cluster [WRN] slow request 35.974373 seconds old, received at 2017-07-11 13:26:36.217600: pg_notify((query:25 sent:60 0.539( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:17.811353 I | rook-ceph-mon2: 2017-07-11 13:27:13.192251 osd.1 osd.1 10.233.76.4:6800/178 131 : cluster [WRN] 55 slow requests, 3 included below; oldest blocked for > 52.211112 secs
- 2017-07-11 13:27:17.811366 I | rook-ceph-mon2: 2017-07-11 13:27:13.192255 osd.1 osd.1 10.233.76.4:6800/178 132 : cluster [WRN] slow request 36.549638 seconds old, received at 2017-07-11 13:26:36.642558: pg_notify((query:25 sent:61 0.53d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:17.811377 I | rook-ceph-mon2: 2017-07-11 13:27:13.192257 osd.1 osd.1 10.233.76.4:6800/178 133 : cluster [WRN] slow request 34.772839 seconds old, received at 2017-07-11 13:26:38.419357: pg_notify((query:25 sent:62 0.551( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 62) currently wait for new map
- 2017-07-11 13:27:17.811399 I | rook-ceph-mon2: 2017-07-11 13:27:13.192259 osd.1 osd.1 10.233.76.4:6800/178 134 : cluster [WRN] slow request 33.301633 seconds old, received at 2017-07-11 13:26:39.890564: pg_notify((query:25 sent:61 0.558( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:19.792742 I | rook-ceph-mon2: 2017-07-11 13:27:19.792705 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:27:19.792976 I | rook-ceph-mon2: 2017-07-11 13:27:19.792855 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/363902673' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:27:20.555114 I | rook-ceph-mon2: 2017-07-11 13:27:16.663305 osd.2 osd.2 10.233.69.0:6800/178 15 : cluster [WRN] map e86 wrongly marked me down at e86
- 2017-07-11 13:27:20.555178 I | rook-ceph-mon2: 2017-07-11 13:27:19.292801 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 234 : cluster [INF] osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:27:20.555197 I | rook-ceph-mon2: 2017-07-11 13:27:19.293185 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 235 : cluster [INF] osdmap e87: 6 total, 6 up, 6 in
- 2017-07-11 13:27:22.167032 I | rook-ceph-mon2: 2017-07-11 13:27:20.855499 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 237 : cluster [INF] osdmap e88: 6 total, 6 up, 6 in
- 2017-07-11 13:27:26.647081 I | rook-ceph-mon2: 2017-07-11 13:27:21.198479 osd.1 osd.1 10.233.76.4:6800/178 135 : cluster [WRN] 51 slow requests, 5 included below; oldest blocked for > 60.217363 secs
- 2017-07-11 13:27:26.647160 I | rook-ceph-mon2: 2017-07-11 13:27:21.198486 osd.1 osd.1 10.233.76.4:6800/178 136 : cluster [WRN] slow request 60.216860 seconds old, received at 2017-07-11 13:26:20.981588: pg_notify((query:21 sent:36 0.4a4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.647191 I | rook-ceph-mon2: 2017-07-11 13:27:21.198491 osd.1 osd.1 10.233.76.4:6800/178 137 : cluster [WRN] slow request 60.216797 seconds old, received at 2017-07-11 13:26:20.981650: pg_notify((query:21 sent:36 0.4a6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.647224 I | rook-ceph-mon2: 2017-07-11 13:27:21.198493 osd.1 osd.1 10.233.76.4:6800/178 138 : cluster [WRN] slow request 60.217363 seconds old, received at 2017-07-11 13:26:20.981085: pg_notify((query:21 sent:36 0.427( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.647246 I | rook-ceph-mon2: 2017-07-11 13:27:21.198495 osd.1 osd.1 10.233.76.4:6800/178 139 : cluster [WRN] slow request 60.217124 seconds old, received at 2017-07-11 13:26:20.981323: pg_notify((query:21 sent:36 0.434( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.647264 I | rook-ceph-mon2: 2017-07-11 13:27:21.198497 osd.1 osd.1 10.233.76.4:6800/178 140 : cluster [WRN] slow request 60.217076 seconds old, received at 2017-07-11 13:26:20.981372: pg_notify((query:21 sent:36 0.437( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.647293 I | rook-ceph-mon2: 2017-07-11 13:27:22.198684 osd.1 osd.1 10.233.76.4:6800/178 141 : cluster [WRN] 51 slow requests, 2 included below; oldest blocked for > 61.217571 secs
- 2017-07-11 13:27:26.647307 I | rook-ceph-mon2: 2017-07-11 13:27:22.198688 osd.1 osd.1 10.233.76.4:6800/178 142 : cluster [WRN] slow request 61.217133 seconds old, received at 2017-07-11 13:26:20.981522: pg_notify((query:21 sent:36 0.46a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.647319 I | rook-ceph-mon2: 2017-07-11 13:27:22.198704 osd.1 osd.1 10.233.76.4:6800/178 143 : cluster [WRN] slow request 61.217096 seconds old, received at 2017-07-11 13:26:20.981560: pg_notify((query:21 sent:36 0.474( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:26.647349 I | rook-ceph-mon2: 2017-07-11 13:27:25.199148 osd.1 osd.1 10.233.76.4:6800/178 144 : cluster [WRN] 51 slow requests, 1 included below; oldest blocked for > 64.218040 secs
- 2017-07-11 13:27:26.647372 I | rook-ceph-mon2: 2017-07-11 13:27:25.199152 osd.1 osd.1 10.233.76.4:6800/178 145 : cluster [WRN] slow request 60.111971 seconds old, received at 2017-07-11 13:26:25.087153: pg_notify((query:25 sent:53 0.4b2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:30.498249 I | rook-ceph-mon2: 2017-07-11 13:27:30.498198 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:27:30.498436 I | rook-ceph-mon2: 2017-07-11 13:27:30.498368 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/58287957' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:27:33.502803 I | rook-ceph-mon2: 2017-07-11 13:27:32.459644 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 238 : cluster [INF] osdmap e89: 6 total, 6 up, 6 in
- 2017-07-11 13:27:36.285703 I | rook-ceph-mon2: 2017-07-11 13:27:34.984953 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 239 : cluster [INF] osdmap e90: 6 total, 6 up, 6 in
- 2017-07-11 13:27:37.516643 I | rook-ceph-mon2: 2017-07-11 13:27:27.199539 osd.1 osd.1 10.233.76.4:6800/178 146 : cluster [WRN] 51 slow requests, 2 included below; oldest blocked for > 66.218430 secs
- 2017-07-11 13:27:37.516715 I | rook-ceph-mon2: 2017-07-11 13:27:27.199556 osd.1 osd.1 10.233.76.4:6800/178 147 : cluster [WRN] slow request 60.619029 seconds old, received at 2017-07-11 13:26:26.580485: pg_notify((query:25 sent:53 0.4d9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:37.516732 I | rook-ceph-mon2: 2017-07-11 13:27:27.199559 osd.1 osd.1 10.233.76.4:6800/178 148 : cluster [WRN] slow request 60.064519 seconds old, received at 2017-07-11 13:26:27.134996: pg_notify((query:25 sent:54 0.4dd( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 54) currently wait for new map
- 2017-07-11 13:27:37.516744 I | rook-ceph-mon2: 2017-07-11 13:27:28.200194 osd.1 osd.1 10.233.76.4:6800/178 149 : cluster [WRN] 51 slow requests, 2 included below; oldest blocked for > 67.219084 secs
- 2017-07-11 13:27:37.516784 I | rook-ceph-mon2: 2017-07-11 13:27:28.200212 osd.1 osd.1 10.233.76.4:6800/178 150 : cluster [WRN] slow request 60.724418 seconds old, received at 2017-07-11 13:26:27.475751: pg_notify((query:25 sent:53 0.4e3( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:37.516797 I | rook-ceph-mon2: 2017-07-11 13:27:28.200216 osd.1 osd.1 10.233.76.4:6800/178 151 : cluster [WRN] slow request 60.324999 seconds old, received at 2017-07-11 13:26:27.875170: pg_notify((query:25 sent:55 0.4e6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:37.516809 I | rook-ceph-mon2: 2017-07-11 13:27:29.200370 osd.1 osd.1 10.233.76.4:6800/178 152 : cluster [WRN] 51 slow requests, 1 included below; oldest blocked for > 68.219263 secs
- 2017-07-11 13:27:37.516836 I | rook-ceph-mon2: 2017-07-11 13:27:29.200374 osd.1 osd.1 10.233.76.4:6800/178 153 : cluster [WRN] slow request 60.902580 seconds old, received at 2017-07-11 13:26:28.297767: pg_notify((query:25 sent:55 0.4ec( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:37.516862 I | rook-ceph-mon2: 2017-07-11 13:27:30.204516 osd.1 osd.1 10.233.76.4:6800/178 154 : cluster [WRN] 51 slow requests, 5 included below; oldest blocked for > 69.223400 secs
- 2017-07-11 13:27:37.516875 I | rook-ceph-mon2: 2017-07-11 13:27:30.204520 osd.1 osd.1 10.233.76.4:6800/178 155 : cluster [WRN] slow request 60.185531 seconds old, received at 2017-07-11 13:26:30.018953: pg_notify((query:21 sent:42 0.486( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.516886 I | rook-ceph-mon2: 2017-07-11 13:27:30.204523 osd.1 osd.1 10.233.76.4:6800/178 156 : cluster [WRN] slow request 60.185465 seconds old, received at 2017-07-11 13:26:30.019019: pg_notify((query:21 sent:42 0.49d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.516897 I | rook-ceph-mon2: 2017-07-11 13:27:30.204525 osd.1 osd.1 10.233.76.4:6800/178 157 : cluster [WRN] slow request 60.185445 seconds old, received at 2017-07-11 13:26:30.019039: pg_notify((query:21 sent:42 0.4a5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.516908 I | rook-ceph-mon2: 2017-07-11 13:27:30.204528 osd.1 osd.1 10.233.76.4:6800/178 158 : cluster [WRN] slow request 60.891603 seconds old, received at 2017-07-11 13:26:29.312882: pg_notify((query:25 sent:56 0.4f7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.516939 I | rook-ceph-mon2: 2017-07-11 13:27:30.204530 osd.1 osd.1 10.233.76.4:6800/178 159 : cluster [WRN] slow request 60.502898 seconds old, received at 2017-07-11 13:26:29.701587: pg_notify((query:25 sent:56 0.4fb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.516953 I | rook-ceph-mon2: 2017-07-11 13:27:31.204809 osd.1 osd.1 10.233.76.4:6800/178 160 : cluster [WRN] 51 slow requests, 5 included below; oldest blocked for > 70.223681 secs
- 2017-07-11 13:27:37.516964 I | rook-ceph-mon2: 2017-07-11 13:27:31.204814 osd.1 osd.1 10.233.76.4:6800/178 161 : cluster [WRN] slow request 61.185711 seconds old, received at 2017-07-11 13:26:30.019054: pg_notify((query:25 sent:42 0.4b0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.516974 I | rook-ceph-mon2: 2017-07-11 13:27:31.204816 osd.1 osd.1 10.233.76.4:6800/178 162 : cluster [WRN] slow request 60.406144 seconds old, received at 2017-07-11 13:26:30.798622: pg_notify((query:25 sent:57 0.503( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 57) currently wait for new map
- 2017-07-11 13:27:37.516989 I | rook-ceph-mon2: 2017-07-11 13:27:31.204819 osd.1 osd.1 10.233.76.4:6800/178 163 : cluster [WRN] slow request 60.430232 seconds old, received at 2017-07-11 13:26:30.774533: pg_notify((query:25 sent:56 0.502( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.517001 I | rook-ceph-mon2: 2017-07-11 13:27:31.204821 osd.1 osd.1 10.233.76.4:6800/178 164 : cluster [WRN] slow request 61.185696 seconds old, received at 2017-07-11 13:26:30.019069: pg_notify((query:25 sent:42 0.4bb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.517026 I | rook-ceph-mon2: 2017-07-11 13:27:31.204824 osd.1 osd.1 10.233.76.4:6800/178 165 : cluster [WRN] slow request 61.185679 seconds old, received at 2017-07-11 13:26:30.019086: pg_notify((query:25 sent:42 0.4e0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.517037 I | rook-ceph-mon2: 2017-07-11 13:27:32.208023 osd.1 osd.1 10.233.76.4:6800/178 166 : cluster [WRN] 50 slow requests, 2 included below; oldest blocked for > 71.226891 secs
- 2017-07-11 13:27:37.517048 I | rook-ceph-mon2: 2017-07-11 13:27:32.208028 osd.1 osd.1 10.233.76.4:6800/178 167 : cluster [WRN] slow request 60.550061 seconds old, received at 2017-07-11 13:26:31.657915: pg_notify((query:25 sent:56 0.509( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.517058 I | rook-ceph-mon2: 2017-07-11 13:27:32.208032 osd.1 osd.1 10.233.76.4:6800/178 168 : cluster [WRN] slow request 62.188873 seconds old, received at 2017-07-11 13:26:30.019102: pg_notify((query:25 sent:42 0.4f5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:37.517069 I | rook-ceph-mon2: 2017-07-11 13:27:33.209659 osd.1 osd.1 10.233.76.4:6800/178 169 : cluster [WRN] 50 slow requests, 2 included below; oldest blocked for > 72.228549 secs
- 2017-07-11 13:27:37.517092 I | rook-ceph-mon2: 2017-07-11 13:27:33.209663 osd.1 osd.1 10.233.76.4:6800/178 170 : cluster [WRN] slow request 60.551891 seconds old, received at 2017-07-11 13:26:32.657742: pg_notify((query:25 sent:58 0.514( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 58) currently wait for new map
- 2017-07-11 13:27:37.517104 I | rook-ceph-mon2: 2017-07-11 13:27:33.209666 osd.1 osd.1 10.233.76.4:6800/178 171 : cluster [WRN] slow request 60.711361 seconds old, received at 2017-07-11 13:26:32.498272: pg_notify((query:25 sent:56 0.513( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:37.517126 I | rook-ceph-mon2: 2017-07-11 13:27:34.211396 osd.1 osd.1 10.233.76.4:6800/178 172 : cluster [WRN] 65 slow requests, 5 included below; oldest blocked for > 69.124192 secs
- 2017-07-11 13:27:37.517138 I | rook-ceph-mon2: 2017-07-11 13:27:34.211401 osd.1 osd.1 10.233.76.4:6800/178 173 : cluster [WRN] slow request 43.169587 seconds old, received at 2017-07-11 13:26:51.041759: pg_notify((query:26 sent:72 0.5bc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 72) currently wait for new map
- 2017-07-11 13:27:37.517176 I | rook-ceph-mon2: 2017-07-11 13:27:34.211403 osd.1 osd.1 10.233.76.4:6800/178 174 : cluster [WRN] slow request 50.483405 seconds old, received at 2017-07-11 13:26:43.727940: pg_notify((query:26 sent:67 0.580( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:37.517194 I | rook-ceph-mon2: 2017-07-11 13:27:34.211405 osd.1 osd.1 10.233.76.4:6800/178 175 : cluster [WRN] slow request 39.432352 seconds old, received at 2017-07-11 13:26:54.778993: pg_notify((query:26 sent:76 0.5eb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:37.517206 I | rook-ceph-mon2: 2017-07-11 13:27:34.211408 osd.1 osd.1 10.233.76.4:6800/178 176 : cluster [WRN] slow request 50.472048 seconds old, received at 2017-07-11 13:26:43.739297: pg_notify((query:26 sent:67 0.581( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:37.517217 I | rook-ceph-mon2: 2017-07-11 13:27:34.211410 osd.1 osd.1 10.233.76.4:6800/178 177 : cluster [WRN] slow request 38.991231 seconds old, received at 2017-07-11 13:26:55.220115: pg_notify((query:26 sent:76 0.5f2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:37.517228 I | rook-ceph-mon2: 2017-07-11 13:27:35.211614 osd.1 osd.1 10.233.76.4:6800/178 178 : cluster [WRN] 66 slow requests, 5 included below; oldest blocked for > 70.124410 secs
- 2017-07-11 13:27:37.517252 I | rook-ceph-mon2: 2017-07-11 13:27:35.211618 osd.1 osd.1 10.233.76.4:6800/178 179 : cluster [WRN] slow request 50.962313 seconds old, received at 2017-07-11 13:26:44.249250: pg_notify((query:26 sent:67 0.584( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:37.517264 I | rook-ceph-mon2: 2017-07-11 13:27:35.211621 osd.1 osd.1 10.233.76.4:6800/178 180 : cluster [WRN] slow request 36.391198 seconds old, received at 2017-07-11 13:26:58.820365: pg_notify((query:26 sent:77 0.60e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:37.517275 I | rook-ceph-mon2: 2017-07-11 13:27:35.211624 osd.1 osd.1 10.233.76.4:6800/178 181 : cluster [WRN] slow request 49.607724 seconds old, received at 2017-07-11 13:26:45.603838: pg_notify((query:26 sent:68 0.595( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:37.517286 I | rook-ceph-mon2: 2017-07-11 13:27:35.211626 osd.1 osd.1 10.233.76.4:6800/178 182 : cluster [WRN] slow request 35.996271 seconds old, received at 2017-07-11 13:26:59.215292: pg_notify((query:26 sent:77 0.610( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:37.517297 I | rook-ceph-mon2: 2017-07-11 13:27:35.211628 osd.1 osd.1 10.233.76.4:6800/178 183 : cluster [WRN] slow request 43.225311 seconds old, received at 2017-07-11 13:26:51.986252: pg_notify((query:26 sent:73 0.5cb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 73) currently wait for new map
- 2017-07-11 13:27:37.517309 I | rook-ceph-mon2: 2017-07-11 13:27:35.858263 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 240 : cluster [INF] osd.3 failed (root=default,host=master-2) (4 reporters from different host after 26.962517 >= grace 24.549064)
- 2017-07-11 13:27:37.517332 I | rook-ceph-mon2: 2017-07-11 13:27:36.138047 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 241 : cluster [INF] osdmap e91: 6 total, 5 up, 6 in
- 2017-07-11 13:27:37.517345 I | rook-ceph-mon2: 2017-07-11 13:27:37.223230 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 242 : cluster [INF] osdmap e92: 6 total, 5 up, 6 in
- 2017-07-11 13:27:39.495850 I | rook-ceph-mon2: 2017-07-11 13:27:38.378426 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 243 : cluster [INF] osdmap e93: 6 total, 5 up, 6 in
- 2017-07-11 13:27:40.921682 I | rook-ceph-mon2: 2017-07-11 13:27:39.754027 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 244 : cluster [INF] osdmap e94: 6 total, 5 up, 6 in
- 2017-07-11 13:27:42.344920 I | rook-ceph-mon2: 2017-07-11 13:27:41.198794 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 245 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:27:42.345129 I | rook-ceph-mon2: 2017-07-11 13:27:41.199181 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 246 : cluster [INF] osdmap e95: 6 total, 6 up, 6 in
- 2017-07-11 13:27:43.728210 I | rook-ceph-mon2: 2017-07-11 13:27:42.676001 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 248 : cluster [INF] osdmap e96: 6 total, 6 up, 6 in
- 2017-07-11 13:27:45.016851 I | rook-ceph-mon2: 2017-07-11 13:27:43.930594 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 251 : cluster [INF] osdmap e97: 6 total, 6 up, 6 in
- 2017-07-11 13:27:46.507991 I | rook-ceph-mon2: 2017-07-11 13:27:36.211828 osd.1 osd.1 10.233.76.4:6800/178 184 : cluster [WRN] 71 slow requests, 5 included below; oldest blocked for > 71.124614 secs
- 2017-07-11 13:27:46.508159 I | rook-ceph-mon2: 2017-07-11 13:27:36.211833 osd.1 osd.1 10.233.76.4:6800/178 185 : cluster [WRN] slow request 30.721337 seconds old, received at 2017-07-11 13:27:05.490431: pg_notify((query:30 sent:78 0.5e2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.5f4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.508202 I | rook-ceph-mon2: 2017-07-11 13:27:36.211837 osd.1 osd.1 10.233.76.4:6800/178 186 : cluster [WRN] slow request 35.307991 seconds old, received at 2017-07-11 13:27:00.903776: pg_notify((query:26 sent:78 0.61e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.508216 I | rook-ceph-mon2: 2017-07-11 13:27:36.211839 osd.1 osd.1 10.233.76.4:6800/178 187 : cluster [WRN] slow request 30.644354 seconds old, received at 2017-07-11 13:27:05.567414: pg_notify((query:31 sent:78 0.430( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.508228 I | rook-ceph-mon2: 2017-07-11 13:27:36.211841 osd.1 osd.1 10.233.76.4:6800/178 188 : cluster [WRN] slow request 30.027417 seconds old, received at 2017-07-11 13:27:06.184351: pg_notify((query:31 sent:78 0.45f( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.46d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.508241 I | rook-ceph-mon2: 2017-07-11 13:27:36.211844 osd.1 osd.1 10.233.76.4:6800/178 189 : cluster [WRN] slow request 30.011214 seconds old, received at 2017-07-11 13:27:06.200553: pg_notify((query:31 sent:78 0.41d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.421( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.422( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:46.508277 I | rook-ceph-mon2: 2017-07-11 13:27:37.212020 osd.1 osd.1 10.233.76.4:6800/178 190 : cluster [WRN] 73 slow requests, 5 included below; oldest blocked for > 72.124801 secs
- 2017-07-11 13:27:46.508363 I | rook-ceph-mon2: 2017-07-11 13:27:37.212024 osd.1 osd.1 10.233.76.4:6800/178 191 : cluster [WRN] slow request 30.831535 seconds old, received at 2017-07-11 13:27:06.380420: pg_notify((query:33 sent:81 0.489( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.49b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.4ad( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 81) currently wait for new map
- 2017-07-11 13:27:46.508383 I | rook-ceph-mon2: 2017-07-11 13:27:37.212027 osd.1 osd.1 10.233.76.4:6800/178 192 : cluster [WRN] slow request 30.022916 seconds old, received at 2017-07-11 13:27:07.189039: pg_notify((query:33 sent:81 0.4bc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.4c0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.4c1( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 81) currently wait for new map
- 2017-07-11 13:27:46.508395 I | rook-ceph-mon2: 2017-07-11 13:27:37.212030 osd.1 osd.1 10.233.76.4:6800/178 193 : cluster [WRN] slow request 33.423069 seconds old, received at 2017-07-11 13:27:03.788885: pg_notify((query:26 sent:79 0.63e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 79) currently wait for new map
- 2017-07-11 13:27:46.508409 I | rook-ceph-mon2: 2017-07-11 13:27:37.212032 osd.1 osd.1 10.233.76.4:6800/178 194 : cluster [WRN] slow request 43.439708 seconds old, received at 2017-07-11 13:26:53.772246: pg_notify((query:26 sent:75 0.5df( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 75) currently wait for new map
- 2017-07-11 13:27:46.508420 I | rook-ceph-mon2: 2017-07-11 13:27:37.212046 osd.1 osd.1 10.233.76.4:6800/178 195 : cluster [WRN] slow request 42.610629 seconds old, received at 2017-07-11 13:26:54.601325: pg_notify((query:26 sent:76 0.5e8( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:46.508436 I | rook-ceph-mon2: 2017-07-11 13:27:38.229288 osd.1 osd.1 10.233.76.4:6800/178 196 : cluster [WRN] 76 slow requests, 5 included below; oldest blocked for > 73.125544 secs
- 2017-07-11 13:27:46.508451 I | rook-ceph-mon2: 2017-07-11 13:27:38.229300 osd.1 osd.1 10.233.76.4:6800/178 197 : cluster [WRN] slow request 30.467090 seconds old, received at 2017-07-11 13:27:07.745608: pg_notify((query:33 sent:82 0.4e4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.4e7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.4fe( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.506( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.508464 I | rook-ceph-mon2: 2017-07-11 13:27:38.229304 osd.1 osd.1 10.233.76.4:6800/178 198 : cluster [WRN] slow request 30.466970 seconds old, received at 2017-07-11 13:27:07.745728: pg_notify((query:33 sent:82 0.592( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.508476 I | rook-ceph-mon2: 2017-07-11 13:27:38.229307 osd.1 osd.1 10.233.76.4:6800/178 199 : cluster [WRN] slow request 62.853766 seconds old, received at 2017-07-11 13:26:35.358932: pg_notify((query:25 sent:60 0.52b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:46.508498 I | rook-ceph-mon2: 2017-07-11 13:27:38.229319 osd.1 osd.1 10.233.76.4:6800/178 200 : cluster [WRN] slow request 85.373497 seconds old, received at 2017-07-11 13:26:12.839201: osd_pg_create(e44 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:46.508515 I | rook-ceph-mon2: 2017-07-11 13:27:38.229323 osd.1 osd.1 10.233.76.4:6800/178 201 : cluster [WRN] slow request 42.086802 seconds old, received at 2017-07-11 13:26:56.125895: pg_notify((query:26 sent:77 0.5fa( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:46.508527 I | rook-ceph-mon2: 2017-07-11 13:27:39.229559 osd.1 osd.1 10.233.76.4:6800/178 202 : cluster [WRN] 86 slow requests, 5 included below; oldest blocked for > 74.142341 secs
- 2017-07-11 13:27:46.508541 I | rook-ceph-mon2: 2017-07-11 13:27:39.229564 osd.1 osd.1 10.233.76.4:6800/178 203 : cluster [WRN] slow request 30.990371 seconds old, received at 2017-07-11 13:27:08.239123: pg_notify((query:33 sent:82 0.599( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.59d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5a2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5b1( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5b7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5b8( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.508559 I | rook-ceph-mon2: 2017-07-11 13:27:39.229569 osd.1 osd.1 10.233.76.4:6800/178 204 : cluster [WRN] slow request 30.916765 seconds old, received at 2017-07-11 13:27:08.312729: pg_notify((query:33 sent:82 0.658( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.508571 I | rook-ceph-mon2: 2017-07-11 13:27:39.229573 osd.1 osd.1 10.233.76.4:6800/178 205 : cluster [WRN] slow request 30.951168 seconds old, received at 2017-07-11 13:27:08.278327: pg_notify((query:33 sent:82 0.646( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.508583 I | rook-ceph-mon2: 2017-07-11 13:27:39.229590 osd.1 osd.1 10.233.76.4:6800/178 206 : cluster [WRN] slow request 30.905708 seconds old, received at 2017-07-11 13:27:08.323786: pg_notify((query:33 sent:82 0.660( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.508594 I | rook-ceph-mon2: 2017-07-11 13:27:39.229592 osd.1 osd.1 10.233.76.4:6800/178 207 : cluster [WRN] slow request 30.903106 seconds old, received at 2017-07-11 13:27:08.326388: pg_notify((query:33 sent:82 0.663( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.508605 I | rook-ceph-mon2: 2017-07-11 13:27:40.229798 osd.1 osd.1 10.233.76.4:6800/178 208 : cluster [WRN] 86 slow requests, 5 included below; oldest blocked for > 75.142592 secs
- 2017-07-11 13:27:46.508616 I | rook-ceph-mon2: 2017-07-11 13:27:40.229802 osd.1 osd.1 10.233.76.4:6800/178 209 : cluster [WRN] slow request 60.918775 seconds old, received at 2017-07-11 13:26:39.310971: pg_notify((query:25 sent:63 0.557( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 63) currently wait for new map
- 2017-07-11 13:27:46.508627 I | rook-ceph-mon2: 2017-07-11 13:27:40.229805 osd.1 osd.1 10.233.76.4:6800/178 210 : cluster [WRN] slow request 31.923477 seconds old, received at 2017-07-11 13:27:08.306268: pg_notify((query:33 sent:80 0.659( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 80) currently wait for new map
- 2017-07-11 13:27:46.508638 I | rook-ceph-mon2: 2017-07-11 13:27:40.229807 osd.1 osd.1 10.233.76.4:6800/178 211 : cluster [WRN] slow request 31.894077 seconds old, received at 2017-07-11 13:27:08.335668: pg_notify((query:33 sent:80 0.66d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 80) currently wait for new map
- 2017-07-11 13:27:46.508658 I | rook-ceph-mon2: 2017-07-11 13:27:40.229822 osd.1 osd.1 10.233.76.4:6800/178 212 : cluster [WRN] slow request 87.390545 seconds old, received at 2017-07-11 13:26:12.839201: osd_pg_create(e44 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:46.508688 I | rook-ceph-mon2: 2017-07-11 13:27:40.229826 osd.1 osd.1 10.233.76.4:6800/178 213 : cluster [WRN] slow request 56.953126 seconds old, received at 2017-07-11 13:26:43.276620: pg_notify((query:26 sent:61 0.572( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.508712 I | rook-ceph-mon2: 2017-07-11 13:27:41.230168 osd.1 osd.1 10.233.76.4:6800/178 214 : cluster [WRN] 88 slow requests, 5 included below; oldest blocked for > 76.142899 secs
- 2017-07-11 13:27:46.508723 I | rook-ceph-mon2: 2017-07-11 13:27:41.230173 osd.1 osd.1 10.233.76.4:6800/178 215 : cluster [WRN] slow request 60.171119 seconds old, received at 2017-07-11 13:26:41.058933: pg_notify((query:25 sent:61 0.560( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.508739 I | rook-ceph-mon2: 2017-07-11 13:27:41.230175 osd.1 osd.1 10.233.76.4:6800/178 216 : cluster [WRN] slow request 60.223683 seconds old, received at 2017-07-11 13:26:41.006369: pg_notify((query:25 sent:61 0.55c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.508750 I | rook-ceph-mon2: 2017-07-11 13:27:41.230180 osd.1 osd.1 10.233.76.4:6800/178 217 : cluster [WRN] slow request 30.592509 seconds old, received at 2017-07-11 13:27:10.637543: pg_notify((query:33 sent:83 0.69b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:46.508773 I | rook-ceph-mon2: 2017-07-11 13:27:41.230192 osd.1 osd.1 10.233.76.4:6800/178 218 : cluster [WRN] slow request 33.468466 seconds old, received at 2017-07-11 13:27:07.761587: pg_notify((query:33 sent:82 0.546( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.55a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.569( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:46.508784 I | rook-ceph-mon2: 2017-07-11 13:27:41.230195 osd.1 osd.1 10.233.76.4:6800/178 219 : cluster [WRN] slow request 56.124997 seconds old, received at 2017-07-11 13:26:45.105055: pg_notify((query:26 sent:68 0.58a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:46.508795 I | rook-ceph-mon2: 2017-07-11 13:27:42.230491 osd.1 osd.1 10.233.76.4:6800/178 220 : cluster [WRN] 92 slow requests, 5 included below; oldest blocked for > 77.143283 secs
- 2017-07-11 13:27:46.508805 I | rook-ceph-mon2: 2017-07-11 13:27:42.230496 osd.1 osd.1 10.233.76.4:6800/178 221 : cluster [WRN] slow request 60.775534 seconds old, received at 2017-07-11 13:26:41.454902: pg_notify((query:25 sent:61 0.568( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.508816 I | rook-ceph-mon2: 2017-07-11 13:27:42.230500 osd.1 osd.1 10.233.76.4:6800/178 222 : cluster [WRN] slow request 30.955004 seconds old, received at 2017-07-11 13:27:11.275432: pg_notify((query:33 sent:84 0.6a9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.508826 I | rook-ceph-mon2: 2017-07-11 13:27:42.230502 osd.1 osd.1 10.233.76.4:6800/178 223 : cluster [WRN] slow request 30.597711 seconds old, received at 2017-07-11 13:27:11.632725: pg_notify((query:33 sent:84 0.6af( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.508837 I | rook-ceph-mon2: 2017-07-11 13:27:42.230505 osd.1 osd.1 10.233.76.4:6800/178 224 : cluster [WRN] slow request 30.588758 seconds old, received at 2017-07-11 13:27:11.641678: pg_notify((query:33 sent:84 0.6b0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.508847 I | rook-ceph-mon2: 2017-07-11 13:27:42.230508 osd.1 osd.1 10.233.76.4:6800/178 225 : cluster [WRN] slow request 30.092767 seconds old, received at 2017-07-11 13:27:12.137669: pg_notify((query:33 sent:84 0.6b2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.508858 I | rook-ceph-mon2: 2017-07-11 13:27:43.230779 osd.1 osd.1 10.233.76.4:6800/178 226 : cluster [WRN] 93 slow requests, 5 included below; oldest blocked for > 78.143573 secs
- 2017-07-11 13:27:46.508873 I | rook-ceph-mon2: 2017-07-11 13:27:43.230784 osd.1 osd.1 10.233.76.4:6800/178 227 : cluster [WRN] slow request 30.365027 seconds old, received at 2017-07-11 13:27:12.865700: pg_notify((query:33 sent:84 0.6c5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.508885 I | rook-ceph-mon2: 2017-07-11 13:27:43.230787 osd.1 osd.1 10.233.76.4:6800/178 228 : cluster [WRN] slow request 34.456532 seconds old, received at 2017-07-11 13:27:08.774195: pg_notify((query:33 sent:80 0.67d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 80) currently wait for new map
- 2017-07-11 13:27:46.508896 I | rook-ceph-mon2: 2017-07-11 13:27:43.230789 osd.1 osd.1 10.233.76.4:6800/178 229 : cluster [WRN] slow request 67.013127 seconds old, received at 2017-07-11 13:26:36.217600: pg_notify((query:25 sent:60 0.539( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:46.508906 I | rook-ceph-mon2: 2017-07-11 13:27:43.230800 osd.1 osd.1 10.233.76.4:6800/178 230 : cluster [WRN] slow request 59.951200 seconds old, received at 2017-07-11 13:26:43.279526: pg_notify((query:26 sent:66 0.577( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 66) currently wait for new map
- 2017-07-11 13:27:46.508929 I | rook-ceph-mon2: 2017-07-11 13:27:43.230802 osd.1 osd.1 10.233.76.4:6800/178 231 : cluster [WRN] slow request 46.111899 seconds old, received at 2017-07-11 13:26:57.118827: pg_notify((query:26 sent:77 0.601( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:46.508939 I | rook-ceph-mon2: 2017-07-11 13:27:44.230992 osd.1 osd.1 10.233.76.4:6800/178 232 : cluster [WRN] 96 slow requests, 5 included below; oldest blocked for > 79.143791 secs
- 2017-07-11 13:27:46.508948 I | rook-ceph-mon2: 2017-07-11 13:27:44.230997 osd.1 osd.1 10.233.76.4:6800/178 233 : cluster [WRN] slow request 60.503004 seconds old, received at 2017-07-11 13:26:43.727940: pg_notify((query:26 sent:67 0.580( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:46.508958 I | rook-ceph-mon2: 2017-07-11 13:27:44.231000 osd.1 osd.1 10.233.76.4:6800/178 234 : cluster [WRN] slow request 30.193221 seconds old, received at 2017-07-11 13:27:14.037724: pg_notify((query:33 sent:84 0.6e4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.508968 I | rook-ceph-mon2: 2017-07-11 13:27:44.231004 osd.1 osd.1 10.233.76.4:6800/178 235 : cluster [WRN] slow request 60.491647 seconds old, received at 2017-07-11 13:26:43.739297: pg_notify((query:26 sent:67 0.581( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:46.508981 I | rook-ceph-mon2: 2017-07-11 13:27:44.231007 osd.1 osd.1 10.233.76.4:6800/178 236 : cluster [WRN] slow request 30.184016 seconds old, received at 2017-07-11 13:27:14.046928: pg_notify((query:33 sent:84 0.6dc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.508992 I | rook-ceph-mon2: 2017-07-11 13:27:44.231009 osd.1 osd.1 10.233.76.4:6800/178 237 : cluster [WRN] slow request 60.954325 seconds old, received at 2017-07-11 13:26:43.276620: pg_notify((query:26 sent:61 0.572( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:46.509002 I | rook-ceph-mon2: 2017-07-11 13:27:45.231175 osd.1 osd.1 10.233.76.4:6800/178 238 : cluster [WRN] 102 slow requests, 5 included below; oldest blocked for > 80.143968 secs
- 2017-07-11 13:27:46.509012 I | rook-ceph-mon2: 2017-07-11 13:27:45.231179 osd.1 osd.1 10.233.76.4:6800/178 239 : cluster [WRN] slow request 30.669061 seconds old, received at 2017-07-11 13:27:14.562060: pg_notify((query:33 sent:84 0.6eb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.509022 I | rook-ceph-mon2: 2017-07-11 13:27:45.231184 osd.1 osd.1 10.233.76.4:6800/178 240 : cluster [WRN] slow request 60.981872 seconds old, received at 2017-07-11 13:26:44.249250: pg_notify((query:26 sent:67 0.584( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:46.509043 I | rook-ceph-mon2: 2017-07-11 13:27:45.231186 osd.1 osd.1 10.233.76.4:6800/178 241 : cluster [WRN] slow request 30.579540 seconds old, received at 2017-07-11 13:27:14.651582: pg_notify((query:33 sent:84 0.6f4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:46.509053 I | rook-ceph-mon2: 2017-07-11 13:27:45.231188 osd.1 osd.1 10.233.76.4:6800/178 242 : cluster [WRN] slow request 30.579626 seconds old, received at 2017-07-11 13:27:14.651495: pg_notify((query:33 sent:83 0.6fb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:46.509082 I | rook-ceph-mon2: 2017-07-11 13:27:45.231190 osd.1 osd.1 10.233.76.4:6800/178 243 : cluster [WRN] slow request 30.150142 seconds old, received at 2017-07-11 13:27:15.080979: pg_notify((query:33 sent:83 0.704( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:46.509093 I | rook-ceph-mon2: 2017-07-11 13:27:45.268744 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 252 : cluster [INF] osdmap e98: 6 total, 6 up, 6 in
- 2017-07-11 13:27:46.509105 I | rook-ceph-mon2: 2017-07-11 13:27:45.978362 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 253 : cluster [INF] osd.0 failed (root=default,host=master-1) (3 reporters from different host after 33.064678 >= grace 24.401318)
- 2017-07-11 13:27:46.509116 I | rook-ceph-mon2: 2017-07-11 13:27:46.220901 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 254 : cluster [INF] osdmap e99: 6 total, 5 up, 6 in
- 2017-07-11 13:27:47.650868 I | rook-ceph-mon2: 2017-07-11 13:27:37.573529 osd.3 osd.3 10.233.86.0:6800/178 15 : cluster [WRN] map e92 wrongly marked me down at e91
- 2017-07-11 13:27:49.079482 I | rook-ceph-mon2: 2017-07-11 13:27:47.874831 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 255 : cluster [INF] osdmap e100: 6 total, 5 up, 6 in
- 2017-07-11 13:27:50.793825 I | rook-ceph-mon2: 2017-07-11 13:27:49.481726 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 256 : cluster [INF] osdmap e101: 6 total, 5 up, 6 in
- 2017-07-11 13:27:52.235801 I | rook-ceph-mon2: 2017-07-11 13:27:51.023882 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 257 : cluster [INF] osdmap e102: 6 total, 5 up, 6 in
- 2017-07-11 13:27:52.235865 I | rook-ceph-mon2: 2017-07-11 13:27:51.496114 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 258 : cluster [INF] osdmap e103: 6 total, 5 up, 6 in
- 2017-07-11 13:27:52.236250 I | rook-ceph-mon2: 2017-07-11 13:27:52.236232 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:27:52.236330 I | rook-ceph-mon2: 2017-07-11 13:27:52.236316 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1242058219' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:27:53.531805 I | rook-ceph-mon2: 2017-07-11 13:27:52.669897 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 259 : cluster [INF] osdmap e104: 6 total, 5 up, 6 in
- 2017-07-11 13:27:55.064090 I | rook-ceph-mon2: 2017-07-11 13:27:53.915602 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 260 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:27:55.064156 I | rook-ceph-mon2: 2017-07-11 13:27:53.952139 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 262 : cluster [INF] osdmap e105: 6 total, 6 up, 6 in
- 2017-07-11 13:27:56.746204 I | rook-ceph-mon2: 2017-07-11 13:27:46.231376 osd.1 osd.1 10.233.76.4:6800/178 244 : cluster [WRN] 105 slow requests, 5 included below; oldest blocked for > 81.144176 secs
- 2017-07-11 13:27:56.746303 I | rook-ceph-mon2: 2017-07-11 13:27:46.231380 osd.1 osd.1 10.233.76.4:6800/178 245 : cluster [WRN] slow request 60.627491 seconds old, received at 2017-07-11 13:26:45.603838: pg_notify((query:26 sent:68 0.595( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:56.746366 I | rook-ceph-mon2: 2017-07-11 13:27:46.231384 osd.1 osd.1 10.233.76.4:6800/178 246 : cluster [WRN] slow request 30.655197 seconds old, received at 2017-07-11 13:27:15.576133: pg_notify((query:33 sent:85 0.710( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 85) currently wait for new map
- 2017-07-11 13:27:56.746418 I | rook-ceph-mon2: 2017-07-11 13:27:46.231386 osd.1 osd.1 10.233.76.4:6800/178 247 : cluster [WRN] slow request 30.282693 seconds old, received at 2017-07-11 13:27:15.948637: pg_notify((query:33 sent:85 0.718( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 85) currently wait for new map
- 2017-07-11 13:27:56.746432 I | rook-ceph-mon2: 2017-07-11 13:27:46.231389 osd.1 osd.1 10.233.76.4:6800/178 248 : cluster [WRN] slow request 31.116766 seconds old, received at 2017-07-11 13:27:15.114563: pg_notify((query:33 sent:83 0.707( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:56.746444 I | rook-ceph-mon2: 2017-07-11 13:27:46.231391 osd.1 osd.1 10.233.76.4:6800/178 249 : cluster [WRN] slow request 31.665693 seconds old, received at 2017-07-11 13:27:14.565637: pg_notify((query:33 sent:84 0.6ec( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:56.746476 I | rook-ceph-mon2: 2017-07-11 13:27:47.231623 osd.1 osd.1 10.233.76.4:6800/178 250 : cluster [WRN] 98 slow requests, 5 included below; oldest blocked for > 82.144421 secs
- 2017-07-11 13:27:56.746492 I | rook-ceph-mon2: 2017-07-11 13:27:47.231627 osd.1 osd.1 10.233.76.4:6800/178 251 : cluster [WRN] slow request 62.126519 seconds old, received at 2017-07-11 13:26:45.105055: pg_notify((query:26 sent:68 0.58a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:56.746504 I | rook-ceph-mon2: 2017-07-11 13:27:47.231630 osd.1 osd.1 10.233.76.4:6800/178 252 : cluster [WRN] slow request 63.952048 seconds old, received at 2017-07-11 13:26:43.279526: pg_notify((query:26 sent:66 0.577( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 66) currently wait for new map
- 2017-07-11 13:27:56.746516 I | rook-ceph-mon2: 2017-07-11 13:27:47.231632 osd.1 osd.1 10.233.76.4:6800/178 253 : cluster [WRN] slow request 31.698025 seconds old, received at 2017-07-11 13:27:15.533549: pg_notify((query:33 sent:85 0.70d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 85) currently wait for new map
- 2017-07-11 13:27:56.746527 I | rook-ceph-mon2: 2017-07-11 13:27:47.231635 osd.1 osd.1 10.233.76.4:6800/178 254 : cluster [WRN] slow request 73.529111 seconds old, received at 2017-07-11 13:26:33.702464: pg_notify((query:25 sent:56 0.51c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:56.746552 I | rook-ceph-mon2: 2017-07-11 13:27:47.231638 osd.1 osd.1 10.233.76.4:6800/178 255 : cluster [WRN] slow request 62.639275 seconds old, received at 2017-07-11 13:26:44.592300: pg_notify((query:26 sent:67 0.585( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:56.746564 I | rook-ceph-mon2: 2017-07-11 13:27:48.232898 osd.1 osd.1 10.233.76.4:6800/178 256 : cluster [WRN] 91 slow requests, 5 included below; oldest blocked for > 96.647456 secs
- 2017-07-11 13:27:56.746581 I | rook-ceph-mon2: 2017-07-11 13:27:48.232904 osd.1 osd.1 10.233.76.4:6800/178 257 : cluster [WRN] slow request 63.640544 seconds old, received at 2017-07-11 13:26:44.592300: pg_notify((query:26 sent:67 0.585( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:56.746594 I | rook-ceph-mon2: 2017-07-11 13:27:48.232907 osd.1 osd.1 10.233.76.4:6800/178 258 : cluster [WRN] slow request 40.013111 seconds old, received at 2017-07-11 13:27:08.219733: pg_notify((query:33 sent:82 0.5d4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:56.746606 I | rook-ceph-mon2: 2017-07-11 13:27:48.232909 osd.1 osd.1 10.233.76.4:6800/178 259 : cluster [WRN] slow request 71.590286 seconds old, received at 2017-07-11 13:26:36.642558: pg_notify((query:25 sent:61 0.53d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:56.746631 I | rook-ceph-mon2: 2017-07-11 13:27:48.232911 osd.1 osd.1 10.233.76.4:6800/178 260 : cluster [WRN] slow request 43.246956 seconds old, received at 2017-07-11 13:27:04.985887: pg_notify((query:30 sent:78 0.5f9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:30 sent:78 0.608( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.60a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:56.746648 I | rook-ceph-mon2: 2017-07-11 13:27:48.232914 osd.1 osd.1 10.233.76.4:6800/178 261 : cluster [WRN] slow request 37.072739 seconds old, received at 2017-07-11 13:27:11.160105: pg_notify((query:33 sent:84 0.69c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:56.746660 I | rook-ceph-mon2: 2017-07-11 13:27:49.233130 osd.1 osd.1 10.233.76.4:6800/178 262 : cluster [WRN] 92 slow requests, 5 included below; oldest blocked for > 97.647688 secs
- 2017-07-11 13:27:56.746671 I | rook-ceph-mon2: 2017-07-11 13:27:49.233135 osd.1 osd.1 10.233.76.4:6800/178 263 : cluster [WRN] slow request 30.033977 seconds old, received at 2017-07-11 13:27:19.199097: pg_notify((query:33 sent:86 0.735( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:56.746682 I | rook-ceph-mon2: 2017-07-11 13:27:49.233137 osd.1 osd.1 10.233.76.4:6800/178 264 : cluster [WRN] slow request 70.813718 seconds old, received at 2017-07-11 13:26:38.419357: pg_notify((query:25 sent:62 0.551( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 62) currently wait for new map
- 2017-07-11 13:27:56.746705 I | rook-ceph-mon2: 2017-07-11 13:27:49.233140 osd.1 osd.1 10.233.76.4:6800/178 265 : cluster [WRN] slow request 60.350007 seconds old, received at 2017-07-11 13:26:48.883068: pg_notify((query:26 sent:70 0.5ab( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 70) currently wait for new map
- 2017-07-11 13:27:56.746722 I | rook-ceph-mon2: 2017-07-11 13:27:49.233142 osd.1 osd.1 10.233.76.4:6800/178 266 : cluster [WRN] slow request 51.699534 seconds old, received at 2017-07-11 13:26:57.533540: pg_notify((query:26 sent:77 0.605( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:56.746738 I | rook-ceph-mon2: 2017-07-11 13:27:49.233146 osd.1 osd.1 10.233.76.4:6800/178 267 : cluster [WRN] slow request 75.255146 seconds old, received at 2017-07-11 13:26:33.977929: pg_notify((query:25 sent:56 0.51e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:56.746751 I | rook-ceph-mon2: 2017-07-11 13:27:50.233371 osd.1 osd.1 10.233.76.4:6800/178 268 : cluster [WRN] 93 slow requests, 5 included below; oldest blocked for > 98.647930 secs
- 2017-07-11 13:27:56.746763 I | rook-ceph-mon2: 2017-07-11 13:27:50.233377 osd.1 osd.1 10.233.76.4:6800/178 269 : cluster [WRN] slow request 30.401485 seconds old, received at 2017-07-11 13:27:19.831832: pg_notify((query:33 sent:86 0.73a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:56.746811 I | rook-ceph-mon2: 2017-07-11 13:27:50.233379 osd.1 osd.1 10.233.76.4:6800/178 270 : cluster [WRN] slow request 61.350249 seconds old, received at 2017-07-11 13:26:48.883068: pg_notify((query:26 sent:70 0.5ab( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 70) currently wait for new map
- 2017-07-11 13:27:56.746822 I | rook-ceph-mon2: 2017-07-11 13:27:50.233382 osd.1 osd.1 10.233.76.4:6800/178 271 : cluster [WRN] slow request 66.953742 seconds old, received at 2017-07-11 13:26:43.279575: pg_notify((query:26 sent:66 0.57a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 66) currently wait for new map
- 2017-07-11 13:27:56.746833 I | rook-ceph-mon2: 2017-07-11 13:27:50.233384 osd.1 osd.1 10.233.76.4:6800/178 272 : cluster [WRN] slow request 42.012912 seconds old, received at 2017-07-11 13:27:08.220405: pg_notify((query:33 sent:82 0.634( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:56.746843 I | rook-ceph-mon2: 2017-07-11 13:27:50.233386 osd.1 osd.1 10.233.76.4:6800/178 273 : cluster [WRN] slow request 70.342753 seconds old, received at 2017-07-11 13:26:39.890564: pg_notify((query:25 sent:61 0.558( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:56.746854 I | rook-ceph-mon2: 2017-07-11 13:27:51.242252 osd.1 osd.1 10.233.76.4:6800/178 274 : cluster [WRN] 104 slow requests, 5 included below; oldest blocked for > 99.656573 secs
- 2017-07-11 13:27:56.746887 I | rook-ceph-mon2: 2017-07-11 13:27:51.242257 osd.1 osd.1 10.233.76.4:6800/178 275 : cluster [WRN] slow request 60.200202 seconds old, received at 2017-07-11 13:26:51.041759: pg_notify((query:26 sent:72 0.5bc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 72) currently wait for new map
- 2017-07-11 13:27:56.746904 I | rook-ceph-mon2: 2017-07-11 13:27:51.242266 osd.1 osd.1 10.233.76.4:6800/178 276 : cluster [WRN] slow request 96.978876 seconds old, received at 2017-07-11 13:26:14.263085: osd_pg_create(e45 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.746926 I | rook-ceph-mon2: 2017-07-11 13:27:51.242273 osd.1 osd.1 10.233.76.4:6800/178 277 : cluster [WRN] slow request 95.369145 seconds old, received at 2017-07-11 13:26:15.872816: osd_pg_create(e46 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.746962 I | rook-ceph-mon2: 2017-07-11 13:27:51.242278 osd.1 osd.1 10.233.76.4:6800/178 278 : cluster [WRN] slow request 94.044219 seconds old, received at 2017-07-11 13:26:17.197741: osd_pg_create(e47 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.746983 I | rook-ceph-mon2: 2017-07-11 13:27:51.242283 osd.1 osd.1 10.233.76.4:6800/178 279 : cluster [WRN] slow request 92.879030 seconds old, received at 2017-07-11 13:26:18.362931: osd_pg_create(e48 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.747000 I | rook-ceph-mon2: 2017-07-11 13:27:51.845944 osd.0 osd.0 10.233.72.0:6800/180 51 : cluster [WRN] map e103 wrongly marked me down at e99
- 2017-07-11 13:27:56.747010 I | rook-ceph-mon2: 2017-07-11 13:27:52.242645 osd.1 osd.1 10.233.76.4:6800/178 280 : cluster [WRN] 87 slow requests, 5 included below; oldest blocked for > 75.599868 secs
- 2017-07-11 13:27:56.747057 I | rook-ceph-mon2: 2017-07-11 13:27:52.242657 osd.1 osd.1 10.233.76.4:6800/178 281 : cluster [WRN] slow request 95.044685 seconds old, received at 2017-07-11 13:26:17.197741: osd_pg_create(e47 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently started
- 2017-07-11 13:27:56.747080 I | rook-ceph-mon2: 2017-07-11 13:27:52.242662 osd.1 osd.1 10.233.76.4:6800/178 282 : cluster [WRN] slow request 93.879496 seconds old, received at 2017-07-11 13:26:18.362931: osd_pg_create(e48 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.747133 I | rook-ceph-mon2: 2017-07-11 13:27:52.242667 osd.1 osd.1 10.233.76.4:6800/178 283 : cluster [WRN] slow request 92.142505 seconds old, received at 2017-07-11 13:26:20.099922: osd_pg_create(e49 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.747158 I | rook-ceph-mon2: 2017-07-11 13:27:52.242672 osd.1 osd.1 10.233.76.4:6800/178 284 : cluster [WRN] slow request 90.643368 seconds old, received at 2017-07-11 13:26:21.599058: osd_pg_create(e50 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.747182 I | rook-ceph-mon2: 2017-07-11 13:27:52.242687 osd.1 osd.1 10.233.76.4:6800/178 285 : cluster [WRN] slow request 89.306341 seconds old, received at 2017-07-11 13:26:22.936086: osd_pg_create(e51 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.747208 I | rook-ceph-mon2: 2017-07-11 13:27:53.242971 osd.1 osd.1 10.233.76.4:6800/178 286 : cluster [WRN] 85 slow requests, 5 included below; oldest blocked for > 76.600234 secs
- 2017-07-11 13:27:56.747223 I | rook-ceph-mon2: 2017-07-11 13:27:53.242975 osd.1 osd.1 10.233.76.4:6800/178 287 : cluster [WRN] slow request 30.644460 seconds old, received at 2017-07-11 13:27:22.598333: pg_notify((query:33 sent:88 0.754( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 88) currently wait for new map
- 2017-07-11 13:27:56.747235 I | rook-ceph-mon2: 2017-07-11 13:27:53.242978 osd.1 osd.1 10.233.76.4:6800/178 288 : cluster [WRN] slow request 89.851805 seconds old, received at 2017-07-11 13:26:23.390988: osd pg remove(epoch 50; pg0.4d; ) currently wait for new map
- 2017-07-11 13:27:56.747253 I | rook-ceph-mon2: 2017-07-11 13:27:53.242982 osd.1 osd.1 10.233.76.4:6800/178 289 : cluster [WRN] slow request 90.306707 seconds old, received at 2017-07-11 13:26:22.936086: osd_pg_create(e51 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently started
- 2017-07-11 13:27:56.747291 I | rook-ceph-mon2: 2017-07-11 13:27:53.242986 osd.1 osd.1 10.233.76.4:6800/178 290 : cluster [WRN] slow request 88.629480 seconds old, received at 2017-07-11 13:26:24.613312: osd_pg_create(e52 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.747309 I | rook-ceph-mon2: 2017-07-11 13:27:53.242989 osd.1 osd.1 10.233.76.4:6800/178 291 : cluster [WRN] slow request 88.254915 seconds old, received at 2017-07-11 13:26:24.987877: osd_pg_create(e53 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:56.747327 I | rook-ceph-mon2: 2017-07-11 13:27:54.248265 osd.1 osd.1 10.233.76.4:6800/178 292 : cluster [WRN] 77 slow requests, 5 included below; oldest blocked for > 77.605662 secs
- 2017-07-11 13:27:56.747339 I | rook-ceph-mon2: 2017-07-11 13:27:54.248269 osd.1 osd.1 10.233.76.4:6800/178 293 : cluster [WRN] slow request 62.261968 seconds old, received at 2017-07-11 13:26:51.986252: pg_notify((query:26 sent:73 0.5cb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 73) currently wait for new map
- 2017-07-11 13:27:56.747368 I | rook-ceph-mon2: 2017-07-11 13:27:54.248273 osd.1 osd.1 10.233.76.4:6800/178 294 : cluster [WRN] slow request 60.475974 seconds old, received at 2017-07-11 13:26:53.772246: pg_notify((query:26 sent:75 0.5df( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 75) currently wait for new map
- 2017-07-11 13:27:56.747382 I | rook-ceph-mon2: 2017-07-11 13:27:54.248277 osd.1 osd.1 10.233.76.4:6800/178 295 : cluster [WRN] slow request 33.326644 seconds old, received at 2017-07-11 13:27:20.921576: pg_notify((query:33 sent:86 0.743( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:56.747393 I | rook-ceph-mon2: 2017-07-11 13:27:54.248279 osd.1 osd.1 10.233.76.4:6800/178 296 : cluster [WRN] slow request 32.118362 seconds old, received at 2017-07-11 13:27:22.129859: pg_notify((query:33 sent:86 0.751( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:56.747404 I | rook-ceph-mon2: 2017-07-11 13:27:54.248282 osd.1 osd.1 10.233.76.4:6800/178 297 : cluster [WRN] slow request 33.820998 seconds old, received at 2017-07-11 13:27:20.427222: pg_notify((query:33 sent:87 0.741( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 87) currently wait for new map
- 2017-07-11 13:27:56.747415 I | rook-ceph-mon2: 2017-07-11 13:27:55.248442 osd.1 osd.1 10.233.76.4:6800/178 298 : cluster [WRN] 59 slow requests, 5 included below; oldest blocked for > 64.206642 secs
- 2017-07-11 13:27:56.747438 I | rook-ceph-mon2: 2017-07-11 13:27:55.248447 osd.1 osd.1 10.233.76.4:6800/178 299 : cluster [WRN] slow request 60.469408 seconds old, received at 2017-07-11 13:26:54.778993: pg_notify((query:26 sent:76 0.5eb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:56.747451 I | rook-ceph-mon2: 2017-07-11 13:27:55.248450 osd.1 osd.1 10.233.76.4:6800/178 300 : cluster [WRN] slow request 60.028286 seconds old, received at 2017-07-11 13:26:55.220115: pg_notify((query:26 sent:76 0.5f2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:56.747462 I | rook-ceph-mon2: 2017-07-11 13:27:55.248454 osd.1 osd.1 10.233.76.4:6800/178 301 : cluster [WRN] slow request 60.647076 seconds old, received at 2017-07-11 13:26:54.601325: pg_notify((query:26 sent:76 0.5e8( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:56.747473 I | rook-ceph-mon2: 2017-07-11 13:27:55.248457 osd.1 osd.1 10.233.76.4:6800/178 302 : cluster [WRN] slow request 33.915342 seconds old, received at 2017-07-11 13:27:21.333059: pg_notify((query:33 sent:88 0.74a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 88) currently wait for new map
- 2017-07-11 13:27:56.747499 I | rook-ceph-mon2: 2017-07-11 13:27:55.248459 osd.1 osd.1 10.233.76.4:6800/178 303 : cluster [WRN] slow request 41.837203 seconds old, received at 2017-07-11 13:27:13.411198: pg_notify((query:33 sent:84 0.6cd( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:56.747546 I | rook-ceph-mon2: 2017-07-11 13:27:55.359173 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 263 : cluster [INF] osdmap e106: 6 total, 6 up, 6 in
- 2017-07-11 13:27:57.683446 I | rook-ceph-mon2: 2017-07-11 13:27:57.683265 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4805 MB, avail 94381 MB
- 2017-07-11 13:27:58.429761 I | rook-ceph-mon2: 2017-07-11 13:27:56.470839 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 264 : cluster [INF] osdmap e107: 6 total, 6 up, 6 in
- 2017-07-11 13:27:58.429844 I | rook-ceph-mon2: 2017-07-11 13:27:57.081894 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 265 : cluster [INF] osdmap e108: 6 total, 6 up, 6 in
- 2017-07-11 13:27:59.554045 I | rook-ceph-mon2: 2017-07-11 13:27:57.891366 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 266 : cluster [INF] osdmap e109: 6 total, 6 up, 6 in
- 2017-07-11 13:27:59.554231 I | rook-ceph-mon2: 2017-07-11 13:27:59.197103 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 267 : cluster [INF] osdmap e110: 6 total, 6 up, 6 in
- 2017-07-11 13:28:02.503611 I | rook-ceph-mon2: 2017-07-11 13:28:01.375068 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 269 : cluster [INF] osdmap e111: 6 total, 6 up, 6 in
- 2017-07-11 13:28:02.503681 I | rook-ceph-mon2: 2017-07-11 13:28:01.767503 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 270 : cluster [INF] osdmap e112: 6 total, 6 up, 6 in
- 2017-07-11 13:28:04.171490 I | rook-ceph-mon2: 2017-07-11 13:28:03.045809 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 271 : cluster [INF] osdmap e113: 6 total, 6 up, 6 in
- 2017-07-11 13:28:05.589525 I | rook-ceph-mon2: 2017-07-11 13:28:04.370173 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 273 : cluster [INF] osdmap e114: 6 total, 6 up, 6 in
- 2017-07-11 13:28:05.589598 I | rook-ceph-mon2: 2017-07-11 13:28:05.281233 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 275 : cluster [INF] HEALTH_WARN; 178 pgs peering; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:28:07.379282 I | rook-ceph-mon2: 2017-07-11 13:27:56.248965 osd.1 osd.1 10.233.76.4:6800/178 304 : cluster [WRN] 51 slow requests, 5 included below; oldest blocked for > 48.503111 secs
- 2017-07-11 13:28:07.379498 I | rook-ceph-mon2: 2017-07-11 13:27:56.248970 osd.1 osd.1 10.233.76.4:6800/178 305 : cluster [WRN] slow request 48.009182 seconds old, received at 2017-07-11 13:27:08.239537: osd pg remove(epoch 82; pg0.336; ) currently wait for new map
- 2017-07-11 13:28:07.379526 I | rook-ceph-mon2: 2017-07-11 13:27:56.248972 osd.1 osd.1 10.233.76.4:6800/178 306 : cluster [WRN] slow request 47.970436 seconds old, received at 2017-07-11 13:27:08.278283: osd pg remove(epoch 82; pg0.2e6; ) currently wait for new map
- 2017-07-11 13:28:07.379539 I | rook-ceph-mon2: 2017-07-11 13:27:56.248975 osd.1 osd.1 10.233.76.4:6800/178 307 : cluster [WRN] slow request 48.009160 seconds old, received at 2017-07-11 13:27:08.239559: osd pg remove(epoch 82; pg0.199; ) currently wait for new map
- 2017-07-11 13:28:07.379563 I | rook-ceph-mon2: 2017-07-11 13:27:56.248977 osd.1 osd.1 10.233.76.4:6800/178 308 : cluster [WRN] slow request 47.970427 seconds old, received at 2017-07-11 13:27:08.278291: osd pg remove(epoch 82; pg0.3b3; ) currently wait for new map
- 2017-07-11 13:28:07.379593 I | rook-ceph-mon2: 2017-07-11 13:27:56.248980 osd.1 osd.1 10.233.76.4:6800/178 309 : cluster [WRN] slow request 48.009044 seconds old, received at 2017-07-11 13:27:08.239674: osd pg remove(epoch 82; pg0.197; ) currently wait for new map
- 2017-07-11 13:28:07.379616 I | rook-ceph-mon2: 2017-07-11 13:27:57.249520 osd.1 osd.1 10.233.76.4:6800/178 310 : cluster [WRN] 28 slow requests, 2 included below; oldest blocked for > 46.611937 secs
- 2017-07-11 13:28:07.379646 I | rook-ceph-mon2: 2017-07-11 13:27:57.249525 osd.1 osd.1 10.233.76.4:6800/178 311 : cluster [WRN] slow request 30.617720 seconds old, received at 2017-07-11 13:27:26.631760: pg_notify((query:33 sent:86 0.775( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:28:07.379661 I | rook-ceph-mon2: 2017-07-11 13:27:57.249528 osd.1 osd.1 10.233.76.4:6800/178 312 : cluster [WRN] slow request 30.041037 seconds old, received at 2017-07-11 13:27:27.208443: pg_notify((query:33 sent:86 0.77d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:28:07.379684 I | rook-ceph-mon2: 2017-07-11 13:28:05.804575 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 276 : cluster [INF] osdmap e115: 6 total, 6 up, 6 in
- 2017-07-11 13:28:08.937295 I | rook-ceph-mon2: 2017-07-11 13:28:06.907330 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 278 : cluster [INF] osdmap e116: 6 total, 6 up, 6 in
- 2017-07-11 13:28:08.937316 I | rook-ceph-mon2: 2017-07-11 13:28:08.157071 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 280 : cluster [INF] osdmap e117: 6 total, 6 up, 6 in
- 2017-07-11 13:28:09.907804 I | rook-ceph-mon2: 2017-07-11 13:28:09.528677 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 281 : cluster [INF] osdmap e118: 6 total, 6 up, 6 in
- 2017-07-11 13:28:11.830938 I | rook-ceph-mon2: 2017-07-11 13:28:10.772923 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 282 : cluster [INF] osdmap e119: 6 total, 6 up, 6 in
- 2017-07-11 13:28:14.004384 I | rook-ceph-mon2: 2017-07-11 13:28:12.744037 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 283 : cluster [INF] osdmap e120: 6 total, 6 up, 6 in
- 2017-07-11 13:28:15.335472 I | rook-ceph-mon2: 2017-07-11 13:28:14.371326 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 285 : cluster [INF] osdmap e121: 6 total, 6 up, 6 in
- 2017-07-11 13:28:16.701576 I | rook-ceph-mon2: 2017-07-11 13:28:15.650065 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 286 : cluster [INF] osdmap e122: 6 total, 6 up, 6 in
- 2017-07-11 13:28:18.175672 I | rook-ceph-mon2: 2017-07-11 13:28:17.031562 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 289 : cluster [INF] osdmap e123: 6 total, 6 up, 6 in
- 2017-07-11 13:28:18.175747 I | rook-ceph-mon2: 2017-07-11 13:28:17.239569 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 291 : cluster [INF] osdmap e124: 6 total, 6 up, 6 in
- 2017-07-11 13:28:21.098963 I | rook-ceph-mon2: 2017-07-11 13:28:19.653996 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 292 : cluster [INF] osdmap e125: 6 total, 6 up, 6 in
- 2017-07-11 13:28:22.334913 I | rook-ceph-mon2: 2017-07-11 13:28:20.915334 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 297 : cluster [INF] osdmap e126: 6 total, 6 up, 6 in
- 2017-07-11 13:28:43.249931 I | rook-ceph-mon2: 2017-07-11 13:28:43.248744 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 13:28:43.250010 I | rook-ceph-mon2: 2017-07-11 13:28:43.249531 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2627197876' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 13:28:46.870239 I | rook-ceph-mon2: 2017-07-11 13:28:46.408075 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 300 : cluster [INF] osd.0 failed (root=default,host=master-1) (5 reporters from different host after 27.149230 >= grace 25.430099)
- 2017-07-11 13:28:46.870320 I | rook-ceph-mon2: 2017-07-11 13:28:46.408119 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 301 : cluster [INF] osd.2 failed (root=default,host=master-0) (5 reporters from different host after 27.148959 >= grace 25.137665)
- 2017-07-11 13:28:46.870338 I | rook-ceph-mon2: 2017-07-11 13:28:46.408138 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 302 : cluster [INF] osd.3 failed (root=default,host=master-2) (5 reporters from different host after 27.148717 >= grace 24.383721)
- 2017-07-11 13:28:48.107107 I | rook-ceph-mon2: 2017-07-11 13:28:46.611904 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 303 : cluster [INF] osdmap e127: 6 total, 3 up, 6 in
- 2017-07-11 13:28:48.107209 I | rook-ceph-mon2: 2017-07-11 13:28:46.811742 osd.3 osd.3 10.233.86.0:6800/178 16 : cluster [WRN] map e127 wrongly marked me down at e127
- 2017-07-11 13:28:49.449626 I | rook-ceph-mon2: 2017-07-11 13:28:48.346465 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 304 : cluster [INF] osd.2 10.233.69.0:6800/178 boot
- 2017-07-11 13:28:49.449705 I | rook-ceph-mon2: 2017-07-11 13:28:48.346713 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 305 : cluster [INF] osdmap e128: 6 total, 4 up, 6 in
- 2017-07-11 13:28:49.449722 I | rook-ceph-mon2: 2017-07-11 13:28:48.725338 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 306 : cluster [INF] osdmap e129: 6 total, 4 up, 6 in
- 2017-07-11 13:28:50.825998 I | rook-ceph-mon2: 2017-07-11 13:28:46.720300 osd.2 osd.2 10.233.69.0:6800/178 16 : cluster [WRN] map e127 wrongly marked me down at e127
- 2017-07-11 13:28:50.833510 I | rook-ceph-mon2: 2017-07-11 13:28:49.970181 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 307 : cluster [INF] osd.3 10.233.86.0:6800/178 boot
- 2017-07-11 13:28:50.833550 I | rook-ceph-mon2: 2017-07-11 13:28:49.970424 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 308 : cluster [INF] osd.0 10.233.72.0:6800/180 boot
- 2017-07-11 13:28:50.833578 I | rook-ceph-mon2: 2017-07-11 13:28:49.970609 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 309 : cluster [INF] osdmap e130: 6 total, 6 up, 6 in
- 2017-07-11 13:28:50.833593 I | rook-ceph-mon2: 2017-07-11 13:28:50.348085 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 310 : cluster [INF] osdmap e131: 6 total, 6 up, 6 in
- 2017-07-11 13:28:55.065821 I | rook-ceph-mon2: 2017-07-11 13:28:55.065789 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 13:28:55.066001 I | rook-ceph-mon2: 2017-07-11 13:28:55.065921 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1288746055' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 13:28:56.543042 I | rook-ceph-mon2: 2017-07-11 13:28:46.711677 osd.0 osd.0 10.233.72.0:6800/180 52 : cluster [WRN] map e127 wrongly marked me down at e127
- 2017-07-11 13:28:57.713733 I | rook-ceph-mon2: 2017-07-11 13:28:57.713552 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4806 MB, avail 94380 MB
- 2017-07-11 13:29:05.529017 I | rook-ceph-mon2: 2017-07-11 13:29:05.281261 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 312 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.057379s > max 0.05s
- 2017-07-11 13:29:05.529112 I | rook-ceph-mon2: 2017-07-11 13:29:05.281595 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 313 : cluster [INF] HEALTH_WARN; clock skew detected on mon.rook-ceph-mon2; too many PGs per OSD (341 > max 300); Monitor clock skew detected
- 2017-07-11 13:29:35.571723 I | rook-ceph-mon2: 2017-07-11 13:29:35.282978 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 332 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0567242s > max 0.05s
- 2017-07-11 13:29:36.836618 I | rook-ceph-mon2: 2017-07-11 13:29:36.441482 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 333 : cluster [INF] osd.5 failed (root=default,host=minion-1) (4 reporters from different host after 24.165733 >= grace 22.318605)
- 2017-07-11 13:29:36.836713 I | rook-ceph-mon2: 2017-07-11 13:29:36.551524 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 334 : cluster [INF] osdmap e132: 6 total, 5 up, 6 in
- 2017-07-11 13:29:40.302769 I | rook-ceph-mon2: 2017-07-11 13:29:40.302729 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:29:40.303029 I | rook-ceph-mon2: 2017-07-11 13:29:40.303011 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/392558207' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:29:42.211451 I | rook-ceph-mon2: 2017-07-11 13:29:41.457270 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 337 : cluster [INF] osd.0 failed (root=default,host=master-1) (4 reporters from different host after 26.826850 >= grace 25.513242)
- 2017-07-11 13:29:42.211547 I | rook-ceph-mon2: 2017-07-11 13:29:41.457311 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 338 : cluster [INF] osd.2 failed (root=default,host=master-0) (4 reporters from different host after 27.632048 >= grace 25.128155)
- 2017-07-11 13:29:42.211570 I | rook-ceph-mon2: 2017-07-11 13:29:41.457327 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 339 : cluster [INF] osd.3 failed (root=default,host=master-2) (4 reporters from different host after 26.826716 >= grace 24.377216)
- 2017-07-11 13:29:42.211597 I | rook-ceph-mon2: 2017-07-11 13:29:41.695300 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 340 : cluster [INF] osdmap e133: 6 total, 2 up, 6 in
- 2017-07-11 13:29:47.067174 I | rook-ceph-mon2: 2017-07-11 13:29:41.780816 osd.0 osd.0 10.233.72.0:6800/180 53 : cluster [WRN] map e133 wrongly marked me down at e133
- 2017-07-11 13:29:47.067250 I | rook-ceph-mon2: 2017-07-11 13:29:46.508018 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 341 : cluster [INF] osd.4 failed (root=default,host=minion-2) (2 reporters from different host after 26.605152 >= grace 24.528981)
- 2017-07-11 13:29:47.067270 I | rook-ceph-mon2: 2017-07-11 13:29:46.835426 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 342 : cluster [INF] osdmap e134: 6 total, 1 up, 6 in
- 2017-07-11 13:29:48.256931 I | rook-ceph-mon2: 2017-07-11 13:29:41.699497 osd.3 osd.3 10.233.86.0:6800/178 17 : cluster [WRN] map e133 wrongly marked me down at e133
- 2017-07-11 13:29:49.752108 I | rook-ceph-mon2: 2017-07-11 13:29:41.877104 osd.2 osd.2 10.233.69.0:6800/178 17 : cluster [WRN] map e133 wrongly marked me down at e133
- 2017-07-11 13:29:51.131334 I | rook-ceph-mon2: 2017-07-11 13:29:51.131297 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:29:51.131517 I | rook-ceph-mon2: 2017-07-11 13:29:51.131438 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4265606978' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:29:52.830595 I | rook-ceph-mon2: 2017-07-11 13:29:51.757576 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 343 : cluster [INF] osdmap e135: 6 total, 1 up, 6 in
- 2017-07-11 13:29:57.814799 I | rook-ceph-mon2: 2017-07-11 13:29:57.814613 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4806 MB, avail 94380 MB
- 2017-07-11 13:30:01.977971 I | rook-ceph-mon2: 2017-07-11 13:30:01.977831 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:30:01.978072 I | rook-ceph-mon2: 2017-07-11 13:30:01.977853 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1129359255' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:30:05.547977 I | rook-ceph-mon2: 2017-07-11 13:30:05.281807 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 344 : cluster [INF] HEALTH_WARN; clock skew detected on mon.rook-ceph-mon2; 5 hosts (5 osds) down; 5 osds down; 1696 pgs stale; too many PGs per OSD (341 > max 300); Monitor clock skew detected
- 2017-07-11 13:30:14.513088 I | rook-ceph-mon2: 2017-07-11 13:30:14.513054 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 13:30:14.513190 I | rook-ceph-mon2: 2017-07-11 13:30:14.513175 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1330269528' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 13:30:23.572371 I | rook-ceph-mon2: 2017-07-11 13:30:23.572329 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:30:23.572606 I | rook-ceph-mon2: 2017-07-11 13:30:23.572572 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1173394670' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:30:48.081178 I | rook-ceph-mon2: 2017-07-11 13:30:48.081145 7f0c84e17700 0 log_channel(cluster) log [WRN] : message from mon.0 was stamped 0.051486s in the future, clocks not synchronized
- 2017-07-11 13:30:49.324839 I | rook-ceph-mon2: 2017-07-11 13:30:48.081252 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 32 : cluster [WRN] message from mon.0 was stamped 0.051486s in the future, clocks not synchronized
- 2017-07-11 13:30:55.824110 I | rook-ceph-mon2: 2017-07-11 13:30:55.824073 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 13:30:55.824407 I | rook-ceph-mon2: 2017-07-11 13:30:55.824390 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3637363263' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 13:30:57.815077 I | rook-ceph-mon2: 2017-07-11 13:30:57.814820 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4806 MB, avail 94380 MB
- 2017-07-11 13:30:59.474120 I | rook-ceph-mon2: 2017-07-11 13:30:59.474069 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 13:30:59.474291 I | rook-ceph-mon2: 2017-07-11 13:30:59.474214 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2867138252' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 13:31:05.468040 I | rook-ceph-mon2: 2017-07-11 13:31:05.281997 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 346 : cluster [INF] HEALTH_WARN; 5 hosts (5 osds) down; 5 osds down; 1696 pgs stale; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:31:06.742445 I | rook-ceph-mon2: 2017-07-11 13:31:06.742406 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:31:06.742650 I | rook-ceph-mon2: 2017-07-11 13:31:06.742633 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3492883498' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:31:50.639602 I | rook-ceph-mon2: 2017-07-11 13:31:50.639548 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:31:50.639697 I | rook-ceph-mon2: 2017-07-11 13:31:50.639667 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4210124345' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:31:57.815297 I | rook-ceph-mon2: 2017-07-11 13:31:57.815030 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4806 MB, avail 94380 MB
- 2017-07-11 13:32:12.324651 I | rook-ceph-mon2: 2017-07-11 13:32:12.324605 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:32:12.324839 I | rook-ceph-mon2: 2017-07-11 13:32:12.324753 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1272493395' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:32:44.718966 I | rook-ceph-mon2: 2017-07-11 13:32:44.718928 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:32:44.724833 I | rook-ceph-mon2: 2017-07-11 13:32:44.719076 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3569960061' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:32:56.912946 I | rook-ceph-mon2: 2017-07-11 13:32:56.912904 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #9. Immutable memtables: 0.
- 2017-07-11 13:32:56.913042 I | rook-ceph-mon2:
- 2017-07-11 13:32:56.913721 I | rook-ceph-mon2: 2017-07-11 13:32:56.913698 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 3] Syncing log #6
- 2017-07-11 13:32:56.943086 I | rook-ceph-mon2: 2017-07-11 13:32:56.943047 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:32:56.913247) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:32:56.943169 I | rook-ceph-mon2: 2017-07-11 13:32:56.943152 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 3] Flushing memtable with next log file: 9
- 2017-07-11 13:32:56.943189 I | rook-ceph-mon2:
- 2017-07-11 13:32:56.943286 I | rook-ceph-mon2: 2017-07-11 13:32:56.943271 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779976943266, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 5186, "num_deletes": 258, "memory_usage": 24623912}
- 2017-07-11 13:32:56.943316 I | rook-ceph-mon2: 2017-07-11 13:32:56.943304 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 3] Level-0 flush table #10: started
- 2017-07-11 13:32:57.341086 I | rook-ceph-mon2: 2017-07-11 13:32:57.340999 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977340990, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 10, "file_size": 13526003, "table_properties": {"data_size": 13496311, "index_size": 28872, "filter_size": 0, "raw_key_size": 28624, "raw_average_key_size": 18, "raw_value_size": 13454665, "raw_average_value_size": 8548, "num_data_blocks": 922, "num_entries": 1574, "filter_policy_name": "", "kDeletedKeys": "258", "kMergeOperands": "0"}}
- 2017-07-11 13:32:57.341417 I | rook-ceph-mon2: 2017-07-11 13:32:57.341235 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 3] Level-0 flush table #10: 13526003 bytes OK
- 2017-07-11 13:32:57.426292 I | rook-ceph-mon2: 2017-07-11 13:32:57.426234 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.371442) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #10 started
- 2017-07-11 13:32:57.426415 I | rook-ceph-mon2: 2017-07-11 13:32:57.426399 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.426164) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #10: memtable #1 done
- 2017-07-11 13:32:57.426468 I | rook-ceph-mon2: 2017-07-11 13:32:57.426451 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.426189) EVENT_LOG_v1 {"time_micros": 1499779977426180, "job": 3, "event": "flush_finished", "lsm_state": [2, 0, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:32:57.426557 I | rook-ceph-mon2: 2017-07-11 13:32:57.426497 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.426213) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[2 0 0 0 0 0 0] max score 0.50
- 2017-07-11 13:32:57.426598 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.426647 I | rook-ceph-mon2: 2017-07-11 13:32:57.426633 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 3] Try to delete WAL files size 24423999, prev total WAL file size 24436763, number of live WAL files 2.
- 2017-07-11 13:32:57.426661 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.430296 I | rook-ceph-mon2: 2017-07-11 13:32:57.430257 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:32:57.431499 I | rook-ceph-mon2: 2017-07-11 13:32:57.431475 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 13:32:57.431569 I | rook-ceph-mon2: 2017-07-11 13:32:57.431540 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 13:32:57.431587 I | rook-ceph-mon2: ** DB Stats **
- 2017-07-11 13:32:57.431617 I | rook-ceph-mon2: Uptime(secs): 540.2 total, 540.2 interval
- 2017-07-11 13:32:57.431632 I | rook-ceph-mon2: Cumulative writes: 1270 writes, 5193 keys, 1270 commit groups, 1.0 writes per commit group, ingest: 0.02 GB, 0.04 MB/s
- 2017-07-11 13:32:57.431644 I | rook-ceph-mon2: Cumulative WAL: 1269 writes, 1269 syncs, 1.00 writes per sync, written: 0.02 GB, 0.04 MB/s
- 2017-07-11 13:32:57.431655 I | rook-ceph-mon2: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:32:57.431666 I | rook-ceph-mon2: Interval writes: 1270 writes, 5193 keys, 1270 commit groups, 1.0 writes per commit group, ingest: 23.30 MB, 0.04 MB/s
- 2017-07-11 13:32:57.431705 I | rook-ceph-mon2: Interval WAL: 1269 writes, 1269 syncs, 1.00 writes per sync, written: 0.02 MB, 0.04 MB/s
- 2017-07-11 13:32:57.431718 I | rook-ceph-mon2: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:32:57.431728 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.431739 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 13:32:57.431749 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:32:57.431771 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:32:57.431792 I | rook-ceph-mon2: L0 2/2 12.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 26.9 0 2 0.239 0 0
- 2017-07-11 13:32:57.431803 I | rook-ceph-mon2: Sum 2/2 12.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 26.9 0 2 0.239 0 0
- 2017-07-11 13:32:57.431813 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 26.9 0 2 0.239 0 0
- 2017-07-11 13:32:57.431823 I | rook-ceph-mon2: Uptime(secs): 540.2 total, 540.2 interval
- 2017-07-11 13:32:57.431833 I | rook-ceph-mon2: Flush(GB): cumulative 0.013, interval 0.013
- 2017-07-11 13:32:57.431855 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:32:57.431877 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:32:57.431901 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:32:57.431923 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:32:57.431947 I | rook-ceph-mon2: Cumulative compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.5 seconds
- 2017-07-11 13:32:57.431958 I | rook-ceph-mon2: Interval compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.5 seconds
- 2017-07-11 13:32:57.431969 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:32:57.431981 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.432005 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:32:57.432018 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.432029 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 13:32:57.432040 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:32:57.432051 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:32:57.432064 I | rook-ceph-mon2: L0 2/2 12.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 26.9 0 2 0.239 0 0
- 2017-07-11 13:32:57.432089 I | rook-ceph-mon2: Sum 2/2 12.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 26.9 0 2 0.239 0 0
- 2017-07-11 13:32:57.432101 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 13:32:57.432112 I | rook-ceph-mon2: Uptime(secs): 540.2 total, 540.2 interval
- 2017-07-11 13:32:57.432123 I | rook-ceph-mon2: Flush(GB): cumulative 0.013, interval 0.000
- 2017-07-11 13:32:57.432135 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:32:57.432158 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:32:57.432181 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:32:57.432191 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:32:57.432201 I | rook-ceph-mon2: Cumulative compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.5 seconds
- 2017-07-11 13:32:57.432234 I | rook-ceph-mon2: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 13:32:57.432247 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:32:57.432257 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.432267 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:32:57.432277 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.432341 I | rook-ceph-mon2: 2017-07-11 13:32:57.432314 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.432294) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:32:57.432400 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.432432 I | rook-ceph-mon2: 2017-07-11 13:32:57.432418 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 4] Compacting 2@0 files to L1, score -1.00
- 2017-07-11 13:32:57.432475 I | rook-ceph-mon2: 2017-07-11 13:32:57.432449 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 3 Base level 0, inputs: [10(12MB) 4(1764B)]
- 2017-07-11 13:32:57.432500 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.432550 I | rook-ceph-mon2: 2017-07-11 13:32:57.432523 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977432514, "job": 4, "event": "compaction_started", "files_L0": [10, 4], "score": -1, "input_data_size": 13527767}
- 2017-07-11 13:32:57.559825 I | rook-ceph-mon2: 2017-07-11 13:32:57.559777 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 4] Generated table #11: 1319 keys, 13523178 bytes
- 2017-07-11 13:32:57.560044 I | rook-ceph-mon2: 2017-07-11 13:32:57.559935 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977559926, "cf_name": "default", "job": 4, "event": "table_file_creation", "file_number": 11, "file_size": 13523178, "table_properties": {"data_size": 13493496, "index_size": 28863, "filter_size": 0, "raw_key_size": 23832, "raw_average_key_size": 18, "raw_value_size": 13455191, "raw_average_value_size": 10201, "num_data_blocks": 922, "num_entries": 1319, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:32:57.609445 I | rook-ceph-mon2: 2017-07-11 13:32:57.606812 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 4] Compacted 2@0 files to L1 => 13523178 bytes
- 2017-07-11 13:32:57.642638 I | rook-ceph-mon2: 2017-07-11 13:32:57.642593 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.642507) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 77.6 rd, 77.6 wr, level 1, files in(2, 0) out(1) MB in(12.9, 0.0) out(12.9), read-write-amplify(2.0) write-amplify(1.0) OK, records in: 1579, records dropped: 260
- 2017-07-11 13:32:57.642768 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.642825 I | rook-ceph-mon2: 2017-07-11 13:32:57.642788 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.642545) EVENT_LOG_v1 {"time_micros": 1499779977642535, "job": 4, "event": "compaction_finished", "compaction_time_micros": 174232, "output_level": 1, "num_output_files": 1, "total_output_size": 13523178, "num_input_records": 1579, "num_output_records": 1319, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:32:57.650211 I | rook-ceph-mon2: 2017-07-11 13:32:57.650190 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977650187, "job": 4, "event": "table_file_deletion", "file_number": 10}
- 2017-07-11 13:32:57.650381 I | rook-ceph-mon2: 2017-07-11 13:32:57.650367 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977650365, "job": 4, "event": "table_file_deletion", "file_number": 4}
- 2017-07-11 13:32:57.650746 I | rook-ceph-mon2: 2017-07-11 13:32:57.650645 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #12. Immutable memtables: 0.
- 2017-07-11 13:32:57.650794 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.650811 I | rook-ceph-mon2: 2017-07-11 13:32:57.650676 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 5] Syncing log #9
- 2017-07-11 13:32:57.690120 I | rook-ceph-mon2: 2017-07-11 13:32:57.689870 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.650670) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:32:57.690166 I | rook-ceph-mon2: 2017-07-11 13:32:57.689879 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 5] Flushing memtable with next log file: 12
- 2017-07-11 13:32:57.690182 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.690195 I | rook-ceph-mon2: 2017-07-11 13:32:57.689888 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977689884, "job": 5, "event": "flush_started", "num_memtables": 1, "num_entries": 7, "num_deletes": 0, "memory_usage": 15032}
- 2017-07-11 13:32:57.690206 I | rook-ceph-mon2: 2017-07-11 13:32:57.689890 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 5] Level-0 flush table #13: started
- 2017-07-11 13:32:57.718803 I | rook-ceph-mon2: 2017-07-11 13:32:57.718739 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977718730, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 13, "file_size": 9452, "table_properties": {"data_size": 8563, "index_size": 81, "filter_size": 0, "raw_key_size": 141, "raw_average_key_size": 23, "raw_value_size": 8383, "raw_average_value_size": 1397, "num_data_blocks": 3, "num_entries": 6, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:32:57.718863 I | rook-ceph-mon2: 2017-07-11 13:32:57.718748 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 5] Level-0 flush table #13: 9452 bytes OK
- 2017-07-11 13:32:57.782730 I | rook-ceph-mon2: 2017-07-11 13:32:57.782563 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.751316) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #13 started
- 2017-07-11 13:32:57.782787 I | rook-ceph-mon2: 2017-07-11 13:32:57.782569 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.782530) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #13: memtable #1 done
- 2017-07-11 13:32:57.782802 I | rook-ceph-mon2: 2017-07-11 13:32:57.782571 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.782542) EVENT_LOG_v1 {"time_micros": 1499779977782538, "job": 5, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:32:57.782954 I | rook-ceph-mon2: 2017-07-11 13:32:57.782572 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.782553) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:32:57.782977 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.783005 I | rook-ceph-mon2: 2017-07-11 13:32:57.782577 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 5] Try to delete WAL files size 12764, prev total WAL file size 12764, number of live WAL files 2.
- 2017-07-11 13:32:57.783019 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.783031 I | rook-ceph-mon2: 2017-07-11 13:32:57.782862 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:32:57.783090 I | rook-ceph-mon2: 2017-07-11 13:32:57.783057 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:32:57.783051) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:32:57.783107 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.783138 I | rook-ceph-mon2: 2017-07-11 13:32:57.783123 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 6] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:32:57.783204 I | rook-ceph-mon2: 2017-07-11 13:32:57.783180 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 5 Base level 0, inputs: [13(9452B)], [11(12MB)]
- 2017-07-11 13:32:57.783239 I | rook-ceph-mon2:
- 2017-07-11 13:32:57.783273 I | rook-ceph-mon2: 2017-07-11 13:32:57.783262 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779977783254, "job": 6, "event": "compaction_started", "files_L0": [13], "files_L1": [11], "score": -1, "input_data_size": 13532630}
- 2017-07-11 13:32:57.821954 I | rook-ceph-mon2: 2017-07-11 13:32:57.821670 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4855 MB, avail 94332 MB
- 2017-07-11 13:32:58.106622 I | rook-ceph-mon2: 2017-07-11 13:32:58.106571 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 6] Generated table #14: 1321 keys, 13531661 bytes
- 2017-07-11 13:32:58.106757 I | rook-ceph-mon2: 2017-07-11 13:32:58.106738 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779978106727, "cf_name": "default", "job": 6, "event": "table_file_creation", "file_number": 14, "file_size": 13531661, "table_properties": {"data_size": 13501917, "index_size": 28925, "filter_size": 0, "raw_key_size": 23868, "raw_average_key_size": 18, "raw_value_size": 13463542, "raw_average_value_size": 10191, "num_data_blocks": 924, "num_entries": 1321, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:32:58.198970 I | rook-ceph-mon2: 2017-07-11 13:32:58.198927 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 6] Compacted 1@0 + 1@1 files to L1 => 13531661 bytes
- 2017-07-11 13:32:58.233390 I | rook-ceph-mon2: 2017-07-11 13:32:58.233363 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:32:58.233300) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 32.6 rd, 32.6 wr, level 1, files in(1, 1) out(1) MB in(0.0, 12.9) out(12.9), read-write-amplify(2863.3) write-amplify(1431.6) OK, records in: 1325, records dropped: 4
- 2017-07-11 13:32:58.233435 I | rook-ceph-mon2:
- 2017-07-11 13:32:58.233467 I | rook-ceph-mon2: 2017-07-11 13:32:58.233452 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:32:58.233322) EVENT_LOG_v1 {"time_micros": 1499779978233313, "job": 6, "event": "compaction_finished", "compaction_time_micros": 415620, "output_level": 1, "num_output_files": 1, "total_output_size": 13531661, "num_input_records": 1325, "num_output_records": 1321, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:32:58.233666 I | rook-ceph-mon2: 2017-07-11 13:32:58.233637 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779978233633, "job": 6, "event": "table_file_deletion", "file_number": 13}
- 2017-07-11 13:32:58.235274 I | rook-ceph-mon2: 2017-07-11 13:32:58.235260 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779978235257, "job": 6, "event": "table_file_deletion", "file_number": 11}
- 2017-07-11 13:33:38.831937 I | rook-ceph-mon2: 2017-07-11 13:33:38.831896 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:33:38.832133 I | rook-ceph-mon2: 2017-07-11 13:33:38.832047 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3862579595' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:33:49.677545 I | rook-ceph-mon2: 2017-07-11 13:33:49.677505 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:33:49.677631 I | rook-ceph-mon2: 2017-07-11 13:33:49.677615 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/385074955' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:33:57.822184 I | rook-ceph-mon2: 2017-07-11 13:33:57.821889 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4819 MB, avail 94367 MB
- 2017-07-11 13:34:00.621239 I | rook-ceph-mon2: 2017-07-11 13:34:00.621197 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:34:00.621494 I | rook-ceph-mon2: 2017-07-11 13:34:00.621476 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1033484770' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:34:11.520150 I | rook-ceph-mon2: 2017-07-11 13:34:11.520111 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:34:11.520329 I | rook-ceph-mon2: 2017-07-11 13:34:11.520247 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/59074765' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:34:57.822535 I | rook-ceph-mon2: 2017-07-11 13:34:57.822115 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4820 MB, avail 94367 MB
- 2017-07-11 13:35:06.270610 I | rook-ceph-mon2: 2017-07-11 13:35:05.283265 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 358 : cluster [INF] HEALTH_ERR; 5 hosts (5 osds) down; 5 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (341 > max 300)
- 2017-07-11 13:35:16.578109 I | rook-ceph-mon2: 2017-07-11 13:35:16.578070 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:35:16.578355 I | rook-ceph-mon2: 2017-07-11 13:35:16.578336 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1111001874' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:35:38.138656 I | rook-ceph-mon2: 2017-07-11 13:35:38.138621 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:35:38.138744 I | rook-ceph-mon2: 2017-07-11 13:35:38.138729 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/824575376' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:35:48.970260 I | rook-ceph-mon2: 2017-07-11 13:35:48.970189 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:35:48.970488 I | rook-ceph-mon2: 2017-07-11 13:35:48.970457 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4148906279' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:35:57.822831 I | rook-ceph-mon2: 2017-07-11 13:35:57.822531 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4820 MB, avail 94367 MB
- 2017-07-11 13:36:06.352046 I | rook-ceph-mon2: 2017-07-11 13:36:05.365801 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 361 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0732848s > max 0.05s
- 2017-07-11 13:36:57.823333 I | rook-ceph-mon2: 2017-07-11 13:36:57.823021 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4820 MB, avail 94367 MB
- 2017-07-11 13:37:06.668907 I | rook-ceph-mon2: 2017-07-11 13:37:05.429926 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 368 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0727043s > max 0.05s
- 2017-07-11 13:37:15.985705 I | rook-ceph-mon2: 2017-07-11 13:37:15.985661 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:37:15.985912 I | rook-ceph-mon2: 2017-07-11 13:37:15.985801 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1048322190' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:37:35.718548 I | rook-ceph-mon2: 2017-07-11 13:37:35.457039 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 369 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0729757s > max 0.05s
- 2017-07-11 13:37:57.824439 I | rook-ceph-mon2: 2017-07-11 13:37:57.823931 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4820 MB, avail 94367 MB
- 2017-07-11 13:37:59.767862 I | rook-ceph-mon2: 2017-07-11 13:37:59.767762 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #15. Immutable memtables: 0.
- 2017-07-11 13:37:59.767936 I | rook-ceph-mon2:
- 2017-07-11 13:37:59.767954 I | rook-ceph-mon2: 2017-07-11 13:37:59.767809 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 7] Syncing log #12
- 2017-07-11 13:37:59.796299 I | rook-ceph-mon2: 2017-07-11 13:37:59.795173 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:37:59.767803) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:37:59.796364 I | rook-ceph-mon2: 2017-07-11 13:37:59.795190 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 7] Flushing memtable with next log file: 15
- 2017-07-11 13:37:59.796381 I | rook-ceph-mon2:
- 2017-07-11 13:37:59.796393 I | rook-ceph-mon2: 2017-07-11 13:37:59.795207 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780279795199, "job": 7, "event": "flush_started", "num_memtables": 1, "num_entries": 1586, "num_deletes": 251, "memory_usage": 3764368}
- 2017-07-11 13:37:59.796404 I | rook-ceph-mon2: 2017-07-11 13:37:59.795211 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 7] Level-0 flush table #16: started
- 2017-07-11 13:37:59.940014 I | rook-ceph-mon2: 2017-07-11 13:37:59.939974 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780279939964, "cf_name": "default", "job": 7, "event": "table_file_creation", "file_number": 16, "file_size": 2482014, "table_properties": {"data_size": 2470167, "index_size": 11029, "filter_size": 0, "raw_key_size": 11435, "raw_average_key_size": 17, "raw_value_size": 2453634, "raw_average_value_size": 3763, "num_data_blocks": 365, "num_entries": 652, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:37:59.940103 I | rook-ceph-mon2: 2017-07-11 13:37:59.940087 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 7] Level-0 flush table #16: 2482014 bytes OK
- 2017-07-11 13:38:00.003005 I | rook-ceph-mon2: 2017-07-11 13:38:00.002973 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:37:59.974751) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #16 started
- 2017-07-11 13:38:00.003099 I | rook-ceph-mon2: 2017-07-11 13:38:00.003069 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.002920) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #16: memtable #1 done
- 2017-07-11 13:38:00.003177 I | rook-ceph-mon2: 2017-07-11 13:38:00.003162 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.002935) EVENT_LOG_v1 {"time_micros": 1499780280002930, "job": 7, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:38:00.003222 I | rook-ceph-mon2: 2017-07-11 13:38:00.003194 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.002950) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:38:00.003238 I | rook-ceph-mon2:
- 2017-07-11 13:38:00.003270 I | rook-ceph-mon2: 2017-07-11 13:38:00.003256 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 7] Try to delete WAL files size 3732405, prev total WAL file size 3732405, number of live WAL files 2.
- 2017-07-11 13:38:00.003283 I | rook-ceph-mon2:
- 2017-07-11 13:38:00.004190 I | rook-ceph-mon2: 2017-07-11 13:38:00.003965 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:38:00.004249 I | rook-ceph-mon2: 2017-07-11 13:38:00.004002 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.003997) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 13:38:00.004268 I | rook-ceph-mon2:
- 2017-07-11 13:38:00.004294 I | rook-ceph-mon2: 2017-07-11 13:38:00.004007 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 8] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:38:00.004353 I | rook-ceph-mon2: 2017-07-11 13:38:00.004011 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 7 Base level 0, inputs: [16(2423KB)], [14(12MB)]
- 2017-07-11 13:38:00.004377 I | rook-ceph-mon2:
- 2017-07-11 13:38:00.004390 I | rook-ceph-mon2: 2017-07-11 13:38:00.004021 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780280004014, "job": 8, "event": "compaction_started", "files_L0": [16], "files_L1": [14], "score": -1, "input_data_size": 16013675}
- 2017-07-11 13:38:00.118375 I | rook-ceph-mon2: 2017-07-11 13:38:00.118324 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 8] Generated table #17: 1464 keys, 11099602 bytes
- 2017-07-11 13:38:00.118554 I | rook-ceph-mon2: 2017-07-11 13:38:00.118474 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780280118465, "cf_name": "default", "job": 8, "event": "table_file_creation", "file_number": 17, "file_size": 11099602, "table_properties": {"data_size": 11065505, "index_size": 33278, "filter_size": 0, "raw_key_size": 26800, "raw_average_key_size": 18, "raw_value_size": 11022042, "raw_average_value_size": 7528, "num_data_blocks": 1059, "num_entries": 1464, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:38:00.179376 I | rook-ceph-mon2: 2017-07-11 13:38:00.179344 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 8] Compacted 1@0 + 1@1 files to L1 => 11099602 bytes
- 2017-07-11 13:38:00.208380 I | rook-ceph-mon2: 2017-07-11 13:38:00.208334 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.208254) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 91.4 rd, 63.3 wr, level 1, files in(1, 1) out(1) MB in(2.4, 12.9) out(10.6), read-write-amplify(10.9) write-amplify(4.5) OK, records in: 1973, records dropped: 509
- 2017-07-11 13:38:00.208479 I | rook-ceph-mon2:
- 2017-07-11 13:38:00.208515 I | rook-ceph-mon2: 2017-07-11 13:38:00.208498 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:38:00.208281) EVENT_LOG_v1 {"time_micros": 1499780280208270, "job": 8, "event": "compaction_finished", "compaction_time_micros": 175296, "output_level": 1, "num_output_files": 1, "total_output_size": 11099602, "num_input_records": 1973, "num_output_records": 1464, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:38:00.209090 I | rook-ceph-mon2: 2017-07-11 13:38:00.209074 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780280209070, "job": 8, "event": "table_file_deletion", "file_number": 16}
- 2017-07-11 13:38:00.211186 I | rook-ceph-mon2: 2017-07-11 13:38:00.211167 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780280211165, "job": 8, "event": "table_file_deletion", "file_number": 14}
- 2017-07-11 13:38:05.400222 I | rook-ceph-mon2: 2017-07-11 13:38:05.284151 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 373 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon2; 5 hosts (5 osds) down; 5 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (341 > max 300); Monitor clock skew detected
- 2017-07-11 13:38:10.149305 I | rook-ceph-mon2: 2017-07-11 13:38:10.149268 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:38:10.149509 I | rook-ceph-mon2: 2017-07-11 13:38:10.149415 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1629603778' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:38:21.034683 I | rook-ceph-mon2: 2017-07-11 13:38:21.034628 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:38:21.034887 I | rook-ceph-mon2: 2017-07-11 13:38:21.034812 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3527890553' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:38:32.103047 I | rook-ceph-mon2: 2017-07-11 13:38:32.103011 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:38:32.103189 I | rook-ceph-mon2: 2017-07-11 13:38:32.103174 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1844756602' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:38:35.574579 I | rook-ceph-mon2: 2017-07-11 13:38:35.465413 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 374 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0726208s > max 0.05s
- 2017-07-11 13:38:43.253112 I | rook-ceph-mon2: 2017-07-11 13:38:42.094921 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 375 : cluster [WRN] message from mon.1 was stamped 0.050966s in the future, clocks not synchronized
- 2017-07-11 13:38:49.238698 I | rook-ceph-mon2: 2017-07-11 13:38:48.471605 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 377 : cluster [WRN] message from mon.1 was stamped 0.052154s in the future, clocks not synchronized
- 2017-07-11 13:38:53.887527 I | rook-ceph-mon2: 2017-07-11 13:38:53.887487 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:38:53.887772 I | rook-ceph-mon2: 2017-07-11 13:38:53.887756 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2723265332' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:38:57.824749 I | rook-ceph-mon2: 2017-07-11 13:38:57.824396 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:39:19.527486 I | rook-ceph-mon2: 2017-07-11 13:39:18.303060 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 379 : cluster [WRN] message from mon.1 was stamped 0.054269s in the future, clocks not synchronized
- 2017-07-11 13:39:26.330874 I | rook-ceph-mon2: 2017-07-11 13:39:26.330839 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:39:26.331048 I | rook-ceph-mon2: 2017-07-11 13:39:26.330971 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2426004894' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:39:37.869102 I | rook-ceph-mon2: 2017-07-11 13:39:36.776470 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 380 : cluster [INF] osd.5 out (down for 600.225244)
- 2017-07-11 13:39:37.869121 I | rook-ceph-mon2: 2017-07-11 13:39:36.927602 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 381 : cluster [INF] osdmap e136: 6 total, 1 up, 5 in
- 2017-07-11 13:39:47.626474 I | rook-ceph-mon2: 2017-07-11 13:39:46.849512 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 382 : cluster [INF] osd.0 out (down for 605.155937)
- 2017-07-11 13:39:47.626545 I | rook-ceph-mon2: 2017-07-11 13:39:46.944482 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 383 : cluster [INF] osdmap e137: 6 total, 1 up, 4 in
- 2017-07-11 13:39:57.825044 I | rook-ceph-mon2: 2017-07-11 13:39:57.824736 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:40:05.691170 I | rook-ceph-mon2: 2017-07-11 13:40:05.284971 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 386 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 13:40:05.691272 I | rook-ceph-mon2: 2017-07-11 13:40:05.472329 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 387 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0644023s > max 0.05s
- 2017-07-11 13:40:09.886924 I | rook-ceph-mon2: 2017-07-11 13:40:09.886884 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:40:09.887174 I | rook-ceph-mon2: 2017-07-11 13:40:09.887052 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3059500173' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:40:53.571378 I | rook-ceph-mon2: 2017-07-11 13:40:53.571330 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:40:53.571578 I | rook-ceph-mon2: 2017-07-11 13:40:53.571487 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/694488495' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:40:57.825578 I | rook-ceph-mon2: 2017-07-11 13:40:57.825180 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:41:22.108245 I | rook-ceph-mon2: 2017-07-11 13:41:22.108167 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #18. Immutable memtables: 0.
- 2017-07-11 13:41:22.108321 I | rook-ceph-mon2:
- 2017-07-11 13:41:22.108341 I | rook-ceph-mon2: 2017-07-11 13:41:22.108203 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 9] Syncing log #15
- 2017-07-11 13:41:22.138745 I | rook-ceph-mon2: 2017-07-11 13:41:22.137704 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.108198) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:41:22.138787 I | rook-ceph-mon2: 2017-07-11 13:41:22.137713 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 9] Flushing memtable with next log file: 18
- 2017-07-11 13:41:22.138802 I | rook-ceph-mon2:
- 2017-07-11 13:41:22.138813 I | rook-ceph-mon2: 2017-07-11 13:41:22.137721 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482137717, "job": 9, "event": "flush_started", "num_memtables": 1, "num_entries": 1201, "num_deletes": 252, "memory_usage": 2890512}
- 2017-07-11 13:41:22.138824 I | rook-ceph-mon2: 2017-07-11 13:41:22.137724 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 9] Level-0 flush table #19: started
- 2017-07-11 13:41:22.249581 I | rook-ceph-mon2: 2017-07-11 13:41:22.249530 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482249519, "cf_name": "default", "job": 9, "event": "table_file_creation", "file_number": 19, "file_size": 1285232, "table_properties": {"data_size": 1279694, "index_size": 4723, "filter_size": 0, "raw_key_size": 8322, "raw_average_key_size": 18, "raw_value_size": 1270283, "raw_average_value_size": 2835, "num_data_blocks": 160, "num_entries": 448, "filter_policy_name": "", "kDeletedKeys": "252", "kMergeOperands": "0"}}
- 2017-07-11 13:41:22.249640 I | rook-ceph-mon2: 2017-07-11 13:41:22.249624 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 9] Level-0 flush table #19: 1285232 bytes OK
- 2017-07-11 13:41:22.328939 I | rook-ceph-mon2: 2017-07-11 13:41:22.328894 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.281244) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #19 started
- 2017-07-11 13:41:22.329043 I | rook-ceph-mon2: 2017-07-11 13:41:22.329027 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.328839) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #19: memtable #1 done
- 2017-07-11 13:41:22.329164 I | rook-ceph-mon2: 2017-07-11 13:41:22.329121 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.328862) EVENT_LOG_v1 {"time_micros": 1499780482328856, "job": 9, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:41:22.329201 I | rook-ceph-mon2: 2017-07-11 13:41:22.329185 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.328880) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:41:22.329215 I | rook-ceph-mon2:
- 2017-07-11 13:41:22.329266 I | rook-ceph-mon2: 2017-07-11 13:41:22.329252 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 9] Try to delete WAL files size 2865962, prev total WAL file size 2865962, number of live WAL files 2.
- 2017-07-11 13:41:22.329282 I | rook-ceph-mon2:
- 2017-07-11 13:41:22.330174 I | rook-ceph-mon2: 2017-07-11 13:41:22.329882 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:41:22.330213 I | rook-ceph-mon2: 2017-07-11 13:41:22.329917 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.329912) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:41:22.330230 I | rook-ceph-mon2:
- 2017-07-11 13:41:22.330243 I | rook-ceph-mon2: 2017-07-11 13:41:22.329922 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 10] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:41:22.330254 I | rook-ceph-mon2: 2017-07-11 13:41:22.329927 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 9 Base level 0, inputs: [19(1255KB)], [17(10MB)]
- 2017-07-11 13:41:22.330281 I | rook-ceph-mon2:
- 2017-07-11 13:41:22.330294 I | rook-ceph-mon2: 2017-07-11 13:41:22.329937 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482329929, "job": 10, "event": "compaction_started", "files_L0": [19], "files_L1": [17], "score": -1, "input_data_size": 12384834}
- 2017-07-11 13:41:22.439419 I | rook-ceph-mon2: 2017-07-11 13:41:22.439369 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 10] Generated table #20: 1493 keys, 11476995 bytes
- 2017-07-11 13:41:22.439675 I | rook-ceph-mon2: 2017-07-11 13:41:22.439591 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482439580, "cf_name": "default", "job": 10, "event": "table_file_creation", "file_number": 20, "file_size": 11476995, "table_properties": {"data_size": 11443038, "index_size": 33138, "filter_size": 0, "raw_key_size": 27077, "raw_average_key_size": 18, "raw_value_size": 11399357, "raw_average_value_size": 7635, "num_data_blocks": 1061, "num_entries": 1493, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:41:22.500303 I | rook-ceph-mon2: 2017-07-11 13:41:22.500270 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 10] Compacted 1@0 + 1@1 files to L1 => 11476995 bytes
- 2017-07-11 13:41:22.545413 I | rook-ceph-mon2: 2017-07-11 13:41:22.545348 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.545244) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 72.7 rd, 67.4 wr, level 1, files in(1, 1) out(1) MB in(1.2, 10.6) out(10.9), read-write-amplify(18.6) write-amplify(8.9) OK, records in: 1912, records dropped: 419
- 2017-07-11 13:41:22.545510 I | rook-ceph-mon2:
- 2017-07-11 13:41:22.545586 I | rook-ceph-mon2: 2017-07-11 13:41:22.545569 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:41:22.545281) EVENT_LOG_v1 {"time_micros": 1499780482545266, "job": 10, "event": "compaction_finished", "compaction_time_micros": 170318, "output_level": 1, "num_output_files": 1, "total_output_size": 11476995, "num_input_records": 1912, "num_output_records": 1493, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:41:22.546012 I | rook-ceph-mon2: 2017-07-11 13:41:22.545996 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482545993, "job": 10, "event": "table_file_deletion", "file_number": 19}
- 2017-07-11 13:41:22.547554 I | rook-ceph-mon2: 2017-07-11 13:41:22.547540 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780482547538, "job": 10, "event": "table_file_deletion", "file_number": 17}
- 2017-07-11 13:41:22.547618 I | rook-ceph-mon2: 2017-07-11 13:41:22.547603 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:41:24.899969 I | rook-ceph-mon2: 2017-07-11 13:41:23.375125 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 393 : cluster [WRN] message from mon.1 was stamped 0.059033s in the future, clocks not synchronized
- 2017-07-11 13:41:29.150031 I | rook-ceph-mon2: 2017-07-11 13:41:29.149996 7f0c84e17700 0 log_channel(cluster) log [WRN] : message from mon.0 was stamped 0.054591s in the future, clocks not synchronized
- 2017-07-11 13:41:30.401956 I | rook-ceph-mon2: 2017-07-11 13:41:29.150060 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 54 : cluster [WRN] message from mon.0 was stamped 0.054591s in the future, clocks not synchronized
- 2017-07-11 13:41:57.825947 I | rook-ceph-mon2: 2017-07-11 13:41:57.825645 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 13:42:06.489645 I | rook-ceph-mon2: 2017-07-11 13:42:05.479708 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 396 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0654724s > max 0.05s
- 2017-07-11 13:42:09.541969 I | rook-ceph-mon2: 2017-07-11 13:42:09.541935 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:42:09.542161 I | rook-ceph-mon2: 2017-07-11 13:42:09.542073 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2093053967' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:42:20.429155 I | rook-ceph-mon2: 2017-07-11 13:42:20.429120 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:42:20.429347 I | rook-ceph-mon2: 2017-07-11 13:42:20.429255 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2337123231' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:42:57.826201 I | rook-ceph-mon2: 2017-07-11 13:42:57.825906 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 13:43:25.479693 I | rook-ceph-mon2: 2017-07-11 13:43:25.479645 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:43:25.479888 I | rook-ceph-mon2: 2017-07-11 13:43:25.479803 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2564498990' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:43:47.324027 I | rook-ceph-mon2: 2017-07-11 13:43:47.323993 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:43:47.324132 I | rook-ceph-mon2: 2017-07-11 13:43:47.324117 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3119056072' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:43:57.826679 I | rook-ceph-mon2: 2017-07-11 13:43:57.826304 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 13:43:58.163387 I | rook-ceph-mon2: 2017-07-11 13:43:58.163357 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:43:58.163447 I | rook-ceph-mon2: 2017-07-11 13:43:58.163433 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3921831106' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:44:19.971248 I | rook-ceph-mon2: 2017-07-11 13:44:19.971190 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:44:19.971481 I | rook-ceph-mon2: 2017-07-11 13:44:19.971462 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4203922966' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:44:35.640125 I | rook-ceph-mon2: 2017-07-11 13:44:35.488576 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 403 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0657463s > max 0.05s
- 2017-07-11 13:44:42.067110 I | rook-ceph-mon2: 2017-07-11 13:44:42.066993 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #21. Immutable memtables: 0.
- 2017-07-11 13:44:42.067215 I | rook-ceph-mon2:
- 2017-07-11 13:44:42.067235 I | rook-ceph-mon2: 2017-07-11 13:44:42.067037 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 11] Syncing log #18
- 2017-07-11 13:44:42.101878 I | rook-ceph-mon2: 2017-07-11 13:44:42.101299 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.067032) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:44:42.101953 I | rook-ceph-mon2: 2017-07-11 13:44:42.101321 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 11] Flushing memtable with next log file: 21
- 2017-07-11 13:44:42.101969 I | rook-ceph-mon2:
- 2017-07-11 13:44:42.101982 I | rook-ceph-mon2: 2017-07-11 13:44:42.101338 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682101330, "job": 11, "event": "flush_started", "num_memtables": 1, "num_entries": 1157, "num_deletes": 251, "memory_usage": 2771424}
- 2017-07-11 13:44:42.102752 I | rook-ceph-mon2: 2017-07-11 13:44:42.101342 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 11] Level-0 flush table #22: started
- 2017-07-11 13:44:42.164376 I | rook-ceph-mon2: 2017-07-11 13:44:42.164322 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682164303, "cf_name": "default", "job": 11, "event": "table_file_creation", "file_number": 22, "file_size": 1827283, "table_properties": {"data_size": 1819048, "index_size": 7420, "filter_size": 0, "raw_key_size": 9280, "raw_average_key_size": 17, "raw_value_size": 1806683, "raw_average_value_size": 3434, "num_data_blocks": 247, "num_entries": 526, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:44:42.164565 I | rook-ceph-mon2: 2017-07-11 13:44:42.164486 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 11] Level-0 flush table #22: 1827283 bytes OK
- 2017-07-11 13:44:42.227461 I | rook-ceph-mon2: 2017-07-11 13:44:42.227435 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.195555) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #22 started
- 2017-07-11 13:44:42.227536 I | rook-ceph-mon2: 2017-07-11 13:44:42.227520 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.227396) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #22: memtable #1 done
- 2017-07-11 13:44:42.227993 I | rook-ceph-mon2: 2017-07-11 13:44:42.227557 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.227408) EVENT_LOG_v1 {"time_micros": 1499780682227404, "job": 11, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:44:42.228035 I | rook-ceph-mon2: 2017-07-11 13:44:42.228018 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.227423) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:44:42.228074 I | rook-ceph-mon2:
- 2017-07-11 13:44:42.228190 I | rook-ceph-mon2: 2017-07-11 13:44:42.228106 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 11] Try to delete WAL files size 2747535, prev total WAL file size 2747535, number of live WAL files 2.
- 2017-07-11 13:44:42.228219 I | rook-ceph-mon2:
- 2017-07-11 13:44:42.229169 I | rook-ceph-mon2: 2017-07-11 13:44:42.228807 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:44:42.229231 I | rook-ceph-mon2: 2017-07-11 13:44:42.228945 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 13:44:42.229249 I | rook-ceph-mon2: 2017-07-11 13:44:42.228948 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 13:44:42.229262 I | rook-ceph-mon2: ** DB Stats **
- 2017-07-11 13:44:42.229288 I | rook-ceph-mon2: Uptime(secs): 1245.0 total, 704.8 interval
- 2017-07-11 13:44:42.229312 I | rook-ceph-mon2: Cumulative writes: 2138 writes, 9137 keys, 2138 commit groups, 1.0 writes per commit group, ingest: 0.03 GB, 0.03 MB/s
- 2017-07-11 13:44:42.229442 I | rook-ceph-mon2: Cumulative WAL: 2138 writes, 2138 syncs, 1.00 writes per sync, written: 0.03 GB, 0.03 MB/s
- 2017-07-11 13:44:42.229461 I | rook-ceph-mon2: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:44:42.229473 I | rook-ceph-mon2: Interval writes: 868 writes, 3944 keys, 868 commit groups, 1.0 writes per commit group, ingest: 8.91 MB, 0.01 MB/s
- 2017-07-11 13:44:42.229485 I | rook-ceph-mon2: Interval WAL: 869 writes, 869 syncs, 1.00 writes per sync, written: 0.01 MB, 0.01 MB/s
- 2017-07-11 13:44:42.229496 I | rook-ceph-mon2: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:44:42.229520 I | rook-ceph-mon2:
- 2017-07-11 13:44:42.229532 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 13:44:42.229544 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:44:42.229555 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:44:42.229569 I | rook-ceph-mon2: L0 1/1 1.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 19.0 1 6 0.160 0 0
- 2017-07-11 13:44:42.229593 I | rook-ceph-mon2: L1 1/1 10.95 MB 0.0 0.1 0.0 0.0 0.0 0.0 0.0 2.9 56.5 50.6 1 4 0.234 6789 1192
- 2017-07-11 13:44:42.229607 I | rook-ceph-mon2: Sum 2/2 12.69 MB 0.0 0.1 0.0 0.0 0.1 0.0 0.0 3.6 27.9 34.6 2 10 0.189 6789 1192
- 2017-07-11 13:44:42.229619 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.1 0.0 0.0 0.1 0.0 0.0 9.9 37.4 37.2 1 8 0.177 6789 1192
- 2017-07-11 13:44:42.229631 I | rook-ceph-mon2: Uptime(secs): 1245.0 total, 1245.0 interval
- 2017-07-11 13:44:42.229642 I | rook-ceph-mon2: Flush(GB): cumulative 0.018, interval 0.005
- 2017-07-11 13:44:42.229935 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:44:42.229985 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:44:42.230004 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:44:42.230017 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:44:42.230028 I | rook-ceph-mon2: Cumulative compaction: 0.06 GB write, 0.05 MB/s write, 0.05 GB read, 0.04 MB/s read, 1.9 seconds
- 2017-07-11 13:44:42.230039 I | rook-ceph-mon2: Interval compaction: 0.05 GB write, 0.04 MB/s write, 0.05 GB read, 0.04 MB/s read, 1.4 seconds
- 2017-07-11 13:44:42.230209 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:44:42.230239 I | rook-ceph-mon2:
- 2017-07-11 13:44:42.230252 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:44:42.230263 I | rook-ceph-mon2:
- 2017-07-11 13:44:42.230284 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 13:44:42.230324 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:44:42.230337 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:44:42.230349 I | rook-ceph-mon2: L0 1/1 1.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 19.0 1 6 0.160 0 0
- 2017-07-11 13:44:42.230361 I | rook-ceph-mon2: L1 1/1 10.95 MB 0.0 0.1 0.0 0.0 0.0 0.0 0.0 2.9 56.5 50.6 1 4 0.234 6789 1192
- 2017-07-11 13:44:42.230384 I | rook-ceph-mon2: Sum 2/2 12.69 MB 0.0 0.1 0.0 0.0 0.1 0.0 0.0 3.6 27.9 34.6 2 10 0.189 6789 1192
- 2017-07-11 13:44:42.230397 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 13:44:42.230408 I | rook-ceph-mon2: Uptime(secs): 1245.0 total, 1245.0 interval
- 2017-07-11 13:44:42.230465 I | rook-ceph-mon2: Flush(GB): cumulative 0.018, interval 0.000
- 2017-07-11 13:44:42.230480 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:44:42.230491 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:44:42.230502 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:44:42.230513 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:44:42.230541 I | rook-ceph-mon2: Cumulative compaction: 0.06 GB write, 0.05 MB/s write, 0.05 GB read, 0.04 MB/s read, 1.9 seconds
- 2017-07-11 13:44:42.232495 I | rook-ceph-mon2: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 13:44:42.232528 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:44:42.232544 I | rook-ceph-mon2:
- 2017-07-11 13:44:42.232557 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:44:42.232586 I | rook-ceph-mon2:
- 2017-07-11 13:44:42.232597 I | rook-ceph-mon2: 2017-07-11 13:44:42.228965 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.228961) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 13:44:42.232608 I | rook-ceph-mon2:
- 2017-07-11 13:44:42.232621 I | rook-ceph-mon2: 2017-07-11 13:44:42.228970 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 12] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:44:42.232654 I | rook-ceph-mon2: 2017-07-11 13:44:42.228973 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 11 Base level 0, inputs: [22(1784KB)], [20(10MB)]
- 2017-07-11 13:44:42.232668 I | rook-ceph-mon2:
- 2017-07-11 13:44:42.232734 I | rook-ceph-mon2: 2017-07-11 13:44:42.228983 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682228976, "job": 12, "event": "compaction_started", "files_L0": [22], "files_L1": [20], "score": -1, "input_data_size": 13304278}
- 2017-07-11 13:44:42.403226 I | rook-ceph-mon2: 2017-07-11 13:44:42.403174 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 12] Generated table #23: 1510 keys, 10417645 bytes
- 2017-07-11 13:44:42.403292 I | rook-ceph-mon2: 2017-07-11 13:44:42.403274 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682403263, "cf_name": "default", "job": 12, "event": "table_file_creation", "file_number": 23, "file_size": 10417645, "table_properties": {"data_size": 10382408, "index_size": 34418, "filter_size": 0, "raw_key_size": 27638, "raw_average_key_size": 18, "raw_value_size": 10337512, "raw_average_value_size": 6846, "num_data_blocks": 1095, "num_entries": 1510, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:44:42.464379 I | rook-ceph-mon2: 2017-07-11 13:44:42.464349 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 12] Compacted 1@0 + 1@1 files to L1 => 10417645 bytes
- 2017-07-11 13:44:42.541035 I | rook-ceph-mon2: 2017-07-11 13:44:42.541004 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.540945) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 56.5 rd, 44.3 wr, level 1, files in(1, 1) out(1) MB in(1.7, 10.9) out(9.9), read-write-amplify(13.0) write-amplify(5.7) OK, records in: 2019, records dropped: 509
- 2017-07-11 13:44:42.541045 I | rook-ceph-mon2:
- 2017-07-11 13:44:42.541074 I | rook-ceph-mon2: 2017-07-11 13:44:42.541058 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:44:42.540965) EVENT_LOG_v1 {"time_micros": 1499780682540955, "job": 12, "event": "compaction_finished", "compaction_time_micros": 235352, "output_level": 1, "num_output_files": 1, "total_output_size": 10417645, "num_input_records": 2019, "num_output_records": 1510, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:44:42.541415 I | rook-ceph-mon2: 2017-07-11 13:44:42.541400 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682541398, "job": 12, "event": "table_file_deletion", "file_number": 22}
- 2017-07-11 13:44:42.542816 I | rook-ceph-mon2: 2017-07-11 13:44:42.542801 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780682542799, "job": 12, "event": "table_file_deletion", "file_number": 20}
- 2017-07-11 13:44:57.826930 I | rook-ceph-mon2: 2017-07-11 13:44:57.826655 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:45:57.827412 I | rook-ceph-mon2: 2017-07-11 13:45:57.826980 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:45:57.997104 I | rook-ceph-mon2: 2017-07-11 13:45:57.997066 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:45:57.997317 I | rook-ceph-mon2: 2017-07-11 13:45:57.997200 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4006496929' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:46:52.335923 I | rook-ceph-mon2: 2017-07-11 13:46:52.335874 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:46:52.335996 I | rook-ceph-mon2: 2017-07-11 13:46:52.335979 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4052259318' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:46:57.827746 I | rook-ceph-mon2: 2017-07-11 13:46:57.827419 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:47:14.154412 I | rook-ceph-mon2: 2017-07-11 13:47:14.154373 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:47:14.154655 I | rook-ceph-mon2: 2017-07-11 13:47:14.154603 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3121906627' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:47:35.648889 I | rook-ceph-mon2: 2017-07-11 13:47:35.496735 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 413 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0652957s > max 0.05s
- 2017-07-11 13:47:47.036823 I | rook-ceph-mon2: 2017-07-11 13:47:47.036773 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:47:47.037069 I | rook-ceph-mon2: 2017-07-11 13:47:47.037023 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1758911191' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:47:57.828226 I | rook-ceph-mon2: 2017-07-11 13:47:57.827928 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:48:52.253192 I | rook-ceph-mon2: 2017-07-11 13:48:52.253136 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:48:52.253430 I | rook-ceph-mon2: 2017-07-11 13:48:52.253299 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4190247604' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:48:57.828631 I | rook-ceph-mon2: 2017-07-11 13:48:57.828359 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4817 MB, avail 94369 MB
- 2017-07-11 13:49:03.157681 I | rook-ceph-mon2: 2017-07-11 13:49:03.157642 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:49:03.157857 I | rook-ceph-mon2: 2017-07-11 13:49:03.157781 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4021123206' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:49:14.066850 I | rook-ceph-mon2: 2017-07-11 13:49:14.066812 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:49:14.067114 I | rook-ceph-mon2: 2017-07-11 13:49:14.067098 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/81160851' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:49:47.396449 I | rook-ceph-mon2: 2017-07-11 13:49:47.396372 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #24. Immutable memtables: 0.
- 2017-07-11 13:49:47.396600 I | rook-ceph-mon2:
- 2017-07-11 13:49:47.396637 I | rook-ceph-mon2: 2017-07-11 13:49:47.396408 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 13] Syncing log #21
- 2017-07-11 13:49:47.461096 I | rook-ceph-mon2: 2017-07-11 13:49:47.460603 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.396403) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:49:47.461140 I | rook-ceph-mon2: 2017-07-11 13:49:47.460614 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 13] Flushing memtable with next log file: 24
- 2017-07-11 13:49:47.461155 I | rook-ceph-mon2:
- 2017-07-11 13:49:47.461167 I | rook-ceph-mon2: 2017-07-11 13:49:47.460623 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780987460618, "job": 13, "event": "flush_started", "num_memtables": 1, "num_entries": 1574, "num_deletes": 250, "memory_usage": 4047368}
- 2017-07-11 13:49:47.461178 I | rook-ceph-mon2: 2017-07-11 13:49:47.460625 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 13] Level-0 flush table #25: started
- 2017-07-11 13:49:47.750829 I | rook-ceph-mon2: 2017-07-11 13:49:47.750780 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780987750769, "cf_name": "default", "job": 13, "event": "table_file_creation", "file_number": 25, "file_size": 1718604, "table_properties": {"data_size": 1711192, "index_size": 6597, "filter_size": 0, "raw_key_size": 9382, "raw_average_key_size": 18, "raw_value_size": 1699702, "raw_average_value_size": 3385, "num_data_blocks": 218, "num_entries": 502, "filter_policy_name": "", "kDeletedKeys": "250", "kMergeOperands": "0"}}
- 2017-07-11 13:49:47.750881 I | rook-ceph-mon2: 2017-07-11 13:49:47.750864 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 13] Level-0 flush table #25: 1718604 bytes OK
- 2017-07-11 13:49:47.811361 I | rook-ceph-mon2: 2017-07-11 13:49:47.811330 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.776099) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #25 started
- 2017-07-11 13:49:47.811393 I | rook-ceph-mon2: 2017-07-11 13:49:47.811380 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.811291) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #25: memtable #1 done
- 2017-07-11 13:49:47.811412 I | rook-ceph-mon2: 2017-07-11 13:49:47.811400 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.811307) EVENT_LOG_v1 {"time_micros": 1499780987811298, "job": 13, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:49:47.811429 I | rook-ceph-mon2: 2017-07-11 13:49:47.811418 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.811321) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:49:47.811432 I | rook-ceph-mon2:
- 2017-07-11 13:49:47.811459 I | rook-ceph-mon2: 2017-07-11 13:49:47.811440 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 13] Try to delete WAL files size 4014689, prev total WAL file size 4014689, number of live WAL files 2.
- 2017-07-11 13:49:47.811463 I | rook-ceph-mon2:
- 2017-07-11 13:49:47.812380 I | rook-ceph-mon2: 2017-07-11 13:49:47.812109 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:49:47.812409 I | rook-ceph-mon2: 2017-07-11 13:49:47.812143 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:49:47.812139) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:49:47.812414 I | rook-ceph-mon2:
- 2017-07-11 13:49:47.812417 I | rook-ceph-mon2: 2017-07-11 13:49:47.812148 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 14] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:49:47.812420 I | rook-ceph-mon2: 2017-07-11 13:49:47.812153 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 13 Base level 0, inputs: [25(1678KB)], [23(10173KB)]
- 2017-07-11 13:49:47.812423 I | rook-ceph-mon2:
- 2017-07-11 13:49:47.812426 I | rook-ceph-mon2: 2017-07-11 13:49:47.812162 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780987812155, "job": 14, "event": "compaction_started", "files_L0": [25], "files_L1": [23], "score": -1, "input_data_size": 12136249}
- 2017-07-11 13:49:47.941524 I | rook-ceph-mon2: 2017-07-11 13:49:47.925292 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 14] Generated table #26: 1650 keys, 11446652 bytes
- 2017-07-11 13:49:47.941751 I | rook-ceph-mon2: 2017-07-11 13:49:47.941718 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780987941709, "cf_name": "default", "job": 14, "event": "table_file_creation", "file_number": 26, "file_size": 11446652, "table_properties": {"data_size": 11407940, "index_size": 37893, "filter_size": 0, "raw_key_size": 30088, "raw_average_key_size": 18, "raw_value_size": 11358753, "raw_average_value_size": 6884, "num_data_blocks": 1208, "num_entries": 1650, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:49:47.993104 I | rook-ceph-mon2: 2017-07-11 13:49:47.990045 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 14] Compacted 1@0 + 1@1 files to L1 => 11446652 bytes
- 2017-07-11 13:49:48.043905 I | rook-ceph-mon2: 2017-07-11 13:49:48.035060 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:49:48.034985) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 68.2 rd, 64.4 wr, level 1, files in(1, 1) out(1) MB in(1.6, 9.9) out(10.9), read-write-amplify(13.7) write-amplify(6.7) OK, records in: 2012, records dropped: 362
- 2017-07-11 13:49:48.045099 I | rook-ceph-mon2:
- 2017-07-11 13:49:48.052815 I | rook-ceph-mon2: 2017-07-11 13:49:48.052769 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:49:48.035005) EVENT_LOG_v1 {"time_micros": 1499780988034996, "job": 14, "event": "compaction_finished", "compaction_time_micros": 177867, "output_level": 1, "num_output_files": 1, "total_output_size": 11446652, "num_input_records": 2012, "num_output_records": 1650, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:49:48.063513 I | rook-ceph-mon2: 2017-07-11 13:49:48.063496 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780988063493, "job": 14, "event": "table_file_deletion", "file_number": 25}
- 2017-07-11 13:49:48.064710 I | rook-ceph-mon2: 2017-07-11 13:49:48.064696 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499780988064694, "job": 14, "event": "table_file_deletion", "file_number": 23}
- 2017-07-11 13:49:48.064751 I | rook-ceph-mon2: 2017-07-11 13:49:48.064738 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:49:57.856109 I | rook-ceph-mon2: 2017-07-11 13:49:57.855916 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 13:49:57.942115 I | rook-ceph-mon2: 2017-07-11 13:49:57.942087 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:49:57.952303 I | rook-ceph-mon2: 2017-07-11 13:49:57.952253 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/845788908' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:50:19.828235 I | rook-ceph-mon2: 2017-07-11 13:50:19.828177 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:50:19.828490 I | rook-ceph-mon2: 2017-07-11 13:50:19.828437 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3816634115' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:50:30.813164 I | rook-ceph-mon2: 2017-07-11 13:50:30.813126 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:50:30.813440 I | rook-ceph-mon2: 2017-07-11 13:50:30.813423 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1634964377' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:50:57.868340 I | rook-ceph-mon2: 2017-07-11 13:50:57.860825 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 13:51:03.547504 I | rook-ceph-mon2: 2017-07-11 13:51:03.547466 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:51:03.547682 I | rook-ceph-mon2: 2017-07-11 13:51:03.547600 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/255495998' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:51:06.350909 I | rook-ceph-mon2: 2017-07-11 13:51:05.507072 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 421 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0662768s > max 0.05s
- 2017-07-11 13:51:06.350987 I | rook-ceph-mon2: 2017-07-11 13:51:05.507492 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 422 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.0569526s > max 0.05s
- 2017-07-11 13:51:14.384961 I | rook-ceph-mon2: 2017-07-11 13:51:14.384923 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:51:14.385217 I | rook-ceph-mon2: 2017-07-11 13:51:14.385181 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3184784056' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:51:43.440210 I | rook-ceph-mon2: 2017-07-11 13:51:43.440132 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #27. Immutable memtables: 0.
- 2017-07-11 13:51:43.440287 I | rook-ceph-mon2:
- 2017-07-11 13:51:43.440307 I | rook-ceph-mon2: 2017-07-11 13:51:43.440169 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 15] Syncing log #24
- 2017-07-11 13:51:43.507782 I | rook-ceph-mon2: 2017-07-11 13:51:43.506492 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.440164) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:51:43.507824 I | rook-ceph-mon2: 2017-07-11 13:51:43.506500 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 15] Flushing memtable with next log file: 27
- 2017-07-11 13:51:43.507840 I | rook-ceph-mon2:
- 2017-07-11 13:51:43.507852 I | rook-ceph-mon2: 2017-07-11 13:51:43.506508 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103506504, "job": 15, "event": "flush_started", "num_memtables": 1, "num_entries": 762, "num_deletes": 251, "memory_usage": 1570584}
- 2017-07-11 13:51:43.507863 I | rook-ceph-mon2: 2017-07-11 13:51:43.506511 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 15] Level-0 flush table #28: started
- 2017-07-11 13:51:43.570090 I | rook-ceph-mon2: 2017-07-11 13:51:43.570047 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103570038, "cf_name": "default", "job": 15, "event": "table_file_creation", "file_number": 28, "file_size": 1032781, "table_properties": {"data_size": 1027701, "index_size": 4265, "filter_size": 0, "raw_key_size": 7221, "raw_average_key_size": 17, "raw_value_size": 1019190, "raw_average_value_size": 2498, "num_data_blocks": 140, "num_entries": 408, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:51:43.570161 I | rook-ceph-mon2: 2017-07-11 13:51:43.570145 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 15] Level-0 flush table #28: 1032781 bytes OK
- 2017-07-11 13:51:43.648980 I | rook-ceph-mon2: 2017-07-11 13:51:43.648938 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.617570) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #28 started
- 2017-07-11 13:51:43.649080 I | rook-ceph-mon2: 2017-07-11 13:51:43.649064 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.648877) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #28: memtable #1 done
- 2017-07-11 13:51:43.649129 I | rook-ceph-mon2: 2017-07-11 13:51:43.649113 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.648899) EVENT_LOG_v1 {"time_micros": 1499781103648892, "job": 15, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:51:43.649158 I | rook-ceph-mon2: 2017-07-11 13:51:43.649146 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.648916) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:51:43.649173 I | rook-ceph-mon2:
- 2017-07-11 13:51:43.649219 I | rook-ceph-mon2: 2017-07-11 13:51:43.649206 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 15] Try to delete WAL files size 1552932, prev total WAL file size 1552932, number of live WAL files 2.
- 2017-07-11 13:51:43.649232 I | rook-ceph-mon2:
- 2017-07-11 13:51:43.649872 I | rook-ceph-mon2: 2017-07-11 13:51:43.649638 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:51:43.649907 I | rook-ceph-mon2: 2017-07-11 13:51:43.649670 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.649664) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 13:51:43.649922 I | rook-ceph-mon2:
- 2017-07-11 13:51:43.649933 I | rook-ceph-mon2: 2017-07-11 13:51:43.649675 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 16] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:51:43.649944 I | rook-ceph-mon2: 2017-07-11 13:51:43.649679 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 15 Base level 0, inputs: [28(1008KB)], [26(10MB)]
- 2017-07-11 13:51:43.649954 I | rook-ceph-mon2:
- 2017-07-11 13:51:43.649978 I | rook-ceph-mon2: 2017-07-11 13:51:43.649688 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103649681, "job": 16, "event": "compaction_started", "files_L0": [28], "files_L1": [26], "score": -1, "input_data_size": 12479433}
- 2017-07-11 13:51:43.739654 I | rook-ceph-mon2: 2017-07-11 13:51:43.739607 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 16] Generated table #29: 1549 keys, 10840113 bytes
- 2017-07-11 13:51:43.739848 I | rook-ceph-mon2: 2017-07-11 13:51:43.739769 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103739760, "cf_name": "default", "job": 16, "event": "table_file_creation", "file_number": 29, "file_size": 10840113, "table_properties": {"data_size": 10804490, "index_size": 34804, "filter_size": 0, "raw_key_size": 28590, "raw_average_key_size": 18, "raw_value_size": 10758719, "raw_average_value_size": 6945, "num_data_blocks": 1097, "num_entries": 1549, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:51:43.839982 I | rook-ceph-mon2: 2017-07-11 13:51:43.839951 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 16] Compacted 1@0 + 1@1 files to L1 => 10840113 bytes
- 2017-07-11 13:51:43.871685 I | rook-ceph-mon2: 2017-07-11 13:51:43.871659 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.871602) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 65.6 rd, 57.0 wr, level 1, files in(1, 1) out(1) MB in(1.0, 10.9) out(10.3), read-write-amplify(22.6) write-amplify(10.5) OK, records in: 2058, records dropped: 509
- 2017-07-11 13:51:43.871725 I | rook-ceph-mon2:
- 2017-07-11 13:51:43.871757 I | rook-ceph-mon2: 2017-07-11 13:51:43.871742 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:51:43.871617) EVENT_LOG_v1 {"time_micros": 1499781103871611, "job": 16, "event": "compaction_finished", "compaction_time_micros": 190249, "output_level": 1, "num_output_files": 1, "total_output_size": 10840113, "num_input_records": 2058, "num_output_records": 1549, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:51:43.872053 I | rook-ceph-mon2: 2017-07-11 13:51:43.872039 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103872036, "job": 16, "event": "table_file_deletion", "file_number": 28}
- 2017-07-11 13:51:43.873583 I | rook-ceph-mon2: 2017-07-11 13:51:43.873567 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781103873564, "job": 16, "event": "table_file_deletion", "file_number": 26}
- 2017-07-11 13:51:47.367785 I | rook-ceph-mon2: 2017-07-11 13:51:47.367749 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:51:47.367850 I | rook-ceph-mon2: 2017-07-11 13:51:47.367835 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/298521484' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:51:49.970951 I | rook-ceph-mon2: 2017-07-11 13:51:48.622941 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 424 : cluster [WRN] message from mon.1 was stamped 0.084083s in the future, clocks not synchronized
- 2017-07-11 13:51:57.861834 I | rook-ceph-mon2: 2017-07-11 13:51:57.861533 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94369 MB
- 2017-07-11 13:51:58.293473 I | rook-ceph-mon2: 2017-07-11 13:51:58.293438 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:51:58.293649 I | rook-ceph-mon2: 2017-07-11 13:51:58.293571 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1581051982' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:52:05.511834 I | rook-ceph-mon2: 2017-07-11 13:52:05.320100 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 425 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 13:52:20.039058 I | rook-ceph-mon2: 2017-07-11 13:52:20.039018 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:52:20.039294 I | rook-ceph-mon2: 2017-07-11 13:52:20.039165 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/175300425' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:52:41.854084 I | rook-ceph-mon2: 2017-07-11 13:52:41.854046 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:52:41.854276 I | rook-ceph-mon2: 2017-07-11 13:52:41.854192 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2927777917' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:52:57.878209 I | rook-ceph-mon2: 2017-07-11 13:52:57.878039 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94369 MB
- 2017-07-11 13:53:57.878517 I | rook-ceph-mon2: 2017-07-11 13:53:57.878262 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94369 MB
- 2017-07-11 13:54:20.057537 I | rook-ceph-mon2: 2017-07-11 13:54:20.057483 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:54:20.057724 I | rook-ceph-mon2: 2017-07-11 13:54:20.057640 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1889890196' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:54:57.878846 I | rook-ceph-mon2: 2017-07-11 13:54:57.878537 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94369 MB
- 2017-07-11 13:55:06.723334 I | rook-ceph-mon2: 2017-07-11 13:55:05.508559 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 434 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0663925s > max 0.05s
- 2017-07-11 13:55:06.723450 I | rook-ceph-mon2: 2017-07-11 13:55:05.512428 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 435 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.0852258s > max 0.05s
- 2017-07-11 13:55:26.018086 I | rook-ceph-mon2: 2017-07-11 13:55:26.018035 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:55:26.018296 I | rook-ceph-mon2: 2017-07-11 13:55:26.018264 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/611264511' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:55:57.879441 I | rook-ceph-mon2: 2017-07-11 13:55:57.879106 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94369 MB
- 2017-07-11 13:56:20.914751 I | rook-ceph-mon2: 2017-07-11 13:56:20.914706 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:56:20.914964 I | rook-ceph-mon2: 2017-07-11 13:56:20.914861 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1311024037' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:56:57.879779 I | rook-ceph-mon2: 2017-07-11 13:56:57.879366 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94369 MB
- 2017-07-11 13:57:04.742047 I | rook-ceph-mon2: 2017-07-11 13:57:04.742005 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:57:04.742279 I | rook-ceph-mon2: 2017-07-11 13:57:04.742232 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2920837063' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:57:57.880273 I | rook-ceph-mon2: 2017-07-11 13:57:57.879941 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94369 MB
- 2017-07-11 13:57:59.618436 I | rook-ceph-mon2: 2017-07-11 13:57:59.618376 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:57:59.618615 I | rook-ceph-mon2: 2017-07-11 13:57:59.618538 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2096735565' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:58:10.834584 I | rook-ceph-mon2: 2017-07-11 13:58:10.834513 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:58:10.834829 I | rook-ceph-mon2: 2017-07-11 13:58:10.834798 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3806174629' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:58:12.563601 I | rook-ceph-mon2: 2017-07-11 13:58:12.563459 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #30. Immutable memtables: 0.
- 2017-07-11 13:58:12.563821 I | rook-ceph-mon2:
- 2017-07-11 13:58:12.563849 I | rook-ceph-mon2: 2017-07-11 13:58:12.563522 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 17] Syncing log #27
- 2017-07-11 13:58:12.589027 I | rook-ceph-mon2: 2017-07-11 13:58:12.587534 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.563508) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:58:12.589069 I | rook-ceph-mon2: 2017-07-11 13:58:12.587543 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 17] Flushing memtable with next log file: 30
- 2017-07-11 13:58:12.589096 I | rook-ceph-mon2:
- 2017-07-11 13:58:12.589109 I | rook-ceph-mon2: 2017-07-11 13:58:12.587554 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781492587550, "job": 17, "event": "flush_started", "num_memtables": 1, "num_entries": 1959, "num_deletes": 251, "memory_usage": 5259112}
- 2017-07-11 13:58:12.589136 I | rook-ceph-mon2: 2017-07-11 13:58:12.587556 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 17] Level-0 flush table #31: started
- 2017-07-11 13:58:12.683429 I | rook-ceph-mon2: 2017-07-11 13:58:12.683379 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781492683369, "cf_name": "default", "job": 17, "event": "table_file_creation", "file_number": 31, "file_size": 2237920, "table_properties": {"data_size": 2228572, "index_size": 8530, "filter_size": 0, "raw_key_size": 10717, "raw_average_key_size": 18, "raw_value_size": 2214723, "raw_average_value_size": 3851, "num_data_blocks": 281, "num_entries": 575, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:58:12.683641 I | rook-ceph-mon2: 2017-07-11 13:58:12.683532 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 17] Level-0 flush table #31: 2237920 bytes OK
- 2017-07-11 13:58:12.881195 I | rook-ceph-mon2: 2017-07-11 13:58:12.881152 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.713061) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #31 started
- 2017-07-11 13:58:12.881428 I | rook-ceph-mon2: 2017-07-11 13:58:12.881275 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.881098) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #31: memtable #1 done
- 2017-07-11 13:58:12.881504 I | rook-ceph-mon2: 2017-07-11 13:58:12.881470 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.881121) EVENT_LOG_v1 {"time_micros": 1499781492881115, "job": 17, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:58:12.881555 I | rook-ceph-mon2: 2017-07-11 13:58:12.881524 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.881137) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:58:12.881570 I | rook-ceph-mon2:
- 2017-07-11 13:58:12.881602 I | rook-ceph-mon2: 2017-07-11 13:58:12.881588 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 17] Try to delete WAL files size 5214241, prev total WAL file size 5214241, number of live WAL files 2.
- 2017-07-11 13:58:12.881631 I | rook-ceph-mon2:
- 2017-07-11 13:58:12.883317 I | rook-ceph-mon2: 2017-07-11 13:58:12.882934 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:58:12.883376 I | rook-ceph-mon2: 2017-07-11 13:58:12.883084 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 13:58:12.883393 I | rook-ceph-mon2: 2017-07-11 13:58:12.883088 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 13:58:12.883407 I | rook-ceph-mon2: ** DB Stats **
- 2017-07-11 13:58:12.883434 I | rook-ceph-mon2: Uptime(secs): 2055.6 total, 810.7 interval
- 2017-07-11 13:58:12.883447 I | rook-ceph-mon2: Cumulative writes: 3106 writes, 13K keys, 3106 commit groups, 1.0 writes per commit group, ingest: 0.04 GB, 0.02 MB/s
- 2017-07-11 13:58:12.883458 I | rook-ceph-mon2: Cumulative WAL: 3106 writes, 3106 syncs, 1.00 writes per sync, written: 0.04 GB, 0.02 MB/s
- 2017-07-11 13:58:12.883469 I | rook-ceph-mon2: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:58:12.883479 I | rook-ceph-mon2: Interval writes: 968 writes, 4295 keys, 968 commit groups, 1.0 writes per commit group, ingest: 10.28 MB, 0.01 MB/s
- 2017-07-11 13:58:12.883490 I | rook-ceph-mon2: Interval WAL: 968 writes, 968 syncs, 1.00 writes per sync, written: 0.01 MB, 0.01 MB/s
- 2017-07-11 13:58:12.883520 I | rook-ceph-mon2: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 13:58:12.883533 I | rook-ceph-mon2:
- 2017-07-11 13:58:12.883544 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 13:58:12.883598 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:58:12.883613 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:58:12.883628 I | rook-ceph-mon2: L0 1/1 2.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 15.2 2 9 0.168 0 0
- 2017-07-11 13:58:12.883641 I | rook-ceph-mon2: L1 1/1 10.34 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 3.8 57.9 51.0 2 7 0.220 12K 2572
- 2017-07-11 13:58:12.883651 I | rook-ceph-mon2: Sum 2/2 12.47 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 4.4 29.2 33.3 3 16 0.191 12K 2572
- 2017-07-11 13:58:12.883674 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 7.6 31.3 31.1 1 6 0.193 6089 1380
- 2017-07-11 13:58:12.883686 I | rook-ceph-mon2: Uptime(secs): 2055.6 total, 2055.6 interval
- 2017-07-11 13:58:12.883696 I | rook-ceph-mon2: Flush(GB): cumulative 0.022, interval 0.005
- 2017-07-11 13:58:12.883706 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:58:12.883716 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:58:12.883726 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:58:12.883753 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:58:12.883766 I | rook-ceph-mon2: Cumulative compaction: 0.10 GB write, 0.05 MB/s write, 0.09 GB read, 0.04 MB/s read, 3.0 seconds
- 2017-07-11 13:58:12.883776 I | rook-ceph-mon2: Interval compaction: 0.04 GB write, 0.02 MB/s write, 0.04 GB read, 0.02 MB/s read, 1.2 seconds
- 2017-07-11 13:58:12.883801 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:58:12.883829 I | rook-ceph-mon2:
- 2017-07-11 13:58:12.883859 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:58:12.883878 I | rook-ceph-mon2:
- 2017-07-11 13:58:12.883896 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 13:58:12.883917 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 13:58:12.883927 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 13:58:12.883938 I | rook-ceph-mon2: L0 1/1 2.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 15.2 2 9 0.168 0 0
- 2017-07-11 13:58:12.883949 I | rook-ceph-mon2: L1 1/1 10.34 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 3.8 57.9 51.0 2 7 0.220 12K 2572
- 2017-07-11 13:58:12.883959 I | rook-ceph-mon2: Sum 2/2 12.47 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 4.4 29.2 33.3 3 16 0.191 12K 2572
- 2017-07-11 13:58:12.883981 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 13:58:12.883994 I | rook-ceph-mon2: Uptime(secs): 2055.6 total, 2055.6 interval
- 2017-07-11 13:58:12.884004 I | rook-ceph-mon2: Flush(GB): cumulative 0.022, interval 0.000
- 2017-07-11 13:58:12.884014 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 13:58:12.884024 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 13:58:12.884035 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 13:58:12.884045 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 13:58:12.884068 I | rook-ceph-mon2: Cumulative compaction: 0.10 GB write, 0.05 MB/s write, 0.09 GB read, 0.04 MB/s read, 3.0 seconds
- 2017-07-11 13:58:12.884079 I | rook-ceph-mon2: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 13:58:12.884090 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 13:58:12.884100 I | rook-ceph-mon2:
- 2017-07-11 13:58:12.884141 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 13:58:12.884153 I | rook-ceph-mon2:
- 2017-07-11 13:58:12.884499 I | rook-ceph-mon2: 2017-07-11 13:58:12.883104 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:58:12.883099) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 13:58:12.884524 I | rook-ceph-mon2:
- 2017-07-11 13:58:12.884537 I | rook-ceph-mon2: 2017-07-11 13:58:12.883108 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 18] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:58:12.884548 I | rook-ceph-mon2: 2017-07-11 13:58:12.883111 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 17 Base level 0, inputs: [31(2185KB)], [29(10MB)]
- 2017-07-11 13:58:12.884684 I | rook-ceph-mon2:
- 2017-07-11 13:58:12.884698 I | rook-ceph-mon2: 2017-07-11 13:58:12.883120 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781492883113, "job": 18, "event": "compaction_started", "files_L0": [31], "files_L1": [29], "score": -1, "input_data_size": 13078033}
- 2017-07-11 13:58:13.021901 I | rook-ceph-mon2: 2017-07-11 13:58:13.021828 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 18] Generated table #32: 1802 keys, 12652982 bytes
- 2017-07-11 13:58:13.022104 I | rook-ceph-mon2: 2017-07-11 13:58:13.022003 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781493021994, "cf_name": "default", "job": 18, "event": "table_file_creation", "file_number": 32, "file_size": 12652982, "table_properties": {"data_size": 12610623, "index_size": 41540, "filter_size": 0, "raw_key_size": 33131, "raw_average_key_size": 18, "raw_value_size": 12556746, "raw_average_value_size": 6968, "num_data_blocks": 1313, "num_entries": 1802, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:58:13.064104 I | rook-ceph-mon2: 2017-07-11 13:58:13.064061 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 18] Compacted 1@0 + 1@1 files to L1 => 12652982 bytes
- 2017-07-11 13:58:13.106324 I | rook-ceph-mon2: 2017-07-11 13:58:13.106289 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:58:13.106219) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 72.3 rd, 69.9 wr, level 1, files in(1, 1) out(1) MB in(2.1, 10.3) out(12.1), read-write-amplify(11.5) write-amplify(5.7) OK, records in: 2124, records dropped: 322
- 2017-07-11 13:58:13.106376 I | rook-ceph-mon2:
- 2017-07-11 13:58:13.106409 I | rook-ceph-mon2: 2017-07-11 13:58:13.106394 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:58:13.106240) EVENT_LOG_v1 {"time_micros": 1499781493106231, "job": 18, "event": "compaction_finished", "compaction_time_micros": 180922, "output_level": 1, "num_output_files": 1, "total_output_size": 12652982, "num_input_records": 2124, "num_output_records": 1802, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:58:13.106908 I | rook-ceph-mon2: 2017-07-11 13:58:13.106892 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781493106890, "job": 18, "event": "table_file_deletion", "file_number": 31}
- 2017-07-11 13:58:13.108282 I | rook-ceph-mon2: 2017-07-11 13:58:13.108268 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781493108266, "job": 18, "event": "table_file_deletion", "file_number": 29}
- 2017-07-11 13:58:13.108343 I | rook-ceph-mon2: 2017-07-11 13:58:13.108329 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:58:42.104572 I | rook-ceph-mon2: 2017-07-11 13:58:42.104474 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #33. Immutable memtables: 0.
- 2017-07-11 13:58:42.104679 I | rook-ceph-mon2:
- 2017-07-11 13:58:42.104722 I | rook-ceph-mon2: 2017-07-11 13:58:42.104522 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 19] Syncing log #30
- 2017-07-11 13:58:42.135158 I | rook-ceph-mon2: 2017-07-11 13:58:42.134696 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.104517) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 13:58:42.135241 I | rook-ceph-mon2: 2017-07-11 13:58:42.134711 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 19] Flushing memtable with next log file: 33
- 2017-07-11 13:58:42.135258 I | rook-ceph-mon2:
- 2017-07-11 13:58:42.135269 I | rook-ceph-mon2: 2017-07-11 13:58:42.134723 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522134718, "job": 19, "event": "flush_started", "num_memtables": 1, "num_entries": 380, "num_deletes": 251, "memory_usage": 397160}
- 2017-07-11 13:58:42.135280 I | rook-ceph-mon2: 2017-07-11 13:58:42.134725 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 19] Level-0 flush table #34: started
- 2017-07-11 13:58:42.337445 I | rook-ceph-mon2: 2017-07-11 13:58:42.337378 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522337368, "cf_name": "default", "job": 19, "event": "table_file_creation", "file_number": 34, "file_size": 257113, "table_properties": {"data_size": 255198, "index_size": 1101, "filter_size": 0, "raw_key_size": 5155, "raw_average_key_size": 17, "raw_value_size": 250502, "raw_average_value_size": 849, "num_data_blocks": 36, "num_entries": 295, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 13:58:42.337537 I | rook-ceph-mon2: 2017-07-11 13:58:42.337389 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 19] Level-0 flush table #34: 257113 bytes OK
- 2017-07-11 13:58:42.397251 I | rook-ceph-mon2: 2017-07-11 13:58:42.397223 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.365402) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #34 started
- 2017-07-11 13:58:42.397315 I | rook-ceph-mon2: 2017-07-11 13:58:42.397300 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.397183) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #34: memtable #1 done
- 2017-07-11 13:58:42.397347 I | rook-ceph-mon2: 2017-07-11 13:58:42.397334 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.397198) EVENT_LOG_v1 {"time_micros": 1499781522397193, "job": 19, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 13:58:42.397392 I | rook-ceph-mon2: 2017-07-11 13:58:42.397378 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.397212) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 13:58:42.397407 I | rook-ceph-mon2:
- 2017-07-11 13:58:42.397462 I | rook-ceph-mon2: 2017-07-11 13:58:42.397434 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 19] Try to delete WAL files size 386797, prev total WAL file size 386797, number of live WAL files 2.
- 2017-07-11 13:58:42.397475 I | rook-ceph-mon2:
- 2017-07-11 13:58:42.399164 I | rook-ceph-mon2: 2017-07-11 13:58:42.397744 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 13:58:42.399213 I | rook-ceph-mon2: 2017-07-11 13:58:42.397775 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.397770) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 13:58:42.399239 I | rook-ceph-mon2:
- 2017-07-11 13:58:42.399250 I | rook-ceph-mon2: 2017-07-11 13:58:42.397780 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 20] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 13:58:42.399260 I | rook-ceph-mon2: 2017-07-11 13:58:42.397784 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 19 Base level 0, inputs: [34(251KB)], [32(12MB)]
- 2017-07-11 13:58:42.399271 I | rook-ceph-mon2:
- 2017-07-11 13:58:42.399299 I | rook-ceph-mon2: 2017-07-11 13:58:42.397793 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522397786, "job": 20, "event": "compaction_started", "files_L0": [34], "files_L1": [32], "score": -1, "input_data_size": 12910095}
- 2017-07-11 13:58:42.523709 I | rook-ceph-mon2: 2017-07-11 13:58:42.523646 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 20] Generated table #35: 1588 keys, 11020708 bytes
- 2017-07-11 13:58:42.523840 I | rook-ceph-mon2: 2017-07-11 13:58:42.523822 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522523814, "cf_name": "default", "job": 20, "event": "table_file_creation", "file_number": 35, "file_size": 11020708, "table_properties": {"data_size": 10984680, "index_size": 35209, "filter_size": 0, "raw_key_size": 29557, "raw_average_key_size": 18, "raw_value_size": 10938013, "raw_average_value_size": 6887, "num_data_blocks": 1099, "num_entries": 1588, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:58:42.556977 I | rook-ceph-mon2: 2017-07-11 13:58:42.556947 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 20] Compacted 1@0 + 1@1 files to L1 => 11020708 bytes
- 2017-07-11 13:58:42.588183 I | rook-ceph-mon2: 2017-07-11 13:58:42.588159 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.588094) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 81.1 rd, 69.3 wr, level 1, files in(1, 1) out(1) MB in(0.2, 12.1) out(10.5), read-write-amplify(93.1) write-amplify(42.9) OK, records in: 2097, records dropped: 509
- 2017-07-11 13:58:42.588223 I | rook-ceph-mon2:
- 2017-07-11 13:58:42.588259 I | rook-ceph-mon2: 2017-07-11 13:58:42.588240 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-13:58:42.588111) EVENT_LOG_v1 {"time_micros": 1499781522588104, "job": 20, "event": "compaction_finished", "compaction_time_micros": 159138, "output_level": 1, "num_output_files": 1, "total_output_size": 11020708, "num_input_records": 2097, "num_output_records": 1588, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 13:58:42.588467 I | rook-ceph-mon2: 2017-07-11 13:58:42.588438 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522588436, "job": 20, "event": "table_file_deletion", "file_number": 34}
- 2017-07-11 13:58:42.590007 I | rook-ceph-mon2: 2017-07-11 13:58:42.589993 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781522589991, "job": 20, "event": "table_file_deletion", "file_number": 32}
- 2017-07-11 13:58:54.766596 I | rook-ceph-mon2: 2017-07-11 13:58:54.766538 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:58:54.766802 I | rook-ceph-mon2: 2017-07-11 13:58:54.766715 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3014939177' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:58:57.880454 I | rook-ceph-mon2: 2017-07-11 13:58:57.880214 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 13:59:27.694602 I | rook-ceph-mon2: 2017-07-11 13:59:27.694565 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:59:27.694725 I | rook-ceph-mon2: 2017-07-11 13:59:27.694681 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1350297731' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:59:35.746567 I | rook-ceph-mon2: 2017-07-11 13:59:35.513856 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 450 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0762522s > max 0.05s
- 2017-07-11 13:59:35.746638 I | rook-ceph-mon2: 2017-07-11 13:59:35.518886 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 451 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.112485s > max 0.05s
- 2017-07-11 13:59:49.582682 I | rook-ceph-mon2: 2017-07-11 13:59:49.582612 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 13:59:49.582790 I | rook-ceph-mon2: 2017-07-11 13:59:49.582775 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1622502770' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 13:59:57.881365 I | rook-ceph-mon2: 2017-07-11 13:59:57.881075 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 14:00:00.235018 I | rook-ceph-mon2: 2017-07-11 14:00:00.000377 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 453 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:00:00.612283 I | rook-ceph-mon2: 2017-07-11 14:00:00.612225 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:00:00.612550 I | rook-ceph-mon2: 2017-07-11 14:00:00.612534 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2063591768' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:00:22.477295 I | rook-ceph-mon2: 2017-07-11 14:00:22.477250 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:00:22.477565 I | rook-ceph-mon2: 2017-07-11 14:00:22.477548 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2396865004' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:00:41.838212 I | rook-ceph-mon2: 2017-07-11 14:00:41.838177 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:00:41.838406 I | rook-ceph-mon2: 2017-07-11 14:00:41.838317 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1852235816' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:00:44.661918 I | rook-ceph-mon2: 2017-07-11 14:00:44.661883 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:00:44.662110 I | rook-ceph-mon2: 2017-07-11 14:00:44.662025 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1182915896' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:00:46.370492 I | rook-ceph-mon2: 2017-07-11 14:00:46.370428 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:00:46.370743 I | rook-ceph-mon2: 2017-07-11 14:00:46.370726 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2156487954' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:00:55.283244 I | rook-ceph-mon2: 2017-07-11 14:00:55.283211 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:00:55.283479 I | rook-ceph-mon2: 2017-07-11 14:00:55.283370 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3021345428' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:00:57.881852 I | rook-ceph-mon2: 2017-07-11 14:00:57.881454 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 14:01:12.693218 I | rook-ceph-mon2: 2017-07-11 14:01:12.693184 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:01:12.693409 I | rook-ceph-mon2: 2017-07-11 14:01:12.693325 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3588718591' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:01:17.186351 I | rook-ceph-mon2: 2017-07-11 14:01:17.186318 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:01:17.186427 I | rook-ceph-mon2: 2017-07-11 14:01:17.186412 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1217501523' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:01:28.367093 I | rook-ceph-mon2: 2017-07-11 14:01:28.367054 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:01:28.367322 I | rook-ceph-mon2: 2017-07-11 14:01:28.367305 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2108341050' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:01:39.423879 I | rook-ceph-mon2: 2017-07-11 14:01:39.423840 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:01:39.424105 I | rook-ceph-mon2: 2017-07-11 14:01:39.424064 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/893459205' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:01:57.882377 I | rook-ceph-mon2: 2017-07-11 14:01:57.882116 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 14:02:01.308055 I | rook-ceph-mon2: 2017-07-11 14:02:01.308019 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:02:01.308119 I | rook-ceph-mon2: 2017-07-11 14:02:01.308103 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2191340744' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:02:57.882709 I | rook-ceph-mon2: 2017-07-11 14:02:57.882508 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 14:03:06.960876 I | rook-ceph-mon2: 2017-07-11 14:03:06.960837 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:03:06.961075 I | rook-ceph-mon2: 2017-07-11 14:03:06.960979 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1259010049' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:03:57.897261 I | rook-ceph-mon2: 2017-07-11 14:03:57.897051 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 14:04:02.346609 I | rook-ceph-mon2: 2017-07-11 14:04:02.346570 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:04:02.346803 I | rook-ceph-mon2: 2017-07-11 14:04:02.346716 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1123992699' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:04:13.414554 I | rook-ceph-mon2: 2017-07-11 14:04:13.414508 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:04:13.414758 I | rook-ceph-mon2: 2017-07-11 14:04:13.414658 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3130828920' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:04:35.751484 I | rook-ceph-mon2: 2017-07-11 14:04:35.520533 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 467 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.077392s > max 0.05s
- 2017-07-11 14:04:35.751568 I | rook-ceph-mon2: 2017-07-11 14:04:35.520874 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 468 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.141366s > max 0.05s
- 2017-07-11 14:04:57.898072 I | rook-ceph-mon2: 2017-07-11 14:04:57.897753 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4818 MB, avail 94368 MB
- 2017-07-11 14:05:19.415960 I | rook-ceph-mon2: 2017-07-11 14:05:19.415924 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:05:19.416131 I | rook-ceph-mon2: 2017-07-11 14:05:19.416052 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1028031592' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:05:20.397429 I | rook-ceph-mon2: 2017-07-11 14:05:20.397346 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"} v 0) v1
- 2017-07-11 14:05:20.397635 I | rook-ceph-mon2: 2017-07-11 14:05:20.397550 7f0c84e17700 0 log_channel(audit) log [INF] : from='client.? 10.233.99.0:0/695457415' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:05:20.880878 I | rook-ceph-mon2: 2017-07-11 14:05:20.397690 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 101 : audit [INF] from='client.? 10.233.99.0:0/695457415' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:05:20.880899 I | rook-ceph-mon2: 2017-07-11 14:05:20.472654 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 474 : audit [INF] from='client.4559 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:05:31.011343 I | rook-ceph-mon2: 2017-07-11 14:05:31.010894 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #36. Immutable memtables: 0.
- 2017-07-11 14:05:31.011447 I | rook-ceph-mon2:
- 2017-07-11 14:05:31.011546 I | rook-ceph-mon2: 2017-07-11 14:05:31.011290 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 21] Syncing log #33
- 2017-07-11 14:05:31.042722 I | rook-ceph-mon2: 2017-07-11 14:05:31.040107 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.011284) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:05:31.042779 I | rook-ceph-mon2: 2017-07-11 14:05:31.040117 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 21] Flushing memtable with next log file: 36
- 2017-07-11 14:05:31.042796 I | rook-ceph-mon2:
- 2017-07-11 14:05:31.042810 I | rook-ceph-mon2: 2017-07-11 14:05:31.040126 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931040122, "job": 21, "event": "flush_started", "num_memtables": 1, "num_entries": 2105, "num_deletes": 251, "memory_usage": 5781592}
- 2017-07-11 14:05:31.042823 I | rook-ceph-mon2: 2017-07-11 14:05:31.040128 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 21] Level-0 flush table #37: started
- 2017-07-11 14:05:31.246752 I | rook-ceph-mon2: 2017-07-11 14:05:31.246705 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931246695, "cf_name": "default", "job": 21, "event": "table_file_creation", "file_number": 37, "file_size": 3814701, "table_properties": {"data_size": 3798004, "index_size": 15879, "filter_size": 0, "raw_key_size": 15057, "raw_average_key_size": 18, "raw_value_size": 3775761, "raw_average_value_size": 4672, "num_data_blocks": 506, "num_entries": 808, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:05:31.246959 I | rook-ceph-mon2: 2017-07-11 14:05:31.246841 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 21] Level-0 flush table #37: 3814701 bytes OK
- 2017-07-11 14:05:31.358974 I | rook-ceph-mon2: 2017-07-11 14:05:31.358919 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.290559) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #37 started
- 2017-07-11 14:05:31.359143 I | rook-ceph-mon2: 2017-07-11 14:05:31.359068 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.358872) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #37: memtable #1 done
- 2017-07-11 14:05:31.359204 I | rook-ceph-mon2: 2017-07-11 14:05:31.359187 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.358891) EVENT_LOG_v1 {"time_micros": 1499781931358885, "job": 21, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:05:31.359248 I | rook-ceph-mon2: 2017-07-11 14:05:31.359223 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.358907) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:05:31.359277 I | rook-ceph-mon2:
- 2017-07-11 14:05:31.359307 I | rook-ceph-mon2: 2017-07-11 14:05:31.359294 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 21] Try to delete WAL files size 5734704, prev total WAL file size 5734704, number of live WAL files 2.
- 2017-07-11 14:05:31.359322 I | rook-ceph-mon2:
- 2017-07-11 14:05:31.362702 I | rook-ceph-mon2: 2017-07-11 14:05:31.360293 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:05:31.362757 I | rook-ceph-mon2: 2017-07-11 14:05:31.360329 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.360323) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:05:31.362776 I | rook-ceph-mon2:
- 2017-07-11 14:05:31.362788 I | rook-ceph-mon2: 2017-07-11 14:05:31.360334 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 22] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:05:31.362816 I | rook-ceph-mon2: 2017-07-11 14:05:31.360338 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 21 Base level 0, inputs: [37(3725KB)], [35(10MB)]
- 2017-07-11 14:05:31.362829 I | rook-ceph-mon2:
- 2017-07-11 14:05:31.362841 I | rook-ceph-mon2: 2017-07-11 14:05:31.360353 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931360340, "job": 22, "event": "compaction_started", "files_L0": [37], "files_L1": [35], "score": -1, "input_data_size": 14835409}
- 2017-07-11 14:05:31.518985 I | rook-ceph-mon2: 2017-07-11 14:05:31.518935 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 22] Generated table #38: 1887 keys, 12961212 bytes
- 2017-07-11 14:05:31.519178 I | rook-ceph-mon2: 2017-07-11 14:05:31.519087 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931519077, "cf_name": "default", "job": 22, "event": "table_file_creation", "file_number": 38, "file_size": 12961212, "table_properties": {"data_size": 12916791, "index_size": 43602, "filter_size": 0, "raw_key_size": 35393, "raw_average_key_size": 18, "raw_value_size": 12860092, "raw_average_value_size": 6815, "num_data_blocks": 1353, "num_entries": 1887, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:05:31.581838 I | rook-ceph-mon2: 2017-07-11 14:05:31.581781 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 22] Compacted 1@0 + 1@1 files to L1 => 12961212 bytes
- 2017-07-11 14:05:31.664523 I | rook-ceph-mon2: 2017-07-11 14:05:31.664473 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.660864) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 67.0 rd, 58.5 wr, level 1, files in(1, 1) out(1) MB in(3.6, 10.5) out(12.4), read-write-amplify(7.3) write-amplify(3.4) OK, records in: 2396, records dropped: 509
- 2017-07-11 14:05:31.664595 I | rook-ceph-mon2:
- 2017-07-11 14:05:31.664634 I | rook-ceph-mon2: 2017-07-11 14:05:31.664615 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:05:31.664413) EVENT_LOG_v1 {"time_micros": 1499781931660878, "job": 22, "event": "compaction_finished", "compaction_time_micros": 221408, "output_level": 1, "num_output_files": 1, "total_output_size": 12961212, "num_input_records": 2396, "num_output_records": 1887, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:05:31.665328 I | rook-ceph-mon2: 2017-07-11 14:05:31.665312 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931665309, "job": 22, "event": "table_file_deletion", "file_number": 37}
- 2017-07-11 14:05:31.672518 I | rook-ceph-mon2: 2017-07-11 14:05:31.672498 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781931672496, "job": 22, "event": "table_file_deletion", "file_number": 35}
- 2017-07-11 14:05:42.916676 I | rook-ceph-mon2: 2017-07-11 14:05:42.916636 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:05:42.916890 I | rook-ceph-mon2: 2017-07-11 14:05:42.916785 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/661886127' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:05:53.958319 I | rook-ceph-mon2: 2017-07-11 14:05:53.958281 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:05:53.958412 I | rook-ceph-mon2: 2017-07-11 14:05:53.958396 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3654740300' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:05:57.898709 I | rook-ceph-mon2: 2017-07-11 14:05:57.898416 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4820 MB, avail 94366 MB
- 2017-07-11 14:06:37.663597 I | rook-ceph-mon2: 2017-07-11 14:06:37.663487 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #39. Immutable memtables: 0.
- 2017-07-11 14:06:37.663688 I | rook-ceph-mon2:
- 2017-07-11 14:06:37.663707 I | rook-ceph-mon2: 2017-07-11 14:06:37.663528 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 23] Syncing log #36
- 2017-07-11 14:06:37.694159 I | rook-ceph-mon2: 2017-07-11 14:06:37.693212 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:06:37.663522) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:06:37.694233 I | rook-ceph-mon2: 2017-07-11 14:06:37.693223 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 23] Flushing memtable with next log file: 39
- 2017-07-11 14:06:37.694250 I | rook-ceph-mon2:
- 2017-07-11 14:06:37.694263 I | rook-ceph-mon2: 2017-07-11 14:06:37.693233 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781997693228, "job": 23, "event": "flush_started", "num_memtables": 1, "num_entries": 588, "num_deletes": 250, "memory_usage": 1094320}
- 2017-07-11 14:06:37.694275 I | rook-ceph-mon2: 2017-07-11 14:06:37.693235 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 23] Level-0 flush table #40: started
- 2017-07-11 14:06:37.786703 I | rook-ceph-mon2: 2017-07-11 14:06:37.786600 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781997786591, "cf_name": "default", "job": 23, "event": "table_file_creation", "file_number": 40, "file_size": 546989, "table_properties": {"data_size": 544226, "index_size": 1949, "filter_size": 0, "raw_key_size": 6561, "raw_average_key_size": 19, "raw_value_size": 538377, "raw_average_value_size": 1621, "num_data_blocks": 64, "num_entries": 332, "filter_policy_name": "", "kDeletedKeys": "250", "kMergeOperands": "0"}}
- 2017-07-11 14:06:37.786791 I | rook-ceph-mon2: 2017-07-11 14:06:37.786610 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 23] Level-0 flush table #40: 546989 bytes OK
- 2017-07-11 14:06:37.852624 I | rook-ceph-mon2: 2017-07-11 14:06:37.852326 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:06:37.819655) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #40 started
- 2017-07-11 14:06:37.852700 I | rook-ceph-mon2: 2017-07-11 14:06:37.852334 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:06:37.852274) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #40: memtable #1 done
- 2017-07-11 14:06:37.852719 I | rook-ceph-mon2: 2017-07-11 14:06:37.852336 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:06:37.852295) EVENT_LOG_v1 {"time_micros": 1499781997852289, "job": 23, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:06:37.852733 I | rook-ceph-mon2: 2017-07-11 14:06:37.852338 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:06:37.852311) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:06:37.852765 I | rook-ceph-mon2:
- 2017-07-11 14:06:37.852779 I | rook-ceph-mon2: 2017-07-11 14:06:37.852344 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 23] Try to delete WAL files size 1080866, prev total WAL file size 1087567, number of live WAL files 2.
- 2017-07-11 14:06:37.852790 I | rook-ceph-mon2:
- 2017-07-11 14:06:37.854396 I | rook-ceph-mon2: 2017-07-11 14:06:37.852810 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:06:37.854431 I | rook-ceph-mon2: 2017-07-11 14:06:37.852860 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:06:37.852854) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:06:37.854447 I | rook-ceph-mon2:
- 2017-07-11 14:06:37.854474 I | rook-ceph-mon2: 2017-07-11 14:06:37.852865 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 24] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:06:37.854488 I | rook-ceph-mon2: 2017-07-11 14:06:37.852869 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 23 Base level 0, inputs: [40(534KB)], [38(12MB)]
- 2017-07-11 14:06:37.854500 I | rook-ceph-mon2:
- 2017-07-11 14:06:37.854511 I | rook-ceph-mon2: 2017-07-11 14:06:37.852879 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781997852872, "job": 24, "event": "compaction_started", "files_L0": [40], "files_L1": [38], "score": -1, "input_data_size": 13508201}
- 2017-07-11 14:06:38.053013 I | rook-ceph-mon2: 2017-07-11 14:06:38.052963 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 24] Generated table #41: 1738 keys, 12030088 bytes
- 2017-07-11 14:06:38.053196 I | rook-ceph-mon2: 2017-07-11 14:06:38.053114 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998053104, "cf_name": "default", "job": 24, "event": "table_file_creation", "file_number": 41, "file_size": 12030088, "table_properties": {"data_size": 11991013, "index_size": 38256, "filter_size": 0, "raw_key_size": 32287, "raw_average_key_size": 18, "raw_value_size": 11940173, "raw_average_value_size": 6870, "num_data_blocks": 1193, "num_entries": 1738, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:06:38.107029 I | rook-ceph-mon2: 2017-07-11 14:06:38.107001 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 24] Compacted 1@0 + 1@1 files to L1 => 12030088 bytes
- 2017-07-11 14:06:38.137697 I | rook-ceph-mon2: 2017-07-11 14:06:38.137664 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.137601) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 53.2 rd, 47.3 wr, level 1, files in(1, 1) out(1) MB in(0.5, 12.4) out(11.5), read-write-amplify(46.7) write-amplify(22.0) OK, records in: 2219, records dropped: 481
- 2017-07-11 14:06:38.137746 I | rook-ceph-mon2:
- 2017-07-11 14:06:38.137782 I | rook-ceph-mon2: 2017-07-11 14:06:38.137765 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.137618) EVENT_LOG_v1 {"time_micros": 1499781998137611, "job": 24, "event": "compaction_finished", "compaction_time_micros": 254108, "output_level": 1, "num_output_files": 1, "total_output_size": 12030088, "num_input_records": 2219, "num_output_records": 1738, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:06:38.138042 I | rook-ceph-mon2: 2017-07-11 14:06:38.138029 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998138026, "job": 24, "event": "table_file_deletion", "file_number": 40}
- 2017-07-11 14:06:38.139591 I | rook-ceph-mon2: 2017-07-11 14:06:38.139577 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998139575, "job": 24, "event": "table_file_deletion", "file_number": 38}
- 2017-07-11 14:06:38.204087 I | rook-ceph-mon2: 2017-07-11 14:06:38.204023 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #42. Immutable memtables: 0.
- 2017-07-11 14:06:38.204131 I | rook-ceph-mon2:
- 2017-07-11 14:06:38.204147 I | rook-ceph-mon2: 2017-07-11 14:06:38.204047 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 25] Syncing log #39
- 2017-07-11 14:06:38.231981 I | rook-ceph-mon2: 2017-07-11 14:06:38.231733 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.204042) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:06:38.232023 I | rook-ceph-mon2: 2017-07-11 14:06:38.231741 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 25] Flushing memtable with next log file: 42
- 2017-07-11 14:06:38.232038 I | rook-ceph-mon2:
- 2017-07-11 14:06:38.232049 I | rook-ceph-mon2: 2017-07-11 14:06:38.231749 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998231745, "job": 25, "event": "flush_started", "num_memtables": 1, "num_entries": 7, "num_deletes": 0, "memory_usage": 22208}
- 2017-07-11 14:06:38.232059 I | rook-ceph-mon2: 2017-07-11 14:06:38.231751 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 25] Level-0 flush table #43: started
- 2017-07-11 14:06:38.263588 I | rook-ceph-mon2: 2017-07-11 14:06:38.263538 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998263530, "cf_name": "default", "job": 25, "event": "table_file_creation", "file_number": 43, "file_size": 14235, "table_properties": {"data_size": 13346, "index_size": 81, "filter_size": 0, "raw_key_size": 143, "raw_average_key_size": 23, "raw_value_size": 13164, "raw_average_value_size": 2194, "num_data_blocks": 3, "num_entries": 6, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:06:38.263636 I | rook-ceph-mon2: 2017-07-11 14:06:38.263547 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 25] Level-0 flush table #43: 14235 bytes OK
- 2017-07-11 14:06:38.374361 I | rook-ceph-mon2: 2017-07-11 14:06:38.374228 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.341456) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #43 started
- 2017-07-11 14:06:38.374402 I | rook-ceph-mon2: 2017-07-11 14:06:38.374235 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.374191) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #43: memtable #1 done
- 2017-07-11 14:06:38.374417 I | rook-ceph-mon2: 2017-07-11 14:06:38.374236 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.374203) EVENT_LOG_v1 {"time_micros": 1499781998374199, "job": 25, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:06:38.374443 I | rook-ceph-mon2: 2017-07-11 14:06:38.374238 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.374217) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:06:38.374457 I | rook-ceph-mon2:
- 2017-07-11 14:06:38.374468 I | rook-ceph-mon2: 2017-07-11 14:06:38.374242 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 25] Try to delete WAL files size 19939, prev total WAL file size 19939, number of live WAL files 2.
- 2017-07-11 14:06:38.374478 I | rook-ceph-mon2:
- 2017-07-11 14:06:38.374531 I | rook-ceph-mon2: 2017-07-11 14:06:38.374495 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:06:38.374585 I | rook-ceph-mon2: 2017-07-11 14:06:38.374569 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:06:38.374564) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:06:38.374631 I | rook-ceph-mon2:
- 2017-07-11 14:06:38.374680 I | rook-ceph-mon2: 2017-07-11 14:06:38.374651 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 26] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:06:38.374724 I | rook-ceph-mon2: 2017-07-11 14:06:38.374711 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 25 Base level 0, inputs: [43(13KB)], [41(11MB)]
- 2017-07-11 14:06:38.374737 I | rook-ceph-mon2:
- 2017-07-11 14:06:38.374822 I | rook-ceph-mon2: 2017-07-11 14:06:38.374807 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781998374798, "job": 26, "event": "compaction_started", "files_L0": [43], "files_L1": [41], "score": -1, "input_data_size": 12044323}
- 2017-07-11 14:06:39.435417 I | rook-ceph-mon2: 2017-07-11 14:06:39.435340 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 26] Generated table #44: 1740 keys, 12043355 bytes
- 2017-07-11 14:06:39.435612 I | rook-ceph-mon2: 2017-07-11 14:06:39.435531 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781999435521, "cf_name": "default", "job": 26, "event": "table_file_creation", "file_number": 44, "file_size": 12043355, "table_properties": {"data_size": 12004217, "index_size": 38319, "filter_size": 0, "raw_key_size": 32325, "raw_average_key_size": 18, "raw_value_size": 11953305, "raw_average_value_size": 6869, "num_data_blocks": 1195, "num_entries": 1740, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:06:39.534142 I | rook-ceph-mon2: 2017-07-11 14:06:39.534104 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 26] Compacted 1@0 + 1@1 files to L1 => 12043355 bytes
- 2017-07-11 14:06:39.589367 I | rook-ceph-mon2: 2017-07-11 14:06:39.589340 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:06:39.589262) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.04, MB/sec: 10.4 rd, 10.4 wr, level 1, files in(1, 1) out(1) MB in(0.0, 11.5) out(11.5), read-write-amplify(1692.1) write-amplify(846.0) OK, records in: 1744, records dropped: 4
- 2017-07-11 14:06:39.589425 I | rook-ceph-mon2:
- 2017-07-11 14:06:39.589461 I | rook-ceph-mon2: 2017-07-11 14:06:39.589444 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:06:39.589281) EVENT_LOG_v1 {"time_micros": 1499781999589273, "job": 26, "event": "compaction_finished", "compaction_time_micros": 1159131, "output_level": 1, "num_output_files": 1, "total_output_size": 12043355, "num_input_records": 1744, "num_output_records": 1740, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:06:39.589671 I | rook-ceph-mon2: 2017-07-11 14:06:39.589641 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781999589638, "job": 26, "event": "table_file_deletion", "file_number": 43}
- 2017-07-11 14:06:39.591187 I | rook-ceph-mon2: 2017-07-11 14:06:39.591173 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499781999591171, "job": 26, "event": "table_file_deletion", "file_number": 41}
- 2017-07-11 14:06:47.327647 I | rook-ceph-mon2: 2017-07-11 14:06:47.327610 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:06:47.327853 I | rook-ceph-mon2: 2017-07-11 14:06:47.327756 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1942250118' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:06:57.898991 I | rook-ceph-mon2: 2017-07-11 14:06:57.898730 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4819 MB, avail 94367 MB
- 2017-07-11 14:06:58.357528 I | rook-ceph-mon2: 2017-07-11 14:06:58.357490 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:06:58.357709 I | rook-ceph-mon2: 2017-07-11 14:06:58.357628 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/215310525' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:07:22.028900 I | rook-ceph-mon2: 2017-07-11 14:07:22.028865 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:07:22.029257 I | rook-ceph-mon2: 2017-07-11 14:07:22.029011 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4172071798' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:07:31.334522 I | rook-ceph-mon2: 2017-07-11 14:07:31.334481 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:07:31.334779 I | rook-ceph-mon2: 2017-07-11 14:07:31.334762 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3718070789' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:07:42.398637 I | rook-ceph-mon2: 2017-07-11 14:07:42.398590 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:07:42.398866 I | rook-ceph-mon2: 2017-07-11 14:07:42.398825 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3662225794' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:07:44.179750 I | rook-ceph-mon2: 2017-07-11 14:07:44.179714 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:07:44.179979 I | rook-ceph-mon2: 2017-07-11 14:07:44.179857 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/514945994' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:07:57.899310 I | rook-ceph-mon2: 2017-07-11 14:07:57.898945 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4819 MB, avail 94367 MB
- 2017-07-11 14:08:04.558116 I | rook-ceph-mon2: 2017-07-11 14:08:04.558069 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:08:04.558382 I | rook-ceph-mon2: 2017-07-11 14:08:04.558363 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2999023878' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:08:15.558994 I | rook-ceph-mon2: 2017-07-11 14:08:15.558947 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:08:15.559166 I | rook-ceph-mon2: 2017-07-11 14:08:15.559091 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4028842534' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:08:57.967370 I | rook-ceph-mon2: 2017-07-11 14:08:57.967114 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4819 MB, avail 94367 MB
- 2017-07-11 14:09:10.529779 I | rook-ceph-mon2: 2017-07-11 14:09:10.529741 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:09:10.529980 I | rook-ceph-mon2: 2017-07-11 14:09:10.529888 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1338055452' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:09:12.180051 I | rook-ceph-mon2: 2017-07-11 14:09:12.180013 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:09:12.180294 I | rook-ceph-mon2: 2017-07-11 14:09:12.180164 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2646401625' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:09:21.552104 I | rook-ceph-mon2: 2017-07-11 14:09:21.552054 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:09:21.552464 I | rook-ceph-mon2: 2017-07-11 14:09:21.552207 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2866084882' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:09:23.115595 I | rook-ceph-mon2: 2017-07-11 14:09:23.115554 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:09:23.115725 I | rook-ceph-mon2: 2017-07-11 14:09:23.115708 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/885394462' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:09:32.620883 I | rook-ceph-mon2: 2017-07-11 14:09:32.620845 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:09:32.621067 I | rook-ceph-mon2: 2017-07-11 14:09:32.620986 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1733917744' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:09:34.077068 I | rook-ceph-mon2: 2017-07-11 14:09:34.077028 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:09:34.077358 I | rook-ceph-mon2: 2017-07-11 14:09:34.077323 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3693073979' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:09:36.098589 I | rook-ceph-mon2: 2017-07-11 14:09:35.522281 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 496 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0783901s > max 0.05s
- 2017-07-11 14:09:36.098607 I | rook-ceph-mon2: 2017-07-11 14:09:35.531016 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 497 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.107634s > max 0.05s
- 2017-07-11 14:09:56.076002 I | rook-ceph-mon2: 2017-07-11 14:09:56.075943 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:09:56.076253 I | rook-ceph-mon2: 2017-07-11 14:09:56.076235 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1541279546' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:09:57.967825 I | rook-ceph-mon2: 2017-07-11 14:09:57.967557 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4819 MB, avail 94367 MB
- 2017-07-11 14:10:05.616920 I | rook-ceph-mon2: 2017-07-11 14:10:05.616852 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:10:05.616987 I | rook-ceph-mon2: 2017-07-11 14:10:05.616971 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3471600725' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:10:07.022912 I | rook-ceph-mon2: 2017-07-11 14:10:07.022873 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:10:07.023147 I | rook-ceph-mon2: 2017-07-11 14:10:07.023105 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3853422368' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:10:16.614086 I | rook-ceph-mon2: 2017-07-11 14:10:16.614039 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:10:16.614183 I | rook-ceph-mon2: 2017-07-11 14:10:16.614168 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3306936166' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:10:27.618362 I | rook-ceph-mon2: 2017-07-11 14:10:27.618324 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:10:27.618575 I | rook-ceph-mon2: 2017-07-11 14:10:27.618484 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4214688719' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:10:38.959611 I | rook-ceph-mon2: 2017-07-11 14:10:38.959572 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:10:38.959834 I | rook-ceph-mon2: 2017-07-11 14:10:38.959715 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2443652139' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:10:57.968099 I | rook-ceph-mon2: 2017-07-11 14:10:57.967839 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4819 MB, avail 94367 MB
- 2017-07-11 14:11:00.790271 I | rook-ceph-mon2: 2017-07-11 14:11:00.790235 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:11:00.790527 I | rook-ceph-mon2: 2017-07-11 14:11:00.790368 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3814796544' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:11:02.634487 I | rook-ceph-mon2: 2017-07-11 14:11:02.634448 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:11:02.634700 I | rook-ceph-mon2: 2017-07-11 14:11:02.634593 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1560816269' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:11:35.759311 I | rook-ceph-mon2: 2017-07-11 14:11:35.759273 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:11:35.759518 I | rook-ceph-mon2: 2017-07-11 14:11:35.759432 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/689652400' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:11:36.833433 I | rook-ceph-mon2: 2017-07-11 14:11:36.832961 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #45. Immutable memtables: 0.
- 2017-07-11 14:11:36.833517 I | rook-ceph-mon2:
- 2017-07-11 14:11:36.833545 I | rook-ceph-mon2: 2017-07-11 14:11:36.832997 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 27] Syncing log #42
- 2017-07-11 14:11:36.885125 I | rook-ceph-mon2: 2017-07-11 14:11:36.864809 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:11:36.832992) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:11:36.885211 I | rook-ceph-mon2: 2017-07-11 14:11:36.864822 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 27] Flushing memtable with next log file: 45
- 2017-07-11 14:11:36.885229 I | rook-ceph-mon2:
- 2017-07-11 14:11:36.885249 I | rook-ceph-mon2: 2017-07-11 14:11:36.864833 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782296864829, "job": 27, "event": "flush_started", "num_memtables": 1, "num_entries": 1799, "num_deletes": 251, "memory_usage": 4983456}
- 2017-07-11 14:11:36.885285 I | rook-ceph-mon2: 2017-07-11 14:11:36.864835 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 27] Level-0 flush table #46: started
- 2017-07-11 14:11:36.928081 I | rook-ceph-mon2: 2017-07-11 14:11:36.928033 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782296928023, "cf_name": "default", "job": 27, "event": "table_file_creation", "file_number": 46, "file_size": 3287836, "table_properties": {"data_size": 3274049, "index_size": 12969, "filter_size": 0, "raw_key_size": 13445, "raw_average_key_size": 18, "raw_value_size": 3255001, "raw_average_value_size": 4495, "num_data_blocks": 414, "num_entries": 724, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:11:36.928208 I | rook-ceph-mon2: 2017-07-11 14:11:36.928179 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 27] Level-0 flush table #46: 3287836 bytes OK
- 2017-07-11 14:11:36.993399 I | rook-ceph-mon2: 2017-07-11 14:11:36.993368 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:11:36.961120) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #46 started
- 2017-07-11 14:11:36.993468 I | rook-ceph-mon2: 2017-07-11 14:11:36.993452 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:11:36.993328) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #46: memtable #1 done
- 2017-07-11 14:11:36.993504 I | rook-ceph-mon2: 2017-07-11 14:11:36.993489 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:11:36.993342) EVENT_LOG_v1 {"time_micros": 1499782296993337, "job": 27, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:11:36.993559 I | rook-ceph-mon2: 2017-07-11 14:11:36.993544 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:11:36.993357) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:11:36.993583 I | rook-ceph-mon2:
- 2017-07-11 14:11:36.993630 I | rook-ceph-mon2: 2017-07-11 14:11:36.993616 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 27] Try to delete WAL files size 4943070, prev total WAL file size 4943070, number of live WAL files 2.
- 2017-07-11 14:11:36.993646 I | rook-ceph-mon2:
- 2017-07-11 14:11:36.998288 I | rook-ceph-mon2: 2017-07-11 14:11:36.994542 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:11:36.998357 I | rook-ceph-mon2: 2017-07-11 14:11:36.994696 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:11:36.998377 I | rook-ceph-mon2: 2017-07-11 14:11:36.994700 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:11:36.998391 I | rook-ceph-mon2: ** DB Stats **
- 2017-07-11 14:11:36.998423 I | rook-ceph-mon2: Uptime(secs): 2859.7 total, 804.1 interval
- 2017-07-11 14:11:36.998436 I | rook-ceph-mon2: Cumulative writes: 4146 writes, 18K keys, 4146 commit groups, 1.0 writes per commit group, ingest: 0.05 GB, 0.02 MB/s
- 2017-07-11 14:11:36.998447 I | rook-ceph-mon2: Cumulative WAL: 4146 writes, 4146 syncs, 1.00 writes per sync, written: 0.05 GB, 0.02 MB/s
- 2017-07-11 14:11:36.998459 I | rook-ceph-mon2: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:11:36.998471 I | rook-ceph-mon2: Interval writes: 1040 writes, 4879 keys, 1040 commit groups, 1.0 writes per commit group, ingest: 11.60 MB, 0.01 MB/s
- 2017-07-11 14:11:36.998498 I | rook-ceph-mon2: Interval WAL: 1040 writes, 1040 syncs, 1.00 writes per sync, written: 0.01 MB, 0.01 MB/s
- 2017-07-11 14:11:36.998510 I | rook-ceph-mon2: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:11:36.998531 I | rook-ceph-mon2:
- 2017-07-11 14:11:36.998542 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 14:11:36.998565 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:11:36.998578 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:11:36.998591 I | rook-ceph-mon2: L0 1/1 3.14 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 13.2 2 14 0.166 0 0
- 2017-07-11 14:11:36.998603 I | rook-ceph-mon2: L1 1/1 11.49 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 5.0 43.4 38.8 4 12 0.293 23K 4397
- 2017-07-11 14:11:36.998615 I | rook-ceph-mon2: Sum 2/2 14.62 MB 0.0 0.1 0.0 0.1 0.2 0.0 0.0 5.5 26.1 28.6 6 26 0.225 23K 4397
- 2017-07-11 14:11:36.998626 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 8.7 22.7 23.5 3 10 0.279 10K 1825
- 2017-07-11 14:11:36.998663 I | rook-ceph-mon2: Uptime(secs): 2859.7 total, 2859.7 interval
- 2017-07-11 14:11:36.998674 I | rook-ceph-mon2: Flush(GB): cumulative 0.030, interval 0.007
- 2017-07-11 14:11:36.998684 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:11:36.998695 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:11:36.998736 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:11:36.998760 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:11:36.998771 I | rook-ceph-mon2: Cumulative compaction: 0.16 GB write, 0.06 MB/s write, 0.15 GB read, 0.05 MB/s read, 5.8 seconds
- 2017-07-11 14:11:36.998783 I | rook-ceph-mon2: Interval compaction: 0.06 GB write, 0.02 MB/s write, 0.06 GB read, 0.02 MB/s read, 2.8 seconds
- 2017-07-11 14:11:36.998794 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:11:36.998819 I | rook-ceph-mon2:
- 2017-07-11 14:11:36.998832 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:11:36.998844 I | rook-ceph-mon2:
- 2017-07-11 14:11:36.998855 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 14:11:36.998866 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:11:36.998878 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:11:36.998904 I | rook-ceph-mon2: L0 1/1 3.14 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 13.2 2 14 0.166 0 0
- 2017-07-11 14:11:36.998916 I | rook-ceph-mon2: L1 1/1 11.49 MB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 5.0 43.4 38.8 4 12 0.293 23K 4397
- 2017-07-11 14:11:36.998927 I | rook-ceph-mon2: Sum 2/2 14.62 MB 0.0 0.1 0.0 0.1 0.2 0.0 0.0 5.5 26.1 28.6 6 26 0.225 23K 4397
- 2017-07-11 14:11:36.998939 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:11:36.998950 I | rook-ceph-mon2: Uptime(secs): 2859.7 total, 2859.7 interval
- 2017-07-11 14:11:36.998974 I | rook-ceph-mon2: Flush(GB): cumulative 0.030, interval 0.000
- 2017-07-11 14:11:36.998987 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:11:36.999008 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:11:36.999019 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:11:36.999051 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:11:36.999062 I | rook-ceph-mon2: Cumulative compaction: 0.16 GB write, 0.06 MB/s write, 0.15 GB read, 0.05 MB/s read, 5.8 seconds
- 2017-07-11 14:11:36.999072 I | rook-ceph-mon2: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:11:36.999082 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:11:36.999092 I | rook-ceph-mon2:
- 2017-07-11 14:11:36.999102 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:11:36.999111 I | rook-ceph-mon2:
- 2017-07-11 14:11:36.999132 I | rook-ceph-mon2: 2017-07-11 14:11:36.994715 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:11:36.994710) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:11:36.999143 I | rook-ceph-mon2:
- 2017-07-11 14:11:36.999153 I | rook-ceph-mon2: 2017-07-11 14:11:36.994720 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 28] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:11:36.999164 I | rook-ceph-mon2: 2017-07-11 14:11:36.994723 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 27 Base level 0, inputs: [46(3210KB)], [44(11MB)]
- 2017-07-11 14:11:36.999173 I | rook-ceph-mon2:
- 2017-07-11 14:11:36.999183 I | rook-ceph-mon2: 2017-07-11 14:11:36.994733 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782296994725, "job": 28, "event": "compaction_started", "files_L0": [46], "files_L1": [44], "score": -1, "input_data_size": 15331191}
- 2017-07-11 14:11:37.103966 I | rook-ceph-mon2: 2017-07-11 14:11:37.103915 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 28] Generated table #47: 1955 keys, 13445771 bytes
- 2017-07-11 14:11:37.104148 I | rook-ceph-mon2: 2017-07-11 14:11:37.104068 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782297104058, "cf_name": "default", "job": 28, "event": "table_file_creation", "file_number": 47, "file_size": 13445771, "table_properties": {"data_size": 13401191, "index_size": 43761, "filter_size": 0, "raw_key_size": 36549, "raw_average_key_size": 18, "raw_value_size": 13343465, "raw_average_value_size": 6825, "num_data_blocks": 1356, "num_entries": 1955, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:11:37.150473 I | rook-ceph-mon2: 2017-07-11 14:11:37.150443 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 28] Compacted 1@0 + 1@1 files to L1 => 13445771 bytes
- 2017-07-11 14:11:37.183677 I | rook-ceph-mon2: 2017-07-11 14:11:37.183644 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.183575) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 98.5 rd, 86.4 wr, level 1, files in(1, 1) out(1) MB in(3.1, 11.5) out(12.8), read-write-amplify(8.8) write-amplify(4.1) OK, records in: 2464, records dropped: 509
- 2017-07-11 14:11:37.183725 I | rook-ceph-mon2:
- 2017-07-11 14:11:37.183830 I | rook-ceph-mon2: 2017-07-11 14:11:37.183744 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:11:37.183595) EVENT_LOG_v1 {"time_micros": 1499782297183586, "job": 28, "event": "compaction_finished", "compaction_time_micros": 155696, "output_level": 1, "num_output_files": 1, "total_output_size": 13445771, "num_input_records": 2464, "num_output_records": 1955, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:11:37.184544 I | rook-ceph-mon2: 2017-07-11 14:11:37.184527 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782297184524, "job": 28, "event": "table_file_deletion", "file_number": 46}
- 2017-07-11 14:11:37.186027 I | rook-ceph-mon2: 2017-07-11 14:11:37.186013 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782297186011, "job": 28, "event": "table_file_deletion", "file_number": 44}
- 2017-07-11 14:11:44.822377 I | rook-ceph-mon2: 2017-07-11 14:11:44.822303 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:11:44.822474 I | rook-ceph-mon2: 2017-07-11 14:11:44.822459 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1534737241' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:11:57.968407 I | rook-ceph-mon2: 2017-07-11 14:11:57.968160 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4821 MB, avail 94366 MB
- 2017-07-11 14:12:06.960506 I | rook-ceph-mon2: 2017-07-11 14:12:06.960466 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:12:06.960706 I | rook-ceph-mon2: 2017-07-11 14:12:06.960610 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4276635253' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:12:08.959575 I | rook-ceph-mon2: 2017-07-11 14:12:08.959536 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:12:08.959933 I | rook-ceph-mon2: 2017-07-11 14:12:08.959870 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4280345854' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:12:30.860980 I | rook-ceph-mon2: 2017-07-11 14:12:30.860931 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:12:30.861263 I | rook-ceph-mon2: 2017-07-11 14:12:30.861245 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1959940746' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:12:57.969185 I | rook-ceph-mon2: 2017-07-11 14:12:57.968883 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4821 MB, avail 94365 MB
- 2017-07-11 14:13:02.320938 I | rook-ceph-mon2: 2017-07-11 14:13:02.320900 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:13:02.321136 I | rook-ceph-mon2: 2017-07-11 14:13:02.321040 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3715494403' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:13:35.287382 I | rook-ceph-mon2: 2017-07-11 14:13:35.287330 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:13:35.287656 I | rook-ceph-mon2: 2017-07-11 14:13:35.287639 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2081513005' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:13:37.138694 I | rook-ceph-mon2: 2017-07-11 14:13:37.138657 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:13:37.138930 I | rook-ceph-mon2: 2017-07-11 14:13:37.138822 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1111392999' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:13:46.287909 I | rook-ceph-mon2: 2017-07-11 14:13:46.287858 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:13:46.287986 I | rook-ceph-mon2: 2017-07-11 14:13:46.287971 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/26218474' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:13:57.298776 I | rook-ceph-mon2: 2017-07-11 14:13:57.298725 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:13:57.299015 I | rook-ceph-mon2: 2017-07-11 14:13:57.298984 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3604283413' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:13:57.969494 I | rook-ceph-mon2: 2017-07-11 14:13:57.969143 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4821 MB, avail 94365 MB
- 2017-07-11 14:13:59.349419 I | rook-ceph-mon2: 2017-07-11 14:13:59.349374 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:13:59.349590 I | rook-ceph-mon2: 2017-07-11 14:13:59.349518 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/757635110' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:14:25.459635 I | rook-ceph-mon2: 2017-07-11 14:14:25.459272 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:14:25.459955 I | rook-ceph-mon2: 2017-07-11 14:14:25.459290 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4292540088' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:14:29.454485 I | rook-ceph-mon2: 2017-07-11 14:14:29.454401 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:14:29.454598 I | rook-ceph-mon2: 2017-07-11 14:14:29.454582 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2983561022' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:14:35.643986 I | rook-ceph-mon2: 2017-07-11 14:14:35.532643 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 530 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0690982s > max 0.05s
- 2017-07-11 14:14:35.644073 I | rook-ceph-mon2: 2017-07-11 14:14:35.539479 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 531 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.127837s > max 0.05s
- 2017-07-11 14:14:41.500236 I | rook-ceph-mon2: 2017-07-11 14:14:41.500196 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:14:41.500486 I | rook-ceph-mon2: 2017-07-11 14:14:41.500456 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3963674333' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:14:57.969811 I | rook-ceph-mon2: 2017-07-11 14:14:57.969545 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4821 MB, avail 94365 MB
- 2017-07-11 14:15:02.838148 I | rook-ceph-mon2: 2017-07-11 14:15:02.838068 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #48. Immutable memtables: 0.
- 2017-07-11 14:15:02.838165 I | rook-ceph-mon2:
- 2017-07-11 14:15:02.838221 I | rook-ceph-mon2: 2017-07-11 14:15:02.838106 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 29] Syncing log #45
- 2017-07-11 14:15:02.872236 I | rook-ceph-mon2: 2017-07-11 14:15:02.871172 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:15:02.838101) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:15:02.872281 I | rook-ceph-mon2: 2017-07-11 14:15:02.871180 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 29] Flushing memtable with next log file: 48
- 2017-07-11 14:15:02.872297 I | rook-ceph-mon2:
- 2017-07-11 14:15:02.872309 I | rook-ceph-mon2: 2017-07-11 14:15:02.871190 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782502871184, "job": 29, "event": "flush_started", "num_memtables": 1, "num_entries": 1359, "num_deletes": 252, "memory_usage": 3570696}
- 2017-07-11 14:15:02.872320 I | rook-ceph-mon2: 2017-07-11 14:15:02.871192 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 29] Level-0 flush table #49: started
- 2017-07-11 14:15:02.931660 I | rook-ceph-mon2: 2017-07-11 14:15:02.931611 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782502931601, "cf_name": "default", "job": 29, "event": "table_file_creation", "file_number": 49, "file_size": 1724021, "table_properties": {"data_size": 1717164, "index_size": 6042, "filter_size": 0, "raw_key_size": 9566, "raw_average_key_size": 19, "raw_value_size": 1706109, "raw_average_value_size": 3432, "num_data_blocks": 198, "num_entries": 497, "filter_policy_name": "", "kDeletedKeys": "252", "kMergeOperands": "0"}}
- 2017-07-11 14:15:02.931764 I | rook-ceph-mon2: 2017-07-11 14:15:02.931746 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 29] Level-0 flush table #49: 1724021 bytes OK
- 2017-07-11 14:15:02.995836 I | rook-ceph-mon2: 2017-07-11 14:15:02.995812 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:15:02.963764) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #49 started
- 2017-07-11 14:15:02.995894 I | rook-ceph-mon2: 2017-07-11 14:15:02.995879 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:15:02.995766) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #49: memtable #1 done
- 2017-07-11 14:15:02.995924 I | rook-ceph-mon2: 2017-07-11 14:15:02.995912 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:15:02.995777) EVENT_LOG_v1 {"time_micros": 1499782502995773, "job": 29, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:15:02.995968 I | rook-ceph-mon2: 2017-07-11 14:15:02.995955 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:15:02.995803) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:15:02.995983 I | rook-ceph-mon2:
- 2017-07-11 14:15:02.996023 I | rook-ceph-mon2: 2017-07-11 14:15:02.995999 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 29] Try to delete WAL files size 3542711, prev total WAL file size 3542711, number of live WAL files 2.
- 2017-07-11 14:15:02.996038 I | rook-ceph-mon2:
- 2017-07-11 14:15:03.000225 I | rook-ceph-mon2: 2017-07-11 14:15:02.996719 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:15:03.000268 I | rook-ceph-mon2: 2017-07-11 14:15:02.996754 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:15:02.996749) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:15:03.000285 I | rook-ceph-mon2:
- 2017-07-11 14:15:03.000297 I | rook-ceph-mon2: 2017-07-11 14:15:02.996760 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 30] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:15:03.000309 I | rook-ceph-mon2: 2017-07-11 14:15:02.996764 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 29 Base level 0, inputs: [49(1683KB)], [47(12MB)]
- 2017-07-11 14:15:03.000335 I | rook-ceph-mon2:
- 2017-07-11 14:15:03.000348 I | rook-ceph-mon2: 2017-07-11 14:15:02.996773 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782502996766, "job": 30, "event": "compaction_started", "files_L0": [49], "files_L1": [47], "score": -1, "input_data_size": 15169792}
- 2017-07-11 14:15:03.330120 I | rook-ceph-mon2: 2017-07-11 14:15:03.330070 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 30] Generated table #50: 2037 keys, 14139152 bytes
- 2017-07-11 14:15:03.330238 I | rook-ceph-mon2: 2017-07-11 14:15:03.330212 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782503330202, "cf_name": "default", "job": 30, "event": "table_file_creation", "file_number": 50, "file_size": 14139152, "table_properties": {"data_size": 14093480, "index_size": 44853, "filter_size": 0, "raw_key_size": 37768, "raw_average_key_size": 18, "raw_value_size": 14033958, "raw_average_value_size": 6889, "num_data_blocks": 1397, "num_entries": 2037, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:15:03.390708 I | rook-ceph-mon2: 2017-07-11 14:15:03.390654 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 30] Compacted 1@0 + 1@1 files to L1 => 14139152 bytes
- 2017-07-11 14:15:03.424431 I | rook-ceph-mon2: 2017-07-11 14:15:03.424348 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.424257) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 38.5 rd, 35.9 wr, level 1, files in(1, 1) out(1) MB in(1.6, 12.8) out(13.5), read-write-amplify(17.0) write-amplify(8.2) OK, records in: 2452, records dropped: 415
- 2017-07-11 14:15:03.424530 I | rook-ceph-mon2:
- 2017-07-11 14:15:03.424566 I | rook-ceph-mon2: 2017-07-11 14:15:03.424550 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:15:03.424284) EVENT_LOG_v1 {"time_micros": 1499782503424274, "job": 30, "event": "compaction_finished", "compaction_time_micros": 393857, "output_level": 1, "num_output_files": 1, "total_output_size": 14139152, "num_input_records": 2452, "num_output_records": 2037, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:15:03.425033 I | rook-ceph-mon2: 2017-07-11 14:15:03.425018 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782503425016, "job": 30, "event": "table_file_deletion", "file_number": 49}
- 2017-07-11 14:15:03.426686 I | rook-ceph-mon2: 2017-07-11 14:15:03.426671 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782503426669, "job": 30, "event": "table_file_deletion", "file_number": 47}
- 2017-07-11 14:15:03.426755 I | rook-ceph-mon2: 2017-07-11 14:15:03.426740 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:15:17.475804 I | rook-ceph-mon2: 2017-07-11 14:15:17.475746 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:15:17.476059 I | rook-ceph-mon2: 2017-07-11 14:15:17.476042 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3063780269' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:15:50.770948 I | rook-ceph-mon2: 2017-07-11 14:15:50.770920 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:15:50.771050 I | rook-ceph-mon2: 2017-07-11 14:15:50.771035 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2458967165' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:15:57.978991 I | rook-ceph-mon2: 2017-07-11 14:15:57.978872 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4910 MB, avail 94276 MB
- 2017-07-11 14:15:59.884903 I | rook-ceph-mon2: 2017-07-11 14:15:59.884870 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:15:59.885112 I | rook-ceph-mon2: 2017-07-11 14:15:59.885011 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1924318511' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:16:00.052661 I | rook-ceph-mon2: 2017-07-11 14:16:00.052628 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:16:00.059614 I | rook-ceph-mon2: 2017-07-11 14:16:00.053349 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/659159429' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:16:00.284917 I | rook-ceph-mon2: 2017-07-11 14:16:00.284883 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:00.285176 I | rook-ceph-mon2: 2017-07-11 14:16:00.285148 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/611638498' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:01.567057 I | rook-ceph-mon2: 2017-07-11 14:16:01.567004 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:16:01.567278 I | rook-ceph-mon2: 2017-07-11 14:16:01.567259 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2308072772' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:16:05.679875 I | rook-ceph-mon2: 2017-07-11 14:16:05.679600 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:05.679954 I | rook-ceph-mon2: 2017-07-11 14:16:05.679618 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1613140712' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:07.554077 I | rook-ceph-mon2: 2017-07-11 14:16:07.554038 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:07.554279 I | rook-ceph-mon2: 2017-07-11 14:16:07.554184 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1427219258' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:09.583843 I | rook-ceph-mon2: 2017-07-11 14:16:09.583811 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:09.584057 I | rook-ceph-mon2: 2017-07-11 14:16:09.583954 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3845649776' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:11.235384 I | rook-ceph-mon2: 2017-07-11 14:16:11.235349 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:16:11.235606 I | rook-ceph-mon2: 2017-07-11 14:16:11.235576 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3834247889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:16:12.240379 I | rook-ceph-mon2: 2017-07-11 14:16:12.240343 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:12.240590 I | rook-ceph-mon2: 2017-07-11 14:16:12.240480 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/81668606' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:14.627044 I | rook-ceph-mon2: 2017-07-11 14:16:14.619557 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:14.629651 I | rook-ceph-mon2: 2017-07-11 14:16:14.627348 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2466190500' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:15.252330 I | rook-ceph-mon2: 2017-07-11 14:16:15.252168 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:16:15.252449 I | rook-ceph-mon2: 2017-07-11 14:16:15.252185 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3144809960' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:16:16.889052 I | rook-ceph-mon2: 2017-07-11 14:16:16.889018 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:16:16.889240 I | rook-ceph-mon2: 2017-07-11 14:16:16.889154 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3356948214' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:16:17.783168 I | rook-ceph-mon2: 2017-07-11 14:16:17.783133 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:17.783357 I | rook-ceph-mon2: 2017-07-11 14:16:17.783273 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1632456395' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:19.594546 I | rook-ceph-mon2: 2017-07-11 14:16:19.594511 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:19.594746 I | rook-ceph-mon2: 2017-07-11 14:16:19.594665 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3447353137' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:24.088477 I | rook-ceph-mon2: 2017-07-11 14:16:24.088442 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:24.088704 I | rook-ceph-mon2: 2017-07-11 14:16:24.088584 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3746995344' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:24.570748 I | rook-ceph-mon2: 2017-07-11 14:16:24.570689 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:24.570958 I | rook-ceph-mon2: 2017-07-11 14:16:24.570853 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3310472764' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:25.070315 I | rook-ceph-mon2: 2017-07-11 14:16:25.070283 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:16:25.070530 I | rook-ceph-mon2: 2017-07-11 14:16:25.070417 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1993740152' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:16:27.103726 I | rook-ceph-mon2: 2017-07-11 14:16:27.103692 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:16:27.103946 I | rook-ceph-mon2: 2017-07-11 14:16:27.103915 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/920402673' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:16:28.945092 I | rook-ceph-mon2: 2017-07-11 14:16:28.945058 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:28.945320 I | rook-ceph-mon2: 2017-07-11 14:16:28.945302 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3113370946' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:29.891368 I | rook-ceph-mon2: 2017-07-11 14:16:29.891333 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:16:29.891561 I | rook-ceph-mon2: 2017-07-11 14:16:29.891474 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3751605074' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:16:31.259567 I | rook-ceph-mon2: 2017-07-11 14:16:31.259317 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:16:31.259644 I | rook-ceph-mon2: 2017-07-11 14:16:31.259345 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2192183747' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:16:32.644040 I | rook-ceph-mon2: 2017-07-11 14:16:32.643996 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:32.644260 I | rook-ceph-mon2: 2017-07-11 14:16:32.644141 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1460868831' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:33.885425 I | rook-ceph-mon2: 2017-07-11 14:16:33.885391 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:33.885609 I | rook-ceph-mon2: 2017-07-11 14:16:33.885528 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1196605666' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:34.424489 I | rook-ceph-mon2: 2017-07-11 14:16:34.424456 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:34.424730 I | rook-ceph-mon2: 2017-07-11 14:16:34.424593 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1342522069' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:35.757411 I | rook-ceph-mon2: 2017-07-11 14:16:35.757379 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:35.757517 I | rook-ceph-mon2: 2017-07-11 14:16:35.757503 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1832254946' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:36.768797 I | rook-ceph-mon2: 2017-07-11 14:16:36.768762 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:16:36.768993 I | rook-ceph-mon2: 2017-07-11 14:16:36.768918 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2334080917' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:16:37.731479 I | rook-ceph-mon2: 2017-07-11 14:16:37.731442 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:37.731692 I | rook-ceph-mon2: 2017-07-11 14:16:37.731586 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/79827274' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:38.801878 I | rook-ceph-mon2: 2017-07-11 14:16:38.801842 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:38.802133 I | rook-ceph-mon2: 2017-07-11 14:16:38.802087 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3353035807' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:39.265811 I | rook-ceph-mon2: 2017-07-11 14:16:39.265777 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:39.266041 I | rook-ceph-mon2: 2017-07-11 14:16:39.266024 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4265110377' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:40.146234 I | rook-ceph-mon2: 2017-07-11 14:16:40.146202 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:40.146397 I | rook-ceph-mon2: 2017-07-11 14:16:40.146327 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4116423753' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:42.021309 I | rook-ceph-mon2: 2017-07-11 14:16:42.021250 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:42.021880 I | rook-ceph-mon2: 2017-07-11 14:16:42.021800 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4260194104' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:43.767926 I | rook-ceph-mon2: 2017-07-11 14:16:43.767891 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:43.768006 I | rook-ceph-mon2: 2017-07-11 14:16:43.767989 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4101911819' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:44.232657 I | rook-ceph-mon2: 2017-07-11 14:16:44.232589 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:44.238490 I | rook-ceph-mon2: 2017-07-11 14:16:44.238454 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3332173824' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:44.684081 I | rook-ceph-mon2: 2017-07-11 14:16:44.684048 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:16:44.684276 I | rook-ceph-mon2: 2017-07-11 14:16:44.684259 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1674874456' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:16:47.063027 I | rook-ceph-mon2: 2017-07-11 14:16:47.062997 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:47.063134 I | rook-ceph-mon2: 2017-07-11 14:16:47.063119 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3534394660' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:47.613040 I | rook-ceph-mon2: 2017-07-11 14:16:47.612937 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #51. Immutable memtables: 0.
- 2017-07-11 14:16:47.613124 I | rook-ceph-mon2:
- 2017-07-11 14:16:47.613144 I | rook-ceph-mon2: 2017-07-11 14:16:47.612985 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 31] Syncing log #48
- 2017-07-11 14:16:47.647213 I | rook-ceph-mon2: 2017-07-11 14:16:47.645082 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:16:47.612976) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:16:47.647272 I | rook-ceph-mon2: 2017-07-11 14:16:47.645093 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 31] Flushing memtable with next log file: 51
- 2017-07-11 14:16:47.647289 I | rook-ceph-mon2:
- 2017-07-11 14:16:47.647302 I | rook-ceph-mon2: 2017-07-11 14:16:47.645104 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782607645099, "job": 31, "event": "flush_started", "num_memtables": 1, "num_entries": 1089, "num_deletes": 251, "memory_usage": 2949040}
- 2017-07-11 14:16:47.647313 I | rook-ceph-mon2: 2017-07-11 14:16:47.645106 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 31] Level-0 flush table #52: started
- 2017-07-11 14:16:47.693146 I | rook-ceph-mon2: 2017-07-11 14:16:47.693113 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782607693104, "cf_name": "default", "job": 31, "event": "table_file_creation", "file_number": 52, "file_size": 1945599, "table_properties": {"data_size": 1938092, "index_size": 6692, "filter_size": 0, "raw_key_size": 9557, "raw_average_key_size": 18, "raw_value_size": 1926293, "raw_average_value_size": 3711, "num_data_blocks": 216, "num_entries": 519, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:16:47.693220 I | rook-ceph-mon2: 2017-07-11 14:16:47.693203 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 31] Level-0 flush table #52: 1945599 bytes OK
- 2017-07-11 14:16:47.757314 I | rook-ceph-mon2: 2017-07-11 14:16:47.757251 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:16:47.725272) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #52 started
- 2017-07-11 14:16:47.757532 I | rook-ceph-mon2: 2017-07-11 14:16:47.757430 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:16:47.757168) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #52: memtable #1 done
- 2017-07-11 14:16:47.757614 I | rook-ceph-mon2: 2017-07-11 14:16:47.757598 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:16:47.757194) EVENT_LOG_v1 {"time_micros": 1499782607757185, "job": 31, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:16:47.757660 I | rook-ceph-mon2: 2017-07-11 14:16:47.757646 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:16:47.757217) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:16:47.757675 I | rook-ceph-mon2:
- 2017-07-11 14:16:47.757724 I | rook-ceph-mon2: 2017-07-11 14:16:47.757695 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 31] Try to delete WAL files size 2925520, prev total WAL file size 2925520, number of live WAL files 2.
- 2017-07-11 14:16:47.757751 I | rook-ceph-mon2:
- 2017-07-11 14:16:47.758546 I | rook-ceph-mon2: 2017-07-11 14:16:47.758318 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:16:47.758597 I | rook-ceph-mon2: 2017-07-11 14:16:47.758360 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:16:47.758354) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:16:47.758614 I | rook-ceph-mon2:
- 2017-07-11 14:16:47.758625 I | rook-ceph-mon2: 2017-07-11 14:16:47.758366 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 32] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:16:47.758657 I | rook-ceph-mon2: 2017-07-11 14:16:47.758370 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 31 Base level 0, inputs: [52(1899KB)], [50(13MB)]
- 2017-07-11 14:16:47.758671 I | rook-ceph-mon2:
- 2017-07-11 14:16:47.758682 I | rook-ceph-mon2: 2017-07-11 14:16:47.758381 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782607758373, "job": 32, "event": "compaction_started", "files_L0": [52], "files_L1": [50], "score": -1, "input_data_size": 16084751}
- 2017-07-11 14:16:48.913739 I | rook-ceph-mon2: 2017-07-11 14:16:48.913703 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:48.913990 I | rook-ceph-mon2: 2017-07-11 14:16:48.913972 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1029386178' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:49.036903 I | rook-ceph-mon2: 2017-07-11 14:16:49.036857 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 32] Generated table #53: 2047 keys, 14156370 bytes
- 2017-07-11 14:16:49.037169 I | rook-ceph-mon2: 2017-07-11 14:16:49.037148 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782609037139, "cf_name": "default", "job": 32, "event": "table_file_creation", "file_number": 53, "file_size": 14156370, "table_properties": {"data_size": 14111560, "index_size": 43991, "filter_size": 0, "raw_key_size": 38104, "raw_average_key_size": 18, "raw_value_size": 14052451, "raw_average_value_size": 6864, "num_data_blocks": 1361, "num_entries": 2047, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:16:49.092411 I | rook-ceph-mon2: 2017-07-11 14:16:49.092311 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 32] Compacted 1@0 + 1@1 files to L1 => 14156370 bytes
- 2017-07-11 14:16:49.111201 I | rook-ceph-mon2: 2017-07-11 14:16:49.111027 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:16:49.110940) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 12.1 rd, 10.6 wr, level 1, files in(1, 1) out(1) MB in(1.9, 13.5) out(13.5), read-write-amplify(15.5) write-amplify(7.3) OK, records in: 2556, records dropped: 509
- 2017-07-11 14:16:49.111280 I | rook-ceph-mon2:
- 2017-07-11 14:16:49.111297 I | rook-ceph-mon2: 2017-07-11 14:16:49.111034 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:16:49.110965) EVENT_LOG_v1 {"time_micros": 1499782609110956, "job": 32, "event": "compaction_finished", "compaction_time_micros": 1333900, "output_level": 1, "num_output_files": 1, "total_output_size": 14156370, "num_input_records": 2556, "num_output_records": 2047, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:16:49.113253 I | rook-ceph-mon2: 2017-07-11 14:16:49.111641 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782609111638, "job": 32, "event": "table_file_deletion", "file_number": 52}
- 2017-07-11 14:16:49.113302 I | rook-ceph-mon2: 2017-07-11 14:16:49.113223 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782609113222, "job": 32, "event": "table_file_deletion", "file_number": 50}
- 2017-07-11 14:16:49.429681 I | rook-ceph-mon2: 2017-07-11 14:16:49.429648 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:49.429785 I | rook-ceph-mon2: 2017-07-11 14:16:49.429771 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2998377723' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:49.863465 I | rook-ceph-mon2: 2017-07-11 14:16:49.863428 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:16:49.863662 I | rook-ceph-mon2: 2017-07-11 14:16:49.863575 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1168332447' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:16:51.328173 I | rook-ceph-mon2: 2017-07-11 14:16:51.328138 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:16:51.328352 I | rook-ceph-mon2: 2017-07-11 14:16:51.328273 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3308371843' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:16:52.611085 I | rook-ceph-mon2: 2017-07-11 14:16:52.611050 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:52.611373 I | rook-ceph-mon2: 2017-07-11 14:16:52.611197 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1866724343' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:53.609750 I | rook-ceph-mon2: 2017-07-11 14:16:53.609590 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:16:53.609837 I | rook-ceph-mon2: 2017-07-11 14:16:53.609626 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3302450062' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:16:54.091648 I | rook-ceph-mon2: 2017-07-11 14:16:54.091614 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:16:54.091883 I | rook-ceph-mon2: 2017-07-11 14:16:54.091793 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2131781859' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:16:54.551362 I | rook-ceph-mon2: 2017-07-11 14:16:54.551326 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:16:54.551632 I | rook-ceph-mon2: 2017-07-11 14:16:54.551586 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3292439279' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:16:57.979631 I | rook-ceph-mon2: 2017-07-11 14:16:57.979270 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4918 MB, avail 94268 MB
- 2017-07-11 14:16:59.500242 I | rook-ceph-mon2: 2017-07-11 14:16:59.500198 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:16:59.500473 I | rook-ceph-mon2: 2017-07-11 14:16:59.500437 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3231249509' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:17:01.815209 I | rook-ceph-mon2: 2017-07-11 14:17:01.815155 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:01.815611 I | rook-ceph-mon2: 2017-07-11 14:17:01.815576 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3763998502' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:03.569455 I | rook-ceph-mon2: 2017-07-11 14:17:03.569419 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:03.569681 I | rook-ceph-mon2: 2017-07-11 14:17:03.569638 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3692967777' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:04.565193 I | rook-ceph-mon2: 2017-07-11 14:17:04.565151 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:17:04.565289 I | rook-ceph-mon2: 2017-07-11 14:17:04.565274 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2986905790' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:17:05.022662 I | rook-ceph-mon2: 2017-07-11 14:17:05.022617 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:05.022866 I | rook-ceph-mon2: 2017-07-11 14:17:05.022788 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/466226883' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:07.299290 I | rook-ceph-mon2: 2017-07-11 14:17:07.299257 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:07.299527 I | rook-ceph-mon2: 2017-07-11 14:17:07.299413 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3340680762' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:08.191423 I | rook-ceph-mon2: 2017-07-11 14:17:08.191377 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:17:08.191750 I | rook-ceph-mon2: 2017-07-11 14:17:08.191730 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4068356539' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:17:08.505041 I | rook-ceph-mon2: 2017-07-11 14:17:08.504998 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:08.505237 I | rook-ceph-mon2: 2017-07-11 14:17:08.505162 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2406844926' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:09.451804 I | rook-ceph-mon2: 2017-07-11 14:17:09.451769 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:17:09.458028 I | rook-ceph-mon2: 2017-07-11 14:17:09.451924 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/934887692' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:17:11.811004 I | rook-ceph-mon2: 2017-07-11 14:17:11.810968 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:11.811199 I | rook-ceph-mon2: 2017-07-11 14:17:11.811101 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2037784627' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:13.795094 I | rook-ceph-mon2: 2017-07-11 14:17:13.795059 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:13.795199 I | rook-ceph-mon2: 2017-07-11 14:17:13.795183 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3833952560' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:14.895066 I | rook-ceph-mon2: 2017-07-11 14:17:14.895020 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:14.895275 I | rook-ceph-mon2: 2017-07-11 14:17:14.895242 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3835566852' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:16.746776 I | rook-ceph-mon2: 2017-07-11 14:17:16.746733 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:16.746979 I | rook-ceph-mon2: 2017-07-11 14:17:16.746895 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1062534774' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:18.310016 I | rook-ceph-mon2: 2017-07-11 14:17:18.309982 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:18.310211 I | rook-ceph-mon2: 2017-07-11 14:17:18.310125 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/988502561' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:18.753740 I | rook-ceph-mon2: 2017-07-11 14:17:18.753705 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:18.753963 I | rook-ceph-mon2: 2017-07-11 14:17:18.753935 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3970100821' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:19.249119 I | rook-ceph-mon2: 2017-07-11 14:17:19.249040 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:17:19.249354 I | rook-ceph-mon2: 2017-07-11 14:17:19.249323 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/211883410' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:17:19.787068 I | rook-ceph-mon2: 2017-07-11 14:17:19.787021 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:19.787305 I | rook-ceph-mon2: 2017-07-11 14:17:19.787273 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/220696404' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:20.766639 I | rook-ceph-mon2: 2017-07-11 14:17:20.766607 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:17:20.766883 I | rook-ceph-mon2: 2017-07-11 14:17:20.766866 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2765575149' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:17:23.756469 I | rook-ceph-mon2: 2017-07-11 14:17:23.756434 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:23.756570 I | rook-ceph-mon2: 2017-07-11 14:17:23.756555 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3068370235' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:24.733941 I | rook-ceph-mon2: 2017-07-11 14:17:24.733906 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:24.734184 I | rook-ceph-mon2: 2017-07-11 14:17:24.734167 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/171035058' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:26.653977 I | rook-ceph-mon2: 2017-07-11 14:17:26.653944 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:26.654158 I | rook-ceph-mon2: 2017-07-11 14:17:26.654079 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1311676337' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:28.289205 I | rook-ceph-mon2: 2017-07-11 14:17:28.289168 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:17:28.305427 I | rook-ceph-mon2: 2017-07-11 14:17:28.304946 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/67083476' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:17:28.587912 I | rook-ceph-mon2: 2017-07-11 14:17:28.587877 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:28.588087 I | rook-ceph-mon2: 2017-07-11 14:17:28.588009 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1011102283' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:33.502907 I | rook-ceph-mon2: 2017-07-11 14:17:33.502875 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:33.503162 I | rook-ceph-mon2: 2017-07-11 14:17:33.503132 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/78418313' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:33.970990 I | rook-ceph-mon2: 2017-07-11 14:17:33.970955 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:17:33.971307 I | rook-ceph-mon2: 2017-07-11 14:17:33.971140 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3458932889' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:17:35.387503 I | rook-ceph-mon2: 2017-07-11 14:17:35.387465 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:17:35.394148 I | rook-ceph-mon2: 2017-07-11 14:17:35.393274 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1720219027' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:17:37.998529 I | rook-ceph-mon2: 2017-07-11 14:17:37.998492 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:37.998724 I | rook-ceph-mon2: 2017-07-11 14:17:37.998637 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/799071498' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:40.275974 I | rook-ceph-mon2: 2017-07-11 14:17:40.275940 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:17:40.276204 I | rook-ceph-mon2: 2017-07-11 14:17:40.276097 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2145642221' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:17:41.252852 I | rook-ceph-mon2: 2017-07-11 14:17:41.252819 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:41.252918 I | rook-ceph-mon2: 2017-07-11 14:17:41.252903 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1902160468' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:43.364467 I | rook-ceph-mon2: 2017-07-11 14:17:43.364436 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:43.364670 I | rook-ceph-mon2: 2017-07-11 14:17:43.364592 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/788790825' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:44.262483 I | rook-ceph-mon2: 2017-07-11 14:17:44.262449 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:44.262680 I | rook-ceph-mon2: 2017-07-11 14:17:44.262592 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/8369587' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:45.201735 I | rook-ceph-mon2: 2017-07-11 14:17:45.201700 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:17:45.201980 I | rook-ceph-mon2: 2017-07-11 14:17:45.201917 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4140510378' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:17:47.858830 I | rook-ceph-mon2: 2017-07-11 14:17:47.858775 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:47.858925 I | rook-ceph-mon2: 2017-07-11 14:17:47.858910 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3365458775' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:48.731807 I | rook-ceph-mon2: 2017-07-11 14:17:48.731773 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:17:48.732010 I | rook-ceph-mon2: 2017-07-11 14:17:48.731994 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1219973526' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:17:49.231385 I | rook-ceph-mon2: 2017-07-11 14:17:49.231355 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:49.231590 I | rook-ceph-mon2: 2017-07-11 14:17:49.231511 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1310387735' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:52.805324 I | rook-ceph-mon2: 2017-07-11 14:17:52.805278 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:52.805541 I | rook-ceph-mon2: 2017-07-11 14:17:52.805436 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2390108029' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:53.252525 I | rook-ceph-mon2: 2017-07-11 14:17:53.252493 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:53.252734 I | rook-ceph-mon2: 2017-07-11 14:17:53.252629 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2283305214' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:54.000956 I | rook-ceph-mon2: 2017-07-11 14:17:54.000922 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:17:54.001194 I | rook-ceph-mon2: 2017-07-11 14:17:54.001162 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1507297860' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:17:54.468067 I | rook-ceph-mon2: 2017-07-11 14:17:54.468033 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:54.468258 I | rook-ceph-mon2: 2017-07-11 14:17:54.468178 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1071922303' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:57.760866 I | rook-ceph-mon2: 2017-07-11 14:17:57.760833 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:17:57.761050 I | rook-ceph-mon2: 2017-07-11 14:17:57.760969 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/809532334' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:17:57.981145 I | rook-ceph-mon2: 2017-07-11 14:17:57.980766 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4918 MB, avail 94268 MB
- 2017-07-11 14:17:58.201773 I | rook-ceph-mon2: 2017-07-11 14:17:58.201737 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:58.201899 I | rook-ceph-mon2: 2017-07-11 14:17:58.201883 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3221302132' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:17:58.669891 I | rook-ceph-mon2: 2017-07-11 14:17:58.669857 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:17:58.670084 I | rook-ceph-mon2: 2017-07-11 14:17:58.669997 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2842297595' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:17:59.163965 I | rook-ceph-mon2: 2017-07-11 14:17:59.163929 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:17:59.169910 I | rook-ceph-mon2: 2017-07-11 14:17:59.164073 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/507334832' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:01.011530 I | rook-ceph-mon2: 2017-07-11 14:18:01.011496 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:01.011734 I | rook-ceph-mon2: 2017-07-11 14:18:01.011719 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/659604647' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:01.661640 I | rook-ceph-mon2: 2017-07-11 14:18:01.661597 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:18:01.661899 I | rook-ceph-mon2: 2017-07-11 14:18:01.661855 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1857473053' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:18:03.136675 I | rook-ceph-mon2: 2017-07-11 14:18:03.136631 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:03.136863 I | rook-ceph-mon2: 2017-07-11 14:18:03.136784 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2018948034' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:03.583921 I | rook-ceph-mon2: 2017-07-11 14:18:03.583886 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:18:03.584137 I | rook-ceph-mon2: 2017-07-11 14:18:03.584101 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1705778212' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:18:04.982584 I | rook-ceph-mon2: 2017-07-11 14:18:04.982548 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:18:04.982787 I | rook-ceph-mon2: 2017-07-11 14:18:04.982769 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/780891498' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:18:05.942455 I | rook-ceph-mon2: 2017-07-11 14:18:05.942395 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:05.942637 I | rook-ceph-mon2: 2017-07-11 14:18:05.942555 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/317637169' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:07.624253 I | rook-ceph-mon2: 2017-07-11 14:18:07.624208 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:07.624320 I | rook-ceph-mon2: 2017-07-11 14:18:07.624306 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3225016325' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:08.078333 I | rook-ceph-mon2: 2017-07-11 14:18:08.078297 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:08.078544 I | rook-ceph-mon2: 2017-07-11 14:18:08.078437 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/411367596' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:08.531402 I | rook-ceph-mon2: 2017-07-11 14:18:08.531368 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:18:08.531508 I | rook-ceph-mon2: 2017-07-11 14:18:08.531493 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1265183940' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:18:10.741597 I | rook-ceph-mon2: 2017-07-11 14:18:10.741538 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:10.741790 I | rook-ceph-mon2: 2017-07-11 14:18:10.741691 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2385540146' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:12.519663 I | rook-ceph-mon2: 2017-07-11 14:18:12.519607 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:12.519770 I | rook-ceph-mon2: 2017-07-11 14:18:12.519755 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1485182421' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:13.544170 I | rook-ceph-mon2: 2017-07-11 14:18:13.544133 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:18:13.544350 I | rook-ceph-mon2: 2017-07-11 14:18:13.544267 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4122364789' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:18:16.040606 I | rook-ceph-mon2: 2017-07-11 14:18:16.040572 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:16.040831 I | rook-ceph-mon2: 2017-07-11 14:18:16.040797 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3724666963' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:17.652919 I | rook-ceph-mon2: 2017-07-11 14:18:17.652812 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:17.653149 I | rook-ceph-mon2: 2017-07-11 14:18:17.653035 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1848781809' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:18.084040 I | rook-ceph-mon2: 2017-07-11 14:18:18.084007 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:18.084290 I | rook-ceph-mon2: 2017-07-11 14:18:18.084239 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1136958637' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:18.583899 I | rook-ceph-mon2: 2017-07-11 14:18:18.583863 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:18:18.584088 I | rook-ceph-mon2: 2017-07-11 14:18:18.584007 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3648364055' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:18:19.109697 I | rook-ceph-mon2: 2017-07-11 14:18:19.109663 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:19.109902 I | rook-ceph-mon2: 2017-07-11 14:18:19.109823 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3371722690' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:24.057549 I | rook-ceph-mon2: 2017-07-11 14:18:24.057512 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:24.057718 I | rook-ceph-mon2: 2017-07-11 14:18:24.057643 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1947813584' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:25.030848 I | rook-ceph-mon2: 2017-07-11 14:18:25.030642 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:18:25.030925 I | rook-ceph-mon2: 2017-07-11 14:18:25.030665 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/237023119' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:18:26.143579 I | rook-ceph-mon2: 2017-07-11 14:18:26.143546 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:26.143756 I | rook-ceph-mon2: 2017-07-11 14:18:26.143675 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1953571462' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:27.395870 I | rook-ceph-mon2: 2017-07-11 14:18:27.395836 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:27.396116 I | rook-ceph-mon2: 2017-07-11 14:18:27.395985 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3593506242' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:30.709691 I | rook-ceph-mon2: 2017-07-11 14:18:30.709659 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:30.709921 I | rook-ceph-mon2: 2017-07-11 14:18:30.709793 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/380484621' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:32.745011 I | rook-ceph-mon2: 2017-07-11 14:18:32.744978 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:32.745180 I | rook-ceph-mon2: 2017-07-11 14:18:32.745105 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/123270837' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:33.639188 I | rook-ceph-mon2: 2017-07-11 14:18:33.639149 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:33.639280 I | rook-ceph-mon2: 2017-07-11 14:18:33.639266 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1019502141' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:34.598392 I | rook-ceph-mon2: 2017-07-11 14:18:34.598356 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:18:34.598564 I | rook-ceph-mon2: 2017-07-11 14:18:34.598491 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1806045424' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:18:35.734608 I | rook-ceph-mon2: 2017-07-11 14:18:35.734558 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:35.734796 I | rook-ceph-mon2: 2017-07-11 14:18:35.734715 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/688407163' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:36.621011 I | rook-ceph-mon2: 2017-07-11 14:18:36.620976 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:18:36.621252 I | rook-ceph-mon2: 2017-07-11 14:18:36.621212 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3105417719' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:18:38.172878 I | rook-ceph-mon2: 2017-07-11 14:18:38.172830 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:18:38.173055 I | rook-ceph-mon2: 2017-07-11 14:18:38.172975 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2622930629' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:18:38.644456 I | rook-ceph-mon2: 2017-07-11 14:18:38.644423 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:38.644667 I | rook-ceph-mon2: 2017-07-11 14:18:38.644561 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1085968218' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:43.026498 I | rook-ceph-mon2: 2017-07-11 14:18:43.026461 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:18:43.026687 I | rook-ceph-mon2: 2017-07-11 14:18:43.026603 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2471185352' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:18:43.496238 I | rook-ceph-mon2: 2017-07-11 14:18:43.496195 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:43.496342 I | rook-ceph-mon2: 2017-07-11 14:18:43.496327 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1475160401' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:44.462773 I | rook-ceph-mon2: 2017-07-11 14:18:44.462733 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:18:44.462970 I | rook-ceph-mon2: 2017-07-11 14:18:44.462878 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3016924128' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:18:45.522966 I | rook-ceph-mon2: 2017-07-11 14:18:45.522932 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:45.523152 I | rook-ceph-mon2: 2017-07-11 14:18:45.523068 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/9271253' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:47.034699 I | rook-ceph-mon2: 2017-07-11 14:18:47.034665 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:47.034958 I | rook-ceph-mon2: 2017-07-11 14:18:47.034892 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2686917083' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:47.667123 I | rook-ceph-mon2: 2017-07-11 14:18:47.667065 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:18:47.667429 I | rook-ceph-mon2: 2017-07-11 14:18:47.667412 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3825224214' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:18:48.015888 I | rook-ceph-mon2: 2017-07-11 14:18:48.015854 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:18:48.016072 I | rook-ceph-mon2: 2017-07-11 14:18:48.015991 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2979784338' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:18:48.519890 I | rook-ceph-mon2: 2017-07-11 14:18:48.519860 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:48.519995 I | rook-ceph-mon2: 2017-07-11 14:18:48.519979 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1898125110' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:49.558920 I | rook-ceph-mon2: 2017-07-11 14:18:49.558885 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:18:49.559165 I | rook-ceph-mon2: 2017-07-11 14:18:49.559147 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3859127464' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:18:52.454190 I | rook-ceph-mon2: 2017-07-11 14:18:52.454153 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:52.454405 I | rook-ceph-mon2: 2017-07-11 14:18:52.454299 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2431118578' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:52.937739 I | rook-ceph-mon2: 2017-07-11 14:18:52.937705 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:18:52.937975 I | rook-ceph-mon2: 2017-07-11 14:18:52.937957 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4081227026' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:18:54.411326 I | rook-ceph-mon2: 2017-07-11 14:18:54.411276 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:18:54.411562 I | rook-ceph-mon2: 2017-07-11 14:18:54.411485 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2945358097' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:18:55.304966 I | rook-ceph-mon2: 2017-07-11 14:18:55.304937 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:18:55.305070 I | rook-ceph-mon2: 2017-07-11 14:18:55.305055 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2174619708' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:18:57.981693 I | rook-ceph-mon2: 2017-07-11 14:18:57.981378 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4918 MB, avail 94268 MB
- 2017-07-11 14:18:58.400956 I | rook-ceph-mon2: 2017-07-11 14:18:58.400678 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:18:58.401066 I | rook-ceph-mon2: 2017-07-11 14:18:58.400696 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1525580423' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:18:59.418859 I | rook-ceph-mon2: 2017-07-11 14:18:59.418824 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:18:59.419079 I | rook-ceph-mon2: 2017-07-11 14:18:59.419045 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/823618382' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:19:00.373593 I | rook-ceph-mon2: 2017-07-11 14:19:00.373559 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:00.373819 I | rook-ceph-mon2: 2017-07-11 14:19:00.373803 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2942940741' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:01.861708 I | rook-ceph-mon2: 2017-07-11 14:19:01.861673 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:01.861949 I | rook-ceph-mon2: 2017-07-11 14:19:01.861819 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2095830670' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:02.483580 I | rook-ceph-mon2: 2017-07-11 14:19:02.483545 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:02.483803 I | rook-ceph-mon2: 2017-07-11 14:19:02.483683 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2921111790' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:02.968659 I | rook-ceph-mon2: 2017-07-11 14:19:02.968623 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:19:02.968872 I | rook-ceph-mon2: 2017-07-11 14:19:02.968769 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4016385195' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:19:03.426314 I | rook-ceph-mon2: 2017-07-11 14:19:03.426257 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:03.426610 I | rook-ceph-mon2: 2017-07-11 14:19:03.426423 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4077574918' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:04.364600 I | rook-ceph-mon2: 2017-07-11 14:19:04.364554 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:19:04.364763 I | rook-ceph-mon2: 2017-07-11 14:19:04.364694 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1693481903' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:19:05.249865 I | rook-ceph-mon2: 2017-07-11 14:19:05.249833 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:05.250041 I | rook-ceph-mon2: 2017-07-11 14:19:05.249965 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2828648489' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:06.783502 I | rook-ceph-mon2: 2017-07-11 14:19:06.783456 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:06.783713 I | rook-ceph-mon2: 2017-07-11 14:19:06.783613 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1219843836' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:11.719780 I | rook-ceph-mon2: 2017-07-11 14:19:11.719745 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:11.719970 I | rook-ceph-mon2: 2017-07-11 14:19:11.719883 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/677761549' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:12.702865 I | rook-ceph-mon2: 2017-07-11 14:19:12.702820 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:19:12.702972 I | rook-ceph-mon2: 2017-07-11 14:19:12.702958 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/509589836' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:19:13.212524 I | rook-ceph-mon2: 2017-07-11 14:19:13.212483 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:13.212725 I | rook-ceph-mon2: 2017-07-11 14:19:13.212639 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1097398992' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:14.219992 I | rook-ceph-mon2: 2017-07-11 14:19:14.219946 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:19:14.220229 I | rook-ceph-mon2: 2017-07-11 14:19:14.220212 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2869241085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:19:17.588672 I | rook-ceph-mon2: 2017-07-11 14:19:17.588637 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:19:17.588852 I | rook-ceph-mon2: 2017-07-11 14:19:17.588773 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1008264955' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:19:18.078188 I | rook-ceph-mon2: 2017-07-11 14:19:18.078154 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:18.078425 I | rook-ceph-mon2: 2017-07-11 14:19:18.078339 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/367327366' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:21.051745 I | rook-ceph-mon2: 2017-07-11 14:19:21.051710 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:19:21.051990 I | rook-ceph-mon2: 2017-07-11 14:19:21.051971 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2897190017' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:19:21.623439 I | rook-ceph-mon2: 2017-07-11 14:19:21.623405 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:21.623628 I | rook-ceph-mon2: 2017-07-11 14:19:21.623545 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3384737343' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:22.100490 I | rook-ceph-mon2: 2017-07-11 14:19:22.100456 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:22.100741 I | rook-ceph-mon2: 2017-07-11 14:19:22.100606 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/871260171' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:23.091462 I | rook-ceph-mon2: 2017-07-11 14:19:23.091427 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:23.091581 I | rook-ceph-mon2: 2017-07-11 14:19:23.091566 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1510392677' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:24.895417 I | rook-ceph-mon2: 2017-07-11 14:19:24.895383 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:24.895589 I | rook-ceph-mon2: 2017-07-11 14:19:24.895512 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2156455757' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:27.019295 I | rook-ceph-mon2: 2017-07-11 14:19:27.019235 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:27.019604 I | rook-ceph-mon2: 2017-07-11 14:19:27.019586 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2261433864' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:27.985521 I | rook-ceph-mon2: 2017-07-11 14:19:27.985486 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:27.985735 I | rook-ceph-mon2: 2017-07-11 14:19:27.985631 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1510402072' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:29.866531 I | rook-ceph-mon2: 2017-07-11 14:19:29.866496 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:29.866731 I | rook-ceph-mon2: 2017-07-11 14:19:29.866652 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1112203331' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:31.914512 I | rook-ceph-mon2: 2017-07-11 14:19:31.914477 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:31.914701 I | rook-ceph-mon2: 2017-07-11 14:19:31.914616 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2238256630' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:32.350841 I | rook-ceph-mon2: 2017-07-11 14:19:32.350797 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:19:32.350990 I | rook-ceph-mon2: 2017-07-11 14:19:32.350974 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4273443056' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:19:32.927628 I | rook-ceph-mon2: 2017-07-11 14:19:32.927359 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:32.927704 I | rook-ceph-mon2: 2017-07-11 14:19:32.927377 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/154010247' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:34.793782 I | rook-ceph-mon2: 2017-07-11 14:19:34.793748 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:34.793966 I | rook-ceph-mon2: 2017-07-11 14:19:34.793885 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2022916141' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:36.397140 I | rook-ceph-mon2: 2017-07-11 14:19:35.543148 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 675 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.156382s > max 0.05s
- 2017-07-11 14:19:36.398936 I | rook-ceph-mon2: 2017-07-11 14:19:35.551965 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 676 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0675102s > max 0.05s
- 2017-07-11 14:19:37.322691 I | rook-ceph-mon2: 2017-07-11 14:19:37.322654 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:19:37.322912 I | rook-ceph-mon2: 2017-07-11 14:19:37.322797 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4255227974' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:19:38.726472 I | rook-ceph-mon2: 2017-07-11 14:19:38.726441 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:19:38.732116 I | rook-ceph-mon2: 2017-07-11 14:19:38.732095 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/148705619' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:19:39.661490 I | rook-ceph-mon2: 2017-07-11 14:19:39.661443 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:39.667229 I | rook-ceph-mon2: 2017-07-11 14:19:39.667204 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/54967577' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:41.948225 I | rook-ceph-mon2: 2017-07-11 14:19:41.948184 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:41.948458 I | rook-ceph-mon2: 2017-07-11 14:19:41.948440 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3539185715' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:42.402210 I | rook-ceph-mon2: 2017-07-11 14:19:42.402159 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:19:42.402393 I | rook-ceph-mon2: 2017-07-11 14:19:42.402313 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1881838721' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:19:42.870898 I | rook-ceph-mon2: 2017-07-11 14:19:42.870852 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:42.871086 I | rook-ceph-mon2: 2017-07-11 14:19:42.871006 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3863448993' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:46.676764 I | rook-ceph-mon2: 2017-07-11 14:19:46.676712 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:46.677062 I | rook-ceph-mon2: 2017-07-11 14:19:46.676978 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/819933921' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:47.790481 I | rook-ceph-mon2: 2017-07-11 14:19:47.790449 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:19:47.790584 I | rook-ceph-mon2: 2017-07-11 14:19:47.790570 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1576607255' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:19:49.296157 I | rook-ceph-mon2: 2017-07-11 14:19:49.296124 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:19:49.296374 I | rook-ceph-mon2: 2017-07-11 14:19:49.296339 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3746868787' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:19:51.149555 I | rook-ceph-mon2: 2017-07-11 14:19:51.149518 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:51.149777 I | rook-ceph-mon2: 2017-07-11 14:19:51.149664 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3191510924' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:51.786000 I | rook-ceph-mon2: 2017-07-11 14:19:51.785964 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:51.786194 I | rook-ceph-mon2: 2017-07-11 14:19:51.786108 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/377826838' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:52.239070 I | rook-ceph-mon2: 2017-07-11 14:19:52.239036 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:19:52.239299 I | rook-ceph-mon2: 2017-07-11 14:19:52.239262 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4247044332' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:19:52.699000 I | rook-ceph-mon2: 2017-07-11 14:19:52.698964 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:52.699267 I | rook-ceph-mon2: 2017-07-11 14:19:52.699237 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3374661962' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:53.798038 I | rook-ceph-mon2: 2017-07-11 14:19:53.798005 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:19:53.798311 I | rook-ceph-mon2: 2017-07-11 14:19:53.798287 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2506419810' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:19:54.342145 I | rook-ceph-mon2: 2017-07-11 14:19:54.342108 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:19:54.344205 I | rook-ceph-mon2: 2017-07-11 14:19:54.344185 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1763885682' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:19:54.777543 I | rook-ceph-mon2: 2017-07-11 14:19:54.777508 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:54.777717 I | rook-ceph-mon2: 2017-07-11 14:19:54.777640 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/7475192' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:19:57.460801 I | rook-ceph-mon2: 2017-07-11 14:19:57.460769 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:19:57.460905 I | rook-ceph-mon2: 2017-07-11 14:19:57.460890 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/955921762' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:19:57.986334 I | rook-ceph-mon2: 2017-07-11 14:19:57.986029 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4919 MB, avail 94268 MB
- 2017-07-11 14:19:58.420714 I | rook-ceph-mon2: 2017-07-11 14:19:58.420679 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:19:58.420922 I | rook-ceph-mon2: 2017-07-11 14:19:58.420840 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/696945314' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:19:59.367582 I | rook-ceph-mon2: 2017-07-11 14:19:59.367547 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:19:59.367821 I | rook-ceph-mon2: 2017-07-11 14:19:59.367771 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4030090446' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:20:01.028650 I | rook-ceph-mon2: 2017-07-11 14:20:01.028616 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:20:01.028888 I | rook-ceph-mon2: 2017-07-11 14:20:01.028775 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/612171608' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:20:01.511189 I | rook-ceph-mon2: 2017-07-11 14:20:01.511157 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:20:01.511420 I | rook-ceph-mon2: 2017-07-11 14:20:01.511307 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/540473208' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:20:01.968072 I | rook-ceph-mon2: 2017-07-11 14:20:01.968027 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:20:01.968195 I | rook-ceph-mon2: 2017-07-11 14:20:01.968180 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/477274655' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:20:02.409386 I | rook-ceph-mon2: 2017-07-11 14:20:02.409357 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:20:02.409490 I | rook-ceph-mon2: 2017-07-11 14:20:02.409475 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2539215173' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:20:02.973812 I | rook-ceph-mon2: 2017-07-11 14:20:02.973733 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #54. Immutable memtables: 0.
- 2017-07-11 14:20:02.973891 I | rook-ceph-mon2:
- 2017-07-11 14:20:02.973911 I | rook-ceph-mon2: 2017-07-11 14:20:02.973768 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 33] Syncing log #51
- 2017-07-11 14:20:03.007403 I | rook-ceph-mon2: 2017-07-11 14:20:03.005828 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:20:02.973763) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:20:03.007457 I | rook-ceph-mon2: 2017-07-11 14:20:03.005836 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 33] Flushing memtable with next log file: 54
- 2017-07-11 14:20:03.007473 I | rook-ceph-mon2:
- 2017-07-11 14:20:03.007485 I | rook-ceph-mon2: 2017-07-11 14:20:03.005844 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803005841, "job": 33, "event": "flush_started", "num_memtables": 1, "num_entries": 2313, "num_deletes": 251, "memory_usage": 7640624}
- 2017-07-11 14:20:03.007499 I | rook-ceph-mon2: 2017-07-11 14:20:03.005847 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 33] Level-0 flush table #55: started
- 2017-07-11 14:20:03.087015 I | rook-ceph-mon2: 2017-07-11 14:20:03.086961 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803086951, "cf_name": "default", "job": 33, "event": "table_file_creation", "file_number": 55, "file_size": 5047328, "table_properties": {"data_size": 5030022, "index_size": 16486, "filter_size": 0, "raw_key_size": 16822, "raw_average_key_size": 18, "raw_value_size": 5006021, "raw_average_value_size": 5489, "num_data_blocks": 521, "num_entries": 912, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:20:03.096976 I | rook-ceph-mon2: 2017-07-11 14:20:03.096953 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 33] Level-0 flush table #55: 5047328 bytes OK
- 2017-07-11 14:20:03.156738 I | rook-ceph-mon2: 2017-07-11 14:20:03.156706 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.136796) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #55 started
- 2017-07-11 14:20:03.156989 I | rook-ceph-mon2: 2017-07-11 14:20:03.156968 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.156667) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #55: memtable #1 done
- 2017-07-11 14:20:03.157174 I | rook-ceph-mon2: 2017-07-11 14:20:03.157143 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.156681) EVENT_LOG_v1 {"time_micros": 1499782803156677, "job": 33, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:20:03.157339 I | rook-ceph-mon2: 2017-07-11 14:20:03.157320 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.156696) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:20:03.157375 I | rook-ceph-mon2:
- 2017-07-11 14:20:03.157413 I | rook-ceph-mon2: 2017-07-11 14:20:03.157397 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 33] Try to delete WAL files size 7587772, prev total WAL file size 7587772, number of live WAL files 2.
- 2017-07-11 14:20:03.157455 I | rook-ceph-mon2:
- 2017-07-11 14:20:03.176469 I | rook-ceph-mon2: 2017-07-11 14:20:03.158712 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:20:03.176697 I | rook-ceph-mon2: 2017-07-11 14:20:03.159384 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.159378) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:20:03.176726 I | rook-ceph-mon2:
- 2017-07-11 14:20:03.176739 I | rook-ceph-mon2: 2017-07-11 14:20:03.159391 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 34] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:20:03.176764 I | rook-ceph-mon2: 2017-07-11 14:20:03.159395 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 33 Base level 0, inputs: [55(4929KB)], [53(13MB)]
- 2017-07-11 14:20:03.176778 I | rook-ceph-mon2:
- 2017-07-11 14:20:03.176789 I | rook-ceph-mon2: 2017-07-11 14:20:03.159404 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803159397, "job": 34, "event": "compaction_started", "files_L0": [55], "files_L1": [53], "score": -1, "input_data_size": 19203698}
- 2017-07-11 14:20:03.649447 I | rook-ceph-mon2: 2017-07-11 14:20:03.649390 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 34] Generated table #56: 2450 keys, 17170353 bytes
- 2017-07-11 14:20:03.649659 I | rook-ceph-mon2: 2017-07-11 14:20:03.649551 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803649542, "cf_name": "default", "job": 34, "event": "table_file_creation", "file_number": 56, "file_size": 17170353, "table_properties": {"data_size": 17116584, "index_size": 52950, "filter_size": 0, "raw_key_size": 45705, "raw_average_key_size": 18, "raw_value_size": 17045679, "raw_average_value_size": 6957, "num_data_blocks": 1631, "num_entries": 2450, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:20:03.698709 I | rook-ceph-mon2: 2017-07-11 14:20:03.698674 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 34] Compacted 1@0 + 1@1 files to L1 => 17170353 bytes
- 2017-07-11 14:20:03.772883 I | rook-ceph-mon2: 2017-07-11 14:20:03.764314 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.764235) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 35.6 rd, 31.8 wr, level 1, files in(1, 1) out(1) MB in(4.8, 13.5) out(16.4), read-write-amplify(7.2) write-amplify(3.4) OK, records in: 2959, records dropped: 509
- 2017-07-11 14:20:03.772905 I | rook-ceph-mon2:
- 2017-07-11 14:20:03.772943 I | rook-ceph-mon2: 2017-07-11 14:20:03.772924 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:20:03.764261) EVENT_LOG_v1 {"time_micros": 1499782803764251, "job": 34, "event": "compaction_finished", "compaction_time_micros": 539255, "output_level": 1, "num_output_files": 1, "total_output_size": 17170353, "num_input_records": 2959, "num_output_records": 2450, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:20:03.773685 I | rook-ceph-mon2: 2017-07-11 14:20:03.773669 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803773666, "job": 34, "event": "table_file_deletion", "file_number": 55}
- 2017-07-11 14:20:03.784865 I | rook-ceph-mon2: 2017-07-11 14:20:03.784844 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782803784839, "job": 34, "event": "table_file_deletion", "file_number": 53}
- 2017-07-11 14:20:05.184617 I | rook-ceph-mon2: 2017-07-11 14:20:05.184582 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:20:05.184825 I | rook-ceph-mon2: 2017-07-11 14:20:05.184744 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/840376422' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:20:05.964803 I | rook-ceph-mon2: 2017-07-11 14:20:05.964756 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:20:05.965004 I | rook-ceph-mon2: 2017-07-11 14:20:05.964920 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3670450926' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:20:06.428578 I | rook-ceph-mon2: 2017-07-11 14:20:06.428542 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:20:06.428836 I | rook-ceph-mon2: 2017-07-11 14:20:06.428766 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1085885604' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:20:07.338552 I | rook-ceph-mon2: 2017-07-11 14:20:07.338520 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:20:07.338766 I | rook-ceph-mon2: 2017-07-11 14:20:07.338728 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1958267249' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:20:09.201303 I | rook-ceph-mon2: 2017-07-11 14:20:09.201267 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:20:09.201525 I | rook-ceph-mon2: 2017-07-11 14:20:09.201487 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/693327978' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:20:10.891170 I | rook-ceph-mon2: 2017-07-11 14:20:10.891124 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:20:10.891355 I | rook-ceph-mon2: 2017-07-11 14:20:10.891273 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3459412423' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:20:16.317765 I | rook-ceph-mon2: 2017-07-11 14:20:16.317729 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:20:16.317988 I | rook-ceph-mon2: 2017-07-11 14:20:16.317955 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3197460286' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:20:16.780220 I | rook-ceph-mon2: 2017-07-11 14:20:16.780184 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:20:16.780284 I | rook-ceph-mon2: 2017-07-11 14:20:16.780269 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3150437937' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:20:18.690490 I | rook-ceph-mon2: 2017-07-11 14:20:18.690459 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:20:18.690599 I | rook-ceph-mon2: 2017-07-11 14:20:18.690583 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3878767728' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:20:19.746547 I | rook-ceph-mon2: 2017-07-11 14:20:19.746510 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:20:19.747483 I | rook-ceph-mon2: 2017-07-11 14:20:19.747465 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3534124367' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:20:21.088435 I | rook-ceph-mon2: 2017-07-11 14:20:21.088402 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:20:21.088663 I | rook-ceph-mon2: 2017-07-11 14:20:21.088542 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2931438830' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:20:21.552620 I | rook-ceph-mon2: 2017-07-11 14:20:21.552311 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:20:21.552811 I | rook-ceph-mon2: 2017-07-11 14:20:21.552727 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/32843951' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:20:22.026788 I | rook-ceph-mon2: 2017-07-11 14:20:22.026753 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:20:22.026903 I | rook-ceph-mon2: 2017-07-11 14:20:22.026886 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2352971907' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:20:22.519578 I | rook-ceph-mon2: 2017-07-11 14:20:22.518946 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:20:22.519820 I | rook-ceph-mon2: 2017-07-11 14:20:22.519800 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2166848442' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:20:28.832129 I | rook-ceph-mon2: 2017-07-11 14:20:28.832096 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:20:28.832316 I | rook-ceph-mon2: 2017-07-11 14:20:28.832225 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2941238626' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:20:57.986467 I | rook-ceph-mon2: 2017-07-11 14:20:57.986237 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4922 MB, avail 94264 MB
- 2017-07-11 14:21:08.021110 I | rook-ceph-mon2: 2017-07-11 14:21:08.020998 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #57. Immutable memtables: 0.
- 2017-07-11 14:21:08.021221 I | rook-ceph-mon2:
- 2017-07-11 14:21:08.021260 I | rook-ceph-mon2: 2017-07-11 14:21:08.021052 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 35] Syncing log #54
- 2017-07-11 14:21:08.078221 I | rook-ceph-mon2: 2017-07-11 14:21:08.076825 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.021046) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:21:08.078274 I | rook-ceph-mon2: 2017-07-11 14:21:08.076842 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 35] Flushing memtable with next log file: 57
- 2017-07-11 14:21:08.078292 I | rook-ceph-mon2:
- 2017-07-11 14:21:08.078305 I | rook-ceph-mon2: 2017-07-11 14:21:08.076870 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868076851, "job": 35, "event": "flush_started", "num_memtables": 1, "num_entries": 937, "num_deletes": 500, "memory_usage": 1541408}
- 2017-07-11 14:21:08.078318 I | rook-ceph-mon2: 2017-07-11 14:21:08.076871 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 35] Level-0 flush table #58: started
- 2017-07-11 14:21:08.115451 I | rook-ceph-mon2: 2017-07-11 14:21:08.115421 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868115413, "cf_name": "default", "job": 35, "event": "table_file_creation", "file_number": 58, "file_size": 1008999, "table_properties": {"data_size": 1004597, "index_size": 3588, "filter_size": 0, "raw_key_size": 11717, "raw_average_key_size": 18, "raw_value_size": 993652, "raw_average_value_size": 1550, "num_data_blocks": 116, "num_entries": 641, "filter_policy_name": "", "kDeletedKeys": "500", "kMergeOperands": "0"}}
- 2017-07-11 14:21:08.115532 I | rook-ceph-mon2: 2017-07-11 14:21:08.115515 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 35] Level-0 flush table #58: 1008999 bytes OK
- 2017-07-11 14:21:08.194927 I | rook-ceph-mon2: 2017-07-11 14:21:08.194889 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.148219) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #58 started
- 2017-07-11 14:21:08.195013 I | rook-ceph-mon2: 2017-07-11 14:21:08.194996 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.194845) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #58: memtable #1 done
- 2017-07-11 14:21:08.195121 I | rook-ceph-mon2: 2017-07-11 14:21:08.195104 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.194862) EVENT_LOG_v1 {"time_micros": 1499782868194857, "job": 35, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:21:08.195168 I | rook-ceph-mon2: 2017-07-11 14:21:08.195154 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.194878) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:21:08.195183 I | rook-ceph-mon2:
- 2017-07-11 14:21:08.195237 I | rook-ceph-mon2: 2017-07-11 14:21:08.195210 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 35] Try to delete WAL files size 1519643, prev total WAL file size 1526344, number of live WAL files 2.
- 2017-07-11 14:21:08.195252 I | rook-ceph-mon2:
- 2017-07-11 14:21:08.196268 I | rook-ceph-mon2: 2017-07-11 14:21:08.195627 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:21:08.196302 I | rook-ceph-mon2: 2017-07-11 14:21:08.195656 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.195651) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:21:08.196317 I | rook-ceph-mon2:
- 2017-07-11 14:21:08.196329 I | rook-ceph-mon2: 2017-07-11 14:21:08.195660 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 36] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:21:08.196339 I | rook-ceph-mon2: 2017-07-11 14:21:08.195664 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 35 Base level 0, inputs: [58(985KB)], [56(16MB)]
- 2017-07-11 14:21:08.196351 I | rook-ceph-mon2:
- 2017-07-11 14:21:08.196375 I | rook-ceph-mon2: 2017-07-11 14:21:08.195673 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868195666, "job": 36, "event": "compaction_started", "files_L0": [58], "files_L1": [56], "score": -1, "input_data_size": 18179352}
- 2017-07-11 14:21:08.593761 I | rook-ceph-mon2: 2017-07-11 14:21:08.593711 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 36] Generated table #59: 2084 keys, 13681170 bytes
- 2017-07-11 14:21:08.593936 I | rook-ceph-mon2: 2017-07-11 14:21:08.593858 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868593848, "cf_name": "default", "job": 36, "event": "table_file_creation", "file_number": 59, "file_size": 13681170, "table_properties": {"data_size": 13633986, "index_size": 46365, "filter_size": 0, "raw_key_size": 39170, "raw_average_key_size": 18, "raw_value_size": 13572443, "raw_average_value_size": 6512, "num_data_blocks": 1435, "num_entries": 2084, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:21:08.659101 I | rook-ceph-mon2: 2017-07-11 14:21:08.659055 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 36] Compacted 1@0 + 1@1 files to L1 => 13681170 bytes
- 2017-07-11 14:21:08.688829 I | rook-ceph-mon2: 2017-07-11 14:21:08.688799 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.688702) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 39.2 rd, 29.5 wr, level 1, files in(1, 1) out(1) MB in(1.0, 16.4) out(13.0), read-write-amplify(31.6) write-amplify(13.6) OK, records in: 3091, records dropped: 1007
- 2017-07-11 14:21:08.688871 I | rook-ceph-mon2:
- 2017-07-11 14:21:08.688903 I | rook-ceph-mon2: 2017-07-11 14:21:08.688888 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.688739) EVENT_LOG_v1 {"time_micros": 1499782868688724, "job": 36, "event": "compaction_finished", "compaction_time_micros": 463368, "output_level": 1, "num_output_files": 1, "total_output_size": 13681170, "num_input_records": 3091, "num_output_records": 2084, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:21:08.689282 I | rook-ceph-mon2: 2017-07-11 14:21:08.689266 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868689252, "job": 36, "event": "table_file_deletion", "file_number": 58}
- 2017-07-11 14:21:08.691285 I | rook-ceph-mon2: 2017-07-11 14:21:08.691270 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868691267, "job": 36, "event": "table_file_deletion", "file_number": 56}
- 2017-07-11 14:21:08.691668 I | rook-ceph-mon2: 2017-07-11 14:21:08.691596 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #60. Immutable memtables: 0.
- 2017-07-11 14:21:08.691719 I | rook-ceph-mon2:
- 2017-07-11 14:21:08.691735 I | rook-ceph-mon2: 2017-07-11 14:21:08.691623 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 37] Syncing log #57
- 2017-07-11 14:21:08.807609 I | rook-ceph-mon2: 2017-07-11 14:21:08.807300 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.691619) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:21:08.807683 I | rook-ceph-mon2: 2017-07-11 14:21:08.807314 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 37] Flushing memtable with next log file: 60
- 2017-07-11 14:21:08.807699 I | rook-ceph-mon2:
- 2017-07-11 14:21:08.807712 I | rook-ceph-mon2: 2017-07-11 14:21:08.807324 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868807320, "job": 37, "event": "flush_started", "num_memtables": 1, "num_entries": 7, "num_deletes": 0, "memory_usage": 22184}
- 2017-07-11 14:21:08.807724 I | rook-ceph-mon2: 2017-07-11 14:21:08.807328 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 37] Level-0 flush table #61: started
- 2017-07-11 14:21:08.830991 I | rook-ceph-mon2: 2017-07-11 14:21:08.830928 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499782868830908, "cf_name": "default", "job": 37, "event": "table_file_creation", "file_number": 61, "file_size": 14235, "table_properties": {"data_size": 13346, "index_size": 81, "filter_size": 0, "raw_key_size": 143, "raw_average_key_size": 23, "raw_value_size": 13164, "raw_average_value_size": 2194, "num_data_blocks": 3, "num_entries": 6, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:21:08.831085 I | rook-ceph-mon2: 2017-07-11 14:21:08.830936 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 37] Level-0 flush table #61: 14235 bytes OK
- 2017-07-11 14:21:08.906308 I | rook-ceph-mon2: 2017-07-11 14:21:08.906139 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.862938) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #61 started
- 2017-07-11 14:21:08.906372 I | rook-ceph-mon2: 2017-07-11 14:21:08.906147 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.906093) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #61: memtable #1 done
- 2017-07-11 14:21:08.906389 I | rook-ceph-mon2: 2017-07-11 14:21:08.906149 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.906112) EVENT_LOG_v1 {"time_micros": 1499782868906107, "job": 37, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:21:08.906412 I | rook-ceph-mon2: 2017-07-11 14:21:08.906150 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:21:08.906128) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:21:08.906425 I | rook-ceph-mon2:
- 2017-07-11 14:21:08.906513 I | rook-ceph-mon2: 2017-07-11 14:21:08.906155 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 37] Try to delete WAL files size 19939, prev total WAL file size 19939, number of live WAL files 2.
- 2017-07-11 14:21:08.906525 I | rook-ceph-mon2:
- 2017-07-11 14:21:08.906553 I | rook-ceph-mon2: 2017-07-11 14:21:08.906477 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:21:24.493763 I | rook-ceph-mon2: 2017-07-11 14:21:24.493712 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:21:24.494006 I | rook-ceph-mon2: 2017-07-11 14:21:24.493971 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2587003750' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:21:26.615377 I | rook-ceph-mon2: 2017-07-11 14:21:26.615343 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:26.616004 I | rook-ceph-mon2: 2017-07-11 14:21:26.615487 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/397179832' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:27.090396 I | rook-ceph-mon2: 2017-07-11 14:21:27.090350 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:27.090585 I | rook-ceph-mon2: 2017-07-11 14:21:27.090503 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/441340381' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:27.579366 I | rook-ceph-mon2: 2017-07-11 14:21:27.579028 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:27.579434 I | rook-ceph-mon2: 2017-07-11 14:21:27.579049 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2331648717' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:30.579732 I | rook-ceph-mon2: 2017-07-11 14:21:30.579697 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:30.579941 I | rook-ceph-mon2: 2017-07-11 14:21:30.579837 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/993118658' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:31.461278 I | rook-ceph-mon2: 2017-07-11 14:21:31.461238 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:31.461387 I | rook-ceph-mon2: 2017-07-11 14:21:31.461371 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1285207474' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:31.925011 I | rook-ceph-mon2: 2017-07-11 14:21:31.924974 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:21:31.925126 I | rook-ceph-mon2: 2017-07-11 14:21:31.925102 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1251853812' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:21:32.401579 I | rook-ceph-mon2: 2017-07-11 14:21:32.401531 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:32.401816 I | rook-ceph-mon2: 2017-07-11 14:21:32.401773 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1955081404' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:35.227174 I | rook-ceph-mon2: 2017-07-11 14:21:35.227141 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:35.239001 I | rook-ceph-mon2: 2017-07-11 14:21:35.236543 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2875232372' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:35.755824 I | rook-ceph-mon2: 2017-07-11 14:21:35.755791 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:21:35.761670 I | rook-ceph-mon2: 2017-07-11 14:21:35.761649 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3946091097' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:21:36.251482 I | rook-ceph-mon2: 2017-07-11 14:21:36.251448 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:36.251667 I | rook-ceph-mon2: 2017-07-11 14:21:36.251650 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4186372070' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:40.355392 I | rook-ceph-mon2: 2017-07-11 14:21:40.355359 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:40.355506 I | rook-ceph-mon2: 2017-07-11 14:21:40.355487 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3679537415' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:42.788696 I | rook-ceph-mon2: 2017-07-11 14:21:42.788652 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:42.788883 I | rook-ceph-mon2: 2017-07-11 14:21:42.788800 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/178870726' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:43.251138 I | rook-ceph-mon2: 2017-07-11 14:21:43.251104 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:43.251349 I | rook-ceph-mon2: 2017-07-11 14:21:43.251242 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3478230237' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:43.710527 I | rook-ceph-mon2: 2017-07-11 14:21:43.710494 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:21:43.710704 I | rook-ceph-mon2: 2017-07-11 14:21:43.710628 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2074107489' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:21:45.101045 I | rook-ceph-mon2: 2017-07-11 14:21:45.101010 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:21:45.101223 I | rook-ceph-mon2: 2017-07-11 14:21:45.101147 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3777045199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:21:46.703953 I | rook-ceph-mon2: 2017-07-11 14:21:46.695546 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:46.707066 I | rook-ceph-mon2: 2017-07-11 14:21:46.704062 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/564817091' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:50.128859 I | rook-ceph-mon2: 2017-07-11 14:21:50.128824 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:50.129046 I | rook-ceph-mon2: 2017-07-11 14:21:50.128964 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1584893830' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:50.521475 I | rook-ceph-mon2: 2017-07-11 14:21:50.521432 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:50.521657 I | rook-ceph-mon2: 2017-07-11 14:21:50.521584 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3593264167' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:52.973227 I | rook-ceph-mon2: 2017-07-11 14:21:52.973194 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:21:52.973408 I | rook-ceph-mon2: 2017-07-11 14:21:52.973331 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1615031234' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:21:54.080832 I | rook-ceph-mon2: 2017-07-11 14:21:54.080787 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:54.081018 I | rook-ceph-mon2: 2017-07-11 14:21:54.080930 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/278840516' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:55.972770 I | rook-ceph-mon2: 2017-07-11 14:21:55.972722 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:21:55.972944 I | rook-ceph-mon2: 2017-07-11 14:21:55.972868 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1766101485' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:21:57.235519 I | rook-ceph-mon2: 2017-07-11 14:21:57.235468 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:21:57.235747 I | rook-ceph-mon2: 2017-07-11 14:21:57.235707 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3528813526' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:21:57.991500 I | rook-ceph-mon2: 2017-07-11 14:21:57.987613 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4919 MB, avail 94268 MB
- 2017-07-11 14:21:58.171210 I | rook-ceph-mon2: 2017-07-11 14:21:58.171176 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:58.171341 I | rook-ceph-mon2: 2017-07-11 14:21:58.171309 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3082090809' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:58.626286 I | rook-ceph-mon2: 2017-07-11 14:21:58.626241 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:21:58.626545 I | rook-ceph-mon2: 2017-07-11 14:21:58.626435 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4091005649' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:21:59.946489 I | rook-ceph-mon2: 2017-07-11 14:21:59.946307 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:21:59.946576 I | rook-ceph-mon2: 2017-07-11 14:21:59.946328 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/965832350' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:01.380442 I | rook-ceph-mon2: 2017-07-11 14:22:01.380405 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:01.380560 I | rook-ceph-mon2: 2017-07-11 14:22:01.380544 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1292945315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:02.429457 I | rook-ceph-mon2: 2017-07-11 14:22:02.429079 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:02.429625 I | rook-ceph-mon2: 2017-07-11 14:22:02.429552 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1625758510' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:02.887131 I | rook-ceph-mon2: 2017-07-11 14:22:02.887097 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:02.887349 I | rook-ceph-mon2: 2017-07-11 14:22:02.887236 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2244567051' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:03.587582 I | rook-ceph-mon2: 2017-07-11 14:22:03.587536 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:03.587721 I | rook-ceph-mon2: 2017-07-11 14:22:03.587705 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1716689742' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:05.566806 I | rook-ceph-mon2: 2017-07-11 14:22:05.566758 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:05.567017 I | rook-ceph-mon2: 2017-07-11 14:22:05.566950 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2116479504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:07.017597 I | rook-ceph-mon2: 2017-07-11 14:22:07.017275 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:07.017900 I | rook-ceph-mon2: 2017-07-11 14:22:07.017297 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4183944408' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:07.464263 I | rook-ceph-mon2: 2017-07-11 14:22:07.464226 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:07.464451 I | rook-ceph-mon2: 2017-07-11 14:22:07.464366 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/119798135' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:07.950303 I | rook-ceph-mon2: 2017-07-11 14:22:07.950267 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:07.950567 I | rook-ceph-mon2: 2017-07-11 14:22:07.950410 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3332642037' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:08.391894 I | rook-ceph-mon2: 2017-07-11 14:22:08.391831 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:08.392003 I | rook-ceph-mon2: 2017-07-11 14:22:08.391987 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/860842115' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:09.356654 I | rook-ceph-mon2: 2017-07-11 14:22:09.356618 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:09.356878 I | rook-ceph-mon2: 2017-07-11 14:22:09.356837 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2393655035' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:10.747654 I | rook-ceph-mon2: 2017-07-11 14:22:10.747620 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:10.747890 I | rook-ceph-mon2: 2017-07-11 14:22:10.747861 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3330724632' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:12.243062 I | rook-ceph-mon2: 2017-07-11 14:22:12.243027 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:12.243278 I | rook-ceph-mon2: 2017-07-11 14:22:12.243253 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1765642115' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:13.420186 I | rook-ceph-mon2: 2017-07-11 14:22:13.420151 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:13.420371 I | rook-ceph-mon2: 2017-07-11 14:22:13.420294 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1062409099' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:14.407089 I | rook-ceph-mon2: 2017-07-11 14:22:14.407053 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:14.407264 I | rook-ceph-mon2: 2017-07-11 14:22:14.407184 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3673718634' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:14.863433 I | rook-ceph-mon2: 2017-07-11 14:22:14.863397 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:14.869218 I | rook-ceph-mon2: 2017-07-11 14:22:14.863540 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/818962557' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:19.247976 I | rook-ceph-mon2: 2017-07-11 14:22:19.247934 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:19.248205 I | rook-ceph-mon2: 2017-07-11 14:22:19.248174 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/840692961' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:20.192511 I | rook-ceph-mon2: 2017-07-11 14:22:20.192478 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:20.192720 I | rook-ceph-mon2: 2017-07-11 14:22:20.192613 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/299548909' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:21.234672 I | rook-ceph-mon2: 2017-07-11 14:22:21.234640 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:21.234863 I | rook-ceph-mon2: 2017-07-11 14:22:21.234782 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4153147698' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:23.150916 I | rook-ceph-mon2: 2017-07-11 14:22:23.150871 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:23.151050 I | rook-ceph-mon2: 2017-07-11 14:22:23.151034 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2978943764' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:24.127604 I | rook-ceph-mon2: 2017-07-11 14:22:24.127568 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:24.127802 I | rook-ceph-mon2: 2017-07-11 14:22:24.127715 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1666692729' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:25.039235 I | rook-ceph-mon2: 2017-07-11 14:22:25.039202 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:25.039426 I | rook-ceph-mon2: 2017-07-11 14:22:25.039349 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3062820278' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:26.100995 I | rook-ceph-mon2: 2017-07-11 14:22:26.100962 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:26.101224 I | rook-ceph-mon2: 2017-07-11 14:22:26.101113 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2933401240' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:28.227642 I | rook-ceph-mon2: 2017-07-11 14:22:28.227585 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:28.227823 I | rook-ceph-mon2: 2017-07-11 14:22:28.227744 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1088611303' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:29.152170 I | rook-ceph-mon2: 2017-07-11 14:22:29.152134 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:29.152408 I | rook-ceph-mon2: 2017-07-11 14:22:29.152374 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/962965694' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:30.168838 I | rook-ceph-mon2: 2017-07-11 14:22:30.168804 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:30.169060 I | rook-ceph-mon2: 2017-07-11 14:22:30.168947 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/573365114' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:31.023005 I | rook-ceph-mon2: 2017-07-11 14:22:31.022968 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:31.023199 I | rook-ceph-mon2: 2017-07-11 14:22:31.023110 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2479888957' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:31.538033 I | rook-ceph-mon2: 2017-07-11 14:22:31.537998 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:31.539324 I | rook-ceph-mon2: 2017-07-11 14:22:31.539304 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/729505165' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:31.995751 I | rook-ceph-mon2: 2017-07-11 14:22:31.995697 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:31.995931 I | rook-ceph-mon2: 2017-07-11 14:22:31.995845 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2102816286' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:32.912956 I | rook-ceph-mon2: 2017-07-11 14:22:32.912921 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:32.913203 I | rook-ceph-mon2: 2017-07-11 14:22:32.913146 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1319337443' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:34.330407 I | rook-ceph-mon2: 2017-07-11 14:22:34.330341 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:34.330594 I | rook-ceph-mon2: 2017-07-11 14:22:34.330510 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1968711862' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:34.894312 I | rook-ceph-mon2: 2017-07-11 14:22:34.894266 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:34.894530 I | rook-ceph-mon2: 2017-07-11 14:22:34.894423 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4191861026' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:35.852106 I | rook-ceph-mon2: 2017-07-11 14:22:35.852049 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:35.852334 I | rook-ceph-mon2: 2017-07-11 14:22:35.852211 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2325997463' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:36.782184 I | rook-ceph-mon2: 2017-07-11 14:22:36.781772 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:36.782554 I | rook-ceph-mon2: 2017-07-11 14:22:36.781799 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3834723103' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:38.211307 I | rook-ceph-mon2: 2017-07-11 14:22:38.211273 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:38.211515 I | rook-ceph-mon2: 2017-07-11 14:22:38.211412 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/67199087' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:38.724329 I | rook-ceph-mon2: 2017-07-11 14:22:38.724032 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:38.724550 I | rook-ceph-mon2: 2017-07-11 14:22:38.724049 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3816690763' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:39.216025 I | rook-ceph-mon2: 2017-07-11 14:22:39.215988 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:39.216201 I | rook-ceph-mon2: 2017-07-11 14:22:39.216121 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1752679084' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:39.682415 I | rook-ceph-mon2: 2017-07-11 14:22:39.682379 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:39.682650 I | rook-ceph-mon2: 2017-07-11 14:22:39.682611 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/839155732' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:40.556019 I | rook-ceph-mon2: 2017-07-11 14:22:40.555984 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:40.556246 I | rook-ceph-mon2: 2017-07-11 14:22:40.556209 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/301029284' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:41.965704 I | rook-ceph-mon2: 2017-07-11 14:22:41.965668 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:41.965975 I | rook-ceph-mon2: 2017-07-11 14:22:41.965816 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2005549286' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:42.472967 I | rook-ceph-mon2: 2017-07-11 14:22:42.472934 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:42.473146 I | rook-ceph-mon2: 2017-07-11 14:22:42.473070 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/9124025' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:42.927559 I | rook-ceph-mon2: 2017-07-11 14:22:42.927514 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:42.927777 I | rook-ceph-mon2: 2017-07-11 14:22:42.927667 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2201038081' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:22:44.632723 I | rook-ceph-mon2: 2017-07-11 14:22:44.632689 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:44.632901 I | rook-ceph-mon2: 2017-07-11 14:22:44.632821 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2787938890' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:46.111209 I | rook-ceph-mon2: 2017-07-11 14:22:46.110892 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:46.111496 I | rook-ceph-mon2: 2017-07-11 14:22:46.110915 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2997999803' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:46.570119 I | rook-ceph-mon2: 2017-07-11 14:22:46.570087 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:46.570339 I | rook-ceph-mon2: 2017-07-11 14:22:46.570310 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4260874007' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:47.517053 I | rook-ceph-mon2: 2017-07-11 14:22:47.517020 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:47.517162 I | rook-ceph-mon2: 2017-07-11 14:22:47.517148 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1013810340' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:48.401947 I | rook-ceph-mon2: 2017-07-11 14:22:48.401915 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:48.402131 I | rook-ceph-mon2: 2017-07-11 14:22:48.402044 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1871580251' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:49.783073 I | rook-ceph-mon2: 2017-07-11 14:22:49.783026 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:49.783305 I | rook-ceph-mon2: 2017-07-11 14:22:49.783266 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/703078699' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:50.264779 I | rook-ceph-mon2: 2017-07-11 14:22:50.264745 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:50.264963 I | rook-ceph-mon2: 2017-07-11 14:22:50.264885 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/740872828' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:51.333535 I | rook-ceph-mon2: 2017-07-11 14:22:51.333497 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:51.333756 I | rook-ceph-mon2: 2017-07-11 14:22:51.333646 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3407161337' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:53.511955 I | rook-ceph-mon2: 2017-07-11 14:22:53.511923 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:53.512059 I | rook-ceph-mon2: 2017-07-11 14:22:53.512044 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3831265983' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:56.466307 I | rook-ceph-mon2: 2017-07-11 14:22:56.466250 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:22:56.466484 I | rook-ceph-mon2: 2017-07-11 14:22:56.466407 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2135285936' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:22:57.933387 I | rook-ceph-mon2: 2017-07-11 14:22:57.933353 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:22:57.933489 I | rook-ceph-mon2: 2017-07-11 14:22:57.933474 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/216118712' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:22:57.993671 I | rook-ceph-mon2: 2017-07-11 14:22:57.993381 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4919 MB, avail 94267 MB
- 2017-07-11 14:22:58.395738 I | rook-ceph-mon2: 2017-07-11 14:22:58.395706 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:22:58.395869 I | rook-ceph-mon2: 2017-07-11 14:22:58.395853 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1836336665' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:22:58.867578 I | rook-ceph-mon2: 2017-07-11 14:22:58.867545 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:22:58.867685 I | rook-ceph-mon2: 2017-07-11 14:22:58.867668 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3253117029' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:23:00.369152 I | rook-ceph-mon2: 2017-07-11 14:23:00.369117 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:23:00.369378 I | rook-ceph-mon2: 2017-07-11 14:23:00.369360 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2968255725' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:23:01.771433 I | rook-ceph-mon2: 2017-07-11 14:23:01.771401 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:01.771621 I | rook-ceph-mon2: 2017-07-11 14:23:01.771541 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/523781424' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:04.583356 I | rook-ceph-mon2: 2017-07-11 14:23:04.583322 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:23:04.583546 I | rook-ceph-mon2: 2017-07-11 14:23:04.583465 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/432452993' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:23:06.041912 I | rook-ceph-mon2: 2017-07-11 14:23:06.041876 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:06.042115 I | rook-ceph-mon2: 2017-07-11 14:23:06.042028 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/326657650' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:06.542981 I | rook-ceph-mon2: 2017-07-11 14:23:06.542946 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:23:06.543179 I | rook-ceph-mon2: 2017-07-11 14:23:06.543092 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/529340500' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:23:09.703221 I | rook-ceph-mon2: 2017-07-11 14:23:09.703185 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:09.703463 I | rook-ceph-mon2: 2017-07-11 14:23:09.703445 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/849850360' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:10.290254 I | rook-ceph-mon2: 2017-07-11 14:23:10.290116 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:10.290272 I | rook-ceph-mon2: 2017-07-11 14:23:10.290155 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4197458039' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:10.694745 I | rook-ceph-mon2: 2017-07-11 14:23:10.694710 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:23:10.694964 I | rook-ceph-mon2: 2017-07-11 14:23:10.694940 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1703522535' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:23:11.138302 I | rook-ceph-mon2: 2017-07-11 14:23:11.138268 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:23:11.138537 I | rook-ceph-mon2: 2017-07-11 14:23:11.138497 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3583976493' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:23:13.551674 I | rook-ceph-mon2: 2017-07-11 14:23:13.551638 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:13.551921 I | rook-ceph-mon2: 2017-07-11 14:23:13.551903 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3989175035' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:14.957131 I | rook-ceph-mon2: 2017-07-11 14:23:14.957092 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:23:14.957381 I | rook-ceph-mon2: 2017-07-11 14:23:14.957240 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1302317680' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:23:15.645012 I | rook-ceph-mon2: 2017-07-11 14:23:15.644976 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:23:15.645221 I | rook-ceph-mon2: 2017-07-11 14:23:15.645137 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/196054307' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:23:16.258423 I | rook-ceph-mon2: 2017-07-11 14:23:16.258371 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:23:16.258490 I | rook-ceph-mon2: 2017-07-11 14:23:16.258474 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2829916009' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:23:28.155197 I | rook-ceph-mon2: 2017-07-11 14:23:28.155082 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #62. Immutable memtables: 0.
- 2017-07-11 14:23:28.155287 I | rook-ceph-mon2:
- 2017-07-11 14:23:28.155308 I | rook-ceph-mon2: 2017-07-11 14:23:28.155127 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 38] Syncing log #60
- 2017-07-11 14:23:28.226917 I | rook-ceph-mon2: 2017-07-11 14:23:28.223782 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.155121) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:23:28.226979 I | rook-ceph-mon2: 2017-07-11 14:23:28.223791 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 38] Flushing memtable with next log file: 62
- 2017-07-11 14:23:28.226995 I | rook-ceph-mon2:
- 2017-07-11 14:23:28.227008 I | rook-ceph-mon2: 2017-07-11 14:23:28.223800 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008223796, "job": 38, "event": "flush_started", "num_memtables": 1, "num_entries": 1586, "num_deletes": 251, "memory_usage": 4924344}
- 2017-07-11 14:23:28.227037 I | rook-ceph-mon2: 2017-07-11 14:23:28.223802 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 38] Level-0 flush table #63: started
- 2017-07-11 14:23:28.362217 I | rook-ceph-mon2: 2017-07-11 14:23:28.362170 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008362159, "cf_name": "default", "job": 38, "event": "table_file_creation", "file_number": 63, "file_size": 2832397, "table_properties": {"data_size": 2822942, "index_size": 8637, "filter_size": 0, "raw_key_size": 11757, "raw_average_key_size": 19, "raw_value_size": 2808467, "raw_average_value_size": 4559, "num_data_blocks": 278, "num_entries": 616, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:23:28.362353 I | rook-ceph-mon2: 2017-07-11 14:23:28.362335 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 38] Level-0 flush table #63: 2832397 bytes OK
- 2017-07-11 14:23:28.425151 I | rook-ceph-mon2: 2017-07-11 14:23:28.425121 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.391926) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #63 started
- 2017-07-11 14:23:28.425226 I | rook-ceph-mon2: 2017-07-11 14:23:28.425210 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.425072) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #63: memtable #1 done
- 2017-07-11 14:23:28.425259 I | rook-ceph-mon2: 2017-07-11 14:23:28.425245 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.425093) EVENT_LOG_v1 {"time_micros": 1499783008425088, "job": 38, "event": "flush_finished", "lsm_state": [2, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:23:28.425288 I | rook-ceph-mon2: 2017-07-11 14:23:28.425275 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.425108) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[2 1 0 0 0 0 0] max score 0.50
- 2017-07-11 14:23:28.425303 I | rook-ceph-mon2:
- 2017-07-11 14:23:28.425344 I | rook-ceph-mon2: 2017-07-11 14:23:28.425320 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 38] Try to delete WAL files size 4882084, prev total WAL file size 4882084, number of live WAL files 2.
- 2017-07-11 14:23:28.425368 I | rook-ceph-mon2:
- 2017-07-11 14:23:28.431601 I | rook-ceph-mon2: 2017-07-11 14:23:28.426065 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:23:28.431669 I | rook-ceph-mon2: 2017-07-11 14:23:28.426186 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:23:28.431695 I | rook-ceph-mon2: 2017-07-11 14:23:28.426189 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:23:28.431725 I | rook-ceph-mon2: ** DB Stats **
- 2017-07-11 14:23:28.431767 I | rook-ceph-mon2: Uptime(secs): 3571.2 total, 711.4 interval
- 2017-07-11 14:23:28.431781 I | rook-ceph-mon2: Cumulative writes: 5592 writes, 25K keys, 5592 commit groups, 1.0 writes per commit group, ingest: 0.07 GB, 0.02 MB/s
- 2017-07-11 14:23:28.431810 I | rook-ceph-mon2: Cumulative WAL: 5592 writes, 5592 syncs, 1.00 writes per sync, written: 0.07 GB, 0.02 MB/s
- 2017-07-11 14:23:28.431823 I | rook-ceph-mon2: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:23:28.431834 I | rook-ceph-mon2: Interval writes: 1446 writes, 7291 keys, 1446 commit groups, 1.0 writes per commit group, ingest: 19.53 MB, 0.03 MB/s
- 2017-07-11 14:23:28.431845 I | rook-ceph-mon2: Interval WAL: 1446 writes, 1446 syncs, 1.00 writes per sync, written: 0.02 MB, 0.03 MB/s
- 2017-07-11 14:23:28.431856 I | rook-ceph-mon2: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:23:28.431889 I | rook-ceph-mon2:
- 2017-07-11 14:23:28.431912 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 14:23:28.431923 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:23:28.431933 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:23:28.431949 I | rook-ceph-mon2: L0 2/2 2.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.6 3 20 0.146 0 0
- 2017-07-11 14:23:28.431989 I | rook-ceph-mon2: L1 1/1 13.05 MB 0.0 0.2 0.0 0.2 0.2 0.0 0.0 5.2 36.3 32.1 6 17 0.376 36K 7346
- 2017-07-11 14:23:28.432000 I | rook-ceph-mon2: Sum 3/3 15.76 MB 0.0 0.2 0.0 0.2 0.2 0.1 0.0 5.8 24.9 26.6 9 37 0.252 36K 7346
- 2017-07-11 14:23:28.432011 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 6.8 23.0 23.3 3 11 0.317 13K 2949
- 2017-07-11 14:23:28.432021 I | rook-ceph-mon2: Uptime(secs): 3571.2 total, 3571.2 interval
- 2017-07-11 14:23:28.432032 I | rook-ceph-mon2: Flush(GB): cumulative 0.042, interval 0.012
- 2017-07-11 14:23:28.432054 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:23:28.432067 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:23:28.432077 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:23:28.432088 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:23:28.432098 I | rook-ceph-mon2: Cumulative compaction: 0.24 GB write, 0.07 MB/s write, 0.23 GB read, 0.07 MB/s read, 9.3 seconds
- 2017-07-11 14:23:28.432109 I | rook-ceph-mon2: Interval compaction: 0.08 GB write, 0.02 MB/s write, 0.08 GB read, 0.02 MB/s read, 3.5 seconds
- 2017-07-11 14:23:28.432132 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:23:28.432145 I | rook-ceph-mon2:
- 2017-07-11 14:23:28.432156 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:23:28.432183 I | rook-ceph-mon2:
- 2017-07-11 14:23:28.432195 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 14:23:28.432221 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:23:28.432232 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:23:28.432253 I | rook-ceph-mon2: L0 2/2 2.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 14.6 3 20 0.146 0 0
- 2017-07-11 14:23:28.432264 I | rook-ceph-mon2: L1 1/1 13.05 MB 0.0 0.2 0.0 0.2 0.2 0.0 0.0 5.2 36.3 32.1 6 17 0.376 36K 7346
- 2017-07-11 14:23:28.432311 I | rook-ceph-mon2: Sum 3/3 15.76 MB 0.0 0.2 0.0 0.2 0.2 0.1 0.0 5.8 24.9 26.6 9 37 0.252 36K 7346
- 2017-07-11 14:23:28.432323 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:23:28.432334 I | rook-ceph-mon2: Uptime(secs): 3571.2 total, 3571.2 interval
- 2017-07-11 14:23:28.432344 I | rook-ceph-mon2: Flush(GB): cumulative 0.042, interval 0.000
- 2017-07-11 14:23:28.432366 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:23:28.432389 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:23:28.432401 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:23:28.432411 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:23:28.432422 I | rook-ceph-mon2: Cumulative compaction: 0.24 GB write, 0.07 MB/s write, 0.23 GB read, 0.07 MB/s read, 9.3 seconds
- 2017-07-11 14:23:28.432445 I | rook-ceph-mon2: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:23:28.432458 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:23:28.432469 I | rook-ceph-mon2:
- 2017-07-11 14:23:28.432480 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:23:28.432501 I | rook-ceph-mon2:
- 2017-07-11 14:23:28.432541 I | rook-ceph-mon2: 2017-07-11 14:23:28.426204 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.426200) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:23:28.432554 I | rook-ceph-mon2:
- 2017-07-11 14:23:28.432566 I | rook-ceph-mon2: 2017-07-11 14:23:28.426208 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 39] Compacting 2@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:23:28.432578 I | rook-ceph-mon2: 2017-07-11 14:23:28.426213 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 38 Base level 0, inputs: [63(2766KB) 61(13KB)], [59(13MB)]
- 2017-07-11 14:23:28.432589 I | rook-ceph-mon2:
- 2017-07-11 14:23:28.432622 I | rook-ceph-mon2: 2017-07-11 14:23:28.426221 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008426215, "job": 39, "event": "compaction_started", "files_L0": [63, 61], "files_L1": [59], "score": -1, "input_data_size": 16527802}
- 2017-07-11 14:23:28.593744 I | rook-ceph-mon2: 2017-07-11 14:23:28.593697 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 39] Generated table #64: 2256 keys, 15285670 bytes
- 2017-07-11 14:23:28.593919 I | rook-ceph-mon2: 2017-07-11 14:23:28.593840 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008593830, "cf_name": "default", "job": 39, "event": "table_file_creation", "file_number": 64, "file_size": 15285670, "table_properties": {"data_size": 15235790, "index_size": 49061, "filter_size": 0, "raw_key_size": 41998, "raw_average_key_size": 18, "raw_value_size": 15170106, "raw_average_value_size": 6724, "num_data_blocks": 1526, "num_entries": 2256, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:23:28.664039 I | rook-ceph-mon2: 2017-07-11 14:23:28.664009 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 39] Compacted 2@0 + 1@1 files to L1 => 15285670 bytes
- 2017-07-11 14:23:28.695128 I | rook-ceph-mon2: 2017-07-11 14:23:28.695098 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.695029) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 69.5 rd, 64.3 wr, level 1, files in(2, 1) out(1) MB in(2.7, 13.0) out(14.6), read-write-amplify(11.2) write-amplify(5.4) OK, records in: 2706, records dropped: 450
- 2017-07-11 14:23:28.695171 I | rook-ceph-mon2:
- 2017-07-11 14:23:28.695206 I | rook-ceph-mon2: 2017-07-11 14:23:28.695189 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:23:28.695048) EVENT_LOG_v1 {"time_micros": 1499783008695040, "job": 39, "event": "compaction_finished", "compaction_time_micros": 237773, "output_level": 1, "num_output_files": 1, "total_output_size": 15285670, "num_input_records": 2706, "num_output_records": 2256, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:23:28.695796 I | rook-ceph-mon2: 2017-07-11 14:23:28.695781 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008695778, "job": 39, "event": "table_file_deletion", "file_number": 63}
- 2017-07-11 14:23:28.695947 I | rook-ceph-mon2: 2017-07-11 14:23:28.695876 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008695874, "job": 39, "event": "table_file_deletion", "file_number": 61}
- 2017-07-11 14:23:28.697389 I | rook-ceph-mon2: 2017-07-11 14:23:28.697374 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783008697372, "job": 39, "event": "table_file_deletion", "file_number": 59}
- 2017-07-11 14:23:28.697455 I | rook-ceph-mon2: 2017-07-11 14:23:28.697440 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:23:47.008586 I | rook-ceph-mon2: 2017-07-11 14:23:47.008549 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:23:47.008839 I | rook-ceph-mon2: 2017-07-11 14:23:47.008822 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3703167718' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:23:47.947121 I | rook-ceph-mon2: 2017-07-11 14:23:47.947087 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:47.947307 I | rook-ceph-mon2: 2017-07-11 14:23:47.947226 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/843582498' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:48.417113 I | rook-ceph-mon2: 2017-07-11 14:23:48.417078 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:48.417383 I | rook-ceph-mon2: 2017-07-11 14:23:48.417271 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4000164017' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:50.649838 I | rook-ceph-mon2: 2017-07-11 14:23:50.649805 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:23:50.650012 I | rook-ceph-mon2: 2017-07-11 14:23:50.649934 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1736823753' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:23:52.059496 I | rook-ceph-mon2: 2017-07-11 14:23:52.059445 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:52.059699 I | rook-ceph-mon2: 2017-07-11 14:23:52.059607 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2698300684' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:53.688077 I | rook-ceph-mon2: 2017-07-11 14:23:53.688031 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:23:53.688443 I | rook-ceph-mon2: 2017-07-11 14:23:53.688421 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2985615075' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:23:56.616369 I | rook-ceph-mon2: 2017-07-11 14:23:56.616336 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:23:56.616538 I | rook-ceph-mon2: 2017-07-11 14:23:56.616460 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1047832676' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:23:57.068427 I | rook-ceph-mon2: 2017-07-11 14:23:57.068392 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:23:57.068651 I | rook-ceph-mon2: 2017-07-11 14:23:57.068529 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1178198799' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:23:57.995535 I | rook-ceph-mon2: 2017-07-11 14:23:57.995243 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4920 MB, avail 94266 MB
- 2017-07-11 14:23:58.482118 I | rook-ceph-mon2: 2017-07-11 14:23:58.482072 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:23:58.482315 I | rook-ceph-mon2: 2017-07-11 14:23:58.482235 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2621994914' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:23:59.402287 I | rook-ceph-mon2: 2017-07-11 14:23:59.402251 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:59.402509 I | rook-ceph-mon2: 2017-07-11 14:23:59.402491 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1058991014' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:23:59.859127 I | rook-ceph-mon2: 2017-07-11 14:23:59.859092 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:23:59.859315 I | rook-ceph-mon2: 2017-07-11 14:23:59.859232 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2686591486' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:00.071108 I | rook-ceph-mon2: 2017-07-11 14:24:00.070996 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #65. Immutable memtables: 0.
- 2017-07-11 14:24:00.071195 I | rook-ceph-mon2:
- 2017-07-11 14:24:00.071215 I | rook-ceph-mon2: 2017-07-11 14:24:00.071055 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 40] Syncing log #62
- 2017-07-11 14:24:00.098017 I | rook-ceph-mon2: 2017-07-11 14:24:00.088502 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.071049) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:24:00.098066 I | rook-ceph-mon2: 2017-07-11 14:24:00.088511 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 40] Flushing memtable with next log file: 65
- 2017-07-11 14:24:00.098086 I | rook-ceph-mon2:
- 2017-07-11 14:24:00.098111 I | rook-ceph-mon2: 2017-07-11 14:24:00.088520 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040088516, "job": 40, "event": "flush_started", "num_memtables": 1, "num_entries": 490, "num_deletes": 251, "memory_usage": 862880}
- 2017-07-11 14:24:00.098145 I | rook-ceph-mon2: 2017-07-11 14:24:00.088522 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 40] Level-0 flush table #66: started
- 2017-07-11 14:24:00.188618 I | rook-ceph-mon2: 2017-07-11 14:24:00.188583 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040188561, "cf_name": "default", "job": 40, "event": "table_file_creation", "file_number": 66, "file_size": 565374, "table_properties": {"data_size": 562644, "index_size": 1916, "filter_size": 0, "raw_key_size": 6081, "raw_average_key_size": 18, "raw_value_size": 556845, "raw_average_value_size": 1677, "num_data_blocks": 62, "num_entries": 332, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:24:00.198001 I | rook-ceph-mon2: 2017-07-11 14:24:00.197977 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 40] Level-0 flush table #66: 565374 bytes OK
- 2017-07-11 14:24:00.266757 I | rook-ceph-mon2: 2017-07-11 14:24:00.266626 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.237071) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #66 started
- 2017-07-11 14:24:00.266856 I | rook-ceph-mon2: 2017-07-11 14:24:00.266840 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.266545) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #66: memtable #1 done
- 2017-07-11 14:24:00.266907 I | rook-ceph-mon2: 2017-07-11 14:24:00.266874 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.266576) EVENT_LOG_v1 {"time_micros": 1499783040266566, "job": 40, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:24:00.266955 I | rook-ceph-mon2: 2017-07-11 14:24:00.266941 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.266600) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:24:00.266986 I | rook-ceph-mon2:
- 2017-07-11 14:24:00.267041 I | rook-ceph-mon2: 2017-07-11 14:24:00.267028 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 40] Try to delete WAL files size 850553, prev total WAL file size 850553, number of live WAL files 2.
- 2017-07-11 14:24:00.267072 I | rook-ceph-mon2:
- 2017-07-11 14:24:00.268737 I | rook-ceph-mon2: 2017-07-11 14:24:00.267426 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:24:00.268783 I | rook-ceph-mon2: 2017-07-11 14:24:00.267458 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.267453) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:24:00.268798 I | rook-ceph-mon2:
- 2017-07-11 14:24:00.268810 I | rook-ceph-mon2: 2017-07-11 14:24:00.267463 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 41] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:24:00.268821 I | rook-ceph-mon2: 2017-07-11 14:24:00.267467 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 40 Base level 0, inputs: [66(552KB)], [64(14MB)]
- 2017-07-11 14:24:00.268846 I | rook-ceph-mon2:
- 2017-07-11 14:24:00.268858 I | rook-ceph-mon2: 2017-07-11 14:24:00.267477 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040267470, "job": 41, "event": "compaction_started", "files_L0": [66], "files_L1": [64], "score": -1, "input_data_size": 15851044}
- 2017-07-11 14:24:00.356235 I | rook-ceph-mon2: 2017-07-11 14:24:00.356184 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 41] Generated table #67: 2079 keys, 13675781 bytes
- 2017-07-11 14:24:00.358641 I | rook-ceph-mon2: 2017-07-11 14:24:00.358622 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040358613, "cf_name": "default", "job": 41, "event": "table_file_creation", "file_number": 67, "file_size": 13675781, "table_properties": {"data_size": 13631668, "index_size": 43294, "filter_size": 0, "raw_key_size": 38858, "raw_average_key_size": 18, "raw_value_size": 13572372, "raw_average_value_size": 6528, "num_data_blocks": 1337, "num_entries": 2079, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:24:00.408865 I | rook-ceph-mon2: 2017-07-11 14:24:00.408822 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 41] Compacted 1@0 + 1@1 files to L1 => 13675781 bytes
- 2017-07-11 14:24:00.452554 I | rook-ceph-mon2: 2017-07-11 14:24:00.452517 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.452443) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 112.2 rd, 96.8 wr, level 1, files in(1, 1) out(1) MB in(0.5, 14.6) out(13.0), read-write-amplify(52.2) write-amplify(24.2) OK, records in: 2588, records dropped: 509
- 2017-07-11 14:24:00.452770 I | rook-ceph-mon2:
- 2017-07-11 14:24:00.452822 I | rook-ceph-mon2: 2017-07-11 14:24:00.452801 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:24:00.452468) EVENT_LOG_v1 {"time_micros": 1499783040452459, "job": 41, "event": "compaction_finished", "compaction_time_micros": 141325, "output_level": 1, "num_output_files": 1, "total_output_size": 13675781, "num_input_records": 2588, "num_output_records": 2079, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:24:00.454967 I | rook-ceph-mon2: 2017-07-11 14:24:00.454950 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040454947, "job": 41, "event": "table_file_deletion", "file_number": 66}
- 2017-07-11 14:24:00.472183 I | rook-ceph-mon2: 2017-07-11 14:24:00.472165 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783040472163, "job": 41, "event": "table_file_deletion", "file_number": 64}
- 2017-07-11 14:24:01.336663 I | rook-ceph-mon2: 2017-07-11 14:24:01.336608 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:01.336856 I | rook-ceph-mon2: 2017-07-11 14:24:01.336771 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4186103102' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:03.493468 I | rook-ceph-mon2: 2017-07-11 14:24:03.493434 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:03.493639 I | rook-ceph-mon2: 2017-07-11 14:24:03.493561 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3122243743' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:04.875631 I | rook-ceph-mon2: 2017-07-11 14:24:04.875595 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:04.875839 I | rook-ceph-mon2: 2017-07-11 14:24:04.875737 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1707102730' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:24:05.376391 I | rook-ceph-mon2: 2017-07-11 14:24:05.376357 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:05.376605 I | rook-ceph-mon2: 2017-07-11 14:24:05.376578 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3938938034' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:07.486314 I | rook-ceph-mon2: 2017-07-11 14:24:07.486268 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:07.486511 I | rook-ceph-mon2: 2017-07-11 14:24:07.486414 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1328677620' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:08.418764 I | rook-ceph-mon2: 2017-07-11 14:24:08.418717 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:08.418956 I | rook-ceph-mon2: 2017-07-11 14:24:08.418859 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2914855997' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:09.396235 I | rook-ceph-mon2: 2017-07-11 14:24:09.396202 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:09.396340 I | rook-ceph-mon2: 2017-07-11 14:24:09.396326 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/111783485' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:12.777065 I | rook-ceph-mon2: 2017-07-11 14:24:12.777029 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:12.777290 I | rook-ceph-mon2: 2017-07-11 14:24:12.777184 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2855423971' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:24:13.223533 I | rook-ceph-mon2: 2017-07-11 14:24:13.223498 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:13.223640 I | rook-ceph-mon2: 2017-07-11 14:24:13.223624 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2534726058' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:14.479545 I | rook-ceph-mon2: 2017-07-11 14:24:14.479510 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:14.479803 I | rook-ceph-mon2: 2017-07-11 14:24:14.479657 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4209408604' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:15.564266 I | rook-ceph-mon2: 2017-07-11 14:24:15.558334 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:15.564804 I | rook-ceph-mon2: 2017-07-11 14:24:15.564493 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1480601836' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:17.037083 I | rook-ceph-mon2: 2017-07-11 14:24:17.037013 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:17.042983 I | rook-ceph-mon2: 2017-07-11 14:24:17.037032 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/371966226' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:24:18.764926 I | rook-ceph-mon2: 2017-07-11 14:24:18.764893 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:18.765119 I | rook-ceph-mon2: 2017-07-11 14:24:18.765036 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2172092508' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:19.381618 I | rook-ceph-mon2: 2017-07-11 14:24:19.381582 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:24:19.381797 I | rook-ceph-mon2: 2017-07-11 14:24:19.381714 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2047385436' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:24:19.864011 I | rook-ceph-mon2: 2017-07-11 14:24:19.863974 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:19.864203 I | rook-ceph-mon2: 2017-07-11 14:24:19.864119 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4190446885' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:20.727713 I | rook-ceph-mon2: 2017-07-11 14:24:20.727666 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:20.727957 I | rook-ceph-mon2: 2017-07-11 14:24:20.727917 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/460142883' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:21.807355 I | rook-ceph-mon2: 2017-07-11 14:24:21.807077 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:21.807454 I | rook-ceph-mon2: 2017-07-11 14:24:21.807099 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3944921699' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:22.726840 I | rook-ceph-mon2: 2017-07-11 14:24:22.726779 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:24:22.729652 I | rook-ceph-mon2: 2017-07-11 14:24:22.729625 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/803154869' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:24:23.774667 I | rook-ceph-mon2: 2017-07-11 14:24:23.774637 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:23.774898 I | rook-ceph-mon2: 2017-07-11 14:24:23.774859 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4038036400' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:24.762575 I | rook-ceph-mon2: 2017-07-11 14:24:24.762541 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:24.762828 I | rook-ceph-mon2: 2017-07-11 14:24:24.762777 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3782746523' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:25.412691 I | rook-ceph-mon2: 2017-07-11 14:24:25.412647 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:25.412871 I | rook-ceph-mon2: 2017-07-11 14:24:25.412782 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2993319898' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:24:25.904096 I | rook-ceph-mon2: 2017-07-11 14:24:25.904060 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:25.904320 I | rook-ceph-mon2: 2017-07-11 14:24:25.904203 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1573356475' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:27.873178 I | rook-ceph-mon2: 2017-07-11 14:24:27.873142 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:27.873369 I | rook-ceph-mon2: 2017-07-11 14:24:27.873285 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1180592353' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:29.330962 I | rook-ceph-mon2: 2017-07-11 14:24:29.330902 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:29.331050 I | rook-ceph-mon2: 2017-07-11 14:24:29.331034 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3882166218' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:24:30.692087 I | rook-ceph-mon2: 2017-07-11 14:24:30.692054 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:30.692311 I | rook-ceph-mon2: 2017-07-11 14:24:30.692295 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/697285253' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:32.246605 I | rook-ceph-mon2: 2017-07-11 14:24:32.246572 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:32.246792 I | rook-ceph-mon2: 2017-07-11 14:24:32.246709 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3204859144' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:32.705449 I | rook-ceph-mon2: 2017-07-11 14:24:32.705418 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:32.705622 I | rook-ceph-mon2: 2017-07-11 14:24:32.705547 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3441070083' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:33.178177 I | rook-ceph-mon2: 2017-07-11 14:24:33.178143 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:33.178279 I | rook-ceph-mon2: 2017-07-11 14:24:33.178265 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1539283946' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:24:33.661224 I | rook-ceph-mon2: 2017-07-11 14:24:33.661194 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:33.661439 I | rook-ceph-mon2: 2017-07-11 14:24:33.661408 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3398129054' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:36.082619 I | rook-ceph-mon2: 2017-07-11 14:24:36.082582 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:36.082829 I | rook-ceph-mon2: 2017-07-11 14:24:36.082724 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3149235181' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:36.600222 I | rook-ceph-mon2: 2017-07-11 14:24:36.600148 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:36.600428 I | rook-ceph-mon2: 2017-07-11 14:24:36.600348 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2166002911' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:36.698043 I | rook-ceph-mon2: 2017-07-11 14:24:35.562760 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 823 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0706579s > max 0.05s
- 2017-07-11 14:24:36.698255 I | rook-ceph-mon2: 2017-07-11 14:24:35.578916 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 824 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.137923s > max 0.05s
- 2017-07-11 14:24:37.094586 I | rook-ceph-mon2: 2017-07-11 14:24:37.094404 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:37.094670 I | rook-ceph-mon2: 2017-07-11 14:24:37.094424 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3484759386' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:24:37.567448 I | rook-ceph-mon2: 2017-07-11 14:24:37.567418 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:37.567625 I | rook-ceph-mon2: 2017-07-11 14:24:37.567547 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3366902187' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:38.475514 I | rook-ceph-mon2: 2017-07-11 14:24:38.475481 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:38.475697 I | rook-ceph-mon2: 2017-07-11 14:24:38.475610 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2419839324' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:39.368903 I | rook-ceph-mon2: 2017-07-11 14:24:39.368868 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:39.369118 I | rook-ceph-mon2: 2017-07-11 14:24:39.369015 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3089417144' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:39.869077 I | rook-ceph-mon2: 2017-07-11 14:24:39.869040 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:39.869275 I | rook-ceph-mon2: 2017-07-11 14:24:39.869187 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/262848901' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:40.769464 I | rook-ceph-mon2: 2017-07-11 14:24:40.769420 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:40.769658 I | rook-ceph-mon2: 2017-07-11 14:24:40.769572 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1308073262' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:24:41.212314 I | rook-ceph-mon2: 2017-07-11 14:24:41.212278 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:41.212558 I | rook-ceph-mon2: 2017-07-11 14:24:41.212537 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2405635' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:42.202836 I | rook-ceph-mon2: 2017-07-11 14:24:42.202567 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:42.202955 I | rook-ceph-mon2: 2017-07-11 14:24:42.202594 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2269677882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:43.123290 I | rook-ceph-mon2: 2017-07-11 14:24:43.123244 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:43.123518 I | rook-ceph-mon2: 2017-07-11 14:24:43.123399 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/107966401' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:43.635315 I | rook-ceph-mon2: 2017-07-11 14:24:43.635283 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:43.635487 I | rook-ceph-mon2: 2017-07-11 14:24:43.635414 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1220407854' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:45.104337 I | rook-ceph-mon2: 2017-07-11 14:24:45.104300 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:45.104516 I | rook-ceph-mon2: 2017-07-11 14:24:45.104434 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3823792165' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:46.106456 I | rook-ceph-mon2: 2017-07-11 14:24:46.106420 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:46.106694 I | rook-ceph-mon2: 2017-07-11 14:24:46.106647 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/227597237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:47.063848 I | rook-ceph-mon2: 2017-07-11 14:24:47.063813 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:47.064039 I | rook-ceph-mon2: 2017-07-11 14:24:47.063955 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2085799037' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:47.535907 I | rook-ceph-mon2: 2017-07-11 14:24:47.535799 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:47.535975 I | rook-ceph-mon2: 2017-07-11 14:24:47.535820 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/179937505' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:47.977652 I | rook-ceph-mon2: 2017-07-11 14:24:47.977618 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:47.977839 I | rook-ceph-mon2: 2017-07-11 14:24:47.977760 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3778524168' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:48.418150 I | rook-ceph-mon2: 2017-07-11 14:24:48.418098 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:48.418474 I | rook-ceph-mon2: 2017-07-11 14:24:48.418456 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3382553726' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:24:48.869487 I | rook-ceph-mon2: 2017-07-11 14:24:48.869449 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:48.869665 I | rook-ceph-mon2: 2017-07-11 14:24:48.869590 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1837183896' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:49.814592 I | rook-ceph-mon2: 2017-07-11 14:24:49.814558 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:49.814813 I | rook-ceph-mon2: 2017-07-11 14:24:49.814782 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3831917171' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:50.717748 I | rook-ceph-mon2: 2017-07-11 14:24:50.717704 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:50.717954 I | rook-ceph-mon2: 2017-07-11 14:24:50.717917 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3453840644' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:51.217859 I | rook-ceph-mon2: 2017-07-11 14:24:51.217826 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:51.218068 I | rook-ceph-mon2: 2017-07-11 14:24:51.218049 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3203356441' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:51.698340 I | rook-ceph-mon2: 2017-07-11 14:24:51.698309 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:51.698576 I | rook-ceph-mon2: 2017-07-11 14:24:51.698559 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1736832175' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:52.166561 I | rook-ceph-mon2: 2017-07-11 14:24:52.166514 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:24:52.166778 I | rook-ceph-mon2: 2017-07-11 14:24:52.166761 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2784173660' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:24:53.683772 I | rook-ceph-mon2: 2017-07-11 14:24:53.683737 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:53.683855 I | rook-ceph-mon2: 2017-07-11 14:24:53.683840 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1417804262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:54.835782 I | rook-ceph-mon2: 2017-07-11 14:24:54.835745 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:54.835889 I | rook-ceph-mon2: 2017-07-11 14:24:54.835874 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2847582223' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:55.378094 I | rook-ceph-mon2: 2017-07-11 14:24:55.378038 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:55.378277 I | rook-ceph-mon2: 2017-07-11 14:24:55.378195 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3739805666' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:55.819870 I | rook-ceph-mon2: 2017-07-11 14:24:55.819836 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:55.820142 I | rook-ceph-mon2: 2017-07-11 14:24:55.820038 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2955035814' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:56.760205 I | rook-ceph-mon2: 2017-07-11 14:24:56.760162 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:56.760425 I | rook-ceph-mon2: 2017-07-11 14:24:56.760392 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1920268802' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:24:57.705542 I | rook-ceph-mon2: 2017-07-11 14:24:57.705509 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:24:57.711747 I | rook-ceph-mon2: 2017-07-11 14:24:57.711684 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3810564634' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:24:58.003761 I | rook-ceph-mon2: 2017-07-11 14:24:58.003473 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4919 MB, avail 94267 MB
- 2017-07-11 14:24:59.139235 I | rook-ceph-mon2: 2017-07-11 14:24:59.139181 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:24:59.139439 I | rook-ceph-mon2: 2017-07-11 14:24:59.139354 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/285393943' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:24:59.677938 I | rook-ceph-mon2: 2017-07-11 14:24:59.677904 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:24:59.678021 I | rook-ceph-mon2: 2017-07-11 14:24:59.677996 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1613832044' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:00.342739 I | rook-ceph-mon2: 2017-07-11 14:25:00.342702 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:00.342960 I | rook-ceph-mon2: 2017-07-11 14:25:00.342928 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4175906421' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:03.220203 I | rook-ceph-mon2: 2017-07-11 14:25:03.220073 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:03.220446 I | rook-ceph-mon2: 2017-07-11 14:25:03.220095 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3739209769' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:03.712598 I | rook-ceph-mon2: 2017-07-11 14:25:03.712562 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:03.712791 I | rook-ceph-mon2: 2017-07-11 14:25:03.712707 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/444302765' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:07.571930 I | rook-ceph-mon2: 2017-07-11 14:25:07.571891 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:07.572134 I | rook-ceph-mon2: 2017-07-11 14:25:07.572117 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/651355317' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:10.449071 I | rook-ceph-mon2: 2017-07-11 14:25:10.449038 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:10.464611 I | rook-ceph-mon2: 2017-07-11 14:25:10.457534 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1412981039' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:10.892337 I | rook-ceph-mon2: 2017-07-11 14:25:10.892303 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:10.892515 I | rook-ceph-mon2: 2017-07-11 14:25:10.892439 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/737232422' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:11.861918 I | rook-ceph-mon2: 2017-07-11 14:25:11.861861 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:11.862104 I | rook-ceph-mon2: 2017-07-11 14:25:11.862024 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/64499367' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:12.568635 I | rook-ceph-mon2: 2017-07-11 14:25:12.568599 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:12.568696 I | rook-ceph-mon2: 2017-07-11 14:25:12.568681 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3846692792' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:14.712857 I | rook-ceph-mon2: 2017-07-11 14:25:14.712812 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:25:14.712973 I | rook-ceph-mon2: 2017-07-11 14:25:14.712958 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1606950250' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:25:15.078742 I | rook-ceph-mon2: 2017-07-11 14:25:15.078712 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:15.084597 I | rook-ceph-mon2: 2017-07-11 14:25:15.084571 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1194432387' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:16.125858 I | rook-ceph-mon2: 2017-07-11 14:25:16.125821 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:16.126041 I | rook-ceph-mon2: 2017-07-11 14:25:16.125961 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3257835257' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:17.127870 I | rook-ceph-mon2: 2017-07-11 14:25:17.127837 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:17.128096 I | rook-ceph-mon2: 2017-07-11 14:25:17.128079 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1461734471' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:19.022268 I | rook-ceph-mon2: 2017-07-11 14:25:19.022237 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:19.022444 I | rook-ceph-mon2: 2017-07-11 14:25:19.022367 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2844760992' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:19.467898 I | rook-ceph-mon2: 2017-07-11 14:25:19.467859 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:19.468070 I | rook-ceph-mon2: 2017-07-11 14:25:19.467994 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/715692210' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:19.944335 I | rook-ceph-mon2: 2017-07-11 14:25:19.944298 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:19.944454 I | rook-ceph-mon2: 2017-07-11 14:25:19.944433 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/820127591' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:20.590567 I | rook-ceph-mon2: 2017-07-11 14:25:20.590533 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:20.590672 I | rook-ceph-mon2: 2017-07-11 14:25:20.590658 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3707271346' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:21.051272 I | rook-ceph-mon2: 2017-07-11 14:25:21.051236 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:21.051507 I | rook-ceph-mon2: 2017-07-11 14:25:21.051470 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1197444192' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:24.473589 I | rook-ceph-mon2: 2017-07-11 14:25:24.473552 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:24.473784 I | rook-ceph-mon2: 2017-07-11 14:25:24.473697 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4155406236' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:24.966828 I | rook-ceph-mon2: 2017-07-11 14:25:24.966782 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:24.967058 I | rook-ceph-mon2: 2017-07-11 14:25:24.967027 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3543078213' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:25.859176 I | rook-ceph-mon2: 2017-07-11 14:25:25.859126 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:25:25.859403 I | rook-ceph-mon2: 2017-07-11 14:25:25.859373 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3007385627' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:25:26.059973 I | rook-ceph-mon2: 2017-07-11 14:25:26.059925 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:26.060210 I | rook-ceph-mon2: 2017-07-11 14:25:26.060169 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2180562788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:27.509608 I | rook-ceph-mon2: 2017-07-11 14:25:27.509468 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:27.515415 I | rook-ceph-mon2: 2017-07-11 14:25:27.509492 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1821821009' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:29.866058 I | rook-ceph-mon2: 2017-07-11 14:25:29.866025 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:29.866255 I | rook-ceph-mon2: 2017-07-11 14:25:29.866169 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/351207853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:30.890515 I | rook-ceph-mon2: 2017-07-11 14:25:30.890485 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:30.890745 I | rook-ceph-mon2: 2017-07-11 14:25:30.890622 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2375306550' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:31.350382 I | rook-ceph-mon2: 2017-07-11 14:25:31.350347 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:31.350590 I | rook-ceph-mon2: 2017-07-11 14:25:31.350573 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1887189895' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:33.863968 I | rook-ceph-mon2: 2017-07-11 14:25:33.863934 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:33.864091 I | rook-ceph-mon2: 2017-07-11 14:25:33.864052 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1794365730' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:35.949248 I | rook-ceph-mon2: 2017-07-11 14:25:35.949214 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:35.949484 I | rook-ceph-mon2: 2017-07-11 14:25:35.949467 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1806692739' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:36.683386 I | rook-ceph-mon2: 2017-07-11 14:25:36.683349 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:36.683599 I | rook-ceph-mon2: 2017-07-11 14:25:36.683581 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/733746950' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:37.161075 I | rook-ceph-mon2: 2017-07-11 14:25:37.161041 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:37.161184 I | rook-ceph-mon2: 2017-07-11 14:25:37.161169 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1649310167' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:39.506551 I | rook-ceph-mon2: 2017-07-11 14:25:39.506504 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:39.506870 I | rook-ceph-mon2: 2017-07-11 14:25:39.506819 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3896049018' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:40.004321 I | rook-ceph-mon2: 2017-07-11 14:25:40.004287 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:40.004524 I | rook-ceph-mon2: 2017-07-11 14:25:40.004439 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/835735548' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:43.213740 I | rook-ceph-mon2: 2017-07-11 14:25:43.213603 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:43.213858 I | rook-ceph-mon2: 2017-07-11 14:25:43.213626 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1085838089' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:43.738115 I | rook-ceph-mon2: 2017-07-11 14:25:43.738083 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:43.738685 I | rook-ceph-mon2: 2017-07-11 14:25:43.738645 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1743410061' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:44.208152 I | rook-ceph-mon2: 2017-07-11 14:25:44.208116 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:44.208345 I | rook-ceph-mon2: 2017-07-11 14:25:44.208328 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4076552076' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:45.722082 I | rook-ceph-mon2: 2017-07-11 14:25:45.722034 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:45.722299 I | rook-ceph-mon2: 2017-07-11 14:25:45.722268 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/937872826' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:46.666480 I | rook-ceph-mon2: 2017-07-11 14:25:46.666423 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:46.666710 I | rook-ceph-mon2: 2017-07-11 14:25:46.666669 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3903489988' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:48.053035 I | rook-ceph-mon2: 2017-07-11 14:25:48.053003 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:48.053138 I | rook-ceph-mon2: 2017-07-11 14:25:48.053124 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2380286091' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:49.423006 I | rook-ceph-mon2: 2017-07-11 14:25:49.422960 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:49.423246 I | rook-ceph-mon2: 2017-07-11 14:25:49.423206 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2021413855' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:50.343168 I | rook-ceph-mon2: 2017-07-11 14:25:50.343127 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:50.343429 I | rook-ceph-mon2: 2017-07-11 14:25:50.343411 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2518107752' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:51.821334 I | rook-ceph-mon2: 2017-07-11 14:25:51.821166 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:51.821418 I | rook-ceph-mon2: 2017-07-11 14:25:51.821186 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/775534257' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:53.310333 I | rook-ceph-mon2: 2017-07-11 14:25:53.310300 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:25:53.310626 I | rook-ceph-mon2: 2017-07-11 14:25:53.310584 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1361905473' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:25:54.312221 I | rook-ceph-mon2: 2017-07-11 14:25:54.312189 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:54.312410 I | rook-ceph-mon2: 2017-07-11 14:25:54.312334 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1923776686' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:54.835259 I | rook-ceph-mon2: 2017-07-11 14:25:54.835227 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:25:54.835434 I | rook-ceph-mon2: 2017-07-11 14:25:54.835358 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2867112089' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:25:55.275523 I | rook-ceph-mon2: 2017-07-11 14:25:55.275480 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:55.275754 I | rook-ceph-mon2: 2017-07-11 14:25:55.275736 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3893073425' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:55.843344 I | rook-ceph-mon2: 2017-07-11 14:25:55.843315 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:25:55.843435 I | rook-ceph-mon2: 2017-07-11 14:25:55.843420 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2667184756' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:25:56.291000 I | rook-ceph-mon2: 2017-07-11 14:25:56.290964 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:56.291238 I | rook-ceph-mon2: 2017-07-11 14:25:56.291131 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3685302245' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:25:58.009861 I | rook-ceph-mon2: 2017-07-11 14:25:58.009613 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4919 MB, avail 94267 MB
- 2017-07-11 14:25:59.120945 I | rook-ceph-mon2: 2017-07-11 14:25:59.120911 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:25:59.121144 I | rook-ceph-mon2: 2017-07-11 14:25:59.121050 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/803906879' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:01.146458 I | rook-ceph-mon2: 2017-07-11 14:26:01.146425 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:01.146694 I | rook-ceph-mon2: 2017-07-11 14:26:01.146634 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/6120100' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:02.611287 I | rook-ceph-mon2: 2017-07-11 14:26:02.611251 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:02.611496 I | rook-ceph-mon2: 2017-07-11 14:26:02.611395 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/404137716' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:04.963635 I | rook-ceph-mon2: 2017-07-11 14:26:04.963604 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:04.963885 I | rook-ceph-mon2: 2017-07-11 14:26:04.963867 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3292932103' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:06.263109 I | rook-ceph-mon2: 2017-07-11 14:26:06.263073 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:06.263332 I | rook-ceph-mon2: 2017-07-11 14:26:06.263289 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1697405133' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:06.735168 I | rook-ceph-mon2: 2017-07-11 14:26:06.735123 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:06.735337 I | rook-ceph-mon2: 2017-07-11 14:26:06.735262 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2298212126' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:07.181281 I | rook-ceph-mon2: 2017-07-11 14:26:07.181244 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:07.181402 I | rook-ceph-mon2: 2017-07-11 14:26:07.181387 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1756927940' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:08.278930 I | rook-ceph-mon2: 2017-07-11 14:26:08.278861 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:08.279124 I | rook-ceph-mon2: 2017-07-11 14:26:08.279040 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2095940429' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:09.184811 I | rook-ceph-mon2: 2017-07-11 14:26:09.184778 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:09.185004 I | rook-ceph-mon2: 2017-07-11 14:26:09.184914 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2928573556' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:11.623327 I | rook-ceph-mon2: 2017-07-11 14:26:11.623293 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:11.623568 I | rook-ceph-mon2: 2017-07-11 14:26:11.623429 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2949437620' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:12.133184 I | rook-ceph-mon2: 2017-07-11 14:26:12.132898 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:12.133503 I | rook-ceph-mon2: 2017-07-11 14:26:12.132918 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4216326269' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:13.198257 I | rook-ceph-mon2: 2017-07-11 14:26:13.198214 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:13.198506 I | rook-ceph-mon2: 2017-07-11 14:26:13.198489 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2282634669' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:14.222243 I | rook-ceph-mon2: 2017-07-11 14:26:14.222211 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:14.222508 I | rook-ceph-mon2: 2017-07-11 14:26:14.222352 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1433882947' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:15.835919 I | rook-ceph-mon2: 2017-07-11 14:26:15.835886 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:15.836125 I | rook-ceph-mon2: 2017-07-11 14:26:15.836094 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2813540356' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:16.334862 I | rook-ceph-mon2: 2017-07-11 14:26:16.334828 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:16.335053 I | rook-ceph-mon2: 2017-07-11 14:26:16.335037 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2664284881' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:17.447978 I | rook-ceph-mon2: 2017-07-11 14:26:17.447944 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:17.448158 I | rook-ceph-mon2: 2017-07-11 14:26:17.448081 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2990212239' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:20.307410 I | rook-ceph-mon2: 2017-07-11 14:26:20.307375 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:20.313317 I | rook-ceph-mon2: 2017-07-11 14:26:20.313195 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3971750926' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:23.116001 I | rook-ceph-mon2: 2017-07-11 14:26:23.110263 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:23.116586 I | rook-ceph-mon2: 2017-07-11 14:26:23.116108 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/817605074' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:23.635673 I | rook-ceph-mon2: 2017-07-11 14:26:23.635638 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:23.635786 I | rook-ceph-mon2: 2017-07-11 14:26:23.635769 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3285004168' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:24.177520 I | rook-ceph-mon2: 2017-07-11 14:26:24.177488 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:24.177689 I | rook-ceph-mon2: 2017-07-11 14:26:24.177614 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3787015269' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:26.704639 I | rook-ceph-mon2: 2017-07-11 14:26:26.704593 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:26.704839 I | rook-ceph-mon2: 2017-07-11 14:26:26.704754 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/152853045' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:27.139315 I | rook-ceph-mon2: 2017-07-11 14:26:27.139282 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:27.139556 I | rook-ceph-mon2: 2017-07-11 14:26:27.139503 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3475108483' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:27.651557 I | rook-ceph-mon2: 2017-07-11 14:26:27.651510 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:27.651768 I | rook-ceph-mon2: 2017-07-11 14:26:27.651738 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2986356578' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:28.122146 I | rook-ceph-mon2: 2017-07-11 14:26:28.122111 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:28.128035 I | rook-ceph-mon2: 2017-07-11 14:26:28.128008 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/991207593' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:29.243542 I | rook-ceph-mon2: 2017-07-11 14:26:29.243509 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:29.243763 I | rook-ceph-mon2: 2017-07-11 14:26:29.243649 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1065058701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:30.758689 I | rook-ceph-mon2: 2017-07-11 14:26:30.758649 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:30.758907 I | rook-ceph-mon2: 2017-07-11 14:26:30.758795 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/961991866' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:31.188617 I | rook-ceph-mon2: 2017-07-11 14:26:31.188583 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:31.188852 I | rook-ceph-mon2: 2017-07-11 14:26:31.188725 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/860892052' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:32.212058 I | rook-ceph-mon2: 2017-07-11 14:26:32.211998 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:32.218125 I | rook-ceph-mon2: 2017-07-11 14:26:32.218106 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1539210539' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:33.127411 I | rook-ceph-mon2: 2017-07-11 14:26:33.127377 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:33.127600 I | rook-ceph-mon2: 2017-07-11 14:26:33.127521 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1039913115' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:35.029059 I | rook-ceph-mon2: 2017-07-11 14:26:35.029024 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:35.029273 I | rook-ceph-mon2: 2017-07-11 14:26:35.029165 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2092232313' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:36.019542 I | rook-ceph-mon2: 2017-07-11 14:26:36.019272 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:36.019628 I | rook-ceph-mon2: 2017-07-11 14:26:36.019294 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4089692247' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:36.940145 I | rook-ceph-mon2: 2017-07-11 14:26:36.940109 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:36.940390 I | rook-ceph-mon2: 2017-07-11 14:26:36.940359 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3832820760' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:37.998940 I | rook-ceph-mon2: 2017-07-11 14:26:37.998823 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:37.999132 I | rook-ceph-mon2: 2017-07-11 14:26:37.999050 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3240081476' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:40.776376 I | rook-ceph-mon2: 2017-07-11 14:26:40.776345 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:40.776567 I | rook-ceph-mon2: 2017-07-11 14:26:40.776482 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1315880397' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:41.695616 I | rook-ceph-mon2: 2017-07-11 14:26:41.695582 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:41.701763 I | rook-ceph-mon2: 2017-07-11 14:26:41.695715 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3871091577' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:42.285703 I | rook-ceph-mon2: 2017-07-11 14:26:42.285672 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:42.285836 I | rook-ceph-mon2: 2017-07-11 14:26:42.285799 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2404821579' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:43.237530 I | rook-ceph-mon2: 2017-07-11 14:26:43.237494 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:43.237753 I | rook-ceph-mon2: 2017-07-11 14:26:43.237662 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2891540080' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:43.739594 I | rook-ceph-mon2: 2017-07-11 14:26:43.739549 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:43.739828 I | rook-ceph-mon2: 2017-07-11 14:26:43.739724 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1762113148' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:43.819157 I | rook-ceph-mon2: 2017-07-11 14:26:43.819125 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:26:43.820912 I | rook-ceph-mon2: 2017-07-11 14:26:43.820893 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/792893878' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:26:45.598199 I | rook-ceph-mon2: 2017-07-11 14:26:45.598166 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:45.598363 I | rook-ceph-mon2: 2017-07-11 14:26:45.598291 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2500767877' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:46.007332 I | rook-ceph-mon2: 2017-07-11 14:26:46.007296 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:46.007573 I | rook-ceph-mon2: 2017-07-11 14:26:46.007524 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1660230458' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:46.429766 I | rook-ceph-mon2: 2017-07-11 14:26:46.429734 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:46.429948 I | rook-ceph-mon2: 2017-07-11 14:26:46.429869 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/649633041' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:46.870264 I | rook-ceph-mon2: 2017-07-11 14:26:46.870231 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:46.870370 I | rook-ceph-mon2: 2017-07-11 14:26:46.870355 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/534566587' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:49.493632 I | rook-ceph-mon2: 2017-07-11 14:26:49.493589 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:49.499370 I | rook-ceph-mon2: 2017-07-11 14:26:49.499349 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/168431725' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:50.819578 I | rook-ceph-mon2: 2017-07-11 14:26:50.819534 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:50.819830 I | rook-ceph-mon2: 2017-07-11 14:26:50.819814 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/799963233' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:51.669697 I | rook-ceph-mon2: 2017-07-11 14:26:51.663796 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:51.669893 I | rook-ceph-mon2: 2017-07-11 14:26:51.669814 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/315226877' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:26:52.745081 I | rook-ceph-mon2: 2017-07-11 14:26:52.745048 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:52.745265 I | rook-ceph-mon2: 2017-07-11 14:26:52.745184 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1779683336' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:53.617180 I | rook-ceph-mon2: 2017-07-11 14:26:53.617144 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:53.617393 I | rook-ceph-mon2: 2017-07-11 14:26:53.617305 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2082302963' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:54.528583 I | rook-ceph-mon2: 2017-07-11 14:26:54.528548 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:54.528648 I | rook-ceph-mon2: 2017-07-11 14:26:54.528633 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/702984905' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:57.167889 I | rook-ceph-mon2: 2017-07-11 14:26:57.167853 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:26:57.168077 I | rook-ceph-mon2: 2017-07-11 14:26:57.167994 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3491362139' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:26:57.650129 I | rook-ceph-mon2: 2017-07-11 14:26:57.650097 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:57.650320 I | rook-ceph-mon2: 2017-07-11 14:26:57.650235 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/73339933' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:58.013000 I | rook-ceph-mon2: 2017-07-11 14:26:58.012774 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4919 MB, avail 94267 MB
- 2017-07-11 14:26:58.084334 I | rook-ceph-mon2: 2017-07-11 14:26:58.084303 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:26:58.084537 I | rook-ceph-mon2: 2017-07-11 14:26:58.084448 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1322195219' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:26:58.152387 I | rook-ceph-mon2: 2017-07-11 14:26:58.152278 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #68. Immutable memtables: 0.
- 2017-07-11 14:26:58.152464 I | rook-ceph-mon2:
- 2017-07-11 14:26:58.152483 I | rook-ceph-mon2: 2017-07-11 14:26:58.152328 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 42] Syncing log #65
- 2017-07-11 14:26:58.201665 I | rook-ceph-mon2: 2017-07-11 14:26:58.181734 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.152322) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:26:58.201753 I | rook-ceph-mon2: 2017-07-11 14:26:58.181743 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 42] Flushing memtable with next log file: 68
- 2017-07-11 14:26:58.201769 I | rook-ceph-mon2:
- 2017-07-11 14:26:58.201781 I | rook-ceph-mon2: 2017-07-11 14:26:58.181759 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218181755, "job": 42, "event": "flush_started", "num_memtables": 1, "num_entries": 2400, "num_deletes": 500, "memory_usage": 7122448}
- 2017-07-11 14:26:58.201803 I | rook-ceph-mon2: 2017-07-11 14:26:58.181761 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 42] Level-0 flush table #69: started
- 2017-07-11 14:26:58.271749 I | rook-ceph-mon2: 2017-07-11 14:26:58.271703 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218271693, "cf_name": "default", "job": 42, "event": "table_file_creation", "file_number": 69, "file_size": 4702775, "table_properties": {"data_size": 4686679, "index_size": 15277, "filter_size": 0, "raw_key_size": 20609, "raw_average_key_size": 18, "raw_value_size": 4660985, "raw_average_value_size": 4199, "num_data_blocks": 484, "num_entries": 1110, "filter_policy_name": "", "kDeletedKeys": "500", "kMergeOperands": "0"}}
- 2017-07-11 14:26:58.271852 I | rook-ceph-mon2: 2017-07-11 14:26:58.271836 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 42] Level-0 flush table #69: 4702775 bytes OK
- 2017-07-11 14:26:58.367192 I | rook-ceph-mon2: 2017-07-11 14:26:58.367156 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.330511) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #69 started
- 2017-07-11 14:26:58.367272 I | rook-ceph-mon2: 2017-07-11 14:26:58.367255 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.367101) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #69: memtable #1 done
- 2017-07-11 14:26:58.367321 I | rook-ceph-mon2: 2017-07-11 14:26:58.367291 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.367129) EVENT_LOG_v1 {"time_micros": 1499783218367120, "job": 42, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:26:58.367351 I | rook-ceph-mon2: 2017-07-11 14:26:58.367337 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.367143) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:26:58.367365 I | rook-ceph-mon2:
- 2017-07-11 14:26:58.367408 I | rook-ceph-mon2: 2017-07-11 14:26:58.367395 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 42] Try to delete WAL files size 7071956, prev total WAL file size 7071956, number of live WAL files 2.
- 2017-07-11 14:26:58.367423 I | rook-ceph-mon2:
- 2017-07-11 14:26:58.369697 I | rook-ceph-mon2: 2017-07-11 14:26:58.368351 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:26:58.369750 I | rook-ceph-mon2: 2017-07-11 14:26:58.368386 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.368382) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:26:58.369769 I | rook-ceph-mon2:
- 2017-07-11 14:26:58.369781 I | rook-ceph-mon2: 2017-07-11 14:26:58.368391 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 43] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:26:58.369808 I | rook-ceph-mon2: 2017-07-11 14:26:58.368396 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 42 Base level 0, inputs: [69(4592KB)], [67(13MB)]
- 2017-07-11 14:26:58.369821 I | rook-ceph-mon2:
- 2017-07-11 14:26:58.369832 I | rook-ceph-mon2: 2017-07-11 14:26:58.368404 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218368398, "job": 43, "event": "compaction_started", "files_L0": [69], "files_L1": [67], "score": -1, "input_data_size": 18378556}
- 2017-07-11 14:26:58.530164 I | rook-ceph-mon2: 2017-07-11 14:26:58.530103 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 43] Generated table #70: 2182 keys, 15523911 bytes
- 2017-07-11 14:26:58.538937 I | rook-ceph-mon2: 2017-07-11 14:26:58.538916 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218538907, "cf_name": "default", "job": 43, "event": "table_file_creation", "file_number": 70, "file_size": 15523911, "table_properties": {"data_size": 15473219, "index_size": 49873, "filter_size": 0, "raw_key_size": 40783, "raw_average_key_size": 18, "raw_value_size": 15408065, "raw_average_value_size": 7061, "num_data_blocks": 1555, "num_entries": 2182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:26:58.624270 I | rook-ceph-mon2: 2017-07-11 14:26:58.624065 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:26:58.624322 I | rook-ceph-mon2: 2017-07-11 14:26:58.624086 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2332426211' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:26:58.632211 I | rook-ceph-mon2: 2017-07-11 14:26:58.632190 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 43] Compacted 1@0 + 1@1 files to L1 => 15523911 bytes
- 2017-07-11 14:26:58.669516 I | rook-ceph-mon2: 2017-07-11 14:26:58.669485 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.669416) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 69.7 rd, 58.9 wr, level 1, files in(1, 1) out(1) MB in(4.5, 13.0) out(14.8), read-write-amplify(7.2) write-amplify(3.3) OK, records in: 3189, records dropped: 1007
- 2017-07-11 14:26:58.678601 I | rook-ceph-mon2:
- 2017-07-11 14:26:58.678867 I | rook-ceph-mon2: 2017-07-11 14:26:58.678713 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:26:58.669436) EVENT_LOG_v1 {"time_micros": 1499783218669428, "job": 43, "event": "compaction_finished", "compaction_time_micros": 263772, "output_level": 1, "num_output_files": 1, "total_output_size": 15523911, "num_input_records": 3189, "num_output_records": 2182, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:26:58.679546 I | rook-ceph-mon2: 2017-07-11 14:26:58.679531 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218679526, "job": 43, "event": "table_file_deletion", "file_number": 69}
- 2017-07-11 14:26:58.680993 I | rook-ceph-mon2: 2017-07-11 14:26:58.680979 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783218680977, "job": 43, "event": "table_file_deletion", "file_number": 67}
- 2017-07-11 14:26:58.681055 I | rook-ceph-mon2: 2017-07-11 14:26:58.681041 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:26:59.716409 I | rook-ceph-mon2: 2017-07-11 14:26:59.716376 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:26:59.716636 I | rook-ceph-mon2: 2017-07-11 14:26:59.716595 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3204969426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:00.991205 I | rook-ceph-mon2: 2017-07-11 14:27:00.991173 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:00.991732 I | rook-ceph-mon2: 2017-07-11 14:27:00.991363 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/699039469' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:01.443475 I | rook-ceph-mon2: 2017-07-11 14:27:01.443441 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:01.443700 I | rook-ceph-mon2: 2017-07-11 14:27:01.443684 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/844086731' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:02.386385 I | rook-ceph-mon2: 2017-07-11 14:27:02.386352 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:02.386562 I | rook-ceph-mon2: 2017-07-11 14:27:02.386486 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2748702023' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:03.449566 I | rook-ceph-mon2: 2017-07-11 14:27:03.449532 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:03.456239 I | rook-ceph-mon2: 2017-07-11 14:27:03.449662 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3299252543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:05.641155 I | rook-ceph-mon2: 2017-07-11 14:27:05.641115 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:05.641379 I | rook-ceph-mon2: 2017-07-11 14:27:05.641261 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1703105455' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:06.504835 I | rook-ceph-mon2: 2017-07-11 14:27:06.504625 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:06.504899 I | rook-ceph-mon2: 2017-07-11 14:27:06.504642 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1463313337' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:08.374965 I | rook-ceph-mon2: 2017-07-11 14:27:08.374932 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:08.375069 I | rook-ceph-mon2: 2017-07-11 14:27:08.375055 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2058962137' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:08.810265 I | rook-ceph-mon2: 2017-07-11 14:27:08.810231 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:08.810444 I | rook-ceph-mon2: 2017-07-11 14:27:08.810368 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1469213832' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:09.668359 I | rook-ceph-mon2: 2017-07-11 14:27:09.668327 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:09.668534 I | rook-ceph-mon2: 2017-07-11 14:27:09.668458 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2322820471' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:11.882857 I | rook-ceph-mon2: 2017-07-11 14:27:11.882821 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:11.889268 I | rook-ceph-mon2: 2017-07-11 14:27:11.889246 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3344621731' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:12.385729 I | rook-ceph-mon2: 2017-07-11 14:27:12.385702 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:12.385886 I | rook-ceph-mon2: 2017-07-11 14:27:12.385824 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2977959924' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:12.808302 I | rook-ceph-mon2: 2017-07-11 14:27:12.805647 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #71. Immutable memtables: 0.
- 2017-07-11 14:27:12.808388 I | rook-ceph-mon2:
- 2017-07-11 14:27:12.808411 I | rook-ceph-mon2: 2017-07-11 14:27:12.805683 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 44] Syncing log #68
- 2017-07-11 14:27:12.840532 I | rook-ceph-mon2: 2017-07-11 14:27:12.839323 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:27:12.805678) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:27:12.849866 I | rook-ceph-mon2: 2017-07-11 14:27:12.839333 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 44] Flushing memtable with next log file: 71
- 2017-07-11 14:27:12.849909 I | rook-ceph-mon2:
- 2017-07-11 14:27:12.849925 I | rook-ceph-mon2: 2017-07-11 14:27:12.839342 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783232839338, "job": 44, "event": "flush_started", "num_memtables": 1, "num_entries": 416, "num_deletes": 251, "memory_usage": 635768}
- 2017-07-11 14:27:12.849968 I | rook-ceph-mon2: 2017-07-11 14:27:12.839345 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 44] Level-0 flush table #72: started
- 2017-07-11 14:27:12.931108 I | rook-ceph-mon2: 2017-07-11 14:27:12.931052 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783232931042, "cf_name": "default", "job": 44, "event": "table_file_creation", "file_number": 72, "file_size": 415056, "table_properties": {"data_size": 412936, "index_size": 1306, "filter_size": 0, "raw_key_size": 5691, "raw_average_key_size": 18, "raw_value_size": 407865, "raw_average_value_size": 1315, "num_data_blocks": 42, "num_entries": 310, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:27:12.938056 I | rook-ceph-mon2: 2017-07-11 14:27:12.938031 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 44] Level-0 flush table #72: 415056 bytes OK
- 2017-07-11 14:27:13.008357 I | rook-ceph-mon2: 2017-07-11 14:27:13.008302 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:27:12.978121) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #72 started
- 2017-07-11 14:27:13.009914 I | rook-ceph-mon2: 2017-07-11 14:27:13.009892 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.008256) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #72: memtable #1 done
- 2017-07-11 14:27:13.009979 I | rook-ceph-mon2: 2017-07-11 14:27:13.009963 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.008276) EVENT_LOG_v1 {"time_micros": 1499783233008270, "job": 44, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:27:13.010012 I | rook-ceph-mon2: 2017-07-11 14:27:13.009999 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.008290) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:27:13.010057 I | rook-ceph-mon2:
- 2017-07-11 14:27:13.010088 I | rook-ceph-mon2: 2017-07-11 14:27:13.010075 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 44] Try to delete WAL files size 624563, prev total WAL file size 624563, number of live WAL files 2.
- 2017-07-11 14:27:13.010103 I | rook-ceph-mon2:
- 2017-07-11 14:27:13.027430 I | rook-ceph-mon2: 2017-07-11 14:27:13.010407 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:27:13.027476 I | rook-ceph-mon2: 2017-07-11 14:27:13.010440 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.010435) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:27:13.027496 I | rook-ceph-mon2:
- 2017-07-11 14:27:13.027509 I | rook-ceph-mon2: 2017-07-11 14:27:13.010445 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 45] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:27:13.027519 I | rook-ceph-mon2: 2017-07-11 14:27:13.010449 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 44 Base level 0, inputs: [72(405KB)], [70(14MB)]
- 2017-07-11 14:27:13.027530 I | rook-ceph-mon2:
- 2017-07-11 14:27:13.027558 I | rook-ceph-mon2: 2017-07-11 14:27:13.010459 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233010452, "job": 45, "event": "compaction_started", "files_L0": [72], "files_L1": [70], "score": -1, "input_data_size": 15938967}
- 2017-07-11 14:27:13.363352 I | rook-ceph-mon2: 2017-07-11 14:27:13.363306 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 45] Generated table #73: 1983 keys, 13391484 bytes
- 2017-07-11 14:27:13.364554 I | rook-ceph-mon2: 2017-07-11 14:27:13.364534 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233364522, "cf_name": "default", "job": 45, "event": "table_file_creation", "file_number": 73, "file_size": 13391484, "table_properties": {"data_size": 13347190, "index_size": 43475, "filter_size": 0, "raw_key_size": 37253, "raw_average_key_size": 18, "raw_value_size": 13289158, "raw_average_value_size": 6701, "num_data_blocks": 1346, "num_entries": 1983, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:27:13.400027 I | rook-ceph-mon2: 2017-07-11 14:27:13.399858 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 45] Compacted 1@0 + 1@1 files to L1 => 13391484 bytes
- 2017-07-11 14:27:13.437727 I | rook-ceph-mon2: 2017-07-11 14:27:13.437699 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.437620) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 40.9 rd, 34.4 wr, level 1, files in(1, 1) out(1) MB in(0.4, 14.8) out(12.8), read-write-amplify(70.7) write-amplify(32.3) OK, records in: 2492, records dropped: 509
- 2017-07-11 14:27:13.439405 I | rook-ceph-mon2:
- 2017-07-11 14:27:13.439460 I | rook-ceph-mon2: 2017-07-11 14:27:13.439441 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:27:13.437642) EVENT_LOG_v1 {"time_micros": 1499783233437633, "job": 45, "event": "compaction_finished", "compaction_time_micros": 389382, "output_level": 1, "num_output_files": 1, "total_output_size": 13391484, "num_input_records": 2492, "num_output_records": 1983, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:27:13.439686 I | rook-ceph-mon2: 2017-07-11 14:27:13.439672 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233439669, "job": 45, "event": "table_file_deletion", "file_number": 72}
- 2017-07-11 14:27:13.457095 I | rook-ceph-mon2: 2017-07-11 14:27:13.457078 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783233457076, "job": 45, "event": "table_file_deletion", "file_number": 70}
- 2017-07-11 14:27:14.747236 I | rook-ceph-mon2: 2017-07-11 14:27:14.747204 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:14.747408 I | rook-ceph-mon2: 2017-07-11 14:27:14.747334 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3064289353' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:15.811177 I | rook-ceph-mon2: 2017-07-11 14:27:15.811145 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:15.811357 I | rook-ceph-mon2: 2017-07-11 14:27:15.811270 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2050163843' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:17.578299 I | rook-ceph-mon2: 2017-07-11 14:27:17.572206 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:17.578644 I | rook-ceph-mon2: 2017-07-11 14:27:17.578395 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/260126708' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:19.861800 I | rook-ceph-mon2: 2017-07-11 14:27:19.861767 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:19.861986 I | rook-ceph-mon2: 2017-07-11 14:27:19.861903 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3126606716' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:20.716821 I | rook-ceph-mon2: 2017-07-11 14:27:20.716789 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:20.716998 I | rook-ceph-mon2: 2017-07-11 14:27:20.716921 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3185093904' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:21.171884 I | rook-ceph-mon2: 2017-07-11 14:27:21.171840 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:21.172067 I | rook-ceph-mon2: 2017-07-11 14:27:21.171981 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2686246744' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:22.429709 I | rook-ceph-mon2: 2017-07-11 14:27:22.429675 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:22.429861 I | rook-ceph-mon2: 2017-07-11 14:27:22.429799 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4027536932' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:23.515952 I | rook-ceph-mon2: 2017-07-11 14:27:23.515919 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:23.516127 I | rook-ceph-mon2: 2017-07-11 14:27:23.516046 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/746738564' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:23.963713 I | rook-ceph-mon2: 2017-07-11 14:27:23.963679 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:23.963898 I | rook-ceph-mon2: 2017-07-11 14:27:23.963821 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4006814532' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:24.433960 I | rook-ceph-mon2: 2017-07-11 14:27:24.433915 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:24.434128 I | rook-ceph-mon2: 2017-07-11 14:27:24.434043 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4271854378' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:24.911244 I | rook-ceph-mon2: 2017-07-11 14:27:24.911212 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:24.911408 I | rook-ceph-mon2: 2017-07-11 14:27:24.911341 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2814852111' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:26.537923 I | rook-ceph-mon2: 2017-07-11 14:27:26.537888 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:26.538110 I | rook-ceph-mon2: 2017-07-11 14:27:26.538027 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3916373388' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:30.172360 I | rook-ceph-mon2: 2017-07-11 14:27:30.166532 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:30.172447 I | rook-ceph-mon2: 2017-07-11 14:27:30.172220 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3332966101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:31.276585 I | rook-ceph-mon2: 2017-07-11 14:27:31.276553 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:31.276824 I | rook-ceph-mon2: 2017-07-11 14:27:31.276784 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1898248738' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:31.748426 I | rook-ceph-mon2: 2017-07-11 14:27:31.748388 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:31.748686 I | rook-ceph-mon2: 2017-07-11 14:27:31.748642 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1078243099' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:32.192036 I | rook-ceph-mon2: 2017-07-11 14:27:32.192002 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:32.192149 I | rook-ceph-mon2: 2017-07-11 14:27:32.192134 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/382932383' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:33.051593 I | rook-ceph-mon2: 2017-07-11 14:27:33.051565 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:33.051692 I | rook-ceph-mon2: 2017-07-11 14:27:33.051678 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1082556200' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:33.918924 I | rook-ceph-mon2: 2017-07-11 14:27:33.918820 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:33.919158 I | rook-ceph-mon2: 2017-07-11 14:27:33.919116 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3103219425' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:35.239100 I | rook-ceph-mon2: 2017-07-11 14:27:35.239065 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:35.239364 I | rook-ceph-mon2: 2017-07-11 14:27:35.239339 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3867846227' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:36.191967 I | rook-ceph-mon2: 2017-07-11 14:27:36.191933 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:36.192147 I | rook-ceph-mon2: 2017-07-11 14:27:36.192069 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/560383435' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:37.495078 I | rook-ceph-mon2: 2017-07-11 14:27:37.495042 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:37.495305 I | rook-ceph-mon2: 2017-07-11 14:27:37.495195 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2723147484' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:39.294274 I | rook-ceph-mon2: 2017-07-11 14:27:39.294240 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:39.294487 I | rook-ceph-mon2: 2017-07-11 14:27:39.294471 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/278640994' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:41.968435 I | rook-ceph-mon2: 2017-07-11 14:27:41.968388 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:41.968673 I | rook-ceph-mon2: 2017-07-11 14:27:41.968557 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/815256405' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:42.403550 I | rook-ceph-mon2: 2017-07-11 14:27:42.403515 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:42.403774 I | rook-ceph-mon2: 2017-07-11 14:27:42.403745 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/541453225' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:43.354971 I | rook-ceph-mon2: 2017-07-11 14:27:43.354934 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:43.355145 I | rook-ceph-mon2: 2017-07-11 14:27:43.355067 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1077431228' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:46.338794 I | rook-ceph-mon2: 2017-07-11 14:27:46.338759 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:46.339000 I | rook-ceph-mon2: 2017-07-11 14:27:46.338899 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4083570881' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:46.788949 I | rook-ceph-mon2: 2017-07-11 14:27:46.788915 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:46.789052 I | rook-ceph-mon2: 2017-07-11 14:27:46.789038 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1073866024' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:49.631393 I | rook-ceph-mon2: 2017-07-11 14:27:49.631322 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:49.631514 I | rook-ceph-mon2: 2017-07-11 14:27:49.631498 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/40871162' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:51.510258 I | rook-ceph-mon2: 2017-07-11 14:27:51.510225 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:27:51.510371 I | rook-ceph-mon2: 2017-07-11 14:27:51.510357 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1220582192' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:27:53.444875 I | rook-ceph-mon2: 2017-07-11 14:27:53.444840 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:53.445057 I | rook-ceph-mon2: 2017-07-11 14:27:53.444978 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/364688444' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:55.412651 I | rook-ceph-mon2: 2017-07-11 14:27:55.412616 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:27:55.412873 I | rook-ceph-mon2: 2017-07-11 14:27:55.412835 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1373545769' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:27:56.890130 I | rook-ceph-mon2: 2017-07-11 14:27:56.890095 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:27:56.890317 I | rook-ceph-mon2: 2017-07-11 14:27:56.890237 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3403650132' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:27:57.814153 I | rook-ceph-mon2: 2017-07-11 14:27:57.814122 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:27:57.814321 I | rook-ceph-mon2: 2017-07-11 14:27:57.814249 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2562495204' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:27:58.103052 I | rook-ceph-mon2: 2017-07-11 14:27:58.102877 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4919 MB, avail 94267 MB
- 2017-07-11 14:28:00.509211 I | rook-ceph-mon2: 2017-07-11 14:28:00.502268 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:28:00.511334 I | rook-ceph-mon2: 2017-07-11 14:28:00.509394 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/553141090' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:28:00.926232 I | rook-ceph-mon2: 2017-07-11 14:28:00.926200 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:00.926337 I | rook-ceph-mon2: 2017-07-11 14:28:00.926323 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3635936238' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:01.876843 I | rook-ceph-mon2: 2017-07-11 14:28:01.876811 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:28:01.877027 I | rook-ceph-mon2: 2017-07-11 14:28:01.876950 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3898218781' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:28:04.100575 I | rook-ceph-mon2: 2017-07-11 14:28:04.100541 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:28:04.100678 I | rook-ceph-mon2: 2017-07-11 14:28:04.100664 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2770676502' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:28:04.220720 I | rook-ceph-mon2: 2017-07-11 14:28:04.220692 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:04.220818 I | rook-ceph-mon2: 2017-07-11 14:28:04.220803 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3595160598' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:05.102642 I | rook-ceph-mon2: 2017-07-11 14:28:05.102605 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:28:05.102904 I | rook-ceph-mon2: 2017-07-11 14:28:05.102845 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3137043275' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:28:06.619172 I | rook-ceph-mon2: 2017-07-11 14:28:06.618917 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:28:06.619239 I | rook-ceph-mon2: 2017-07-11 14:28:06.618943 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2171923865' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:28:07.476761 I | rook-ceph-mon2: 2017-07-11 14:28:07.476723 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:07.476951 I | rook-ceph-mon2: 2017-07-11 14:28:07.476862 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/940138834' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:09.147155 I | rook-ceph-mon2: 2017-07-11 14:28:09.147122 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:09.147255 I | rook-ceph-mon2: 2017-07-11 14:28:09.147238 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1573070512' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:09.861453 I | rook-ceph-mon2: 2017-07-11 14:28:09.861419 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:09.861620 I | rook-ceph-mon2: 2017-07-11 14:28:09.861547 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1754754664' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:10.284689 I | rook-ceph-mon2: 2017-07-11 14:28:10.284640 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:28:10.284886 I | rook-ceph-mon2: 2017-07-11 14:28:10.284793 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4292310375' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:28:10.660734 I | rook-ceph-mon2: 2017-07-11 14:28:10.660702 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:10.660946 I | rook-ceph-mon2: 2017-07-11 14:28:10.660930 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1758112267' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:11.696944 I | rook-ceph-mon2: 2017-07-11 14:28:11.696913 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:28:11.697159 I | rook-ceph-mon2: 2017-07-11 14:28:11.697126 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/944835522' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:28:12.630438 I | rook-ceph-mon2: 2017-07-11 14:28:12.630402 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:12.630673 I | rook-ceph-mon2: 2017-07-11 14:28:12.630656 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/636522323' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:14.054526 I | rook-ceph-mon2: 2017-07-11 14:28:14.054495 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:14.054636 I | rook-ceph-mon2: 2017-07-11 14:28:14.054621 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2201283625' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:14.570494 I | rook-ceph-mon2: 2017-07-11 14:28:14.570461 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:14.570718 I | rook-ceph-mon2: 2017-07-11 14:28:14.570680 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/862505437' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:14.993485 I | rook-ceph-mon2: 2017-07-11 14:28:14.993452 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:28:14.993614 I | rook-ceph-mon2: 2017-07-11 14:28:14.993588 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/180169941' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:28:16.420311 I | rook-ceph-mon2: 2017-07-11 14:28:16.420276 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:28:16.420476 I | rook-ceph-mon2: 2017-07-11 14:28:16.420402 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/166151124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:28:19.419276 I | rook-ceph-mon2: 2017-07-11 14:28:19.419246 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:19.419498 I | rook-ceph-mon2: 2017-07-11 14:28:19.419379 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/873043375' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:19.868568 I | rook-ceph-mon2: 2017-07-11 14:28:19.868531 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:28:19.868762 I | rook-ceph-mon2: 2017-07-11 14:28:19.868679 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3299607425' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:28:20.291344 I | rook-ceph-mon2: 2017-07-11 14:28:20.291308 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:20.291457 I | rook-ceph-mon2: 2017-07-11 14:28:20.291442 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2514416613' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:21.129136 I | rook-ceph-mon2: 2017-07-11 14:28:21.129062 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:28:21.129348 I | rook-ceph-mon2: 2017-07-11 14:28:21.129319 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2010592378' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:28:25.418509 I | rook-ceph-mon2: 2017-07-11 14:28:25.418464 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:25.418768 I | rook-ceph-mon2: 2017-07-11 14:28:25.418753 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/984074103' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:26.416405 I | rook-ceph-mon2: 2017-07-11 14:28:26.416374 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:28:26.416626 I | rook-ceph-mon2: 2017-07-11 14:28:26.416609 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2552912333' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:28:27.386084 I | rook-ceph-mon2: 2017-07-11 14:28:27.386050 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:27.386280 I | rook-ceph-mon2: 2017-07-11 14:28:27.386200 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3241465086' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:28.890593 I | rook-ceph-mon2: 2017-07-11 14:28:28.890559 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:28.890780 I | rook-ceph-mon2: 2017-07-11 14:28:28.890699 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3005343855' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:29.786578 I | rook-ceph-mon2: 2017-07-11 14:28:29.786386 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:28:29.786663 I | rook-ceph-mon2: 2017-07-11 14:28:29.786432 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1701496857' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:28:30.229120 I | rook-ceph-mon2: 2017-07-11 14:28:30.229086 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:30.229227 I | rook-ceph-mon2: 2017-07-11 14:28:30.229212 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3149133547' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:31.895313 I | rook-ceph-mon2: 2017-07-11 14:28:31.895281 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:31.895516 I | rook-ceph-mon2: 2017-07-11 14:28:31.895430 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/913722208' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:33.810463 I | rook-ceph-mon2: 2017-07-11 14:28:33.810428 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:33.810688 I | rook-ceph-mon2: 2017-07-11 14:28:33.810651 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2788242680' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:34.724808 I | rook-ceph-mon2: 2017-07-11 14:28:34.724771 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:28:34.724915 I | rook-ceph-mon2: 2017-07-11 14:28:34.724899 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2553139397' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:28:35.156966 I | rook-ceph-mon2: 2017-07-11 14:28:35.156912 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:35.157088 I | rook-ceph-mon2: 2017-07-11 14:28:35.157073 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/956451356' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:36.212335 I | rook-ceph-mon2: 2017-07-11 14:28:36.212103 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:28:36.212406 I | rook-ceph-mon2: 2017-07-11 14:28:36.212130 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3333522039' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:28:38.716795 I | rook-ceph-mon2: 2017-07-11 14:28:38.716761 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:38.717003 I | rook-ceph-mon2: 2017-07-11 14:28:38.716985 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1627126633' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:40.001674 I | rook-ceph-mon2: 2017-07-11 14:28:40.001641 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:40.001780 I | rook-ceph-mon2: 2017-07-11 14:28:40.001765 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1085025272' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:43.632368 I | rook-ceph-mon2: 2017-07-11 14:28:43.632009 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:43.632439 I | rook-ceph-mon2: 2017-07-11 14:28:43.632031 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2505449833' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:46.760877 I | rook-ceph-mon2: 2017-07-11 14:28:46.760845 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:46.760987 I | rook-ceph-mon2: 2017-07-11 14:28:46.760972 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3785692292' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:49.115628 I | rook-ceph-mon2: 2017-07-11 14:28:49.115597 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:49.115817 I | rook-ceph-mon2: 2017-07-11 14:28:49.115801 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1327573387' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:49.947921 I | rook-ceph-mon2: 2017-07-11 14:28:49.947887 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:49.948029 I | rook-ceph-mon2: 2017-07-11 14:28:49.948014 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/48076087' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:50.726012 I | rook-ceph-mon2: 2017-07-11 14:28:50.725978 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:28:50.726222 I | rook-ceph-mon2: 2017-07-11 14:28:50.726116 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/35520882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:28:54.771932 I | rook-ceph-mon2: 2017-07-11 14:28:54.771581 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:28:54.771999 I | rook-ceph-mon2: 2017-07-11 14:28:54.771615 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/133474310' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:28:55.731224 I | rook-ceph-mon2: 2017-07-11 14:28:55.724678 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:28:55.731307 I | rook-ceph-mon2: 2017-07-11 14:28:55.730467 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1275557127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:28:56.555438 I | rook-ceph-mon2: 2017-07-11 14:28:56.555405 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:28:56.555678 I | rook-ceph-mon2: 2017-07-11 14:28:56.555661 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4002440011' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:28:58.105226 I | rook-ceph-mon2: 2017-07-11 14:28:58.104970 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4919 MB, avail 94267 MB
- 2017-07-11 14:28:59.376004 I | rook-ceph-mon2: 2017-07-11 14:28:59.375972 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:28:59.376182 I | rook-ceph-mon2: 2017-07-11 14:28:59.376102 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1814047199' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:28:59.800838 I | rook-ceph-mon2: 2017-07-11 14:28:59.800802 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:28:59.801464 I | rook-ceph-mon2: 2017-07-11 14:28:59.801446 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/638835852' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:29:00.759431 I | rook-ceph-mon2: 2017-07-11 14:29:00.759402 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:29:00.765234 I | rook-ceph-mon2: 2017-07-11 14:29:00.759530 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3624845566' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:29:01.787448 I | rook-ceph-mon2: 2017-07-11 14:29:01.787419 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:01.787548 I | rook-ceph-mon2: 2017-07-11 14:29:01.787532 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1750747057' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:03.385212 I | rook-ceph-mon2: 2017-07-11 14:29:03.385176 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:03.385408 I | rook-ceph-mon2: 2017-07-11 14:29:03.385322 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2637482822' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:03.841538 I | rook-ceph-mon2: 2017-07-11 14:29:03.841506 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:03.841714 I | rook-ceph-mon2: 2017-07-11 14:29:03.841640 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3482402362' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:04.763835 I | rook-ceph-mon2: 2017-07-11 14:29:04.757482 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:04.764100 I | rook-ceph-mon2: 2017-07-11 14:29:04.763382 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/614065144' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:08.070322 I | rook-ceph-mon2: 2017-07-11 14:29:08.070284 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:29:08.070507 I | rook-ceph-mon2: 2017-07-11 14:29:08.070426 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3504291490' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:29:08.781385 I | rook-ceph-mon2: 2017-07-11 14:29:08.781328 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:08.781558 I | rook-ceph-mon2: 2017-07-11 14:29:08.781482 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2730445910' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:09.622331 I | rook-ceph-mon2: 2017-07-11 14:29:09.622297 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:09.622436 I | rook-ceph-mon2: 2017-07-11 14:29:09.622421 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/764100119' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:10.602474 I | rook-ceph-mon2: 2017-07-11 14:29:10.602443 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:29:10.602696 I | rook-ceph-mon2: 2017-07-11 14:29:10.602653 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2398318646' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:29:11.547500 I | rook-ceph-mon2: 2017-07-11 14:29:11.547466 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:11.547753 I | rook-ceph-mon2: 2017-07-11 14:29:11.547705 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3397341686' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:14.165427 I | rook-ceph-mon2: 2017-07-11 14:29:14.165393 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:29:14.165678 I | rook-ceph-mon2: 2017-07-11 14:29:14.165531 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2305476869' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:29:19.705216 I | rook-ceph-mon2: 2017-07-11 14:29:19.705170 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:19.705458 I | rook-ceph-mon2: 2017-07-11 14:29:19.705427 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1826716630' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:21.471218 I | rook-ceph-mon2: 2017-07-11 14:29:21.471185 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:21.471387 I | rook-ceph-mon2: 2017-07-11 14:29:21.471313 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1921903914' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:23.582097 I | rook-ceph-mon2: 2017-07-11 14:29:23.582058 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:23.582327 I | rook-ceph-mon2: 2017-07-11 14:29:23.582311 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1036859998' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:24.025830 I | rook-ceph-mon2: 2017-07-11 14:29:24.025796 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:29:24.026007 I | rook-ceph-mon2: 2017-07-11 14:29:24.025929 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/344072597' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:29:24.440138 I | rook-ceph-mon2: 2017-07-11 14:29:24.440107 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:24.440246 I | rook-ceph-mon2: 2017-07-11 14:29:24.440231 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2199656419' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:26.677038 I | rook-ceph-mon2: 2017-07-11 14:29:26.677004 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:26.677249 I | rook-ceph-mon2: 2017-07-11 14:29:26.677146 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/243884833' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:27.991453 I | rook-ceph-mon2: 2017-07-11 14:29:27.991418 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:27.991657 I | rook-ceph-mon2: 2017-07-11 14:29:27.991572 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1455719967' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:29.255948 I | rook-ceph-mon2: 2017-07-11 14:29:29.255914 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:29.262797 I | rook-ceph-mon2: 2017-07-11 14:29:29.261802 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1696127416' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:30.206733 I | rook-ceph-mon2: 2017-07-11 14:29:30.206701 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:29:30.206921 I | rook-ceph-mon2: 2017-07-11 14:29:30.206904 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1057059773' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:29:31.078396 I | rook-ceph-mon2: 2017-07-11 14:29:31.078278 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:31.078492 I | rook-ceph-mon2: 2017-07-11 14:29:31.078298 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2570880982' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:32.903446 I | rook-ceph-mon2: 2017-07-11 14:29:32.903411 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:32.903628 I | rook-ceph-mon2: 2017-07-11 14:29:32.903546 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3343287188' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:34.304569 I | rook-ceph-mon2: 2017-07-11 14:29:34.304541 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:34.304741 I | rook-ceph-mon2: 2017-07-11 14:29:34.304669 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1296049579' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:35.927939 I | rook-ceph-mon2: 2017-07-11 14:29:35.582160 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1036 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.174452s > max 0.05s
- 2017-07-11 14:29:38.318572 I | rook-ceph-mon2: 2017-07-11 14:29:38.318541 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:38.318817 I | rook-ceph-mon2: 2017-07-11 14:29:38.318800 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3714346444' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:38.808397 I | rook-ceph-mon2: 2017-07-11 14:29:38.808350 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:29:38.808614 I | rook-ceph-mon2: 2017-07-11 14:29:38.808578 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2904863265' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:29:40.576226 I | rook-ceph-mon2: 2017-07-11 14:29:40.576195 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:29:40.576466 I | rook-ceph-mon2: 2017-07-11 14:29:40.576431 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1039394369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:29:42.806280 I | rook-ceph-mon2: 2017-07-11 14:29:42.806245 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:42.806493 I | rook-ceph-mon2: 2017-07-11 14:29:42.806476 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3239066539' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:45.179176 I | rook-ceph-mon2: 2017-07-11 14:29:45.179148 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:29:45.179342 I | rook-ceph-mon2: 2017-07-11 14:29:45.179270 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4266294638' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:29:47.735202 I | rook-ceph-mon2: 2017-07-11 14:29:47.735166 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:47.735387 I | rook-ceph-mon2: 2017-07-11 14:29:47.735300 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1800235066' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:48.627020 I | rook-ceph-mon2: 2017-07-11 14:29:48.626981 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:29:48.627276 I | rook-ceph-mon2: 2017-07-11 14:29:48.627146 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3360423871' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:29:49.122772 I | rook-ceph-mon2: 2017-07-11 14:29:49.122730 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:49.122998 I | rook-ceph-mon2: 2017-07-11 14:29:49.122981 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4143172370' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:50.204164 I | rook-ceph-mon2: 2017-07-11 14:29:50.204128 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:29:50.204444 I | rook-ceph-mon2: 2017-07-11 14:29:50.204426 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1757537978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:29:52.703126 I | rook-ceph-mon2: 2017-07-11 14:29:52.703088 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:52.703359 I | rook-ceph-mon2: 2017-07-11 14:29:52.703340 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3610068476' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:53.344641 I | rook-ceph-mon2: 2017-07-11 14:29:53.344599 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:53.344875 I | rook-ceph-mon2: 2017-07-11 14:29:53.344831 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1906471213' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:54.534170 I | rook-ceph-mon2: 2017-07-11 14:29:54.534125 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:54.534394 I | rook-ceph-mon2: 2017-07-11 14:29:54.534266 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1553491690' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:55.590741 I | rook-ceph-mon2: 2017-07-11 14:29:55.590706 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:29:55.590929 I | rook-ceph-mon2: 2017-07-11 14:29:55.590844 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/951759746' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:29:57.008301 I | rook-ceph-mon2: 2017-07-11 14:29:57.008243 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:29:57.008616 I | rook-ceph-mon2: 2017-07-11 14:29:57.008598 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1736629983' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:29:58.056460 I | rook-ceph-mon2: 2017-07-11 14:29:58.056410 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:58.056639 I | rook-ceph-mon2: 2017-07-11 14:29:58.056553 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4174466333' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:29:58.106735 I | rook-ceph-mon2: 2017-07-11 14:29:58.106500 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4920 MB, avail 94267 MB
- 2017-07-11 14:29:58.998562 I | rook-ceph-mon2: 2017-07-11 14:29:58.998531 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:29:58.998748 I | rook-ceph-mon2: 2017-07-11 14:29:58.998666 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1571862563' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:00.796777 I | rook-ceph-mon2: 2017-07-11 14:30:00.796741 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:00.796959 I | rook-ceph-mon2: 2017-07-11 14:30:00.796877 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3482846095' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:02.483254 I | rook-ceph-mon2: 2017-07-11 14:30:02.483218 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:02.483490 I | rook-ceph-mon2: 2017-07-11 14:30:02.483460 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2312117206' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:02.942400 I | rook-ceph-mon2: 2017-07-11 14:30:02.942369 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:02.942571 I | rook-ceph-mon2: 2017-07-11 14:30:02.942497 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3919886362' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:03.952678 I | rook-ceph-mon2: 2017-07-11 14:30:03.952644 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:03.952922 I | rook-ceph-mon2: 2017-07-11 14:30:03.952890 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3305084468' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:04.945459 I | rook-ceph-mon2: 2017-07-11 14:30:04.945423 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:30:04.945706 I | rook-ceph-mon2: 2017-07-11 14:30:04.945689 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1866558808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:30:05.803452 I | rook-ceph-mon2: 2017-07-11 14:30:05.330496 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1054 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:30:06.039683 I | rook-ceph-mon2: 2017-07-11 14:30:06.039646 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:06.039911 I | rook-ceph-mon2: 2017-07-11 14:30:06.039816 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2504232359' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:07.963162 I | rook-ceph-mon2: 2017-07-11 14:30:07.963119 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:07.969059 I | rook-ceph-mon2: 2017-07-11 14:30:07.969035 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1287189965' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:10.815559 I | rook-ceph-mon2: 2017-07-11 14:30:10.815518 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:10.815775 I | rook-ceph-mon2: 2017-07-11 14:30:10.815743 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1185865401' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:12.866932 I | rook-ceph-mon2: 2017-07-11 14:30:12.866899 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:12.867115 I | rook-ceph-mon2: 2017-07-11 14:30:12.867035 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/422658231' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:13.884377 I | rook-ceph-mon2: 2017-07-11 14:30:13.884343 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:13.884549 I | rook-ceph-mon2: 2017-07-11 14:30:13.884474 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3248590443' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:18.172933 I | rook-ceph-mon2: 2017-07-11 14:30:18.172901 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:30:18.173121 I | rook-ceph-mon2: 2017-07-11 14:30:18.173105 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3744275405' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:30:19.560917 I | rook-ceph-mon2: 2017-07-11 14:30:19.555035 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:30:19.560999 I | rook-ceph-mon2: 2017-07-11 14:30:19.560788 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2028771762' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:30:22.277029 I | rook-ceph-mon2: 2017-07-11 14:30:22.276993 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:22.277249 I | rook-ceph-mon2: 2017-07-11 14:30:22.277141 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2560942023' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:24.694857 I | rook-ceph-mon2: 2017-07-11 14:30:24.694810 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:30:24.695079 I | rook-ceph-mon2: 2017-07-11 14:30:24.695042 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/246518581' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:30:25.691541 I | rook-ceph-mon2: 2017-07-11 14:30:25.691505 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:25.691730 I | rook-ceph-mon2: 2017-07-11 14:30:25.691712 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/3400993774' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:27.150139 I | rook-ceph-mon2: 2017-07-11 14:30:27.150104 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:27.150328 I | rook-ceph-mon2: 2017-07-11 14:30:27.150246 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4176905756' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:28.067050 I | rook-ceph-mon2: 2017-07-11 14:30:28.067003 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:30:28.067289 I | rook-ceph-mon2: 2017-07-11 14:30:28.067183 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3099838717' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:30:31.291430 I | rook-ceph-mon2: 2017-07-11 14:30:31.291339 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #74. Immutable memtables: 0.
- 2017-07-11 14:30:31.291550 I | rook-ceph-mon2:
- 2017-07-11 14:30:31.291626 I | rook-ceph-mon2: 2017-07-11 14:30:31.291382 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 46] Syncing log #71
- 2017-07-11 14:30:31.328902 I | rook-ceph-mon2: 2017-07-11 14:30:31.326106 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.291377) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:30:31.328976 I | rook-ceph-mon2: 2017-07-11 14:30:31.326116 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 46] Flushing memtable with next log file: 74
- 2017-07-11 14:30:31.328992 I | rook-ceph-mon2:
- 2017-07-11 14:30:31.329022 I | rook-ceph-mon2: 2017-07-11 14:30:31.326125 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783431326121, "job": 46, "event": "flush_started", "num_memtables": 1, "num_entries": 2311, "num_deletes": 251, "memory_usage": 7655632}
- 2017-07-11 14:30:31.329036 I | rook-ceph-mon2: 2017-07-11 14:30:31.326127 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 46] Level-0 flush table #75: started
- 2017-07-11 14:30:31.481402 I | rook-ceph-mon2: 2017-07-11 14:30:31.481353 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783431481343, "cf_name": "default", "job": 46, "event": "table_file_creation", "file_number": 75, "file_size": 5060213, "table_properties": {"data_size": 5042677, "index_size": 16716, "filter_size": 0, "raw_key_size": 17109, "raw_average_key_size": 18, "raw_value_size": 5018483, "raw_average_value_size": 5508, "num_data_blocks": 523, "num_entries": 911, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:30:31.481509 I | rook-ceph-mon2: 2017-07-11 14:30:31.481492 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 46] Level-0 flush table #75: 5060213 bytes OK
- 2017-07-11 14:30:31.669367 I | rook-ceph-mon2: 2017-07-11 14:30:31.669325 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.518673) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #75 started
- 2017-07-11 14:30:31.672913 I | rook-ceph-mon2: 2017-07-11 14:30:31.672892 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.669274) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #75: memtable #1 done
- 2017-07-11 14:30:31.678733 I | rook-ceph-mon2: 2017-07-11 14:30:31.678711 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.669296) EVENT_LOG_v1 {"time_micros": 1499783431669290, "job": 46, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:30:31.678756 I | rook-ceph-mon2: 2017-07-11 14:30:31.678743 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.669311) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:30:31.678760 I | rook-ceph-mon2:
- 2017-07-11 14:30:31.678790 I | rook-ceph-mon2: 2017-07-11 14:30:31.678769 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 46] Try to delete WAL files size 7606847, prev total WAL file size 7606847, number of live WAL files 2.
- 2017-07-11 14:30:31.678794 I | rook-ceph-mon2:
- 2017-07-11 14:30:31.680793 I | rook-ceph-mon2: 2017-07-11 14:30:31.679782 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:30:31.680821 I | rook-ceph-mon2: 2017-07-11 14:30:31.679817 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:30:31.679812) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:30:31.680825 I | rook-ceph-mon2:
- 2017-07-11 14:30:31.680828 I | rook-ceph-mon2: 2017-07-11 14:30:31.679822 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 47] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:30:31.680831 I | rook-ceph-mon2: 2017-07-11 14:30:31.679827 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 46 Base level 0, inputs: [75(4941KB)], [73(12MB)]
- 2017-07-11 14:30:31.680833 I | rook-ceph-mon2:
- 2017-07-11 14:30:31.680835 I | rook-ceph-mon2: 2017-07-11 14:30:31.679836 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783431679829, "job": 47, "event": "compaction_started", "files_L0": [75], "files_L1": [73], "score": -1, "input_data_size": 18451697}
- 2017-07-11 14:30:32.000864 I | rook-ceph-mon2: 2017-07-11 14:30:31.998028 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 47] Generated table #76: 2385 keys, 16004766 bytes
- 2017-07-11 14:30:32.000953 I | rook-ceph-mon2: 2017-07-11 14:30:31.998078 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783431998046, "cf_name": "default", "job": 47, "event": "table_file_creation", "file_number": 76, "file_size": 16004766, "table_properties": {"data_size": 15951301, "index_size": 52646, "filter_size": 0, "raw_key_size": 45141, "raw_average_key_size": 18, "raw_value_size": 15881265, "raw_average_value_size": 6658, "num_data_blocks": 1618, "num_entries": 2385, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:30:32.045233 I | rook-ceph-mon2: 2017-07-11 14:30:32.045090 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 47] Compacted 1@0 + 1@1 files to L1 => 16004766 bytes
- 2017-07-11 14:30:32.064783 I | rook-ceph-mon2: 2017-07-11 14:30:32.064498 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:30:32.064367) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 50.5 rd, 43.8 wr, level 1, files in(1, 1) out(1) MB in(4.8, 12.8) out(15.3), read-write-amplify(6.8) write-amplify(3.2) OK, records in: 2894, records dropped: 509
- 2017-07-11 14:30:32.064830 I | rook-ceph-mon2:
- 2017-07-11 14:30:32.064847 I | rook-ceph-mon2: 2017-07-11 14:30:32.064510 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:30:32.064414) EVENT_LOG_v1 {"time_micros": 1499783432064387, "job": 47, "event": "compaction_finished", "compaction_time_micros": 365231, "output_level": 1, "num_output_files": 1, "total_output_size": 16004766, "num_input_records": 2894, "num_output_records": 2385, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:30:32.065477 I | rook-ceph-mon2: 2017-07-11 14:30:32.065462 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783432065458, "job": 47, "event": "table_file_deletion", "file_number": 75}
- 2017-07-11 14:30:32.067038 I | rook-ceph-mon2: 2017-07-11 14:30:32.067023 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783432067022, "job": 47, "event": "table_file_deletion", "file_number": 73}
- 2017-07-11 14:30:32.231301 I | rook-ceph-mon2: 2017-07-11 14:30:32.231265 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:32.231532 I | rook-ceph-mon2: 2017-07-11 14:30:32.231483 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/725611850' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:32.708110 I | rook-ceph-mon2: 2017-07-11 14:30:32.708075 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:32.708175 I | rook-ceph-mon2: 2017-07-11 14:30:32.708161 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/410064981' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:33.158545 I | rook-ceph-mon2: 2017-07-11 14:30:33.158498 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:30:33.158719 I | rook-ceph-mon2: 2017-07-11 14:30:33.158704 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/188055636' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:30:34.608709 I | rook-ceph-mon2: 2017-07-11 14:30:34.608676 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:30:34.608947 I | rook-ceph-mon2: 2017-07-11 14:30:34.608866 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1462290110' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:30:35.517006 I | rook-ceph-mon2: 2017-07-11 14:30:35.516974 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:35.517227 I | rook-ceph-mon2: 2017-07-11 14:30:35.517116 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3545868847' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:36.807517 I | rook-ceph-mon2: 2017-07-11 14:30:36.807481 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:30:36.807706 I | rook-ceph-mon2: 2017-07-11 14:30:36.807625 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/749295618' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:30:37.450052 I | rook-ceph-mon2: 2017-07-11 14:30:37.450020 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:37.450291 I | rook-ceph-mon2: 2017-07-11 14:30:37.450272 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/453238683' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:38.370313 I | rook-ceph-mon2: 2017-07-11 14:30:38.370282 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:38.370428 I | rook-ceph-mon2: 2017-07-11 14:30:38.370412 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4070212835' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:39.418270 I | rook-ceph-mon2: 2017-07-11 14:30:39.418234 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:30:39.418501 I | rook-ceph-mon2: 2017-07-11 14:30:39.418458 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1308134503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:30:40.443217 I | rook-ceph-mon2: 2017-07-11 14:30:40.443174 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:40.443451 I | rook-ceph-mon2: 2017-07-11 14:30:40.443410 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3424898662' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:43.351573 I | rook-ceph-mon2: 2017-07-11 14:30:43.351541 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:43.351799 I | rook-ceph-mon2: 2017-07-11 14:30:43.351676 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2587125727' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:44.414875 I | rook-ceph-mon2: 2017-07-11 14:30:44.414831 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:30:44.415044 I | rook-ceph-mon2: 2017-07-11 14:30:44.414976 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3102408042' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:30:48.237429 I | rook-ceph-mon2: 2017-07-11 14:30:48.237397 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:48.237657 I | rook-ceph-mon2: 2017-07-11 14:30:48.237640 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1604801808' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:49.170844 I | rook-ceph-mon2: 2017-07-11 14:30:49.170810 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:30:49.171016 I | rook-ceph-mon2: 2017-07-11 14:30:49.170940 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2057907084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:30:50.297377 I | rook-ceph-mon2: 2017-07-11 14:30:50.297344 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:50.297492 I | rook-ceph-mon2: 2017-07-11 14:30:50.297477 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2597817038' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:53.413726 I | rook-ceph-mon2: 2017-07-11 14:30:53.413693 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:53.413822 I | rook-ceph-mon2: 2017-07-11 14:30:53.413808 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1843376384' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:54.380575 I | rook-ceph-mon2: 2017-07-11 14:30:54.380541 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:30:54.380797 I | rook-ceph-mon2: 2017-07-11 14:30:54.380764 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4223677743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:30:55.360590 I | rook-ceph-mon2: 2017-07-11 14:30:55.360557 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:55.360694 I | rook-ceph-mon2: 2017-07-11 14:30:55.360679 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3805270895' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:56.699189 I | rook-ceph-mon2: 2017-07-11 14:30:56.699155 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:30:56.699379 I | rook-ceph-mon2: 2017-07-11 14:30:56.699289 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/306025374' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:30:57.190316 I | rook-ceph-mon2: 2017-07-11 14:30:57.190270 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:57.190560 I | rook-ceph-mon2: 2017-07-11 14:30:57.190530 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/671436039' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:58.108513 I | rook-ceph-mon2: 2017-07-11 14:30:58.108218 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4922 MB, avail 94264 MB
- 2017-07-11 14:30:58.388619 I | rook-ceph-mon2: 2017-07-11 14:30:58.388584 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:30:58.388828 I | rook-ceph-mon2: 2017-07-11 14:30:58.388747 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1092191945' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:30:59.316727 I | rook-ceph-mon2: 2017-07-11 14:30:59.316691 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:30:59.322508 I | rook-ceph-mon2: 2017-07-11 14:30:59.316839 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/194599649' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:31:01.927643 I | rook-ceph-mon2: 2017-07-11 14:31:01.927609 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:01.927863 I | rook-ceph-mon2: 2017-07-11 14:31:01.927822 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1610251664' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:02.140858 I | rook-ceph-mon2: 2017-07-11 14:31:02.140811 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:31:02.140922 I | rook-ceph-mon2: 2017-07-11 14:31:02.140908 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3906622035' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:31:02.439376 I | rook-ceph-mon2: 2017-07-11 14:31:02.439128 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:02.439473 I | rook-ceph-mon2: 2017-07-11 14:31:02.439458 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3080031048' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:06.547464 I | rook-ceph-mon2: 2017-07-11 14:31:06.547423 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:06.547678 I | rook-ceph-mon2: 2017-07-11 14:31:06.547574 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3344867168' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:07.107047 I | rook-ceph-mon2: 2017-07-11 14:31:07.107013 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:07.107235 I | rook-ceph-mon2: 2017-07-11 14:31:07.107153 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2469116789' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:07.552875 I | rook-ceph-mon2: 2017-07-11 14:31:07.552841 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:31:07.553061 I | rook-ceph-mon2: 2017-07-11 14:31:07.552979 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2682002016' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:31:08.029797 I | rook-ceph-mon2: 2017-07-11 14:31:08.029765 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:08.030003 I | rook-ceph-mon2: 2017-07-11 14:31:08.029987 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1997013415' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:09.113386 I | rook-ceph-mon2: 2017-07-11 14:31:09.113330 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:31:09.113768 I | rook-ceph-mon2: 2017-07-11 14:31:09.113742 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/238131354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:31:11.450220 I | rook-ceph-mon2: 2017-07-11 14:31:11.450156 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:11.450429 I | rook-ceph-mon2: 2017-07-11 14:31:11.450327 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1095892417' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:12.504593 I | rook-ceph-mon2: 2017-07-11 14:31:12.504555 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:31:12.504847 I | rook-ceph-mon2: 2017-07-11 14:31:12.504706 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4119552619' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:31:12.964847 I | rook-ceph-mon2: 2017-07-11 14:31:12.964811 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:12.965029 I | rook-ceph-mon2: 2017-07-11 14:31:12.964948 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1517420370' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:15.065625 I | rook-ceph-mon2: 2017-07-11 14:31:15.065583 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:15.065918 I | rook-ceph-mon2: 2017-07-11 14:31:15.065897 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2239231859' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:16.396576 I | rook-ceph-mon2: 2017-07-11 14:31:16.396544 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:16.402493 I | rook-ceph-mon2: 2017-07-11 14:31:16.402458 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/944635478' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:17.301090 I | rook-ceph-mon2: 2017-07-11 14:31:17.301057 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:31:17.301194 I | rook-ceph-mon2: 2017-07-11 14:31:17.301180 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2497852454' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:31:18.561439 I | rook-ceph-mon2: 2017-07-11 14:31:18.561403 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:31:18.561657 I | rook-ceph-mon2: 2017-07-11 14:31:18.561629 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3536903156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:31:19.441969 I | rook-ceph-mon2: 2017-07-11 14:31:19.441936 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:19.442185 I | rook-ceph-mon2: 2017-07-11 14:31:19.442100 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3593805122' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:22.178251 I | rook-ceph-mon2: 2017-07-11 14:31:22.178216 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:31:22.178498 I | rook-ceph-mon2: 2017-07-11 14:31:22.178374 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2000099519' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:31:26.243702 I | rook-ceph-mon2: 2017-07-11 14:31:26.243656 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:26.243886 I | rook-ceph-mon2: 2017-07-11 14:31:26.243806 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4101063739' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:27.506592 I | rook-ceph-mon2: 2017-07-11 14:31:27.506327 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:27.506659 I | rook-ceph-mon2: 2017-07-11 14:31:27.506349 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1308799537' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:31.181550 I | rook-ceph-mon2: 2017-07-11 14:31:31.181504 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:31.181801 I | rook-ceph-mon2: 2017-07-11 14:31:31.181758 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1774029594' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:31.611622 I | rook-ceph-mon2: 2017-07-11 14:31:31.611555 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:31.611878 I | rook-ceph-mon2: 2017-07-11 14:31:31.611837 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/4227652928' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:33.342186 I | rook-ceph-mon2: 2017-07-11 14:31:33.342149 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:31:33.342418 I | rook-ceph-mon2: 2017-07-11 14:31:33.342400 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/182842879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:31:34.315984 I | rook-ceph-mon2: 2017-07-11 14:31:34.315932 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:34.316371 I | rook-ceph-mon2: 2017-07-11 14:31:34.316271 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3050296139' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:36.132278 I | rook-ceph-mon2: 2017-07-11 14:31:36.132241 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:36.132494 I | rook-ceph-mon2: 2017-07-11 14:31:36.132391 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1104336674' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:37.111582 I | rook-ceph-mon2: 2017-07-11 14:31:37.111548 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:31:37.118116 I | rook-ceph-mon2: 2017-07-11 14:31:37.111685 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1866334049' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:31:38.497321 I | rook-ceph-mon2: 2017-07-11 14:31:38.497294 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:31:38.497488 I | rook-ceph-mon2: 2017-07-11 14:31:38.497412 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3134828987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:31:41.010844 I | rook-ceph-mon2: 2017-07-11 14:31:41.010797 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:41.011096 I | rook-ceph-mon2: 2017-07-11 14:31:41.011079 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/582760956' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:41.432983 I | rook-ceph-mon2: 2017-07-11 14:31:41.432943 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:41.433160 I | rook-ceph-mon2: 2017-07-11 14:31:41.433086 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/144382171' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:42.510826 I | rook-ceph-mon2: 2017-07-11 14:31:42.510781 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:42.511289 I | rook-ceph-mon2: 2017-07-11 14:31:42.511271 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1116704079' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:46.013823 I | rook-ceph-mon2: 2017-07-11 14:31:46.013788 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:46.013894 I | rook-ceph-mon2: 2017-07-11 14:31:46.013877 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3978455488' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:46.438639 I | rook-ceph-mon2: 2017-07-11 14:31:46.438583 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:46.438852 I | rook-ceph-mon2: 2017-07-11 14:31:46.438819 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1004535021' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:46.848687 I | rook-ceph-mon2: 2017-07-11 14:31:46.848655 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:31:46.848791 I | rook-ceph-mon2: 2017-07-11 14:31:46.848776 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1989929479' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:31:47.279062 I | rook-ceph-mon2: 2017-07-11 14:31:47.279029 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:47.279170 I | rook-ceph-mon2: 2017-07-11 14:31:47.279155 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2096813574' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:49.010647 I | rook-ceph-mon2: 2017-07-11 14:31:49.010602 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:49.010832 I | rook-ceph-mon2: 2017-07-11 14:31:49.010752 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3744767739' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:50.821715 I | rook-ceph-mon2: 2017-07-11 14:31:50.821680 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:50.821944 I | rook-ceph-mon2: 2017-07-11 14:31:50.821835 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1249883923' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:51.682829 I | rook-ceph-mon2: 2017-07-11 14:31:51.682797 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:31:51.683054 I | rook-ceph-mon2: 2017-07-11 14:31:51.683037 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4206006707' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:31:52.126783 I | rook-ceph-mon2: 2017-07-11 14:31:52.126747 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:31:52.127042 I | rook-ceph-mon2: 2017-07-11 14:31:52.127026 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1020207982' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:31:53.096438 I | rook-ceph-mon2: 2017-07-11 14:31:53.096403 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:31:53.096522 I | rook-ceph-mon2: 2017-07-11 14:31:53.096495 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/669038151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:31:53.336337 I | rook-ceph-mon2: 2017-07-11 14:31:53.336242 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #77. Immutable memtables: 0.
- 2017-07-11 14:31:53.336436 I | rook-ceph-mon2:
- 2017-07-11 14:31:53.336463 I | rook-ceph-mon2: 2017-07-11 14:31:53.336275 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 48] Syncing log #74
- 2017-07-11 14:31:53.385604 I | rook-ceph-mon2: 2017-07-11 14:31:53.377205 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.336269) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:31:53.385702 I | rook-ceph-mon2: 2017-07-11 14:31:53.377214 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 48] Flushing memtable with next log file: 77
- 2017-07-11 14:31:53.385721 I | rook-ceph-mon2:
- 2017-07-11 14:31:53.385746 I | rook-ceph-mon2: 2017-07-11 14:31:53.377226 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513377219, "job": 48, "event": "flush_started", "num_memtables": 1, "num_entries": 1084, "num_deletes": 251, "memory_usage": 3083680}
- 2017-07-11 14:31:53.385758 I | rook-ceph-mon2: 2017-07-11 14:31:53.377228 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 48] Level-0 flush table #78: started
- 2017-07-11 14:31:53.464234 I | rook-ceph-mon2: 2017-07-11 14:31:53.464167 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513464156, "cf_name": "default", "job": 48, "event": "table_file_creation", "file_number": 78, "file_size": 1804705, "table_properties": {"data_size": 1798374, "index_size": 5516, "filter_size": 0, "raw_key_size": 9503, "raw_average_key_size": 19, "raw_value_size": 1787833, "raw_average_value_size": 3678, "num_data_blocks": 177, "num_entries": 486, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:31:53.473702 I | rook-ceph-mon2: 2017-07-11 14:31:53.473641 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 48] Level-0 flush table #78: 1804705 bytes OK
- 2017-07-11 14:31:53.549729 I | rook-ceph-mon2: 2017-07-11 14:31:53.549705 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.493080) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #78 started
- 2017-07-11 14:31:53.549803 I | rook-ceph-mon2: 2017-07-11 14:31:53.549786 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.549666) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #78: memtable #1 done
- 2017-07-11 14:31:53.549855 I | rook-ceph-mon2: 2017-07-11 14:31:53.549840 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.549680) EVENT_LOG_v1 {"time_micros": 1499783513549675, "job": 48, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:31:53.549886 I | rook-ceph-mon2: 2017-07-11 14:31:53.549873 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.549695) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:31:53.549901 I | rook-ceph-mon2:
- 2017-07-11 14:31:53.549963 I | rook-ceph-mon2: 2017-07-11 14:31:53.549950 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 48] Try to delete WAL files size 3060435, prev total WAL file size 3060435, number of live WAL files 2.
- 2017-07-11 14:31:53.549977 I | rook-ceph-mon2:
- 2017-07-11 14:31:53.561165 I | rook-ceph-mon2: 2017-07-11 14:31:53.550625 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:31:53.561235 I | rook-ceph-mon2: 2017-07-11 14:31:53.550683 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.550678) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:31:53.561254 I | rook-ceph-mon2:
- 2017-07-11 14:31:53.561284 I | rook-ceph-mon2: 2017-07-11 14:31:53.550689 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 49] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:31:53.561299 I | rook-ceph-mon2: 2017-07-11 14:31:53.550694 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 48 Base level 0, inputs: [78(1762KB)], [76(15MB)]
- 2017-07-11 14:31:53.561311 I | rook-ceph-mon2:
- 2017-07-11 14:31:53.561322 I | rook-ceph-mon2: 2017-07-11 14:31:53.550704 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513550696, "job": 49, "event": "compaction_started", "files_L0": [78], "files_L1": [76], "score": -1, "input_data_size": 17809471}
- 2017-07-11 14:31:53.715131 I | rook-ceph-mon2: 2017-07-11 14:31:53.715077 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 49] Generated table #79: 2397 keys, 16384050 bytes
- 2017-07-11 14:31:53.715905 I | rook-ceph-mon2: 2017-07-11 14:31:53.715886 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513715876, "cf_name": "default", "job": 49, "event": "table_file_creation", "file_number": 79, "file_size": 16384050, "table_properties": {"data_size": 16332013, "index_size": 51218, "filter_size": 0, "raw_key_size": 45117, "raw_average_key_size": 18, "raw_value_size": 16262882, "raw_average_value_size": 6784, "num_data_blocks": 1578, "num_entries": 2397, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:31:53.767386 I | rook-ceph-mon2: 2017-07-11 14:31:53.767339 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 49] Compacted 1@0 + 1@1 files to L1 => 16384050 bytes
- 2017-07-11 14:31:53.826348 I | rook-ceph-mon2: 2017-07-11 14:31:53.826313 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.825474) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 82.2 rd, 75.6 wr, level 1, files in(1, 1) out(1) MB in(1.7, 15.3) out(15.6), read-write-amplify(18.9) write-amplify(9.1) OK, records in: 2871, records dropped: 474
- 2017-07-11 14:31:53.826440 I | rook-ceph-mon2:
- 2017-07-11 14:31:53.826495 I | rook-ceph-mon2: 2017-07-11 14:31:53.826477 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:31:53.825491) EVENT_LOG_v1 {"time_micros": 1499783513825484, "job": 49, "event": "compaction_finished", "compaction_time_micros": 216613, "output_level": 1, "num_output_files": 1, "total_output_size": 16384050, "num_input_records": 2871, "num_output_records": 2397, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:31:53.827823 I | rook-ceph-mon2: 2017-07-11 14:31:53.827804 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513827801, "job": 49, "event": "table_file_deletion", "file_number": 78}
- 2017-07-11 14:31:53.834783 I | rook-ceph-mon2: 2017-07-11 14:31:53.834762 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783513834760, "job": 49, "event": "table_file_deletion", "file_number": 76}
- 2017-07-11 14:31:53.834867 I | rook-ceph-mon2: 2017-07-11 14:31:53.834848 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:31:54.392588 I | rook-ceph-mon2: 2017-07-11 14:31:54.392554 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:31:54.392827 I | rook-ceph-mon2: 2017-07-11 14:31:54.392689 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1445275978' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:31:54.667690 I | rook-ceph-mon2: 2017-07-11 14:31:54.667626 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:31:54.677821 I | rook-ceph-mon2: 2017-07-11 14:31:54.677800 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4223140528' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:31:58.108754 I | rook-ceph-mon2: 2017-07-11 14:31:58.108433 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94264 MB
- 2017-07-11 14:32:00.709982 I | rook-ceph-mon2: 2017-07-11 14:32:00.709947 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:00.710204 I | rook-ceph-mon2: 2017-07-11 14:32:00.710172 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3292507617' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:01.578692 I | rook-ceph-mon2: 2017-07-11 14:32:01.578657 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:32:01.578921 I | rook-ceph-mon2: 2017-07-11 14:32:01.578789 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2718451135' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:32:02.022026 I | rook-ceph-mon2: 2017-07-11 14:32:02.021992 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:02.022123 I | rook-ceph-mon2: 2017-07-11 14:32:02.022108 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2280394886' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:03.882062 I | rook-ceph-mon2: 2017-07-11 14:32:03.882016 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:03.882278 I | rook-ceph-mon2: 2017-07-11 14:32:03.882243 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1086623387' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:05.776916 I | rook-ceph-mon2: 2017-07-11 14:32:05.776883 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:05.777125 I | rook-ceph-mon2: 2017-07-11 14:32:05.777093 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4028779522' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:06.684919 I | rook-ceph-mon2: 2017-07-11 14:32:06.684885 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:32:06.685107 I | rook-ceph-mon2: 2017-07-11 14:32:06.685026 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3904508907' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:32:08.119522 I | rook-ceph-mon2: 2017-07-11 14:32:08.119480 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:32:08.119749 I | rook-ceph-mon2: 2017-07-11 14:32:08.119709 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1135223214' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:32:09.203498 I | rook-ceph-mon2: 2017-07-11 14:32:09.203444 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:09.203685 I | rook-ceph-mon2: 2017-07-11 14:32:09.203604 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/669290108' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:10.594340 I | rook-ceph-mon2: 2017-07-11 14:32:10.594306 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:10.594562 I | rook-ceph-mon2: 2017-07-11 14:32:10.594522 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4187565202' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:11.442998 I | rook-ceph-mon2: 2017-07-11 14:32:11.442966 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:32:11.443170 I | rook-ceph-mon2: 2017-07-11 14:32:11.443093 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2496020427' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:32:12.919875 I | rook-ceph-mon2: 2017-07-11 14:32:12.919840 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:32:12.920054 I | rook-ceph-mon2: 2017-07-11 14:32:12.919974 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3084444119' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:32:13.768706 I | rook-ceph-mon2: 2017-07-11 14:32:13.768671 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:13.768967 I | rook-ceph-mon2: 2017-07-11 14:32:13.768926 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/249864610' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:16.604668 I | rook-ceph-mon2: 2017-07-11 14:32:16.604610 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:32:16.604948 I | rook-ceph-mon2: 2017-07-11 14:32:16.604930 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4193746776' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:32:17.035403 I | rook-ceph-mon2: 2017-07-11 14:32:17.035202 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:17.035476 I | rook-ceph-mon2: 2017-07-11 14:32:17.035221 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1345552713' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:18.934031 I | rook-ceph-mon2: 2017-07-11 14:32:18.933997 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:18.934214 I | rook-ceph-mon2: 2017-07-11 14:32:18.934132 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2322230081' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:19.589109 I | rook-ceph-mon2: 2017-07-11 14:32:19.589070 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:32:19.589378 I | rook-ceph-mon2: 2017-07-11 14:32:19.589259 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/651645786' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:32:21.007426 I | rook-ceph-mon2: 2017-07-11 14:32:21.007389 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:21.007671 I | rook-ceph-mon2: 2017-07-11 14:32:21.007622 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/511701083' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:21.452404 I | rook-ceph-mon2: 2017-07-11 14:32:21.452332 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:32:21.452635 I | rook-ceph-mon2: 2017-07-11 14:32:21.452593 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3745882208' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:32:21.865209 I | rook-ceph-mon2: 2017-07-11 14:32:21.865174 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:21.865472 I | rook-ceph-mon2: 2017-07-11 14:32:21.865455 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/140153671' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:22.854247 I | rook-ceph-mon2: 2017-07-11 14:32:22.854203 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:32:22.854461 I | rook-ceph-mon2: 2017-07-11 14:32:22.854428 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3058014676' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:32:23.711154 I | rook-ceph-mon2: 2017-07-11 14:32:23.711109 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:23.716943 I | rook-ceph-mon2: 2017-07-11 14:32:23.711247 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1716696568' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:25.381112 I | rook-ceph-mon2: 2017-07-11 14:32:25.381077 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:25.381381 I | rook-ceph-mon2: 2017-07-11 14:32:25.381237 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/801230280' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:26.302606 I | rook-ceph-mon2: 2017-07-11 14:32:26.302572 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:32:26.302858 I | rook-ceph-mon2: 2017-07-11 14:32:26.302720 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3578955578' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:32:27.558538 I | rook-ceph-mon2: 2017-07-11 14:32:27.558504 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:32:27.558775 I | rook-ceph-mon2: 2017-07-11 14:32:27.558757 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3859724201' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:32:28.411624 I | rook-ceph-mon2: 2017-07-11 14:32:28.411593 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:28.411809 I | rook-ceph-mon2: 2017-07-11 14:32:28.411727 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2683914385' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:30.302316 I | rook-ceph-mon2: 2017-07-11 14:32:30.302283 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:30.302503 I | rook-ceph-mon2: 2017-07-11 14:32:30.302421 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/826254871' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:30.704194 I | rook-ceph-mon2: 2017-07-11 14:32:30.704161 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:30.704409 I | rook-ceph-mon2: 2017-07-11 14:32:30.704299 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3663941928' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:31.193148 I | rook-ceph-mon2: 2017-07-11 14:32:31.193112 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:32:31.193386 I | rook-ceph-mon2: 2017-07-11 14:32:31.193268 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1532280751' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:32:33.431905 I | rook-ceph-mon2: 2017-07-11 14:32:33.431808 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #80. Immutable memtables: 0.
- 2017-07-11 14:32:33.431991 I | rook-ceph-mon2:
- 2017-07-11 14:32:33.432040 I | rook-ceph-mon2: 2017-07-11 14:32:33.431856 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 50] Syncing log #77
- 2017-07-11 14:32:33.463238 I | rook-ceph-mon2: 2017-07-11 14:32:33.462018 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.431852) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:32:33.463281 I | rook-ceph-mon2: 2017-07-11 14:32:33.462027 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 50] Flushing memtable with next log file: 80
- 2017-07-11 14:32:33.463298 I | rook-ceph-mon2:
- 2017-07-11 14:32:33.463311 I | rook-ceph-mon2: 2017-07-11 14:32:33.462046 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553462031, "job": 50, "event": "flush_started", "num_memtables": 1, "num_entries": 913, "num_deletes": 506, "memory_usage": 1535640}
- 2017-07-11 14:32:33.463324 I | rook-ceph-mon2: 2017-07-11 14:32:33.462048 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 50] Level-0 flush table #81: started
- 2017-07-11 14:32:33.509883 I | rook-ceph-mon2: 2017-07-11 14:32:33.509842 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553509833, "cf_name": "default", "job": 50, "event": "table_file_creation", "file_number": 81, "file_size": 1005372, "table_properties": {"data_size": 1001285, "index_size": 3273, "filter_size": 0, "raw_key_size": 11976, "raw_average_key_size": 18, "raw_value_size": 990457, "raw_average_value_size": 1545, "num_data_blocks": 105, "num_entries": 641, "filter_policy_name": "", "kDeletedKeys": "506", "kMergeOperands": "0"}}
- 2017-07-11 14:32:33.509953 I | rook-ceph-mon2: 2017-07-11 14:32:33.509935 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 50] Level-0 flush table #81: 1005372 bytes OK
- 2017-07-11 14:32:33.605011 I | rook-ceph-mon2: 2017-07-11 14:32:33.604985 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.580708) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #81 started
- 2017-07-11 14:32:33.605075 I | rook-ceph-mon2: 2017-07-11 14:32:33.605060 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.604951) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #81: memtable #1 done
- 2017-07-11 14:32:33.605108 I | rook-ceph-mon2: 2017-07-11 14:32:33.605095 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.604963) EVENT_LOG_v1 {"time_micros": 1499783553604958, "job": 50, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:32:33.605153 I | rook-ceph-mon2: 2017-07-11 14:32:33.605139 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.604976) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:32:33.605168 I | rook-ceph-mon2:
- 2017-07-11 14:32:33.605196 I | rook-ceph-mon2: 2017-07-11 14:32:33.605184 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 50] Try to delete WAL files size 1514436, prev total WAL file size 1514436, number of live WAL files 2.
- 2017-07-11 14:32:33.605235 I | rook-ceph-mon2:
- 2017-07-11 14:32:33.607237 I | rook-ceph-mon2: 2017-07-11 14:32:33.605650 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:32:33.607275 I | rook-ceph-mon2: 2017-07-11 14:32:33.605683 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.605677) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:32:33.607291 I | rook-ceph-mon2:
- 2017-07-11 14:32:33.607302 I | rook-ceph-mon2: 2017-07-11 14:32:33.605687 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 51] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:32:33.607314 I | rook-ceph-mon2: 2017-07-11 14:32:33.605692 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 50 Base level 0, inputs: [81(981KB)], [79(15MB)]
- 2017-07-11 14:32:33.607324 I | rook-ceph-mon2:
- 2017-07-11 14:32:33.607349 I | rook-ceph-mon2: 2017-07-11 14:32:33.605701 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553605694, "job": 51, "event": "compaction_started", "files_L0": [81], "files_L1": [79], "score": -1, "input_data_size": 17389422}
- 2017-07-11 14:32:33.763118 I | rook-ceph-mon2: 2017-07-11 14:32:33.763058 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 51] Generated table #82: 2019 keys, 14336729 bytes
- 2017-07-11 14:32:33.763179 I | rook-ceph-mon2: 2017-07-11 14:32:33.763160 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553763151, "cf_name": "default", "job": 51, "event": "table_file_creation", "file_number": 82, "file_size": 14336729, "table_properties": {"data_size": 14290781, "index_size": 45129, "filter_size": 0, "raw_key_size": 38187, "raw_average_key_size": 18, "raw_value_size": 14231090, "raw_average_value_size": 7048, "num_data_blocks": 1398, "num_entries": 2019, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:32:33.834416 I | rook-ceph-mon2: 2017-07-11 14:32:33.834359 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 51] Compacted 1@0 + 1@1 files to L1 => 14336729 bytes
- 2017-07-11 14:32:33.882248 I | rook-ceph-mon2: 2017-07-11 14:32:33.882215 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.882142) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 76.1 rd, 62.7 wr, level 1, files in(1, 1) out(1) MB in(1.0, 15.6) out(13.7), read-write-amplify(31.6) write-amplify(14.3) OK, records in: 3038, records dropped: 1019
- 2017-07-11 14:32:33.882260 I | rook-ceph-mon2:
- 2017-07-11 14:32:33.882289 I | rook-ceph-mon2: 2017-07-11 14:32:33.882273 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:32:33.882163) EVENT_LOG_v1 {"time_micros": 1499783553882154, "job": 51, "event": "compaction_finished", "compaction_time_micros": 228637, "output_level": 1, "num_output_files": 1, "total_output_size": 14336729, "num_input_records": 3038, "num_output_records": 2019, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:32:33.882558 I | rook-ceph-mon2: 2017-07-11 14:32:33.882532 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553882520, "job": 51, "event": "table_file_deletion", "file_number": 81}
- 2017-07-11 14:32:33.884656 I | rook-ceph-mon2: 2017-07-11 14:32:33.884642 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783553884637, "job": 51, "event": "table_file_deletion", "file_number": 79}
- 2017-07-11 14:32:33.884719 I | rook-ceph-mon2: 2017-07-11 14:32:33.884705 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:32:35.243442 I | rook-ceph-mon2: 2017-07-11 14:32:35.243396 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:35.243678 I | rook-ceph-mon2: 2017-07-11 14:32:35.243661 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2901255932' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:36.120144 I | rook-ceph-mon2: 2017-07-11 14:32:36.120105 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:32:36.120342 I | rook-ceph-mon2: 2017-07-11 14:32:36.120252 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1496524931' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:32:36.582488 I | rook-ceph-mon2: 2017-07-11 14:32:36.582458 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:36.582583 I | rook-ceph-mon2: 2017-07-11 14:32:36.582569 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3455385635' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:37.528499 I | rook-ceph-mon2: 2017-07-11 14:32:37.528464 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:32:37.534227 I | rook-ceph-mon2: 2017-07-11 14:32:37.534182 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/228897907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:32:40.218785 I | rook-ceph-mon2: 2017-07-11 14:32:40.218751 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:40.218985 I | rook-ceph-mon2: 2017-07-11 14:32:40.218901 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/698160767' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:40.671026 I | rook-ceph-mon2: 2017-07-11 14:32:40.670991 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:40.671215 I | rook-ceph-mon2: 2017-07-11 14:32:40.671131 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2428341659' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:41.072576 I | rook-ceph-mon2: 2017-07-11 14:32:41.072542 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:32:41.072770 I | rook-ceph-mon2: 2017-07-11 14:32:41.072685 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4125311578' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:32:41.498114 I | rook-ceph-mon2: 2017-07-11 14:32:41.498082 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:41.498251 I | rook-ceph-mon2: 2017-07-11 14:32:41.498237 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2797300605' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:42.460188 I | rook-ceph-mon2: 2017-07-11 14:32:42.460156 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:32:42.460388 I | rook-ceph-mon2: 2017-07-11 14:32:42.460371 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3634589970' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:32:43.439061 I | rook-ceph-mon2: 2017-07-11 14:32:43.439024 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:43.439300 I | rook-ceph-mon2: 2017-07-11 14:32:43.439211 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3897075564' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:45.088849 I | rook-ceph-mon2: 2017-07-11 14:32:45.088791 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:45.089121 I | rook-ceph-mon2: 2017-07-11 14:32:45.089053 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2562254825' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:45.963899 I | rook-ceph-mon2: 2017-07-11 14:32:45.963863 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:32:45.964152 I | rook-ceph-mon2: 2017-07-11 14:32:45.964112 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/791536885' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:32:46.488948 I | rook-ceph-mon2: 2017-07-11 14:32:46.488915 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:46.489211 I | rook-ceph-mon2: 2017-07-11 14:32:46.489171 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2131371265' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:47.342672 I | rook-ceph-mon2: 2017-07-11 14:32:47.342634 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:32:47.342922 I | rook-ceph-mon2: 2017-07-11 14:32:47.342868 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2427342676' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:32:50.081984 I | rook-ceph-mon2: 2017-07-11 14:32:50.081947 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:50.082199 I | rook-ceph-mon2: 2017-07-11 14:32:50.082085 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/379710199' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:55.836646 I | rook-ceph-mon2: 2017-07-11 14:32:55.836609 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:32:55.836899 I | rook-ceph-mon2: 2017-07-11 14:32:55.836755 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1433063435' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:32:56.391353 I | rook-ceph-mon2: 2017-07-11 14:32:56.391320 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:32:56.391594 I | rook-ceph-mon2: 2017-07-11 14:32:56.391458 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4276759801' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:32:57.255792 I | rook-ceph-mon2: 2017-07-11 14:32:57.255761 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:32:57.256058 I | rook-ceph-mon2: 2017-07-11 14:32:57.255900 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3534741514' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:32:58.112344 I | rook-ceph-mon2: 2017-07-11 14:32:58.112157 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4921 MB, avail 94265 MB
- 2017-07-11 14:32:58.274405 I | rook-ceph-mon2: 2017-07-11 14:32:58.274376 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:58.274510 I | rook-ceph-mon2: 2017-07-11 14:32:58.274495 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1494140304' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:32:59.840559 I | rook-ceph-mon2: 2017-07-11 14:32:59.840512 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:32:59.846947 I | rook-ceph-mon2: 2017-07-11 14:32:59.840660 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2241462789' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:00.316661 I | rook-ceph-mon2: 2017-07-11 14:33:00.316628 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:00.316842 I | rook-ceph-mon2: 2017-07-11 14:33:00.316759 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1756279340' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:01.994970 I | rook-ceph-mon2: 2017-07-11 14:33:01.994937 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:33:01.995158 I | rook-ceph-mon2: 2017-07-11 14:33:01.995078 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1396708626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:33:05.240561 I | rook-ceph-mon2: 2017-07-11 14:33:05.236821 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:05.246449 I | rook-ceph-mon2: 2017-07-11 14:33:05.240672 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1161637074' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:05.790840 I | rook-ceph-mon2: 2017-07-11 14:33:05.790805 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:33:05.791038 I | rook-ceph-mon2: 2017-07-11 14:33:05.790954 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1504399040' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:33:07.239600 I | rook-ceph-mon2: 2017-07-11 14:33:07.239567 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:33:07.239732 I | rook-ceph-mon2: 2017-07-11 14:33:07.239717 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/91421531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:33:08.102603 I | rook-ceph-mon2: 2017-07-11 14:33:08.102569 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:08.102813 I | rook-ceph-mon2: 2017-07-11 14:33:08.102709 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2462121128' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:09.716331 I | rook-ceph-mon2: 2017-07-11 14:33:09.716272 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:09.716558 I | rook-ceph-mon2: 2017-07-11 14:33:09.716526 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/247489316' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:10.168205 I | rook-ceph-mon2: 2017-07-11 14:33:10.167933 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:10.173953 I | rook-ceph-mon2: 2017-07-11 14:33:10.173935 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1291544034' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:11.809019 I | rook-ceph-mon2: 2017-07-11 14:33:11.808984 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:33:11.809181 I | rook-ceph-mon2: 2017-07-11 14:33:11.809164 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3579549182' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:33:12.773744 I | rook-ceph-mon2: 2017-07-11 14:33:12.773704 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:12.773963 I | rook-ceph-mon2: 2017-07-11 14:33:12.773926 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2853804346' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:15.302821 I | rook-ceph-mon2: 2017-07-11 14:33:15.302652 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:33:15.306186 I | rook-ceph-mon2: 2017-07-11 14:33:15.302670 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1384543763' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:33:15.648407 I | rook-ceph-mon2: 2017-07-11 14:33:15.648243 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:33:15.648514 I | rook-ceph-mon2: 2017-07-11 14:33:15.648263 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/48633625' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:33:16.002345 I | rook-ceph-mon2: 2017-07-11 14:33:16.002314 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:16.002528 I | rook-ceph-mon2: 2017-07-11 14:33:16.002440 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2275617552' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:16.861518 I | rook-ceph-mon2: 2017-07-11 14:33:16.861474 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:33:16.861744 I | rook-ceph-mon2: 2017-07-11 14:33:16.861705 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3378923511' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:33:18.071073 I | rook-ceph-mon2: 2017-07-11 14:33:18.071043 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:18.071251 I | rook-ceph-mon2: 2017-07-11 14:33:18.071173 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/834152888' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:20.443037 I | rook-ceph-mon2: 2017-07-11 14:33:20.443004 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:33:20.443145 I | rook-ceph-mon2: 2017-07-11 14:33:20.443129 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2628836776' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:33:20.782784 I | rook-ceph-mon2: 2017-07-11 14:33:20.782751 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:20.782947 I | rook-ceph-mon2: 2017-07-11 14:33:20.782932 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1388235966' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:21.815578 I | rook-ceph-mon2: 2017-07-11 14:33:21.815515 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:33:21.815800 I | rook-ceph-mon2: 2017-07-11 14:33:21.815682 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2286515115' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:33:23.314993 I | rook-ceph-mon2: 2017-07-11 14:33:23.314955 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:33:23.315176 I | rook-ceph-mon2: 2017-07-11 14:33:23.315087 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/126394393' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:33:24.470253 I | rook-ceph-mon2: 2017-07-11 14:33:24.470206 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:24.470478 I | rook-ceph-mon2: 2017-07-11 14:33:24.470462 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3825190769' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:24.889551 I | rook-ceph-mon2: 2017-07-11 14:33:24.889520 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:24.889660 I | rook-ceph-mon2: 2017-07-11 14:33:24.889645 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1742952473' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:25.389856 I | rook-ceph-mon2: 2017-07-11 14:33:25.389823 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:33:25.390052 I | rook-ceph-mon2: 2017-07-11 14:33:25.389977 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/676367452' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:33:29.398515 I | rook-ceph-mon2: 2017-07-11 14:33:29.392084 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:29.401476 I | rook-ceph-mon2: 2017-07-11 14:33:29.398160 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4109366053' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:31.424404 I | rook-ceph-mon2: 2017-07-11 14:33:31.424373 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:33:31.424592 I | rook-ceph-mon2: 2017-07-11 14:33:31.424513 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2395555873' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:33:34.607102 I | rook-ceph-mon2: 2017-07-11 14:33:34.607071 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:33:34.607375 I | rook-ceph-mon2: 2017-07-11 14:33:34.607328 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3440020471' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:33:34.806359 I | rook-ceph-mon2: 2017-07-11 14:33:34.806326 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:34.806582 I | rook-ceph-mon2: 2017-07-11 14:33:34.806463 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2693602863' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:35.276832 I | rook-ceph-mon2: 2017-07-11 14:33:35.276800 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:33:35.277001 I | rook-ceph-mon2: 2017-07-11 14:33:35.276929 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2063652953' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:33:35.790541 I | rook-ceph-mon2: 2017-07-11 14:33:35.790506 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:35.790772 I | rook-ceph-mon2: 2017-07-11 14:33:35.790648 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3153426486' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:39.427101 I | rook-ceph-mon2: 2017-07-11 14:33:39.427066 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:39.427290 I | rook-ceph-mon2: 2017-07-11 14:33:39.427272 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/487069078' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:39.865406 I | rook-ceph-mon2: 2017-07-11 14:33:39.865359 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:39.865635 I | rook-ceph-mon2: 2017-07-11 14:33:39.865545 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1856936036' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:40.369000 I | rook-ceph-mon2: 2017-07-11 14:33:40.368965 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:33:40.369240 I | rook-ceph-mon2: 2017-07-11 14:33:40.369185 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1873998052' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:33:40.784417 I | rook-ceph-mon2: 2017-07-11 14:33:40.784384 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:40.784596 I | rook-ceph-mon2: 2017-07-11 14:33:40.784518 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3004579393' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:41.550645 I | rook-ceph-mon2: 2017-07-11 14:33:41.550609 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:33:41.550837 I | rook-ceph-mon2: 2017-07-11 14:33:41.550748 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1484086399' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:33:42.509304 I | rook-ceph-mon2: 2017-07-11 14:33:42.509269 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:42.509514 I | rook-ceph-mon2: 2017-07-11 14:33:42.509410 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1472967054' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:44.656714 I | rook-ceph-mon2: 2017-07-11 14:33:44.656682 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:44.656926 I | rook-ceph-mon2: 2017-07-11 14:33:44.656814 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1182300736' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:45.064006 I | rook-ceph-mon2: 2017-07-11 14:33:45.063961 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:33:45.064215 I | rook-ceph-mon2: 2017-07-11 14:33:45.064118 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2779857072' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:33:45.676789 I | rook-ceph-mon2: 2017-07-11 14:33:45.676758 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:45.676891 I | rook-ceph-mon2: 2017-07-11 14:33:45.676877 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/327567667' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:46.484428 I | rook-ceph-mon2: 2017-07-11 14:33:46.484394 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:33:46.484590 I | rook-ceph-mon2: 2017-07-11 14:33:46.484525 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3560309689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:33:47.363498 I | rook-ceph-mon2: 2017-07-11 14:33:47.363464 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:33:47.363714 I | rook-ceph-mon2: 2017-07-11 14:33:47.363681 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1943513062' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:33:51.211945 I | rook-ceph-mon2: 2017-07-11 14:33:51.211905 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:33:51.212179 I | rook-ceph-mon2: 2017-07-11 14:33:51.212140 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3476385240' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:33:52.127085 I | rook-ceph-mon2: 2017-07-11 14:33:52.126980 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #83. Immutable memtables: 0.
- 2017-07-11 14:33:52.127151 I | rook-ceph-mon2:
- 2017-07-11 14:33:52.127169 I | rook-ceph-mon2: 2017-07-11 14:33:52.127019 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 52] Syncing log #80
- 2017-07-11 14:33:52.147838 I | rook-ceph-mon2: 2017-07-11 14:33:52.145334 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.127013) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:33:52.147886 I | rook-ceph-mon2: 2017-07-11 14:33:52.145343 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 52] Flushing memtable with next log file: 83
- 2017-07-11 14:33:52.147904 I | rook-ceph-mon2:
- 2017-07-11 14:33:52.147917 I | rook-ceph-mon2: 2017-07-11 14:33:52.145352 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632145348, "job": 52, "event": "flush_started", "num_memtables": 1, "num_entries": 1061, "num_deletes": 251, "memory_usage": 3002424}
- 2017-07-11 14:33:52.147929 I | rook-ceph-mon2: 2017-07-11 14:33:52.145354 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 52] Level-0 flush table #84: started
- 2017-07-11 14:33:52.193699 I | rook-ceph-mon2: 2017-07-11 14:33:52.193666 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632193655, "cf_name": "default", "job": 52, "event": "table_file_creation", "file_number": 84, "file_size": 1981484, "table_properties": {"data_size": 1974219, "index_size": 6450, "filter_size": 0, "raw_key_size": 9566, "raw_average_key_size": 18, "raw_value_size": 1962639, "raw_average_value_size": 3818, "num_data_blocks": 206, "num_entries": 514, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:33:52.193781 I | rook-ceph-mon2: 2017-07-11 14:33:52.193763 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 52] Level-0 flush table #84: 1981484 bytes OK
- 2017-07-11 14:33:52.240590 I | rook-ceph-mon2: 2017-07-11 14:33:52.240560 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.211882) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #84 started
- 2017-07-11 14:33:52.240654 I | rook-ceph-mon2: 2017-07-11 14:33:52.240639 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.240520) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #84: memtable #1 done
- 2017-07-11 14:33:52.240686 I | rook-ceph-mon2: 2017-07-11 14:33:52.240674 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.240533) EVENT_LOG_v1 {"time_micros": 1499783632240529, "job": 52, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:33:52.240728 I | rook-ceph-mon2: 2017-07-11 14:33:52.240716 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.240547) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:33:52.240743 I | rook-ceph-mon2:
- 2017-07-11 14:33:52.240772 I | rook-ceph-mon2: 2017-07-11 14:33:52.240761 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 52] Try to delete WAL files size 2979288, prev total WAL file size 2979288, number of live WAL files 2.
- 2017-07-11 14:33:52.240798 I | rook-ceph-mon2:
- 2017-07-11 14:33:52.245155 I | rook-ceph-mon2: 2017-07-11 14:33:52.241441 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:33:52.245220 I | rook-ceph-mon2: 2017-07-11 14:33:52.241652 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:33:52.245237 I | rook-ceph-mon2: 2017-07-11 14:33:52.241658 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:33:52.245280 I | rook-ceph-mon2: ** DB Stats **
- 2017-07-11 14:33:52.245294 I | rook-ceph-mon2: Uptime(secs): 4195.0 total, 623.8 interval
- 2017-07-11 14:33:52.245305 I | rook-ceph-mon2: Cumulative writes: 7158 writes, 34K keys, 7158 commit groups, 1.0 writes per commit group, ingest: 0.09 GB, 0.02 MB/s
- 2017-07-11 14:33:52.245316 I | rook-ceph-mon2: Cumulative WAL: 7158 writes, 7158 syncs, 1.00 writes per sync, written: 0.09 GB, 0.02 MB/s
- 2017-07-11 14:33:52.245328 I | rook-ceph-mon2: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:33:52.245352 I | rook-ceph-mon2: Interval writes: 1566 writes, 8675 keys, 1566 commit groups, 1.0 writes per commit group, ingest: 22.61 MB, 0.04 MB/s
- 2017-07-11 14:33:52.245377 I | rook-ceph-mon2: Interval WAL: 1566 writes, 1566 syncs, 1.00 writes per sync, written: 0.02 MB, 0.04 MB/s
- 2017-07-11 14:33:52.245388 I | rook-ceph-mon2: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:33:52.245398 I | rook-ceph-mon2:
- 2017-07-11 14:33:52.245408 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 14:33:52.245442 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:33:52.245454 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:33:52.245466 I | rook-ceph-mon2: L0 1/1 1.89 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 14.9 4 27 0.143 0 0
- 2017-07-11 14:33:52.245477 I | rook-ceph-mon2: L1 1/1 13.67 MB 0.0 0.3 0.1 0.3 0.3 0.0 0.0 5.5 42.1 37.1 8 24 0.343 56K 11K
- 2017-07-11 14:33:52.245489 I | rook-ceph-mon2: Sum 2/2 15.56 MB 0.0 0.3 0.1 0.3 0.4 0.1 0.0 6.3 28.7 30.0 12 51 0.237 56K 11K
- 2017-07-11 14:33:52.245524 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 7.7 41.4 41.3 3 14 0.198 19K 4477
- 2017-07-11 14:33:52.245536 I | rook-ceph-mon2: Uptime(secs): 4195.0 total, 4195.0 interval
- 2017-07-11 14:33:52.245548 I | rook-ceph-mon2: Flush(GB): cumulative 0.056, interval 0.014
- 2017-07-11 14:33:52.245559 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:33:52.245596 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:33:52.245608 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:33:52.245618 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:33:52.245630 I | rook-ceph-mon2: Cumulative compaction: 0.35 GB write, 0.09 MB/s write, 0.34 GB read, 0.08 MB/s read, 12.1 seconds
- 2017-07-11 14:33:52.245641 I | rook-ceph-mon2: Interval compaction: 0.11 GB write, 0.03 MB/s write, 0.11 GB read, 0.03 MB/s read, 2.8 seconds
- 2017-07-11 14:33:52.245652 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:33:52.245687 I | rook-ceph-mon2:
- 2017-07-11 14:33:52.245699 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:33:52.245710 I | rook-ceph-mon2:
- 2017-07-11 14:33:52.245732 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 14:33:52.245742 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:33:52.245803 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:33:52.245817 I | rook-ceph-mon2: L0 1/1 1.89 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 14.9 4 27 0.143 0 0
- 2017-07-11 14:33:52.245843 I | rook-ceph-mon2: L1 1/1 13.67 MB 0.0 0.3 0.1 0.3 0.3 0.0 0.0 5.5 42.1 37.1 8 24 0.343 56K 11K
- 2017-07-11 14:33:52.245854 I | rook-ceph-mon2: Sum 2/2 15.56 MB 0.0 0.3 0.1 0.3 0.4 0.1 0.0 6.3 28.7 30.0 12 51 0.237 56K 11K
- 2017-07-11 14:33:52.245877 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:33:52.245890 I | rook-ceph-mon2: Uptime(secs): 4195.0 total, 4195.0 interval
- 2017-07-11 14:33:52.245900 I | rook-ceph-mon2: Flush(GB): cumulative 0.056, interval 0.000
- 2017-07-11 14:33:52.245911 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:33:52.245921 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:33:52.245932 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:33:52.245954 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:33:52.245967 I | rook-ceph-mon2: Cumulative compaction: 0.35 GB write, 0.09 MB/s write, 0.34 GB read, 0.08 MB/s read, 12.1 seconds
- 2017-07-11 14:33:52.245977 I | rook-ceph-mon2: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:33:52.245989 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:33:52.245999 I | rook-ceph-mon2:
- 2017-07-11 14:33:52.246010 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:33:52.246032 I | rook-ceph-mon2:
- 2017-07-11 14:33:52.246044 I | rook-ceph-mon2: 2017-07-11 14:33:52.241673 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.241668) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:33:52.246055 I | rook-ceph-mon2:
- 2017-07-11 14:33:52.246066 I | rook-ceph-mon2: 2017-07-11 14:33:52.241677 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 53] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:33:52.246089 I | rook-ceph-mon2: 2017-07-11 14:33:52.241680 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 52 Base level 0, inputs: [84(1935KB)], [82(13MB)]
- 2017-07-11 14:33:52.246110 I | rook-ceph-mon2:
- 2017-07-11 14:33:52.246121 I | rook-ceph-mon2: 2017-07-11 14:33:52.241689 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632241682, "job": 53, "event": "compaction_started", "files_L0": [84], "files_L1": [82], "score": -1, "input_data_size": 16318213}
- 2017-07-11 14:33:52.431961 I | rook-ceph-mon2: 2017-07-11 14:33:52.431877 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 53] Generated table #85: 2024 keys, 13731213 bytes
- 2017-07-11 14:33:52.432187 I | rook-ceph-mon2: 2017-07-11 14:33:52.432140 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632432054, "cf_name": "default", "job": 53, "event": "table_file_creation", "file_number": 85, "file_size": 13731213, "table_properties": {"data_size": 13686386, "index_size": 44008, "filter_size": 0, "raw_key_size": 38532, "raw_average_key_size": 19, "raw_value_size": 13627332, "raw_average_value_size": 6732, "num_data_blocks": 1352, "num_entries": 2024, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:33:52.479915 I | rook-ceph-mon2: 2017-07-11 14:33:52.479881 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 53] Compacted 1@0 + 1@1 files to L1 => 13731213 bytes
- 2017-07-11 14:33:52.546196 I | rook-ceph-mon2: 2017-07-11 14:33:52.546159 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.546082) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 68.5 rd, 57.7 wr, level 1, files in(1, 1) out(1) MB in(1.9, 13.7) out(13.1), read-write-amplify(15.2) write-amplify(6.9) OK, records in: 2533, records dropped: 509
- 2017-07-11 14:33:52.546210 I | rook-ceph-mon2:
- 2017-07-11 14:33:52.546243 I | rook-ceph-mon2: 2017-07-11 14:33:52.546225 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:33:52.546107) EVENT_LOG_v1 {"time_micros": 1499783632546097, "job": 53, "event": "compaction_finished", "compaction_time_micros": 238178, "output_level": 1, "num_output_files": 1, "total_output_size": 13731213, "num_input_records": 2533, "num_output_records": 2024, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:33:52.546652 I | rook-ceph-mon2: 2017-07-11 14:33:52.546626 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632546623, "job": 53, "event": "table_file_deletion", "file_number": 84}
- 2017-07-11 14:33:52.548397 I | rook-ceph-mon2: 2017-07-11 14:33:52.548383 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783632548381, "job": 53, "event": "table_file_deletion", "file_number": 82}
- 2017-07-11 14:33:54.455497 I | rook-ceph-mon2: 2017-07-11 14:33:54.455466 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:54.455691 I | rook-ceph-mon2: 2017-07-11 14:33:54.455598 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/485932256' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:55.470986 I | rook-ceph-mon2: 2017-07-11 14:33:55.470956 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:55.471089 I | rook-ceph-mon2: 2017-07-11 14:33:55.471075 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2740971934' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:33:56.372864 I | rook-ceph-mon2: 2017-07-11 14:33:56.372832 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:33:56.373069 I | rook-ceph-mon2: 2017-07-11 14:33:56.372988 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2745537175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:33:58.112833 I | rook-ceph-mon2: 2017-07-11 14:33:58.112502 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4920 MB, avail 94266 MB
- 2017-07-11 14:33:59.369323 I | rook-ceph-mon2: 2017-07-11 14:33:59.369278 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:33:59.369517 I | rook-ceph-mon2: 2017-07-11 14:33:59.369430 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/304420230' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:00.249314 I | rook-ceph-mon2: 2017-07-11 14:34:00.249279 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:00.249556 I | rook-ceph-mon2: 2017-07-11 14:34:00.249519 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3716774593' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:02.096304 I | rook-ceph-mon2: 2017-07-11 14:34:02.096268 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:02.096429 I | rook-ceph-mon2: 2017-07-11 14:34:02.096412 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3935069033' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:04.297778 I | rook-ceph-mon2: 2017-07-11 14:34:04.297747 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:04.297955 I | rook-ceph-mon2: 2017-07-11 14:34:04.297876 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/46394333' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:08.149919 I | rook-ceph-mon2: 2017-07-11 14:34:08.149873 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:34:08.150107 I | rook-ceph-mon2: 2017-07-11 14:34:08.150017 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2541420126' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:34:09.294581 I | rook-ceph-mon2: 2017-07-11 14:34:09.294548 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:09.294814 I | rook-ceph-mon2: 2017-07-11 14:34:09.294683 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2718464772' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:09.766693 I | rook-ceph-mon2: 2017-07-11 14:34:09.766656 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:34:09.766925 I | rook-ceph-mon2: 2017-07-11 14:34:09.766906 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/912487009' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:34:10.180541 I | rook-ceph-mon2: 2017-07-11 14:34:10.180487 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:10.180724 I | rook-ceph-mon2: 2017-07-11 14:34:10.180646 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2037241330' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:10.935751 I | rook-ceph-mon2: 2017-07-11 14:34:10.935716 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:34:10.935946 I | rook-ceph-mon2: 2017-07-11 14:34:10.935862 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4197285727' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:34:11.805977 I | rook-ceph-mon2: 2017-07-11 14:34:11.805899 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:11.806184 I | rook-ceph-mon2: 2017-07-11 14:34:11.806097 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2001721962' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:13.693811 I | rook-ceph-mon2: 2017-07-11 14:34:13.693776 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:13.694051 I | rook-ceph-mon2: 2017-07-11 14:34:13.693945 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1203466398' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:14.109333 I | rook-ceph-mon2: 2017-07-11 14:34:14.109297 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:14.109542 I | rook-ceph-mon2: 2017-07-11 14:34:14.109436 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1544223893' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:16.189027 I | rook-ceph-mon2: 2017-07-11 14:34:16.188992 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:34:16.189240 I | rook-ceph-mon2: 2017-07-11 14:34:16.189203 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3650423796' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:34:17.163622 I | rook-ceph-mon2: 2017-07-11 14:34:17.163591 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:17.163718 I | rook-ceph-mon2: 2017-07-11 14:34:17.163704 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4109295784' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:19.076954 I | rook-ceph-mon2: 2017-07-11 14:34:19.076921 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:19.077143 I | rook-ceph-mon2: 2017-07-11 14:34:19.077056 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1665224596' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:19.478167 I | rook-ceph-mon2: 2017-07-11 14:34:19.478132 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:34:19.478297 I | rook-ceph-mon2: 2017-07-11 14:34:19.478283 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3085502835' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:34:20.730288 I | rook-ceph-mon2: 2017-07-11 14:34:20.730253 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:34:20.730512 I | rook-ceph-mon2: 2017-07-11 14:34:20.730471 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/326245850' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:34:21.556751 I | rook-ceph-mon2: 2017-07-11 14:34:21.556674 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:21.556938 I | rook-ceph-mon2: 2017-07-11 14:34:21.556860 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/170560145' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:21.610435 I | rook-ceph-mon2: 2017-07-11 14:34:21.610402 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:34:21.610549 I | rook-ceph-mon2: 2017-07-11 14:34:21.610534 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3350894521' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:34:23.813451 I | rook-ceph-mon2: 2017-07-11 14:34:23.813405 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:23.813714 I | rook-ceph-mon2: 2017-07-11 14:34:23.813676 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/802180149' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:24.234128 I | rook-ceph-mon2: 2017-07-11 14:34:24.234094 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:24.234367 I | rook-ceph-mon2: 2017-07-11 14:34:24.234262 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1186689019' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:24.735955 I | rook-ceph-mon2: 2017-07-11 14:34:24.735919 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:34:24.736217 I | rook-ceph-mon2: 2017-07-11 14:34:24.736189 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3927697684' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:34:28.941972 I | rook-ceph-mon2: 2017-07-11 14:34:28.941922 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:28.942090 I | rook-ceph-mon2: 2017-07-11 14:34:28.942076 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/735306959' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:29.376544 I | rook-ceph-mon2: 2017-07-11 14:34:29.376509 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:34:29.376736 I | rook-ceph-mon2: 2017-07-11 14:34:29.376652 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1398491424' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:34:29.822791 I | rook-ceph-mon2: 2017-07-11 14:34:29.822756 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:29.822914 I | rook-ceph-mon2: 2017-07-11 14:34:29.822898 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1882963782' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:32.737920 I | rook-ceph-mon2: 2017-07-11 14:34:32.737747 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:34:32.737938 I | rook-ceph-mon2: 2017-07-11 14:34:32.737780 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/297925324' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:34:33.412628 I | rook-ceph-mon2: 2017-07-11 14:34:33.412583 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:33.412805 I | rook-ceph-mon2: 2017-07-11 14:34:33.412724 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/476838486' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:34.213424 I | rook-ceph-mon2: 2017-07-11 14:34:34.213391 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:34:34.219140 I | rook-ceph-mon2: 2017-07-11 14:34:34.219110 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/811170026' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:34:34.611188 I | rook-ceph-mon2: 2017-07-11 14:34:34.611155 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:34.611363 I | rook-ceph-mon2: 2017-07-11 14:34:34.611348 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2573441318' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:36.484241 I | rook-ceph-mon2: 2017-07-11 14:34:36.484208 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:36.484427 I | rook-ceph-mon2: 2017-07-11 14:34:36.484346 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4065407842' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:36.797105 I | rook-ceph-mon2: 2017-07-11 14:34:35.588917 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1208 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.179707s > max 0.05s
- 2017-07-11 14:34:38.722693 I | rook-ceph-mon2: 2017-07-11 14:34:38.722659 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:38.722800 I | rook-ceph-mon2: 2017-07-11 14:34:38.722785 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3338124871' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:39.148490 I | rook-ceph-mon2: 2017-07-11 14:34:39.148458 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:34:39.148620 I | rook-ceph-mon2: 2017-07-11 14:34:39.148604 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2185813982' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:34:39.645799 I | rook-ceph-mon2: 2017-07-11 14:34:39.645763 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:39.646088 I | rook-ceph-mon2: 2017-07-11 14:34:39.646059 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3113657344' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:41.234482 I | rook-ceph-mon2: 2017-07-11 14:34:41.234446 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:41.234753 I | rook-ceph-mon2: 2017-07-11 14:34:41.234735 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3197927228' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:43.254566 I | rook-ceph-mon2: 2017-07-11 14:34:43.254533 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:43.260557 I | rook-ceph-mon2: 2017-07-11 14:34:43.260534 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2127228394' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:44.080523 I | rook-ceph-mon2: 2017-07-11 14:34:44.080490 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:34:44.080645 I | rook-ceph-mon2: 2017-07-11 14:34:44.080620 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1333092309' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:34:44.497929 I | rook-ceph-mon2: 2017-07-11 14:34:44.497893 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:44.498180 I | rook-ceph-mon2: 2017-07-11 14:34:44.498133 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3714345124' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:46.321023 I | rook-ceph-mon2: 2017-07-11 14:34:46.320988 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:46.321223 I | rook-ceph-mon2: 2017-07-11 14:34:46.321129 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/883594103' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:48.186811 I | rook-ceph-mon2: 2017-07-11 14:34:48.186427 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:48.187125 I | rook-ceph-mon2: 2017-07-11 14:34:48.186448 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1435310481' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:49.017539 I | rook-ceph-mon2: 2017-07-11 14:34:49.017385 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:34:49.017630 I | rook-ceph-mon2: 2017-07-11 14:34:49.017404 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1984436213' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:34:51.099484 I | rook-ceph-mon2: 2017-07-11 14:34:51.099448 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:51.099713 I | rook-ceph-mon2: 2017-07-11 14:34:51.099642 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3807151162' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:53.631950 I | rook-ceph-mon2: 2017-07-11 14:34:53.631914 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:53.632180 I | rook-ceph-mon2: 2017-07-11 14:34:53.632163 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3079652864' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:54.485052 I | rook-ceph-mon2: 2017-07-11 14:34:54.484993 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:54.485264 I | rook-ceph-mon2: 2017-07-11 14:34:54.485248 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/225250398' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:34:56.185919 I | rook-ceph-mon2: 2017-07-11 14:34:56.185884 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:56.186161 I | rook-ceph-mon2: 2017-07-11 14:34:56.186109 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3966654510' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:58.049880 I | rook-ceph-mon2: 2017-07-11 14:34:58.049846 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:34:58.050071 I | rook-ceph-mon2: 2017-07-11 14:34:58.049986 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2023652397' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:34:58.116542 I | rook-ceph-mon2: 2017-07-11 14:34:58.116324 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4921 MB, avail 94266 MB
- 2017-07-11 14:34:58.494416 I | rook-ceph-mon2: 2017-07-11 14:34:58.494386 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:34:58.494593 I | rook-ceph-mon2: 2017-07-11 14:34:58.494511 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/799882862' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:05.217076 I | rook-ceph-mon2: 2017-07-11 14:35:05.217041 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:35:05.217329 I | rook-ceph-mon2: 2017-07-11 14:35:05.217312 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3438020674' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:35:06.153292 I | rook-ceph-mon2: 2017-07-11 14:35:06.153255 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:06.153485 I | rook-ceph-mon2: 2017-07-11 14:35:06.153396 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3730637946' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:08.546577 I | rook-ceph-mon2: 2017-07-11 14:35:08.546527 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:08.546831 I | rook-ceph-mon2: 2017-07-11 14:35:08.546791 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2047702592' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:09.420902 I | rook-ceph-mon2: 2017-07-11 14:35:09.420866 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:09.421094 I | rook-ceph-mon2: 2017-07-11 14:35:09.421007 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1050067563' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:10.371012 I | rook-ceph-mon2: 2017-07-11 14:35:10.370968 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:35:10.371205 I | rook-ceph-mon2: 2017-07-11 14:35:10.371116 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2221807201' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:35:11.518162 I | rook-ceph-mon2: 2017-07-11 14:35:11.518127 7f0c84e17700 0 log_channel(cluster) log [WRN] : message from mon.0 was stamped 0.051743s in the future, clocks not synchronized
- 2017-07-11 14:35:12.736865 I | rook-ceph-mon2: 2017-07-11 14:35:11.518246 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 950 : cluster [WRN] message from mon.0 was stamped 0.051743s in the future, clocks not synchronized
- 2017-07-11 14:35:13.225583 I | rook-ceph-mon2: 2017-07-11 14:35:13.225551 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:13.225846 I | rook-ceph-mon2: 2017-07-11 14:35:13.225681 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1504604041' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:15.341873 I | rook-ceph-mon2: 2017-07-11 14:35:15.341837 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:35:15.342130 I | rook-ceph-mon2: 2017-07-11 14:35:15.342106 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3531884508' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:35:18.135603 I | rook-ceph-mon2: 2017-07-11 14:35:18.135575 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:18.135701 I | rook-ceph-mon2: 2017-07-11 14:35:18.135687 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1134866072' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:18.528086 I | rook-ceph-mon2: 2017-07-11 14:35:18.528052 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:35:18.528205 I | rook-ceph-mon2: 2017-07-11 14:35:18.528189 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1391625066' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:35:18.946733 I | rook-ceph-mon2: 2017-07-11 14:35:18.946698 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:18.946949 I | rook-ceph-mon2: 2017-07-11 14:35:18.946842 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2271627446' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:19.807290 I | rook-ceph-mon2: 2017-07-11 14:35:19.807245 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:35:19.807546 I | rook-ceph-mon2: 2017-07-11 14:35:19.807528 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/991429826' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:35:23.661616 I | rook-ceph-mon2: 2017-07-11 14:35:23.661569 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:35:23.661841 I | rook-ceph-mon2: 2017-07-11 14:35:23.661738 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3905567836' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:35:24.098292 I | rook-ceph-mon2: 2017-07-11 14:35:24.098246 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:24.098483 I | rook-ceph-mon2: 2017-07-11 14:35:24.098396 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1407010076' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:27.566561 I | rook-ceph-mon2: 2017-07-11 14:35:27.566526 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:27.566789 I | rook-ceph-mon2: 2017-07-11 14:35:27.566748 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2197575673' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:28.201620 I | rook-ceph-mon2: 2017-07-11 14:35:28.201453 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:35:28.201715 I | rook-ceph-mon2: 2017-07-11 14:35:28.201480 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2852942826' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:35:28.443985 I | rook-ceph-mon2: 2017-07-11 14:35:28.443954 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:35:28.444085 I | rook-ceph-mon2: 2017-07-11 14:35:28.444070 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2004181804' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:35:28.842233 I | rook-ceph-mon2: 2017-07-11 14:35:28.842198 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:28.842409 I | rook-ceph-mon2: 2017-07-11 14:35:28.842329 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1060229056' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:29.743327 I | rook-ceph-mon2: 2017-07-11 14:35:29.743277 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:35:29.743550 I | rook-ceph-mon2: 2017-07-11 14:35:29.743509 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3777053506' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:35:32.489515 I | rook-ceph-mon2: 2017-07-11 14:35:32.489479 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:32.489708 I | rook-ceph-mon2: 2017-07-11 14:35:32.489620 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4268518775' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:32.934976 I | rook-ceph-mon2: 2017-07-11 14:35:32.934945 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:32.935163 I | rook-ceph-mon2: 2017-07-11 14:35:32.935089 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2781565916' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:33.384446 I | rook-ceph-mon2: 2017-07-11 14:35:33.384410 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:35:33.384547 I | rook-ceph-mon2: 2017-07-11 14:35:33.384533 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/411195581' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:35:33.808740 I | rook-ceph-mon2: 2017-07-11 14:35:33.808705 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:33.808921 I | rook-ceph-mon2: 2017-07-11 14:35:33.808840 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/193190165' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:34.756681 I | rook-ceph-mon2: 2017-07-11 14:35:34.756647 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:35:34.756863 I | rook-ceph-mon2: 2017-07-11 14:35:34.756844 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1414724415' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:35:35.829677 I | rook-ceph-mon2: 2017-07-11 14:35:35.829642 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:35.829862 I | rook-ceph-mon2: 2017-07-11 14:35:35.829776 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3413677590' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:37.890062 I | rook-ceph-mon2: 2017-07-11 14:35:37.890030 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:37.890262 I | rook-ceph-mon2: 2017-07-11 14:35:37.890240 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2978332700' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:38.342366 I | rook-ceph-mon2: 2017-07-11 14:35:38.342334 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:35:38.342471 I | rook-ceph-mon2: 2017-07-11 14:35:38.342456 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3907911129' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:35:38.748350 I | rook-ceph-mon2: 2017-07-11 14:35:38.748315 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:38.748456 I | rook-ceph-mon2: 2017-07-11 14:35:38.748441 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3718070822' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:40.535549 I | rook-ceph-mon2: 2017-07-11 14:35:40.535510 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:40.535748 I | rook-ceph-mon2: 2017-07-11 14:35:40.535660 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4020579532' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:42.772047 I | rook-ceph-mon2: 2017-07-11 14:35:42.772016 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:42.772225 I | rook-ceph-mon2: 2017-07-11 14:35:42.772145 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1384652922' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:43.276869 I | rook-ceph-mon2: 2017-07-11 14:35:43.276834 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:35:43.277110 I | rook-ceph-mon2: 2017-07-11 14:35:43.277068 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/785633019' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:35:43.699149 I | rook-ceph-mon2: 2017-07-11 14:35:43.699113 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:43.699330 I | rook-ceph-mon2: 2017-07-11 14:35:43.699246 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3343910729' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:47.694598 I | rook-ceph-mon2: 2017-07-11 14:35:47.694568 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:47.694866 I | rook-ceph-mon2: 2017-07-11 14:35:47.694849 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1336919756' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:48.526128 I | rook-ceph-mon2: 2017-07-11 14:35:48.526095 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:48.526256 I | rook-ceph-mon2: 2017-07-11 14:35:48.526241 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2284302339' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:49.361779 I | rook-ceph-mon2: 2017-07-11 14:35:49.361746 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:35:49.361995 I | rook-ceph-mon2: 2017-07-11 14:35:49.361898 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3558485130' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:35:50.322487 I | rook-ceph-mon2: 2017-07-11 14:35:50.322443 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:50.322677 I | rook-ceph-mon2: 2017-07-11 14:35:50.322594 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3834696853' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:52.614642 I | rook-ceph-mon2: 2017-07-11 14:35:52.614598 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:35:52.614902 I | rook-ceph-mon2: 2017-07-11 14:35:52.614884 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1740862189' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:35:55.186553 I | rook-ceph-mon2: 2017-07-11 14:35:55.180266 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:55.186670 I | rook-ceph-mon2: 2017-07-11 14:35:55.186019 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1730802516' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:57.137307 I | rook-ceph-mon2: 2017-07-11 14:35:57.137272 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:35:57.137541 I | rook-ceph-mon2: 2017-07-11 14:35:57.137521 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3068392062' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:35:57.948548 I | rook-ceph-mon2: 2017-07-11 14:35:57.948490 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:35:57.948729 I | rook-ceph-mon2: 2017-07-11 14:35:57.948650 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/461951480' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:35:58.119430 I | rook-ceph-mon2: 2017-07-11 14:35:58.119146 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4921 MB, avail 94266 MB
- 2017-07-11 14:35:59.450835 I | rook-ceph-mon2: 2017-07-11 14:35:59.450800 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:35:59.451207 I | rook-ceph-mon2: 2017-07-11 14:35:59.451188 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1298625879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:36:01.349877 I | rook-ceph-mon2: 2017-07-11 14:36:01.349837 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:36:01.350061 I | rook-ceph-mon2: 2017-07-11 14:36:01.349982 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/516141483' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:36:02.929718 I | rook-ceph-mon2: 2017-07-11 14:36:02.929683 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:36:02.929936 I | rook-ceph-mon2: 2017-07-11 14:36:02.929832 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1389458483' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:36:04.463900 I | rook-ceph-mon2: 2017-07-11 14:36:04.463870 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:36:04.464082 I | rook-ceph-mon2: 2017-07-11 14:36:04.464006 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/724473808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:36:05.268481 I | rook-ceph-mon2: 2017-07-11 14:36:05.268445 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:05.268724 I | rook-ceph-mon2: 2017-07-11 14:36:05.268685 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2816949520' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:07.006622 I | rook-ceph-mon2: 2017-07-11 14:36:07.006587 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:07.006831 I | rook-ceph-mon2: 2017-07-11 14:36:07.006729 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2493321551' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:07.932589 I | rook-ceph-mon2: 2017-07-11 14:36:07.932548 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:36:07.932773 I | rook-ceph-mon2: 2017-07-11 14:36:07.932689 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4072885163' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:36:08.338400 I | rook-ceph-mon2: 2017-07-11 14:36:08.337906 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:08.338677 I | rook-ceph-mon2: 2017-07-11 14:36:08.337945 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/372367971' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:10.131898 I | rook-ceph-mon2: 2017-07-11 14:36:10.131857 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:10.132154 I | rook-ceph-mon2: 2017-07-11 14:36:10.132126 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1228207239' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:11.899390 I | rook-ceph-mon2: 2017-07-11 14:36:11.899340 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:11.899627 I | rook-ceph-mon2: 2017-07-11 14:36:11.899502 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2678216005' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:12.763156 I | rook-ceph-mon2: 2017-07-11 14:36:12.763123 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:36:12.763273 I | rook-ceph-mon2: 2017-07-11 14:36:12.763258 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/315020043' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:36:13.169261 I | rook-ceph-mon2: 2017-07-11 14:36:13.169225 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:13.169371 I | rook-ceph-mon2: 2017-07-11 14:36:13.169355 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2755446721' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:16.825038 I | rook-ceph-mon2: 2017-07-11 14:36:16.824949 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:16.825884 I | rook-ceph-mon2: 2017-07-11 14:36:16.825866 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3280029211' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:17.427080 I | rook-ceph-mon2: 2017-07-11 14:36:17.427036 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:17.427448 I | rook-ceph-mon2: 2017-07-11 14:36:17.427433 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1851799994' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:18.270504 I | rook-ceph-mon2: 2017-07-11 14:36:18.270472 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:18.270712 I | rook-ceph-mon2: 2017-07-11 14:36:18.270634 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2725435684' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:19.122767 I | rook-ceph-mon2: 2017-07-11 14:36:19.122731 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:36:19.122987 I | rook-ceph-mon2: 2017-07-11 14:36:19.122869 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/315470591' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:36:21.117309 I | rook-ceph-mon2: 2017-07-11 14:36:21.117270 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:36:21.117513 I | rook-ceph-mon2: 2017-07-11 14:36:21.117412 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1849946637' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:36:21.765114 I | rook-ceph-mon2: 2017-07-11 14:36:21.765070 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:21.765344 I | rook-ceph-mon2: 2017-07-11 14:36:21.765305 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2293924189' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:22.158136 I | rook-ceph-mon2: 2017-07-11 14:36:22.158095 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:22.158362 I | rook-ceph-mon2: 2017-07-11 14:36:22.158346 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/883441872' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:23.008270 I | rook-ceph-mon2: 2017-07-11 14:36:23.008231 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:23.008465 I | rook-ceph-mon2: 2017-07-11 14:36:23.008383 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1975726019' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:27.109631 I | rook-ceph-mon2: 2017-07-11 14:36:27.109600 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:27.109831 I | rook-ceph-mon2: 2017-07-11 14:36:27.109744 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1961015213' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:27.569608 I | rook-ceph-mon2: 2017-07-11 14:36:27.569552 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:36:27.569791 I | rook-ceph-mon2: 2017-07-11 14:36:27.569708 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1610588632' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:36:27.980847 I | rook-ceph-mon2: 2017-07-11 14:36:27.980814 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:27.980960 I | rook-ceph-mon2: 2017-07-11 14:36:27.980945 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3227746404' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:28.812937 I | rook-ceph-mon2: 2017-07-11 14:36:28.812904 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:36:28.813172 I | rook-ceph-mon2: 2017-07-11 14:36:28.813140 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2622386835' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:36:29.824504 I | rook-ceph-mon2: 2017-07-11 14:36:29.818383 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:29.824618 I | rook-ceph-mon2: 2017-07-11 14:36:29.818415 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1044627826' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:31.609893 I | rook-ceph-mon2: 2017-07-11 14:36:31.609848 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:31.610084 I | rook-ceph-mon2: 2017-07-11 14:36:31.609989 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2467496290' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:32.360256 I | rook-ceph-mon2: 2017-07-11 14:36:32.360211 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:36:32.360429 I | rook-ceph-mon2: 2017-07-11 14:36:32.360353 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1480334202' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:36:32.428936 I | rook-ceph-mon2: 2017-07-11 14:36:32.428778 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:36:32.428979 I | rook-ceph-mon2: 2017-07-11 14:36:32.428792 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4049931600' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:36:33.779874 I | rook-ceph-mon2: 2017-07-11 14:36:33.779837 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:36:33.780113 I | rook-ceph-mon2: 2017-07-11 14:36:33.779984 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1133338125' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:36:37.369883 I | rook-ceph-mon2: 2017-07-11 14:36:37.369739 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:36:37.370298 I | rook-ceph-mon2: 2017-07-11 14:36:37.370281 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/734732751' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:36:37.853636 I | rook-ceph-mon2: 2017-07-11 14:36:37.853603 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:37.853802 I | rook-ceph-mon2: 2017-07-11 14:36:37.853732 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4169150861' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:39.785156 I | rook-ceph-mon2: 2017-07-11 14:36:39.785121 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:39.785352 I | rook-ceph-mon2: 2017-07-11 14:36:39.785258 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1524373151' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:41.425920 I | rook-ceph-mon2: 2017-07-11 14:36:41.425887 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:41.426109 I | rook-ceph-mon2: 2017-07-11 14:36:41.426027 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3833854899' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:41.847526 I | rook-ceph-mon2: 2017-07-11 14:36:41.847496 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:41.847697 I | rook-ceph-mon2: 2017-07-11 14:36:41.847622 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1910482334' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:46.353297 I | rook-ceph-mon2: 2017-07-11 14:36:46.353254 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:46.353526 I | rook-ceph-mon2: 2017-07-11 14:36:46.353430 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2069524128' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:46.797370 I | rook-ceph-mon2: 2017-07-11 14:36:46.797337 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:46.797564 I | rook-ceph-mon2: 2017-07-11 14:36:46.797475 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1083613169' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:47.349019 I | rook-ceph-mon2: 2017-07-11 14:36:47.348984 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:36:47.349209 I | rook-ceph-mon2: 2017-07-11 14:36:47.349125 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1526414763' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:36:48.779237 I | rook-ceph-mon2: 2017-07-11 14:36:48.779207 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:36:48.779389 I | rook-ceph-mon2: 2017-07-11 14:36:48.779326 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/888881996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:36:49.774539 I | rook-ceph-mon2: 2017-07-11 14:36:49.774505 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:49.774738 I | rook-ceph-mon2: 2017-07-11 14:36:49.774650 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2560053374' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:52.293036 I | rook-ceph-mon2: 2017-07-11 14:36:52.293001 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:52.293273 I | rook-ceph-mon2: 2017-07-11 14:36:52.293141 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3657640115' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:52.745832 I | rook-ceph-mon2: 2017-07-11 14:36:52.745796 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:36:52.751630 I | rook-ceph-mon2: 2017-07-11 14:36:52.751610 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3604554351' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:36:53.147298 I | rook-ceph-mon2: 2017-07-11 14:36:53.147265 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:53.153085 I | rook-ceph-mon2: 2017-07-11 14:36:53.153064 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2314636300' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:54.009880 I | rook-ceph-mon2: 2017-07-11 14:36:54.009849 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:36:54.010071 I | rook-ceph-mon2: 2017-07-11 14:36:54.010034 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3285833118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:36:54.891816 I | rook-ceph-mon2: 2017-07-11 14:36:54.891782 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:54.892003 I | rook-ceph-mon2: 2017-07-11 14:36:54.891921 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3757498353' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:56.721507 I | rook-ceph-mon2: 2017-07-11 14:36:56.721470 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:36:56.721722 I | rook-ceph-mon2: 2017-07-11 14:36:56.721639 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2401112013' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:36:57.143601 I | rook-ceph-mon2: 2017-07-11 14:36:57.143567 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:36:57.143780 I | rook-ceph-mon2: 2017-07-11 14:36:57.143701 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2600280781' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:36:57.640949 I | rook-ceph-mon2: 2017-07-11 14:36:57.640919 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:36:57.641139 I | rook-ceph-mon2: 2017-07-11 14:36:57.641122 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3164494912' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:36:58.121714 I | rook-ceph-mon2: 2017-07-11 14:36:58.121461 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4921 MB, avail 94266 MB
- 2017-07-11 14:37:01.632871 I | rook-ceph-mon2: 2017-07-11 14:37:01.632835 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:01.641511 I | rook-ceph-mon2: 2017-07-11 14:37:01.633070 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/67470550' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:02.099869 I | rook-ceph-mon2: 2017-07-11 14:37:02.099834 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:02.105877 I | rook-ceph-mon2: 2017-07-11 14:37:02.105857 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1593377471' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:04.250436 I | rook-ceph-mon2: 2017-07-11 14:37:04.250398 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:37:04.250702 I | rook-ceph-mon2: 2017-07-11 14:37:04.250686 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1744085878' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:37:06.972706 I | rook-ceph-mon2: 2017-07-11 14:37:06.972671 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:06.972942 I | rook-ceph-mon2: 2017-07-11 14:37:06.972901 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/706885327' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:07.374698 I | rook-ceph-mon2: 2017-07-11 14:37:07.374661 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:07.374838 I | rook-ceph-mon2: 2017-07-11 14:37:07.374821 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2492044712' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:08.313750 I | rook-ceph-mon2: 2017-07-11 14:37:08.313703 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:08.313923 I | rook-ceph-mon2: 2017-07-11 14:37:08.313850 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/8308688' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:11.474877 I | rook-ceph-mon2: 2017-07-11 14:37:11.474844 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:11.475063 I | rook-ceph-mon2: 2017-07-11 14:37:11.474982 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2056230095' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:12.169592 I | rook-ceph-mon2: 2017-07-11 14:37:12.169471 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #86. Immutable memtables: 0.
- 2017-07-11 14:37:12.169773 I | rook-ceph-mon2:
- 2017-07-11 14:37:12.169794 I | rook-ceph-mon2: 2017-07-11 14:37:12.169522 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 54] Syncing log #83
- 2017-07-11 14:37:12.197800 I | rook-ceph-mon2: 2017-07-11 14:37:12.188236 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.169516) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:37:12.197855 I | rook-ceph-mon2: 2017-07-11 14:37:12.188245 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 54] Flushing memtable with next log file: 86
- 2017-07-11 14:37:12.197872 I | rook-ceph-mon2:
- 2017-07-11 14:37:12.197886 I | rook-ceph-mon2: 2017-07-11 14:37:12.188254 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832188250, "job": 54, "event": "flush_started", "num_memtables": 1, "num_entries": 2307, "num_deletes": 251, "memory_usage": 7603912}
- 2017-07-11 14:37:12.197918 I | rook-ceph-mon2: 2017-07-11 14:37:12.188256 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 54] Level-0 flush table #87: started
- 2017-07-11 14:37:12.315990 I | rook-ceph-mon2: 2017-07-11 14:37:12.315766 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:12.316062 I | rook-ceph-mon2: 2017-07-11 14:37:12.315789 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/749359014' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:12.323796 I | rook-ceph-mon2: 2017-07-11 14:37:12.323763 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832323751, "cf_name": "default", "job": 54, "event": "table_file_creation", "file_number": 87, "file_size": 5023914, "table_properties": {"data_size": 5006413, "index_size": 16681, "filter_size": 0, "raw_key_size": 17071, "raw_average_key_size": 18, "raw_value_size": 4982269, "raw_average_value_size": 5481, "num_data_blocks": 522, "num_entries": 909, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:37:12.323874 I | rook-ceph-mon2: 2017-07-11 14:37:12.323856 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 54] Level-0 flush table #87: 5023914 bytes OK
- 2017-07-11 14:37:12.385563 I | rook-ceph-mon2: 2017-07-11 14:37:12.385519 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.342775) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #87 started
- 2017-07-11 14:37:12.394448 I | rook-ceph-mon2: 2017-07-11 14:37:12.394388 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.385464) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #87: memtable #1 done
- 2017-07-11 14:37:12.394564 I | rook-ceph-mon2: 2017-07-11 14:37:12.394545 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.385488) EVENT_LOG_v1 {"time_micros": 1499783832385481, "job": 54, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:37:12.394619 I | rook-ceph-mon2: 2017-07-11 14:37:12.394586 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.385506) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:37:12.394635 I | rook-ceph-mon2:
- 2017-07-11 14:37:12.394672 I | rook-ceph-mon2: 2017-07-11 14:37:12.394658 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 54] Try to delete WAL files size 7552372, prev total WAL file size 7552372, number of live WAL files 2.
- 2017-07-11 14:37:12.394704 I | rook-ceph-mon2:
- 2017-07-11 14:37:12.405681 I | rook-ceph-mon2: 2017-07-11 14:37:12.396272 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:37:12.405786 I | rook-ceph-mon2: 2017-07-11 14:37:12.396355 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.396349) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:37:12.405806 I | rook-ceph-mon2:
- 2017-07-11 14:37:12.405848 I | rook-ceph-mon2: 2017-07-11 14:37:12.396363 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 55] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:37:12.405862 I | rook-ceph-mon2: 2017-07-11 14:37:12.396371 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 54 Base level 0, inputs: [87(4906KB)], [85(13MB)]
- 2017-07-11 14:37:12.405874 I | rook-ceph-mon2:
- 2017-07-11 14:37:12.405885 I | rook-ceph-mon2: 2017-07-11 14:37:12.396388 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832396376, "job": 55, "event": "compaction_started", "files_L0": [87], "files_L1": [85], "score": -1, "input_data_size": 18755127}
- 2017-07-11 14:37:12.685738 I | rook-ceph-mon2: 2017-07-11 14:37:12.685026 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 55] Generated table #88: 2424 keys, 16201406 bytes
- 2017-07-11 14:37:12.685833 I | rook-ceph-mon2: 2017-07-11 14:37:12.685073 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832685054, "cf_name": "default", "job": 55, "event": "table_file_creation", "file_number": 88, "file_size": 16201406, "table_properties": {"data_size": 16147471, "index_size": 53116, "filter_size": 0, "raw_key_size": 46382, "raw_average_key_size": 19, "raw_value_size": 16076483, "raw_average_value_size": 6632, "num_data_blocks": 1622, "num_entries": 2424, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:37:12.743100 I | rook-ceph-mon2: 2017-07-11 14:37:12.742991 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 55] Compacted 1@0 + 1@1 files to L1 => 16201406 bytes
- 2017-07-11 14:37:12.821587 I | rook-ceph-mon2: 2017-07-11 14:37:12.821559 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:37:12.821802 I | rook-ceph-mon2: 2017-07-11 14:37:12.821699 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/20687882' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:37:12.863550 I | rook-ceph-mon2: 2017-07-11 14:37:12.847433 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.847352) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 54.1 rd, 46.7 wr, level 1, files in(1, 1) out(1) MB in(4.8, 13.1) out(15.5), read-write-amplify(7.0) write-amplify(3.2) OK, records in: 2933, records dropped: 509
- 2017-07-11 14:37:12.863615 I | rook-ceph-mon2:
- 2017-07-11 14:37:12.863634 I | rook-ceph-mon2: 2017-07-11 14:37:12.847440 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:37:12.847372) EVENT_LOG_v1 {"time_micros": 1499783832847364, "job": 55, "event": "compaction_finished", "compaction_time_micros": 346581, "output_level": 1, "num_output_files": 1, "total_output_size": 16201406, "num_input_records": 2933, "num_output_records": 2424, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:37:12.864103 I | rook-ceph-mon2: 2017-07-11 14:37:12.864087 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832864084, "job": 55, "event": "table_file_deletion", "file_number": 87}
- 2017-07-11 14:37:12.865741 I | rook-ceph-mon2: 2017-07-11 14:37:12.865727 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783832865725, "job": 55, "event": "table_file_deletion", "file_number": 85}
- 2017-07-11 14:37:14.160262 I | rook-ceph-mon2: 2017-07-11 14:37:14.160217 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:37:14.160501 I | rook-ceph-mon2: 2017-07-11 14:37:14.160461 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3396705151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:37:15.090113 I | rook-ceph-mon2: 2017-07-11 14:37:15.090077 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:15.090339 I | rook-ceph-mon2: 2017-07-11 14:37:15.090307 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/920390593' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:16.410916 I | rook-ceph-mon2: 2017-07-11 14:37:16.410878 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:16.411155 I | rook-ceph-mon2: 2017-07-11 14:37:16.411042 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2260708729' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:16.862820 I | rook-ceph-mon2: 2017-07-11 14:37:16.862774 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:16.863072 I | rook-ceph-mon2: 2017-07-11 14:37:16.862924 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3070644598' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:17.412084 I | rook-ceph-mon2: 2017-07-11 14:37:17.412053 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:37:17.412260 I | rook-ceph-mon2: 2017-07-11 14:37:17.412179 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1074834258' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:37:19.625151 I | rook-ceph-mon2: 2017-07-11 14:37:19.625116 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:19.625387 I | rook-ceph-mon2: 2017-07-11 14:37:19.625253 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1836820905' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:21.320485 I | rook-ceph-mon2: 2017-07-11 14:37:21.320442 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:21.326576 I | rook-ceph-mon2: 2017-07-11 14:37:21.326554 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1337849818' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:22.179290 I | rook-ceph-mon2: 2017-07-11 14:37:22.179236 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:37:22.179399 I | rook-ceph-mon2: 2017-07-11 14:37:22.179383 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/804819746' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:37:22.599357 I | rook-ceph-mon2: 2017-07-11 14:37:22.599321 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:22.599493 I | rook-ceph-mon2: 2017-07-11 14:37:22.599478 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1177456707' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:23.453997 I | rook-ceph-mon2: 2017-07-11 14:37:23.453961 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:37:23.454216 I | rook-ceph-mon2: 2017-07-11 14:37:23.454181 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1414841996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:37:24.364893 I | rook-ceph-mon2: 2017-07-11 14:37:24.364858 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:24.365149 I | rook-ceph-mon2: 2017-07-11 14:37:24.365130 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/911243008' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:26.282677 I | rook-ceph-mon2: 2017-07-11 14:37:26.282640 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:26.288624 I | rook-ceph-mon2: 2017-07-11 14:37:26.288592 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2106824402' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:27.166730 I | rook-ceph-mon2: 2017-07-11 14:37:27.166685 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:37:27.166926 I | rook-ceph-mon2: 2017-07-11 14:37:27.166838 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1865634442' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:37:27.591095 I | rook-ceph-mon2: 2017-07-11 14:37:27.591057 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:37:27.591264 I | rook-ceph-mon2: 2017-07-11 14:37:27.591189 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3290765139' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:37:27.779848 I | rook-ceph-mon2: 2017-07-11 14:37:27.779619 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:27.779939 I | rook-ceph-mon2: 2017-07-11 14:37:27.779638 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/632983630' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:28.766168 I | rook-ceph-mon2: 2017-07-11 14:37:28.766131 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:37:28.766410 I | rook-ceph-mon2: 2017-07-11 14:37:28.766361 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3805294710' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:37:29.700961 I | rook-ceph-mon2: 2017-07-11 14:37:29.700923 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:29.701175 I | rook-ceph-mon2: 2017-07-11 14:37:29.701071 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/207651076' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:31.177187 I | rook-ceph-mon2: 2017-07-11 14:37:31.177152 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:31.177435 I | rook-ceph-mon2: 2017-07-11 14:37:31.177418 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3634784658' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:31.590430 I | rook-ceph-mon2: 2017-07-11 14:37:31.590381 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:31.590743 I | rook-ceph-mon2: 2017-07-11 14:37:31.590717 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2055662592' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:32.030428 I | rook-ceph-mon2: 2017-07-11 14:37:32.030391 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:37:32.030627 I | rook-ceph-mon2: 2017-07-11 14:37:32.030529 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/674281197' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:37:33.413660 I | rook-ceph-mon2: 2017-07-11 14:37:33.413625 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:37:33.413894 I | rook-ceph-mon2: 2017-07-11 14:37:33.413789 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2078498851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:37:34.433034 I | rook-ceph-mon2: 2017-07-11 14:37:34.433000 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:34.433246 I | rook-ceph-mon2: 2017-07-11 14:37:34.433140 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/861080040' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:36.503601 I | rook-ceph-mon2: 2017-07-11 14:37:36.503569 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:36.503797 I | rook-ceph-mon2: 2017-07-11 14:37:36.503695 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2741941800' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:36.942213 I | rook-ceph-mon2: 2017-07-11 14:37:36.942178 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:37:36.942429 I | rook-ceph-mon2: 2017-07-11 14:37:36.942348 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3058988017' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:37:37.414912 I | rook-ceph-mon2: 2017-07-11 14:37:37.414877 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:37.415019 I | rook-ceph-mon2: 2017-07-11 14:37:37.415003 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2407455939' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:41.486258 I | rook-ceph-mon2: 2017-07-11 14:37:41.486223 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:41.486494 I | rook-ceph-mon2: 2017-07-11 14:37:41.486374 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/220381838' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:42.375957 I | rook-ceph-mon2: 2017-07-11 14:37:42.375923 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:42.376196 I | rook-ceph-mon2: 2017-07-11 14:37:42.376076 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3367957692' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:43.305956 I | rook-ceph-mon2: 2017-07-11 14:37:43.305925 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:37:43.306142 I | rook-ceph-mon2: 2017-07-11 14:37:43.306061 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/848346850' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:37:44.249944 I | rook-ceph-mon2: 2017-07-11 14:37:44.249904 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:44.250136 I | rook-ceph-mon2: 2017-07-11 14:37:44.250045 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1870065317' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:45.941057 I | rook-ceph-mon2: 2017-07-11 14:37:45.941026 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:45.941312 I | rook-ceph-mon2: 2017-07-11 14:37:45.941294 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/233360887' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:46.777921 I | rook-ceph-mon2: 2017-07-11 14:37:46.777885 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:37:46.778135 I | rook-ceph-mon2: 2017-07-11 14:37:46.778098 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2909355217' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:37:48.184287 I | rook-ceph-mon2: 2017-07-11 14:37:48.184252 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:37:48.184521 I | rook-ceph-mon2: 2017-07-11 14:37:48.184467 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2165517580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:37:51.308243 I | rook-ceph-mon2: 2017-07-11 14:37:51.308208 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:51.308456 I | rook-ceph-mon2: 2017-07-11 14:37:51.308352 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/433013120' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:51.750383 I | rook-ceph-mon2: 2017-07-11 14:37:51.750347 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:37:51.750577 I | rook-ceph-mon2: 2017-07-11 14:37:51.750491 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/273511421' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:37:52.284542 I | rook-ceph-mon2: 2017-07-11 14:37:52.284239 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:52.284628 I | rook-ceph-mon2: 2017-07-11 14:37:52.284270 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4177870523' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:54.044310 I | rook-ceph-mon2: 2017-07-11 14:37:54.044271 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:54.044535 I | rook-ceph-mon2: 2017-07-11 14:37:54.044415 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4000791047' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:37:56.249000 I | rook-ceph-mon2: 2017-07-11 14:37:56.248965 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:37:56.249205 I | rook-ceph-mon2: 2017-07-11 14:37:56.249108 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/210615673' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:37:58.126953 I | rook-ceph-mon2: 2017-07-11 14:37:58.126663 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94263 MB
- 2017-07-11 14:37:59.004792 I | rook-ceph-mon2: 2017-07-11 14:37:59.004755 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:37:59.005014 I | rook-ceph-mon2: 2017-07-11 14:37:59.004895 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2438908164' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:01.271360 I | rook-ceph-mon2: 2017-07-11 14:38:01.271313 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:01.271550 I | rook-ceph-mon2: 2017-07-11 14:38:01.271465 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4017950344' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:01.731896 I | rook-ceph-mon2: 2017-07-11 14:38:01.731854 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:38:01.732166 I | rook-ceph-mon2: 2017-07-11 14:38:01.732005 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1352106733' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:38:02.244196 I | rook-ceph-mon2: 2017-07-11 14:38:02.244161 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:02.244374 I | rook-ceph-mon2: 2017-07-11 14:38:02.244297 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/872119615' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:04.197010 I | rook-ceph-mon2: 2017-07-11 14:38:04.196964 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:04.197272 I | rook-ceph-mon2: 2017-07-11 14:38:04.197239 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/894943879' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:05.798652 I | rook-ceph-mon2: 2017-07-11 14:38:05.798617 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:05.798893 I | rook-ceph-mon2: 2017-07-11 14:38:05.798843 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/35294887' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:06.155549 I | rook-ceph-mon2: 2017-07-11 14:38:06.155516 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:06.155727 I | rook-ceph-mon2: 2017-07-11 14:38:06.155650 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1796435856' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:07.017264 I | rook-ceph-mon2: 2017-07-11 14:38:07.017216 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:07.017474 I | rook-ceph-mon2: 2017-07-11 14:38:07.017365 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3027591592' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:08.937173 I | rook-ceph-mon2: 2017-07-11 14:38:08.937115 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:08.937401 I | rook-ceph-mon2: 2017-07-11 14:38:08.937290 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3797738492' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:10.838344 I | rook-ceph-mon2: 2017-07-11 14:38:10.838307 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:10.838573 I | rook-ceph-mon2: 2017-07-11 14:38:10.838530 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2589026100' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:11.184898 I | rook-ceph-mon2: 2017-07-11 14:38:11.184841 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:11.185021 I | rook-ceph-mon2: 2017-07-11 14:38:11.185007 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3746627703' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:11.613696 I | rook-ceph-mon2: 2017-07-11 14:38:11.613660 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:38:11.620040 I | rook-ceph-mon2: 2017-07-11 14:38:11.619381 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/442853871' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:38:13.560781 I | rook-ceph-mon2: 2017-07-11 14:38:13.560668 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #89. Immutable memtables: 0.
- 2017-07-11 14:38:13.560895 I | rook-ceph-mon2:
- 2017-07-11 14:38:13.560932 I | rook-ceph-mon2: 2017-07-11 14:38:13.560719 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 56] Syncing log #86
- 2017-07-11 14:38:13.599139 I | rook-ceph-mon2: 2017-07-11 14:38:13.589207 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:38:13.560714) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:38:13.599219 I | rook-ceph-mon2: 2017-07-11 14:38:13.589218 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 56] Flushing memtable with next log file: 89
- 2017-07-11 14:38:13.599237 I | rook-ceph-mon2:
- 2017-07-11 14:38:13.599250 I | rook-ceph-mon2: 2017-07-11 14:38:13.589228 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783893589223, "job": 56, "event": "flush_started", "num_memtables": 1, "num_entries": 1118, "num_deletes": 506, "memory_usage": 2294304}
- 2017-07-11 14:38:13.599263 I | rook-ceph-mon2: 2017-07-11 14:38:13.589230 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 56] Level-0 flush table #90: started
- 2017-07-11 14:38:13.687155 I | rook-ceph-mon2: 2017-07-11 14:38:13.687110 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783893687100, "cf_name": "default", "job": 56, "event": "table_file_creation", "file_number": 90, "file_size": 1507508, "table_properties": {"data_size": 1501788, "index_size": 4905, "filter_size": 0, "raw_key_size": 13225, "raw_average_key_size": 18, "raw_value_size": 1488887, "raw_average_value_size": 2108, "num_data_blocks": 157, "num_entries": 706, "filter_policy_name": "", "kDeletedKeys": "506", "kMergeOperands": "0"}}
- 2017-07-11 14:38:13.687285 I | rook-ceph-mon2: 2017-07-11 14:38:13.687267 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 56] Level-0 flush table #90: 1507508 bytes OK
- 2017-07-11 14:38:13.775748 I | rook-ceph-mon2: 2017-07-11 14:38:13.775680 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:38:13.756568) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #90 started
- 2017-07-11 14:38:13.775795 I | rook-ceph-mon2: 2017-07-11 14:38:13.775775 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:38:13.775634) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #90: memtable #1 done
- 2017-07-11 14:38:13.775818 I | rook-ceph-mon2: 2017-07-11 14:38:13.775803 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:38:13.775653) EVENT_LOG_v1 {"time_micros": 1499783893775647, "job": 56, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:38:13.775836 I | rook-ceph-mon2: 2017-07-11 14:38:13.775824 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:38:13.775668) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:38:13.775840 I | rook-ceph-mon2:
- 2017-07-11 14:38:13.775869 I | rook-ceph-mon2: 2017-07-11 14:38:13.775857 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 56] Try to delete WAL files size 2269283, prev total WAL file size 2269283, number of live WAL files 2.
- 2017-07-11 14:38:13.775873 I | rook-ceph-mon2:
- 2017-07-11 14:38:13.795999 I | rook-ceph-mon2: 2017-07-11 14:38:13.776316 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:38:13.796037 I | rook-ceph-mon2: 2017-07-11 14:38:13.776345 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:38:13.776339) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:38:13.796051 I | rook-ceph-mon2:
- 2017-07-11 14:38:13.796165 I | rook-ceph-mon2: 2017-07-11 14:38:13.776349 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 57] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:38:13.796185 I | rook-ceph-mon2: 2017-07-11 14:38:13.776353 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 56 Base level 0, inputs: [90(1472KB)], [88(15MB)]
- 2017-07-11 14:38:13.796198 I | rook-ceph-mon2:
- 2017-07-11 14:38:13.796210 I | rook-ceph-mon2: 2017-07-11 14:38:13.776363 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783893776355, "job": 57, "event": "compaction_started", "files_L0": [90], "files_L1": [88], "score": -1, "input_data_size": 17708914}
- 2017-07-11 14:38:13.944024 I | rook-ceph-mon2: 2017-07-11 14:38:13.943962 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 57] Generated table #91: 2111 keys, 14597563 bytes
- 2017-07-11 14:38:13.950275 I | rook-ceph-mon2: 2017-07-11 14:38:13.950251 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783893950241, "cf_name": "default", "job": 57, "event": "table_file_creation", "file_number": 91, "file_size": 14597563, "table_properties": {"data_size": 14548301, "index_size": 48443, "filter_size": 0, "raw_key_size": 40673, "raw_average_key_size": 19, "raw_value_size": 14484876, "raw_average_value_size": 6861, "num_data_blocks": 1485, "num_entries": 2111, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:38:13.990141 I | rook-ceph-mon2: 2017-07-11 14:38:13.990114 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 57] Compacted 1@0 + 1@1 files to L1 => 14597563 bytes
- 2017-07-11 14:38:14.021699 I | rook-ceph-mon2: 2017-07-11 14:38:14.020990 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:38:14.020781) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 82.9 rd, 68.3 wr, level 1, files in(1, 1) out(1) MB in(1.4, 15.5) out(13.9), read-write-amplify(21.4) write-amplify(9.7) OK, records in: 3130, records dropped: 1019
- 2017-07-11 14:38:14.021750 I | rook-ceph-mon2:
- 2017-07-11 14:38:14.021784 I | rook-ceph-mon2: 2017-07-11 14:38:14.021767 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:38:14.020804) EVENT_LOG_v1 {"time_micros": 1499783894020795, "job": 57, "event": "compaction_finished", "compaction_time_micros": 213738, "output_level": 1, "num_output_files": 1, "total_output_size": 14597563, "num_input_records": 3130, "num_output_records": 2111, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:38:14.022193 I | rook-ceph-mon2: 2017-07-11 14:38:14.022176 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783894022173, "job": 57, "event": "table_file_deletion", "file_number": 90}
- 2017-07-11 14:38:14.032380 I | rook-ceph-mon2: 2017-07-11 14:38:14.032363 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499783894032361, "job": 57, "event": "table_file_deletion", "file_number": 88}
- 2017-07-11 14:38:14.032453 I | rook-ceph-mon2: 2017-07-11 14:38:14.032438 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:38:14.716047 I | rook-ceph-mon2: 2017-07-11 14:38:14.716011 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:38:14.716300 I | rook-ceph-mon2: 2017-07-11 14:38:14.716256 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4273435741' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:38:15.611830 I | rook-ceph-mon2: 2017-07-11 14:38:15.611529 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:15.612176 I | rook-ceph-mon2: 2017-07-11 14:38:15.611551 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/900757015' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:16.105834 I | rook-ceph-mon2: 2017-07-11 14:38:16.105802 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:16.106084 I | rook-ceph-mon2: 2017-07-11 14:38:16.106067 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1499994340' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:16.534194 I | rook-ceph-mon2: 2017-07-11 14:38:16.534160 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:38:16.534378 I | rook-ceph-mon2: 2017-07-11 14:38:16.534303 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3297104699' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:38:16.961237 I | rook-ceph-mon2: 2017-07-11 14:38:16.961203 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:16.961424 I | rook-ceph-mon2: 2017-07-11 14:38:16.961343 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2673161222' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:18.841055 I | rook-ceph-mon2: 2017-07-11 14:38:18.841020 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:18.841238 I | rook-ceph-mon2: 2017-07-11 14:38:18.841157 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2282854558' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:20.518219 I | rook-ceph-mon2: 2017-07-11 14:38:20.518173 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:20.518465 I | rook-ceph-mon2: 2017-07-11 14:38:20.518333 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2089433566' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:21.017111 I | rook-ceph-mon2: 2017-07-11 14:38:21.017076 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:21.017300 I | rook-ceph-mon2: 2017-07-11 14:38:21.017217 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2313319848' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:21.528877 I | rook-ceph-mon2: 2017-07-11 14:38:21.528829 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:38:21.529066 I | rook-ceph-mon2: 2017-07-11 14:38:21.528987 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3841072933' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:38:23.817321 I | rook-ceph-mon2: 2017-07-11 14:38:23.817285 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:23.817561 I | rook-ceph-mon2: 2017-07-11 14:38:23.817511 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2301201645' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:25.566072 I | rook-ceph-mon2: 2017-07-11 14:38:25.566039 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:25.566302 I | rook-ceph-mon2: 2017-07-11 14:38:25.566178 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1036820443' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:25.812705 I | rook-ceph-mon2: 2017-07-11 14:38:25.812545 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:38:25.812795 I | rook-ceph-mon2: 2017-07-11 14:38:25.812566 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4100101554' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:38:26.452996 I | rook-ceph-mon2: 2017-07-11 14:38:26.452961 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:38:26.453184 I | rook-ceph-mon2: 2017-07-11 14:38:26.453101 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/61887727' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:38:26.871453 I | rook-ceph-mon2: 2017-07-11 14:38:26.871417 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:26.871674 I | rook-ceph-mon2: 2017-07-11 14:38:26.871640 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2612211546' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:27.713387 I | rook-ceph-mon2: 2017-07-11 14:38:27.713353 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:38:27.713569 I | rook-ceph-mon2: 2017-07-11 14:38:27.713491 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2723316065' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:38:31.771396 I | rook-ceph-mon2: 2017-07-11 14:38:31.771362 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:31.771578 I | rook-ceph-mon2: 2017-07-11 14:38:31.771493 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/39807055' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:32.668913 I | rook-ceph-mon2: 2017-07-11 14:38:32.668866 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:38:32.669137 I | rook-ceph-mon2: 2017-07-11 14:38:32.669023 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/7363083' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:38:33.669081 I | rook-ceph-mon2: 2017-07-11 14:38:33.669047 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:33.669197 I | rook-ceph-mon2: 2017-07-11 14:38:33.669181 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1891849974' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:37.519352 I | rook-ceph-mon2: 2017-07-11 14:38:37.519316 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:38:37.519605 I | rook-ceph-mon2: 2017-07-11 14:38:37.519572 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3302359744' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:38:38.439098 I | rook-ceph-mon2: 2017-07-11 14:38:38.439036 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:38.439336 I | rook-ceph-mon2: 2017-07-11 14:38:38.439318 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1583852329' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:41.516852 I | rook-ceph-mon2: 2017-07-11 14:38:41.516801 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:41.517068 I | rook-ceph-mon2: 2017-07-11 14:38:41.516960 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2889236418' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:43.281513 I | rook-ceph-mon2: 2017-07-11 14:38:43.281469 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:43.281698 I | rook-ceph-mon2: 2017-07-11 14:38:43.281618 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1979830114' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:45.297709 I | rook-ceph-mon2: 2017-07-11 14:38:45.297673 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:45.297945 I | rook-ceph-mon2: 2017-07-11 14:38:45.297928 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2858349088' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:46.630194 I | rook-ceph-mon2: 2017-07-11 14:38:46.629946 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:46.630265 I | rook-ceph-mon2: 2017-07-11 14:38:46.629966 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3360443717' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:47.499586 I | rook-ceph-mon2: 2017-07-11 14:38:47.499552 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:38:47.499772 I | rook-ceph-mon2: 2017-07-11 14:38:47.499692 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2337867685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:38:53.081134 I | rook-ceph-mon2: 2017-07-11 14:38:53.080883 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:53.081244 I | rook-ceph-mon2: 2017-07-11 14:38:53.080905 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1678265699' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:55.202183 I | rook-ceph-mon2: 2017-07-11 14:38:55.202020 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:55.202272 I | rook-ceph-mon2: 2017-07-11 14:38:55.202054 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1248384980' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:55.601999 I | rook-ceph-mon2: 2017-07-11 14:38:55.601964 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:38:55.602221 I | rook-ceph-mon2: 2017-07-11 14:38:55.602102 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/234162006' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:38:56.016353 I | rook-ceph-mon2: 2017-07-11 14:38:56.016319 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:38:56.016572 I | rook-ceph-mon2: 2017-07-11 14:38:56.016541 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/137612151' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:38:57.372647 I | rook-ceph-mon2: 2017-07-11 14:38:57.372376 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:38:57.372734 I | rook-ceph-mon2: 2017-07-11 14:38:57.372403 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1924872321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:38:58.144844 I | rook-ceph-mon2: 2017-07-11 14:38:58.144619 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4922 MB, avail 94265 MB
- 2017-07-11 14:38:58.357257 I | rook-ceph-mon2: 2017-07-11 14:38:58.357224 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:58.357433 I | rook-ceph-mon2: 2017-07-11 14:38:58.357355 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/651229031' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:38:59.205569 I | rook-ceph-mon2: 2017-07-11 14:38:59.205530 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:38:59.205781 I | rook-ceph-mon2: 2017-07-11 14:38:59.205680 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2974767612' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:38:59.993841 I | rook-ceph-mon2: 2017-07-11 14:38:59.993805 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:38:59.994086 I | rook-ceph-mon2: 2017-07-11 14:38:59.994044 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1707805344' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:01.314384 I | rook-ceph-mon2: 2017-07-11 14:39:01.314346 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:01.314628 I | rook-ceph-mon2: 2017-07-11 14:39:01.314609 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/17920159' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:02.288048 I | rook-ceph-mon2: 2017-07-11 14:39:02.287943 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:39:02.288127 I | rook-ceph-mon2: 2017-07-11 14:39:02.287969 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3186582026' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:39:05.186914 I | rook-ceph-mon2: 2017-07-11 14:39:05.186882 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:05.186990 I | rook-ceph-mon2: 2017-07-11 14:39:05.186969 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1106842300' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:06.031767 I | rook-ceph-mon2: 2017-07-11 14:39:06.031720 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:39:06.031933 I | rook-ceph-mon2: 2017-07-11 14:39:06.031903 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/203650956' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:39:06.951014 I | rook-ceph-mon2: 2017-07-11 14:39:06.950979 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:06.951248 I | rook-ceph-mon2: 2017-07-11 14:39:06.951231 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3917211123' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:07.817340 I | rook-ceph-mon2: 2017-07-11 14:39:07.817292 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:39:07.817569 I | rook-ceph-mon2: 2017-07-11 14:39:07.817534 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/291449845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:39:08.744964 I | rook-ceph-mon2: 2017-07-11 14:39:08.744932 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:08.745183 I | rook-ceph-mon2: 2017-07-11 14:39:08.745068 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2778709084' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:11.213396 I | rook-ceph-mon2: 2017-07-11 14:39:11.213364 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:11.213472 I | rook-ceph-mon2: 2017-07-11 14:39:11.213445 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/704522634' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:12.124032 I | rook-ceph-mon2: 2017-07-11 14:39:12.123998 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:39:12.124199 I | rook-ceph-mon2: 2017-07-11 14:39:12.124127 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1932807616' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:39:14.797221 I | rook-ceph-mon2: 2017-07-11 14:39:14.797187 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:14.797439 I | rook-ceph-mon2: 2017-07-11 14:39:14.797354 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3412440784' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:15.371719 I | rook-ceph-mon2: 2017-07-11 14:39:15.371685 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:15.371916 I | rook-ceph-mon2: 2017-07-11 14:39:15.371837 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2695938030' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:15.792725 I | rook-ceph-mon2: 2017-07-11 14:39:15.792680 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:39:15.792897 I | rook-ceph-mon2: 2017-07-11 14:39:15.792819 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/757050510' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:39:18.485265 I | rook-ceph-mon2: 2017-07-11 14:39:18.485234 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:39:18.485511 I | rook-ceph-mon2: 2017-07-11 14:39:18.485458 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4013809059' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:39:20.639812 I | rook-ceph-mon2: 2017-07-11 14:39:20.639779 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:39:20.639999 I | rook-ceph-mon2: 2017-07-11 14:39:20.639913 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4175580302' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:39:21.127590 I | rook-ceph-mon2: 2017-07-11 14:39:21.127556 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:21.127858 I | rook-ceph-mon2: 2017-07-11 14:39:21.127813 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1410254182' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:22.022011 I | rook-ceph-mon2: 2017-07-11 14:39:22.021975 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:39:22.022238 I | rook-ceph-mon2: 2017-07-11 14:39:22.022220 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2188462505' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:39:23.186498 I | rook-ceph-mon2: 2017-07-11 14:39:23.186464 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:23.186679 I | rook-ceph-mon2: 2017-07-11 14:39:23.186601 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1648201585' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:24.698198 I | rook-ceph-mon2: 2017-07-11 14:39:24.698162 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:24.698490 I | rook-ceph-mon2: 2017-07-11 14:39:24.698472 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1341151810' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:25.853064 I | rook-ceph-mon2: 2017-07-11 14:39:25.853029 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:39:25.853245 I | rook-ceph-mon2: 2017-07-11 14:39:25.853165 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3745544362' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:39:26.244348 I | rook-ceph-mon2: 2017-07-11 14:39:26.244314 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:26.244540 I | rook-ceph-mon2: 2017-07-11 14:39:26.244454 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1870940706' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:27.124136 I | rook-ceph-mon2: 2017-07-11 14:39:27.124102 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:39:27.124390 I | rook-ceph-mon2: 2017-07-11 14:39:27.124372 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2395304244' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:39:27.964885 I | rook-ceph-mon2: 2017-07-11 14:39:27.964851 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:27.964990 I | rook-ceph-mon2: 2017-07-11 14:39:27.964975 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1369616759' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:30.002633 I | rook-ceph-mon2: 2017-07-11 14:39:30.002599 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:30.002742 I | rook-ceph-mon2: 2017-07-11 14:39:30.002728 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/149629825' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:30.444333 I | rook-ceph-mon2: 2017-07-11 14:39:30.444300 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:39:30.444516 I | rook-ceph-mon2: 2017-07-11 14:39:30.444426 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2435178700' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:39:30.908863 I | rook-ceph-mon2: 2017-07-11 14:39:30.908825 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:30.908968 I | rook-ceph-mon2: 2017-07-11 14:39:30.908953 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1778838712' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:31.785356 I | rook-ceph-mon2: 2017-07-11 14:39:31.785323 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:39:31.785543 I | rook-ceph-mon2: 2017-07-11 14:39:31.785460 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/153714513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:39:34.518560 I | rook-ceph-mon2: 2017-07-11 14:39:34.518527 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:34.518799 I | rook-ceph-mon2: 2017-07-11 14:39:34.518720 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/681459403' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:34.985627 I | rook-ceph-mon2: 2017-07-11 14:39:34.985593 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:34.985808 I | rook-ceph-mon2: 2017-07-11 14:39:34.985729 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2389622646' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:35.976865 I | rook-ceph-mon2: 2017-07-11 14:39:35.976829 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:35.977109 I | rook-ceph-mon2: 2017-07-11 14:39:35.976978 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/171149834' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:36.301571 I | rook-ceph-mon2: 2017-07-11 14:39:35.602815 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1379 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0541632s > max 0.05s
- 2017-07-11 14:39:36.301649 I | rook-ceph-mon2: 2017-07-11 14:39:35.606906 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1380 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.155999s > max 0.05s
- 2017-07-11 14:39:36.796657 I | rook-ceph-mon2: 2017-07-11 14:39:36.796623 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:39:36.797576 I | rook-ceph-mon2: 2017-07-11 14:39:36.797557 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3745921396' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:39:37.958865 I | rook-ceph-mon2: 2017-07-11 14:39:37.958830 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:37.959081 I | rook-ceph-mon2: 2017-07-11 14:39:37.958977 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/125338218' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:40.745447 I | rook-ceph-mon2: 2017-07-11 14:39:40.745413 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:40.745682 I | rook-ceph-mon2: 2017-07-11 14:39:40.745636 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1600240839' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:42.463562 I | rook-ceph-mon2: 2017-07-11 14:39:42.463503 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:42.463762 I | rook-ceph-mon2: 2017-07-11 14:39:42.463689 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1075893319' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:44.418890 I | rook-ceph-mon2: 2017-07-11 14:39:44.418839 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:44.419135 I | rook-ceph-mon2: 2017-07-11 14:39:44.419112 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3314524142' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:44.865878 I | rook-ceph-mon2: 2017-07-11 14:39:44.865844 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:44.866055 I | rook-ceph-mon2: 2017-07-11 14:39:44.865983 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2560080178' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:45.904617 I | rook-ceph-mon2: 2017-07-11 14:39:45.904581 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:45.904811 I | rook-ceph-mon2: 2017-07-11 14:39:45.904726 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3340530160' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:46.716773 I | rook-ceph-mon2: 2017-07-11 14:39:46.716739 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:39:46.716843 I | rook-ceph-mon2: 2017-07-11 14:39:46.716828 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1670619429' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:39:47.709594 I | rook-ceph-mon2: 2017-07-11 14:39:47.709561 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:47.709781 I | rook-ceph-mon2: 2017-07-11 14:39:47.709765 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4060124466' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:49.343482 I | rook-ceph-mon2: 2017-07-11 14:39:49.343443 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:49.343667 I | rook-ceph-mon2: 2017-07-11 14:39:49.343584 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3820935734' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:49.739548 I | rook-ceph-mon2: 2017-07-11 14:39:49.739513 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:49.739745 I | rook-ceph-mon2: 2017-07-11 14:39:49.739650 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/270986572' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:52.303244 I | rook-ceph-mon2: 2017-07-11 14:39:52.303078 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:52.303354 I | rook-ceph-mon2: 2017-07-11 14:39:52.303101 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1199082619' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:54.410017 I | rook-ceph-mon2: 2017-07-11 14:39:54.409961 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:54.410232 I | rook-ceph-mon2: 2017-07-11 14:39:54.410204 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/296072972' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:54.863520 I | rook-ceph-mon2: 2017-07-11 14:39:54.863484 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:39:54.863707 I | rook-ceph-mon2: 2017-07-11 14:39:54.863630 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2996737867' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:39:55.546550 I | rook-ceph-mon2: 2017-07-11 14:39:55.546515 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:39:55.546738 I | rook-ceph-mon2: 2017-07-11 14:39:55.546650 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1015886961' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:39:57.823453 I | rook-ceph-mon2: 2017-07-11 14:39:57.823418 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:57.823682 I | rook-ceph-mon2: 2017-07-11 14:39:57.823644 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2492114312' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:39:58.145166 I | rook-ceph-mon2: 2017-07-11 14:39:58.144876 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4922 MB, avail 94264 MB
- 2017-07-11 14:39:59.212503 I | rook-ceph-mon2: 2017-07-11 14:39:59.212371 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:39:59.212618 I | rook-ceph-mon2: 2017-07-11 14:39:59.212391 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2066222191' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:00.140669 I | rook-ceph-mon2: 2017-07-11 14:40:00.140627 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:40:00.140799 I | rook-ceph-mon2: 2017-07-11 14:40:00.140784 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/869925945' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:40:01.464787 I | rook-ceph-mon2: 2017-07-11 14:40:01.464756 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:40:01.464954 I | rook-ceph-mon2: 2017-07-11 14:40:01.464880 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1008399681' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:40:02.667520 I | rook-ceph-mon2: 2017-07-11 14:40:02.667487 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:40:02.667731 I | rook-ceph-mon2: 2017-07-11 14:40:02.667655 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1312646830' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:40:04.232566 I | rook-ceph-mon2: 2017-07-11 14:40:04.232531 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:04.232810 I | rook-ceph-mon2: 2017-07-11 14:40:04.232675 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3184864100' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:04.657022 I | rook-ceph-mon2: 2017-07-11 14:40:04.656960 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:04.657212 I | rook-ceph-mon2: 2017-07-11 14:40:04.657121 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1486117555' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:05.120816 I | rook-ceph-mon2: 2017-07-11 14:40:05.120780 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:40:05.121062 I | rook-ceph-mon2: 2017-07-11 14:40:05.121046 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/962504116' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:40:06.478706 I | rook-ceph-mon2: 2017-07-11 14:40:05.332750 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1397 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:40:06.499091 I | rook-ceph-mon2: 2017-07-11 14:40:06.499071 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:40:06.499185 I | rook-ceph-mon2: 2017-07-11 14:40:06.499159 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2622000150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:40:07.352995 I | rook-ceph-mon2: 2017-07-11 14:40:07.352960 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:07.353122 I | rook-ceph-mon2: 2017-07-11 14:40:07.353106 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3470045849' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:09.555435 I | rook-ceph-mon2: 2017-07-11 14:40:09.555394 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:09.555621 I | rook-ceph-mon2: 2017-07-11 14:40:09.555538 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3375365657' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:10.003696 I | rook-ceph-mon2: 2017-07-11 14:40:10.003663 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:40:10.003933 I | rook-ceph-mon2: 2017-07-11 14:40:10.003916 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/67949818' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:40:11.245804 I | rook-ceph-mon2: 2017-07-11 14:40:11.245681 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:40:11.251707 I | rook-ceph-mon2: 2017-07-11 14:40:11.245897 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4218756742' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:40:12.420986 I | rook-ceph-mon2: 2017-07-11 14:40:12.420945 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:12.421237 I | rook-ceph-mon2: 2017-07-11 14:40:12.421220 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1300268889' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:14.879430 I | rook-ceph-mon2: 2017-07-11 14:40:14.879395 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:40:14.879616 I | rook-ceph-mon2: 2017-07-11 14:40:14.879528 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/342586919' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:40:16.373005 I | rook-ceph-mon2: 2017-07-11 14:40:16.372969 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:40:16.373241 I | rook-ceph-mon2: 2017-07-11 14:40:16.373139 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/971207363' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:40:17.221734 I | rook-ceph-mon2: 2017-07-11 14:40:17.221690 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:17.221944 I | rook-ceph-mon2: 2017-07-11 14:40:17.221849 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/177474956' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:19.408367 I | rook-ceph-mon2: 2017-07-11 14:40:19.408333 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:19.408475 I | rook-ceph-mon2: 2017-07-11 14:40:19.408462 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2788610755' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:21.171923 I | rook-ceph-mon2: 2017-07-11 14:40:21.171886 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:40:21.172143 I | rook-ceph-mon2: 2017-07-11 14:40:21.172109 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/542870700' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:40:22.164251 I | rook-ceph-mon2: 2017-07-11 14:40:22.164216 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:22.170328 I | rook-ceph-mon2: 2017-07-11 14:40:22.164359 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2412680124' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:23.700857 I | rook-ceph-mon2: 2017-07-11 14:40:23.700732 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #92. Immutable memtables: 0.
- 2017-07-11 14:40:23.700924 I | rook-ceph-mon2:
- 2017-07-11 14:40:23.700945 I | rook-ceph-mon2: 2017-07-11 14:40:23.700776 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 58] Syncing log #89
- 2017-07-11 14:40:23.762344 I | rook-ceph-mon2: 2017-07-11 14:40:23.746714 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:40:23.700771) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:40:23.762401 I | rook-ceph-mon2: 2017-07-11 14:40:23.746722 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 58] Flushing memtable with next log file: 92
- 2017-07-11 14:40:23.762416 I | rook-ceph-mon2:
- 2017-07-11 14:40:23.762429 I | rook-ceph-mon2: 2017-07-11 14:40:23.746731 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784023746727, "job": 58, "event": "flush_started", "num_memtables": 1, "num_entries": 1606, "num_deletes": 254, "memory_usage": 5006560}
- 2017-07-11 14:40:23.762440 I | rook-ceph-mon2: 2017-07-11 14:40:23.746734 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 58] Level-0 flush table #93: started
- 2017-07-11 14:40:23.823848 I | rook-ceph-mon2: 2017-07-11 14:40:23.823797 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784023823786, "cf_name": "default", "job": 58, "event": "table_file_creation", "file_number": 93, "file_size": 2919306, "table_properties": {"data_size": 2909539, "index_size": 8949, "filter_size": 0, "raw_key_size": 12218, "raw_average_key_size": 19, "raw_value_size": 2894607, "raw_average_value_size": 4594, "num_data_blocks": 284, "num_entries": 630, "filter_policy_name": "", "kDeletedKeys": "254", "kMergeOperands": "0"}}
- 2017-07-11 14:40:23.824000 I | rook-ceph-mon2: 2017-07-11 14:40:23.823980 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 58] Level-0 flush table #93: 2919306 bytes OK
- 2017-07-11 14:40:23.880673 I | rook-ceph-mon2: 2017-07-11 14:40:23.880634 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:40:23.860739) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #93 started
- 2017-07-11 14:40:23.882512 I | rook-ceph-mon2: 2017-07-11 14:40:23.882492 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:40:23.880550) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #93: memtable #1 done
- 2017-07-11 14:40:23.882577 I | rook-ceph-mon2: 2017-07-11 14:40:23.882559 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:40:23.880580) EVENT_LOG_v1 {"time_micros": 1499784023880563, "job": 58, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:40:23.882625 I | rook-ceph-mon2: 2017-07-11 14:40:23.882596 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:40:23.880596) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:40:23.882640 I | rook-ceph-mon2:
- 2017-07-11 14:40:23.882671 I | rook-ceph-mon2: 2017-07-11 14:40:23.882658 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 58] Try to delete WAL files size 4973235, prev total WAL file size 4973235, number of live WAL files 2.
- 2017-07-11 14:40:23.882687 I | rook-ceph-mon2:
- 2017-07-11 14:40:23.899963 I | rook-ceph-mon2: 2017-07-11 14:40:23.883673 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:40:23.900020 I | rook-ceph-mon2: 2017-07-11 14:40:23.883713 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:40:23.883708) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:40:23.900042 I | rook-ceph-mon2:
- 2017-07-11 14:40:23.900054 I | rook-ceph-mon2: 2017-07-11 14:40:23.883720 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 59] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:40:23.900079 I | rook-ceph-mon2: 2017-07-11 14:40:23.883725 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 58 Base level 0, inputs: [93(2850KB)], [91(13MB)]
- 2017-07-11 14:40:23.900092 I | rook-ceph-mon2:
- 2017-07-11 14:40:23.900102 I | rook-ceph-mon2: 2017-07-11 14:40:23.883735 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784023883727, "job": 59, "event": "compaction_started", "files_L0": [93], "files_L1": [91], "score": -1, "input_data_size": 17516869}
- 2017-07-11 14:40:24.018370 I | rook-ceph-mon2: 2017-07-11 14:40:24.018229 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:24.018456 I | rook-ceph-mon2: 2017-07-11 14:40:24.018253 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4028106395' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:24.146675 I | rook-ceph-mon2: 2017-07-11 14:40:24.146623 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 59] Generated table #94: 2285 keys, 16229593 bytes
- 2017-07-11 14:40:24.147687 I | rook-ceph-mon2: 2017-07-11 14:40:24.147665 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784024147641, "cf_name": "default", "job": 59, "event": "table_file_creation", "file_number": 94, "file_size": 16229593, "table_properties": {"data_size": 16177615, "index_size": 51159, "filter_size": 0, "raw_key_size": 43724, "raw_average_key_size": 19, "raw_value_size": 16109977, "raw_average_value_size": 7050, "num_data_blocks": 1573, "num_entries": 2285, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:40:24.221484 I | rook-ceph-mon2: 2017-07-11 14:40:24.221429 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 59] Compacted 1@0 + 1@1 files to L1 => 16229593 bytes
- 2017-07-11 14:40:24.249806 I | rook-ceph-mon2: 2017-07-11 14:40:24.249766 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:40:24.249688) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 51.9 rd, 48.1 wr, level 1, files in(1, 1) out(1) MB in(2.8, 13.9) out(15.5), read-write-amplify(11.6) write-amplify(5.6) OK, records in: 2741, records dropped: 456
- 2017-07-11 14:40:24.249880 I | rook-ceph-mon2:
- 2017-07-11 14:40:24.249925 I | rook-ceph-mon2: 2017-07-11 14:40:24.249899 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:40:24.249705) EVENT_LOG_v1 {"time_micros": 1499784024249698, "job": 59, "event": "compaction_finished", "compaction_time_micros": 337665, "output_level": 1, "num_output_files": 1, "total_output_size": 16229593, "num_input_records": 2741, "num_output_records": 2285, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:40:24.250555 I | rook-ceph-mon2: 2017-07-11 14:40:24.250537 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784024250534, "job": 59, "event": "table_file_deletion", "file_number": 93}
- 2017-07-11 14:40:24.255579 I | rook-ceph-mon2: 2017-07-11 14:40:24.255559 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784024255557, "job": 59, "event": "table_file_deletion", "file_number": 91}
- 2017-07-11 14:40:24.255668 I | rook-ceph-mon2: 2017-07-11 14:40:24.255652 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:40:24.445684 I | rook-ceph-mon2: 2017-07-11 14:40:24.445439 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:24.445770 I | rook-ceph-mon2: 2017-07-11 14:40:24.445461 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4161329601' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:24.865261 I | rook-ceph-mon2: 2017-07-11 14:40:24.865227 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:40:24.865503 I | rook-ceph-mon2: 2017-07-11 14:40:24.865459 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3405124352' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:40:27.058039 I | rook-ceph-mon2: 2017-07-11 14:40:27.057977 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:27.058268 I | rook-ceph-mon2: 2017-07-11 14:40:27.058227 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2266661574' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:29.211365 I | rook-ceph-mon2: 2017-07-11 14:40:29.211212 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:29.211454 I | rook-ceph-mon2: 2017-07-11 14:40:29.211244 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1072804679' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:29.680063 I | rook-ceph-mon2: 2017-07-11 14:40:29.680021 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:29.680165 I | rook-ceph-mon2: 2017-07-11 14:40:29.680151 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2153893847' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:30.098554 I | rook-ceph-mon2: 2017-07-11 14:40:30.098494 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:40:30.098743 I | rook-ceph-mon2: 2017-07-11 14:40:30.098655 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/274644548' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:40:30.592020 I | rook-ceph-mon2: 2017-07-11 14:40:30.591986 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:30.592219 I | rook-ceph-mon2: 2017-07-11 14:40:30.592130 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3142873299' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:31.422984 I | rook-ceph-mon2: 2017-07-11 14:40:31.422952 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:40:31.423195 I | rook-ceph-mon2: 2017-07-11 14:40:31.423101 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/33559436' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:40:31.744592 I | rook-ceph-mon2: 2017-07-11 14:40:31.744445 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #95. Immutable memtables: 0.
- 2017-07-11 14:40:31.744687 I | rook-ceph-mon2:
- 2017-07-11 14:40:31.744724 I | rook-ceph-mon2: 2017-07-11 14:40:31.744486 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 60] Syncing log #92
- 2017-07-11 14:40:31.793027 I | rook-ceph-mon2: 2017-07-11 14:40:31.792486 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:40:31.744481) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:40:31.793082 I | rook-ceph-mon2: 2017-07-11 14:40:31.792498 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 60] Flushing memtable with next log file: 95
- 2017-07-11 14:40:31.793097 I | rook-ceph-mon2:
- 2017-07-11 14:40:31.793156 I | rook-ceph-mon2: 2017-07-11 14:40:31.792508 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784031792504, "job": 60, "event": "flush_started", "num_memtables": 1, "num_entries": 339, "num_deletes": 251, "memory_usage": 334376}
- 2017-07-11 14:40:31.793170 I | rook-ceph-mon2: 2017-07-11 14:40:31.792510 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 60] Level-0 flush table #96: started
- 2017-07-11 14:40:31.851864 I | rook-ceph-mon2: 2017-07-11 14:40:31.849798 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784031849788, "cf_name": "default", "job": 60, "event": "table_file_creation", "file_number": 96, "file_size": 215737, "table_properties": {"data_size": 214220, "index_size": 703, "filter_size": 0, "raw_key_size": 5215, "raw_average_key_size": 18, "raw_value_size": 209927, "raw_average_value_size": 736, "num_data_blocks": 23, "num_entries": 285, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:40:31.851932 I | rook-ceph-mon2: 2017-07-11 14:40:31.849810 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 60] Level-0 flush table #96: 215737 bytes OK
- 2017-07-11 14:40:31.916032 I | rook-ceph-mon2: 2017-07-11 14:40:31.914001 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:40:31.878397) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #96 started
- 2017-07-11 14:40:31.916105 I | rook-ceph-mon2: 2017-07-11 14:40:31.914008 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:40:31.913951) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #96: memtable #1 done
- 2017-07-11 14:40:31.916123 I | rook-ceph-mon2: 2017-07-11 14:40:31.914012 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:40:31.913969) EVENT_LOG_v1 {"time_micros": 1499784031913964, "job": 60, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:40:31.916136 I | rook-ceph-mon2: 2017-07-11 14:40:31.914014 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:40:31.913985) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:40:31.916152 I | rook-ceph-mon2:
- 2017-07-11 14:40:31.916179 I | rook-ceph-mon2: 2017-07-11 14:40:31.914019 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 60] Try to delete WAL files size 324931, prev total WAL file size 324931, number of live WAL files 2.
- 2017-07-11 14:40:31.916192 I | rook-ceph-mon2:
- 2017-07-11 14:40:31.933976 I | rook-ceph-mon2: 2017-07-11 14:40:31.916212 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:40:31.934038 I | rook-ceph-mon2: 2017-07-11 14:40:31.916260 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:40:31.916254) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:40:31.934056 I | rook-ceph-mon2:
- 2017-07-11 14:40:31.934068 I | rook-ceph-mon2: 2017-07-11 14:40:31.916266 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 61] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:40:31.934090 I | rook-ceph-mon2: 2017-07-11 14:40:31.916271 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 60 Base level 0, inputs: [96(210KB)], [94(15MB)]
- 2017-07-11 14:40:31.934115 I | rook-ceph-mon2:
- 2017-07-11 14:40:31.934139 I | rook-ceph-mon2: 2017-07-11 14:40:31.916282 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784031916273, "job": 61, "event": "compaction_started", "files_L0": [96], "files_L1": [94], "score": -1, "input_data_size": 16445330}
- 2017-07-11 14:40:32.158081 I | rook-ceph-mon2: 2017-07-11 14:40:32.158028 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 61] Generated table #97: 2061 keys, 13903963 bytes
- 2017-07-11 14:40:32.158191 I | rook-ceph-mon2: 2017-07-11 14:40:32.158173 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784032158162, "cf_name": "default", "job": 61, "event": "table_file_creation", "file_number": 97, "file_size": 13903963, "table_properties": {"data_size": 13859029, "index_size": 44115, "filter_size": 0, "raw_key_size": 39718, "raw_average_key_size": 19, "raw_value_size": 13799310, "raw_average_value_size": 6695, "num_data_blocks": 1344, "num_entries": 2061, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:40:32.187164 I | rook-ceph-mon2: 2017-07-11 14:40:32.186608 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 61] Compacted 1@0 + 1@1 files to L1 => 13903963 bytes
- 2017-07-11 14:40:32.232434 I | rook-ceph-mon2: 2017-07-11 14:40:32.232406 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:40:32.232314) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 60.8 rd, 51.4 wr, level 1, files in(1, 1) out(1) MB in(0.2, 15.5) out(13.3), read-write-amplify(140.7) write-amplify(64.4) OK, records in: 2570, records dropped: 509
- 2017-07-11 14:40:32.233973 I | rook-ceph-mon2:
- 2017-07-11 14:40:32.234089 I | rook-ceph-mon2: 2017-07-11 14:40:32.234025 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:40:32.232363) EVENT_LOG_v1 {"time_micros": 1499784032232338, "job": 61, "event": "compaction_finished", "compaction_time_micros": 270310, "output_level": 1, "num_output_files": 1, "total_output_size": 13903963, "num_input_records": 2570, "num_output_records": 2061, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:40:32.234376 I | rook-ceph-mon2: 2017-07-11 14:40:32.234360 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784032234357, "job": 61, "event": "table_file_deletion", "file_number": 96}
- 2017-07-11 14:40:32.251320 I | rook-ceph-mon2: 2017-07-11 14:40:32.251302 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784032251299, "job": 61, "event": "table_file_deletion", "file_number": 94}
- 2017-07-11 14:40:32.472237 I | rook-ceph-mon2: 2017-07-11 14:40:32.472203 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:32.472357 I | rook-ceph-mon2: 2017-07-11 14:40:32.472342 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2346596463' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:34.540650 I | rook-ceph-mon2: 2017-07-11 14:40:34.540616 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:40:34.540886 I | rook-ceph-mon2: 2017-07-11 14:40:34.540868 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2718832093' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:40:34.992465 I | rook-ceph-mon2: 2017-07-11 14:40:34.992435 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:34.992657 I | rook-ceph-mon2: 2017-07-11 14:40:34.992564 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1080495590' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:36.013604 I | rook-ceph-mon2: 2017-07-11 14:40:36.013568 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:40:36.013891 I | rook-ceph-mon2: 2017-07-11 14:40:36.013873 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/741058995' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:40:38.641846 I | rook-ceph-mon2: 2017-07-11 14:40:38.641811 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:38.642046 I | rook-ceph-mon2: 2017-07-11 14:40:38.641958 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1027421588' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:40.504803 I | rook-ceph-mon2: 2017-07-11 14:40:40.504769 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:40.505036 I | rook-ceph-mon2: 2017-07-11 14:40:40.504990 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3826157968' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:44.009456 I | rook-ceph-mon2: 2017-07-11 14:40:44.009416 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:44.009698 I | rook-ceph-mon2: 2017-07-11 14:40:44.009551 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3330837485' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:44.438188 I | rook-ceph-mon2: 2017-07-11 14:40:44.438126 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:40:44.438395 I | rook-ceph-mon2: 2017-07-11 14:40:44.438316 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1894772808' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:40:44.894885 I | rook-ceph-mon2: 2017-07-11 14:40:44.894849 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:44.895065 I | rook-ceph-mon2: 2017-07-11 14:40:44.894984 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3830475748' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:46.122786 I | rook-ceph-mon2: 2017-07-11 14:40:46.122751 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:40:46.122976 I | rook-ceph-mon2: 2017-07-11 14:40:46.122895 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/7374114' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:40:49.380176 I | rook-ceph-mon2: 2017-07-11 14:40:49.380129 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:40:49.380360 I | rook-ceph-mon2: 2017-07-11 14:40:49.380278 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/777668083' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:40:50.678440 I | rook-ceph-mon2: 2017-07-11 14:40:50.678323 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:40:50.678531 I | rook-ceph-mon2: 2017-07-11 14:40:50.678348 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1073169766' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:40:51.579698 I | rook-ceph-mon2: 2017-07-11 14:40:51.579665 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:51.579876 I | rook-ceph-mon2: 2017-07-11 14:40:51.579799 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1789877264' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:53.450948 I | rook-ceph-mon2: 2017-07-11 14:40:53.450918 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:53.451057 I | rook-ceph-mon2: 2017-07-11 14:40:53.451042 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2275426699' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:54.719483 I | rook-ceph-mon2: 2017-07-11 14:40:54.719448 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:54.719679 I | rook-ceph-mon2: 2017-07-11 14:40:54.719591 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1434235484' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:58.147640 I | rook-ceph-mon2: 2017-07-11 14:40:58.147358 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4921 MB, avail 94265 MB
- 2017-07-11 14:40:58.367777 I | rook-ceph-mon2: 2017-07-11 14:40:58.367746 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:40:58.367961 I | rook-ceph-mon2: 2017-07-11 14:40:58.367881 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/572320711' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:40:58.851292 I | rook-ceph-mon2: 2017-07-11 14:40:58.851256 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:58.851579 I | rook-ceph-mon2: 2017-07-11 14:40:58.851538 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1809017132' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:40:59.726923 I | rook-ceph-mon2: 2017-07-11 14:40:59.726889 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:40:59.727032 I | rook-ceph-mon2: 2017-07-11 14:40:59.727016 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/440808419' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:01.932475 I | rook-ceph-mon2: 2017-07-11 14:41:01.932415 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:01.932675 I | rook-ceph-mon2: 2017-07-11 14:41:01.932604 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4167590851' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:03.317530 I | rook-ceph-mon2: 2017-07-11 14:41:03.310161 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:03.320629 I | rook-ceph-mon2: 2017-07-11 14:41:03.317661 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1081184547' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:03.793159 I | rook-ceph-mon2: 2017-07-11 14:41:03.793124 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:03.793354 I | rook-ceph-mon2: 2017-07-11 14:41:03.793266 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/493271546' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:04.213299 I | rook-ceph-mon2: 2017-07-11 14:41:04.213257 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:41:04.213404 I | rook-ceph-mon2: 2017-07-11 14:41:04.213388 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3981043333' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:41:04.614839 I | rook-ceph-mon2: 2017-07-11 14:41:04.614808 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:04.614952 I | rook-ceph-mon2: 2017-07-11 14:41:04.614938 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/36327346' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:05.691535 I | rook-ceph-mon2: 2017-07-11 14:41:05.691502 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:41:05.691722 I | rook-ceph-mon2: 2017-07-11 14:41:05.691635 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3416034769' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:41:06.358909 I | rook-ceph-mon2: 2017-07-11 14:41:05.711585 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1429 : audit [INF] from='client.5776 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:41:06.358998 I | rook-ceph-mon2: 2017-07-11 14:41:05.856584 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 1016 : audit [INF] from='client.? 10.233.99.0:0/2415758692' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 14:41:06.565302 I | rook-ceph-mon2: 2017-07-11 14:41:06.565269 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:06.565455 I | rook-ceph-mon2: 2017-07-11 14:41:06.565440 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4195288194' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:08.241573 I | rook-ceph-mon2: 2017-07-11 14:41:08.241544 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:08.241750 I | rook-ceph-mon2: 2017-07-11 14:41:08.241668 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3912582284' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:09.555754 I | rook-ceph-mon2: 2017-07-11 14:41:09.555719 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:09.555943 I | rook-ceph-mon2: 2017-07-11 14:41:09.555859 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/192485562' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:10.398575 I | rook-ceph-mon2: 2017-07-11 14:41:10.398532 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:41:10.398791 I | rook-ceph-mon2: 2017-07-11 14:41:10.398760 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1121857118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:41:11.299778 I | rook-ceph-mon2: 2017-07-11 14:41:11.299746 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:11.300035 I | rook-ceph-mon2: 2017-07-11 14:41:11.300003 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1628837044' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:13.133358 I | rook-ceph-mon2: 2017-07-11 14:41:13.133317 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:13.133610 I | rook-ceph-mon2: 2017-07-11 14:41:13.133548 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3191569001' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:14.421801 I | rook-ceph-mon2: 2017-07-11 14:41:14.421754 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:14.421910 I | rook-ceph-mon2: 2017-07-11 14:41:14.421895 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3072794361' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:15.550979 I | rook-ceph-mon2: 2017-07-11 14:41:15.550945 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:41:15.551083 I | rook-ceph-mon2: 2017-07-11 14:41:15.551069 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3165446039' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:41:16.390976 I | rook-ceph-mon2: 2017-07-11 14:41:16.390941 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:16.391212 I | rook-ceph-mon2: 2017-07-11 14:41:16.391195 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4046027925' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:16.995149 I | rook-ceph-mon2: 2017-07-11 14:41:16.995117 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:16.995343 I | rook-ceph-mon2: 2017-07-11 14:41:16.995248 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4109727659' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:18.491576 I | rook-ceph-mon2: 2017-07-11 14:41:18.491544 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:18.491679 I | rook-ceph-mon2: 2017-07-11 14:41:18.491664 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/746726804' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:18.948643 I | rook-ceph-mon2: 2017-07-11 14:41:18.948607 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:41:18.948763 I | rook-ceph-mon2: 2017-07-11 14:41:18.948748 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/523631695' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:41:20.354372 I | rook-ceph-mon2: 2017-07-11 14:41:20.354339 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:41:20.354543 I | rook-ceph-mon2: 2017-07-11 14:41:20.354473 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3363697706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:41:21.218566 I | rook-ceph-mon2: 2017-07-11 14:41:21.218532 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:21.218679 I | rook-ceph-mon2: 2017-07-11 14:41:21.218655 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4222181094' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:23.061034 I | rook-ceph-mon2: 2017-07-11 14:41:23.060989 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:23.061262 I | rook-ceph-mon2: 2017-07-11 14:41:23.061141 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2368584136' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:23.863679 I | rook-ceph-mon2: 2017-07-11 14:41:23.863647 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:41:23.870163 I | rook-ceph-mon2: 2017-07-11 14:41:23.870144 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3400405281' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:41:24.288197 I | rook-ceph-mon2: 2017-07-11 14:41:24.288165 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:24.288368 I | rook-ceph-mon2: 2017-07-11 14:41:24.288289 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2963826873' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:26.275281 I | rook-ceph-mon2: 2017-07-11 14:41:26.275247 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:26.275564 I | rook-ceph-mon2: 2017-07-11 14:41:26.275512 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2288841149' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:27.962476 I | rook-ceph-mon2: 2017-07-11 14:41:27.962442 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:27.962653 I | rook-ceph-mon2: 2017-07-11 14:41:27.962577 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4233013231' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:28.375630 I | rook-ceph-mon2: 2017-07-11 14:41:28.375595 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:28.375815 I | rook-ceph-mon2: 2017-07-11 14:41:28.375725 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1073677301' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:30.156967 I | rook-ceph-mon2: 2017-07-11 14:41:30.156934 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:41:30.157168 I | rook-ceph-mon2: 2017-07-11 14:41:30.157073 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2466319765' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:41:31.008804 I | rook-ceph-mon2: 2017-07-11 14:41:31.008772 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:31.008908 I | rook-ceph-mon2: 2017-07-11 14:41:31.008894 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3270005382' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:32.935196 I | rook-ceph-mon2: 2017-07-11 14:41:32.935162 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:32.935304 I | rook-ceph-mon2: 2017-07-11 14:41:32.935289 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2242561893' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:33.333699 I | rook-ceph-mon2: 2017-07-11 14:41:33.333667 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:33.333800 I | rook-ceph-mon2: 2017-07-11 14:41:33.333786 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3545797046' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:33.747555 I | rook-ceph-mon2: 2017-07-11 14:41:33.747522 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:41:33.747662 I | rook-ceph-mon2: 2017-07-11 14:41:33.747645 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/701298874' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:41:34.169126 I | rook-ceph-mon2: 2017-07-11 14:41:34.169091 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:34.169312 I | rook-ceph-mon2: 2017-07-11 14:41:34.169232 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/941685725' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:35.164752 I | rook-ceph-mon2: 2017-07-11 14:41:35.164718 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:41:35.164978 I | rook-ceph-mon2: 2017-07-11 14:41:35.164860 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2744422499' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:41:40.146374 I | rook-ceph-mon2: 2017-07-11 14:41:40.146338 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:40.146566 I | rook-ceph-mon2: 2017-07-11 14:41:40.146481 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2449226784' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:40.572410 I | rook-ceph-mon2: 2017-07-11 14:41:40.572378 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:41:40.578714 I | rook-ceph-mon2: 2017-07-11 14:41:40.572458 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/776325646' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:41:41.003840 I | rook-ceph-mon2: 2017-07-11 14:41:41.003805 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:41.004183 I | rook-ceph-mon2: 2017-07-11 14:41:41.003935 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2186689974' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:42.613228 I | rook-ceph-mon2: 2017-07-11 14:41:42.613188 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:42.613586 I | rook-ceph-mon2: 2017-07-11 14:41:42.613552 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1633133007' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:45.065861 I | rook-ceph-mon2: 2017-07-11 14:41:45.065799 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:45.066112 I | rook-ceph-mon2: 2017-07-11 14:41:45.065972 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/360707823' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:45.648909 I | rook-ceph-mon2: 2017-07-11 14:41:45.648880 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:41:45.648968 I | rook-ceph-mon2: 2017-07-11 14:41:45.648954 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1642840971' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:41:46.259277 I | rook-ceph-mon2: 2017-07-11 14:41:46.259244 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:46.259462 I | rook-ceph-mon2: 2017-07-11 14:41:46.259383 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1070511419' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:47.177568 I | rook-ceph-mon2: 2017-07-11 14:41:47.177534 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:41:47.177759 I | rook-ceph-mon2: 2017-07-11 14:41:47.177677 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/611887203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:41:49.963534 I | rook-ceph-mon2: 2017-07-11 14:41:49.963500 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:49.963728 I | rook-ceph-mon2: 2017-07-11 14:41:49.963642 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2881972020' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:50.794065 I | rook-ceph-mon2: 2017-07-11 14:41:50.794032 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:41:50.794284 I | rook-ceph-mon2: 2017-07-11 14:41:50.794246 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1226871217' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:41:51.225486 I | rook-ceph-mon2: 2017-07-11 14:41:51.225452 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:51.225763 I | rook-ceph-mon2: 2017-07-11 14:41:51.225746 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/89460625' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:53.897322 I | rook-ceph-mon2: 2017-07-11 14:41:53.897286 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:41:53.897430 I | rook-ceph-mon2: 2017-07-11 14:41:53.897416 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3966193060' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:41:54.524855 I | rook-ceph-mon2: 2017-07-11 14:41:54.524823 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:54.525116 I | rook-ceph-mon2: 2017-07-11 14:41:54.525098 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2199638149' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:55.006911 I | rook-ceph-mon2: 2017-07-11 14:41:55.006387 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:55.007244 I | rook-ceph-mon2: 2017-07-11 14:41:55.006426 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3286959018' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:56.049910 I | rook-ceph-mon2: 2017-07-11 14:41:56.049866 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:56.050100 I | rook-ceph-mon2: 2017-07-11 14:41:56.050017 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/223330960' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:41:58.148312 I | rook-ceph-mon2: 2017-07-11 14:41:58.147866 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4921 MB, avail 94265 MB
- 2017-07-11 14:41:59.529408 I | rook-ceph-mon2: 2017-07-11 14:41:59.529375 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:41:59.529663 I | rook-ceph-mon2: 2017-07-11 14:41:59.529615 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2776527347' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:41:59.998886 I | rook-ceph-mon2: 2017-07-11 14:41:59.998852 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:41:59.999191 I | rook-ceph-mon2: 2017-07-11 14:41:59.999144 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2097734931' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:00.898358 I | rook-ceph-mon2: 2017-07-11 14:42:00.898127 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:00.898430 I | rook-ceph-mon2: 2017-07-11 14:42:00.898151 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2726347062' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:04.762868 I | rook-ceph-mon2: 2017-07-11 14:42:04.762834 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:04.763055 I | rook-ceph-mon2: 2017-07-11 14:42:04.762979 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/59317392' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:07.004172 I | rook-ceph-mon2: 2017-07-11 14:42:07.004137 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:42:07.004412 I | rook-ceph-mon2: 2017-07-11 14:42:07.004377 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1819029377' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:42:07.980128 I | rook-ceph-mon2: 2017-07-11 14:42:07.980096 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:07.980298 I | rook-ceph-mon2: 2017-07-11 14:42:07.980225 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/312809475' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:09.456832 I | rook-ceph-mon2: 2017-07-11 14:42:09.456787 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:09.457069 I | rook-ceph-mon2: 2017-07-11 14:42:09.456952 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2354617936' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:11.875211 I | rook-ceph-mon2: 2017-07-11 14:42:11.875105 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:42:11.875278 I | rook-ceph-mon2: 2017-07-11 14:42:11.875141 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1498399363' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:42:12.881075 I | rook-ceph-mon2: 2017-07-11 14:42:12.881029 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:12.886875 I | rook-ceph-mon2: 2017-07-11 14:42:12.881171 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3450686971' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:14.205397 I | rook-ceph-mon2: 2017-07-11 14:42:14.205353 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:14.205569 I | rook-ceph-mon2: 2017-07-11 14:42:14.205492 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/292504426' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:15.070738 I | rook-ceph-mon2: 2017-07-11 14:42:15.070705 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:42:15.070911 I | rook-ceph-mon2: 2017-07-11 14:42:15.070836 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2901384170' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:42:16.420106 I | rook-ceph-mon2: 2017-07-11 14:42:16.420072 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:42:16.420350 I | rook-ceph-mon2: 2017-07-11 14:42:16.420317 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/728427140' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:42:17.326781 I | rook-ceph-mon2: 2017-07-11 14:42:17.326745 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:17.327030 I | rook-ceph-mon2: 2017-07-11 14:42:17.327015 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/853851952' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:19.136247 I | rook-ceph-mon2: 2017-07-11 14:42:19.136110 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:19.136341 I | rook-ceph-mon2: 2017-07-11 14:42:19.136148 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/939523112' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:20.447083 I | rook-ceph-mon2: 2017-07-11 14:42:20.447049 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:20.447221 I | rook-ceph-mon2: 2017-07-11 14:42:20.447206 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/232182930' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:21.252393 I | rook-ceph-mon2: 2017-07-11 14:42:21.252359 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:42:21.252608 I | rook-ceph-mon2: 2017-07-11 14:42:21.252577 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2621275960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:42:24.079592 I | rook-ceph-mon2: 2017-07-11 14:42:24.079557 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:24.079787 I | rook-ceph-mon2: 2017-07-11 14:42:24.079691 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2824019781' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:24.980044 I | rook-ceph-mon2: 2017-07-11 14:42:24.980012 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:42:24.980149 I | rook-ceph-mon2: 2017-07-11 14:42:24.980135 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4209002140' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:42:26.946644 I | rook-ceph-mon2: 2017-07-11 14:42:26.946608 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:42:26.946747 I | rook-ceph-mon2: 2017-07-11 14:42:26.946732 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1313019097' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:42:29.095795 I | rook-ceph-mon2: 2017-07-11 14:42:29.095764 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:29.095901 I | rook-ceph-mon2: 2017-07-11 14:42:29.095886 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3677912702' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:29.518058 I | rook-ceph-mon2: 2017-07-11 14:42:29.518006 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:29.518252 I | rook-ceph-mon2: 2017-07-11 14:42:29.518167 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2382401145' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:30.445422 I | rook-ceph-mon2: 2017-07-11 14:42:30.445386 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:30.445658 I | rook-ceph-mon2: 2017-07-11 14:42:30.445539 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1554934634' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:31.230388 I | rook-ceph-mon2: 2017-07-11 14:42:31.230351 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:42:31.236244 I | rook-ceph-mon2: 2017-07-11 14:42:31.236224 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3158366581' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:42:34.352763 I | rook-ceph-mon2: 2017-07-11 14:42:34.352732 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:34.352871 I | rook-ceph-mon2: 2017-07-11 14:42:34.352857 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1579509296' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:35.467476 I | rook-ceph-mon2: 2017-07-11 14:42:35.467131 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:35.467754 I | rook-ceph-mon2: 2017-07-11 14:42:35.467149 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3847366277' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:37.386418 I | rook-ceph-mon2: 2017-07-11 14:42:37.386382 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:37.392336 I | rook-ceph-mon2: 2017-07-11 14:42:37.386529 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1067191616' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:38.816376 I | rook-ceph-mon2: 2017-07-11 14:42:38.816341 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:38.816605 I | rook-ceph-mon2: 2017-07-11 14:42:38.816587 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3622721078' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:39.231891 I | rook-ceph-mon2: 2017-07-11 14:42:39.231861 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:39.231992 I | rook-ceph-mon2: 2017-07-11 14:42:39.231977 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1696727870' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:39.676829 I | rook-ceph-mon2: 2017-07-11 14:42:39.676795 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:42:39.677037 I | rook-ceph-mon2: 2017-07-11 14:42:39.676950 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1996256040' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:42:40.123651 I | rook-ceph-mon2: 2017-07-11 14:42:40.123612 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:40.123892 I | rook-ceph-mon2: 2017-07-11 14:42:40.123853 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3731834912' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:41.072825 I | rook-ceph-mon2: 2017-07-11 14:42:41.072789 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:42:41.073131 I | rook-ceph-mon2: 2017-07-11 14:42:41.073114 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3220274869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:42:41.803791 I | rook-ceph-mon2: 2017-07-11 14:42:41.803757 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:41.803967 I | rook-ceph-mon2: 2017-07-11 14:42:41.803887 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/154764512' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:43.772780 I | rook-ceph-mon2: 2017-07-11 14:42:43.772746 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:43.773033 I | rook-ceph-mon2: 2017-07-11 14:42:43.772983 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3467553797' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:44.178034 I | rook-ceph-mon2: 2017-07-11 14:42:44.178001 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:44.178275 I | rook-ceph-mon2: 2017-07-11 14:42:44.178256 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2443252844' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:44.600009 I | rook-ceph-mon2: 2017-07-11 14:42:44.599975 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:42:44.600182 I | rook-ceph-mon2: 2017-07-11 14:42:44.600108 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/134771999' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:42:45.064037 I | rook-ceph-mon2: 2017-07-11 14:42:45.064003 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:45.064144 I | rook-ceph-mon2: 2017-07-11 14:42:45.064129 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3388019320' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:48.808168 I | rook-ceph-mon2: 2017-07-11 14:42:48.808136 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:48.814265 I | rook-ceph-mon2: 2017-07-11 14:42:48.808274 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/133265094' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:49.235680 I | rook-ceph-mon2: 2017-07-11 14:42:49.235648 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:49.235783 I | rook-ceph-mon2: 2017-07-11 14:42:49.235769 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3582349816' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:49.646538 I | rook-ceph-mon2: 2017-07-11 14:42:49.646504 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:42:49.646641 I | rook-ceph-mon2: 2017-07-11 14:42:49.646626 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3088625736' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:42:50.439817 I | rook-ceph-mon2: 2017-07-11 14:42:50.439782 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:50.440002 I | rook-ceph-mon2: 2017-07-11 14:42:50.439917 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1191592096' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:51.223591 I | rook-ceph-mon2: 2017-07-11 14:42:51.223535 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:42:51.223770 I | rook-ceph-mon2: 2017-07-11 14:42:51.223698 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3120069927' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:42:52.197732 I | rook-ceph-mon2: 2017-07-11 14:42:52.197697 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:52.197924 I | rook-ceph-mon2: 2017-07-11 14:42:52.197839 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1134662451' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:54.204526 I | rook-ceph-mon2: 2017-07-11 14:42:54.204493 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:54.204731 I | rook-ceph-mon2: 2017-07-11 14:42:54.204708 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3802334305' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:55.024579 I | rook-ceph-mon2: 2017-07-11 14:42:55.024545 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:42:55.024698 I | rook-ceph-mon2: 2017-07-11 14:42:55.024683 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4163186908' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:42:56.058470 I | rook-ceph-mon2: 2017-07-11 14:42:56.058436 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:42:56.058683 I | rook-ceph-mon2: 2017-07-11 14:42:56.058581 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3240723654' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:42:58.148594 I | rook-ceph-mon2: 2017-07-11 14:42:58.148232 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4921 MB, avail 94265 MB
- 2017-07-11 14:42:58.740947 I | rook-ceph-mon2: 2017-07-11 14:42:58.740843 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:42:58.741141 I | rook-ceph-mon2: 2017-07-11 14:42:58.741061 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2326578370' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:42:59.648284 I | rook-ceph-mon2: 2017-07-11 14:42:59.648250 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:42:59.648486 I | rook-ceph-mon2: 2017-07-11 14:42:59.648410 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/708833884' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:43:00.109931 I | rook-ceph-mon2: 2017-07-11 14:43:00.109898 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:00.110116 I | rook-ceph-mon2: 2017-07-11 14:43:00.110037 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1888030833' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:01.820140 I | rook-ceph-mon2: 2017-07-11 14:43:01.820085 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:01.820421 I | rook-ceph-mon2: 2017-07-11 14:43:01.820394 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/535791231' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:03.554237 I | rook-ceph-mon2: 2017-07-11 14:43:03.554207 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:03.554411 I | rook-ceph-mon2: 2017-07-11 14:43:03.554332 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1690097810' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:03.994682 I | rook-ceph-mon2: 2017-07-11 14:43:03.994647 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:03.994885 I | rook-ceph-mon2: 2017-07-11 14:43:03.994787 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1960517344' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:05.811485 I | rook-ceph-mon2: 2017-07-11 14:43:05.811413 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:43:05.811740 I | rook-ceph-mon2: 2017-07-11 14:43:05.811709 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2136299383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:43:06.604246 I | rook-ceph-mon2: 2017-07-11 14:43:06.604214 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:06.604439 I | rook-ceph-mon2: 2017-07-11 14:43:06.604347 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/648449272' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:07.810275 I | rook-ceph-mon2: 2017-07-11 14:43:07.810232 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:43:07.810467 I | rook-ceph-mon2: 2017-07-11 14:43:07.810381 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/247487615' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:43:09.450718 I | rook-ceph-mon2: 2017-07-11 14:43:09.450557 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:43:09.450790 I | rook-ceph-mon2: 2017-07-11 14:43:09.450577 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2609712009' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:43:09.912612 I | rook-ceph-mon2: 2017-07-11 14:43:09.912563 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:09.912786 I | rook-ceph-mon2: 2017-07-11 14:43:09.912711 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1293526781' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:10.853855 I | rook-ceph-mon2: 2017-07-11 14:43:10.853822 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:43:10.854107 I | rook-ceph-mon2: 2017-07-11 14:43:10.854091 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1376384114' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:43:11.674251 I | rook-ceph-mon2: 2017-07-11 14:43:11.674217 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:11.674374 I | rook-ceph-mon2: 2017-07-11 14:43:11.674359 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2400580386' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:13.385700 I | rook-ceph-mon2: 2017-07-11 14:43:13.385666 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:13.385807 I | rook-ceph-mon2: 2017-07-11 14:43:13.385792 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/198376341' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:13.803606 I | rook-ceph-mon2: 2017-07-11 14:43:13.803558 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:13.803841 I | rook-ceph-mon2: 2017-07-11 14:43:13.803825 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2891886631' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:15.604095 I | rook-ceph-mon2: 2017-07-11 14:43:15.604060 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:43:15.604289 I | rook-ceph-mon2: 2017-07-11 14:43:15.604203 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3326516923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:43:16.394546 I | rook-ceph-mon2: 2017-07-11 14:43:16.394514 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:16.394722 I | rook-ceph-mon2: 2017-07-11 14:43:16.394707 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1056331142' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:18.282146 I | rook-ceph-mon2: 2017-07-11 14:43:18.282004 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:18.282336 I | rook-ceph-mon2: 2017-07-11 14:43:18.282319 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2550288844' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:18.699605 I | rook-ceph-mon2: 2017-07-11 14:43:18.699370 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:18.699679 I | rook-ceph-mon2: 2017-07-11 14:43:18.699414 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1829757887' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:19.129115 I | rook-ceph-mon2: 2017-07-11 14:43:19.129074 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:43:19.129917 I | rook-ceph-mon2: 2017-07-11 14:43:19.129898 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2556086950' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:43:20.491335 I | rook-ceph-mon2: 2017-07-11 14:43:20.491302 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:43:20.491565 I | rook-ceph-mon2: 2017-07-11 14:43:20.491549 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2827971701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:43:21.460011 I | rook-ceph-mon2: 2017-07-11 14:43:21.459979 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:21.460205 I | rook-ceph-mon2: 2017-07-11 14:43:21.460111 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/880043665' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:23.719953 I | rook-ceph-mon2: 2017-07-11 14:43:23.719919 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:23.720057 I | rook-ceph-mon2: 2017-07-11 14:43:23.720042 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3987524921' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:24.131268 I | rook-ceph-mon2: 2017-07-11 14:43:24.131235 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:43:24.131448 I | rook-ceph-mon2: 2017-07-11 14:43:24.131369 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2697314836' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:43:24.542206 I | rook-ceph-mon2: 2017-07-11 14:43:24.542172 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:24.542381 I | rook-ceph-mon2: 2017-07-11 14:43:24.542304 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3592266812' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:26.279738 I | rook-ceph-mon2: 2017-07-11 14:43:26.279437 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:26.280095 I | rook-ceph-mon2: 2017-07-11 14:43:26.279472 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1003688760' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:29.202853 I | rook-ceph-mon2: 2017-07-11 14:43:29.202820 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:43:29.203020 I | rook-ceph-mon2: 2017-07-11 14:43:29.203003 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4194134107' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:43:29.643533 I | rook-ceph-mon2: 2017-07-11 14:43:29.643451 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:29.643671 I | rook-ceph-mon2: 2017-07-11 14:43:29.643655 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2641513149' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:30.514827 I | rook-ceph-mon2: 2017-07-11 14:43:30.514791 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:43:30.515012 I | rook-ceph-mon2: 2017-07-11 14:43:30.514932 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3618249651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:43:33.100623 I | rook-ceph-mon2: 2017-07-11 14:43:33.100587 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:33.100893 I | rook-ceph-mon2: 2017-07-11 14:43:33.100847 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1338728513' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:33.970455 I | rook-ceph-mon2: 2017-07-11 14:43:33.970389 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:43:33.970670 I | rook-ceph-mon2: 2017-07-11 14:43:33.970587 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2634934200' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:43:34.366058 I | rook-ceph-mon2: 2017-07-11 14:43:34.366026 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:34.366250 I | rook-ceph-mon2: 2017-07-11 14:43:34.366158 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2223650426' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:38.014279 I | rook-ceph-mon2: 2017-07-11 14:43:38.014245 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:38.014481 I | rook-ceph-mon2: 2017-07-11 14:43:38.014371 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2916776571' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:38.887522 I | rook-ceph-mon2: 2017-07-11 14:43:38.887485 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:43:38.887799 I | rook-ceph-mon2: 2017-07-11 14:43:38.887646 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3327089729' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:43:39.334555 I | rook-ceph-mon2: 2017-07-11 14:43:39.334521 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:39.334781 I | rook-ceph-mon2: 2017-07-11 14:43:39.334749 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/591912161' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:42.962018 I | rook-ceph-mon2: 2017-07-11 14:43:42.961981 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:42.962126 I | rook-ceph-mon2: 2017-07-11 14:43:42.962111 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2147391944' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:43.395469 I | rook-ceph-mon2: 2017-07-11 14:43:43.395434 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:43.395722 I | rook-ceph-mon2: 2017-07-11 14:43:43.395704 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4061821918' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:43.938880 I | rook-ceph-mon2: 2017-07-11 14:43:43.936178 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #98. Immutable memtables: 0.
- 2017-07-11 14:43:43.938956 I | rook-ceph-mon2:
- 2017-07-11 14:43:43.939007 I | rook-ceph-mon2: 2017-07-11 14:43:43.936220 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 62] Syncing log #95
- 2017-07-11 14:43:43.975287 I | rook-ceph-mon2: 2017-07-11 14:43:43.974514 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:43:43.936214) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:43:43.975343 I | rook-ceph-mon2: 2017-07-11 14:43:43.974532 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 62] Flushing memtable with next log file: 98
- 2017-07-11 14:43:43.975359 I | rook-ceph-mon2:
- 2017-07-11 14:43:43.975371 I | rook-ceph-mon2: 2017-07-11 14:43:43.974549 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784223974541, "job": 62, "event": "flush_started", "num_memtables": 1, "num_entries": 2520, "num_deletes": 508, "memory_usage": 7502056}
- 2017-07-11 14:43:43.975382 I | rook-ceph-mon2: 2017-07-11 14:43:43.974553 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 62] Level-0 flush table #99: started
- 2017-07-11 14:43:44.166898 I | rook-ceph-mon2: 2017-07-11 14:43:44.165327 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224165318, "cf_name": "default", "job": 62, "event": "table_file_creation", "file_number": 99, "file_size": 4952867, "table_properties": {"data_size": 4935718, "index_size": 16330, "filter_size": 0, "raw_key_size": 22211, "raw_average_key_size": 19, "raw_value_size": 4908620, "raw_average_value_size": 4257, "num_data_blocks": 511, "num_entries": 1153, "filter_policy_name": "", "kDeletedKeys": "508", "kMergeOperands": "0"}}
- 2017-07-11 14:43:44.166971 I | rook-ceph-mon2: 2017-07-11 14:43:44.165340 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 62] Level-0 flush table #99: 4952867 bytes OK
- 2017-07-11 14:43:44.215773 I | rook-ceph-mon2: 2017-07-11 14:43:44.214704 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.194768) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #99 started
- 2017-07-11 14:43:44.216987 I | rook-ceph-mon2: 2017-07-11 14:43:44.214712 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.213845) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #99: memtable #1 done
- 2017-07-11 14:43:44.217069 I | rook-ceph-mon2: 2017-07-11 14:43:44.214714 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.213871) EVENT_LOG_v1 {"time_micros": 1499784224213862, "job": 62, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:43:44.217095 I | rook-ceph-mon2: 2017-07-11 14:43:44.214715 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.214674) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:43:44.217120 I | rook-ceph-mon2:
- 2017-07-11 14:43:44.217132 I | rook-ceph-mon2: 2017-07-11 14:43:44.214720 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 62] Try to delete WAL files size 7448737, prev total WAL file size 7448737, number of live WAL files 2.
- 2017-07-11 14:43:44.217144 I | rook-ceph-mon2:
- 2017-07-11 14:43:44.233474 I | rook-ceph-mon2: 2017-07-11 14:43:44.217176 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:43:44.233523 I | rook-ceph-mon2: 2017-07-11 14:43:44.217208 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.217202) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:43:44.233540 I | rook-ceph-mon2:
- 2017-07-11 14:43:44.233552 I | rook-ceph-mon2: 2017-07-11 14:43:44.217213 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 63] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:43:44.233563 I | rook-ceph-mon2: 2017-07-11 14:43:44.217217 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 62 Base level 0, inputs: [99(4836KB)], [97(13MB)]
- 2017-07-11 14:43:44.233574 I | rook-ceph-mon2:
- 2017-07-11 14:43:44.233612 I | rook-ceph-mon2: 2017-07-11 14:43:44.217228 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224217220, "job": 63, "event": "compaction_started", "files_L0": [99], "files_L1": [97], "score": -1, "input_data_size": 18856830}
- 2017-07-11 14:43:44.488267 I | rook-ceph-mon2: 2017-07-11 14:43:44.488020 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:44.488354 I | rook-ceph-mon2: 2017-07-11 14:43:44.488058 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3352615634' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:44.547995 I | rook-ceph-mon2: 2017-07-11 14:43:44.547951 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 63] Generated table #100: 2191 keys, 15739440 bytes
- 2017-07-11 14:43:44.566016 I | rook-ceph-mon2: 2017-07-11 14:43:44.565957 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224565934, "cf_name": "default", "job": 63, "event": "table_file_creation", "file_number": 100, "file_size": 15739440, "table_properties": {"data_size": 15687911, "index_size": 50710, "filter_size": 0, "raw_key_size": 41933, "raw_average_key_size": 19, "raw_value_size": 15621884, "raw_average_value_size": 7130, "num_data_blocks": 1564, "num_entries": 2191, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:43:44.605739 I | rook-ceph-mon2: 2017-07-11 14:43:44.605711 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 63] Compacted 1@0 + 1@1 files to L1 => 15739440 bytes
- 2017-07-11 14:43:44.645732 I | rook-ceph-mon2: 2017-07-11 14:43:44.645700 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.645597) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 48.5 rd, 40.5 wr, level 1, files in(1, 1) out(1) MB in(4.7, 13.3) out(15.0), read-write-amplify(7.0) write-amplify(3.2) OK, records in: 3214, records dropped: 1023
- 2017-07-11 14:43:44.646701 I | rook-ceph-mon2:
- 2017-07-11 14:43:44.646817 I | rook-ceph-mon2: 2017-07-11 14:43:44.646739 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:43:44.645617) EVENT_LOG_v1 {"time_micros": 1499784224645609, "job": 63, "event": "compaction_finished", "compaction_time_micros": 388470, "output_level": 1, "num_output_files": 1, "total_output_size": 15739440, "num_input_records": 3214, "num_output_records": 2191, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:43:44.662749 I | rook-ceph-mon2: 2017-07-11 14:43:44.662731 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224662729, "job": 63, "event": "table_file_deletion", "file_number": 99}
- 2017-07-11 14:43:44.664381 I | rook-ceph-mon2: 2017-07-11 14:43:44.664366 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784224664364, "job": 63, "event": "table_file_deletion", "file_number": 97}
- 2017-07-11 14:43:44.664468 I | rook-ceph-mon2: 2017-07-11 14:43:44.664453 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:43:45.660359 I | rook-ceph-mon2: 2017-07-11 14:43:45.660325 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:43:45.660552 I | rook-ceph-mon2: 2017-07-11 14:43:45.660468 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2044020850' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:43:47.789917 I | rook-ceph-mon2: 2017-07-11 14:43:47.789459 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #101. Immutable memtables: 0.
- 2017-07-11 14:43:47.789995 I | rook-ceph-mon2:
- 2017-07-11 14:43:47.790014 I | rook-ceph-mon2: 2017-07-11 14:43:47.789545 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 64] Syncing log #98
- 2017-07-11 14:43:47.821351 I | rook-ceph-mon2: 2017-07-11 14:43:47.820855 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:43:47.789539) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:43:47.828166 I | rook-ceph-mon2: 2017-07-11 14:43:47.820880 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 64] Flushing memtable with next log file: 101
- 2017-07-11 14:43:47.828216 I | rook-ceph-mon2:
- 2017-07-11 14:43:47.828242 I | rook-ceph-mon2: 2017-07-11 14:43:47.820890 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784227820884, "job": 64, "event": "flush_started", "num_memtables": 1, "num_entries": 298, "num_deletes": 251, "memory_usage": 180280}
- 2017-07-11 14:43:47.828257 I | rook-ceph-mon2: 2017-07-11 14:43:47.820892 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 64] Level-0 flush table #102: started
- 2017-07-11 14:43:47.880587 I | rook-ceph-mon2: 2017-07-11 14:43:47.877420 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784227877412, "cf_name": "default", "job": 64, "event": "table_file_creation", "file_number": 102, "file_size": 113634, "table_properties": {"data_size": 112456, "index_size": 364, "filter_size": 0, "raw_key_size": 4968, "raw_average_key_size": 18, "raw_value_size": 108591, "raw_average_value_size": 399, "num_data_blocks": 12, "num_entries": 272, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:43:47.880636 I | rook-ceph-mon2: 2017-07-11 14:43:47.877429 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 64] Level-0 flush table #102: 113634 bytes OK
- 2017-07-11 14:43:47.967179 I | rook-ceph-mon2: 2017-07-11 14:43:47.966393 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:43:47.906736) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #102 started
- 2017-07-11 14:43:47.967562 I | rook-ceph-mon2: 2017-07-11 14:43:47.966399 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:43:47.966327) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #102: memtable #1 done
- 2017-07-11 14:43:47.967599 I | rook-ceph-mon2: 2017-07-11 14:43:47.966401 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:43:47.966352) EVENT_LOG_v1 {"time_micros": 1499784227966347, "job": 64, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:43:47.967614 I | rook-ceph-mon2: 2017-07-11 14:43:47.966402 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:43:47.966366) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:43:47.967625 I | rook-ceph-mon2:
- 2017-07-11 14:43:47.967636 I | rook-ceph-mon2: 2017-07-11 14:43:47.966407 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 64] Try to delete WAL files size 171491, prev total WAL file size 171491, number of live WAL files 2.
- 2017-07-11 14:43:47.967647 I | rook-ceph-mon2:
- 2017-07-11 14:43:47.967673 I | rook-ceph-mon2: 2017-07-11 14:43:47.967240 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:43:47.967687 I | rook-ceph-mon2: 2017-07-11 14:43:47.967316 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:43:47.967268) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:43:47.967697 I | rook-ceph-mon2:
- 2017-07-11 14:43:47.967711 I | rook-ceph-mon2: 2017-07-11 14:43:47.967323 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 65] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:43:47.967724 I | rook-ceph-mon2: 2017-07-11 14:43:47.967328 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 64 Base level 0, inputs: [102(110KB)], [100(15MB)]
- 2017-07-11 14:43:47.967736 I | rook-ceph-mon2:
- 2017-07-11 14:43:47.967761 I | rook-ceph-mon2: 2017-07-11 14:43:47.967338 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784227967330, "job": 65, "event": "compaction_started", "files_L0": [102], "files_L1": [100], "score": -1, "input_data_size": 15853074}
- 2017-07-11 14:43:48.067228 I | rook-ceph-mon2: 2017-07-11 14:43:48.067101 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:48.067316 I | rook-ceph-mon2: 2017-07-11 14:43:48.067125 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2165853845' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:48.141434 I | rook-ceph-mon2: 2017-07-11 14:43:48.141356 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 65] Generated table #103: 1954 keys, 13317404 bytes
- 2017-07-11 14:43:48.149542 I | rook-ceph-mon2: 2017-07-11 14:43:48.149451 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784228149441, "cf_name": "default", "job": 65, "event": "table_file_creation", "file_number": 103, "file_size": 13317404, "table_properties": {"data_size": 13273243, "index_size": 43342, "filter_size": 0, "raw_key_size": 37680, "raw_average_key_size": 19, "raw_value_size": 13215540, "raw_average_value_size": 6763, "num_data_blocks": 1325, "num_entries": 1954, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:43:48.170020 I | rook-ceph-mon2: 2017-07-11 14:43:48.169995 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 65] Compacted 1@0 + 1@1 files to L1 => 13317404 bytes
- 2017-07-11 14:43:48.197938 I | rook-ceph-mon2: 2017-07-11 14:43:48.197911 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:43:48.188390) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 78.2 rd, 65.7 wr, level 1, files in(1, 1) out(1) MB in(0.1, 15.0) out(12.7), read-write-amplify(256.7) write-amplify(117.2) OK, records in: 2463, records dropped: 509
- 2017-07-11 14:43:48.198015 I | rook-ceph-mon2:
- 2017-07-11 14:43:48.198073 I | rook-ceph-mon2: 2017-07-11 14:43:48.198037 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:43:48.188426) EVENT_LOG_v1 {"time_micros": 1499784228188411, "job": 65, "event": "compaction_finished", "compaction_time_micros": 202644, "output_level": 1, "num_output_files": 1, "total_output_size": 13317404, "num_input_records": 2463, "num_output_records": 1954, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:43:48.198277 I | rook-ceph-mon2: 2017-07-11 14:43:48.198261 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784228198206, "job": 65, "event": "table_file_deletion", "file_number": 102}
- 2017-07-11 14:43:48.200157 I | rook-ceph-mon2: 2017-07-11 14:43:48.200113 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784228200111, "job": 65, "event": "table_file_deletion", "file_number": 100}
- 2017-07-11 14:43:48.479819 I | rook-ceph-mon2: 2017-07-11 14:43:48.479787 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:48.479926 I | rook-ceph-mon2: 2017-07-11 14:43:48.479912 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2532253705' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:48.901667 I | rook-ceph-mon2: 2017-07-11 14:43:48.901617 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:43:48.901916 I | rook-ceph-mon2: 2017-07-11 14:43:48.901772 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1120524489' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:43:49.403361 I | rook-ceph-mon2: 2017-07-11 14:43:49.403329 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:49.403530 I | rook-ceph-mon2: 2017-07-11 14:43:49.403450 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1499549691' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:50.314064 I | rook-ceph-mon2: 2017-07-11 14:43:50.314014 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:43:50.314313 I | rook-ceph-mon2: 2017-07-11 14:43:50.314274 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4252516855' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:43:51.292182 I | rook-ceph-mon2: 2017-07-11 14:43:51.292148 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:51.292355 I | rook-ceph-mon2: 2017-07-11 14:43:51.292280 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2036240470' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:53.089642 I | rook-ceph-mon2: 2017-07-11 14:43:53.089604 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:43:53.089862 I | rook-ceph-mon2: 2017-07-11 14:43:53.089833 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4177684257' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:43:53.509515 I | rook-ceph-mon2: 2017-07-11 14:43:53.509480 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:53.509711 I | rook-ceph-mon2: 2017-07-11 14:43:53.509628 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/306284572' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:53.934286 I | rook-ceph-mon2: 2017-07-11 14:43:53.934243 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:43:53.934485 I | rook-ceph-mon2: 2017-07-11 14:43:53.934400 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3566118139' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:43:54.359790 I | rook-ceph-mon2: 2017-07-11 14:43:54.359756 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:43:54.359914 I | rook-ceph-mon2: 2017-07-11 14:43:54.359899 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2486200090' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:43:55.154023 I | rook-ceph-mon2: 2017-07-11 14:43:54.197025 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1526 : cluster [WRN] message from mon.1 was stamped 0.213162s in the future, clocks not synchronized
- 2017-07-11 14:43:55.532115 I | rook-ceph-mon2: 2017-07-11 14:43:55.532080 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:43:55.532288 I | rook-ceph-mon2: 2017-07-11 14:43:55.532214 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2319474363' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:43:58.154258 I | rook-ceph-mon2: 2017-07-11 14:43:58.154030 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4921 MB, avail 94265 MB
- 2017-07-11 14:43:58.674554 I | rook-ceph-mon2: 2017-07-11 14:43:58.674520 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:43:58.674659 I | rook-ceph-mon2: 2017-07-11 14:43:58.674644 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3058133701' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:44:02.707332 I | rook-ceph-mon2: 2017-07-11 14:44:02.707300 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:02.707531 I | rook-ceph-mon2: 2017-07-11 14:44:02.707442 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2830130656' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:03.543118 I | rook-ceph-mon2: 2017-07-11 14:44:03.543081 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:44:03.543374 I | rook-ceph-mon2: 2017-07-11 14:44:03.543332 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/30990380' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:44:03.967118 I | rook-ceph-mon2: 2017-07-11 14:44:03.967081 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:03.967346 I | rook-ceph-mon2: 2017-07-11 14:44:03.967227 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3811232163' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:06.897724 I | rook-ceph-mon2: 2017-07-11 14:44:06.897675 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:06.897963 I | rook-ceph-mon2: 2017-07-11 14:44:06.897923 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/293689838' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:07.604635 I | rook-ceph-mon2: 2017-07-11 14:44:07.604597 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:07.604906 I | rook-ceph-mon2: 2017-07-11 14:44:07.604829 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/251855123' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:09.337125 I | rook-ceph-mon2: 2017-07-11 14:44:09.337083 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:09.337350 I | rook-ceph-mon2: 2017-07-11 14:44:09.337310 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2638502830' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:10.238785 I | rook-ceph-mon2: 2017-07-11 14:44:10.238752 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:44:10.238972 I | rook-ceph-mon2: 2017-07-11 14:44:10.238892 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3711829421' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:44:11.560414 I | rook-ceph-mon2: 2017-07-11 14:44:11.560356 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:11.560588 I | rook-ceph-mon2: 2017-07-11 14:44:11.560509 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/257709532' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:12.524171 I | rook-ceph-mon2: 2017-07-11 14:44:12.524135 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:12.524402 I | rook-ceph-mon2: 2017-07-11 14:44:12.524383 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2506127413' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:13.836252 I | rook-ceph-mon2: 2017-07-11 14:44:13.836205 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:13.836456 I | rook-ceph-mon2: 2017-07-11 14:44:13.836369 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1098676480' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:14.834604 I | rook-ceph-mon2: 2017-07-11 14:44:14.834563 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:14.834862 I | rook-ceph-mon2: 2017-07-11 14:44:14.834793 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/585164030' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:14.984990 I | rook-ceph-mon2: 2017-07-11 14:44:14.984960 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:44:14.985114 I | rook-ceph-mon2: 2017-07-11 14:44:14.985096 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2094266419' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:44:17.642458 I | rook-ceph-mon2: 2017-07-11 14:44:17.642424 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:17.642718 I | rook-ceph-mon2: 2017-07-11 14:44:17.642663 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1535028755' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:18.616812 I | rook-ceph-mon2: 2017-07-11 14:44:18.616780 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:44:18.616996 I | rook-ceph-mon2: 2017-07-11 14:44:18.616920 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1397416739' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:44:19.059336 I | rook-ceph-mon2: 2017-07-11 14:44:19.059302 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:19.059542 I | rook-ceph-mon2: 2017-07-11 14:44:19.059504 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2661904474' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:20.974875 I | rook-ceph-mon2: 2017-07-11 14:44:20.974839 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:20.975110 I | rook-ceph-mon2: 2017-07-11 14:44:20.974995 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3129346506' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:21.820253 I | rook-ceph-mon2: 2017-07-11 14:44:21.820215 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:21.820493 I | rook-ceph-mon2: 2017-07-11 14:44:21.820369 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1747275185' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:22.827537 I | rook-ceph-mon2: 2017-07-11 14:44:22.827501 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:22.827746 I | rook-ceph-mon2: 2017-07-11 14:44:22.827660 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2818998798' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:23.656051 I | rook-ceph-mon2: 2017-07-11 14:44:23.656015 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:23.656277 I | rook-ceph-mon2: 2017-07-11 14:44:23.656249 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1137086688' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:27.406428 I | rook-ceph-mon2: 2017-07-11 14:44:27.406290 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:27.406508 I | rook-ceph-mon2: 2017-07-11 14:44:27.406328 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4161804047' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:27.818154 I | rook-ceph-mon2: 2017-07-11 14:44:27.818119 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:27.818356 I | rook-ceph-mon2: 2017-07-11 14:44:27.818338 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/392812064' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:28.299642 I | rook-ceph-mon2: 2017-07-11 14:44:28.299610 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:44:28.299744 I | rook-ceph-mon2: 2017-07-11 14:44:28.299729 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2420549907' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:44:28.707592 I | rook-ceph-mon2: 2017-07-11 14:44:28.707030 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:28.707683 I | rook-ceph-mon2: 2017-07-11 14:44:28.707050 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3043057745' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:29.562347 I | rook-ceph-mon2: 2017-07-11 14:44:29.562315 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:44:29.562535 I | rook-ceph-mon2: 2017-07-11 14:44:29.562455 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3834452542' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:44:33.081122 I | rook-ceph-mon2: 2017-07-11 14:44:33.081088 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:44:33.081310 I | rook-ceph-mon2: 2017-07-11 14:44:33.081222 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/988837967' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:44:33.488939 I | rook-ceph-mon2: 2017-07-11 14:44:33.488906 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:33.489121 I | rook-ceph-mon2: 2017-07-11 14:44:33.489043 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3623023827' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:34.374458 I | rook-ceph-mon2: 2017-07-11 14:44:34.374427 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:44:34.374639 I | rook-ceph-mon2: 2017-07-11 14:44:34.374559 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1188104697' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:44:36.267315 I | rook-ceph-mon2: 2017-07-11 14:44:35.622703 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1554 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.159445s > max 0.05s
- 2017-07-11 14:44:38.177593 I | rook-ceph-mon2: 2017-07-11 14:44:38.177547 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:44:38.177804 I | rook-ceph-mon2: 2017-07-11 14:44:38.177687 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2734818602' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:44:38.633883 I | rook-ceph-mon2: 2017-07-11 14:44:38.633840 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:38.634194 I | rook-ceph-mon2: 2017-07-11 14:44:38.634153 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/592543931' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:39.482531 I | rook-ceph-mon2: 2017-07-11 14:44:39.482496 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:44:39.482759 I | rook-ceph-mon2: 2017-07-11 14:44:39.482718 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/449149898' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:44:42.103495 I | rook-ceph-mon2: 2017-07-11 14:44:42.103458 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:42.103683 I | rook-ceph-mon2: 2017-07-11 14:44:42.103598 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2412709984' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:42.963193 I | rook-ceph-mon2: 2017-07-11 14:44:42.963157 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:44:42.963403 I | rook-ceph-mon2: 2017-07-11 14:44:42.963287 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2121064350' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:44:43.399550 I | rook-ceph-mon2: 2017-07-11 14:44:43.399515 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:43.399779 I | rook-ceph-mon2: 2017-07-11 14:44:43.399648 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/705209366' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:44.541092 I | rook-ceph-mon2: 2017-07-11 14:44:44.541059 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:44:44.541278 I | rook-ceph-mon2: 2017-07-11 14:44:44.541198 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1453077352' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:44:45.372836 I | rook-ceph-mon2: 2017-07-11 14:44:45.372800 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:45.373097 I | rook-ceph-mon2: 2017-07-11 14:44:45.373079 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3469997080' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:47.920929 I | rook-ceph-mon2: 2017-07-11 14:44:47.920894 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:44:47.920991 I | rook-ceph-mon2: 2017-07-11 14:44:47.920977 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3896605019' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:44:48.355050 I | rook-ceph-mon2: 2017-07-11 14:44:48.355008 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:48.355226 I | rook-ceph-mon2: 2017-07-11 14:44:48.355151 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2778514071' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:49.202479 I | rook-ceph-mon2: 2017-07-11 14:44:49.202444 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:44:49.203060 I | rook-ceph-mon2: 2017-07-11 14:44:49.202981 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3608637927' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:44:50.075776 I | rook-ceph-mon2: 2017-07-11 14:44:50.075744 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:50.075974 I | rook-ceph-mon2: 2017-07-11 14:44:50.075885 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2296342531' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:51.996781 I | rook-ceph-mon2: 2017-07-11 14:44:51.996749 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:51.996968 I | rook-ceph-mon2: 2017-07-11 14:44:51.996882 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/459416189' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:52.488911 I | rook-ceph-mon2: 2017-07-11 14:44:52.488869 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:52.489108 I | rook-ceph-mon2: 2017-07-11 14:44:52.489019 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1110000239' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:52.910227 I | rook-ceph-mon2: 2017-07-11 14:44:52.910189 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:44:52.910358 I | rook-ceph-mon2: 2017-07-11 14:44:52.910340 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3589414988' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:44:55.507279 I | rook-ceph-mon2: 2017-07-11 14:44:55.507244 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:44:55.507387 I | rook-ceph-mon2: 2017-07-11 14:44:55.507373 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3917948185' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:44:55.658050 I | rook-ceph-mon2: 2017-07-11 14:44:55.658016 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:55.658228 I | rook-ceph-mon2: 2017-07-11 14:44:55.658151 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/815428276' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:57.038026 I | rook-ceph-mon2: 2017-07-11 14:44:57.037992 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:44:57.038302 I | rook-ceph-mon2: 2017-07-11 14:44:57.038274 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/251388516' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:44:57.480247 I | rook-ceph-mon2: 2017-07-11 14:44:57.480190 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:57.480461 I | rook-ceph-mon2: 2017-07-11 14:44:57.480426 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2467181045' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:57.901860 I | rook-ceph-mon2: 2017-07-11 14:44:57.901827 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:44:57.901963 I | rook-ceph-mon2: 2017-07-11 14:44:57.901948 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1206596293' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:44:58.156436 I | rook-ceph-mon2: 2017-07-11 14:44:58.156225 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4921 MB, avail 94265 MB
- 2017-07-11 14:44:58.413967 I | rook-ceph-mon2: 2017-07-11 14:44:58.413932 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:44:58.414197 I | rook-ceph-mon2: 2017-07-11 14:44:58.414061 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1755268847' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:44:59.319511 I | rook-ceph-mon2: 2017-07-11 14:44:59.319479 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:44:59.319758 I | rook-ceph-mon2: 2017-07-11 14:44:59.319741 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2377267127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:45:00.341009 I | rook-ceph-mon2: 2017-07-11 14:45:00.340949 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:00.341258 I | rook-ceph-mon2: 2017-07-11 14:45:00.341135 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3447373419' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:02.207979 I | rook-ceph-mon2: 2017-07-11 14:45:02.207944 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:02.208167 I | rook-ceph-mon2: 2017-07-11 14:45:02.208084 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2526470536' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:02.619114 I | rook-ceph-mon2: 2017-07-11 14:45:02.619079 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:02.619364 I | rook-ceph-mon2: 2017-07-11 14:45:02.619347 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/21836055' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:03.032797 I | rook-ceph-mon2: 2017-07-11 14:45:03.032761 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:45:03.032988 I | rook-ceph-mon2: 2017-07-11 14:45:03.032904 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3546940842' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:45:03.448536 I | rook-ceph-mon2: 2017-07-11 14:45:03.448500 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:03.448662 I | rook-ceph-mon2: 2017-07-11 14:45:03.448646 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3614323383' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:05.188534 I | rook-ceph-mon2: 2017-07-11 14:45:05.188502 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:05.188747 I | rook-ceph-mon2: 2017-07-11 14:45:05.188627 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3704150678' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:05.605726 I | rook-ceph-mon2: 2017-07-11 14:45:05.334218 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1567 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:45:07.220965 I | rook-ceph-mon2: 2017-07-11 14:45:07.220930 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:07.221141 I | rook-ceph-mon2: 2017-07-11 14:45:07.221059 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/458230498' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:07.685362 I | rook-ceph-mon2: 2017-07-11 14:45:07.685324 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:45:07.693266 I | rook-ceph-mon2: 2017-07-11 14:45:07.693244 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/391378516' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:45:09.160940 I | rook-ceph-mon2: 2017-07-11 14:45:09.160907 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:45:09.161117 I | rook-ceph-mon2: 2017-07-11 14:45:09.161042 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/197080977' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:45:12.141193 I | rook-ceph-mon2: 2017-07-11 14:45:12.141158 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:12.141380 I | rook-ceph-mon2: 2017-07-11 14:45:12.141299 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3720394703' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:12.920656 I | rook-ceph-mon2: 2017-07-11 14:45:12.920610 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:45:12.920883 I | rook-ceph-mon2: 2017-07-11 14:45:12.920848 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3475608917' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:45:13.346391 I | rook-ceph-mon2: 2017-07-11 14:45:13.346354 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:13.346590 I | rook-ceph-mon2: 2017-07-11 14:45:13.346505 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3054838849' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:14.203240 I | rook-ceph-mon2: 2017-07-11 14:45:14.203206 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:45:14.203489 I | rook-ceph-mon2: 2017-07-11 14:45:14.203409 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3410181004' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:45:15.067988 I | rook-ceph-mon2: 2017-07-11 14:45:15.067953 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:15.068172 I | rook-ceph-mon2: 2017-07-11 14:45:15.068093 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3380576528' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:17.510424 I | rook-ceph-mon2: 2017-07-11 14:45:17.510373 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:45:17.510634 I | rook-ceph-mon2: 2017-07-11 14:45:17.510551 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/697338952' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:45:21.968138 I | rook-ceph-mon2: 2017-07-11 14:45:21.968102 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:21.968330 I | rook-ceph-mon2: 2017-07-11 14:45:21.968238 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3874071755' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:22.372973 I | rook-ceph-mon2: 2017-07-11 14:45:22.372625 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:45:22.373310 I | rook-ceph-mon2: 2017-07-11 14:45:22.372645 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2273021736' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:45:23.846332 I | rook-ceph-mon2: 2017-07-11 14:45:23.846293 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:45:23.846551 I | rook-ceph-mon2: 2017-07-11 14:45:23.846439 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3222541994' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:45:24.705266 I | rook-ceph-mon2: 2017-07-11 14:45:24.705227 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:24.705516 I | rook-ceph-mon2: 2017-07-11 14:45:24.705473 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2176085416' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:26.535026 I | rook-ceph-mon2: 2017-07-11 14:45:26.534987 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:26.535239 I | rook-ceph-mon2: 2017-07-11 14:45:26.535173 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/237599040' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:28.833812 I | rook-ceph-mon2: 2017-07-11 14:45:28.833777 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:45:28.834049 I | rook-ceph-mon2: 2017-07-11 14:45:28.833917 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1797228701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:45:29.807272 I | rook-ceph-mon2: 2017-07-11 14:45:29.807222 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:29.807466 I | rook-ceph-mon2: 2017-07-11 14:45:29.807443 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/706778485' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:31.415662 I | rook-ceph-mon2: 2017-07-11 14:45:31.415630 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:31.421261 I | rook-ceph-mon2: 2017-07-11 14:45:31.421230 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3675704799' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:31.820802 I | rook-ceph-mon2: 2017-07-11 14:45:31.820768 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:31.820962 I | rook-ceph-mon2: 2017-07-11 14:45:31.820908 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3042429830' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:32.303072 I | rook-ceph-mon2: 2017-07-11 14:45:32.303028 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:45:32.303230 I | rook-ceph-mon2: 2017-07-11 14:45:32.303185 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1179916113' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:45:32.753207 I | rook-ceph-mon2: 2017-07-11 14:45:32.753173 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:32.753340 I | rook-ceph-mon2: 2017-07-11 14:45:32.753301 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/498936921' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:34.511861 I | rook-ceph-mon2: 2017-07-11 14:45:34.511811 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:34.511995 I | rook-ceph-mon2: 2017-07-11 14:45:34.511979 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1097966563' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:36.358804 I | rook-ceph-mon2: 2017-07-11 14:45:36.358774 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:36.358911 I | rook-ceph-mon2: 2017-07-11 14:45:36.358895 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1337318711' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:36.772290 I | rook-ceph-mon2: 2017-07-11 14:45:36.772256 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:36.772493 I | rook-ceph-mon2: 2017-07-11 14:45:36.772408 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4219634851' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:37.332825 I | rook-ceph-mon2: 2017-07-11 14:45:37.332790 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:45:37.333011 I | rook-ceph-mon2: 2017-07-11 14:45:37.332932 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2224250866' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:45:37.780796 I | rook-ceph-mon2: 2017-07-11 14:45:37.780760 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:37.781034 I | rook-ceph-mon2: 2017-07-11 14:45:37.780927 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/837754077' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:38.651790 I | rook-ceph-mon2: 2017-07-11 14:45:38.651756 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:45:38.651978 I | rook-ceph-mon2: 2017-07-11 14:45:38.651897 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3327883841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:45:39.718394 I | rook-ceph-mon2: 2017-07-11 14:45:39.718362 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:39.718605 I | rook-ceph-mon2: 2017-07-11 14:45:39.718521 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3878402377' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:41.696129 I | rook-ceph-mon2: 2017-07-11 14:45:41.696095 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:41.696605 I | rook-ceph-mon2: 2017-07-11 14:45:41.696581 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2896067587' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:42.127910 I | rook-ceph-mon2: 2017-07-11 14:45:42.127872 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:45:42.128127 I | rook-ceph-mon2: 2017-07-11 14:45:42.128041 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4207103005' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:45:42.556176 I | rook-ceph-mon2: 2017-07-11 14:45:42.556140 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:42.556368 I | rook-ceph-mon2: 2017-07-11 14:45:42.556283 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/972849402' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:44.590042 I | rook-ceph-mon2: 2017-07-11 14:45:44.590008 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:44.590251 I | rook-ceph-mon2: 2017-07-11 14:45:44.590141 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1077766954' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:46.255268 I | rook-ceph-mon2: 2017-07-11 14:45:46.255233 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:46.255476 I | rook-ceph-mon2: 2017-07-11 14:45:46.255377 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3377999913' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:47.481186 I | rook-ceph-mon2: 2017-07-11 14:45:47.481150 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:47.481373 I | rook-ceph-mon2: 2017-07-11 14:45:47.481292 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1436556371' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:51.189303 I | rook-ceph-mon2: 2017-07-11 14:45:51.189257 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:51.189557 I | rook-ceph-mon2: 2017-07-11 14:45:51.189516 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2094496068' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:51.631085 I | rook-ceph-mon2: 2017-07-11 14:45:51.631051 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:51.631284 I | rook-ceph-mon2: 2017-07-11 14:45:51.631184 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2420864326' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:54.658034 I | rook-ceph-mon2: 2017-07-11 14:45:54.657988 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:45:54.658260 I | rook-ceph-mon2: 2017-07-11 14:45:54.658173 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2916200059' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:45:56.574032 I | rook-ceph-mon2: 2017-07-11 14:45:56.573999 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:45:56.574216 I | rook-ceph-mon2: 2017-07-11 14:45:56.574134 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1760209995' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:45:57.009301 I | rook-ceph-mon2: 2017-07-11 14:45:57.009244 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:45:57.009545 I | rook-ceph-mon2: 2017-07-11 14:45:57.009528 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/621470660' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:45:58.159505 I | rook-ceph-mon2: 2017-07-11 14:45:58.159087 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4921 MB, avail 94265 MB
- 2017-07-11 14:45:58.178879 I | rook-ceph-mon2: 2017-07-11 14:45:58.178844 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:45:58.179036 I | rook-ceph-mon2: 2017-07-11 14:45:58.178958 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/543241818' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:45:58.598831 I | rook-ceph-mon2: 2017-07-11 14:45:58.598798 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:45:58.598954 I | rook-ceph-mon2: 2017-07-11 14:45:58.598939 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3208436289' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:46:01.114970 I | rook-ceph-mon2: 2017-07-11 14:46:01.114940 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:01.115153 I | rook-ceph-mon2: 2017-07-11 14:46:01.115064 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3830471450' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:02.464910 I | rook-ceph-mon2: 2017-07-11 14:46:02.464876 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:02.465087 I | rook-ceph-mon2: 2017-07-11 14:46:02.465012 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2345380682' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:03.369361 I | rook-ceph-mon2: 2017-07-11 14:46:03.369257 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:46:03.369447 I | rook-ceph-mon2: 2017-07-11 14:46:03.369286 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3887457836' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:46:04.277248 I | rook-ceph-mon2: 2017-07-11 14:46:04.277185 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:04.277500 I | rook-ceph-mon2: 2017-07-11 14:46:04.277357 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/621962447' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:06.387368 I | rook-ceph-mon2: 2017-07-11 14:46:06.387327 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:06.387568 I | rook-ceph-mon2: 2017-07-11 14:46:06.387490 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3753013900' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:06.721245 I | rook-ceph-mon2: 2017-07-11 14:46:06.721196 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:46:06.721431 I | rook-ceph-mon2: 2017-07-11 14:46:06.721350 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4079250646' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:46:08.157200 I | rook-ceph-mon2: 2017-07-11 14:46:08.157153 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:46:08.163150 I | rook-ceph-mon2: 2017-07-11 14:46:08.163087 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3909521388' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:46:10.917321 I | rook-ceph-mon2: 2017-07-11 14:46:10.917247 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:10.917511 I | rook-ceph-mon2: 2017-07-11 14:46:10.917424 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2385834083' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:11.341126 I | rook-ceph-mon2: 2017-07-11 14:46:11.341092 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:11.341232 I | rook-ceph-mon2: 2017-07-11 14:46:11.341218 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2328452846' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:11.768175 I | rook-ceph-mon2: 2017-07-11 14:46:11.768141 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:46:11.768524 I | rook-ceph-mon2: 2017-07-11 14:46:11.768474 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2096830639' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:46:13.173057 I | rook-ceph-mon2: 2017-07-11 14:46:13.173022 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:46:13.173249 I | rook-ceph-mon2: 2017-07-11 14:46:13.173164 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/670680089' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:46:14.124265 I | rook-ceph-mon2: 2017-07-11 14:46:14.124229 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:14.124452 I | rook-ceph-mon2: 2017-07-11 14:46:14.124369 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1896746293' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:15.845544 I | rook-ceph-mon2: 2017-07-11 14:46:15.845512 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:15.845649 I | rook-ceph-mon2: 2017-07-11 14:46:15.845634 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3782100764' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:16.781208 I | rook-ceph-mon2: 2017-07-11 14:46:16.781182 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:46:16.781357 I | rook-ceph-mon2: 2017-07-11 14:46:16.781296 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2191240148' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:46:16.947931 I | rook-ceph-mon2: 2017-07-11 14:46:16.947896 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:16.951178 I | rook-ceph-mon2: 2017-07-11 14:46:16.951159 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2819498324' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:17.278010 I | rook-ceph-mon2: 2017-07-11 14:46:17.277974 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:17.278183 I | rook-ceph-mon2: 2017-07-11 14:46:17.278106 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2679951907' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:20.387666 I | rook-ceph-mon2: 2017-07-11 14:46:20.387631 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:46:20.387842 I | rook-ceph-mon2: 2017-07-11 14:46:20.387826 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1400636211' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:46:21.706434 I | rook-ceph-mon2: 2017-07-11 14:46:21.706407 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:46:21.706534 I | rook-ceph-mon2: 2017-07-11 14:46:21.706520 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2027991178' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:46:23.122007 I | rook-ceph-mon2: 2017-07-11 14:46:23.121948 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:46:23.122246 I | rook-ceph-mon2: 2017-07-11 14:46:23.122228 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2430424408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:46:26.611603 I | rook-ceph-mon2: 2017-07-11 14:46:26.611560 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:46:26.611740 I | rook-ceph-mon2: 2017-07-11 14:46:26.611725 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3759678834' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:46:27.091346 I | rook-ceph-mon2: 2017-07-11 14:46:27.091313 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:27.091458 I | rook-ceph-mon2: 2017-07-11 14:46:27.091442 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4241040314' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:29.411012 I | rook-ceph-mon2: 2017-07-11 14:46:29.410977 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:29.411254 I | rook-ceph-mon2: 2017-07-11 14:46:29.411215 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2684494693' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:30.676050 I | rook-ceph-mon2: 2017-07-11 14:46:30.676011 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:30.676156 I | rook-ceph-mon2: 2017-07-11 14:46:30.676140 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2432435735' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:31.114234 I | rook-ceph-mon2: 2017-07-11 14:46:31.113324 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:31.114308 I | rook-ceph-mon2: 2017-07-11 14:46:31.113360 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4149636864' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:31.948194 I | rook-ceph-mon2: 2017-07-11 14:46:31.948160 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:31.948385 I | rook-ceph-mon2: 2017-07-11 14:46:31.948288 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1514026592' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:35.602322 I | rook-ceph-mon2: 2017-07-11 14:46:35.602288 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:35.602559 I | rook-ceph-mon2: 2017-07-11 14:46:35.602519 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/36858740' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:38.954419 I | rook-ceph-mon2: 2017-07-11 14:46:38.954383 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:38.954600 I | rook-ceph-mon2: 2017-07-11 14:46:38.954514 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2225971143' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:40.565251 I | rook-ceph-mon2: 2017-07-11 14:46:40.565220 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:40.565352 I | rook-ceph-mon2: 2017-07-11 14:46:40.565337 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2625306933' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:41.413387 I | rook-ceph-mon2: 2017-07-11 14:46:41.413020 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:46:41.413425 I | rook-ceph-mon2: 2017-07-11 14:46:41.413038 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1686009755' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:46:43.090904 I | rook-ceph-mon2: 2017-07-11 14:46:43.090867 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:46:43.091095 I | rook-ceph-mon2: 2017-07-11 14:46:43.091013 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/558980291' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:46:44.141829 I | rook-ceph-mon2: 2017-07-11 14:46:44.141795 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:44.142008 I | rook-ceph-mon2: 2017-07-11 14:46:44.141930 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3510926251' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:45.621732 I | rook-ceph-mon2: 2017-07-11 14:46:45.621698 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:45.621928 I | rook-ceph-mon2: 2017-07-11 14:46:45.621911 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/299487784' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:46.088975 I | rook-ceph-mon2: 2017-07-11 14:46:46.088650 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:46.089065 I | rook-ceph-mon2: 2017-07-11 14:46:46.088671 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3112795516' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:46.479281 I | rook-ceph-mon2: 2017-07-11 14:46:46.479246 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:46:46.479492 I | rook-ceph-mon2: 2017-07-11 14:46:46.479461 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/463047863' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:46:48.840337 I | rook-ceph-mon2: 2017-07-11 14:46:48.840302 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:48.840582 I | rook-ceph-mon2: 2017-07-11 14:46:48.840553 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1474550232' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:50.373776 I | rook-ceph-mon2: 2017-07-11 14:46:50.373707 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:50.373875 I | rook-ceph-mon2: 2017-07-11 14:46:50.373860 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2270900011' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:51.452575 I | rook-ceph-mon2: 2017-07-11 14:46:51.452544 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:46:51.452770 I | rook-ceph-mon2: 2017-07-11 14:46:51.452677 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3299488321' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:46:51.928219 I | rook-ceph-mon2: 2017-07-11 14:46:51.927821 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:51.928503 I | rook-ceph-mon2: 2017-07-11 14:46:51.927837 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4017347038' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:55.515627 I | rook-ceph-mon2: 2017-07-11 14:46:55.515593 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:55.515861 I | rook-ceph-mon2: 2017-07-11 14:46:55.515745 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4096300288' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:46:56.287648 I | rook-ceph-mon2: 2017-07-11 14:46:56.287616 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:56.287825 I | rook-ceph-mon2: 2017-07-11 14:46:56.287744 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2209523864' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:56.698765 I | rook-ceph-mon2: 2017-07-11 14:46:56.698728 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:46:56.698949 I | rook-ceph-mon2: 2017-07-11 14:46:56.698870 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2077677317' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:46:57.229583 I | rook-ceph-mon2: 2017-07-11 14:46:57.229553 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:46:57.229762 I | rook-ceph-mon2: 2017-07-11 14:46:57.229681 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3420540180' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:46:58.165881 I | rook-ceph-mon2: 2017-07-11 14:46:58.165619 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4921 MB, avail 94265 MB
- 2017-07-11 14:46:59.353385 I | rook-ceph-mon2: 2017-07-11 14:46:59.353340 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:46:59.353674 I | rook-ceph-mon2: 2017-07-11 14:46:59.353654 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2534297182' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:00.711637 I | rook-ceph-mon2: 2017-07-11 14:47:00.711592 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:00.711830 I | rook-ceph-mon2: 2017-07-11 14:47:00.711752 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2704320515' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:01.249562 I | rook-ceph-mon2: 2017-07-11 14:47:01.249531 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:47:01.249745 I | rook-ceph-mon2: 2017-07-11 14:47:01.249658 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2676179169' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:47:01.653781 I | rook-ceph-mon2: 2017-07-11 14:47:01.653633 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:01.653852 I | rook-ceph-mon2: 2017-07-11 14:47:01.653655 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3263691328' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:05.497398 I | rook-ceph-mon2: 2017-07-11 14:47:05.497352 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:05.497576 I | rook-ceph-mon2: 2017-07-11 14:47:05.497499 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3698401555' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:05.931989 I | rook-ceph-mon2: 2017-07-11 14:47:05.931956 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:05.932174 I | rook-ceph-mon2: 2017-07-11 14:47:05.932092 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1699017500' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:06.860668 I | rook-ceph-mon2: 2017-07-11 14:47:06.860634 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:06.860782 I | rook-ceph-mon2: 2017-07-11 14:47:06.860761 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2326915433' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:07.692291 I | rook-ceph-mon2: 2017-07-11 14:47:07.692196 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #104. Immutable memtables: 0.
- 2017-07-11 14:47:07.692383 I | rook-ceph-mon2:
- 2017-07-11 14:47:07.692422 I | rook-ceph-mon2: 2017-07-11 14:47:07.692244 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 66] Syncing log #101
- 2017-07-11 14:47:07.731965 I | rook-ceph-mon2: 2017-07-11 14:47:07.723865 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:47:07.692239) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:47:07.732044 I | rook-ceph-mon2: 2017-07-11 14:47:07.723875 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 66] Flushing memtable with next log file: 104
- 2017-07-11 14:47:07.732079 I | rook-ceph-mon2:
- 2017-07-11 14:47:07.732095 I | rook-ceph-mon2: 2017-07-11 14:47:07.723892 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784427723888, "job": 66, "event": "flush_started", "num_memtables": 1, "num_entries": 2311, "num_deletes": 251, "memory_usage": 7653664}
- 2017-07-11 14:47:07.732108 I | rook-ceph-mon2: 2017-07-11 14:47:07.723894 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 66] Level-0 flush table #105: started
- 2017-07-11 14:47:07.877089 I | rook-ceph-mon2: 2017-07-11 14:47:07.877035 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784427877024, "cf_name": "default", "job": 66, "event": "table_file_creation", "file_number": 105, "file_size": 5058867, "table_properties": {"data_size": 5041332, "index_size": 16715, "filter_size": 0, "raw_key_size": 17110, "raw_average_key_size": 18, "raw_value_size": 5017131, "raw_average_value_size": 5507, "num_data_blocks": 523, "num_entries": 911, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:47:07.877195 I | rook-ceph-mon2: 2017-07-11 14:47:07.877177 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 66] Level-0 flush table #105: 5058867 bytes OK
- 2017-07-11 14:47:07.936999 I | rook-ceph-mon2: 2017-07-11 14:47:07.936964 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:47:07.905686) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #105 started
- 2017-07-11 14:47:07.937226 I | rook-ceph-mon2: 2017-07-11 14:47:07.937208 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:47:07.936914) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #105: memtable #1 done
- 2017-07-11 14:47:07.937392 I | rook-ceph-mon2: 2017-07-11 14:47:07.937374 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:47:07.936932) EVENT_LOG_v1 {"time_micros": 1499784427936927, "job": 66, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:47:07.937435 I | rook-ceph-mon2: 2017-07-11 14:47:07.937420 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:47:07.936948) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:47:07.937562 I | rook-ceph-mon2:
- 2017-07-11 14:47:07.937596 I | rook-ceph-mon2: 2017-07-11 14:47:07.937582 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 66] Try to delete WAL files size 7604834, prev total WAL file size 7604834, number of live WAL files 2.
- 2017-07-11 14:47:07.937733 I | rook-ceph-mon2:
- 2017-07-11 14:47:07.944413 I | rook-ceph-mon2: 2017-07-11 14:47:07.938815 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:47:07.944499 I | rook-ceph-mon2: 2017-07-11 14:47:07.938965 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:47:07.944517 I | rook-ceph-mon2: 2017-07-11 14:47:07.938968 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:47:07.944530 I | rook-ceph-mon2: ** DB Stats **
- 2017-07-11 14:47:07.944542 I | rook-ceph-mon2: Uptime(secs): 4990.7 total, 795.7 interval
- 2017-07-11 14:47:07.944553 I | rook-ceph-mon2: Cumulative writes: 9166 writes, 44K keys, 9166 commit groups, 1.0 writes per commit group, ingest: 0.12 GB, 0.03 MB/s
- 2017-07-11 14:47:07.944564 I | rook-ceph-mon2: Cumulative WAL: 9166 writes, 9166 syncs, 1.00 writes per sync, written: 0.12 GB, 0.03 MB/s
- 2017-07-11 14:47:07.944577 I | rook-ceph-mon2: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:47:07.944588 I | rook-ceph-mon2: Interval writes: 2008 writes, 10K keys, 2008 commit groups, 1.0 writes per commit group, ingest: 28.94 MB, 0.04 MB/s
- 2017-07-11 14:47:07.944599 I | rook-ceph-mon2: Interval WAL: 2008 writes, 2008 syncs, 1.00 writes per sync, written: 0.03 MB, 0.04 MB/s
- 2017-07-11 14:47:07.944610 I | rook-ceph-mon2: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:47:07.944620 I | rook-ceph-mon2:
- 2017-07-11 14:47:07.944631 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 14:47:07.944642 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:47:07.944653 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:47:07.944669 I | rook-ceph-mon2: L0 1/1 4.82 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 15.7 5 34 0.143 0 0
- 2017-07-11 14:47:07.944681 I | rook-ceph-mon2: L1 1/1 12.70 MB 0.0 0.5 0.1 0.4 0.4 0.0 0.0 5.7 45.2 39.5 10 31 0.330 76K 16K
- 2017-07-11 14:47:07.944692 I | rook-ceph-mon2: Sum 2/2 17.52 MB 0.0 0.5 0.1 0.4 0.5 0.1 0.0 6.3 30.7 31.8 15 65 0.232 76K 16K
- 2017-07-11 14:47:07.944703 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 6.2 38.5 39.2 3 14 0.215 19K 4534
- 2017-07-11 14:47:07.944713 I | rook-ceph-mon2: Uptime(secs): 4990.7 total, 4990.7 interval
- 2017-07-11 14:47:07.944724 I | rook-ceph-mon2: Flush(GB): cumulative 0.074, interval 0.018
- 2017-07-11 14:47:07.944735 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:47:07.944745 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:47:07.944755 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:47:07.944766 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:47:07.944777 I | rook-ceph-mon2: Cumulative compaction: 0.47 GB write, 0.10 MB/s write, 0.45 GB read, 0.09 MB/s read, 15.1 seconds
- 2017-07-11 14:47:07.944788 I | rook-ceph-mon2: Interval compaction: 0.12 GB write, 0.02 MB/s write, 0.11 GB read, 0.02 MB/s read, 3.0 seconds
- 2017-07-11 14:47:07.944800 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:47:07.944811 I | rook-ceph-mon2:
- 2017-07-11 14:47:07.944822 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:47:07.944837 I | rook-ceph-mon2:
- 2017-07-11 14:47:07.944848 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 14:47:07.944859 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:47:07.944870 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:47:07.944880 I | rook-ceph-mon2: L0 1/1 4.82 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 15.7 5 34 0.143 0 0
- 2017-07-11 14:47:07.944891 I | rook-ceph-mon2: L1 1/1 12.70 MB 0.0 0.5 0.1 0.4 0.4 0.0 0.0 5.7 45.2 39.5 10 31 0.330 76K 16K
- 2017-07-11 14:47:07.944902 I | rook-ceph-mon2: Sum 2/2 17.52 MB 0.0 0.5 0.1 0.4 0.5 0.1 0.0 6.3 30.7 31.8 15 65 0.232 76K 16K
- 2017-07-11 14:47:07.944912 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:47:07.944923 I | rook-ceph-mon2: Uptime(secs): 4990.7 total, 4990.7 interval
- 2017-07-11 14:47:07.944933 I | rook-ceph-mon2: Flush(GB): cumulative 0.074, interval 0.000
- 2017-07-11 14:47:07.944944 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:47:07.944955 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:47:07.944965 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:47:07.944976 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:47:07.944994 I | rook-ceph-mon2: Cumulative compaction: 0.47 GB write, 0.10 MB/s write, 0.45 GB read, 0.09 MB/s read, 15.1 seconds
- 2017-07-11 14:47:07.945005 I | rook-ceph-mon2: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:47:07.945016 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:47:07.945026 I | rook-ceph-mon2:
- 2017-07-11 14:47:07.945037 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:47:07.945047 I | rook-ceph-mon2:
- 2017-07-11 14:47:07.945058 I | rook-ceph-mon2: 2017-07-11 14:47:07.938983 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:47:07.938978) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:47:07.945069 I | rook-ceph-mon2:
- 2017-07-11 14:47:07.945079 I | rook-ceph-mon2: 2017-07-11 14:47:07.938987 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 67] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:47:07.945093 I | rook-ceph-mon2: 2017-07-11 14:47:07.938990 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 66 Base level 0, inputs: [105(4940KB)], [103(12MB)]
- 2017-07-11 14:47:07.945105 I | rook-ceph-mon2:
- 2017-07-11 14:47:07.945116 I | rook-ceph-mon2: 2017-07-11 14:47:07.939000 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784427938992, "job": 67, "event": "compaction_started", "files_L0": [105], "files_L1": [103], "score": -1, "input_data_size": 18376271}
- 2017-07-11 14:47:07.952008 I | rook-ceph-mon2: 2017-07-11 14:47:07.951779 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:47:07.952043 I | rook-ceph-mon2: 2017-07-11 14:47:07.951803 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2839073341' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:47:08.163737 I | rook-ceph-mon2: 2017-07-11 14:47:08.163684 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 67] Generated table #106: 2356 keys, 15830607 bytes
- 2017-07-11 14:47:08.170897 I | rook-ceph-mon2: 2017-07-11 14:47:08.170834 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784428170816, "cf_name": "default", "job": 67, "event": "table_file_creation", "file_number": 106, "file_size": 15830607, "table_properties": {"data_size": 15777303, "index_size": 52485, "filter_size": 0, "raw_key_size": 45569, "raw_average_key_size": 19, "raw_value_size": 15707614, "raw_average_value_size": 6667, "num_data_blocks": 1596, "num_entries": 2356, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:47:08.218969 I | rook-ceph-mon2: 2017-07-11 14:47:08.218914 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 67] Compacted 1@0 + 1@1 files to L1 => 15830607 bytes
- 2017-07-11 14:47:08.256573 I | rook-ceph-mon2: 2017-07-11 14:47:08.256536 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.256436) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 65.7 rd, 56.6 wr, level 1, files in(1, 1) out(1) MB in(4.8, 12.7) out(15.1), read-write-amplify(6.8) write-amplify(3.1) OK, records in: 2865, records dropped: 509
- 2017-07-11 14:47:08.256637 I | rook-ceph-mon2:
- 2017-07-11 14:47:08.256675 I | rook-ceph-mon2: 2017-07-11 14:47:08.256657 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:47:08.256457) EVENT_LOG_v1 {"time_micros": 1499784428256448, "job": 67, "event": "compaction_finished", "compaction_time_micros": 279896, "output_level": 1, "num_output_files": 1, "total_output_size": 15830607, "num_input_records": 2865, "num_output_records": 2356, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:47:08.257472 I | rook-ceph-mon2: 2017-07-11 14:47:08.257457 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784428257454, "job": 67, "event": "table_file_deletion", "file_number": 105}
- 2017-07-11 14:47:08.259385 I | rook-ceph-mon2: 2017-07-11 14:47:08.259369 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784428259366, "job": 67, "event": "table_file_deletion", "file_number": 103}
- 2017-07-11 14:47:09.002198 I | rook-ceph-mon2: 2017-07-11 14:47:09.002164 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:09.002307 I | rook-ceph-mon2: 2017-07-11 14:47:09.002291 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2363405825' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:10.106532 I | rook-ceph-mon2: 2017-07-11 14:47:10.106499 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:10.106639 I | rook-ceph-mon2: 2017-07-11 14:47:10.106623 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2376408071' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:10.590084 I | rook-ceph-mon2: 2017-07-11 14:47:10.590040 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:10.596039 I | rook-ceph-mon2: 2017-07-11 14:47:10.596017 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1806825715' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:11.026522 I | rook-ceph-mon2: 2017-07-11 14:47:11.026488 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:47:11.026659 I | rook-ceph-mon2: 2017-07-11 14:47:11.026617 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/200433284' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:47:12.403050 I | rook-ceph-mon2: 2017-07-11 14:47:12.403015 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:47:12.403270 I | rook-ceph-mon2: 2017-07-11 14:47:12.403240 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/992025865' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:47:13.343015 I | rook-ceph-mon2: 2017-07-11 14:47:13.342980 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:13.343210 I | rook-ceph-mon2: 2017-07-11 14:47:13.343122 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2750806459' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:15.698205 I | rook-ceph-mon2: 2017-07-11 14:47:15.698165 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:15.698475 I | rook-ceph-mon2: 2017-07-11 14:47:15.698410 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/804860683' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:16.172634 I | rook-ceph-mon2: 2017-07-11 14:47:16.172600 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:47:16.172846 I | rook-ceph-mon2: 2017-07-11 14:47:16.172812 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2541272682' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:47:20.489225 I | rook-ceph-mon2: 2017-07-11 14:47:20.489190 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:20.489449 I | rook-ceph-mon2: 2017-07-11 14:47:20.489422 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4058865815' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:22.285841 I | rook-ceph-mon2: 2017-07-11 14:47:22.285805 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:47:22.286053 I | rook-ceph-mon2: 2017-07-11 14:47:22.285947 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2420048501' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:47:23.200152 I | rook-ceph-mon2: 2017-07-11 14:47:23.200118 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:23.200334 I | rook-ceph-mon2: 2017-07-11 14:47:23.200248 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1575308211' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:24.995628 I | rook-ceph-mon2: 2017-07-11 14:47:24.995598 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:24.995820 I | rook-ceph-mon2: 2017-07-11 14:47:24.995732 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3513763987' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:25.595416 I | rook-ceph-mon2: 2017-07-11 14:47:25.595383 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:25.595599 I | rook-ceph-mon2: 2017-07-11 14:47:25.595521 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3430399440' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:27.457521 I | rook-ceph-mon2: 2017-07-11 14:47:27.457489 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:47:27.463424 I | rook-ceph-mon2: 2017-07-11 14:47:27.463406 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3301638349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:47:28.510245 I | rook-ceph-mon2: 2017-07-11 14:47:28.510209 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:28.510490 I | rook-ceph-mon2: 2017-07-11 14:47:28.510471 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2773677710' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:29.865438 I | rook-ceph-mon2: 2017-07-11 14:47:29.865403 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:29.865684 I | rook-ceph-mon2: 2017-07-11 14:47:29.865546 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2078443532' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:30.337128 I | rook-ceph-mon2: 2017-07-11 14:47:30.337093 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:30.337348 I | rook-ceph-mon2: 2017-07-11 14:47:30.337321 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1346996141' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:31.253586 I | rook-ceph-mon2: 2017-07-11 14:47:31.253542 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:31.253773 I | rook-ceph-mon2: 2017-07-11 14:47:31.253689 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2630517907' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:32.147572 I | rook-ceph-mon2: 2017-07-11 14:47:32.147540 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:47:32.147765 I | rook-ceph-mon2: 2017-07-11 14:47:32.147670 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/922543329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:47:33.077516 I | rook-ceph-mon2: 2017-07-11 14:47:33.077471 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:33.077626 I | rook-ceph-mon2: 2017-07-11 14:47:33.077610 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/345507132' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:34.710595 I | rook-ceph-mon2: 2017-07-11 14:47:34.710564 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:34.710812 I | rook-ceph-mon2: 2017-07-11 14:47:34.710699 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4079593676' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:35.383227 I | rook-ceph-mon2: 2017-07-11 14:47:35.383183 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:35.383462 I | rook-ceph-mon2: 2017-07-11 14:47:35.383334 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2489375031' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:35.865396 I | rook-ceph-mon2: 2017-07-11 14:47:35.865358 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:47:35.865589 I | rook-ceph-mon2: 2017-07-11 14:47:35.865503 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3118720587' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:47:36.341129 I | rook-ceph-mon2: 2017-07-11 14:47:36.341078 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:36.341318 I | rook-ceph-mon2: 2017-07-11 14:47:36.341235 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1865405251' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:38.361050 I | rook-ceph-mon2: 2017-07-11 14:47:38.361015 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:38.361308 I | rook-ceph-mon2: 2017-07-11 14:47:38.361259 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3405154561' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:39.635300 I | rook-ceph-mon2: 2017-07-11 14:47:39.635265 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:39.635479 I | rook-ceph-mon2: 2017-07-11 14:47:39.635398 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/692618885' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:40.534453 I | rook-ceph-mon2: 2017-07-11 14:47:40.534418 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:47:40.534672 I | rook-ceph-mon2: 2017-07-11 14:47:40.534591 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/86096151' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:47:42.990062 I | rook-ceph-mon2: 2017-07-11 14:47:42.990027 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:42.990238 I | rook-ceph-mon2: 2017-07-11 14:47:42.990160 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2795621146' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:45.019032 I | rook-ceph-mon2: 2017-07-11 14:47:45.018997 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:45.019314 I | rook-ceph-mon2: 2017-07-11 14:47:45.019138 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/484170224' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:46.963200 I | rook-ceph-mon2: 2017-07-11 14:47:46.963144 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:47:46.963435 I | rook-ceph-mon2: 2017-07-11 14:47:46.963418 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3815588223' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:47:48.282223 I | rook-ceph-mon2: 2017-07-11 14:47:48.276499 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:48.282452 I | rook-ceph-mon2: 2017-07-11 14:47:48.282418 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/500411837' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:49.529005 I | rook-ceph-mon2: 2017-07-11 14:47:49.528975 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:49.529190 I | rook-ceph-mon2: 2017-07-11 14:47:49.529100 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/600530392' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:50.903251 I | rook-ceph-mon2: 2017-07-11 14:47:50.903217 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:50.903471 I | rook-ceph-mon2: 2017-07-11 14:47:50.903384 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4200844064' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:51.836793 I | rook-ceph-mon2: 2017-07-11 14:47:51.836727 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:47:51.836979 I | rook-ceph-mon2: 2017-07-11 14:47:51.836904 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/420077246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:47:54.462060 I | rook-ceph-mon2: 2017-07-11 14:47:54.462027 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:54.462260 I | rook-ceph-mon2: 2017-07-11 14:47:54.462177 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2771018709' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:55.587233 I | rook-ceph-mon2: 2017-07-11 14:47:55.587064 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:47:55.587343 I | rook-ceph-mon2: 2017-07-11 14:47:55.587084 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/706183030' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:47:56.058851 I | rook-ceph-mon2: 2017-07-11 14:47:56.058817 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:56.059080 I | rook-ceph-mon2: 2017-07-11 14:47:56.059031 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/396303299' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:47:57.016722 I | rook-ceph-mon2: 2017-07-11 14:47:57.016687 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:47:57.016915 I | rook-ceph-mon2: 2017-07-11 14:47:57.016896 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/125381807' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:47:58.167503 I | rook-ceph-mon2: 2017-07-11 14:47:58.167182 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4924 MB, avail 94262 MB
- 2017-07-11 14:47:58.227994 I | rook-ceph-mon2: 2017-07-11 14:47:58.227944 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:58.228217 I | rook-ceph-mon2: 2017-07-11 14:47:58.228080 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/902596112' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:59.364496 I | rook-ceph-mon2: 2017-07-11 14:47:59.364452 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:47:59.364737 I | rook-ceph-mon2: 2017-07-11 14:47:59.364613 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2772487408' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:47:59.801829 I | rook-ceph-mon2: 2017-07-11 14:47:59.801795 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:47:59.802069 I | rook-ceph-mon2: 2017-07-11 14:47:59.801933 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3965803195' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:00.710483 I | rook-ceph-mon2: 2017-07-11 14:48:00.710449 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:00.710668 I | rook-ceph-mon2: 2017-07-11 14:48:00.710585 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/410837450' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:01.561099 I | rook-ceph-mon2: 2017-07-11 14:48:01.561068 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:48:01.561264 I | rook-ceph-mon2: 2017-07-11 14:48:01.561196 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3853137945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:48:02.486222 I | rook-ceph-mon2: 2017-07-11 14:48:02.486189 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:02.486406 I | rook-ceph-mon2: 2017-07-11 14:48:02.486327 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/548387085' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:04.676670 I | rook-ceph-mon2: 2017-07-11 14:48:04.676637 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:04.676878 I | rook-ceph-mon2: 2017-07-11 14:48:04.676771 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1692109409' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:05.190848 I | rook-ceph-mon2: 2017-07-11 14:48:05.190817 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:48:05.190952 I | rook-ceph-mon2: 2017-07-11 14:48:05.190937 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3356352942' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:48:05.790606 I | rook-ceph-mon2: 2017-07-11 14:48:05.790560 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:05.790788 I | rook-ceph-mon2: 2017-07-11 14:48:05.790702 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3113502425' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:06.680862 I | rook-ceph-mon2: 2017-07-11 14:48:06.680827 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:48:06.681056 I | rook-ceph-mon2: 2017-07-11 14:48:06.680972 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1685148964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:48:07.621566 I | rook-ceph-mon2: 2017-07-11 14:48:07.621531 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:07.621674 I | rook-ceph-mon2: 2017-07-11 14:48:07.621659 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/711522634' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:09.687572 I | rook-ceph-mon2: 2017-07-11 14:48:09.687532 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:09.687708 I | rook-ceph-mon2: 2017-07-11 14:48:09.687692 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1962376211' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:10.171993 I | rook-ceph-mon2: 2017-07-11 14:48:10.171960 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:48:10.172181 I | rook-ceph-mon2: 2017-07-11 14:48:10.172083 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3880809361' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:48:12.695349 I | rook-ceph-mon2: 2017-07-11 14:48:12.695311 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:12.695593 I | rook-ceph-mon2: 2017-07-11 14:48:12.695575 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/855289183' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:14.537612 I | rook-ceph-mon2: 2017-07-11 14:48:14.537578 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:14.537881 I | rook-ceph-mon2: 2017-07-11 14:48:14.537864 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1737603399' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:15.030553 I | rook-ceph-mon2: 2017-07-11 14:48:15.030518 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:48:15.030681 I | rook-ceph-mon2: 2017-07-11 14:48:15.030645 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3125100025' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:48:15.630478 I | rook-ceph-mon2: 2017-07-11 14:48:15.630444 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:15.636494 I | rook-ceph-mon2: 2017-07-11 14:48:15.630669 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3004928369' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:18.928378 I | rook-ceph-mon2: 2017-07-11 14:48:18.928331 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:18.928560 I | rook-ceph-mon2: 2017-07-11 14:48:18.928474 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/861611976' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:19.051441 I | rook-ceph-mon2: 2017-07-11 14:48:19.051347 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:19.051638 I | rook-ceph-mon2: 2017-07-11 14:48:19.051549 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3973551362' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:19.963542 I | rook-ceph-mon2: 2017-07-11 14:48:19.963491 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:48:19.963854 I | rook-ceph-mon2: 2017-07-11 14:48:19.963674 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2299636493' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:48:20.407862 I | rook-ceph-mon2: 2017-07-11 14:48:20.407830 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:20.408032 I | rook-ceph-mon2: 2017-07-11 14:48:20.407958 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/170952684' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:21.436901 I | rook-ceph-mon2: 2017-07-11 14:48:21.436867 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:48:21.437133 I | rook-ceph-mon2: 2017-07-11 14:48:21.437116 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/304078519' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:48:22.302206 I | rook-ceph-mon2: 2017-07-11 14:48:22.302172 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:22.308218 I | rook-ceph-mon2: 2017-07-11 14:48:22.302372 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4246480588' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:24.937636 I | rook-ceph-mon2: 2017-07-11 14:48:24.937603 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:48:24.937737 I | rook-ceph-mon2: 2017-07-11 14:48:24.937723 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/717273502' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:48:26.575736 I | rook-ceph-mon2: 2017-07-11 14:48:26.575245 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:48:26.576087 I | rook-ceph-mon2: 2017-07-11 14:48:26.575287 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3755289344' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:48:30.521807 I | rook-ceph-mon2: 2017-07-11 14:48:30.521774 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:30.522027 I | rook-ceph-mon2: 2017-07-11 14:48:30.521907 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1637448473' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:32.337789 I | rook-ceph-mon2: 2017-07-11 14:48:32.337746 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:32.338020 I | rook-ceph-mon2: 2017-07-11 14:48:32.337977 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1116828933' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:34.842961 I | rook-ceph-mon2: 2017-07-11 14:48:34.842929 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:48:34.843183 I | rook-ceph-mon2: 2017-07-11 14:48:34.843050 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/476754552' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:48:35.517265 I | rook-ceph-mon2: 2017-07-11 14:48:35.517229 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:35.517490 I | rook-ceph-mon2: 2017-07-11 14:48:35.517448 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/92646312' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:36.420268 I | rook-ceph-mon2: 2017-07-11 14:48:36.420005 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:48:36.420398 I | rook-ceph-mon2: 2017-07-11 14:48:36.420030 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2271260600' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:48:37.268491 I | rook-ceph-mon2: 2017-07-11 14:48:37.268458 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:37.268609 I | rook-ceph-mon2: 2017-07-11 14:48:37.268594 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1861951822' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:37.622846 I | rook-ceph-mon2: 2017-07-11 14:48:37.622807 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:48:37.632784 I | rook-ceph-mon2: 2017-07-11 14:48:37.625602 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2926457526' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:48:39.221134 I | rook-ceph-mon2: 2017-07-11 14:48:39.221099 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:39.221316 I | rook-ceph-mon2: 2017-07-11 14:48:39.221238 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3249278979' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:41.324106 I | rook-ceph-mon2: 2017-07-11 14:48:41.324071 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:48:41.324295 I | rook-ceph-mon2: 2017-07-11 14:48:41.324216 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1569867241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:48:42.159996 I | rook-ceph-mon2: 2017-07-11 14:48:42.159963 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:42.160122 I | rook-ceph-mon2: 2017-07-11 14:48:42.160107 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/700327521' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:44.086973 I | rook-ceph-mon2: 2017-07-11 14:48:44.086940 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:44.087182 I | rook-ceph-mon2: 2017-07-11 14:48:44.087099 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3975246235' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:45.089640 I | rook-ceph-mon2: 2017-07-11 14:48:45.089606 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:45.089875 I | rook-ceph-mon2: 2017-07-11 14:48:45.089836 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3727559342' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:46.177910 I | rook-ceph-mon2: 2017-07-11 14:48:46.177870 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:48:46.178149 I | rook-ceph-mon2: 2017-07-11 14:48:46.178109 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2823930517' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:48:47.325607 I | rook-ceph-mon2: 2017-07-11 14:48:47.325574 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:47.325810 I | rook-ceph-mon2: 2017-07-11 14:48:47.325702 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1152642667' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:48.617858 I | rook-ceph-mon2: 2017-07-11 14:48:48.617811 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:48.617978 I | rook-ceph-mon2: 2017-07-11 14:48:48.617963 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3807801761' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:49.064764 I | rook-ceph-mon2: 2017-07-11 14:48:49.064729 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:49.064990 I | rook-ceph-mon2: 2017-07-11 14:48:49.064954 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3244521731' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:49.310876 I | rook-ceph-mon2: 2017-07-11 14:48:49.310241 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #107. Immutable memtables: 0.
- 2017-07-11 14:48:49.310958 I | rook-ceph-mon2:
- 2017-07-11 14:48:49.310977 I | rook-ceph-mon2: 2017-07-11 14:48:49.310279 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 68] Syncing log #104
- 2017-07-11 14:48:49.344728 I | rook-ceph-mon2: 2017-07-11 14:48:49.339142 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.310274) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:48:49.351052 I | rook-ceph-mon2: 2017-07-11 14:48:49.339151 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 68] Flushing memtable with next log file: 107
- 2017-07-11 14:48:49.351088 I | rook-ceph-mon2:
- 2017-07-11 14:48:49.351103 I | rook-ceph-mon2: 2017-07-11 14:48:49.339160 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784529339156, "job": 68, "event": "flush_started", "num_memtables": 1, "num_entries": 1327, "num_deletes": 251, "memory_usage": 3999256}
- 2017-07-11 14:48:49.351133 I | rook-ceph-mon2: 2017-07-11 14:48:49.339162 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 68] Level-0 flush table #108: started
- 2017-07-11 14:48:49.437541 I | rook-ceph-mon2: 2017-07-11 14:48:49.431806 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784529431797, "cf_name": "default", "job": 68, "event": "table_file_creation", "file_number": 108, "file_size": 2351746, "table_properties": {"data_size": 2343780, "index_size": 7148, "filter_size": 0, "raw_key_size": 10805, "raw_average_key_size": 19, "raw_value_size": 2331145, "raw_average_value_size": 4200, "num_data_blocks": 228, "num_entries": 555, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:48:49.437622 I | rook-ceph-mon2: 2017-07-11 14:48:49.431815 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 68] Level-0 flush table #108: 2351746 bytes OK
- 2017-07-11 14:48:49.537112 I | rook-ceph-mon2: 2017-07-11 14:48:49.521770 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.462120) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #108 started
- 2017-07-11 14:48:49.537167 I | rook-ceph-mon2: 2017-07-11 14:48:49.521777 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.521722) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #108: memtable #1 done
- 2017-07-11 14:48:49.537188 I | rook-ceph-mon2: 2017-07-11 14:48:49.521779 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.521735) EVENT_LOG_v1 {"time_micros": 1499784529521730, "job": 68, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:48:49.537203 I | rook-ceph-mon2: 2017-07-11 14:48:49.521780 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.521748) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:48:49.537216 I | rook-ceph-mon2:
- 2017-07-11 14:48:49.537265 I | rook-ceph-mon2: 2017-07-11 14:48:49.537246 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 68] Try to delete WAL files size 3971817, prev total WAL file size 3971817, number of live WAL files 2.
- 2017-07-11 14:48:49.537280 I | rook-ceph-mon2:
- 2017-07-11 14:48:49.539027 I | rook-ceph-mon2: 2017-07-11 14:48:49.537988 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:48:49.539089 I | rook-ceph-mon2: 2017-07-11 14:48:49.538024 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:48:49.538019) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:48:49.539107 I | rook-ceph-mon2:
- 2017-07-11 14:48:49.539134 I | rook-ceph-mon2: 2017-07-11 14:48:49.538030 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 69] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:48:49.539147 I | rook-ceph-mon2: 2017-07-11 14:48:49.538034 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 68 Base level 0, inputs: [108(2296KB)], [106(15MB)]
- 2017-07-11 14:48:49.539158 I | rook-ceph-mon2:
- 2017-07-11 14:48:49.539168 I | rook-ceph-mon2: 2017-07-11 14:48:49.538044 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784529538036, "job": 69, "event": "compaction_started", "files_L0": [108], "files_L1": [106], "score": -1, "input_data_size": 18182353}
- 2017-07-11 14:48:49.688473 I | rook-ceph-mon2: 2017-07-11 14:48:49.688302 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:48:49.688560 I | rook-ceph-mon2: 2017-07-11 14:48:49.688323 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4268866054' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:48:50.135900 I | rook-ceph-mon2: 2017-07-11 14:48:50.135852 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:50.142294 I | rook-ceph-mon2: 2017-07-11 14:48:50.142189 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1401272134' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:51.016768 I | rook-ceph-mon2: 2017-07-11 14:48:51.016717 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 69] Generated table #109: 2446 keys, 16816170 bytes
- 2017-07-11 14:48:51.016950 I | rook-ceph-mon2: 2017-07-11 14:48:51.016870 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784531016861, "cf_name": "default", "job": 69, "event": "table_file_creation", "file_number": 109, "file_size": 16816170, "table_properties": {"data_size": 16762346, "index_size": 53005, "filter_size": 0, "raw_key_size": 47027, "raw_average_key_size": 19, "raw_value_size": 16691133, "raw_average_value_size": 6823, "num_data_blocks": 1616, "num_entries": 2446, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:48:51.093556 I | rook-ceph-mon2: 2017-07-11 14:48:51.093531 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 69] Compacted 1@0 + 1@1 files to L1 => 16816170 bytes
- 2017-07-11 14:48:51.131163 I | rook-ceph-mon2: 2017-07-11 14:48:51.131134 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:48:51.131067) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 11.7 rd, 10.8 wr, level 1, files in(1, 1) out(1) MB in(2.2, 15.1) out(16.0), read-write-amplify(14.9) write-amplify(7.2) OK, records in: 2911, records dropped: 465
- 2017-07-11 14:48:51.131205 I | rook-ceph-mon2:
- 2017-07-11 14:48:51.131238 I | rook-ceph-mon2: 2017-07-11 14:48:51.131222 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:48:51.131084) EVENT_LOG_v1 {"time_micros": 1499784531131077, "job": 69, "event": "compaction_finished", "compaction_time_micros": 1555475, "output_level": 1, "num_output_files": 1, "total_output_size": 16816170, "num_input_records": 2911, "num_output_records": 2446, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:48:51.131768 I | rook-ceph-mon2: 2017-07-11 14:48:51.131753 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784531131751, "job": 69, "event": "table_file_deletion", "file_number": 108}
- 2017-07-11 14:48:51.133625 I | rook-ceph-mon2: 2017-07-11 14:48:51.133595 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784531133593, "job": 69, "event": "table_file_deletion", "file_number": 106}
- 2017-07-11 14:48:51.133973 I | rook-ceph-mon2: 2017-07-11 14:48:51.133900 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #110. Immutable memtables: 0.
- 2017-07-11 14:48:51.134028 I | rook-ceph-mon2:
- 2017-07-11 14:48:51.134045 I | rook-ceph-mon2: 2017-07-11 14:48:51.133940 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 70] Syncing log #107
- 2017-07-11 14:48:51.158917 I | rook-ceph-mon2: 2017-07-11 14:48:51.158673 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:48:51.133935) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:48:51.158962 I | rook-ceph-mon2: 2017-07-11 14:48:51.158683 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 70] Flushing memtable with next log file: 110
- 2017-07-11 14:48:51.158979 I | rook-ceph-mon2:
- 2017-07-11 14:48:51.158991 I | rook-ceph-mon2: 2017-07-11 14:48:51.158692 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784531158689, "job": 70, "event": "flush_started", "num_memtables": 1, "num_entries": 3, "num_deletes": 0, "memory_usage": 14496}
- 2017-07-11 14:48:51.159003 I | rook-ceph-mon2: 2017-07-11 14:48:51.158695 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 70] Level-0 flush table #111: started
- 2017-07-11 14:48:51.222053 I | rook-ceph-mon2: 2017-07-11 14:48:51.222006 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784531221998, "cf_name": "default", "job": 70, "event": "table_file_creation", "file_number": 111, "file_size": 13196, "table_properties": {"data_size": 12336, "index_size": 53, "filter_size": 0, "raw_key_size": 65, "raw_average_key_size": 21, "raw_value_size": 12249, "raw_average_value_size": 4083, "num_data_blocks": 2, "num_entries": 3, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:48:51.222130 I | rook-ceph-mon2: 2017-07-11 14:48:51.222016 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 70] Level-0 flush table #111: 13196 bytes OK
- 2017-07-11 14:48:51.456552 I | rook-ceph-mon2: 2017-07-11 14:48:51.456304 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:48:51.330852) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #111 started
- 2017-07-11 14:48:51.456655 I | rook-ceph-mon2: 2017-07-11 14:48:51.456311 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:48:51.456244) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #111: memtable #1 done
- 2017-07-11 14:48:51.456688 I | rook-ceph-mon2: 2017-07-11 14:48:51.456313 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:48:51.456270) EVENT_LOG_v1 {"time_micros": 1499784531456265, "job": 70, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:48:51.456717 I | rook-ceph-mon2: 2017-07-11 14:48:51.456314 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:48:51.456293) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:48:51.456730 I | rook-ceph-mon2:
- 2017-07-11 14:48:51.456742 I | rook-ceph-mon2: 2017-07-11 14:48:51.456331 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 70] Try to delete WAL files size 12312, prev total WAL file size 43436, number of live WAL files 2.
- 2017-07-11 14:48:51.456752 I | rook-ceph-mon2:
- 2017-07-11 14:48:51.456786 I | rook-ceph-mon2: 2017-07-11 14:48:51.456510 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:48:51.785592 I | rook-ceph-mon2: 2017-07-11 14:48:51.785545 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:48:51.785814 I | rook-ceph-mon2: 2017-07-11 14:48:51.785777 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2851058657' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:48:53.669165 I | rook-ceph-mon2: 2017-07-11 14:48:53.669083 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:48:53.669405 I | rook-ceph-mon2: 2017-07-11 14:48:53.669364 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1502553746' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:48:54.170172 I | rook-ceph-mon2: 2017-07-11 14:48:54.170138 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:54.170296 I | rook-ceph-mon2: 2017-07-11 14:48:54.170279 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1708598428' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:48:54.716951 I | rook-ceph-mon2: 2017-07-11 14:48:54.716915 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:48:54.717168 I | rook-ceph-mon2: 2017-07-11 14:48:54.717058 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1903952625' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:48:58.168323 I | rook-ceph-mon2: 2017-07-11 14:48:58.168069 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4925 MB, avail 94261 MB
- 2017-07-11 14:48:59.066686 I | rook-ceph-mon2: 2017-07-11 14:48:59.066651 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:48:59.066974 I | rook-ceph-mon2: 2017-07-11 14:48:59.066957 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3593792214' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:01.026250 I | rook-ceph-mon2: 2017-07-11 14:49:01.026215 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:49:01.026511 I | rook-ceph-mon2: 2017-07-11 14:49:01.026493 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2000581124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:49:02.057891 I | rook-ceph-mon2: 2017-07-11 14:49:02.057857 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:02.058129 I | rook-ceph-mon2: 2017-07-11 14:49:02.058091 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/198715118' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:03.373489 I | rook-ceph-mon2: 2017-07-11 14:49:03.373454 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:03.373684 I | rook-ceph-mon2: 2017-07-11 14:49:03.373588 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3995714718' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:03.574971 I | rook-ceph-mon2: 2017-07-11 14:49:03.574935 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:03.575747 I | rook-ceph-mon2: 2017-07-11 14:49:03.575683 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1975490874' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:04.297757 I | rook-ceph-mon2: 2017-07-11 14:49:04.297709 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:49:04.298035 I | rook-ceph-mon2: 2017-07-11 14:49:04.297913 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/721542398' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:49:04.825072 I | rook-ceph-mon2: 2017-07-11 14:49:04.825037 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:04.825247 I | rook-ceph-mon2: 2017-07-11 14:49:04.825166 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/618978523' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:05.915663 I | rook-ceph-mon2: 2017-07-11 14:49:05.915629 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:49:05.915897 I | rook-ceph-mon2: 2017-07-11 14:49:05.915881 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4231888915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:49:06.800856 I | rook-ceph-mon2: 2017-07-11 14:49:06.800820 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:06.807063 I | rook-ceph-mon2: 2017-07-11 14:49:06.801083 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1323658916' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:08.309841 I | rook-ceph-mon2: 2017-07-11 14:49:08.309399 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:08.311431 I | rook-ceph-mon2: 2017-07-11 14:49:08.309435 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/291014466' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:08.916801 I | rook-ceph-mon2: 2017-07-11 14:49:08.916766 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:08.917027 I | rook-ceph-mon2: 2017-07-11 14:49:08.916917 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/1629015338' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:09.863104 I | rook-ceph-mon2: 2017-07-11 14:49:09.863071 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:09.863319 I | rook-ceph-mon2: 2017-07-11 14:49:09.863209 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1885693648' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:11.664655 I | rook-ceph-mon2: 2017-07-11 14:49:11.664613 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:11.664820 I | rook-ceph-mon2: 2017-07-11 14:49:11.664755 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2007508611' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:13.676530 I | rook-ceph-mon2: 2017-07-11 14:49:13.676496 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:13.676703 I | rook-ceph-mon2: 2017-07-11 14:49:13.676625 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1253860543' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:14.202400 I | rook-ceph-mon2: 2017-07-11 14:49:14.202365 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:49:14.202592 I | rook-ceph-mon2: 2017-07-11 14:49:14.202506 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2127401411' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:49:14.366766 I | rook-ceph-mon2: 2017-07-11 14:49:14.359055 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #112. Immutable memtables: 0.
- 2017-07-11 14:49:14.366878 I | rook-ceph-mon2:
- 2017-07-11 14:49:14.366896 I | rook-ceph-mon2: 2017-07-11 14:49:14.359091 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 71] Syncing log #110
- 2017-07-11 14:49:14.385995 I | rook-ceph-mon2: 2017-07-11 14:49:14.377302 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.359086) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:49:14.386044 I | rook-ceph-mon2: 2017-07-11 14:49:14.377311 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 71] Flushing memtable with next log file: 112
- 2017-07-11 14:49:14.386060 I | rook-ceph-mon2:
- 2017-07-11 14:49:14.386073 I | rook-ceph-mon2: 2017-07-11 14:49:14.377321 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554377316, "job": 71, "event": "flush_started", "num_memtables": 1, "num_entries": 756, "num_deletes": 504, "memory_usage": 969744}
- 2017-07-11 14:49:14.386085 I | rook-ceph-mon2: 2017-07-11 14:49:14.377323 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 71] Level-0 flush table #113: started
- 2017-07-11 14:49:14.448850 I | rook-ceph-mon2: 2017-07-11 14:49:14.448803 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554448784, "cf_name": "default", "job": 71, "event": "table_file_creation", "file_number": 113, "file_size": 645848, "table_properties": {"data_size": 642950, "index_size": 2084, "filter_size": 0, "raw_key_size": 11530, "raw_average_key_size": 19, "raw_value_size": 633622, "raw_average_value_size": 1072, "num_data_blocks": 67, "num_entries": 591, "filter_policy_name": "", "kDeletedKeys": "504", "kMergeOperands": "0"}}
- 2017-07-11 14:49:14.449639 I | rook-ceph-mon2: 2017-07-11 14:49:14.449614 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 71] Level-0 flush table #113: 645848 bytes OK
- 2017-07-11 14:49:14.491436 I | rook-ceph-mon2: 2017-07-11 14:49:14.490621 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.468442) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #113 started
- 2017-07-11 14:49:14.491526 I | rook-ceph-mon2: 2017-07-11 14:49:14.491508 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.490543) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #113: memtable #1 done
- 2017-07-11 14:49:14.491582 I | rook-ceph-mon2: 2017-07-11 14:49:14.491551 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.490582) EVENT_LOG_v1 {"time_micros": 1499784554490565, "job": 71, "event": "flush_finished", "lsm_state": [2, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:49:14.491635 I | rook-ceph-mon2: 2017-07-11 14:49:14.491609 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.490608) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[2 1 0 0 0 0 0] max score 0.50
- 2017-07-11 14:49:14.491663 I | rook-ceph-mon2:
- 2017-07-11 14:49:14.491695 I | rook-ceph-mon2: 2017-07-11 14:49:14.491682 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 71] Try to delete WAL files size 952358, prev total WAL file size 952358, number of live WAL files 2.
- 2017-07-11 14:49:14.491707 I | rook-ceph-mon2:
- 2017-07-11 14:49:14.501243 I | rook-ceph-mon2: 2017-07-11 14:49:14.492061 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:49:14.501288 I | rook-ceph-mon2: 2017-07-11 14:49:14.492093 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.492088) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:49:14.501306 I | rook-ceph-mon2:
- 2017-07-11 14:49:14.501319 I | rook-ceph-mon2: 2017-07-11 14:49:14.492098 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 72] Compacting 2@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:49:14.501331 I | rook-ceph-mon2: 2017-07-11 14:49:14.492102 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 71 Base level 0, inputs: [113(630KB) 111(12KB)], [109(16MB)]
- 2017-07-11 14:49:14.501342 I | rook-ceph-mon2:
- 2017-07-11 14:49:14.501374 I | rook-ceph-mon2: 2017-07-11 14:49:14.492114 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554492105, "job": 72, "event": "compaction_started", "files_L0": [113, 111], "files_L1": [109], "score": -1, "input_data_size": 17475214}
- 2017-07-11 14:49:14.650263 I | rook-ceph-mon2: 2017-07-11 14:49:14.650215 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 72] Generated table #114: 2022 keys, 14375270 bytes
- 2017-07-11 14:49:14.650381 I | rook-ceph-mon2: 2017-07-11 14:49:14.650364 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554650355, "cf_name": "default", "job": 72, "event": "table_file_creation", "file_number": 114, "file_size": 14375270, "table_properties": {"data_size": 14329171, "index_size": 45280, "filter_size": 0, "raw_key_size": 38717, "raw_average_key_size": 19, "raw_value_size": 14269258, "raw_average_value_size": 7057, "num_data_blocks": 1394, "num_entries": 2022, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:49:14.695994 I | rook-ceph-mon2: 2017-07-11 14:49:14.695966 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 72] Compacted 2@0 + 1@1 files to L1 => 14375270 bytes
- 2017-07-11 14:49:14.762034 I | rook-ceph-mon2: 2017-07-11 14:49:14.761978 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.761895) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 85.7 rd, 70.5 wr, level 1, files in(2, 1) out(1) MB in(0.6, 16.0) out(13.7), read-write-amplify(48.3) write-amplify(21.8) OK, records in: 3040, records dropped: 1018
- 2017-07-11 14:49:14.762105 I | rook-ceph-mon2:
- 2017-07-11 14:49:14.762188 I | rook-ceph-mon2: 2017-07-11 14:49:14.762135 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.761910) EVENT_LOG_v1 {"time_micros": 1499784554761904, "job": 72, "event": "compaction_finished", "compaction_time_micros": 203839, "output_level": 1, "num_output_files": 1, "total_output_size": 14375270, "num_input_records": 3040, "num_output_records": 2022, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:49:14.762527 I | rook-ceph-mon2: 2017-07-11 14:49:14.762495 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554762492, "job": 72, "event": "table_file_deletion", "file_number": 113}
- 2017-07-11 14:49:14.762656 I | rook-ceph-mon2: 2017-07-11 14:49:14.762607 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554762606, "job": 72, "event": "table_file_deletion", "file_number": 111}
- 2017-07-11 14:49:14.764783 I | rook-ceph-mon2: 2017-07-11 14:49:14.764768 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554764766, "job": 72, "event": "table_file_deletion", "file_number": 109}
- 2017-07-11 14:49:14.765753 I | rook-ceph-mon2: 2017-07-11 14:49:14.765673 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #115. Immutable memtables: 0.
- 2017-07-11 14:49:14.765794 I | rook-ceph-mon2:
- 2017-07-11 14:49:14.765808 I | rook-ceph-mon2: 2017-07-11 14:49:14.765708 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 73] Syncing log #112
- 2017-07-11 14:49:14.810809 I | rook-ceph-mon2: 2017-07-11 14:49:14.801152 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.765703) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:49:14.810894 I | rook-ceph-mon2: 2017-07-11 14:49:14.801164 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 73] Flushing memtable with next log file: 115
- 2017-07-11 14:49:14.810911 I | rook-ceph-mon2:
- 2017-07-11 14:49:14.810924 I | rook-ceph-mon2: 2017-07-11 14:49:14.801174 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554801170, "job": 73, "event": "flush_started", "num_memtables": 1, "num_entries": 8, "num_deletes": 0, "memory_usage": 41632}
- 2017-07-11 14:49:14.810936 I | rook-ceph-mon2: 2017-07-11 14:49:14.801176 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 73] Level-0 flush table #116: started
- 2017-07-11 14:49:14.841594 I | rook-ceph-mon2: 2017-07-11 14:49:14.840414 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554840404, "cf_name": "default", "job": 73, "event": "table_file_creation", "file_number": 116, "file_size": 40412, "table_properties": {"data_size": 39487, "index_size": 114, "filter_size": 0, "raw_key_size": 186, "raw_average_key_size": 23, "raw_value_size": 39230, "raw_average_value_size": 4903, "num_data_blocks": 4, "num_entries": 8, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:49:14.841654 I | rook-ceph-mon2: 2017-07-11 14:49:14.840425 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 73] Level-0 flush table #116: 40412 bytes OK
- 2017-07-11 14:49:14.926326 I | rook-ceph-mon2: 2017-07-11 14:49:14.926092 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.907039) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #116 started
- 2017-07-11 14:49:14.929596 I | rook-ceph-mon2: 2017-07-11 14:49:14.926105 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.926014) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #116: memtable #1 done
- 2017-07-11 14:49:14.929631 I | rook-ceph-mon2: 2017-07-11 14:49:14.926108 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.926042) EVENT_LOG_v1 {"time_micros": 1499784554926033, "job": 73, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:49:14.929645 I | rook-ceph-mon2: 2017-07-11 14:49:14.926111 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.926065) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:49:14.929656 I | rook-ceph-mon2:
- 2017-07-11 14:49:14.929685 I | rook-ceph-mon2: 2017-07-11 14:49:14.926120 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 73] Try to delete WAL files size 39393, prev total WAL file size 39393, number of live WAL files 2.
- 2017-07-11 14:49:14.929710 I | rook-ceph-mon2:
- 2017-07-11 14:49:14.929790 I | rook-ceph-mon2: 2017-07-11 14:49:14.929758 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:49:14.929853 I | rook-ceph-mon2: 2017-07-11 14:49:14.929837 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:49:14.929832) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:49:14.929868 I | rook-ceph-mon2:
- 2017-07-11 14:49:14.929910 I | rook-ceph-mon2: 2017-07-11 14:49:14.929882 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 74] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:49:14.929955 I | rook-ceph-mon2: 2017-07-11 14:49:14.929928 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 73 Base level 0, inputs: [116(39KB)], [114(13MB)]
- 2017-07-11 14:49:14.929969 I | rook-ceph-mon2:
- 2017-07-11 14:49:14.930021 I | rook-ceph-mon2: 2017-07-11 14:49:14.930007 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784554929999, "job": 74, "event": "compaction_started", "files_L0": [116], "files_L1": [114], "score": -1, "input_data_size": 14415682}
- 2017-07-11 14:49:15.005263 I | rook-ceph-mon2: 2017-07-11 14:49:15.005045 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:15.005333 I | rook-ceph-mon2: 2017-07-11 14:49:15.005066 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2980300352' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:15.111712 I | rook-ceph-mon2: 2017-07-11 14:49:15.096478 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 74] Generated table #117: 2025 keys, 14394934 bytes
- 2017-07-11 14:49:15.113584 I | rook-ceph-mon2: 2017-07-11 14:49:15.111811 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555111802, "cf_name": "default", "job": 74, "event": "table_file_creation", "file_number": 117, "file_size": 14394934, "table_properties": {"data_size": 14348740, "index_size": 45375, "filter_size": 0, "raw_key_size": 38776, "raw_average_key_size": 19, "raw_value_size": 14288720, "raw_average_value_size": 7056, "num_data_blocks": 1397, "num_entries": 2025, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:49:15.195541 I | rook-ceph-mon2: 2017-07-11 14:49:15.195495 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 74] Compacted 1@0 + 1@1 files to L1 => 14394934 bytes
- 2017-07-11 14:49:15.246178 I | rook-ceph-mon2: 2017-07-11 14:49:15.244126 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.244035) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 54.3 rd, 54.2 wr, level 1, files in(1, 1) out(1) MB in(0.0, 13.7) out(13.7), read-write-amplify(712.9) write-amplify(356.2) OK, records in: 2030, records dropped: 5
- 2017-07-11 14:49:15.246236 I | rook-ceph-mon2:
- 2017-07-11 14:49:15.246274 I | rook-ceph-mon2: 2017-07-11 14:49:15.246255 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:49:15.244059) EVENT_LOG_v1 {"time_micros": 1499784555244050, "job": 74, "event": "compaction_finished", "compaction_time_micros": 265437, "output_level": 1, "num_output_files": 1, "total_output_size": 14394934, "num_input_records": 2030, "num_output_records": 2025, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:49:15.246520 I | rook-ceph-mon2: 2017-07-11 14:49:15.246444 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555246441, "job": 74, "event": "table_file_deletion", "file_number": 116}
- 2017-07-11 14:49:15.263561 I | rook-ceph-mon2: 2017-07-11 14:49:15.263543 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784555263541, "job": 74, "event": "table_file_deletion", "file_number": 114}
- 2017-07-11 14:49:18.163665 I | rook-ceph-mon2: 2017-07-11 14:49:18.163629 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:18.163774 I | rook-ceph-mon2: 2017-07-11 14:49:18.163759 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1965217551' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:18.603887 I | rook-ceph-mon2: 2017-07-11 14:49:18.603855 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:18.604064 I | rook-ceph-mon2: 2017-07-11 14:49:18.603977 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2477850260' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:23.267268 I | rook-ceph-mon2: 2017-07-11 14:49:23.267223 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:23.267440 I | rook-ceph-mon2: 2017-07-11 14:49:23.267363 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3692552724' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:24.183301 I | rook-ceph-mon2: 2017-07-11 14:49:24.183266 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:49:24.189272 I | rook-ceph-mon2: 2017-07-11 14:49:24.183407 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/992664316' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:49:24.654279 I | rook-ceph-mon2: 2017-07-11 14:49:24.654221 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:24.654497 I | rook-ceph-mon2: 2017-07-11 14:49:24.654391 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3924251815' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:25.683898 I | rook-ceph-mon2: 2017-07-11 14:49:25.683506 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:49:25.684216 I | rook-ceph-mon2: 2017-07-11 14:49:25.683533 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1061058776' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:49:27.999143 I | rook-ceph-mon2: 2017-07-11 14:49:27.999097 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:27.999395 I | rook-ceph-mon2: 2017-07-11 14:49:27.999376 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2229398241' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:29.052074 I | rook-ceph-mon2: 2017-07-11 14:49:29.052043 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:49:29.052269 I | rook-ceph-mon2: 2017-07-11 14:49:29.052178 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4230333477' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:49:29.511064 I | rook-ceph-mon2: 2017-07-11 14:49:29.511028 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:29.511318 I | rook-ceph-mon2: 2017-07-11 14:49:29.511288 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/162999867' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:31.431038 I | rook-ceph-mon2: 2017-07-11 14:49:31.430981 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:31.431245 I | rook-ceph-mon2: 2017-07-11 14:49:31.431175 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1968333805' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:33.402930 I | rook-ceph-mon2: 2017-07-11 14:49:33.402897 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:33.403130 I | rook-ceph-mon2: 2017-07-11 14:49:33.403022 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3106323091' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:33.923624 I | rook-ceph-mon2: 2017-07-11 14:49:33.923452 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:49:33.923689 I | rook-ceph-mon2: 2017-07-11 14:49:33.923472 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/690752764' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:49:34.397498 I | rook-ceph-mon2: 2017-07-11 14:49:34.397466 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:34.403243 I | rook-ceph-mon2: 2017-07-11 14:49:34.403224 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1584983828' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:35.514965 I | rook-ceph-mon2: 2017-07-11 14:49:35.514908 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:49:35.515155 I | rook-ceph-mon2: 2017-07-11 14:49:35.515078 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3017750356' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:49:36.537919 I | rook-ceph-mon2: 2017-07-11 14:49:36.537886 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:36.538178 I | rook-ceph-mon2: 2017-07-11 14:49:36.538136 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/708580452' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:36.602093 I | rook-ceph-mon2: 2017-07-11 14:49:35.633293 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1719 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.1693s > max 0.05s
- 2017-07-11 14:49:38.823895 I | rook-ceph-mon2: 2017-07-11 14:49:38.823860 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:49:38.824015 I | rook-ceph-mon2: 2017-07-11 14:49:38.824000 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/799424983' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:49:40.440240 I | rook-ceph-mon2: 2017-07-11 14:49:40.440204 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:49:40.446193 I | rook-ceph-mon2: 2017-07-11 14:49:40.446156 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3623707510' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:49:42.762011 I | rook-ceph-mon2: 2017-07-11 14:49:42.761964 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:42.767999 I | rook-ceph-mon2: 2017-07-11 14:49:42.762126 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2874949081' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:43.530698 I | rook-ceph-mon2: 2017-07-11 14:49:43.530667 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:43.530866 I | rook-ceph-mon2: 2017-07-11 14:49:43.530802 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1458777893' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:44.012561 I | rook-ceph-mon2: 2017-07-11 14:49:44.012460 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:49:44.013011 I | rook-ceph-mon2: 2017-07-11 14:49:44.012929 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1358374161' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:49:44.481843 I | rook-ceph-mon2: 2017-07-11 14:49:44.481809 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:44.482091 I | rook-ceph-mon2: 2017-07-11 14:49:44.482074 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2196357802' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:46.605565 I | rook-ceph-mon2: 2017-07-11 14:49:46.605267 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:46.605941 I | rook-ceph-mon2: 2017-07-11 14:49:46.605289 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/694922577' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:47.723307 I | rook-ceph-mon2: 2017-07-11 14:49:47.723276 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:47.723488 I | rook-ceph-mon2: 2017-07-11 14:49:47.723411 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3851977724' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:48.161465 I | rook-ceph-mon2: 2017-07-11 14:49:48.161409 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:48.161639 I | rook-ceph-mon2: 2017-07-11 14:49:48.161561 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2584257050' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:49.183855 I | rook-ceph-mon2: 2017-07-11 14:49:49.183801 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:49:49.184041 I | rook-ceph-mon2: 2017-07-11 14:49:49.183950 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3969037960' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:49:49.639906 I | rook-ceph-mon2: 2017-07-11 14:49:49.639862 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:49.640121 I | rook-ceph-mon2: 2017-07-11 14:49:49.640007 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1130616272' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:51.994348 I | rook-ceph-mon2: 2017-07-11 14:49:51.994311 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:51.994558 I | rook-ceph-mon2: 2017-07-11 14:49:51.994472 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/775226503' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:53.837100 I | rook-ceph-mon2: 2017-07-11 14:49:53.837063 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:49:53.837407 I | rook-ceph-mon2: 2017-07-11 14:49:53.837333 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3594822946' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:49:54.309196 I | rook-ceph-mon2: 2017-07-11 14:49:54.309163 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:49:54.309370 I | rook-ceph-mon2: 2017-07-11 14:49:54.309296 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1471921918' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:49:55.771609 I | rook-ceph-mon2: 2017-07-11 14:49:55.771569 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:49:55.771855 I | rook-ceph-mon2: 2017-07-11 14:49:55.771826 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2415772919' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:49:56.564886 I | rook-ceph-mon2: 2017-07-11 14:49:56.563920 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:49:56.565386 I | rook-ceph-mon2: 2017-07-11 14:49:56.565368 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2392306756' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:49:58.174477 I | rook-ceph-mon2: 2017-07-11 14:49:58.174162 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94264 MB
- 2017-07-11 14:49:58.529930 I | rook-ceph-mon2: 2017-07-11 14:49:58.529895 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:49:58.530163 I | rook-ceph-mon2: 2017-07-11 14:49:58.530036 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3354404283' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:50:02.491546 I | rook-ceph-mon2: 2017-07-11 14:50:02.491517 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:02.491649 I | rook-ceph-mon2: 2017-07-11 14:50:02.491634 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2492521997' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:03.442508 I | rook-ceph-mon2: 2017-07-11 14:50:03.442474 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:50:03.442607 I | rook-ceph-mon2: 2017-07-11 14:50:03.442592 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/54516751' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:50:04.888803 I | rook-ceph-mon2: 2017-07-11 14:50:04.888767 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:50:04.889041 I | rook-ceph-mon2: 2017-07-11 14:50:04.889023 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1768206152' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:50:06.014123 I | rook-ceph-mon2: 2017-07-11 14:50:06.014051 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:06.014208 I | rook-ceph-mon2: 2017-07-11 14:50:06.014072 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2766133047' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:07.507384 I | rook-ceph-mon2: 2017-07-11 14:50:07.507355 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:07.507703 I | rook-ceph-mon2: 2017-07-11 14:50:07.507615 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2946723225' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:08.038234 I | rook-ceph-mon2: 2017-07-11 14:50:08.038199 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:08.038477 I | rook-ceph-mon2: 2017-07-11 14:50:08.038459 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2375867684' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:08.486191 I | rook-ceph-mon2: 2017-07-11 14:50:08.486146 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:50:08.486378 I | rook-ceph-mon2: 2017-07-11 14:50:08.486289 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3082411784' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:50:09.115914 I | rook-ceph-mon2: 2017-07-11 14:50:09.115880 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:09.116096 I | rook-ceph-mon2: 2017-07-11 14:50:09.116017 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2914783274' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:10.468532 I | rook-ceph-mon2: 2017-07-11 14:50:10.468493 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:10.468741 I | rook-ceph-mon2: 2017-07-11 14:50:10.468637 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/461982310' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:10.977605 I | rook-ceph-mon2: 2017-07-11 14:50:10.977542 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:10.977826 I | rook-ceph-mon2: 2017-07-11 14:50:10.977790 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2556178611' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:12.342738 I | rook-ceph-mon2: 2017-07-11 14:50:12.342706 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:12.342930 I | rook-ceph-mon2: 2017-07-11 14:50:12.342843 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1575559085' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:13.481907 I | rook-ceph-mon2: 2017-07-11 14:50:13.481858 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:50:13.482082 I | rook-ceph-mon2: 2017-07-11 14:50:13.482004 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2353360930' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:50:13.924001 I | rook-ceph-mon2: 2017-07-11 14:50:13.923970 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:13.924172 I | rook-ceph-mon2: 2017-07-11 14:50:13.924096 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4194224720' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:14.440518 I | rook-ceph-mon2: 2017-07-11 14:50:14.440485 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:14.442365 I | rook-ceph-mon2: 2017-07-11 14:50:14.442345 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2399995799' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:14.859353 I | rook-ceph-mon2: 2017-07-11 14:50:14.859318 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:50:14.859550 I | rook-ceph-mon2: 2017-07-11 14:50:14.859470 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1618894916' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:50:15.937335 I | rook-ceph-mon2: 2017-07-11 14:50:15.937300 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:15.937574 I | rook-ceph-mon2: 2017-07-11 14:50:15.937444 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3117260017' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:17.819027 I | rook-ceph-mon2: 2017-07-11 14:50:17.818988 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:17.819269 I | rook-ceph-mon2: 2017-07-11 14:50:17.819136 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/39020298' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:18.698930 I | rook-ceph-mon2: 2017-07-11 14:50:18.698897 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:18.699033 I | rook-ceph-mon2: 2017-07-11 14:50:18.699018 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3690892299' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:19.674017 I | rook-ceph-mon2: 2017-07-11 14:50:19.673984 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:50:19.674194 I | rook-ceph-mon2: 2017-07-11 14:50:19.674117 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3599359936' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:50:21.742563 I | rook-ceph-mon2: 2017-07-11 14:50:21.742526 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:21.742807 I | rook-ceph-mon2: 2017-07-11 14:50:21.742789 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2494998937' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:22.286891 I | rook-ceph-mon2: 2017-07-11 14:50:22.286857 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:22.286988 I | rook-ceph-mon2: 2017-07-11 14:50:22.286974 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3675601360' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:23.718864 I | rook-ceph-mon2: 2017-07-11 14:50:23.718801 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:23.719068 I | rook-ceph-mon2: 2017-07-11 14:50:23.718992 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/17406533' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:23.939082 I | rook-ceph-mon2: 2017-07-11 14:50:23.938978 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #118. Immutable memtables: 0.
- 2017-07-11 14:50:23.939197 I | rook-ceph-mon2:
- 2017-07-11 14:50:23.939219 I | rook-ceph-mon2: 2017-07-11 14:50:23.939035 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 75] Syncing log #115
- 2017-07-11 14:50:23.995344 I | rook-ceph-mon2: 2017-07-11 14:50:23.988506 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:50:23.939029) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:50:23.995411 I | rook-ceph-mon2: 2017-07-11 14:50:23.988516 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 75] Flushing memtable with next log file: 118
- 2017-07-11 14:50:23.995428 I | rook-ceph-mon2:
- 2017-07-11 14:50:23.995442 I | rook-ceph-mon2: 2017-07-11 14:50:23.988525 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784623988521, "job": 75, "event": "flush_started", "num_memtables": 1, "num_entries": 972, "num_deletes": 251, "memory_usage": 2672552}
- 2017-07-11 14:50:23.995469 I | rook-ceph-mon2: 2017-07-11 14:50:23.988528 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 75] Level-0 flush table #119: started
- 2017-07-11 14:50:24.055595 I | rook-ceph-mon2: 2017-07-11 14:50:24.055541 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624055532, "cf_name": "default", "job": 75, "event": "table_file_creation", "file_number": 119, "file_size": 1763004, "table_properties": {"data_size": 1756486, "index_size": 5703, "filter_size": 0, "raw_key_size": 9034, "raw_average_key_size": 18, "raw_value_size": 1745837, "raw_average_value_size": 3592, "num_data_blocks": 182, "num_entries": 486, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:50:24.057313 I | rook-ceph-mon2: 2017-07-11 14:50:24.057293 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 75] Level-0 flush table #119: 1763004 bytes OK
- 2017-07-11 14:50:24.124516 I | rook-ceph-mon2: 2017-07-11 14:50:24.124441 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.073800) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #119 started
- 2017-07-11 14:50:24.124595 I | rook-ceph-mon2: 2017-07-11 14:50:24.124577 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.124389) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #119: memtable #1 done
- 2017-07-11 14:50:24.124648 I | rook-ceph-mon2: 2017-07-11 14:50:24.124618 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.124416) EVENT_LOG_v1 {"time_micros": 1499784624124399, "job": 75, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:50:24.124681 I | rook-ceph-mon2: 2017-07-11 14:50:24.124666 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.124431) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:50:24.124696 I | rook-ceph-mon2:
- 2017-07-11 14:50:24.124742 I | rook-ceph-mon2: 2017-07-11 14:50:24.124729 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 75] Try to delete WAL files size 2650972, prev total WAL file size 2650972, number of live WAL files 2.
- 2017-07-11 14:50:24.124757 I | rook-ceph-mon2:
- 2017-07-11 14:50:24.142830 I | rook-ceph-mon2: 2017-07-11 14:50:24.125374 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:50:24.142885 I | rook-ceph-mon2: 2017-07-11 14:50:24.125410 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.125405) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:50:24.142920 I | rook-ceph-mon2:
- 2017-07-11 14:50:24.142949 I | rook-ceph-mon2: 2017-07-11 14:50:24.125416 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 76] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:50:24.142962 I | rook-ceph-mon2: 2017-07-11 14:50:24.125420 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 75 Base level 0, inputs: [119(1721KB)], [117(13MB)]
- 2017-07-11 14:50:24.142973 I | rook-ceph-mon2:
- 2017-07-11 14:50:24.142985 I | rook-ceph-mon2: 2017-07-11 14:50:24.125430 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624125423, "job": 76, "event": "compaction_started", "files_L0": [119], "files_L1": [117], "score": -1, "input_data_size": 16157938}
- 2017-07-11 14:50:24.606469 I | rook-ceph-mon2: 2017-07-11 14:50:24.597601 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 76] Generated table #120: 2002 keys, 13596340 bytes
- 2017-07-11 14:50:24.606546 I | rook-ceph-mon2: 2017-07-11 14:50:24.597621 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624597612, "cf_name": "default", "job": 76, "event": "table_file_creation", "file_number": 120, "file_size": 13596340, "table_properties": {"data_size": 13552034, "index_size": 43487, "filter_size": 0, "raw_key_size": 38589, "raw_average_key_size": 19, "raw_value_size": 13493572, "raw_average_value_size": 6740, "num_data_blocks": 1327, "num_entries": 2002, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:50:24.685497 I | rook-ceph-mon2: 2017-07-11 14:50:24.685405 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 76] Compacted 1@0 + 1@1 files to L1 => 13596340 bytes
- 2017-07-11 14:50:24.724057 I | rook-ceph-mon2: 2017-07-11 14:50:24.722219 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.722147) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 28.9 rd, 24.3 wr, level 1, files in(1, 1) out(1) MB in(1.7, 13.7) out(13.0), read-write-amplify(16.9) write-amplify(7.7) OK, records in: 2511, records dropped: 509
- 2017-07-11 14:50:24.724104 I | rook-ceph-mon2:
- 2017-07-11 14:50:24.724120 I | rook-ceph-mon2: 2017-07-11 14:50:24.722224 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:50:24.722164) EVENT_LOG_v1 {"time_micros": 1499784624722157, "job": 76, "event": "compaction_finished", "compaction_time_micros": 559957, "output_level": 1, "num_output_files": 1, "total_output_size": 13596340, "num_input_records": 2511, "num_output_records": 2002, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:50:24.724132 I | rook-ceph-mon2: 2017-07-11 14:50:24.722535 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624722532, "job": 76, "event": "table_file_deletion", "file_number": 119}
- 2017-07-11 14:50:24.724143 I | rook-ceph-mon2: 2017-07-11 14:50:24.724016 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784624724015, "job": 76, "event": "table_file_deletion", "file_number": 117}
- 2017-07-11 14:50:24.777940 I | rook-ceph-mon2: 2017-07-11 14:50:24.777916 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:50:24.778034 I | rook-ceph-mon2: 2017-07-11 14:50:24.778018 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2210195484' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:50:25.986024 I | rook-ceph-mon2: 2017-07-11 14:50:25.985990 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:25.986218 I | rook-ceph-mon2: 2017-07-11 14:50:25.986133 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1167441521' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:27.169197 I | rook-ceph-mon2: 2017-07-11 14:50:27.169166 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:27.169389 I | rook-ceph-mon2: 2017-07-11 14:50:27.169298 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1779332460' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:27.661952 I | rook-ceph-mon2: 2017-07-11 14:50:27.661907 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:27.667838 I | rook-ceph-mon2: 2017-07-11 14:50:27.667816 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3728584368' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:28.119594 I | rook-ceph-mon2: 2017-07-11 14:50:28.119561 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:50:28.119716 I | rook-ceph-mon2: 2017-07-11 14:50:28.119701 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/143690802' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:50:32.022856 I | rook-ceph-mon2: 2017-07-11 14:50:32.022821 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:32.023043 I | rook-ceph-mon2: 2017-07-11 14:50:32.022957 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/951332738' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:32.481022 I | rook-ceph-mon2: 2017-07-11 14:50:32.480987 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:32.481215 I | rook-ceph-mon2: 2017-07-11 14:50:32.481117 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1154229803' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:32.941346 I | rook-ceph-mon2: 2017-07-11 14:50:32.941287 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:50:32.941657 I | rook-ceph-mon2: 2017-07-11 14:50:32.941568 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3639477734' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:50:34.528195 I | rook-ceph-mon2: 2017-07-11 14:50:34.528142 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:50:34.528416 I | rook-ceph-mon2: 2017-07-11 14:50:34.528342 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/381674158' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:50:37.958033 I | rook-ceph-mon2: 2017-07-11 14:50:37.958002 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:50:37.958225 I | rook-ceph-mon2: 2017-07-11 14:50:37.958135 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4241270003' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:50:39.537082 I | rook-ceph-mon2: 2017-07-11 14:50:39.537046 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:50:39.537327 I | rook-ceph-mon2: 2017-07-11 14:50:39.537287 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3368439383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:50:40.518082 I | rook-ceph-mon2: 2017-07-11 14:50:40.518050 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:40.518187 I | rook-ceph-mon2: 2017-07-11 14:50:40.518172 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1670168378' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:41.863896 I | rook-ceph-mon2: 2017-07-11 14:50:41.863862 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:41.864099 I | rook-ceph-mon2: 2017-07-11 14:50:41.863992 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3043081863' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:44.268569 I | rook-ceph-mon2: 2017-07-11 14:50:44.268535 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:50:44.268799 I | rook-ceph-mon2: 2017-07-11 14:50:44.268758 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/80452467' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:50:45.324589 I | rook-ceph-mon2: 2017-07-11 14:50:45.324555 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:45.325158 I | rook-ceph-mon2: 2017-07-11 14:50:45.325079 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/103626262' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:46.918849 I | rook-ceph-mon2: 2017-07-11 14:50:46.918820 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:46.919072 I | rook-ceph-mon2: 2017-07-11 14:50:46.919043 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1512184855' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:47.866288 I | rook-ceph-mon2: 2017-07-11 14:50:47.866253 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:50:47.866475 I | rook-ceph-mon2: 2017-07-11 14:50:47.866391 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3088030772' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:50:50.391037 I | rook-ceph-mon2: 2017-07-11 14:50:50.390978 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:50.391272 I | rook-ceph-mon2: 2017-07-11 14:50:50.391228 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1282167802' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:51.499735 I | rook-ceph-mon2: 2017-07-11 14:50:51.499568 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:50:51.499834 I | rook-ceph-mon2: 2017-07-11 14:50:51.499590 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/506179160' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:50:52.783730 I | rook-ceph-mon2: 2017-07-11 14:50:52.783684 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:50:52.783927 I | rook-ceph-mon2: 2017-07-11 14:50:52.783836 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3798746566' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:50:53.371776 I | rook-ceph-mon2: 2017-07-11 14:50:53.371739 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:53.372049 I | rook-ceph-mon2: 2017-07-11 14:50:53.371896 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3724316865' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:54.316910 I | rook-ceph-mon2: 2017-07-11 14:50:54.316874 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:50:54.317191 I | rook-ceph-mon2: 2017-07-11 14:50:54.317106 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/969252638' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:50:55.398820 I | rook-ceph-mon2: 2017-07-11 14:50:55.398772 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:55.404999 I | rook-ceph-mon2: 2017-07-11 14:50:55.398917 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1907025543' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:56.700198 I | rook-ceph-mon2: 2017-07-11 14:50:56.700126 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:50:56.700302 I | rook-ceph-mon2: 2017-07-11 14:50:56.700150 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2506967466' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:50:57.165243 I | rook-ceph-mon2: 2017-07-11 14:50:57.165210 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:57.171722 I | rook-ceph-mon2: 2017-07-11 14:50:57.165343 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/774528342' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:57.776541 I | rook-ceph-mon2: 2017-07-11 14:50:57.776506 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:50:57.776650 I | rook-ceph-mon2: 2017-07-11 14:50:57.776634 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2577642395' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:50:58.181876 I | rook-ceph-mon2: 2017-07-11 14:50:58.181598 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4922 MB, avail 94264 MB
- 2017-07-11 14:50:58.231913 I | rook-ceph-mon2: 2017-07-11 14:50:58.231673 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:50:58.232004 I | rook-ceph-mon2: 2017-07-11 14:50:58.231695 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1541099757' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:50:59.151636 I | rook-ceph-mon2: 2017-07-11 14:50:59.151603 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:50:59.151803 I | rook-ceph-mon2: 2017-07-11 14:50:59.151730 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2518732017' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:51:01.987709 I | rook-ceph-mon2: 2017-07-11 14:51:01.987665 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:01.987903 I | rook-ceph-mon2: 2017-07-11 14:51:01.987813 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1753773201' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:02.973673 I | rook-ceph-mon2: 2017-07-11 14:51:02.973587 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:02.973774 I | rook-ceph-mon2: 2017-07-11 14:51:02.973609 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1831215263' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:03.910770 I | rook-ceph-mon2: 2017-07-11 14:51:03.903836 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:51:03.911122 I | rook-ceph-mon2: 2017-07-11 14:51:03.910184 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2996239472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:51:06.620633 I | rook-ceph-mon2: 2017-07-11 14:51:06.620601 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:06.620806 I | rook-ceph-mon2: 2017-07-11 14:51:06.620728 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2499744597' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:07.035214 I | rook-ceph-mon2: 2017-07-11 14:51:07.035179 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:07.035397 I | rook-ceph-mon2: 2017-07-11 14:51:07.035312 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2341919499' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:07.971776 I | rook-ceph-mon2: 2017-07-11 14:51:07.971741 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:07.971845 I | rook-ceph-mon2: 2017-07-11 14:51:07.971830 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1390850096' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:11.505831 I | rook-ceph-mon2: 2017-07-11 14:51:11.505485 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:11.506236 I | rook-ceph-mon2: 2017-07-11 14:51:11.505506 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2896007876' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:12.316599 I | rook-ceph-mon2: 2017-07-11 14:51:12.316566 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:51:12.316701 I | rook-ceph-mon2: 2017-07-11 14:51:12.316686 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3871740289' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:51:12.784469 I | rook-ceph-mon2: 2017-07-11 14:51:12.784436 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:12.784642 I | rook-ceph-mon2: 2017-07-11 14:51:12.784566 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/337816866' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:13.917632 I | rook-ceph-mon2: 2017-07-11 14:51:13.917403 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:51:13.917649 I | rook-ceph-mon2: 2017-07-11 14:51:13.917430 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/744413948' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:51:15.156996 I | rook-ceph-mon2: 2017-07-11 14:51:15.156962 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:15.157172 I | rook-ceph-mon2: 2017-07-11 14:51:15.157092 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1611411623' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:16.439357 I | rook-ceph-mon2: 2017-07-11 14:51:16.439327 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:16.439532 I | rook-ceph-mon2: 2017-07-11 14:51:16.439454 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1643557933' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:16.797551 I | rook-ceph-mon2: 2017-07-11 14:51:16.797520 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:16.797655 I | rook-ceph-mon2: 2017-07-11 14:51:16.797640 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3996467012' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:17.565997 I | rook-ceph-mon2: 2017-07-11 14:51:17.565962 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:51:17.566093 I | rook-ceph-mon2: 2017-07-11 14:51:17.566078 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/350631738' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:51:17.575908 I | rook-ceph-mon2: 2017-07-11 14:51:17.575868 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:17.578208 I | rook-ceph-mon2: 2017-07-11 14:51:17.578188 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1005789703' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:18.979474 I | rook-ceph-mon2: 2017-07-11 14:51:18.979441 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:51:18.979715 I | rook-ceph-mon2: 2017-07-11 14:51:18.979651 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1763263775' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:51:21.009345 I | rook-ceph-mon2: 2017-07-11 14:51:21.009309 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:21.010221 I | rook-ceph-mon2: 2017-07-11 14:51:21.010199 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3542971553' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:22.898827 I | rook-ceph-mon2: 2017-07-11 14:51:22.898792 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:22.899021 I | rook-ceph-mon2: 2017-07-11 14:51:22.898936 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3176091447' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:24.127674 I | rook-ceph-mon2: 2017-07-11 14:51:24.127628 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:51:24.127744 I | rook-ceph-mon2: 2017-07-11 14:51:24.127729 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/315650135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:51:26.286191 I | rook-ceph-mon2: 2017-07-11 14:51:26.286147 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:26.286303 I | rook-ceph-mon2: 2017-07-11 14:51:26.286288 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1086749517' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:26.728008 I | rook-ceph-mon2: 2017-07-11 14:51:26.727960 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:26.728237 I | rook-ceph-mon2: 2017-07-11 14:51:26.728219 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1923784499' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:27.829546 I | rook-ceph-mon2: 2017-07-11 14:51:27.829512 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:27.835424 I | rook-ceph-mon2: 2017-07-11 14:51:27.835404 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3659945708' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:28.817345 I | rook-ceph-mon2: 2017-07-11 14:51:28.817310 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:51:28.817505 I | rook-ceph-mon2: 2017-07-11 14:51:28.817488 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/724954647' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:51:29.715956 I | rook-ceph-mon2: 2017-07-11 14:51:29.715923 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:29.716064 I | rook-ceph-mon2: 2017-07-11 14:51:29.716049 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1265854021' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:31.642269 I | rook-ceph-mon2: 2017-07-11 14:51:31.642224 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:31.642422 I | rook-ceph-mon2: 2017-07-11 14:51:31.642406 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1185258694' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:32.046897 I | rook-ceph-mon2: 2017-07-11 14:51:32.046862 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:51:32.047034 I | rook-ceph-mon2: 2017-07-11 14:51:32.046994 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1390244581' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:51:32.630213 I | rook-ceph-mon2: 2017-07-11 14:51:32.630181 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:32.630390 I | rook-ceph-mon2: 2017-07-11 14:51:32.630308 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3427693612' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:36.206118 I | rook-ceph-mon2: 2017-07-11 14:51:36.206087 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:36.206288 I | rook-ceph-mon2: 2017-07-11 14:51:36.206217 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/661603036' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:36.655218 I | rook-ceph-mon2: 2017-07-11 14:51:36.655183 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:36.655402 I | rook-ceph-mon2: 2017-07-11 14:51:36.655314 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2626843589' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:37.125671 I | rook-ceph-mon2: 2017-07-11 14:51:37.125637 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:51:37.125853 I | rook-ceph-mon2: 2017-07-11 14:51:37.125766 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/998324224' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:51:38.794359 I | rook-ceph-mon2: 2017-07-11 14:51:38.794325 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:51:38.794575 I | rook-ceph-mon2: 2017-07-11 14:51:38.794469 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1896105827' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:51:39.797121 I | rook-ceph-mon2: 2017-07-11 14:51:39.797088 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:39.797306 I | rook-ceph-mon2: 2017-07-11 14:51:39.797225 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1955347795' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:41.085224 I | rook-ceph-mon2: 2017-07-11 14:51:41.085192 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:41.085455 I | rook-ceph-mon2: 2017-07-11 14:51:41.085417 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2748988698' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:41.949129 I | rook-ceph-mon2: 2017-07-11 14:51:41.949081 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:51:41.954784 I | rook-ceph-mon2: 2017-07-11 14:51:41.954754 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2775526936' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:51:43.431776 I | rook-ceph-mon2: 2017-07-11 14:51:43.431732 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:51:43.431960 I | rook-ceph-mon2: 2017-07-11 14:51:43.431917 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2337133187' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:51:44.548832 I | rook-ceph-mon2: 2017-07-11 14:51:44.548794 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:44.549054 I | rook-ceph-mon2: 2017-07-11 14:51:44.548944 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4039790759' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:46.486125 I | rook-ceph-mon2: 2017-07-11 14:51:46.486091 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:46.486358 I | rook-ceph-mon2: 2017-07-11 14:51:46.486319 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1789465013' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:46.892092 I | rook-ceph-mon2: 2017-07-11 14:51:46.892058 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:51:46.892280 I | rook-ceph-mon2: 2017-07-11 14:51:46.892197 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3408089567' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:51:47.703422 I | rook-ceph-mon2: 2017-07-11 14:51:47.703374 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:51:47.703615 I | rook-ceph-mon2: 2017-07-11 14:51:47.703533 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/50805609' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:51:48.436316 I | rook-ceph-mon2: 2017-07-11 14:51:48.436195 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:51:48.436395 I | rook-ceph-mon2: 2017-07-11 14:51:48.436221 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3493378515' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:51:49.519249 I | rook-ceph-mon2: 2017-07-11 14:51:49.519215 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:49.519426 I | rook-ceph-mon2: 2017-07-11 14:51:49.519351 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3406451014' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:54.423065 I | rook-ceph-mon2: 2017-07-11 14:51:54.423026 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:54.428980 I | rook-ceph-mon2: 2017-07-11 14:51:54.428959 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3779154637' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:55.858251 I | rook-ceph-mon2: 2017-07-11 14:51:55.858210 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:51:55.858476 I | rook-ceph-mon2: 2017-07-11 14:51:55.858459 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4036081055' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:51:56.318151 I | rook-ceph-mon2: 2017-07-11 14:51:56.318119 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:56.318251 I | rook-ceph-mon2: 2017-07-11 14:51:56.318237 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/533214013' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:57.166956 I | rook-ceph-mon2: 2017-07-11 14:51:57.166922 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:51:57.167195 I | rook-ceph-mon2: 2017-07-11 14:51:57.167178 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1438679393' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:51:58.122028 I | rook-ceph-mon2: 2017-07-11 14:51:58.121989 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:51:58.122260 I | rook-ceph-mon2: 2017-07-11 14:51:58.122220 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/140719510' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:51:58.184103 I | rook-ceph-mon2: 2017-07-11 14:51:58.183858 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4922 MB, avail 94264 MB
- 2017-07-11 14:52:01.190644 I | rook-ceph-mon2: 2017-07-11 14:52:01.190612 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:01.190746 I | rook-ceph-mon2: 2017-07-11 14:52:01.190732 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1624579930' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:03.018651 I | rook-ceph-mon2: 2017-07-11 14:52:03.018619 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:52:03.018822 I | rook-ceph-mon2: 2017-07-11 14:52:03.018749 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3476436112' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:52:04.097513 I | rook-ceph-mon2: 2017-07-11 14:52:04.097470 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:04.097751 I | rook-ceph-mon2: 2017-07-11 14:52:04.097734 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1814105981' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:05.689800 I | rook-ceph-mon2: 2017-07-11 14:52:05.689770 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:05.689907 I | rook-ceph-mon2: 2017-07-11 14:52:05.689891 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4037188727' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:06.155556 I | rook-ceph-mon2: 2017-07-11 14:52:06.155522 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:06.155737 I | rook-ceph-mon2: 2017-07-11 14:52:06.155650 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/221297172' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:06.603793 I | rook-ceph-mon2: 2017-07-11 14:52:06.603761 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:52:06.604016 I | rook-ceph-mon2: 2017-07-11 14:52:06.603988 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1559441364' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:52:06.987336 I | rook-ceph-mon2: 2017-07-11 14:52:06.987303 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:06.987512 I | rook-ceph-mon2: 2017-07-11 14:52:06.987436 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1165701345' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:08.933739 I | rook-ceph-mon2: 2017-07-11 14:52:08.933706 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:08.933929 I | rook-ceph-mon2: 2017-07-11 14:52:08.933844 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/565794420' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:11.573793 I | rook-ceph-mon2: 2017-07-11 14:52:11.573753 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:52:11.574065 I | rook-ceph-mon2: 2017-07-11 14:52:11.574046 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2684123789' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:52:11.952543 I | rook-ceph-mon2: 2017-07-11 14:52:11.952508 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:11.952667 I | rook-ceph-mon2: 2017-07-11 14:52:11.952651 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/978023220' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:12.985835 I | rook-ceph-mon2: 2017-07-11 14:52:12.979725 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:52:12.986140 I | rook-ceph-mon2: 2017-07-11 14:52:12.985466 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2899747919' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:52:13.916147 I | rook-ceph-mon2: 2017-07-11 14:52:13.916107 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:13.916375 I | rook-ceph-mon2: 2017-07-11 14:52:13.916269 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2463449559' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:16.470424 I | rook-ceph-mon2: 2017-07-11 14:52:16.470392 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:52:16.470524 I | rook-ceph-mon2: 2017-07-11 14:52:16.470510 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/554580280' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:52:16.828270 I | rook-ceph-mon2: 2017-07-11 14:52:16.828237 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:16.828430 I | rook-ceph-mon2: 2017-07-11 14:52:16.828363 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1338094942' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:17.946830 I | rook-ceph-mon2: 2017-07-11 14:52:17.946797 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:52:17.952604 I | rook-ceph-mon2: 2017-07-11 14:52:17.952584 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3382565999' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:52:21.009278 I | rook-ceph-mon2: 2017-07-11 14:52:21.009233 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:21.009483 I | rook-ceph-mon2: 2017-07-11 14:52:21.009398 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3273449626' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:23.757169 I | rook-ceph-mon2: 2017-07-11 14:52:23.757135 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:23.757363 I | rook-ceph-mon2: 2017-07-11 14:52:23.757272 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3705220693' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:25.543370 I | rook-ceph-mon2: 2017-07-11 14:52:25.543337 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:25.543577 I | rook-ceph-mon2: 2017-07-11 14:52:25.543471 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2237329641' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:25.991565 I | rook-ceph-mon2: 2017-07-11 14:52:25.991529 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:25.991764 I | rook-ceph-mon2: 2017-07-11 14:52:25.991671 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2764266235' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:26.835299 I | rook-ceph-mon2: 2017-07-11 14:52:26.835072 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:26.835391 I | rook-ceph-mon2: 2017-07-11 14:52:26.835094 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1957189443' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:30.308911 I | rook-ceph-mon2: 2017-07-11 14:52:30.308780 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:30.308978 I | rook-ceph-mon2: 2017-07-11 14:52:30.308803 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1355201284' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:30.754183 I | rook-ceph-mon2: 2017-07-11 14:52:30.754150 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:30.754286 I | rook-ceph-mon2: 2017-07-11 14:52:30.754272 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/136928373' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:31.241745 I | rook-ceph-mon2: 2017-07-11 14:52:31.241710 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:52:31.241858 I | rook-ceph-mon2: 2017-07-11 14:52:31.241843 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/289540729' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:52:32.552758 I | rook-ceph-mon2: 2017-07-11 14:52:32.552723 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:52:32.553052 I | rook-ceph-mon2: 2017-07-11 14:52:32.553017 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1193192610' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:52:33.739209 I | rook-ceph-mon2: 2017-07-11 14:52:33.739171 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:33.739405 I | rook-ceph-mon2: 2017-07-11 14:52:33.739317 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2250365755' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:35.869433 I | rook-ceph-mon2: 2017-07-11 14:52:35.869396 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:35.869632 I | rook-ceph-mon2: 2017-07-11 14:52:35.869543 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2743647374' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:36.326581 I | rook-ceph-mon2: 2017-07-11 14:52:36.326525 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:52:36.326792 I | rook-ceph-mon2: 2017-07-11 14:52:36.326685 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1688268315' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:52:36.844706 I | rook-ceph-mon2: 2017-07-11 14:52:36.844672 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:36.844884 I | rook-ceph-mon2: 2017-07-11 14:52:36.844807 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2667926379' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:40.643908 I | rook-ceph-mon2: 2017-07-11 14:52:40.643875 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:40.644155 I | rook-ceph-mon2: 2017-07-11 14:52:40.644138 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2426381214' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:45.184454 I | rook-ceph-mon2: 2017-07-11 14:52:45.184421 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:45.184558 I | rook-ceph-mon2: 2017-07-11 14:52:45.184543 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/733660935' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:46.124833 I | rook-ceph-mon2: 2017-07-11 14:52:46.124797 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:52:46.125117 I | rook-ceph-mon2: 2017-07-11 14:52:46.125016 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2569153398' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:52:46.587262 I | rook-ceph-mon2: 2017-07-11 14:52:46.587229 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:46.587432 I | rook-ceph-mon2: 2017-07-11 14:52:46.587358 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/439325459' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:47.573818 I | rook-ceph-mon2: 2017-07-11 14:52:47.573783 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:52:47.573995 I | rook-ceph-mon2: 2017-07-11 14:52:47.573924 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/206206283' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:52:50.022093 I | rook-ceph-mon2: 2017-07-11 14:52:50.022062 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:50.022301 I | rook-ceph-mon2: 2017-07-11 14:52:50.022192 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1721973404' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:51.036018 I | rook-ceph-mon2: 2017-07-11 14:52:51.035973 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:51.036399 I | rook-ceph-mon2: 2017-07-11 14:52:51.036299 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1412970517' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:51.546777 I | rook-ceph-mon2: 2017-07-11 14:52:51.546741 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:52:51.546960 I | rook-ceph-mon2: 2017-07-11 14:52:51.546883 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3617204921' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:52:51.921016 I | rook-ceph-mon2: 2017-07-11 14:52:51.920985 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:51.921238 I | rook-ceph-mon2: 2017-07-11 14:52:51.921115 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/924845389' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:52.937761 I | rook-ceph-mon2: 2017-07-11 14:52:52.937729 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:52:52.937952 I | rook-ceph-mon2: 2017-07-11 14:52:52.937869 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3925649711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:52:54.412877 I | rook-ceph-mon2: 2017-07-11 14:52:54.412840 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:52:54.412946 I | rook-ceph-mon2: 2017-07-11 14:52:54.412930 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2573099783' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:52:54.943492 I | rook-ceph-mon2: 2017-07-11 14:52:54.943460 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:54.943598 I | rook-ceph-mon2: 2017-07-11 14:52:54.943581 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3530964123' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:55.636915 I | rook-ceph-mon2: 2017-07-11 14:52:55.636881 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:55.637093 I | rook-ceph-mon2: 2017-07-11 14:52:55.637016 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3164866401' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:56.076665 I | rook-ceph-mon2: 2017-07-11 14:52:56.076619 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:52:56.076862 I | rook-ceph-mon2: 2017-07-11 14:52:56.076775 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/123313210' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:52:56.535155 I | rook-ceph-mon2: 2017-07-11 14:52:56.535119 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:52:56.541007 I | rook-ceph-mon2: 2017-07-11 14:52:56.540989 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3121958505' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:52:57.402913 I | rook-ceph-mon2: 2017-07-11 14:52:57.402877 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:52:57.403165 I | rook-ceph-mon2: 2017-07-11 14:52:57.403148 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/509797115' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:52:58.187500 I | rook-ceph-mon2: 2017-07-11 14:52:58.186444 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4922 MB, avail 94264 MB
- 2017-07-11 14:52:58.329735 I | rook-ceph-mon2: 2017-07-11 14:52:58.329699 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:58.329895 I | rook-ceph-mon2: 2017-07-11 14:52:58.329881 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/72225012' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:52:59.820117 I | rook-ceph-mon2: 2017-07-11 14:52:59.820080 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:52:59.820340 I | rook-ceph-mon2: 2017-07-11 14:52:59.820226 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/392085172' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:00.275149 I | rook-ceph-mon2: 2017-07-11 14:53:00.275114 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:00.275256 I | rook-ceph-mon2: 2017-07-11 14:53:00.275240 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/867720465' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:00.754657 I | rook-ceph-mon2: 2017-07-11 14:53:00.754623 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:53:00.754832 I | rook-ceph-mon2: 2017-07-11 14:53:00.754751 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2476297791' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:53:01.266974 I | rook-ceph-mon2: 2017-07-11 14:53:01.266922 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:01.267482 I | rook-ceph-mon2: 2017-07-11 14:53:01.267464 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2187681903' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:02.117764 I | rook-ceph-mon2: 2017-07-11 14:53:02.117730 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:53:02.123826 I | rook-ceph-mon2: 2017-07-11 14:53:02.117966 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/917229307' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:53:03.122716 I | rook-ceph-mon2: 2017-07-11 14:53:03.122680 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:03.128575 I | rook-ceph-mon2: 2017-07-11 14:53:03.122820 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3281958695' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:04.750523 I | rook-ceph-mon2: 2017-07-11 14:53:04.750488 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:04.750702 I | rook-ceph-mon2: 2017-07-11 14:53:04.750622 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1040940338' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:05.399713 I | rook-ceph-mon2: 2017-07-11 14:53:05.399669 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:05.399955 I | rook-ceph-mon2: 2017-07-11 14:53:05.399940 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/562452404' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:05.846881 I | rook-ceph-mon2: 2017-07-11 14:53:05.846845 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:53:05.847051 I | rook-ceph-mon2: 2017-07-11 14:53:05.846977 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1109069631' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:53:07.157866 I | rook-ceph-mon2: 2017-07-11 14:53:07.157831 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:53:07.157936 I | rook-ceph-mon2: 2017-07-11 14:53:07.157921 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3859670554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:53:08.121829 I | rook-ceph-mon2: 2017-07-11 14:53:08.115528 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:08.121980 I | rook-ceph-mon2: 2017-07-11 14:53:08.121940 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4003375409' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:10.101960 I | rook-ceph-mon2: 2017-07-11 14:53:10.101927 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:10.102127 I | rook-ceph-mon2: 2017-07-11 14:53:10.102063 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/49147418' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:10.605708 I | rook-ceph-mon2: 2017-07-11 14:53:10.605672 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:53:10.605818 I | rook-ceph-mon2: 2017-07-11 14:53:10.605802 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3456118569' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:53:11.051084 I | rook-ceph-mon2: 2017-07-11 14:53:11.051050 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:11.051306 I | rook-ceph-mon2: 2017-07-11 14:53:11.051266 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/731053991' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:11.878928 I | rook-ceph-mon2: 2017-07-11 14:53:11.878861 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:53:11.879126 I | rook-ceph-mon2: 2017-07-11 14:53:11.879097 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3438983675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:53:14.655422 I | rook-ceph-mon2: 2017-07-11 14:53:14.655391 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:14.655672 I | rook-ceph-mon2: 2017-07-11 14:53:14.655530 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1087171588' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:15.299774 I | rook-ceph-mon2: 2017-07-11 14:53:15.299740 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:15.299961 I | rook-ceph-mon2: 2017-07-11 14:53:15.299873 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2511531678' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:15.725873 I | rook-ceph-mon2: 2017-07-11 14:53:15.725840 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:53:15.726140 I | rook-ceph-mon2: 2017-07-11 14:53:15.726123 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2225720817' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:53:16.999507 I | rook-ceph-mon2: 2017-07-11 14:53:16.999464 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:53:16.999722 I | rook-ceph-mon2: 2017-07-11 14:53:16.999685 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/315618044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:53:19.571852 I | rook-ceph-mon2: 2017-07-11 14:53:19.571807 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:19.572028 I | rook-ceph-mon2: 2017-07-11 14:53:19.571947 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3452745424' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:20.078490 I | rook-ceph-mon2: 2017-07-11 14:53:20.078455 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:20.078679 I | rook-ceph-mon2: 2017-07-11 14:53:20.078588 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/141145294' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:20.500744 I | rook-ceph-mon2: 2017-07-11 14:53:20.500588 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:20.500814 I | rook-ceph-mon2: 2017-07-11 14:53:20.500609 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1692741310' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:21.074274 I | rook-ceph-mon2: 2017-07-11 14:53:21.073997 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:21.074390 I | rook-ceph-mon2: 2017-07-11 14:53:21.074020 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/459294900' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:21.915150 I | rook-ceph-mon2: 2017-07-11 14:53:21.915116 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:53:21.915315 I | rook-ceph-mon2: 2017-07-11 14:53:21.915245 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3941354636' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:53:24.489768 I | rook-ceph-mon2: 2017-07-11 14:53:24.489726 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:24.490018 I | rook-ceph-mon2: 2017-07-11 14:53:24.490000 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1765220473' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:29.385306 I | rook-ceph-mon2: 2017-07-11 14:53:29.385244 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:29.385538 I | rook-ceph-mon2: 2017-07-11 14:53:29.385498 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4177137927' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:30.358537 I | rook-ceph-mon2: 2017-07-11 14:53:30.358371 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:53:30.358610 I | rook-ceph-mon2: 2017-07-11 14:53:30.358390 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3416219740' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:53:31.741235 I | rook-ceph-mon2: 2017-07-11 14:53:31.741194 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:53:31.741428 I | rook-ceph-mon2: 2017-07-11 14:53:31.741344 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1450630495' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:53:34.336332 I | rook-ceph-mon2: 2017-07-11 14:53:34.336301 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:34.336511 I | rook-ceph-mon2: 2017-07-11 14:53:34.336429 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/236450546' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:34.807418 I | rook-ceph-mon2: 2017-07-11 14:53:34.807373 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:34.807695 I | rook-ceph-mon2: 2017-07-11 14:53:34.807654 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3633338401' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:35.427746 I | rook-ceph-mon2: 2017-07-11 14:53:35.427712 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:53:35.427939 I | rook-ceph-mon2: 2017-07-11 14:53:35.427854 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3613983310' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:53:36.010179 I | rook-ceph-mon2: 2017-07-11 14:53:36.009857 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:36.010269 I | rook-ceph-mon2: 2017-07-11 14:53:36.009892 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1278961378' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:37.905722 I | rook-ceph-mon2: 2017-07-11 14:53:37.905686 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:37.905949 I | rook-ceph-mon2: 2017-07-11 14:53:37.905834 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2647210970' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:38.977994 I | rook-ceph-mon2: 2017-07-11 14:53:38.977957 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:38.980987 I | rook-ceph-mon2: 2017-07-11 14:53:38.980969 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2876798519' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:39.223429 I | rook-ceph-mon2: 2017-07-11 14:53:39.223400 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:39.223537 I | rook-ceph-mon2: 2017-07-11 14:53:39.223521 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3446411590' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:39.657058 I | rook-ceph-mon2: 2017-07-11 14:53:39.657024 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:39.657274 I | rook-ceph-mon2: 2017-07-11 14:53:39.657257 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1232865332' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:40.523000 I | rook-ceph-mon2: 2017-07-11 14:53:40.522906 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #121. Immutable memtables: 0.
- 2017-07-11 14:53:40.523083 I | rook-ceph-mon2:
- 2017-07-11 14:53:40.523104 I | rook-ceph-mon2: 2017-07-11 14:53:40.522950 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 77] Syncing log #118
- 2017-07-11 14:53:40.548106 I | rook-ceph-mon2: 2017-07-11 14:53:40.546294 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.522944) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:53:40.548175 I | rook-ceph-mon2: 2017-07-11 14:53:40.546304 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 77] Flushing memtable with next log file: 121
- 2017-07-11 14:53:40.548192 I | rook-ceph-mon2:
- 2017-07-11 14:53:40.548206 I | rook-ceph-mon2: 2017-07-11 14:53:40.546314 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784820546310, "job": 77, "event": "flush_started", "num_memtables": 1, "num_entries": 2311, "num_deletes": 251, "memory_usage": 7653744}
- 2017-07-11 14:53:40.548218 I | rook-ceph-mon2: 2017-07-11 14:53:40.546316 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 77] Level-0 flush table #122: started
- 2017-07-11 14:53:40.662624 I | rook-ceph-mon2: 2017-07-11 14:53:40.662577 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784820662566, "cf_name": "default", "job": 77, "event": "table_file_creation", "file_number": 122, "file_size": 5054475, "table_properties": {"data_size": 5036974, "index_size": 16681, "filter_size": 0, "raw_key_size": 17109, "raw_average_key_size": 18, "raw_value_size": 5012797, "raw_average_value_size": 5502, "num_data_blocks": 522, "num_entries": 911, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:53:40.662718 I | rook-ceph-mon2: 2017-07-11 14:53:40.662699 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 77] Level-0 flush table #122: 5054475 bytes OK
- 2017-07-11 14:53:40.730264 I | rook-ceph-mon2: 2017-07-11 14:53:40.730200 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.681115) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #122 started
- 2017-07-11 14:53:40.732954 I | rook-ceph-mon2: 2017-07-11 14:53:40.732934 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.730130) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #122: memtable #1 done
- 2017-07-11 14:53:40.733017 I | rook-ceph-mon2: 2017-07-11 14:53:40.732991 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.730159) EVENT_LOG_v1 {"time_micros": 1499784820730150, "job": 77, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:53:40.733049 I | rook-ceph-mon2: 2017-07-11 14:53:40.733035 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.730182) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:53:40.733081 I | rook-ceph-mon2:
- 2017-07-11 14:53:40.733112 I | rook-ceph-mon2: 2017-07-11 14:53:40.733099 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 77] Try to delete WAL files size 7598318, prev total WAL file size 7598318, number of live WAL files 2.
- 2017-07-11 14:53:40.733126 I | rook-ceph-mon2:
- 2017-07-11 14:53:40.750034 I | rook-ceph-mon2: 2017-07-11 14:53:40.734231 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:53:40.750109 I | rook-ceph-mon2: 2017-07-11 14:53:40.734279 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:53:40.734273) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:53:40.750132 I | rook-ceph-mon2:
- 2017-07-11 14:53:40.750161 I | rook-ceph-mon2: 2017-07-11 14:53:40.734285 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 78] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:53:40.750184 I | rook-ceph-mon2: 2017-07-11 14:53:40.734290 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 77 Base level 0, inputs: [122(4936KB)], [120(12MB)]
- 2017-07-11 14:53:40.750195 I | rook-ceph-mon2:
- 2017-07-11 14:53:40.750205 I | rook-ceph-mon2: 2017-07-11 14:53:40.734300 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784820734292, "job": 78, "event": "compaction_started", "files_L0": [122], "files_L1": [120], "score": -1, "input_data_size": 18650815}
- 2017-07-11 14:53:41.107509 I | rook-ceph-mon2: 2017-07-11 14:53:41.107462 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 78] Generated table #123: 2404 keys, 16097759 bytes
- 2017-07-11 14:53:41.113982 I | rook-ceph-mon2: 2017-07-11 14:53:41.113958 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784821113913, "cf_name": "default", "job": 78, "event": "table_file_creation", "file_number": 123, "file_size": 16097759, "table_properties": {"data_size": 16044346, "index_size": 52594, "filter_size": 0, "raw_key_size": 46477, "raw_average_key_size": 19, "raw_value_size": 15973922, "raw_average_value_size": 6644, "num_data_blocks": 1597, "num_entries": 2404, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:53:41.153685 I | rook-ceph-mon2: 2017-07-11 14:53:41.153646 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 78] Compacted 1@0 + 1@1 files to L1 => 16097759 bytes
- 2017-07-11 14:53:41.180619 I | rook-ceph-mon2: 2017-07-11 14:53:41.180583 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:53:41.180512) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 44.5 rd, 38.4 wr, level 1, files in(1, 1) out(1) MB in(4.8, 13.0) out(15.4), read-write-amplify(6.9) write-amplify(3.2) OK, records in: 2913, records dropped: 509
- 2017-07-11 14:53:41.180887 I | rook-ceph-mon2:
- 2017-07-11 14:53:41.181010 I | rook-ceph-mon2: 2017-07-11 14:53:41.180990 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:53:41.180536) EVENT_LOG_v1 {"time_micros": 1499784821180527, "job": 78, "event": "compaction_finished", "compaction_time_micros": 419326, "output_level": 1, "num_output_files": 1, "total_output_size": 16097759, "num_input_records": 2913, "num_output_records": 2404, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:53:41.194764 I | rook-ceph-mon2: 2017-07-11 14:53:41.194743 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784821194736, "job": 78, "event": "table_file_deletion", "file_number": 122}
- 2017-07-11 14:53:41.196175 I | rook-ceph-mon2: 2017-07-11 14:53:41.196161 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784821196159, "job": 78, "event": "table_file_deletion", "file_number": 120}
- 2017-07-11 14:53:43.212991 I | rook-ceph-mon2: 2017-07-11 14:53:43.207309 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:43.213085 I | rook-ceph-mon2: 2017-07-11 14:53:43.212512 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1618581052' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:44.673830 I | rook-ceph-mon2: 2017-07-11 14:53:44.673794 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:44.679712 I | rook-ceph-mon2: 2017-07-11 14:53:44.679692 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1710361669' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:45.598347 I | rook-ceph-mon2: 2017-07-11 14:53:45.598312 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:53:45.598556 I | rook-ceph-mon2: 2017-07-11 14:53:45.598442 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/719419820' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:53:46.964106 I | rook-ceph-mon2: 2017-07-11 14:53:46.964061 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:53:46.964246 I | rook-ceph-mon2: 2017-07-11 14:53:46.964231 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3038098581' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:53:48.035922 I | rook-ceph-mon2: 2017-07-11 14:53:48.035888 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:48.036026 I | rook-ceph-mon2: 2017-07-11 14:53:48.036010 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/617497945' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:49.636876 I | rook-ceph-mon2: 2017-07-11 14:53:49.636840 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:49.637091 I | rook-ceph-mon2: 2017-07-11 14:53:49.636987 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3547158146' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:50.101161 I | rook-ceph-mon2: 2017-07-11 14:53:50.101128 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:53:50.101390 I | rook-ceph-mon2: 2017-07-11 14:53:50.101359 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3776552256' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:53:52.578450 I | rook-ceph-mon2: 2017-07-11 14:53:52.578402 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:52.578686 I | rook-ceph-mon2: 2017-07-11 14:53:52.578643 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2895876595' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:53.806958 I | rook-ceph-mon2: 2017-07-11 14:53:53.806912 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:53.807163 I | rook-ceph-mon2: 2017-07-11 14:53:53.807084 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3358916980' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:54.611311 I | rook-ceph-mon2: 2017-07-11 14:53:54.611275 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:54.611502 I | rook-ceph-mon2: 2017-07-11 14:53:54.611420 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/616272323' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:55.180909 I | rook-ceph-mon2: 2017-07-11 14:53:55.180871 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:53:55.181135 I | rook-ceph-mon2: 2017-07-11 14:53:55.181105 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2577285836' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:53:55.653956 I | rook-ceph-mon2: 2017-07-11 14:53:55.653922 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:53:55.654196 I | rook-ceph-mon2: 2017-07-11 14:53:55.654142 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2993497886' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:53:56.605073 I | rook-ceph-mon2: 2017-07-11 14:53:56.605040 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:53:56.610957 I | rook-ceph-mon2: 2017-07-11 14:53:56.610936 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2806848963' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:53:57.189808 I | rook-ceph-mon2: 2017-07-11 14:53:57.189769 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:53:57.190131 I | rook-ceph-mon2: 2017-07-11 14:53:57.190099 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2400885949' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:53:57.559560 I | rook-ceph-mon2: 2017-07-11 14:53:57.559524 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:57.559678 I | rook-ceph-mon2: 2017-07-11 14:53:57.559662 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4031445614' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:58.187150 I | rook-ceph-mon2: 2017-07-11 14:53:58.186974 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4925 MB, avail 94262 MB
- 2017-07-11 14:53:58.902996 I | rook-ceph-mon2: 2017-07-11 14:53:58.902961 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:53:58.903113 I | rook-ceph-mon2: 2017-07-11 14:53:58.903097 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4095446523' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:53:59.810941 I | rook-ceph-mon2: 2017-07-11 14:53:59.810905 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:53:59.811142 I | rook-ceph-mon2: 2017-07-11 14:53:59.811050 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1428021259' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:54:00.453730 I | rook-ceph-mon2: 2017-07-11 14:54:00.453698 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:00.453921 I | rook-ceph-mon2: 2017-07-11 14:54:00.453904 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2852106977' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:01.476770 I | rook-ceph-mon2: 2017-07-11 14:54:01.476733 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:54:01.482720 I | rook-ceph-mon2: 2017-07-11 14:54:01.482694 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2925336793' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:54:02.313532 I | rook-ceph-mon2: 2017-07-11 14:54:02.313495 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:02.313726 I | rook-ceph-mon2: 2017-07-11 14:54:02.313634 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3620602609' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:06.497322 I | rook-ceph-mon2: 2017-07-11 14:54:06.497288 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:54:06.497509 I | rook-ceph-mon2: 2017-07-11 14:54:06.497428 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3114795125' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:54:08.746867 I | rook-ceph-mon2: 2017-07-11 14:54:08.746834 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:08.747049 I | rook-ceph-mon2: 2017-07-11 14:54:08.746970 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/740630686' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:09.212813 I | rook-ceph-mon2: 2017-07-11 14:54:09.212768 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:09.212920 I | rook-ceph-mon2: 2017-07-11 14:54:09.212905 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4213976092' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:12.001417 I | rook-ceph-mon2: 2017-07-11 14:54:12.001370 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:12.001654 I | rook-ceph-mon2: 2017-07-11 14:54:12.001604 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/285498025' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:14.146581 I | rook-ceph-mon2: 2017-07-11 14:54:14.146534 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:14.146756 I | rook-ceph-mon2: 2017-07-11 14:54:14.146678 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2751317486' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:15.540030 I | rook-ceph-mon2: 2017-07-11 14:54:15.539996 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:15.540262 I | rook-ceph-mon2: 2017-07-11 14:54:15.540140 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3773792824' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:18.645342 I | rook-ceph-mon2: 2017-07-11 14:54:18.645313 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:18.645544 I | rook-ceph-mon2: 2017-07-11 14:54:18.645461 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2397026204' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:19.109093 I | rook-ceph-mon2: 2017-07-11 14:54:19.109039 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:19.109287 I | rook-ceph-mon2: 2017-07-11 14:54:19.109270 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3157759492' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:19.680936 I | rook-ceph-mon2: 2017-07-11 14:54:19.680752 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:54:19.681021 I | rook-ceph-mon2: 2017-07-11 14:54:19.680795 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2189110789' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:54:21.959881 I | rook-ceph-mon2: 2017-07-11 14:54:21.959847 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:21.960065 I | rook-ceph-mon2: 2017-07-11 14:54:21.959982 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2915860724' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:24.096605 I | rook-ceph-mon2: 2017-07-11 14:54:24.096569 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:24.096861 I | rook-ceph-mon2: 2017-07-11 14:54:24.096845 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3789378435' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:24.543881 I | rook-ceph-mon2: 2017-07-11 14:54:24.543822 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:54:24.544356 I | rook-ceph-mon2: 2017-07-11 14:54:24.544269 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/599660555' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:54:26.066119 I | rook-ceph-mon2: 2017-07-11 14:54:26.066082 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:54:26.066591 I | rook-ceph-mon2: 2017-07-11 14:54:26.066572 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1985982882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:54:26.890512 I | rook-ceph-mon2: 2017-07-11 14:54:26.890455 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:26.897026 I | rook-ceph-mon2: 2017-07-11 14:54:26.896301 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3623559110' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:28.442589 I | rook-ceph-mon2: 2017-07-11 14:54:28.442548 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:28.448477 I | rook-ceph-mon2: 2017-07-11 14:54:28.448458 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1351271787' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:31.920835 I | rook-ceph-mon2: 2017-07-11 14:54:31.920799 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:31.921027 I | rook-ceph-mon2: 2017-07-11 14:54:31.920942 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3029189489' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:35.082780 I | rook-ceph-mon2: 2017-07-11 14:54:35.082742 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:35.083015 I | rook-ceph-mon2: 2017-07-11 14:54:35.082996 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3776047209' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:36.064147 I | rook-ceph-mon2: 2017-07-11 14:54:36.064110 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:54:36.064745 I | rook-ceph-mon2: 2017-07-11 14:54:36.064722 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1376077828' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:54:36.403671 I | rook-ceph-mon2: 2017-07-11 14:54:35.635715 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1900 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0516715s > max 0.05s
- 2017-07-11 14:54:36.403773 I | rook-ceph-mon2: 2017-07-11 14:54:35.636147 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1901 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.184127s > max 0.05s
- 2017-07-11 14:54:37.244215 I | rook-ceph-mon2: 2017-07-11 14:54:37.244177 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:37.244482 I | rook-ceph-mon2: 2017-07-11 14:54:37.244440 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4148283445' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:38.307800 I | rook-ceph-mon2: 2017-07-11 14:54:38.307771 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:38.307904 I | rook-ceph-mon2: 2017-07-11 14:54:38.307889 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1497995062' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:38.742144 I | rook-ceph-mon2: 2017-07-11 14:54:38.742109 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:38.742324 I | rook-ceph-mon2: 2017-07-11 14:54:38.742236 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1555353789' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:39.248729 I | rook-ceph-mon2: 2017-07-11 14:54:39.248692 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:54:39.248839 I | rook-ceph-mon2: 2017-07-11 14:54:39.248823 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3531839543' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:54:39.506133 I | rook-ceph-mon2: 2017-07-11 14:54:39.504548 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #124. Immutable memtables: 0.
- 2017-07-11 14:54:39.506224 I | rook-ceph-mon2:
- 2017-07-11 14:54:39.506244 I | rook-ceph-mon2: 2017-07-11 14:54:39.504643 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 79] Syncing log #121
- 2017-07-11 14:54:39.540177 I | rook-ceph-mon2: 2017-07-11 14:54:39.538128 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.504637) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:54:39.540941 I | rook-ceph-mon2: 2017-07-11 14:54:39.538138 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 79] Flushing memtable with next log file: 124
- 2017-07-11 14:54:39.546863 I | rook-ceph-mon2:
- 2017-07-11 14:54:39.547098 I | rook-ceph-mon2: 2017-07-11 14:54:39.538147 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784879538143, "job": 79, "event": "flush_started", "num_memtables": 1, "num_entries": 1116, "num_deletes": 502, "memory_usage": 2307704}
- 2017-07-11 14:54:39.547131 I | rook-ceph-mon2: 2017-07-11 14:54:39.538149 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 79] Level-0 flush table #125: started
- 2017-07-11 14:54:39.750113 I | rook-ceph-mon2: 2017-07-11 14:54:39.748699 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784879748689, "cf_name": "default", "job": 79, "event": "table_file_creation", "file_number": 125, "file_size": 1516529, "table_properties": {"data_size": 1510769, "index_size": 4945, "filter_size": 0, "raw_key_size": 13658, "raw_average_key_size": 19, "raw_value_size": 1497845, "raw_average_value_size": 2130, "num_data_blocks": 158, "num_entries": 703, "filter_policy_name": "", "kDeletedKeys": "502", "kMergeOperands": "0"}}
- 2017-07-11 14:54:39.750180 I | rook-ceph-mon2: 2017-07-11 14:54:39.748711 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 79] Level-0 flush table #125: 1516529 bytes OK
- 2017-07-11 14:54:39.767215 I | rook-ceph-mon2: 2017-07-11 14:54:39.767168 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:39.767305 I | rook-ceph-mon2: 2017-07-11 14:54:39.767288 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1102162789' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:39.826970 I | rook-ceph-mon2: 2017-07-11 14:54:39.826932 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.782152) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #125 started
- 2017-07-11 14:54:39.827072 I | rook-ceph-mon2: 2017-07-11 14:54:39.827056 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.826863) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #125: memtable #1 done
- 2017-07-11 14:54:39.827123 I | rook-ceph-mon2: 2017-07-11 14:54:39.827092 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.826881) EVENT_LOG_v1 {"time_micros": 1499784879826876, "job": 79, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:54:39.827156 I | rook-ceph-mon2: 2017-07-11 14:54:39.827142 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.826914) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:54:39.827194 I | rook-ceph-mon2:
- 2017-07-11 14:54:39.827230 I | rook-ceph-mon2: 2017-07-11 14:54:39.827217 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 79] Try to delete WAL files size 2283415, prev total WAL file size 2283415, number of live WAL files 2.
- 2017-07-11 14:54:39.827244 I | rook-ceph-mon2:
- 2017-07-11 14:54:39.828089 I | rook-ceph-mon2: 2017-07-11 14:54:39.827709 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:54:39.828140 I | rook-ceph-mon2: 2017-07-11 14:54:39.827749 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:54:39.827744) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 14:54:39.828158 I | rook-ceph-mon2:
- 2017-07-11 14:54:39.828170 I | rook-ceph-mon2: 2017-07-11 14:54:39.827754 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 80] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:54:39.828182 I | rook-ceph-mon2: 2017-07-11 14:54:39.827759 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 79 Base level 0, inputs: [125(1480KB)], [123(15MB)]
- 2017-07-11 14:54:39.828232 I | rook-ceph-mon2:
- 2017-07-11 14:54:39.828261 I | rook-ceph-mon2: 2017-07-11 14:54:39.827768 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784879827761, "job": 80, "event": "compaction_started", "files_L0": [125], "files_L1": [123], "score": -1, "input_data_size": 17614288}
- 2017-07-11 14:54:40.007371 I | rook-ceph-mon2: 2017-07-11 14:54:40.007322 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 80] Generated table #126: 2096 keys, 14538518 bytes
- 2017-07-11 14:54:40.007514 I | rook-ceph-mon2: 2017-07-11 14:54:40.007494 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784880007485, "cf_name": "default", "job": 80, "event": "table_file_creation", "file_number": 126, "file_size": 14538518, "table_properties": {"data_size": 14489812, "index_size": 47887, "filter_size": 0, "raw_key_size": 40373, "raw_average_key_size": 19, "raw_value_size": 14426988, "raw_average_value_size": 6883, "num_data_blocks": 1468, "num_entries": 2096, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:54:40.037393 I | rook-ceph-mon2: 2017-07-11 14:54:40.037365 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 80] Compacted 1@0 + 1@1 files to L1 => 14538518 bytes
- 2017-07-11 14:54:40.075698 I | rook-ceph-mon2: 2017-07-11 14:54:40.075666 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:54:40.075609) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 84.0 rd, 69.4 wr, level 1, files in(1, 1) out(1) MB in(1.4, 15.4) out(13.9), read-write-amplify(21.2) write-amplify(9.6) OK, records in: 3107, records dropped: 1011
- 2017-07-11 14:54:40.076944 I | rook-ceph-mon2:
- 2017-07-11 14:54:40.077047 I | rook-ceph-mon2: 2017-07-11 14:54:40.076993 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:54:40.075628) EVENT_LOG_v1 {"time_micros": 1499784880075620, "job": 80, "event": "compaction_finished", "compaction_time_micros": 209583, "output_level": 1, "num_output_files": 1, "total_output_size": 14538518, "num_input_records": 3107, "num_output_records": 2096, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:54:40.077395 I | rook-ceph-mon2: 2017-07-11 14:54:40.077380 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784880077378, "job": 80, "event": "table_file_deletion", "file_number": 125}
- 2017-07-11 14:54:40.084972 I | rook-ceph-mon2: 2017-07-11 14:54:40.084953 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499784880084951, "job": 80, "event": "table_file_deletion", "file_number": 123}
- 2017-07-11 14:54:40.085116 I | rook-ceph-mon2: 2017-07-11 14:54:40.085057 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:54:41.738166 I | rook-ceph-mon2: 2017-07-11 14:54:41.738119 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:41.738334 I | rook-ceph-mon2: 2017-07-11 14:54:41.738261 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1638706481' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:43.679994 I | rook-ceph-mon2: 2017-07-11 14:54:43.679962 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:43.680098 I | rook-ceph-mon2: 2017-07-11 14:54:43.680084 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/810837033' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:44.121517 I | rook-ceph-mon2: 2017-07-11 14:54:44.121478 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:54:44.121758 I | rook-ceph-mon2: 2017-07-11 14:54:44.121626 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2821925799' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:54:44.658950 I | rook-ceph-mon2: 2017-07-11 14:54:44.658916 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:44.659056 I | rook-ceph-mon2: 2017-07-11 14:54:44.659040 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3365991417' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:45.806371 I | rook-ceph-mon2: 2017-07-11 14:54:45.806335 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:54:45.806547 I | rook-ceph-mon2: 2017-07-11 14:54:45.806470 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/918448348' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:54:48.336933 I | rook-ceph-mon2: 2017-07-11 14:54:48.336897 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:48.337179 I | rook-ceph-mon2: 2017-07-11 14:54:48.337161 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1116201355' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:48.839800 I | rook-ceph-mon2: 2017-07-11 14:54:48.839766 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:48.840065 I | rook-ceph-mon2: 2017-07-11 14:54:48.840043 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3220760054' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:51.264855 I | rook-ceph-mon2: 2017-07-11 14:54:51.264628 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:54:51.264931 I | rook-ceph-mon2: 2017-07-11 14:54:51.264655 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1932130380' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:54:52.104740 I | rook-ceph-mon2: 2017-07-11 14:54:52.104707 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:52.104913 I | rook-ceph-mon2: 2017-07-11 14:54:52.104842 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2272122976' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:52.774011 I | rook-ceph-mon2: 2017-07-11 14:54:52.773974 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:54:52.776915 I | rook-ceph-mon2: 2017-07-11 14:54:52.776896 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3042625328' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:54:53.094771 I | rook-ceph-mon2: 2017-07-11 14:54:53.094738 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:53.094939 I | rook-ceph-mon2: 2017-07-11 14:54:53.094867 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3123408642' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:53.570717 I | rook-ceph-mon2: 2017-07-11 14:54:53.570681 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:53.570910 I | rook-ceph-mon2: 2017-07-11 14:54:53.570824 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1261415348' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:54:56.570267 I | rook-ceph-mon2: 2017-07-11 14:54:56.570232 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:56.570829 I | rook-ceph-mon2: 2017-07-11 14:54:56.570373 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3742042026' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:57.984699 I | rook-ceph-mon2: 2017-07-11 14:54:57.984668 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:54:57.984863 I | rook-ceph-mon2: 2017-07-11 14:54:57.984788 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4242936547' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:54:58.190059 I | rook-ceph-mon2: 2017-07-11 14:54:58.189803 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94263 MB
- 2017-07-11 14:54:58.879027 I | rook-ceph-mon2: 2017-07-11 14:54:58.878765 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:54:58.879108 I | rook-ceph-mon2: 2017-07-11 14:54:58.878803 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/750508628' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:02.897006 I | rook-ceph-mon2: 2017-07-11 14:55:02.896970 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:02.897186 I | rook-ceph-mon2: 2017-07-11 14:55:02.897111 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2873613240' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:03.394231 I | rook-ceph-mon2: 2017-07-11 14:55:03.394195 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:03.394456 I | rook-ceph-mon2: 2017-07-11 14:55:03.394416 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3143332295' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:03.844189 I | rook-ceph-mon2: 2017-07-11 14:55:03.844154 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:55:03.844321 I | rook-ceph-mon2: 2017-07-11 14:55:03.844251 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3339232618' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:55:04.305772 I | rook-ceph-mon2: 2017-07-11 14:55:04.305728 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:04.306020 I | rook-ceph-mon2: 2017-07-11 14:55:04.306004 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2865759119' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:05.930615 I | rook-ceph-mon2: 2017-07-11 14:55:05.336568 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 1919 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 14:55:07.831134 I | rook-ceph-mon2: 2017-07-11 14:55:07.831101 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:07.831318 I | rook-ceph-mon2: 2017-07-11 14:55:07.831244 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1726821439' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:13.252836 I | rook-ceph-mon2: 2017-07-11 14:55:13.252803 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:13.252939 I | rook-ceph-mon2: 2017-07-11 14:55:13.252924 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2272822349' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:13.788852 I | rook-ceph-mon2: 2017-07-11 14:55:13.788822 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:55:13.788961 I | rook-ceph-mon2: 2017-07-11 14:55:13.788943 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3003095023' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:55:14.280542 I | rook-ceph-mon2: 2017-07-11 14:55:14.280497 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:14.280658 I | rook-ceph-mon2: 2017-07-11 14:55:14.280642 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2809810137' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:16.565516 I | rook-ceph-mon2: 2017-07-11 14:55:16.565483 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:16.565698 I | rook-ceph-mon2: 2017-07-11 14:55:16.565619 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1737774904' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:17.774249 I | rook-ceph-mon2: 2017-07-11 14:55:17.774218 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:17.774430 I | rook-ceph-mon2: 2017-07-11 14:55:17.774346 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1084711989' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:18.302366 I | rook-ceph-mon2: 2017-07-11 14:55:18.302331 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:18.302619 I | rook-ceph-mon2: 2017-07-11 14:55:18.302591 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/223234514' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:19.274349 I | rook-ceph-mon2: 2017-07-11 14:55:19.274316 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:19.274454 I | rook-ceph-mon2: 2017-07-11 14:55:19.274439 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4129769454' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:22.639935 I | rook-ceph-mon2: 2017-07-11 14:55:22.639901 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:22.640149 I | rook-ceph-mon2: 2017-07-11 14:55:22.640110 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/435412643' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:23.547685 I | rook-ceph-mon2: 2017-07-11 14:55:23.547648 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:55:23.547880 I | rook-ceph-mon2: 2017-07-11 14:55:23.547792 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3174615311' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:55:24.056646 I | rook-ceph-mon2: 2017-07-11 14:55:24.056612 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:24.056827 I | rook-ceph-mon2: 2017-07-11 14:55:24.056747 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2974473469' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:26.254413 I | rook-ceph-mon2: 2017-07-11 14:55:26.254379 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:26.254679 I | rook-ceph-mon2: 2017-07-11 14:55:26.254606 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3707311992' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:27.573118 I | rook-ceph-mon2: 2017-07-11 14:55:27.573073 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:27.579623 I | rook-ceph-mon2: 2017-07-11 14:55:27.579025 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/689486441' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:28.027915 I | rook-ceph-mon2: 2017-07-11 14:55:28.027871 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:28.028038 I | rook-ceph-mon2: 2017-07-11 14:55:28.028020 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2104461606' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:29.313680 I | rook-ceph-mon2: 2017-07-11 14:55:29.313637 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:29.313877 I | rook-ceph-mon2: 2017-07-11 14:55:29.313790 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/861081887' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:30.223243 I | rook-ceph-mon2: 2017-07-11 14:55:30.223211 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:55:30.223352 I | rook-ceph-mon2: 2017-07-11 14:55:30.223337 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1000752340' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:55:31.234763 I | rook-ceph-mon2: 2017-07-11 14:55:31.234712 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:31.234970 I | rook-ceph-mon2: 2017-07-11 14:55:31.234879 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2170208339' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:32.547022 I | rook-ceph-mon2: 2017-07-11 14:55:32.546991 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:32.547203 I | rook-ceph-mon2: 2017-07-11 14:55:32.547118 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4118345715' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:33.244703 I | rook-ceph-mon2: 2017-07-11 14:55:33.244667 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:33.244899 I | rook-ceph-mon2: 2017-07-11 14:55:33.244812 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1473128304' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:34.761314 I | rook-ceph-mon2: 2017-07-11 14:55:34.761207 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:34.761590 I | rook-ceph-mon2: 2017-07-11 14:55:34.761477 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2061028784' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:36.767592 I | rook-ceph-mon2: 2017-07-11 14:55:36.767530 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:36.767820 I | rook-ceph-mon2: 2017-07-11 14:55:36.767716 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3913304287' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:37.737483 I | rook-ceph-mon2: 2017-07-11 14:55:37.737438 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:37.744052 I | rook-ceph-mon2: 2017-07-11 14:55:37.737587 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1614602714' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:38.721357 I | rook-ceph-mon2: 2017-07-11 14:55:38.721323 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:55:38.721586 I | rook-ceph-mon2: 2017-07-11 14:55:38.721460 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3024997188' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:55:39.163198 I | rook-ceph-mon2: 2017-07-11 14:55:39.163162 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:39.163414 I | rook-ceph-mon2: 2017-07-11 14:55:39.163307 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4150645351' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:40.544345 I | rook-ceph-mon2: 2017-07-11 14:55:40.544314 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:55:40.544556 I | rook-ceph-mon2: 2017-07-11 14:55:40.544525 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3000574438' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:55:41.467378 I | rook-ceph-mon2: 2017-07-11 14:55:41.467331 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:41.467553 I | rook-ceph-mon2: 2017-07-11 14:55:41.467474 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/235168719' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:42.417966 I | rook-ceph-mon2: 2017-07-11 14:55:42.417935 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:42.418150 I | rook-ceph-mon2: 2017-07-11 14:55:42.418066 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2486123722' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:43.311417 I | rook-ceph-mon2: 2017-07-11 14:55:43.311383 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:55:43.311522 I | rook-ceph-mon2: 2017-07-11 14:55:43.311507 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/930104160' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:55:43.809245 I | rook-ceph-mon2: 2017-07-11 14:55:43.809208 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:43.809416 I | rook-ceph-mon2: 2017-07-11 14:55:43.809345 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1096714726' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:44.736228 I | rook-ceph-mon2: 2017-07-11 14:55:44.736194 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:55:44.736463 I | rook-ceph-mon2: 2017-07-11 14:55:44.736334 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1858865030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:55:45.861874 I | rook-ceph-mon2: 2017-07-11 14:55:45.861839 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:45.862066 I | rook-ceph-mon2: 2017-07-11 14:55:45.861968 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3289098345' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:47.359826 I | rook-ceph-mon2: 2017-07-11 14:55:47.359785 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:47.360058 I | rook-ceph-mon2: 2017-07-11 14:55:47.360041 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/158060936' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:47.845616 I | rook-ceph-mon2: 2017-07-11 14:55:47.845583 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:47.845803 I | rook-ceph-mon2: 2017-07-11 14:55:47.845716 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4211902021' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:48.342824 I | rook-ceph-mon2: 2017-07-11 14:55:48.342792 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:55:48.342932 I | rook-ceph-mon2: 2017-07-11 14:55:48.342916 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3579942119' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:55:50.941543 I | rook-ceph-mon2: 2017-07-11 14:55:50.941502 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:50.941768 I | rook-ceph-mon2: 2017-07-11 14:55:50.941652 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2465991139' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:52.267213 I | rook-ceph-mon2: 2017-07-11 14:55:52.267182 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:52.267398 I | rook-ceph-mon2: 2017-07-11 14:55:52.267322 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/274800564' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:53.175746 I | rook-ceph-mon2: 2017-07-11 14:55:53.175701 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:55:53.175966 I | rook-ceph-mon2: 2017-07-11 14:55:53.175847 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1875528910' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:55:53.888049 I | rook-ceph-mon2: 2017-07-11 14:55:53.888016 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:53.888233 I | rook-ceph-mon2: 2017-07-11 14:55:53.888152 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/795623861' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:54.823808 I | rook-ceph-mon2: 2017-07-11 14:55:54.823775 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:55:54.824014 I | rook-ceph-mon2: 2017-07-11 14:55:54.823933 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/786742335' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:55:55.963652 I | rook-ceph-mon2: 2017-07-11 14:55:55.963618 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:55:55.963900 I | rook-ceph-mon2: 2017-07-11 14:55:55.963883 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2370300463' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:55:56.763639 I | rook-ceph-mon2: 2017-07-11 14:55:56.763575 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:55:56.763812 I | rook-ceph-mon2: 2017-07-11 14:55:56.763737 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2776634781' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:55:57.721689 I | rook-ceph-mon2: 2017-07-11 14:55:57.721641 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:57.721793 I | rook-ceph-mon2: 2017-07-11 14:55:57.721779 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1599873876' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:58.184182 I | rook-ceph-mon2: 2017-07-11 14:55:58.184008 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:55:58.184249 I | rook-ceph-mon2: 2017-07-11 14:55:58.184030 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3135327706' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:55:58.205755 I | rook-ceph-mon2: 2017-07-11 14:55:58.190011 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94263 MB
- 2017-07-11 14:55:58.773223 I | rook-ceph-mon2: 2017-07-11 14:55:58.773189 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:55:58.773384 I | rook-ceph-mon2: 2017-07-11 14:55:58.773367 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2814605764' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:55:59.684949 I | rook-ceph-mon2: 2017-07-11 14:55:59.684912 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:55:59.685165 I | rook-ceph-mon2: 2017-07-11 14:55:59.685134 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3500365075' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:56:00.685414 I | rook-ceph-mon2: 2017-07-11 14:56:00.685379 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:00.685624 I | rook-ceph-mon2: 2017-07-11 14:56:00.685586 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3853840991' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:02.565935 I | rook-ceph-mon2: 2017-07-11 14:56:02.565902 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:02.566242 I | rook-ceph-mon2: 2017-07-11 14:56:02.566225 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2596137474' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:03.117472 I | rook-ceph-mon2: 2017-07-11 14:56:03.117441 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:56:03.117581 I | rook-ceph-mon2: 2017-07-11 14:56:03.117566 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1043498657' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:56:03.560704 I | rook-ceph-mon2: 2017-07-11 14:56:03.554053 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:03.560787 I | rook-ceph-mon2: 2017-07-11 14:56:03.554074 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1381872168' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:04.502216 I | rook-ceph-mon2: 2017-07-11 14:56:04.502182 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:56:04.502411 I | rook-ceph-mon2: 2017-07-11 14:56:04.502330 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1967614152' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:56:07.507056 I | rook-ceph-mon2: 2017-07-11 14:56:07.507022 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:07.507158 I | rook-ceph-mon2: 2017-07-11 14:56:07.507144 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/820869296' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:08.471976 I | rook-ceph-mon2: 2017-07-11 14:56:08.471923 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:08.472173 I | rook-ceph-mon2: 2017-07-11 14:56:08.472091 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4276888637' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:10.423963 I | rook-ceph-mon2: 2017-07-11 14:56:10.423895 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:10.424094 I | rook-ceph-mon2: 2017-07-11 14:56:10.424077 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2433582750' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:12.010689 I | rook-ceph-mon2: 2017-07-11 14:56:12.010658 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:12.010751 I | rook-ceph-mon2: 2017-07-11 14:56:12.010737 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1372664899' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:12.456268 I | rook-ceph-mon2: 2017-07-11 14:56:12.456234 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:12.456370 I | rook-ceph-mon2: 2017-07-11 14:56:12.456356 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4049178200' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:12.974839 I | rook-ceph-mon2: 2017-07-11 14:56:12.974794 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:56:12.974946 I | rook-ceph-mon2: 2017-07-11 14:56:12.974931 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3245606067' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:56:14.413465 I | rook-ceph-mon2: 2017-07-11 14:56:14.413435 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:56:14.413640 I | rook-ceph-mon2: 2017-07-11 14:56:14.413565 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1586769071' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:56:17.447005 I | rook-ceph-mon2: 2017-07-11 14:56:17.446972 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:17.447106 I | rook-ceph-mon2: 2017-07-11 14:56:17.447091 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3645631828' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:17.880143 I | rook-ceph-mon2: 2017-07-11 14:56:17.880108 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:56:17.880380 I | rook-ceph-mon2: 2017-07-11 14:56:17.880337 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1061238753' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:56:18.369794 I | rook-ceph-mon2: 2017-07-11 14:56:18.369757 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:18.369975 I | rook-ceph-mon2: 2017-07-11 14:56:18.369884 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2879988946' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:19.362894 I | rook-ceph-mon2: 2017-07-11 14:56:19.362861 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:56:19.363015 I | rook-ceph-mon2: 2017-07-11 14:56:19.363001 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1179255130' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:56:22.128653 I | rook-ceph-mon2: 2017-07-11 14:56:22.128619 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:56:22.130584 I | rook-ceph-mon2: 2017-07-11 14:56:22.130563 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2846030014' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:56:22.514718 I | rook-ceph-mon2: 2017-07-11 14:56:22.514681 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:22.514950 I | rook-ceph-mon2: 2017-07-11 14:56:22.514908 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/386991064' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:22.954594 I | rook-ceph-mon2: 2017-07-11 14:56:22.954558 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:56:22.954788 I | rook-ceph-mon2: 2017-07-11 14:56:22.954701 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2986720666' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:56:24.625506 I | rook-ceph-mon2: 2017-07-11 14:56:24.625473 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:56:24.625721 I | rook-ceph-mon2: 2017-07-11 14:56:24.625689 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1995358417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:56:26.803232 I | rook-ceph-mon2: 2017-07-11 14:56:26.803199 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:26.803336 I | rook-ceph-mon2: 2017-07-11 14:56:26.803321 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3850243750' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:27.953080 I | rook-ceph-mon2: 2017-07-11 14:56:27.953045 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:56:27.953285 I | rook-ceph-mon2: 2017-07-11 14:56:27.953182 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1079899226' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:56:28.411568 I | rook-ceph-mon2: 2017-07-11 14:56:28.411536 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:28.411880 I | rook-ceph-mon2: 2017-07-11 14:56:28.411850 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/91847240' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:30.325402 I | rook-ceph-mon2: 2017-07-11 14:56:30.325366 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:30.325655 I | rook-ceph-mon2: 2017-07-11 14:56:30.325637 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1322381462' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:31.837549 I | rook-ceph-mon2: 2017-07-11 14:56:31.837284 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:31.837827 I | rook-ceph-mon2: 2017-07-11 14:56:31.837305 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1854521954' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:32.204459 I | rook-ceph-mon2: 2017-07-11 14:56:32.204427 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:32.204563 I | rook-ceph-mon2: 2017-07-11 14:56:32.204549 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2891841258' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:33.181334 I | rook-ceph-mon2: 2017-07-11 14:56:33.181240 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:33.187265 I | rook-ceph-mon2: 2017-07-11 14:56:33.187241 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3974097461' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:34.166747 I | rook-ceph-mon2: 2017-07-11 14:56:34.166714 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:56:34.166920 I | rook-ceph-mon2: 2017-07-11 14:56:34.166844 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3398135432' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:56:36.694790 I | rook-ceph-mon2: 2017-07-11 14:56:36.694755 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:36.695057 I | rook-ceph-mon2: 2017-07-11 14:56:36.694887 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/672619511' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:37.067677 I | rook-ceph-mon2: 2017-07-11 14:56:37.067629 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:37.067797 I | rook-ceph-mon2: 2017-07-11 14:56:37.067782 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1511035472' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:37.634370 I | rook-ceph-mon2: 2017-07-11 14:56:37.634335 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:56:37.634585 I | rook-ceph-mon2: 2017-07-11 14:56:37.634477 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3879826275' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:56:38.123637 I | rook-ceph-mon2: 2017-07-11 14:56:38.123603 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:38.123741 I | rook-ceph-mon2: 2017-07-11 14:56:38.123727 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2672047516' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:40.413590 I | rook-ceph-mon2: 2017-07-11 14:56:40.413555 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:40.413767 I | rook-ceph-mon2: 2017-07-11 14:56:40.413687 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2220116359' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:42.163057 I | rook-ceph-mon2: 2017-07-11 14:56:42.163024 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:56:42.163235 I | rook-ceph-mon2: 2017-07-11 14:56:42.163159 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/617458217' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:56:42.617574 I | rook-ceph-mon2: 2017-07-11 14:56:42.617522 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:56:42.620677 I | rook-ceph-mon2: 2017-07-11 14:56:42.620659 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/947774784' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:56:45.053903 I | rook-ceph-mon2: 2017-07-11 14:56:45.053868 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:45.054094 I | rook-ceph-mon2: 2017-07-11 14:56:45.054002 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2745699668' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:56.610096 I | rook-ceph-mon2: 2017-07-11 14:56:56.610059 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:56:56.610272 I | rook-ceph-mon2: 2017-07-11 14:56:56.610195 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2771871542' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:56:58.190672 I | rook-ceph-mon2: 2017-07-11 14:56:58.190267 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4924 MB, avail 94263 MB
- 2017-07-11 14:57:07.039186 I | rook-ceph-mon2: 2017-07-11 14:57:07.039152 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:57:07.039469 I | rook-ceph-mon2: 2017-07-11 14:57:07.039451 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/862544258' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:57:07.673014 I | rook-ceph-mon2: 2017-07-11 14:57:07.672884 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #127. Immutable memtables: 0.
- 2017-07-11 14:57:07.673116 I | rook-ceph-mon2:
- 2017-07-11 14:57:07.673137 I | rook-ceph-mon2: 2017-07-11 14:57:07.672941 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 81] Syncing log #124
- 2017-07-11 14:57:07.707497 I | rook-ceph-mon2: 2017-07-11 14:57:07.697776 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:57:07.672924) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:57:07.707563 I | rook-ceph-mon2: 2017-07-11 14:57:07.697785 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 81] Flushing memtable with next log file: 127
- 2017-07-11 14:57:07.707578 I | rook-ceph-mon2:
- 2017-07-11 14:57:07.707589 I | rook-ceph-mon2: 2017-07-11 14:57:07.697793 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785027697789, "job": 81, "event": "flush_started", "num_memtables": 1, "num_entries": 1688, "num_deletes": 251, "memory_usage": 5313096}
- 2017-07-11 14:57:07.707614 I | rook-ceph-mon2: 2017-07-11 14:57:07.697796 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 81] Level-0 flush table #128: started
- 2017-07-11 14:57:07.852775 I | rook-ceph-mon2: 2017-07-11 14:57:07.852728 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785027852716, "cf_name": "default", "job": 81, "event": "table_file_creation", "file_number": 128, "file_size": 3504920, "table_properties": {"data_size": 3492491, "index_size": 11611, "filter_size": 0, "raw_key_size": 13329, "raw_average_key_size": 18, "raw_value_size": 3474579, "raw_average_value_size": 4880, "num_data_blocks": 366, "num_entries": 712, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:57:07.859157 I | rook-ceph-mon2: 2017-07-11 14:57:07.859094 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 81] Level-0 flush table #128: 3504920 bytes OK
- 2017-07-11 14:57:07.890189 I | rook-ceph-mon2: 2017-07-11 14:57:07.890170 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:57:07.890265 I | rook-ceph-mon2: 2017-07-11 14:57:07.890250 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1581769415' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:57:07.919061 I | rook-ceph-mon2: 2017-07-11 14:57:07.918470 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:57:07.890857) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #128 started
- 2017-07-11 14:57:07.919147 I | rook-ceph-mon2: 2017-07-11 14:57:07.919132 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:57:07.918412) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #128: memtable #1 done
- 2017-07-11 14:57:07.919194 I | rook-ceph-mon2: 2017-07-11 14:57:07.919166 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:57:07.918433) EVENT_LOG_v1 {"time_micros": 1499785027918426, "job": 81, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:57:07.919223 I | rook-ceph-mon2: 2017-07-11 14:57:07.919210 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:57:07.918454) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:57:07.919237 I | rook-ceph-mon2:
- 2017-07-11 14:57:07.919278 I | rook-ceph-mon2: 2017-07-11 14:57:07.919253 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 81] Try to delete WAL files size 5269160, prev total WAL file size 5269160, number of live WAL files 2.
- 2017-07-11 14:57:07.919291 I | rook-ceph-mon2:
- 2017-07-11 14:57:07.920290 I | rook-ceph-mon2: 2017-07-11 14:57:07.920055 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:57:07.920340 I | rook-ceph-mon2: 2017-07-11 14:57:07.920091 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:57:07.920086) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 14:57:07.920384 I | rook-ceph-mon2:
- 2017-07-11 14:57:07.920419 I | rook-ceph-mon2: 2017-07-11 14:57:07.920096 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 82] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:57:07.920431 I | rook-ceph-mon2: 2017-07-11 14:57:07.920100 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 81 Base level 0, inputs: [128(3422KB)], [126(13MB)]
- 2017-07-11 14:57:07.920443 I | rook-ceph-mon2:
- 2017-07-11 14:57:07.920455 I | rook-ceph-mon2: 2017-07-11 14:57:07.920109 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785027920102, "job": 82, "event": "compaction_started", "files_L0": [128], "files_L1": [126], "score": -1, "input_data_size": 18043438}
- 2017-07-11 14:57:08.208936 I | rook-ceph-mon2: 2017-07-11 14:57:08.208887 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 82] Generated table #129: 2299 keys, 15477978 bytes
- 2017-07-11 14:57:08.209039 I | rook-ceph-mon2: 2017-07-11 14:57:08.209022 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785028209013, "cf_name": "default", "job": 82, "event": "table_file_creation", "file_number": 129, "file_size": 15477978, "table_properties": {"data_size": 15425216, "index_size": 51943, "filter_size": 0, "raw_key_size": 44481, "raw_average_key_size": 19, "raw_value_size": 15356693, "raw_average_value_size": 6679, "num_data_blocks": 1582, "num_entries": 2299, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:57:08.297755 I | rook-ceph-mon2: 2017-07-11 14:57:08.297714 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 82] Compacted 1@0 + 1@1 files to L1 => 15477978 bytes
- 2017-07-11 14:57:08.341560 I | rook-ceph-mon2: 2017-07-11 14:57:08.341521 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:57:08.341451) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 47.8 rd, 41.0 wr, level 1, files in(1, 1) out(1) MB in(3.3, 13.9) out(14.8), read-write-amplify(9.6) write-amplify(4.4) OK, records in: 2808, records dropped: 509
- 2017-07-11 14:57:08.341613 I | rook-ceph-mon2:
- 2017-07-11 14:57:08.341650 I | rook-ceph-mon2: 2017-07-11 14:57:08.341633 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:57:08.341473) EVENT_LOG_v1 {"time_micros": 1499785028341464, "job": 82, "event": "compaction_finished", "compaction_time_micros": 377586, "output_level": 1, "num_output_files": 1, "total_output_size": 15477978, "num_input_records": 2808, "num_output_records": 2299, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:57:08.342290 I | rook-ceph-mon2: 2017-07-11 14:57:08.342274 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785028342270, "job": 82, "event": "table_file_deletion", "file_number": 128}
- 2017-07-11 14:57:08.344142 I | rook-ceph-mon2: 2017-07-11 14:57:08.344127 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785028344125, "job": 82, "event": "table_file_deletion", "file_number": 126}
- 2017-07-11 14:57:14.507107 I | rook-ceph-mon2: 2017-07-11 14:57:14.507000 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #130. Immutable memtables: 0.
- 2017-07-11 14:57:14.507199 I | rook-ceph-mon2:
- 2017-07-11 14:57:14.507290 I | rook-ceph-mon2: 2017-07-11 14:57:14.507048 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 83] Syncing log #127
- 2017-07-11 14:57:14.543500 I | rook-ceph-mon2: 2017-07-11 14:57:14.542882 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.507043) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 14:57:14.543546 I | rook-ceph-mon2: 2017-07-11 14:57:14.542900 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 83] Flushing memtable with next log file: 130
- 2017-07-11 14:57:14.543580 I | rook-ceph-mon2:
- 2017-07-11 14:57:14.543593 I | rook-ceph-mon2: 2017-07-11 14:57:14.542916 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785034542908, "job": 83, "event": "flush_started", "num_memtables": 1, "num_entries": 296, "num_deletes": 251, "memory_usage": 161808}
- 2017-07-11 14:57:14.543632 I | rook-ceph-mon2: 2017-07-11 14:57:14.542919 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 83] Level-0 flush table #131: started
- 2017-07-11 14:57:14.613932 I | rook-ceph-mon2: 2017-07-11 14:57:14.613877 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785034613867, "cf_name": "default", "job": 83, "event": "table_file_creation", "file_number": 131, "file_size": 101274, "table_properties": {"data_size": 100099, "index_size": 361, "filter_size": 0, "raw_key_size": 5453, "raw_average_key_size": 20, "raw_value_size": 96219, "raw_average_value_size": 355, "num_data_blocks": 12, "num_entries": 271, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 14:57:14.613982 I | rook-ceph-mon2: 2017-07-11 14:57:14.613886 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 83] Level-0 flush table #131: 101274 bytes OK
- 2017-07-11 14:57:14.668389 I | rook-ceph-mon2: 2017-07-11 14:57:14.668255 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.636640) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #131 started
- 2017-07-11 14:57:14.668431 I | rook-ceph-mon2: 2017-07-11 14:57:14.668260 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.668213) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #131: memtable #1 done
- 2017-07-11 14:57:14.668448 I | rook-ceph-mon2: 2017-07-11 14:57:14.668262 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.668223) EVENT_LOG_v1 {"time_micros": 1499785034668219, "job": 83, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 14:57:14.668460 I | rook-ceph-mon2: 2017-07-11 14:57:14.668263 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.668243) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 14:57:14.668472 I | rook-ceph-mon2:
- 2017-07-11 14:57:14.668483 I | rook-ceph-mon2: 2017-07-11 14:57:14.668268 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 83] Try to delete WAL files size 153637, prev total WAL file size 153637, number of live WAL files 2.
- 2017-07-11 14:57:14.668509 I | rook-ceph-mon2:
- 2017-07-11 14:57:14.668562 I | rook-ceph-mon2: 2017-07-11 14:57:14.668529 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:57:14.668839 I | rook-ceph-mon2: 2017-07-11 14:57:14.668815 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 14:57:14.668910 I | rook-ceph-mon2: 2017-07-11 14:57:14.668888 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 14:57:14.668926 I | rook-ceph-mon2: ** DB Stats **
- 2017-07-11 14:57:14.668938 I | rook-ceph-mon2: Uptime(secs): 5597.4 total, 606.7 interval
- 2017-07-11 14:57:14.668976 I | rook-ceph-mon2: Cumulative writes: 10K writes, 53K keys, 10K commit groups, 1.0 writes per commit group, ingest: 0.14 GB, 0.03 MB/s
- 2017-07-11 14:57:14.668989 I | rook-ceph-mon2: Cumulative WAL: 10K writes, 10K syncs, 1.00 writes per sync, written: 0.14 GB, 0.03 MB/s
- 2017-07-11 14:57:14.669000 I | rook-ceph-mon2: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:57:14.669011 I | rook-ceph-mon2: Interval writes: 1518 writes, 8477 keys, 1518 commit groups, 1.0 writes per commit group, ingest: 21.87 MB, 0.04 MB/s
- 2017-07-11 14:57:14.669022 I | rook-ceph-mon2: Interval WAL: 1518 writes, 1518 syncs, 1.00 writes per sync, written: 0.02 MB, 0.04 MB/s
- 2017-07-11 14:57:14.669033 I | rook-ceph-mon2: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 14:57:14.669055 I | rook-ceph-mon2:
- 2017-07-11 14:57:14.669067 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 14:57:14.669078 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:57:14.669089 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:57:14.669100 I | rook-ceph-mon2: L0 1/1 98.90 KB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 14.8 6 43 0.142 0 0
- 2017-07-11 14:57:14.669149 I | rook-ceph-mon2: L1 1/1 14.76 MB 0.0 0.6 0.1 0.5 0.5 0.0 0.0 5.7 42.2 36.8 14 39 0.362 98K 20K
- 2017-07-11 14:57:14.669161 I | rook-ceph-mon2: Sum 2/2 14.86 MB 0.0 0.6 0.1 0.5 0.6 0.1 0.0 6.7 29.5 30.2 20 82 0.247 98K 20K
- 2017-07-11 14:57:14.669172 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 9.1 25.9 25.4 5 17 0.301 22K 4535
- 2017-07-11 14:57:14.669182 I | rook-ceph-mon2: Uptime(secs): 5597.4 total, 5597.4 interval
- 2017-07-11 14:57:14.669193 I | rook-ceph-mon2: Flush(GB): cumulative 0.088, interval 0.014
- 2017-07-11 14:57:14.669228 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:57:14.669240 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:57:14.669261 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:57:14.669272 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:57:14.669294 I | rook-ceph-mon2: Cumulative compaction: 0.60 GB write, 0.11 MB/s write, 0.58 GB read, 0.11 MB/s read, 20.2 seconds
- 2017-07-11 14:57:14.669307 I | rook-ceph-mon2: Interval compaction: 0.13 GB write, 0.02 MB/s write, 0.13 GB read, 0.02 MB/s read, 5.1 seconds
- 2017-07-11 14:57:14.669318 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:57:14.669329 I | rook-ceph-mon2:
- 2017-07-11 14:57:14.669340 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:57:14.669351 I | rook-ceph-mon2:
- 2017-07-11 14:57:14.669372 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 14:57:14.669384 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 14:57:14.669400 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 14:57:14.669412 I | rook-ceph-mon2: L0 1/1 98.90 KB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 14.8 6 43 0.142 0 0
- 2017-07-11 14:57:14.669422 I | rook-ceph-mon2: L1 1/1 14.76 MB 0.0 0.6 0.1 0.5 0.5 0.0 0.0 5.7 42.2 36.8 14 39 0.362 98K 20K
- 2017-07-11 14:57:14.669433 I | rook-ceph-mon2: Sum 2/2 14.86 MB 0.0 0.6 0.1 0.5 0.6 0.1 0.0 6.7 29.5 30.2 20 82 0.247 98K 20K
- 2017-07-11 14:57:14.669457 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 14:57:14.669469 I | rook-ceph-mon2: Uptime(secs): 5597.4 total, 5597.4 interval
- 2017-07-11 14:57:14.669480 I | rook-ceph-mon2: Flush(GB): cumulative 0.088, interval 0.000
- 2017-07-11 14:57:14.669491 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 14:57:14.669501 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 14:57:14.669512 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 14:57:14.669549 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 14:57:14.669560 I | rook-ceph-mon2: Cumulative compaction: 0.60 GB write, 0.11 MB/s write, 0.58 GB read, 0.11 MB/s read, 20.2 seconds
- 2017-07-11 14:57:14.669571 I | rook-ceph-mon2: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 14:57:14.669582 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 14:57:14.669604 I | rook-ceph-mon2:
- 2017-07-11 14:57:14.669615 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 14:57:14.669626 I | rook-ceph-mon2:
- 2017-07-11 14:57:14.669662 I | rook-ceph-mon2: 2017-07-11 14:57:14.669647 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.669642) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 14:57:14.669688 I | rook-ceph-mon2:
- 2017-07-11 14:57:14.669717 I | rook-ceph-mon2: 2017-07-11 14:57:14.669703 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 84] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 14:57:14.669762 I | rook-ceph-mon2: 2017-07-11 14:57:14.669737 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 83 Base level 0, inputs: [131(98KB)], [129(14MB)]
- 2017-07-11 14:57:14.669775 I | rook-ceph-mon2:
- 2017-07-11 14:57:14.669822 I | rook-ceph-mon2: 2017-07-11 14:57:14.669810 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785034669801, "job": 84, "event": "compaction_started", "files_L0": [131], "files_L1": [129], "score": -1, "input_data_size": 15579252}
- 2017-07-11 14:57:14.873060 I | rook-ceph-mon2: 2017-07-11 14:57:14.872996 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 84] Generated table #132: 2061 keys, 13923368 bytes
- 2017-07-11 14:57:14.873318 I | rook-ceph-mon2: 2017-07-11 14:57:14.873227 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785034873217, "cf_name": "default", "job": 84, "event": "table_file_creation", "file_number": 132, "file_size": 13923368, "table_properties": {"data_size": 13878507, "index_size": 44042, "filter_size": 0, "raw_key_size": 39707, "raw_average_key_size": 19, "raw_value_size": 13818846, "raw_average_value_size": 6704, "num_data_blocks": 1342, "num_entries": 2061, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 14:57:14.907313 I | rook-ceph-mon2: 2017-07-11 14:57:14.907291 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 84] Compacted 1@0 + 1@1 files to L1 => 13923368 bytes
- 2017-07-11 14:57:14.938169 I | rook-ceph-mon2: 2017-07-11 14:57:14.938129 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.938021) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 65.6 rd, 58.6 wr, level 1, files in(1, 1) out(1) MB in(0.1, 14.8) out(13.3), read-write-amplify(291.3) write-amplify(137.5) OK, records in: 2570, records dropped: 509
- 2017-07-11 14:57:14.938208 I | rook-ceph-mon2:
- 2017-07-11 14:57:14.938241 I | rook-ceph-mon2: 2017-07-11 14:57:14.938226 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-14:57:14.938055) EVENT_LOG_v1 {"time_micros": 1499785034938041, "job": 84, "event": "compaction_finished", "compaction_time_micros": 237428, "output_level": 1, "num_output_files": 1, "total_output_size": 13923368, "num_input_records": 2570, "num_output_records": 2061, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 14:57:14.938411 I | rook-ceph-mon2: 2017-07-11 14:57:14.938397 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785034938394, "job": 84, "event": "table_file_deletion", "file_number": 131}
- 2017-07-11 14:57:14.940225 I | rook-ceph-mon2: 2017-07-11 14:57:14.940211 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785034940209, "job": 84, "event": "table_file_deletion", "file_number": 129}
- 2017-07-11 14:57:14.940305 I | rook-ceph-mon2: 2017-07-11 14:57:14.940289 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 14:57:27.628343 I | rook-ceph-mon2: 2017-07-11 14:57:27.628309 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:57:27.628525 I | rook-ceph-mon2: 2017-07-11 14:57:27.628450 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1864416943' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:57:51.675655 I | rook-ceph-mon2: 2017-07-11 14:57:51.675617 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:57:51.675870 I | rook-ceph-mon2: 2017-07-11 14:57:51.675753 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3913192991' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:57:58.190678 I | rook-ceph-mon2: 2017-07-11 14:57:58.190524 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94263 MB
- 2017-07-11 14:57:59.990505 I | rook-ceph-mon2: 2017-07-11 14:57:59.990471 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:57:59.990611 I | rook-ceph-mon2: 2017-07-11 14:57:59.990596 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/476983393' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:00.488131 I | rook-ceph-mon2: 2017-07-11 14:58:00.488086 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:00.488351 I | rook-ceph-mon2: 2017-07-11 14:58:00.488319 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1079107223' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:01.060676 I | rook-ceph-mon2: 2017-07-11 14:58:01.060642 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:01.060960 I | rook-ceph-mon2: 2017-07-11 14:58:01.060904 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2609795890' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:01.513944 I | rook-ceph-mon2: 2017-07-11 14:58:01.513891 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:01.514054 I | rook-ceph-mon2: 2017-07-11 14:58:01.514037 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/203628242' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:01.988141 I | rook-ceph-mon2: 2017-07-11 14:58:01.988109 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:01.988242 I | rook-ceph-mon2: 2017-07-11 14:58:01.988228 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1075047437' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:02.920862 I | rook-ceph-mon2: 2017-07-11 14:58:02.914821 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:02.921062 I | rook-ceph-mon2: 2017-07-11 14:58:02.921024 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/163767128' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:04.312613 I | rook-ceph-mon2: 2017-07-11 14:58:04.306864 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:04.322621 I | rook-ceph-mon2: 2017-07-11 14:58:04.322580 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1094497653' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:05.336058 I | rook-ceph-mon2: 2017-07-11 14:58:05.336024 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:05.336165 I | rook-ceph-mon2: 2017-07-11 14:58:05.336150 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4176186349' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:05.848714 I | rook-ceph-mon2: 2017-07-11 14:58:05.848682 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:05.848820 I | rook-ceph-mon2: 2017-07-11 14:58:05.848805 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/618327554' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:06.810493 I | rook-ceph-mon2: 2017-07-11 14:58:06.810459 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:06.810722 I | rook-ceph-mon2: 2017-07-11 14:58:06.810686 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2102970817' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:07.671343 I | rook-ceph-mon2: 2017-07-11 14:58:07.671279 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:07.671544 I | rook-ceph-mon2: 2017-07-11 14:58:07.671447 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/860823639' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:08.576049 I | rook-ceph-mon2: 2017-07-11 14:58:08.576014 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:08.576286 I | rook-ceph-mon2: 2017-07-11 14:58:08.576247 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2563642568' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:09.520958 I | rook-ceph-mon2: 2017-07-11 14:58:09.520921 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:09.521203 I | rook-ceph-mon2: 2017-07-11 14:58:09.521087 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/454924334' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:14.165379 I | rook-ceph-mon2: 2017-07-11 14:58:14.165337 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:14.165574 I | rook-ceph-mon2: 2017-07-11 14:58:14.165497 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/963734795' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:15.186630 I | rook-ceph-mon2: 2017-07-11 14:58:15.183054 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:15.202807 I | rook-ceph-mon2: 2017-07-11 14:58:15.186748 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1526629528' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:15.811211 I | rook-ceph-mon2: 2017-07-11 14:58:15.811179 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:15.811311 I | rook-ceph-mon2: 2017-07-11 14:58:15.811297 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2991952197' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:17.215678 I | rook-ceph-mon2: 2017-07-11 14:58:17.215600 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:17.215788 I | rook-ceph-mon2: 2017-07-11 14:58:17.215773 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1748272750' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:18.141368 I | rook-ceph-mon2: 2017-07-11 14:58:18.141333 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:18.141577 I | rook-ceph-mon2: 2017-07-11 14:58:18.141465 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3176662161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:19.125683 I | rook-ceph-mon2: 2017-07-11 14:58:19.125647 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:19.125866 I | rook-ceph-mon2: 2017-07-11 14:58:19.125786 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2750899497' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:19.619992 I | rook-ceph-mon2: 2017-07-11 14:58:19.619953 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:19.620209 I | rook-ceph-mon2: 2017-07-11 14:58:19.620094 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2625552831' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:20.423193 I | rook-ceph-mon2: 2017-07-11 14:58:20.416013 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:20.423527 I | rook-ceph-mon2: 2017-07-11 14:58:20.422675 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2732163539' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:20.886851 I | rook-ceph-mon2: 2017-07-11 14:58:20.886690 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:20.886957 I | rook-ceph-mon2: 2017-07-11 14:58:20.886709 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2098330958' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:21.345463 I | rook-ceph-mon2: 2017-07-11 14:58:21.345419 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:21.345681 I | rook-ceph-mon2: 2017-07-11 14:58:21.345565 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1800782335' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:23.432561 I | rook-ceph-mon2: 2017-07-11 14:58:23.432528 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:23.432756 I | rook-ceph-mon2: 2017-07-11 14:58:23.432688 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1960784498' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:24.017788 I | rook-ceph-mon2: 2017-07-11 14:58:24.017743 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:24.018075 I | rook-ceph-mon2: 2017-07-11 14:58:24.018032 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2206253701' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:24.493508 I | rook-ceph-mon2: 2017-07-11 14:58:24.493441 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:24.493703 I | rook-ceph-mon2: 2017-07-11 14:58:24.493623 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/874466431' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:25.574604 I | rook-ceph-mon2: 2017-07-11 14:58:25.574570 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:25.580549 I | rook-ceph-mon2: 2017-07-11 14:58:25.580509 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3715103942' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:27.364622 I | rook-ceph-mon2: 2017-07-11 14:58:27.364588 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:27.364804 I | rook-ceph-mon2: 2017-07-11 14:58:27.364725 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2514633699' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:28.742466 I | rook-ceph-mon2: 2017-07-11 14:58:28.742418 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:28.742793 I | rook-ceph-mon2: 2017-07-11 14:58:28.742762 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3343962627' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:31.114654 I | rook-ceph-mon2: 2017-07-11 14:58:31.114620 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:31.114932 I | rook-ceph-mon2: 2017-07-11 14:58:31.114914 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1706433658' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:32.197968 I | rook-ceph-mon2: 2017-07-11 14:58:32.197939 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:32.198141 I | rook-ceph-mon2: 2017-07-11 14:58:32.198065 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2666609399' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:33.312912 I | rook-ceph-mon2: 2017-07-11 14:58:33.306703 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:33.313262 I | rook-ceph-mon2: 2017-07-11 14:58:33.312542 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4258317728' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:34.302929 I | rook-ceph-mon2: 2017-07-11 14:58:34.302897 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:34.303151 I | rook-ceph-mon2: 2017-07-11 14:58:34.303035 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4245846677' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:35.888691 I | rook-ceph-mon2: 2017-07-11 14:58:35.888654 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:35.888908 I | rook-ceph-mon2: 2017-07-11 14:58:35.888803 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/685428149' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:37.213972 I | rook-ceph-mon2: 2017-07-11 14:58:37.213938 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:37.214163 I | rook-ceph-mon2: 2017-07-11 14:58:37.214085 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/279750956' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:38.934990 I | rook-ceph-mon2: 2017-07-11 14:58:38.934951 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:38.935074 I | rook-ceph-mon2: 2017-07-11 14:58:38.935044 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3780485841' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:39.450368 I | rook-ceph-mon2: 2017-07-11 14:58:39.450335 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:39.450519 I | rook-ceph-mon2: 2017-07-11 14:58:39.450476 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3567727346' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:41.005517 I | rook-ceph-mon2: 2017-07-11 14:58:41.005474 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:41.005746 I | rook-ceph-mon2: 2017-07-11 14:58:41.005708 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/48365090' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:41.490670 I | rook-ceph-mon2: 2017-07-11 14:58:41.490637 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:41.490777 I | rook-ceph-mon2: 2017-07-11 14:58:41.490762 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1764055962' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:44.352977 I | rook-ceph-mon2: 2017-07-11 14:58:44.352945 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:44.353197 I | rook-ceph-mon2: 2017-07-11 14:58:44.353167 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2707290317' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:44.871535 I | rook-ceph-mon2: 2017-07-11 14:58:44.871499 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:44.871705 I | rook-ceph-mon2: 2017-07-11 14:58:44.871628 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2820327701' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:46.438025 I | rook-ceph-mon2: 2017-07-11 14:58:46.437968 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:46.438203 I | rook-ceph-mon2: 2017-07-11 14:58:46.438125 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2711411688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:47.853996 I | rook-ceph-mon2: 2017-07-11 14:58:47.853967 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:47.854172 I | rook-ceph-mon2: 2017-07-11 14:58:47.854088 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2233440302' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:58:48.814126 I | rook-ceph-mon2: 2017-07-11 14:58:48.814092 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:48.814230 I | rook-ceph-mon2: 2017-07-11 14:58:48.814216 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1034954212' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:52.229542 I | rook-ceph-mon2: 2017-07-11 14:58:52.229509 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:52.229744 I | rook-ceph-mon2: 2017-07-11 14:58:52.229728 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1553641334' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:52.672548 I | rook-ceph-mon2: 2017-07-11 14:58:52.672479 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:58:52.672782 I | rook-ceph-mon2: 2017-07-11 14:58:52.672654 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3533192641' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:58:53.155932 I | rook-ceph-mon2: 2017-07-11 14:58:53.155899 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:53.156173 I | rook-ceph-mon2: 2017-07-11 14:58:53.156136 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2290863667' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:54.122751 I | rook-ceph-mon2: 2017-07-11 14:58:54.122718 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:54.122940 I | rook-ceph-mon2: 2017-07-11 14:58:54.122859 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/216714819' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:56.297533 I | rook-ceph-mon2: 2017-07-11 14:58:56.297499 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:58:56.297715 I | rook-ceph-mon2: 2017-07-11 14:58:56.297641 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2582968894' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:58:58.178421 I | rook-ceph-mon2: 2017-07-11 14:58:58.178382 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 14:58:58.178602 I | rook-ceph-mon2: 2017-07-11 14:58:58.178519 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/212632685' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 14:58:58.194949 I | rook-ceph-mon2: 2017-07-11 14:58:58.194750 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94263 MB
- 2017-07-11 14:58:58.195297 I | rook-ceph-mon2: 2017-07-11 14:58:58.195279 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:58:58.195457 I | rook-ceph-mon2: 2017-07-11 14:58:58.195441 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3870562932' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:58:59.100738 I | rook-ceph-mon2: 2017-07-11 14:58:59.100704 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:58:59.100970 I | rook-ceph-mon2: 2017-07-11 14:58:59.100846 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/517339811' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:00.041038 I | rook-ceph-mon2: 2017-07-11 14:59:00.041003 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:00.041212 I | rook-ceph-mon2: 2017-07-11 14:59:00.041135 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4226181061' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:00.964790 I | rook-ceph-mon2: 2017-07-11 14:59:00.964755 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:00.965024 I | rook-ceph-mon2: 2017-07-11 14:59:00.965006 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2648391356' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:03.142599 I | rook-ceph-mon2: 2017-07-11 14:59:03.142566 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:03.142817 I | rook-ceph-mon2: 2017-07-11 14:59:03.142699 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3518084003' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:03.620335 I | rook-ceph-mon2: 2017-07-11 14:59:03.620300 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:03.620442 I | rook-ceph-mon2: 2017-07-11 14:59:03.620426 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1875197141' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:07.792783 I | rook-ceph-mon2: 2017-07-11 14:59:07.792748 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:07.793016 I | rook-ceph-mon2: 2017-07-11 14:59:07.792978 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2256722004' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:08.705437 I | rook-ceph-mon2: 2017-07-11 14:59:08.705400 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:08.705645 I | rook-ceph-mon2: 2017-07-11 14:59:08.705555 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1391232888' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:10.218325 I | rook-ceph-mon2: 2017-07-11 14:59:10.218286 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:10.218850 I | rook-ceph-mon2: 2017-07-11 14:59:10.218828 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2200627731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:12.062632 I | rook-ceph-mon2: 2017-07-11 14:59:12.062598 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:12.062856 I | rook-ceph-mon2: 2017-07-11 14:59:12.062817 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2398105210' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:12.948371 I | rook-ceph-mon2: 2017-07-11 14:59:12.948335 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:12.948478 I | rook-ceph-mon2: 2017-07-11 14:59:12.948463 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2805710224' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:13.414390 I | rook-ceph-mon2: 2017-07-11 14:59:13.414356 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:13.414568 I | rook-ceph-mon2: 2017-07-11 14:59:13.414494 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/375168351' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:15.997502 I | rook-ceph-mon2: 2017-07-11 14:59:15.997466 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:15.997606 I | rook-ceph-mon2: 2017-07-11 14:59:15.997592 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4194050699' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:16.896713 I | rook-ceph-mon2: 2017-07-11 14:59:16.896679 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:16.902485 I | rook-ceph-mon2: 2017-07-11 14:59:16.902465 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/854428194' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:17.288923 I | rook-ceph-mon2: 2017-07-11 14:59:17.288884 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:17.289102 I | rook-ceph-mon2: 2017-07-11 14:59:17.289026 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/574223340' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:19.131633 I | rook-ceph-mon2: 2017-07-11 14:59:19.131600 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:19.131816 I | rook-ceph-mon2: 2017-07-11 14:59:19.131736 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1223607855' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:19.606460 I | rook-ceph-mon2: 2017-07-11 14:59:19.606403 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:19.606685 I | rook-ceph-mon2: 2017-07-11 14:59:19.606598 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1989466898' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:20.111202 I | rook-ceph-mon2: 2017-07-11 14:59:20.111167 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:20.111390 I | rook-ceph-mon2: 2017-07-11 14:59:20.111307 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2648082266' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:21.475624 I | rook-ceph-mon2: 2017-07-11 14:59:21.469844 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:21.476288 I | rook-ceph-mon2: 2017-07-11 14:59:21.475732 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1007911522' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:22.339001 I | rook-ceph-mon2: 2017-07-11 14:59:22.338969 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:22.339237 I | rook-ceph-mon2: 2017-07-11 14:59:22.339188 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3180516933' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:23.753355 I | rook-ceph-mon2: 2017-07-11 14:59:23.753323 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:23.753536 I | rook-ceph-mon2: 2017-07-11 14:59:23.753456 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3032404472' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:24.191721 I | rook-ceph-mon2: 2017-07-11 14:59:24.191664 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:24.191947 I | rook-ceph-mon2: 2017-07-11 14:59:24.191828 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2195248850' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:31.794592 I | rook-ceph-mon2: 2017-07-11 14:59:31.794556 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:31.794812 I | rook-ceph-mon2: 2017-07-11 14:59:31.794781 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2550617289' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:32.606435 I | rook-ceph-mon2: 2017-07-11 14:59:32.606403 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:32.606537 I | rook-ceph-mon2: 2017-07-11 14:59:32.606521 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4030685840' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:33.070422 I | rook-ceph-mon2: 2017-07-11 14:59:33.070375 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:33.070495 I | rook-ceph-mon2: 2017-07-11 14:59:33.070481 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1971623632' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:36.827978 I | rook-ceph-mon2: 2017-07-11 14:59:35.637306 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2061 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0654328s > max 0.05s
- 2017-07-11 14:59:36.831059 I | rook-ceph-mon2: 2017-07-11 14:59:35.637769 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2062 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.212449s > max 0.05s
- 2017-07-11 14:59:37.814341 I | rook-ceph-mon2: 2017-07-11 14:59:37.814307 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:37.814442 I | rook-ceph-mon2: 2017-07-11 14:59:37.814428 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3807410429' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:38.718892 I | rook-ceph-mon2: 2017-07-11 14:59:38.718856 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:38.719107 I | rook-ceph-mon2: 2017-07-11 14:59:38.719002 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4101244516' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:39.747179 I | rook-ceph-mon2: 2017-07-11 14:59:39.747140 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:39.747458 I | rook-ceph-mon2: 2017-07-11 14:59:39.747285 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/612485921' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:40.240328 I | rook-ceph-mon2: 2017-07-11 14:59:40.240295 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:40.240518 I | rook-ceph-mon2: 2017-07-11 14:59:40.240430 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2152421638' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:42.534274 I | rook-ceph-mon2: 2017-07-11 14:59:42.534225 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:42.534485 I | rook-ceph-mon2: 2017-07-11 14:59:42.534466 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1620585296' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:43.513668 I | rook-ceph-mon2: 2017-07-11 14:59:43.513622 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:43.513775 I | rook-ceph-mon2: 2017-07-11 14:59:43.513760 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1197172527' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:44.030671 I | rook-ceph-mon2: 2017-07-11 14:59:44.030636 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:44.030848 I | rook-ceph-mon2: 2017-07-11 14:59:44.030763 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1580897787' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:44.492038 I | rook-ceph-mon2: 2017-07-11 14:59:44.492003 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:44.492145 I | rook-ceph-mon2: 2017-07-11 14:59:44.492124 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1439858095' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:46.633644 I | rook-ceph-mon2: 2017-07-11 14:59:46.633596 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:46.633942 I | rook-ceph-mon2: 2017-07-11 14:59:46.633892 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3196212425' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:47.479880 I | rook-ceph-mon2: 2017-07-11 14:59:47.479850 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:47.479978 I | rook-ceph-mon2: 2017-07-11 14:59:47.479964 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/323776183' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:48.384912 I | rook-ceph-mon2: 2017-07-11 14:59:48.384879 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:48.385016 I | rook-ceph-mon2: 2017-07-11 14:59:48.385001 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/668746180' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:50.267109 I | rook-ceph-mon2: 2017-07-11 14:59:50.267071 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:50.267303 I | rook-ceph-mon2: 2017-07-11 14:59:50.267218 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2144427909' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:52.085073 I | rook-ceph-mon2: 2017-07-11 14:59:52.085029 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:52.085286 I | rook-ceph-mon2: 2017-07-11 14:59:52.085179 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3516020102' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 14:59:52.950018 I | rook-ceph-mon2: 2017-07-11 14:59:52.949986 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:52.950210 I | rook-ceph-mon2: 2017-07-11 14:59:52.950120 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3579130906' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:54.849439 I | rook-ceph-mon2: 2017-07-11 14:59:54.849406 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:54.849542 I | rook-ceph-mon2: 2017-07-11 14:59:54.849528 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2203168240' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:55.998766 I | rook-ceph-mon2: 2017-07-11 14:59:55.998735 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 14:59:55.998959 I | rook-ceph-mon2: 2017-07-11 14:59:55.998867 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4126457592' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 14:59:57.693449 I | rook-ceph-mon2: 2017-07-11 14:59:57.693348 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 14:59:57.693659 I | rook-ceph-mon2: 2017-07-11 14:59:57.693564 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1244447025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 14:59:58.196572 I | rook-ceph-mon2: 2017-07-11 14:59:58.196337 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94263 MB
- 2017-07-11 14:59:58.651127 I | rook-ceph-mon2: 2017-07-11 14:59:58.651095 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 14:59:58.651370 I | rook-ceph-mon2: 2017-07-11 14:59:58.651311 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1539574212' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 14:59:59.674770 I | rook-ceph-mon2: 2017-07-11 14:59:59.674734 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 14:59:59.674960 I | rook-ceph-mon2: 2017-07-11 14:59:59.674878 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3924893897' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:00.168145 I | rook-ceph-mon2: 2017-07-11 15:00:00.168112 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:00.168335 I | rook-ceph-mon2: 2017-07-11 15:00:00.168247 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3227711080' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:00.628107 I | rook-ceph-mon2: 2017-07-11 15:00:00.628062 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:00.628308 I | rook-ceph-mon2: 2017-07-11 15:00:00.628212 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1271783978' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:01.093502 I | rook-ceph-mon2: 2017-07-11 15:00:00.000329 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2084 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (512 > max 300); Monitor clock skew detected
- 2017-07-11 15:00:01.562754 I | rook-ceph-mon2: 2017-07-11 15:00:01.562707 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:01.562980 I | rook-ceph-mon2: 2017-07-11 15:00:01.562945 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3631455321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:02.496991 I | rook-ceph-mon2: 2017-07-11 15:00:02.496831 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:02.497211 I | rook-ceph-mon2: 2017-07-11 15:00:02.496850 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1567633699' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:03.009842 I | rook-ceph-mon2: 2017-07-11 15:00:03.009806 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:03.010047 I | rook-ceph-mon2: 2017-07-11 15:00:03.009945 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1904081050' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:03.937321 I | rook-ceph-mon2: 2017-07-11 15:00:03.937284 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:03.943809 I | rook-ceph-mon2: 2017-07-11 15:00:03.943295 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2575827093' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:07.397303 I | rook-ceph-mon2: 2017-07-11 15:00:07.397268 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:07.397490 I | rook-ceph-mon2: 2017-07-11 15:00:07.397405 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/262759185' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:07.877907 I | rook-ceph-mon2: 2017-07-11 15:00:07.877873 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:07.878144 I | rook-ceph-mon2: 2017-07-11 15:00:07.877997 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3664350457' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:08.354011 I | rook-ceph-mon2: 2017-07-11 15:00:08.353974 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:08.354269 I | rook-ceph-mon2: 2017-07-11 15:00:08.354252 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2347689246' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:09.282247 I | rook-ceph-mon2: 2017-07-11 15:00:09.282212 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:09.282480 I | rook-ceph-mon2: 2017-07-11 15:00:09.282353 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/545823993' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:11.138072 I | rook-ceph-mon2: 2017-07-11 15:00:11.138028 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:11.138294 I | rook-ceph-mon2: 2017-07-11 15:00:11.138254 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2949607586' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:11.565623 I | rook-ceph-mon2: 2017-07-11 15:00:11.565574 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:11.572545 I | rook-ceph-mon2: 2017-07-11 15:00:11.571567 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/990519716' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:12.025760 I | rook-ceph-mon2: 2017-07-11 15:00:12.025714 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:12.025959 I | rook-ceph-mon2: 2017-07-11 15:00:12.025876 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2420429508' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:14.315230 I | rook-ceph-mon2: 2017-07-11 15:00:14.315194 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:14.315471 I | rook-ceph-mon2: 2017-07-11 15:00:14.315451 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1826576995' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:14.804628 I | rook-ceph-mon2: 2017-07-11 15:00:14.804592 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:14.804845 I | rook-ceph-mon2: 2017-07-11 15:00:14.804739 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/187917062' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:15.869809 I | rook-ceph-mon2: 2017-07-11 15:00:15.869773 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:15.870004 I | rook-ceph-mon2: 2017-07-11 15:00:15.869915 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1758474298' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:17.441917 I | rook-ceph-mon2: 2017-07-11 15:00:17.441807 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:17.441945 I | rook-ceph-mon2: 2017-07-11 15:00:17.441832 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1529615156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:19.479635 I | rook-ceph-mon2: 2017-07-11 15:00:19.479588 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:19.479871 I | rook-ceph-mon2: 2017-07-11 15:00:19.479854 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/94660161' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:20.165184 I | rook-ceph-mon2: 2017-07-11 15:00:20.165146 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:20.165401 I | rook-ceph-mon2: 2017-07-11 15:00:20.165293 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/743003704' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:20.656624 I | rook-ceph-mon2: 2017-07-11 15:00:20.656594 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:20.656842 I | rook-ceph-mon2: 2017-07-11 15:00:20.656722 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2799543772' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:21.575768 I | rook-ceph-mon2: 2017-07-11 15:00:21.575735 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:21.575938 I | rook-ceph-mon2: 2017-07-11 15:00:21.575865 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/794007871' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:22.424852 I | rook-ceph-mon2: 2017-07-11 15:00:22.424819 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:22.425028 I | rook-ceph-mon2: 2017-07-11 15:00:22.424951 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1378180' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:22.949274 I | rook-ceph-mon2: 2017-07-11 15:00:22.949242 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:22.949456 I | rook-ceph-mon2: 2017-07-11 15:00:22.949374 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1744722156' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:23.842592 I | rook-ceph-mon2: 2017-07-11 15:00:23.842557 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:23.842804 I | rook-ceph-mon2: 2017-07-11 15:00:23.842722 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1364928641' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:25.269389 I | rook-ceph-mon2: 2017-07-11 15:00:25.269353 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:25.269633 I | rook-ceph-mon2: 2017-07-11 15:00:25.269616 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/802671001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:26.448963 I | rook-ceph-mon2: 2017-07-11 15:00:26.448930 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:26.449155 I | rook-ceph-mon2: 2017-07-11 15:00:26.449050 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1648428843' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:27.327741 I | rook-ceph-mon2: 2017-07-11 15:00:27.327707 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:27.327991 I | rook-ceph-mon2: 2017-07-11 15:00:27.327925 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2188229444' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:27.769223 I | rook-ceph-mon2: 2017-07-11 15:00:27.769192 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:27.769427 I | rook-ceph-mon2: 2017-07-11 15:00:27.769411 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1505762394' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:28.253458 I | rook-ceph-mon2: 2017-07-11 15:00:28.253422 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:28.253694 I | rook-ceph-mon2: 2017-07-11 15:00:28.253676 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3006869898' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:29.195593 I | rook-ceph-mon2: 2017-07-11 15:00:29.195546 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:29.195807 I | rook-ceph-mon2: 2017-07-11 15:00:29.195771 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3109351275' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:30.879555 I | rook-ceph-mon2: 2017-07-11 15:00:30.879518 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:30.879796 I | rook-ceph-mon2: 2017-07-11 15:00:30.879664 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3130862658' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:31.343600 I | rook-ceph-mon2: 2017-07-11 15:00:31.343566 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:31.343704 I | rook-ceph-mon2: 2017-07-11 15:00:31.343690 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/594653062' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:32.303679 I | rook-ceph-mon2: 2017-07-11 15:00:32.303645 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:32.305197 I | rook-ceph-mon2: 2017-07-11 15:00:32.305180 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/151940390' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:33.442503 I | rook-ceph-mon2: 2017-07-11 15:00:33.442441 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:00:33.442769 I | rook-ceph-mon2: 2017-07-11 15:00:33.442622 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/960835288' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:00:34.488138 I | rook-ceph-mon2: 2017-07-11 15:00:34.488104 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:34.488331 I | rook-ceph-mon2: 2017-07-11 15:00:34.488252 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1015430460' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:34.970602 I | rook-ceph-mon2: 2017-07-11 15:00:34.970567 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:34.970789 I | rook-ceph-mon2: 2017-07-11 15:00:34.970711 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/937107782' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:36.131425 I | rook-ceph-mon2: 2017-07-11 15:00:36.131222 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:36.131516 I | rook-ceph-mon2: 2017-07-11 15:00:36.131241 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2488475157' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:36.592009 I | rook-ceph-mon2: 2017-07-11 15:00:36.591977 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:36.592186 I | rook-ceph-mon2: 2017-07-11 15:00:36.592110 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3185151695' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:37.635807 I | rook-ceph-mon2: 2017-07-11 15:00:37.635772 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:37.636055 I | rook-ceph-mon2: 2017-07-11 15:00:37.635915 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1750169401' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:38.607904 I | rook-ceph-mon2: 2017-07-11 15:00:38.607868 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:38.613828 I | rook-ceph-mon2: 2017-07-11 15:00:38.613774 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2696449021' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:39.079826 I | rook-ceph-mon2: 2017-07-11 15:00:39.079791 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:39.080007 I | rook-ceph-mon2: 2017-07-11 15:00:39.079926 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2923972261' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:40.517178 I | rook-ceph-mon2: 2017-07-11 15:00:40.517145 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:40.517360 I | rook-ceph-mon2: 2017-07-11 15:00:40.517282 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2109790208' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:41.450556 I | rook-ceph-mon2: 2017-07-11 15:00:41.450329 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:41.450638 I | rook-ceph-mon2: 2017-07-11 15:00:41.450356 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3412677048' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:42.477921 I | rook-ceph-mon2: 2017-07-11 15:00:42.477887 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:42.478146 I | rook-ceph-mon2: 2017-07-11 15:00:42.478028 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2091406622' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:42.931378 I | rook-ceph-mon2: 2017-07-11 15:00:42.931344 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:42.931572 I | rook-ceph-mon2: 2017-07-11 15:00:42.931486 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1777554253' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:43.928103 I | rook-ceph-mon2: 2017-07-11 15:00:43.928068 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:43.928326 I | rook-ceph-mon2: 2017-07-11 15:00:43.928209 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1771726768' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:45.523796 I | rook-ceph-mon2: 2017-07-11 15:00:45.523760 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:45.524053 I | rook-ceph-mon2: 2017-07-11 15:00:45.524035 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3635245557' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:45.988477 I | rook-ceph-mon2: 2017-07-11 15:00:45.988382 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #133. Immutable memtables: 0.
- 2017-07-11 15:00:45.988703 I | rook-ceph-mon2:
- 2017-07-11 15:00:45.988728 I | rook-ceph-mon2: 2017-07-11 15:00:45.988422 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 85] Syncing log #130
- 2017-07-11 15:00:46.035443 I | rook-ceph-mon2: 2017-07-11 15:00:46.024544 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:00:45.988416) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:00:46.035496 I | rook-ceph-mon2: 2017-07-11 15:00:46.024555 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 85] Flushing memtable with next log file: 133
- 2017-07-11 15:00:46.035512 I | rook-ceph-mon2:
- 2017-07-11 15:00:46.035524 I | rook-ceph-mon2: 2017-07-11 15:00:46.024565 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246024560, "job": 85, "event": "flush_started", "num_memtables": 1, "num_entries": 2243, "num_deletes": 251, "memory_usage": 7338600}
- 2017-07-11 15:00:46.035534 I | rook-ceph-mon2: 2017-07-11 15:00:46.024567 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 85] Level-0 flush table #134: started
- 2017-07-11 15:00:46.106834 I | rook-ceph-mon2: 2017-07-11 15:00:46.106789 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246106778, "cf_name": "default", "job": 85, "event": "table_file_creation", "file_number": 134, "file_size": 4846034, "table_properties": {"data_size": 4828922, "index_size": 16293, "filter_size": 0, "raw_key_size": 16634, "raw_average_key_size": 18, "raw_value_size": 4805351, "raw_average_value_size": 5423, "num_data_blocks": 511, "num_entries": 886, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 15:00:46.106942 I | rook-ceph-mon2: 2017-07-11 15:00:46.106924 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 85] Level-0 flush table #134: 4846034 bytes OK
- 2017-07-11 15:00:46.162612 I | rook-ceph-mon2: 2017-07-11 15:00:46.162590 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.124497) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #134 started
- 2017-07-11 15:00:46.162827 I | rook-ceph-mon2: 2017-07-11 15:00:46.162809 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.162556) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #134: memtable #1 done
- 2017-07-11 15:00:46.162871 I | rook-ceph-mon2: 2017-07-11 15:00:46.162857 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.162567) EVENT_LOG_v1 {"time_micros": 1499785246162563, "job": 85, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:00:46.163019 I | rook-ceph-mon2: 2017-07-11 15:00:46.163002 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.162580) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:00:46.163052 I | rook-ceph-mon2:
- 2017-07-11 15:00:46.163153 I | rook-ceph-mon2: 2017-07-11 15:00:46.163139 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 85] Try to delete WAL files size 7284702, prev total WAL file size 7284702, number of live WAL files 2.
- 2017-07-11 15:00:46.163184 I | rook-ceph-mon2:
- 2017-07-11 15:00:46.173196 I | rook-ceph-mon2: 2017-07-11 15:00:46.172931 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:00:46.173255 I | rook-ceph-mon2: 2017-07-11 15:00:46.172983 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.172978) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 15:00:46.173273 I | rook-ceph-mon2:
- 2017-07-11 15:00:46.173285 I | rook-ceph-mon2: 2017-07-11 15:00:46.172989 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 86] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:00:46.173297 I | rook-ceph-mon2: 2017-07-11 15:00:46.172994 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 85 Base level 0, inputs: [134(4732KB)], [132(13MB)]
- 2017-07-11 15:00:46.173329 I | rook-ceph-mon2:
- 2017-07-11 15:00:46.173341 I | rook-ceph-mon2: 2017-07-11 15:00:46.173004 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246172996, "job": 86, "event": "compaction_started", "files_L0": [134], "files_L1": [132], "score": -1, "input_data_size": 18769402}
- 2017-07-11 15:00:46.389540 I | rook-ceph-mon2: 2017-07-11 15:00:46.389492 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 86] Generated table #135: 2438 keys, 16218533 bytes
- 2017-07-11 15:00:46.391937 I | rook-ceph-mon2: 2017-07-11 15:00:46.391916 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246391906, "cf_name": "default", "job": 86, "event": "table_file_creation", "file_number": 135, "file_size": 16218533, "table_properties": {"data_size": 16164940, "index_size": 52774, "filter_size": 0, "raw_key_size": 47120, "raw_average_key_size": 19, "raw_value_size": 16093922, "raw_average_value_size": 6601, "num_data_blocks": 1601, "num_entries": 2438, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:00:46.409393 I | rook-ceph-mon2: 2017-07-11 15:00:46.409146 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 86] Compacted 1@0 + 1@1 files to L1 => 16218533 bytes
- 2017-07-11 15:00:46.428236 I | rook-ceph-mon2: 2017-07-11 15:00:46.428207 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.428149) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 79.5 rd, 68.7 wr, level 1, files in(1, 1) out(1) MB in(4.6, 13.3) out(15.5), read-write-amplify(7.2) write-amplify(3.3) OK, records in: 2947, records dropped: 509
- 2017-07-11 15:00:46.428494 I | rook-ceph-mon2:
- 2017-07-11 15:00:46.429021 I | rook-ceph-mon2: 2017-07-11 15:00:46.428600 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:00:46.428166) EVENT_LOG_v1 {"time_micros": 1499785246428158, "job": 86, "event": "compaction_finished", "compaction_time_micros": 236130, "output_level": 1, "num_output_files": 1, "total_output_size": 16218533, "num_input_records": 2947, "num_output_records": 2438, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:00:46.448332 I | rook-ceph-mon2: 2017-07-11 15:00:46.448296 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246448293, "job": 86, "event": "table_file_deletion", "file_number": 134}
- 2017-07-11 15:00:46.450007 I | rook-ceph-mon2: 2017-07-11 15:00:46.449991 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785246449988, "job": 86, "event": "table_file_deletion", "file_number": 132}
- 2017-07-11 15:00:46.754772 I | rook-ceph-mon2: 2017-07-11 15:00:46.754738 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:46.754887 I | rook-ceph-mon2: 2017-07-11 15:00:46.754867 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/254982026' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:47.449448 I | rook-ceph-mon2: 2017-07-11 15:00:47.449415 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:47.449657 I | rook-ceph-mon2: 2017-07-11 15:00:47.449553 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/760578176' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:48.376305 I | rook-ceph-mon2: 2017-07-11 15:00:48.376272 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:48.382274 I | rook-ceph-mon2: 2017-07-11 15:00:48.382224 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2803382078' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:49.811609 I | rook-ceph-mon2: 2017-07-11 15:00:49.811575 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:00:49.811825 I | rook-ceph-mon2: 2017-07-11 15:00:49.811790 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1563979609' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:00:50.788088 I | rook-ceph-mon2: 2017-07-11 15:00:50.788054 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:50.788318 I | rook-ceph-mon2: 2017-07-11 15:00:50.788246 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3155548727' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:51.703706 I | rook-ceph-mon2: 2017-07-11 15:00:51.703669 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:51.710563 I | rook-ceph-mon2: 2017-07-11 15:00:51.703893 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1519187731' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:52.233654 I | rook-ceph-mon2: 2017-07-11 15:00:52.233613 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:00:52.233836 I | rook-ceph-mon2: 2017-07-11 15:00:52.233822 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1911721004' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:00:52.648470 I | rook-ceph-mon2: 2017-07-11 15:00:52.648145 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:52.648687 I | rook-ceph-mon2: 2017-07-11 15:00:52.648589 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2072082357' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:56.979978 I | rook-ceph-mon2: 2017-07-11 15:00:56.979943 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:00:56.980166 I | rook-ceph-mon2: 2017-07-11 15:00:56.980151 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3669308706' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:00:58.203589 I | rook-ceph-mon2: 2017-07-11 15:00:58.203332 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4926 MB, avail 94261 MB
- 2017-07-11 15:00:58.812207 I | rook-ceph-mon2: 2017-07-11 15:00:58.812097 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:00:58.812418 I | rook-ceph-mon2: 2017-07-11 15:00:58.812335 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2856221838' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:00:59.641369 I | rook-ceph-mon2: 2017-07-11 15:00:59.641292 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #136. Immutable memtables: 0.
- 2017-07-11 15:00:59.641459 I | rook-ceph-mon2:
- 2017-07-11 15:00:59.641478 I | rook-ceph-mon2: 2017-07-11 15:00:59.641328 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 87] Syncing log #133
- 2017-07-11 15:00:59.702037 I | rook-ceph-mon2: 2017-07-11 15:00:59.701174 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:00:59.641322) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:00:59.702450 I | rook-ceph-mon2: 2017-07-11 15:00:59.701184 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 87] Flushing memtable with next log file: 136
- 2017-07-11 15:00:59.702497 I | rook-ceph-mon2:
- 2017-07-11 15:00:59.702512 I | rook-ceph-mon2: 2017-07-11 15:00:59.701194 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785259701190, "job": 87, "event": "flush_started", "num_memtables": 1, "num_entries": 651, "num_deletes": 506, "memory_usage": 567312}
- 2017-07-11 15:00:59.702546 I | rook-ceph-mon2: 2017-07-11 15:00:59.701196 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 87] Level-0 flush table #137: started
- 2017-07-11 15:00:59.852781 I | rook-ceph-mon2: 2017-07-11 15:00:59.852737 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785259852727, "cf_name": "default", "job": 87, "event": "table_file_creation", "file_number": 137, "file_size": 364544, "table_properties": {"data_size": 362525, "index_size": 1205, "filter_size": 0, "raw_key_size": 10905, "raw_average_key_size": 19, "raw_value_size": 354293, "raw_average_value_size": 634, "num_data_blocks": 39, "num_entries": 558, "filter_policy_name": "", "kDeletedKeys": "506", "kMergeOperands": "0"}}
- 2017-07-11 15:00:59.855453 I | rook-ceph-mon2: 2017-07-11 15:00:59.855428 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 87] Level-0 flush table #137: 364544 bytes OK
- 2017-07-11 15:00:59.964375 I | rook-ceph-mon2: 2017-07-11 15:00:59.964058 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:00:59.905070) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #137 started
- 2017-07-11 15:00:59.967469 I | rook-ceph-mon2: 2017-07-11 15:00:59.964064 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:00:59.964018) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #137: memtable #1 done
- 2017-07-11 15:00:59.967519 I | rook-ceph-mon2: 2017-07-11 15:00:59.964066 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:00:59.964031) EVENT_LOG_v1 {"time_micros": 1499785259964026, "job": 87, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:00:59.967536 I | rook-ceph-mon2: 2017-07-11 15:00:59.964068 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:00:59.964046) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:00:59.967548 I | rook-ceph-mon2:
- 2017-07-11 15:00:59.967559 I | rook-ceph-mon2: 2017-07-11 15:00:59.964073 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 87] Try to delete WAL files size 551776, prev total WAL file size 551776, number of live WAL files 2.
- 2017-07-11 15:00:59.967571 I | rook-ceph-mon2:
- 2017-07-11 15:00:59.967598 I | rook-ceph-mon2: 2017-07-11 15:00:59.964309 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:00:59.967648 I | rook-ceph-mon2: 2017-07-11 15:00:59.965165 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:00:59.965160) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 15:00:59.967692 I | rook-ceph-mon2:
- 2017-07-11 15:00:59.967710 I | rook-ceph-mon2: 2017-07-11 15:00:59.965171 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 88] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:00:59.967734 I | rook-ceph-mon2: 2017-07-11 15:00:59.965176 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 87 Base level 0, inputs: [137(356KB)], [135(15MB)]
- 2017-07-11 15:00:59.967767 I | rook-ceph-mon2:
- 2017-07-11 15:00:59.967781 I | rook-ceph-mon2: 2017-07-11 15:00:59.965184 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785259965178, "job": 88, "event": "compaction_started", "files_L0": [137], "files_L1": [135], "score": -1, "input_data_size": 16583077}
- 2017-07-11 15:01:00.280746 I | rook-ceph-mon2: 2017-07-11 15:01:00.280496 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:00.286921 I | rook-ceph-mon2: 2017-07-11 15:01:00.280518 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3060686807' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:00.308474 I | rook-ceph-mon2: 2017-07-11 15:01:00.298832 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 88] Generated table #138: 1977 keys, 13482425 bytes
- 2017-07-11 15:01:00.308526 I | rook-ceph-mon2: 2017-07-11 15:01:00.298855 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785260298847, "cf_name": "default", "job": 88, "event": "table_file_creation", "file_number": 138, "file_size": 13482425, "table_properties": {"data_size": 13437456, "index_size": 44150, "filter_size": 0, "raw_key_size": 38107, "raw_average_key_size": 19, "raw_value_size": 13378877, "raw_average_value_size": 6767, "num_data_blocks": 1351, "num_entries": 1977, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:01:00.366870 I | rook-ceph-mon2: 2017-07-11 15:01:00.351514 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 88] Compacted 1@0 + 1@1 files to L1 => 13482425 bytes
- 2017-07-11 15:01:00.480632 I | rook-ceph-mon2: 2017-07-11 15:01:00.480589 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:01:00.480517) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 42.9 rd, 34.9 wr, level 1, files in(1, 1) out(1) MB in(0.3, 15.5) out(12.9), read-write-amplify(82.5) write-amplify(37.0) OK, records in: 2996, records dropped: 1019
- 2017-07-11 15:01:00.482611 I | rook-ceph-mon2:
- 2017-07-11 15:01:00.482785 I | rook-ceph-mon2: 2017-07-11 15:01:00.482652 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:01:00.480543) EVENT_LOG_v1 {"time_micros": 1499785260480534, "job": 88, "event": "compaction_finished", "compaction_time_micros": 386309, "output_level": 1, "num_output_files": 1, "total_output_size": 13482425, "num_input_records": 2996, "num_output_records": 1977, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:01:00.483117 I | rook-ceph-mon2: 2017-07-11 15:01:00.483100 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785260483096, "job": 88, "event": "table_file_deletion", "file_number": 137}
- 2017-07-11 15:01:00.501057 I | rook-ceph-mon2: 2017-07-11 15:01:00.501038 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785260501036, "job": 88, "event": "table_file_deletion", "file_number": 135}
- 2017-07-11 15:01:00.501150 I | rook-ceph-mon2: 2017-07-11 15:01:00.501119 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:01:02.912654 I | rook-ceph-mon2: 2017-07-11 15:01:02.912620 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:02.912836 I | rook-ceph-mon2: 2017-07-11 15:01:02.912758 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/186113412' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:04.336191 I | rook-ceph-mon2: 2017-07-11 15:01:04.336159 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:04.336369 I | rook-ceph-mon2: 2017-07-11 15:01:04.336290 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1143548249' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:04.793960 I | rook-ceph-mon2: 2017-07-11 15:01:04.793925 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:04.794187 I | rook-ceph-mon2: 2017-07-11 15:01:04.794060 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2249124490' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:06.782587 I | rook-ceph-mon2: 2017-07-11 15:01:06.782532 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:06.782833 I | rook-ceph-mon2: 2017-07-11 15:01:06.782816 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2938061930' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:07.551998 I | rook-ceph-mon2: 2017-07-11 15:01:07.551962 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:07.552181 I | rook-ceph-mon2: 2017-07-11 15:01:07.552099 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1768772850' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:07.674758 I | rook-ceph-mon2: 2017-07-11 15:01:07.674721 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:07.674884 I | rook-ceph-mon2: 2017-07-11 15:01:07.674868 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/465601297' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:08.177911 I | rook-ceph-mon2: 2017-07-11 15:01:08.177680 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:08.178122 I | rook-ceph-mon2: 2017-07-11 15:01:08.177709 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4179383047' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:09.645756 I | rook-ceph-mon2: 2017-07-11 15:01:09.645721 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:09.645976 I | rook-ceph-mon2: 2017-07-11 15:01:09.645944 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3570597316' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:01:11.612653 I | rook-ceph-mon2: 2017-07-11 15:01:11.612598 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:11.613178 I | rook-ceph-mon2: 2017-07-11 15:01:11.613058 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/979993712' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:12.590287 I | rook-ceph-mon2: 2017-07-11 15:01:12.590228 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:12.596333 I | rook-ceph-mon2: 2017-07-11 15:01:12.590475 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.0:0/2972464585' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:14.986232 I | rook-ceph-mon2: 2017-07-11 15:01:14.986171 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:14.986464 I | rook-ceph-mon2: 2017-07-11 15:01:14.986423 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2573759133' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:16.296332 I | rook-ceph-mon2: 2017-07-11 15:01:16.296297 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:16.296533 I | rook-ceph-mon2: 2017-07-11 15:01:16.296453 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/701284410' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:16.738621 I | rook-ceph-mon2: 2017-07-11 15:01:16.738586 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:16.738876 I | rook-ceph-mon2: 2017-07-11 15:01:16.738757 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3286100557' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:18.787161 I | rook-ceph-mon2: 2017-07-11 15:01:18.787116 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:01:18.787791 I | rook-ceph-mon2: 2017-07-11 15:01:18.787772 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/186420200' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:01:19.765292 I | rook-ceph-mon2: 2017-07-11 15:01:19.765259 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:19.765516 I | rook-ceph-mon2: 2017-07-11 15:01:19.765398 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1974681258' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:20.246657 I | rook-ceph-mon2: 2017-07-11 15:01:20.246624 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:20.246759 I | rook-ceph-mon2: 2017-07-11 15:01:20.246745 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3456638970' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:20.702526 I | rook-ceph-mon2: 2017-07-11 15:01:20.702492 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:20.702602 I | rook-ceph-mon2: 2017-07-11 15:01:20.702588 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2507349421' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:22.638251 I | rook-ceph-mon2: 2017-07-11 15:01:22.638201 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:22.638434 I | rook-ceph-mon2: 2017-07-11 15:01:22.638346 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1423728518' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:23.109140 I | rook-ceph-mon2: 2017-07-11 15:01:23.109105 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:23.109336 I | rook-ceph-mon2: 2017-07-11 15:01:23.109248 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2594582578' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:23.560432 I | rook-ceph-mon2: 2017-07-11 15:01:23.560398 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:23.560679 I | rook-ceph-mon2: 2017-07-11 15:01:23.560529 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/176658224' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:24.121348 I | rook-ceph-mon2: 2017-07-11 15:01:24.121312 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:24.121761 I | rook-ceph-mon2: 2017-07-11 15:01:24.121682 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1450828207' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:24.569583 I | rook-ceph-mon2: 2017-07-11 15:01:24.569548 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:24.569706 I | rook-ceph-mon2: 2017-07-11 15:01:24.569690 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1705240949' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:26.573286 I | rook-ceph-mon2: 2017-07-11 15:01:26.573254 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:26.573470 I | rook-ceph-mon2: 2017-07-11 15:01:26.573390 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/847778888' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:27.030608 I | rook-ceph-mon2: 2017-07-11 15:01:27.030576 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:27.037050 I | rook-ceph-mon2: 2017-07-11 15:01:27.030705 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4289624328' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:27.497693 I | rook-ceph-mon2: 2017-07-11 15:01:27.497660 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:27.497884 I | rook-ceph-mon2: 2017-07-11 15:01:27.497806 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/950921968' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:27.974024 I | rook-ceph-mon2: 2017-07-11 15:01:27.973992 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:27.974189 I | rook-ceph-mon2: 2017-07-11 15:01:27.974116 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1100133070' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:28.436894 I | rook-ceph-mon2: 2017-07-11 15:01:28.436853 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:28.437144 I | rook-ceph-mon2: 2017-07-11 15:01:28.437115 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1613964556' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:30.782864 I | rook-ceph-mon2: 2017-07-11 15:01:30.782828 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:30.783081 I | rook-ceph-mon2: 2017-07-11 15:01:30.782982 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1780578755' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:31.531342 I | rook-ceph-mon2: 2017-07-11 15:01:31.531307 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:31.531526 I | rook-ceph-mon2: 2017-07-11 15:01:31.531441 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1879143201' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:31.985571 I | rook-ceph-mon2: 2017-07-11 15:01:31.985540 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:31.990543 I | rook-ceph-mon2: 2017-07-11 15:01:31.990005 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3515151696' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:32.383496 I | rook-ceph-mon2: 2017-07-11 15:01:32.383450 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:32.383681 I | rook-ceph-mon2: 2017-07-11 15:01:32.383600 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2647717587' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:34.730179 I | rook-ceph-mon2: 2017-07-11 15:01:34.730142 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:34.730409 I | rook-ceph-mon2: 2017-07-11 15:01:34.730365 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/183203421' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:35.856507 I | rook-ceph-mon2: 2017-07-11 15:01:35.856472 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:35.856732 I | rook-ceph-mon2: 2017-07-11 15:01:35.856703 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1182312167' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:36.808310 I | rook-ceph-mon2: 2017-07-11 15:01:36.808252 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:36.808500 I | rook-ceph-mon2: 2017-07-11 15:01:36.808417 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4114754821' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:38.871315 I | rook-ceph-mon2: 2017-07-11 15:01:38.871237 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:38.871581 I | rook-ceph-mon2: 2017-07-11 15:01:38.871471 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2518466011' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:39.362626 I | rook-ceph-mon2: 2017-07-11 15:01:39.362553 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:39.363210 I | rook-ceph-mon2: 2017-07-11 15:01:39.363124 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2644019093' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:39.796027 I | rook-ceph-mon2: 2017-07-11 15:01:39.795985 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:39.796214 I | rook-ceph-mon2: 2017-07-11 15:01:39.796129 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/719558665' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:40.740731 I | rook-ceph-mon2: 2017-07-11 15:01:40.740696 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:40.740949 I | rook-ceph-mon2: 2017-07-11 15:01:40.740867 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1647287486' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:43.589069 I | rook-ceph-mon2: 2017-07-11 15:01:43.589035 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:43.589258 I | rook-ceph-mon2: 2017-07-11 15:01:43.589175 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/727820826' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:46.898973 I | rook-ceph-mon2: 2017-07-11 15:01:46.898940 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:46.899154 I | rook-ceph-mon2: 2017-07-11 15:01:46.899079 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2197370262' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:47.294619 I | rook-ceph-mon2: 2017-07-11 15:01:47.294585 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:47.294805 I | rook-ceph-mon2: 2017-07-11 15:01:47.294728 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2997713655' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:48.334979 I | rook-ceph-mon2: 2017-07-11 15:01:48.334948 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:48.335204 I | rook-ceph-mon2: 2017-07-11 15:01:48.335164 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3340840122' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:49.191585 I | rook-ceph-mon2: 2017-07-11 15:01:49.191552 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:49.191692 I | rook-ceph-mon2: 2017-07-11 15:01:49.191677 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/598582216' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:01:50.697288 I | rook-ceph-mon2: 2017-07-11 15:01:50.697253 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:50.697504 I | rook-ceph-mon2: 2017-07-11 15:01:50.697396 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/996189495' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:51.999167 I | rook-ceph-mon2: 2017-07-11 15:01:51.999128 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:51.999382 I | rook-ceph-mon2: 2017-07-11 15:01:51.999351 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1080205534' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:54.087449 I | rook-ceph-mon2: 2017-07-11 15:01:54.087414 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:54.087555 I | rook-ceph-mon2: 2017-07-11 15:01:54.087539 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1522447569' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:54.527615 I | rook-ceph-mon2: 2017-07-11 15:01:54.527581 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:54.527748 I | rook-ceph-mon2: 2017-07-11 15:01:54.527733 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3299252487' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:55.007578 I | rook-ceph-mon2: 2017-07-11 15:01:55.007337 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:55.007677 I | rook-ceph-mon2: 2017-07-11 15:01:55.007358 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1167150167' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:56.064420 I | rook-ceph-mon2: 2017-07-11 15:01:56.064375 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:56.064655 I | rook-ceph-mon2: 2017-07-11 15:01:56.064608 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3133401208' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:56.925544 I | rook-ceph-mon2: 2017-07-11 15:01:56.925508 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:01:56.925762 I | rook-ceph-mon2: 2017-07-11 15:01:56.925731 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1663793527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:01:57.874308 I | rook-ceph-mon2: 2017-07-11 15:01:57.874273 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:57.874556 I | rook-ceph-mon2: 2017-07-11 15:01:57.874506 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1958784416' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:58.205752 I | rook-ceph-mon2: 2017-07-11 15:01:58.205519 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94263 MB
- 2017-07-11 15:01:58.333855 I | rook-ceph-mon2: 2017-07-11 15:01:58.333825 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:01:58.334036 I | rook-ceph-mon2: 2017-07-11 15:01:58.333962 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/810192839' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:01:58.750122 I | rook-ceph-mon2: 2017-07-11 15:01:58.749709 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:58.750468 I | rook-ceph-mon2: 2017-07-11 15:01:58.749730 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2742228333' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:01:59.199393 I | rook-ceph-mon2: 2017-07-11 15:01:59.199358 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:01:59.199627 I | rook-ceph-mon2: 2017-07-11 15:01:59.199576 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3789164897' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:01:59.661307 I | rook-ceph-mon2: 2017-07-11 15:01:59.661250 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:01:59.661563 I | rook-ceph-mon2: 2017-07-11 15:01:59.661536 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2994754857' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:02.333301 I | rook-ceph-mon2: 2017-07-11 15:02:02.333270 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:02.333407 I | rook-ceph-mon2: 2017-07-11 15:02:02.333392 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3169582573' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:02.719793 I | rook-ceph-mon2: 2017-07-11 15:02:02.719766 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:02:02.719980 I | rook-ceph-mon2: 2017-07-11 15:02:02.719890 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1213449526' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:02:03.142662 I | rook-ceph-mon2: 2017-07-11 15:02:03.142628 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:03.142855 I | rook-ceph-mon2: 2017-07-11 15:02:03.142764 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2724442618' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:04.350390 I | rook-ceph-mon2: 2017-07-11 15:02:04.350355 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:02:04.350585 I | rook-ceph-mon2: 2017-07-11 15:02:04.350500 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3171481459' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:02:04.568764 I | rook-ceph-mon2: 2017-07-11 15:02:04.568685 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:04.569314 I | rook-ceph-mon2: 2017-07-11 15:02:04.569298 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2039878995' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:05.220983 I | rook-ceph-mon2: 2017-07-11 15:02:05.220946 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:05.227066 I | rook-ceph-mon2: 2017-07-11 15:02:05.227043 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/167026417' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:07.101585 I | rook-ceph-mon2: 2017-07-11 15:02:07.101511 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:07.101661 I | rook-ceph-mon2: 2017-07-11 15:02:07.101533 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3106636971' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:08.766304 I | rook-ceph-mon2: 2017-07-11 15:02:08.766241 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:08.766496 I | rook-ceph-mon2: 2017-07-11 15:02:08.766412 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1171787742' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:09.704803 I | rook-ceph-mon2: 2017-07-11 15:02:09.704759 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:09.705012 I | rook-ceph-mon2: 2017-07-11 15:02:09.704927 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3925896749' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:10.235219 I | rook-ceph-mon2: 2017-07-11 15:02:10.235186 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:02:10.235407 I | rook-ceph-mon2: 2017-07-11 15:02:10.235322 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1340089925' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:02:12.826711 I | rook-ceph-mon2: 2017-07-11 15:02:12.826652 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:12.827063 I | rook-ceph-mon2: 2017-07-11 15:02:12.827025 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3739077248' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:13.269239 I | rook-ceph-mon2: 2017-07-11 15:02:13.269192 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:13.269367 I | rook-ceph-mon2: 2017-07-11 15:02:13.269351 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/706796039' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:13.678241 I | rook-ceph-mon2: 2017-07-11 15:02:13.678207 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:13.678421 I | rook-ceph-mon2: 2017-07-11 15:02:13.678344 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3028602951' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:14.724874 I | rook-ceph-mon2: 2017-07-11 15:02:14.724633 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:14.724968 I | rook-ceph-mon2: 2017-07-11 15:02:14.724653 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1154879674' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:16.619576 I | rook-ceph-mon2: 2017-07-11 15:02:16.619538 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:16.619770 I | rook-ceph-mon2: 2017-07-11 15:02:16.619686 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2158046342' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:17.401864 I | rook-ceph-mon2: 2017-07-11 15:02:17.401646 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:17.401934 I | rook-ceph-mon2: 2017-07-11 15:02:17.401682 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1970196602' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:17.805908 I | rook-ceph-mon2: 2017-07-11 15:02:17.805875 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:02:17.806037 I | rook-ceph-mon2: 2017-07-11 15:02:17.806022 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1763860208' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:02:19.079796 I | rook-ceph-mon2: 2017-07-11 15:02:19.079762 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:02:19.080069 I | rook-ceph-mon2: 2017-07-11 15:02:19.080033 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4226760208' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:02:20.048559 I | rook-ceph-mon2: 2017-07-11 15:02:20.048525 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:20.048733 I | rook-ceph-mon2: 2017-07-11 15:02:20.048657 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/437168839' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:21.979764 I | rook-ceph-mon2: 2017-07-11 15:02:21.979728 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:21.980000 I | rook-ceph-mon2: 2017-07-11 15:02:21.979875 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2763275543' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:22.730004 I | rook-ceph-mon2: 2017-07-11 15:02:22.729968 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:22.730190 I | rook-ceph-mon2: 2017-07-11 15:02:22.730115 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3316436546' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:23.594041 I | rook-ceph-mon2: 2017-07-11 15:02:23.593971 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd dump", "format": "json"} v 0) v1
- 2017-07-11 15:02:23.594267 I | rook-ceph-mon2: 2017-07-11 15:02:23.594224 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2375512809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch
- 2017-07-11 15:02:24.638283 I | rook-ceph-mon2: 2017-07-11 15:02:24.638249 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:24.638483 I | rook-ceph-mon2: 2017-07-11 15:02:24.638391 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4215061960' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:26.455781 I | rook-ceph-mon2: 2017-07-11 15:02:26.449550 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:26.456085 I | rook-ceph-mon2: 2017-07-11 15:02:26.455391 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1930107193' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:27.647474 I | rook-ceph-mon2: 2017-07-11 15:02:27.647399 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:27.647662 I | rook-ceph-mon2: 2017-07-11 15:02:27.647439 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2922461693' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:29.561366 I | rook-ceph-mon2: 2017-07-11 15:02:29.561246 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:29.561448 I | rook-ceph-mon2: 2017-07-11 15:02:29.561268 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3020469443' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:30.574762 I | rook-ceph-mon2: 2017-07-11 15:02:30.574723 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:30.574977 I | rook-ceph-mon2: 2017-07-11 15:02:30.574874 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4052577934' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:31.821547 I | rook-ceph-mon2: 2017-07-11 15:02:31.821492 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "json"} v 0) v1
- 2017-07-11 15:02:31.827475 I | rook-ceph-mon2: 2017-07-11 15:02:31.827454 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1350946646' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch
- 2017-07-11 15:02:32.220997 I | rook-ceph-mon2: 2017-07-11 15:02:32.220964 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "status", "format": "plain"} v 0) v1
- 2017-07-11 15:02:32.221101 I | rook-ceph-mon2: 2017-07-11 15:02:32.221086 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/4171059168' entity='client.admin' cmd=[{"prefix": "status", "format": "plain"}]: dispatch
- 2017-07-11 15:02:34.604882 I | rook-ceph-mon2: 2017-07-11 15:02:34.604452 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "df", "detail": "detail", "format": "json"} v 0) v1
- 2017-07-11 15:02:34.605179 I | rook-ceph-mon2: 2017-07-11 15:02:34.604490 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3007513799' entity='client.admin' cmd=[{"prefix": "df", "detail": "detail", "format": "json"}]: dispatch
- 2017-07-11 15:02:38.476316 I | rook-ceph-mon2: 2017-07-11 15:02:38.476280 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:38.476617 I | rook-ceph-mon2: 2017-07-11 15:02:38.476597 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3873497956' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:50.074316 I | rook-ceph-mon2: 2017-07-11 15:02:50.074276 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:02:50.074532 I | rook-ceph-mon2: 2017-07-11 15:02:50.074427 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/187754652' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:02:58.206076 I | rook-ceph-mon2: 2017-07-11 15:02:58.205781 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4922 MB, avail 94264 MB
- 2017-07-11 15:03:12.826835 I | rook-ceph-mon2: 2017-07-11 15:03:12.826797 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:12.827098 I | rook-ceph-mon2: 2017-07-11 15:03:12.827021 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/402014655' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:24.240690 I | rook-ceph-mon2: 2017-07-11 15:03:24.240643 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:24.240755 I | rook-ceph-mon2: 2017-07-11 15:03:24.240738 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4220783504' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:25.925311 I | rook-ceph-mon2: 2017-07-11 15:03:25.925274 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:25.925415 I | rook-ceph-mon2: 2017-07-11 15:03:25.925401 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4197455512' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:47.078221 I | rook-ceph-mon2: 2017-07-11 15:03:47.078188 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:03:47.078473 I | rook-ceph-mon2: 2017-07-11 15:03:47.078456 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3750826142' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:03:58.206434 I | rook-ceph-mon2: 2017-07-11 15:03:58.206098 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4922 MB, avail 94264 MB
- 2017-07-11 15:04:36.784040 I | rook-ceph-mon2: 2017-07-11 15:04:35.639122 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2193 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0585989s > max 0.05s
- 2017-07-11 15:04:36.784136 I | rook-ceph-mon2: 2017-07-11 15:04:35.639389 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2194 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.224719s > max 0.05s
- 2017-07-11 15:04:45.735289 I | rook-ceph-mon2: 2017-07-11 15:04:45.735253 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:04:45.735460 I | rook-ceph-mon2: 2017-07-11 15:04:45.735386 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2837377890' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:54.081157 I | rook-ceph-mon2: 2017-07-11 15:04:54.081097 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:04:54.081221 I | rook-ceph-mon2: 2017-07-11 15:04:54.081206 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4086529606' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:04:58.206970 I | rook-ceph-mon2: 2017-07-11 15:04:58.206684 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4922 MB, avail 94264 MB
- 2017-07-11 15:05:09.437760 I | rook-ceph-mon2: 2017-07-11 15:05:09.437661 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #139. Immutable memtables: 0.
- 2017-07-11 15:05:09.437864 I | rook-ceph-mon2:
- 2017-07-11 15:05:09.437889 I | rook-ceph-mon2: 2017-07-11 15:05:09.437703 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 89] Syncing log #136
- 2017-07-11 15:05:09.481281 I | rook-ceph-mon2: 2017-07-11 15:05:09.479293 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.437698) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:05:09.481365 I | rook-ceph-mon2: 2017-07-11 15:05:09.479311 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 89] Flushing memtable with next log file: 139
- 2017-07-11 15:05:09.481382 I | rook-ceph-mon2:
- 2017-07-11 15:05:09.481412 I | rook-ceph-mon2: 2017-07-11 15:05:09.479323 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785509479318, "job": 89, "event": "flush_started", "num_memtables": 1, "num_entries": 2097, "num_deletes": 251, "memory_usage": 6525280}
- 2017-07-11 15:05:09.481427 I | rook-ceph-mon2: 2017-07-11 15:05:09.479326 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 89] Level-0 flush table #140: started
- 2017-07-11 15:05:09.910611 I | rook-ceph-mon2: 2017-07-11 15:05:09.910565 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785509910556, "cf_name": "default", "job": 89, "event": "table_file_creation", "file_number": 140, "file_size": 4305368, "table_properties": {"data_size": 4289285, "index_size": 15265, "filter_size": 0, "raw_key_size": 15589, "raw_average_key_size": 18, "raw_value_size": 4267177, "raw_average_value_size": 5134, "num_data_blocks": 481, "num_entries": 831, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 15:05:09.910704 I | rook-ceph-mon2: 2017-07-11 15:05:09.910688 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 89] Level-0 flush table #140: 4305368 bytes OK
- 2017-07-11 15:05:09.963274 I | rook-ceph-mon2: 2017-07-11 15:05:09.963239 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.931514) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #140 started
- 2017-07-11 15:05:09.963332 I | rook-ceph-mon2: 2017-07-11 15:05:09.963317 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.963200) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #140: memtable #1 done
- 2017-07-11 15:05:09.963390 I | rook-ceph-mon2: 2017-07-11 15:05:09.963350 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.963212) EVENT_LOG_v1 {"time_micros": 1499785509963207, "job": 89, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:05:09.963422 I | rook-ceph-mon2: 2017-07-11 15:05:09.963408 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.963226) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:05:09.963437 I | rook-ceph-mon2:
- 2017-07-11 15:05:09.963482 I | rook-ceph-mon2: 2017-07-11 15:05:09.963469 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 89] Try to delete WAL files size 6472162, prev total WAL file size 6472162, number of live WAL files 2.
- 2017-07-11 15:05:09.963497 I | rook-ceph-mon2:
- 2017-07-11 15:05:09.965253 I | rook-ceph-mon2: 2017-07-11 15:05:09.964516 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:05:09.965304 I | rook-ceph-mon2: 2017-07-11 15:05:09.964555 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:05:09.964550) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 15:05:09.965321 I | rook-ceph-mon2:
- 2017-07-11 15:05:09.965333 I | rook-ceph-mon2: 2017-07-11 15:05:09.964561 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 90] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:05:09.965345 I | rook-ceph-mon2: 2017-07-11 15:05:09.964565 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 89 Base level 0, inputs: [140(4204KB)], [138(12MB)]
- 2017-07-11 15:05:09.965371 I | rook-ceph-mon2:
- 2017-07-11 15:05:09.965383 I | rook-ceph-mon2: 2017-07-11 15:05:09.964575 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785509964567, "job": 90, "event": "compaction_started", "files_L0": [140], "files_L1": [138], "score": -1, "input_data_size": 17787793}
- 2017-07-11 15:05:10.124790 I | rook-ceph-mon2: 2017-07-11 15:05:10.124739 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 90] Generated table #141: 2299 keys, 15248881 bytes
- 2017-07-11 15:05:10.124986 I | rook-ceph-mon2: 2017-07-11 15:05:10.124895 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785510124886, "cf_name": "default", "job": 90, "event": "table_file_creation", "file_number": 141, "file_size": 15248881, "table_properties": {"data_size": 15196186, "index_size": 51876, "filter_size": 0, "raw_key_size": 44475, "raw_average_key_size": 19, "raw_value_size": 15127710, "raw_average_value_size": 6580, "num_data_blocks": 1580, "num_entries": 2299, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:05:10.154946 I | rook-ceph-mon2: 2017-07-11 15:05:10.154912 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 90] Compacted 1@0 + 1@1 files to L1 => 15248881 bytes
- 2017-07-11 15:05:10.217512 I | rook-ceph-mon2: 2017-07-11 15:05:10.217482 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:05:10.217421) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 93.5 rd, 80.1 wr, level 1, files in(1, 1) out(1) MB in(4.1, 12.9) out(14.5), read-write-amplify(7.7) write-amplify(3.5) OK, records in: 2808, records dropped: 509
- 2017-07-11 15:05:10.217556 I | rook-ceph-mon2:
- 2017-07-11 15:05:10.217610 I | rook-ceph-mon2: 2017-07-11 15:05:10.217593 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:05:10.217440) EVENT_LOG_v1 {"time_micros": 1499785510217432, "job": 90, "event": "compaction_finished", "compaction_time_micros": 190323, "output_level": 1, "num_output_files": 1, "total_output_size": 15248881, "num_input_records": 2808, "num_output_records": 2299, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:05:10.218308 I | rook-ceph-mon2: 2017-07-11 15:05:10.218294 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785510218291, "job": 90, "event": "table_file_deletion", "file_number": 140}
- 2017-07-11 15:05:10.219865 I | rook-ceph-mon2: 2017-07-11 15:05:10.219850 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785510219848, "job": 90, "event": "table_file_deletion", "file_number": 138}
- 2017-07-11 15:05:15.418308 I | rook-ceph-mon2: 2017-07-11 15:05:15.418259 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:15.418381 I | rook-ceph-mon2: 2017-07-11 15:05:15.418366 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3643612392' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:18.831472 I | rook-ceph-mon2: 2017-07-11 15:05:18.831433 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:18.831711 I | rook-ceph-mon2: 2017-07-11 15:05:18.831582 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2888784185' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:26.629148 I | rook-ceph-mon2: 2017-07-11 15:05:26.629088 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:26.629339 I | rook-ceph-mon2: 2017-07-11 15:05:26.629245 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2680584291' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:39.910171 I | rook-ceph-mon2: 2017-07-11 15:05:39.900363 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #142. Immutable memtables: 0.
- 2017-07-11 15:05:39.910368 I | rook-ceph-mon2:
- 2017-07-11 15:05:39.910395 I | rook-ceph-mon2: 2017-07-11 15:05:39.903468 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 91] Syncing log #139
- 2017-07-11 15:05:40.049237 I | rook-ceph-mon2: 2017-07-11 15:05:40.048478 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:05:39.903461) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:05:40.049313 I | rook-ceph-mon2: 2017-07-11 15:05:40.048499 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 91] Flushing memtable with next log file: 142
- 2017-07-11 15:05:40.049330 I | rook-ceph-mon2:
- 2017-07-11 15:05:40.049343 I | rook-ceph-mon2: 2017-07-11 15:05:40.048513 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785540048507, "job": 91, "event": "flush_started", "num_memtables": 1, "num_entries": 425, "num_deletes": 251, "memory_usage": 574272}
- 2017-07-11 15:05:40.049372 I | rook-ceph-mon2: 2017-07-11 15:05:40.048515 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 91] Level-0 flush table #143: started
- 2017-07-11 15:05:40.079545 I | rook-ceph-mon2: 2017-07-11 15:05:40.076538 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785540076527, "cf_name": "default", "job": 91, "event": "table_file_creation", "file_number": 143, "file_size": 315036, "table_properties": {"data_size": 313089, "index_size": 1133, "filter_size": 0, "raw_key_size": 6014, "raw_average_key_size": 19, "raw_value_size": 308243, "raw_average_value_size": 1024, "num_data_blocks": 37, "num_entries": 301, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 15:05:40.079622 I | rook-ceph-mon2: 2017-07-11 15:05:40.076550 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 91] Level-0 flush table #143: 315036 bytes OK
- 2017-07-11 15:05:40.121852 I | rook-ceph-mon2: 2017-07-11 15:05:40.121793 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.090689) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #143 started
- 2017-07-11 15:05:40.121966 I | rook-ceph-mon2: 2017-07-11 15:05:40.121951 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.121722) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #143: memtable #1 done
- 2017-07-11 15:05:40.122046 I | rook-ceph-mon2: 2017-07-11 15:05:40.122031 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.121751) EVENT_LOG_v1 {"time_micros": 1499785540121742, "job": 91, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:05:40.122090 I | rook-ceph-mon2: 2017-07-11 15:05:40.122077 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.121775) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:05:40.122104 I | rook-ceph-mon2:
- 2017-07-11 15:05:40.122132 I | rook-ceph-mon2: 2017-07-11 15:05:40.122120 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 91] Try to delete WAL files size 564040, prev total WAL file size 564040, number of live WAL files 2.
- 2017-07-11 15:05:40.122160 I | rook-ceph-mon2:
- 2017-07-11 15:05:40.123459 I | rook-ceph-mon2: 2017-07-11 15:05:40.122432 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:05:40.123499 I | rook-ceph-mon2: 2017-07-11 15:05:40.122465 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.122460) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 15:05:40.123516 I | rook-ceph-mon2:
- 2017-07-11 15:05:40.123529 I | rook-ceph-mon2: 2017-07-11 15:05:40.122469 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 92] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:05:40.123540 I | rook-ceph-mon2: 2017-07-11 15:05:40.122473 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 91 Base level 0, inputs: [143(307KB)], [141(14MB)]
- 2017-07-11 15:05:40.123569 I | rook-ceph-mon2:
- 2017-07-11 15:05:40.123584 I | rook-ceph-mon2: 2017-07-11 15:05:40.122483 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785540122475, "job": 92, "event": "compaction_started", "files_L0": [143], "files_L1": [141], "score": -1, "input_data_size": 15563917}
- 2017-07-11 15:05:40.293470 I | rook-ceph-mon2: 2017-07-11 15:05:40.293420 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 92] Generated table #144: 2100 keys, 13967280 bytes
- 2017-07-11 15:05:40.293580 I | rook-ceph-mon2: 2017-07-11 15:05:40.293563 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785540293553, "cf_name": "default", "job": 92, "event": "table_file_creation", "file_number": 144, "file_size": 13967280, "table_properties": {"data_size": 13921391, "index_size": 45070, "filter_size": 0, "raw_key_size": 40442, "raw_average_key_size": 19, "raw_value_size": 13860477, "raw_average_value_size": 6600, "num_data_blocks": 1374, "num_entries": 2100, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:05:40.365327 I | rook-ceph-mon2: 2017-07-11 15:05:40.365299 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 92] Compacted 1@0 + 1@1 files to L1 => 13967280 bytes
- 2017-07-11 15:05:40.398043 I | rook-ceph-mon2: 2017-07-11 15:05:40.398016 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.397957) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 64.1 rd, 57.5 wr, level 1, files in(1, 1) out(1) MB in(0.3, 14.5) out(13.3), read-write-amplify(93.7) write-amplify(44.3) OK, records in: 2600, records dropped: 500
- 2017-07-11 15:05:40.398087 I | rook-ceph-mon2:
- 2017-07-11 15:05:40.398123 I | rook-ceph-mon2: 2017-07-11 15:05:40.398107 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:05:40.397975) EVENT_LOG_v1 {"time_micros": 1499785540397967, "job": 92, "event": "compaction_finished", "compaction_time_micros": 242803, "output_level": 1, "num_output_files": 1, "total_output_size": 13967280, "num_input_records": 2600, "num_output_records": 2100, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:05:40.398371 I | rook-ceph-mon2: 2017-07-11 15:05:40.398356 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785540398354, "job": 92, "event": "table_file_deletion", "file_number": 143}
- 2017-07-11 15:05:40.400309 I | rook-ceph-mon2: 2017-07-11 15:05:40.400292 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785540400289, "job": 92, "event": "table_file_deletion", "file_number": 141}
- 2017-07-11 15:05:40.400386 I | rook-ceph-mon2: 2017-07-11 15:05:40.400369 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:05:48.642977 I | rook-ceph-mon2: 2017-07-11 15:05:48.642942 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:48.643214 I | rook-ceph-mon2: 2017-07-11 15:05:48.643198 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3754159127' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:05:58.207306 I | rook-ceph-mon2: 2017-07-11 15:05:58.207009 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94264 MB
- 2017-07-11 15:05:59.696295 I | rook-ceph-mon2: 2017-07-11 15:05:59.696257 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:05:59.696412 I | rook-ceph-mon2: 2017-07-11 15:05:59.696397 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2299551227' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:00.486647 I | rook-ceph-mon2: 2017-07-11 15:06:00.486584 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:00.487394 I | rook-ceph-mon2: 2017-07-11 15:06:00.487371 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1484807415' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:14.399217 I | rook-ceph-mon2: 2017-07-11 15:06:14.399160 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:14.399415 I | rook-ceph-mon2: 2017-07-11 15:06:14.399334 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2824242299' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:22.011028 I | rook-ceph-mon2: 2017-07-11 15:06:22.010988 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:22.011215 I | rook-ceph-mon2: 2017-07-11 15:06:22.011130 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1683946328' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:33.054658 I | rook-ceph-mon2: 2017-07-11 15:06:33.053180 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:33.054739 I | rook-ceph-mon2: 2017-07-11 15:06:33.053201 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/528231185' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:56.238124 I | rook-ceph-mon2: 2017-07-11 15:06:56.238079 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:06:56.238283 I | rook-ceph-mon2: 2017-07-11 15:06:56.238216 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3481544062' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:06:58.207626 I | rook-ceph-mon2: 2017-07-11 15:06:58.207358 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94264 MB
- 2017-07-11 15:07:19.386988 I | rook-ceph-mon2: 2017-07-11 15:07:19.386945 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd lspools", "format": "json"} v 0) v1
- 2017-07-11 15:07:19.387195 I | rook-ceph-mon2: 2017-07-11 15:07:19.387118 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/1774414699' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json"}]: dispatch
- 2017-07-11 15:07:20.703969 I | rook-ceph-mon2: 2017-07-11 15:07:20.703935 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"var": "all", "prefix": "osd pool get", "pool": "rbd", "format": "json"} v 0) v1
- 2017-07-11 15:07:20.704250 I | rook-ceph-mon2: 2017-07-11 15:07:20.704230 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/517547342' entity='client.admin' cmd=[{"var": "all", "prefix": "osd pool get", "pool": "rbd", "format": "json"}]: dispatch
- 2017-07-11 15:07:22.116592 I | rook-ceph-mon2: 2017-07-11 15:07:22.116556 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"} v 0) v1
- 2017-07-11 15:07:22.116835 I | rook-ceph-mon2: 2017-07-11 15:07:22.116816 7f0c84e17700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.5:0/6333933' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:22.118780 I | rook-ceph-mon2: 2017-07-11 15:07:22.118761 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"} v 0) v1
- 2017-07-11 15:07:22.118858 I | rook-ceph-mon2: 2017-07-11 15:07:22.118843 7f0c84e17700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.0:0/842394772' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:22.144784 I | rook-ceph-mon2: 2017-07-11 15:07:22.144766 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"} v 0) v1
- 2017-07-11 15:07:22.144861 I | rook-ceph-mon2: 2017-07-11 15:07:22.144847 7f0c84e17700 0 log_channel(audit) log [INF] : from='client.? 10.233.124.0:0/2650355890' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.242101 I | rook-ceph-mon2: 2017-07-11 15:07:22.116874 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 2218 : audit [INF] from='client.? 10.233.124.5:0/6333933' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.242184 I | rook-ceph-mon2: 2017-07-11 15:07:22.118898 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 2219 : audit [INF] from='client.? 10.233.124.0:0/842394772' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.242200 I | rook-ceph-mon2: 2017-07-11 15:07:22.144880 mon.rook-ceph-mon2 mon.2 10.233.124.3:6790/0 2220 : audit [INF] from='client.? 10.233.124.0:0/2650355890' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.242229 I | rook-ceph-mon2: 2017-07-11 15:07:22.511073 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2225 : audit [INF] from='client.13433 -' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.242242 I | rook-ceph-mon2: 2017-07-11 15:07:23.374621 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2226 : audit [INF] from='client.13430 -' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:24.242253 I | rook-ceph-mon2: 2017-07-11 15:07:23.641539 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2227 : audit [INF] from='client.13436 -' entity='client.admin' cmd=[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:07:25.791233 I | rook-ceph-mon2: 2017-07-11 15:07:24.442863 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2228 : audit [INF] from='client.13433 -' entity='client.admin' cmd='[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]': finished
- 2017-07-11 15:07:25.793585 I | rook-ceph-mon2: 2017-07-11 15:07:24.443270 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2229 : audit [INF] from='client.13430 -' entity='client.admin' cmd='[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]': finished
- 2017-07-11 15:07:25.793628 I | rook-ceph-mon2: 2017-07-11 15:07:24.443542 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2230 : audit [INF] from='client.13436 -' entity='client.admin' cmd='[{"pool_type": "replicated", "prefix": "osd pool create", "pg_num": 0, "pool": "replicapool", "format": "json"}]': finished
- 2017-07-11 15:07:25.793663 I | rook-ceph-mon2: 2017-07-11 15:07:24.443817 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2231 : cluster [INF] osdmap e138: 6 total, 1 up, 4 in
- 2017-07-11 15:07:27.170709 I | rook-ceph-mon2: 2017-07-11 15:07:26.031513 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2232 : audit [INF] from='client.? 10.233.124.0:0/210354122' entity='client.admin' cmd=[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]: dispatch
- 2017-07-11 15:07:27.170770 I | rook-ceph-mon2: 2017-07-11 15:07:26.083167 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2233 : audit [INF] from='client.? 10.233.124.0:0/2191274531' entity='client.admin' cmd=[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]: dispatch
- 2017-07-11 15:07:27.170788 I | rook-ceph-mon2: 2017-07-11 15:07:26.117235 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2234 : audit [INF] from='client.? 10.233.124.5:0/3838214036' entity='client.admin' cmd=[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]: dispatch
- 2017-07-11 15:07:28.492092 I | rook-ceph-mon2: 2017-07-11 15:07:27.316834 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2235 : audit [INF] from='client.? 10.233.124.0:0/210354122' entity='client.admin' cmd='[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]': finished
- 2017-07-11 15:07:28.492209 I | rook-ceph-mon2: 2017-07-11 15:07:27.316872 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2236 : audit [INF] from='client.? 10.233.124.0:0/2191274531' entity='client.admin' cmd='[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]': finished
- 2017-07-11 15:07:28.492246 I | rook-ceph-mon2: 2017-07-11 15:07:27.316899 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2237 : audit [INF] from='client.? 10.233.124.5:0/3838214036' entity='client.admin' cmd='[{"var": "size", "prefix": "osd pool set", "pool": "replicapool", "val": "1", "format": "json"}]': finished
- 2017-07-11 15:07:28.492317 I | rook-ceph-mon2: 2017-07-11 15:07:27.316919 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2238 : cluster [INF] osdmap e139: 6 total, 1 up, 4 in
- 2017-07-11 15:07:42.864034 I | rook-ceph-mon2: 2017-07-11 15:07:42.863971 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:07:42.864221 I | rook-ceph-mon2: 2017-07-11 15:07:42.864137 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1405614256' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:07:58.207936 I | rook-ceph-mon2: 2017-07-11 15:07:58.207668 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94264 MB
- 2017-07-11 15:08:06.361571 I | rook-ceph-mon2: 2017-07-11 15:08:05.359607 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2243 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1696 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 1696 pgs stuck stale; too many PGs per OSD (537 > max 300); Monitor clock skew detected
- 2017-07-11 15:08:55.378995 I | rook-ceph-mon2: 2017-07-11 15:08:55.378921 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:08:55.379244 I | rook-ceph-mon2: 2017-07-11 15:08:55.379160 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1409455119' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:08:58.208181 I | rook-ceph-mon2: 2017-07-11 15:08:58.207946 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94264 MB
- 2017-07-11 15:09:05.983508 I | rook-ceph-mon2: 2017-07-11 15:09:05.983474 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:05.983696 I | rook-ceph-mon2: 2017-07-11 15:09:05.983615 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/291127573' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:27.201537 I | rook-ceph-mon2: 2017-07-11 15:09:27.201478 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:27.201790 I | rook-ceph-mon2: 2017-07-11 15:09:27.201773 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1115664666' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:35.886901 I | rook-ceph-mon2: 2017-07-11 15:09:35.640393 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2248 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0597843s > max 0.05s
- 2017-07-11 15:09:35.886982 I | rook-ceph-mon2: 2017-07-11 15:09:35.646000 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2249 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.227679s > max 0.05s
- 2017-07-11 15:09:48.395485 I | rook-ceph-mon2: 2017-07-11 15:09:48.395447 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:09:48.395662 I | rook-ceph-mon2: 2017-07-11 15:09:48.395584 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2983383358' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:09:58.208431 I | rook-ceph-mon2: 2017-07-11 15:09:58.208240 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94264 MB
- 2017-07-11 15:10:12.667574 I | rook-ceph-mon2: 2017-07-11 15:10:12.667534 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:12.667753 I | rook-ceph-mon2: 2017-07-11 15:10:12.667672 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2153528247' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:35.111095 I | rook-ceph-mon2: 2017-07-11 15:10:35.110966 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #145. Immutable memtables: 0.
- 2017-07-11 15:10:35.111188 I | rook-ceph-mon2:
- 2017-07-11 15:10:35.111227 I | rook-ceph-mon2: 2017-07-11 15:10:35.111042 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 93] Syncing log #142
- 2017-07-11 15:10:35.143536 I | rook-ceph-mon2: 2017-07-11 15:10:35.142831 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.111036) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:10:35.143596 I | rook-ceph-mon2: 2017-07-11 15:10:35.142839 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 93] Flushing memtable with next log file: 145
- 2017-07-11 15:10:35.143612 I | rook-ceph-mon2:
- 2017-07-11 15:10:35.143625 I | rook-ceph-mon2: 2017-07-11 15:10:35.142848 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835142844, "job": 93, "event": "flush_started", "num_memtables": 1, "num_entries": 2016, "num_deletes": 251, "memory_usage": 6123680}
- 2017-07-11 15:10:35.143637 I | rook-ceph-mon2: 2017-07-11 15:10:35.142850 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 93] Level-0 flush table #146: started
- 2017-07-11 15:10:35.239878 I | rook-ceph-mon2: 2017-07-11 15:10:35.239832 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835239811, "cf_name": "default", "job": 93, "event": "table_file_creation", "file_number": 146, "file_size": 4037792, "table_properties": {"data_size": 4022270, "index_size": 14704, "filter_size": 0, "raw_key_size": 15036, "raw_average_key_size": 18, "raw_value_size": 4000925, "raw_average_value_size": 5001, "num_data_blocks": 465, "num_entries": 800, "filter_policy_name": "", "kDeletedKeys": "251", "kMergeOperands": "0"}}
- 2017-07-11 15:10:35.239982 I | rook-ceph-mon2: 2017-07-11 15:10:35.239965 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 93] Level-0 flush table #146: 4037792 bytes OK
- 2017-07-11 15:10:35.333669 I | rook-ceph-mon2: 2017-07-11 15:10:35.333625 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.303965) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #146 started
- 2017-07-11 15:10:35.333845 I | rook-ceph-mon2: 2017-07-11 15:10:35.333765 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.333577) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #146: memtable #1 done
- 2017-07-11 15:10:35.333915 I | rook-ceph-mon2: 2017-07-11 15:10:35.333896 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.333597) EVENT_LOG_v1 {"time_micros": 1499785835333591, "job": 93, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:10:35.333947 I | rook-ceph-mon2: 2017-07-11 15:10:35.333933 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.333613) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:10:35.333974 I | rook-ceph-mon2:
- 2017-07-11 15:10:35.334005 I | rook-ceph-mon2: 2017-07-11 15:10:35.333993 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 93] Try to delete WAL files size 6074240, prev total WAL file size 6074240, number of live WAL files 2.
- 2017-07-11 15:10:35.334021 I | rook-ceph-mon2:
- 2017-07-11 15:10:35.335530 I | rook-ceph-mon2: 2017-07-11 15:10:35.335012 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:10:35.335591 I | rook-ceph-mon2: 2017-07-11 15:10:35.335143 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:447] ------- DUMPING STATS -------
- 2017-07-11 15:10:35.335609 I | rook-ceph-mon2: 2017-07-11 15:10:35.335157 7f0c7ee0b700 3 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:448]
- 2017-07-11 15:10:35.335639 I | rook-ceph-mon2: ** DB Stats **
- 2017-07-11 15:10:35.335653 I | rook-ceph-mon2: Uptime(secs): 6398.1 total, 800.7 interval
- 2017-07-11 15:10:35.335665 I | rook-ceph-mon2: Cumulative writes: 12K writes, 60K keys, 12K commit groups, 1.0 writes per commit group, ingest: 0.16 GB, 0.03 MB/s
- 2017-07-11 15:10:35.335676 I | rook-ceph-mon2: Cumulative WAL: 12K writes, 12K syncs, 1.00 writes per sync, written: 0.16 GB, 0.03 MB/s
- 2017-07-11 15:10:35.335687 I | rook-ceph-mon2: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 15:10:35.335698 I | rook-ceph-mon2: Interval writes: 1496 writes, 7432 keys, 1496 commit groups, 1.0 writes per commit group, ingest: 19.98 MB, 0.02 MB/s
- 2017-07-11 15:10:35.335736 I | rook-ceph-mon2: Interval WAL: 1496 writes, 1496 syncs, 1.00 writes per sync, written: 0.02 MB, 0.02 MB/s
- 2017-07-11 15:10:35.335748 I | rook-ceph-mon2: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- 2017-07-11 15:10:35.335758 I | rook-ceph-mon2:
- 2017-07-11 15:10:35.335780 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 15:10:35.335803 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 15:10:35.335817 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 15:10:35.335836 I | rook-ceph-mon2: L0 1/1 3.85 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 14.7 7 48 0.147 0 0
- 2017-07-11 15:10:35.335848 I | rook-ceph-mon2: L1 1/1 13.32 MB 0.0 0.7 0.1 0.6 0.6 0.0 0.0 5.9 43.9 38.3 15 44 0.350 112K 23K
- 2017-07-11 15:10:35.335859 I | rook-ceph-mon2: Sum 2/2 17.17 MB 0.0 0.7 0.1 0.6 0.7 0.1 0.0 6.7 30.1 30.8 22 92 0.244 112K 23K
- 2017-07-11 15:10:35.335882 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.1 0.0 0.1 0.1 0.0 0.0 6.3 35.7 36.7 2 10 0.225 13K 3046
- 2017-07-11 15:10:35.335907 I | rook-ceph-mon2: Uptime(secs): 6398.1 total, 6398.1 interval
- 2017-07-11 15:10:35.335918 I | rook-ceph-mon2: Flush(GB): cumulative 0.101, interval 0.013
- 2017-07-11 15:10:35.335928 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 15:10:35.335939 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 15:10:35.335972 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 15:10:35.335985 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 15:10:35.336008 I | rook-ceph-mon2: Cumulative compaction: 0.68 GB write, 0.11 MB/s write, 0.66 GB read, 0.11 MB/s read, 22.5 seconds
- 2017-07-11 15:10:35.336028 I | rook-ceph-mon2: Interval compaction: 0.08 GB write, 0.01 MB/s write, 0.08 GB read, 0.01 MB/s read, 2.3 seconds
- 2017-07-11 15:10:35.336050 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 15:10:35.336073 I | rook-ceph-mon2:
- 2017-07-11 15:10:35.336084 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 15:10:35.336098 I | rook-ceph-mon2:
- 2017-07-11 15:10:35.336109 I | rook-ceph-mon2: ** Compaction Stats [default] **
- 2017-07-11 15:10:35.336134 I | rook-ceph-mon2: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- 2017-07-11 15:10:35.336145 I | rook-ceph-mon2: ----------------------------------------------------------------------------------------------------------------------------------------------------------
- 2017-07-11 15:10:35.336156 I | rook-ceph-mon2: L0 1/1 3.85 MB 0.0 0.0 0.0 0.0 0.1 0.1 0.0 1.0 0.0 14.7 7 48 0.147 0 0
- 2017-07-11 15:10:35.336167 I | rook-ceph-mon2: L1 1/1 13.32 MB 0.0 0.7 0.1 0.6 0.6 0.0 0.0 5.9 43.9 38.3 15 44 0.350 112K 23K
- 2017-07-11 15:10:35.336178 I | rook-ceph-mon2: Sum 2/2 17.17 MB 0.0 0.7 0.1 0.6 0.7 0.1 0.0 6.7 30.1 30.8 22 92 0.244 112K 23K
- 2017-07-11 15:10:35.336200 I | rook-ceph-mon2: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- 2017-07-11 15:10:35.336213 I | rook-ceph-mon2: Uptime(secs): 6398.1 total, 6398.1 interval
- 2017-07-11 15:10:35.336224 I | rook-ceph-mon2: Flush(GB): cumulative 0.101, interval 0.000
- 2017-07-11 15:10:35.336234 I | rook-ceph-mon2: AddFile(GB): cumulative 0.000, interval 0.000
- 2017-07-11 15:10:35.336244 I | rook-ceph-mon2: AddFile(Total Files): cumulative 0, interval 0
- 2017-07-11 15:10:35.336254 I | rook-ceph-mon2: AddFile(L0 Files): cumulative 0, interval 0
- 2017-07-11 15:10:35.336264 I | rook-ceph-mon2: AddFile(Keys): cumulative 0, interval 0
- 2017-07-11 15:10:35.336287 I | rook-ceph-mon2: Cumulative compaction: 0.68 GB write, 0.11 MB/s write, 0.66 GB read, 0.11 MB/s read, 22.5 seconds
- 2017-07-11 15:10:35.336298 I | rook-ceph-mon2: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- 2017-07-11 15:10:35.336309 I | rook-ceph-mon2: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- 2017-07-11 15:10:35.336319 I | rook-ceph-mon2:
- 2017-07-11 15:10:35.336331 I | rook-ceph-mon2: ** File Read Latency Histogram By Level [default] **
- 2017-07-11 15:10:35.336341 I | rook-ceph-mon2:
- 2017-07-11 15:10:35.336365 I | rook-ceph-mon2: 2017-07-11 15:10:35.335171 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.335165) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'paxos .. 'paxos; will stop at (end)
- 2017-07-11 15:10:35.336385 I | rook-ceph-mon2:
- 2017-07-11 15:10:35.336399 I | rook-ceph-mon2: 2017-07-11 15:10:35.335175 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 94] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:10:35.336410 I | rook-ceph-mon2: 2017-07-11 15:10:35.335178 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 93 Base level 0, inputs: [146(3943KB)], [144(13MB)]
- 2017-07-11 15:10:35.336431 I | rook-ceph-mon2:
- 2017-07-11 15:10:35.336443 I | rook-ceph-mon2: 2017-07-11 15:10:35.335188 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835335180, "job": 94, "event": "compaction_started", "files_L0": [146], "files_L1": [144], "score": -1, "input_data_size": 18005072}
- 2017-07-11 15:10:35.493991 I | rook-ceph-mon2: 2017-07-11 15:10:35.493931 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 94] Generated table #147: 2388 keys, 15505885 bytes
- 2017-07-11 15:10:35.494195 I | rook-ceph-mon2: 2017-07-11 15:10:35.494175 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835494108, "cf_name": "default", "job": 94, "event": "table_file_creation", "file_number": 147, "file_size": 15505885, "table_properties": {"data_size": 15452817, "index_size": 52249, "filter_size": 0, "raw_key_size": 46170, "raw_average_key_size": 19, "raw_value_size": 15382847, "raw_average_value_size": 6441, "num_data_blocks": 1587, "num_entries": 2388, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:10:35.567296 I | rook-ceph-mon2: 2017-07-11 15:10:35.564971 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 94] Compacted 1@0 + 1@1 files to L1 => 15505885 bytes
- 2017-07-11 15:10:35.605101 I | rook-ceph-mon2: 2017-07-11 15:10:35.605057 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.604988) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 78.4 rd, 67.5 wr, level 1, files in(1, 1) out(1) MB in(3.9, 13.3) out(14.8), read-write-amplify(8.3) write-amplify(3.8) OK, records in: 2900, records dropped: 512
- 2017-07-11 15:10:35.605162 I | rook-ceph-mon2:
- 2017-07-11 15:10:35.605241 I | rook-ceph-mon2: 2017-07-11 15:10:35.605180 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:10:35.605008) EVENT_LOG_v1 {"time_micros": 1499785835604999, "job": 94, "event": "compaction_finished", "compaction_time_micros": 229768, "output_level": 1, "num_output_files": 1, "total_output_size": 15505885, "num_input_records": 2900, "num_output_records": 2388, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:10:35.605931 I | rook-ceph-mon2: 2017-07-11 15:10:35.605915 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835605912, "job": 94, "event": "table_file_deletion", "file_number": 146}
- 2017-07-11 15:10:35.607461 I | rook-ceph-mon2: 2017-07-11 15:10:35.607447 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499785835607445, "job": 94, "event": "table_file_deletion", "file_number": 144}
- 2017-07-11 15:10:51.793586 I | rook-ceph-mon2: 2017-07-11 15:10:51.793547 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:10:51.793744 I | rook-ceph-mon2: 2017-07-11 15:10:51.793726 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/3892878992' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:10:58.209152 I | rook-ceph-mon2: 2017-07-11 15:10:58.208910 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4924 MB, avail 94262 MB
- 2017-07-11 15:11:15.683729 I | rook-ceph-mon2: 2017-07-11 15:11:14.988878 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2258 : audit [INF] from='client.7123 -' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 15:11:15.693089 I | rook-ceph-mon2: 2017-07-11 15:11:15.246998 mon.rook-ceph-mon1 mon.1 10.233.99.4:6790/0 1269 : audit [INF] from='client.? 10.233.99.2:0/211370252' entity='client.admin' cmd=[{"entity": "client.rook-rook-user", "prefix": "auth get-or-create-key", "caps": ["osd", "allow rwx", "mon", "allow r"], "format": "json"}]: dispatch
- 2017-07-11 15:11:15.921832 I | rook-ceph-mon2: 2017-07-11 15:11:15.921788 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "osd lspools", "format": "json"} v 0) v1
- 2017-07-11 15:11:15.921982 I | rook-ceph-mon2: 2017-07-11 15:11:15.921967 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/3398006617' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json"}]: dispatch
- 2017-07-11 15:11:16.349107 I | rook-ceph-mon2: 2017-07-11 15:11:16.348682 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"var": "all", "prefix": "osd pool get", "pool": "rbd", "format": "json"} v 0) v1
- 2017-07-11 15:11:16.349495 I | rook-ceph-mon2: 2017-07-11 15:11:16.348719 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/2660719856' entity='client.admin' cmd=[{"var": "all", "prefix": "osd pool get", "pool": "rbd", "format": "json"}]: dispatch
- 2017-07-11 15:11:16.841148 I | rook-ceph-mon2: 2017-07-11 15:11:16.841017 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"var": "all", "prefix": "osd pool get", "pool": "replicapool", "format": "json"} v 0) v1
- 2017-07-11 15:11:16.841224 I | rook-ceph-mon2: 2017-07-11 15:11:16.841052 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.124.5:0/715195585' entity='client.admin' cmd=[{"var": "all", "prefix": "osd pool get", "pool": "replicapool", "format": "json"}]: dispatch
- 2017-07-11 15:11:24.518301 I | rook-ceph-mon2: 2017-07-11 15:11:24.508495 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:24.518710 I | rook-ceph-mon2: 2017-07-11 15:11:24.518635 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4024158505' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:24.595520 I | rook-ceph-mon2: 2017-07-11 15:11:24.595494 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:24.595611 I | rook-ceph-mon2: 2017-07-11 15:11:24.595596 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2804547797' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:27.238941 I | rook-ceph-mon2: 2017-07-11 15:11:27.238886 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:27.239202 I | rook-ceph-mon2: 2017-07-11 15:11:27.239147 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2492952335' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:35.428069 I | rook-ceph-mon2: 2017-07-11 15:11:35.428028 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:35.428281 I | rook-ceph-mon2: 2017-07-11 15:11:35.428180 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2644759949' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:46.479341 I | rook-ceph-mon2: 2017-07-11 15:11:46.479302 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:11:46.479531 I | rook-ceph-mon2: 2017-07-11 15:11:46.479447 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3879378270' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:11:58.209680 I | rook-ceph-mon2: 2017-07-11 15:11:58.209340 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4924 MB, avail 94262 MB
- 2017-07-11 15:12:07.900014 I | rook-ceph-mon2: 2017-07-11 15:12:07.899980 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:07.900233 I | rook-ceph-mon2: 2017-07-11 15:12:07.900131 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2116003032' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:08.761827 I | rook-ceph-mon2: 2017-07-11 15:12:08.761778 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:08.762029 I | rook-ceph-mon2: 2017-07-11 15:12:08.761935 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/157320149' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:19.417124 I | rook-ceph-mon2: 2017-07-11 15:12:19.417079 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:19.426682 I | rook-ceph-mon2: 2017-07-11 15:12:19.426648 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/4150259800' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:40.280020 I | rook-ceph-mon2: 2017-07-11 15:12:40.279984 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:40.280243 I | rook-ceph-mon2: 2017-07-11 15:12:40.280208 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2584120293' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:41.059171 I | rook-ceph-mon2: 2017-07-11 15:12:41.059132 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:12:41.059393 I | rook-ceph-mon2: 2017-07-11 15:12:41.059356 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1017811274' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:12:58.209839 I | rook-ceph-mon2: 2017-07-11 15:12:58.209611 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4924 MB, avail 94262 MB
- 2017-07-11 15:13:02.405619 I | rook-ceph-mon2: 2017-07-11 15:13:02.405564 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:02.405887 I | rook-ceph-mon2: 2017-07-11 15:13:02.405756 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1646831428' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:05.651264 I | rook-ceph-mon2: 2017-07-11 15:13:05.367470 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2272 : cluster [INF] HEALTH_ERR; clock skew detected on mon.rook-ceph-mon1, mon.rook-ceph-mon2; 4 hosts (4 osds) down; 3 osds down; 1796 pgs are stuck inactive for more than 300 seconds; 1696 pgs stale; 100 pgs stuck inactive; 1696 pgs stuck stale; 100 pgs stuck unclean; too many PGs per OSD (537 > max 300); Monitor clock skew detected
- 2017-07-11 15:13:12.224694 I | rook-ceph-mon2: 2017-07-11 15:13:12.224663 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:12.224755 I | rook-ceph-mon2: 2017-07-11 15:13:12.224741 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2561866066' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:14.627936 I | rook-ceph-mon2: 2017-07-11 15:13:14.627887 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:14.628376 I | rook-ceph-mon2: 2017-07-11 15:13:14.628282 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4253252358' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:14.689995 I | rook-ceph-mon2: 2017-07-11 15:13:14.689975 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:14.690068 I | rook-ceph-mon2: 2017-07-11 15:13:14.690054 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/1912006591' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:25.968202 I | rook-ceph-mon2: 2017-07-11 15:13:25.968163 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:25.968389 I | rook-ceph-mon2: 2017-07-11 15:13:25.968320 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/3920046541' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:35.070087 I | rook-ceph-mon2: 2017-07-11 15:13:35.070051 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:35.070300 I | rook-ceph-mon2: 2017-07-11 15:13:35.070184 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1509619103' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:37.055177 I | rook-ceph-mon2: 2017-07-11 15:13:37.055139 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:37.055286 I | rook-ceph-mon2: 2017-07-11 15:13:37.055270 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4178323919' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:47.171216 I | rook-ceph-mon2: 2017-07-11 15:13:47.171181 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:13:47.171393 I | rook-ceph-mon2: 2017-07-11 15:13:47.171315 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2074812768' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:13:58.210025 I | rook-ceph-mon2: 2017-07-11 15:13:58.209879 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4924 MB, avail 94262 MB
- 2017-07-11 15:14:04.858169 I | rook-ceph-mon2: 2017-07-11 15:14:04.858029 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #148. Immutable memtables: 0.
- 2017-07-11 15:14:04.858260 I | rook-ceph-mon2:
- 2017-07-11 15:14:04.858283 I | rook-ceph-mon2: 2017-07-11 15:14:04.858081 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 95] Syncing log #145
- 2017-07-11 15:14:04.877750 I | rook-ceph-mon2: 2017-07-11 15:14:04.874916 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:14:04.858075) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:14:04.877830 I | rook-ceph-mon2: 2017-07-11 15:14:04.874924 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 95] Flushing memtable with next log file: 148
- 2017-07-11 15:14:04.877847 I | rook-ceph-mon2:
- 2017-07-11 15:14:04.877862 I | rook-ceph-mon2: 2017-07-11 15:14:04.874933 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786044874929, "job": 95, "event": "flush_started", "num_memtables": 1, "num_entries": 1461, "num_deletes": 252, "memory_usage": 5489528}
- 2017-07-11 15:14:04.877890 I | rook-ceph-mon2: 2017-07-11 15:14:04.874935 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 95] Level-0 flush table #149: started
- 2017-07-11 15:14:05.366728 I | rook-ceph-mon2: 2017-07-11 15:14:05.366660 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045366638, "cf_name": "default", "job": 95, "event": "table_file_creation", "file_number": 149, "file_size": 2540781, "table_properties": {"data_size": 2533124, "index_size": 6839, "filter_size": 0, "raw_key_size": 10219, "raw_average_key_size": 19, "raw_value_size": 2521112, "raw_average_value_size": 4783, "num_data_blocks": 221, "num_entries": 527, "filter_policy_name": "", "kDeletedKeys": "252", "kMergeOperands": "0"}}
- 2017-07-11 15:14:05.366836 I | rook-ceph-mon2: 2017-07-11 15:14:05.366818 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 95] Level-0 flush table #149: 2540781 bytes OK
- 2017-07-11 15:14:05.399178 I | rook-ceph-mon2: 2017-07-11 15:14:05.399148 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.381719) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #149 started
- 2017-07-11 15:14:05.399249 I | rook-ceph-mon2: 2017-07-11 15:14:05.399233 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.399102) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #149: memtable #1 done
- 2017-07-11 15:14:05.399308 I | rook-ceph-mon2: 2017-07-11 15:14:05.399269 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.399116) EVENT_LOG_v1 {"time_micros": 1499786045399111, "job": 95, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:14:05.399350 I | rook-ceph-mon2: 2017-07-11 15:14:05.399336 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.399133) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:14:05.399366 I | rook-ceph-mon2:
- 2017-07-11 15:14:05.399418 I | rook-ceph-mon2: 2017-07-11 15:14:05.399404 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 95] Try to delete WAL files size 5459387, prev total WAL file size 5459387, number of live WAL files 2.
- 2017-07-11 15:14:05.399433 I | rook-ceph-mon2:
- 2017-07-11 15:14:05.401700 I | rook-ceph-mon2: 2017-07-11 15:14:05.400331 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:14:05.401752 I | rook-ceph-mon2: 2017-07-11 15:14:05.400383 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.400378) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'mgrstat .. 'mgrstat; will stop at (end)
- 2017-07-11 15:14:05.401770 I | rook-ceph-mon2:
- 2017-07-11 15:14:05.401782 I | rook-ceph-mon2: 2017-07-11 15:14:05.400388 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 96] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:14:05.401819 I | rook-ceph-mon2: 2017-07-11 15:14:05.400392 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 95 Base level 0, inputs: [149(2481KB)], [147(14MB)]
- 2017-07-11 15:14:05.401832 I | rook-ceph-mon2:
- 2017-07-11 15:14:05.401843 I | rook-ceph-mon2: 2017-07-11 15:14:05.400402 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045400395, "job": 96, "event": "compaction_started", "files_L0": [149], "files_L1": [147], "score": -1, "input_data_size": 18046666}
- 2017-07-11 15:14:05.588395 I | rook-ceph-mon2: 2017-07-11 15:14:05.588349 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 96] Generated table #150: 2503 keys, 16971173 bytes
- 2017-07-11 15:14:05.588573 I | rook-ceph-mon2: 2017-07-11 15:14:05.588495 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045588486, "cf_name": "default", "job": 96, "event": "table_file_creation", "file_number": 150, "file_size": 16971173, "table_properties": {"data_size": 16916127, "index_size": 54227, "filter_size": 0, "raw_key_size": 48102, "raw_average_key_size": 19, "raw_value_size": 16843273, "raw_average_value_size": 6729, "num_data_blocks": 1654, "num_entries": 2503, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:14:05.667037 I | rook-ceph-mon2: 2017-07-11 15:14:05.666996 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 96] Compacted 1@0 + 1@1 files to L1 => 16971173 bytes
- 2017-07-11 15:14:05.702604 I | rook-ceph-mon2: 2017-07-11 15:14:05.702573 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.702490) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.06, MB/sec: 67.7 rd, 63.7 wr, level 1, files in(1, 1) out(1) MB in(2.4, 14.8) out(16.2), read-write-amplify(13.8) write-amplify(6.7) OK, records in: 2915, records dropped: 412
- 2017-07-11 15:14:05.702649 I | rook-ceph-mon2:
- 2017-07-11 15:14:05.702735 I | rook-ceph-mon2: 2017-07-11 15:14:05.702679 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:14:05.702509) EVENT_LOG_v1 {"time_micros": 1499786045702501, "job": 96, "event": "compaction_finished", "compaction_time_micros": 266575, "output_level": 1, "num_output_files": 1, "total_output_size": 16971173, "num_input_records": 2915, "num_output_records": 2503, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:14:05.703193 I | rook-ceph-mon2: 2017-07-11 15:14:05.703179 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045703177, "job": 96, "event": "table_file_deletion", "file_number": 149}
- 2017-07-11 15:14:05.704930 I | rook-ceph-mon2: 2017-07-11 15:14:05.704917 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786045704915, "job": 96, "event": "table_file_deletion", "file_number": 147}
- 2017-07-11 15:14:05.704993 I | rook-ceph-mon2: 2017-07-11 15:14:05.704979 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:14:15.012263 I | rook-ceph-mon2: 2017-07-11 15:14:15.012079 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #151. Immutable memtables: 0.
- 2017-07-11 15:14:15.012359 I | rook-ceph-mon2:
- 2017-07-11 15:14:15.012398 I | rook-ceph-mon2: 2017-07-11 15:14:15.012122 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:49] [JOB 97] Syncing log #148
- 2017-07-11 15:14:15.034882 I | rook-ceph-mon2: 2017-07-11 15:14:15.034322 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.012117) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1158] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots allowed 1, compaction slots scheduled 1
- 2017-07-11 15:14:15.034925 I | rook-ceph-mon2: 2017-07-11 15:14:15.034331 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:264] [default] [JOB 97] Flushing memtable with next log file: 151
- 2017-07-11 15:14:15.034941 I | rook-ceph-mon2:
- 2017-07-11 15:14:15.034952 I | rook-ceph-mon2: 2017-07-11 15:14:15.034339 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055034335, "job": 97, "event": "flush_started", "num_memtables": 1, "num_entries": 579, "num_deletes": 502, "memory_usage": 431320}
- 2017-07-11 15:14:15.034964 I | rook-ceph-mon2: 2017-07-11 15:14:15.034340 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:293] [default] [JOB 97] Level-0 flush table #152: started
- 2017-07-11 15:14:15.081721 I | rook-ceph-mon2: 2017-07-11 15:14:15.081647 7f0c7f60c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055081639, "cf_name": "default", "job": 97, "event": "table_file_creation", "file_number": 152, "file_size": 275195, "table_properties": {"data_size": 273739, "index_size": 642, "filter_size": 0, "raw_key_size": 10409, "raw_average_key_size": 19, "raw_value_size": 266267, "raw_average_value_size": 500, "num_data_blocks": 21, "num_entries": 532, "filter_policy_name": "", "kDeletedKeys": "502", "kMergeOperands": "0"}}
- 2017-07-11 15:14:15.081770 I | rook-ceph-mon2: 2017-07-11 15:14:15.081666 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/flush_job.cc:319] [default] [JOB 97] Level-0 flush table #152: 275195 bytes OK
- 2017-07-11 15:14:15.162516 I | rook-ceph-mon2: 2017-07-11 15:14:15.162349 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.114543) [/build/ceph/src/rocksdb/db/memtable_list.cc:360] [default] Level-0 commit table #152 started
- 2017-07-11 15:14:15.162601 I | rook-ceph-mon2: 2017-07-11 15:14:15.162355 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.162312) [/build/ceph/src/rocksdb/db/memtable_list.cc:383] [default] Level-0 commit table #152: memtable #1 done
- 2017-07-11 15:14:15.162633 I | rook-ceph-mon2: 2017-07-11 15:14:15.162357 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.162327) EVENT_LOG_v1 {"time_micros": 1499786055162322, "job": 97, "event": "flush_finished", "lsm_state": [1, 1, 0, 0, 0, 0, 0], "immutable_memtables": 0}
- 2017-07-11 15:14:15.162647 I | rook-ceph-mon2: 2017-07-11 15:14:15.162358 7f0c7f60c700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.162340) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:132] [default] Level summary: base level 1 max bytes base 268435456 files[1 1 0 0 0 0 0] max score 0.25
- 2017-07-11 15:14:15.162682 I | rook-ceph-mon2:
- 2017-07-11 15:14:15.162695 I | rook-ceph-mon2: 2017-07-11 15:14:15.162363 7f0c7f60c700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_files.cc:388] [JOB 97] Try to delete WAL files size 417226, prev total WAL file size 417226, number of live WAL files 2.
- 2017-07-11 15:14:15.162706 I | rook-ceph-mon2:
- 2017-07-11 15:14:15.163117 I | rook-ceph-mon2: 2017-07-11 15:14:15.162724 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:14:15.163171 I | rook-ceph-mon2: 2017-07-11 15:14:15.162772 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.162767) [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:1392] [default] Manual compaction from level-0 to level-1 from 'logm .. 'logm; will stop at (end)
- 2017-07-11 15:14:15.163194 I | rook-ceph-mon2:
- 2017-07-11 15:14:15.163209 I | rook-ceph-mon2: 2017-07-11 15:14:15.162776 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1403] [default] [JOB 98] Compacting 1@0 + 1@1 files to L1, score -1.00
- 2017-07-11 15:14:15.163220 I | rook-ceph-mon2: 2017-07-11 15:14:15.162781 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1407] [default] Compaction start summary: Base version 97 Base level 0, inputs: [152(268KB)], [150(16MB)]
- 2017-07-11 15:14:15.163231 I | rook-ceph-mon2:
- 2017-07-11 15:14:15.163254 I | rook-ceph-mon2: 2017-07-11 15:14:15.162790 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055162783, "job": 98, "event": "compaction_started", "files_L0": [152], "files_L1": [150], "score": -1, "input_data_size": 17246368}
- 2017-07-11 15:14:15.386523 I | rook-ceph-mon2: 2017-07-11 15:14:15.386448 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1116] [default] [JOB 98] Generated table #153: 2024 keys, 14173445 bytes
- 2017-07-11 15:14:15.386699 I | rook-ceph-mon2: 2017-07-11 15:14:15.386620 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055386611, "cf_name": "default", "job": 98, "event": "table_file_creation", "file_number": 153, "file_size": 14173445, "table_properties": {"data_size": 14127447, "index_size": 45179, "filter_size": 0, "raw_key_size": 38749, "raw_average_key_size": 19, "raw_value_size": 14067572, "raw_average_value_size": 6950, "num_data_blocks": 1391, "num_entries": 2024, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 15:14:15.497889 I | rook-ceph-mon2: 2017-07-11 15:14:15.497801 7f0c7ee0b700 4 rocksdb: [/build/ceph/src/rocksdb/db/compaction_job.cc:1173] [default] [JOB 98] Compacted 1@0 + 1@1 files to L1 => 14173445 bytes
- 2017-07-11 15:14:15.526955 I | rook-ceph-mon2: 2017-07-11 15:14:15.526913 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.526806) [/build/ceph/src/rocksdb/db/compaction_job.cc:621] [default] compacted to: base level 1 max bytes base 268435456 files[0 1 0 0 0 0 0] max score 0.05, MB/sec: 51.5 rd, 42.3 wr, level 1, files in(1, 1) out(1) MB in(0.3, 16.2) out(13.5), read-write-amplify(114.2) write-amplify(51.5) OK, records in: 3035, records dropped: 1011
- 2017-07-11 15:14:15.527017 I | rook-ceph-mon2:
- 2017-07-11 15:14:15.527085 I | rook-ceph-mon2: 2017-07-11 15:14:15.527053 7f0c7ee0b700 4 rocksdb: (Original Log Time 2017/07/11-15:14:15.526828) EVENT_LOG_v1 {"time_micros": 1499786055526820, "job": 98, "event": "compaction_finished", "compaction_time_micros": 334976, "output_level": 1, "num_output_files": 1, "total_output_size": 14173445, "num_input_records": 3035, "num_output_records": 2024, "num_subcompactions": 1, "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 0, 0, 0, 0, 0]}
- 2017-07-11 15:14:15.527367 I | rook-ceph-mon2: 2017-07-11 15:14:15.527337 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055527334, "job": 98, "event": "table_file_deletion", "file_number": 152}
- 2017-07-11 15:14:15.529616 I | rook-ceph-mon2: 2017-07-11 15:14:15.529599 7f0c7ee0b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499786055529597, "job": 98, "event": "table_file_deletion", "file_number": 150}
- 2017-07-11 15:14:15.529696 I | rook-ceph-mon2: 2017-07-11 15:14:15.529680 7f0c7fe0d700 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_compaction_flush.cc:839] [default] Manual compaction starting
- 2017-07-11 15:14:17.510389 I | rook-ceph-mon2: 2017-07-11 15:14:17.510334 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:17.510605 I | rook-ceph-mon2: 2017-07-11 15:14:17.510588 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/4224051088' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:21.025878 I | rook-ceph-mon2: 2017-07-11 15:14:21.025837 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:21.026092 I | rook-ceph-mon2: 2017-07-11 15:14:21.026020 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/1210942772' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:35.750669 I | rook-ceph-mon2: 2017-07-11 15:14:35.647435 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2286 : cluster [WRN] mon.2 10.233.124.3:6790/0 clock skew 0.0763369s > max 0.05s
- 2017-07-11 15:14:35.750755 I | rook-ceph-mon2: 2017-07-11 15:14:35.647668 mon.rook-ceph-mon0 mon.0 10.233.76.3:6790/0 2287 : cluster [WRN] mon.1 10.233.99.4:6790/0 clock skew 0.240121s > max 0.05s
- 2017-07-11 15:14:38.763237 I | rook-ceph-mon2: 2017-07-11 15:14:38.763203 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:38.763421 I | rook-ceph-mon2: 2017-07-11 15:14:38.763340 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/237533720' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:52.348052 I | rook-ceph-mon2: 2017-07-11 15:14:52.348016 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:52.348278 I | rook-ceph-mon2: 2017-07-11 15:14:52.348261 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.2:0/2044924630' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:52.931147 I | rook-ceph-mon2: 2017-07-11 15:14:52.931113 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:14:52.931338 I | rook-ceph-mon2: 2017-07-11 15:14:52.931255 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/251932749' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:14:58.210287 I | rook-ceph-mon2: 2017-07-11 15:14:58.210128 7f0c8761c700 0 mon.rook-ceph-mon2@2(peon).data_health(6) update_stats avail 95%!t(MISSING)otal 99203 MB, used 4923 MB, avail 94263 MB
- 2017-07-11 15:15:03.781433 I | rook-ceph-mon2: 2017-07-11 15:15:03.781398 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:15:03.781497 I | rook-ceph-mon2: 2017-07-11 15:15:03.781482 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/2602971081' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- 2017-07-11 15:15:23.020779 I | rook-ceph-mon2: 2017-07-11 15:15:23.020741 7f0c84e17700 0 mon.rook-ceph-mon2@2(peon) e3 handle_command mon_command({"prefix": "mon_status", "format": "json"} v 0) v1
- 2017-07-11 15:15:23.020996 I | rook-ceph-mon2: 2017-07-11 15:15:23.020882 7f0c84e17700 0 log_channel(audit) log [DBG] : from='client.? 10.233.99.0:0/273799030' entity='client.admin' cmd=[{"prefix": "mon_status", "format": "json"}]: dispatch
- END logs from pod: rook-ceph-mon2-zf8zr
- BEGIN logs from pod: rook-ceph-osd-ckdpx
- 2017-07-11 13:24:20.877590 I | cephmon: parsing mon endpoints: rook-ceph-mon1=10.233.99.4:6790,rook-ceph-mon2=10.233.124.3:6790,rook-ceph-mon0=10.233.76.3:6790
- 2017-07-11 13:24:20.884274 I | cephmon: writing config file /var/lib/rook/rook/rook.config
- 2017-07-11 13:24:20.884437 I | cephmon: generated admin config in /var/lib/rook/rook
- 2017-07-11 13:24:20.884476 I | cephosd: discovering hardware
- 2017-07-11 13:24:20.884503 I | exec: Running command: lsblk --all --noheadings --list --output KNAME
- 2017-07-11 13:24:20.895340 I | exec: Running command: lsblk /dev/fd0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.896815 I | exec: Running command: sgdisk --print /dev/fd0
- 2017-07-11 13:24:20.966105 W | inventory: skipping device fd0 with an unknown uuid. Failed to complete get disk fd0 uuid: exit status 2
- 2017-07-11 13:24:20.976154 I | exec: Running command: lsblk /dev/loop0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.082100 I | exec: Running command: lsblk /dev/loop1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.094681 I | exec: Running command: lsblk /dev/loop2 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.104273 I | exec: Running command: lsblk /dev/loop3 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.111341 I | exec: Running command: lsblk /dev/loop4 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.112667 I | exec: Running command: lsblk /dev/loop5 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.114015 I | exec: Running command: lsblk /dev/loop6 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.121053 I | exec: Running command: lsblk /dev/loop7 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.122507 I | exec: Running command: lsblk /dev/sda --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.123971 I | exec: Running command: sgdisk --print /dev/sda
- 2017-07-11 13:24:21.140450 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:21.141560 I | exec: Running command: lsblk /dev/sda1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.142945 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:21.158924 I | exec: Running command: lsblk /dev/sdb --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.160247 I | exec: Running command: sgdisk --print /dev/sdb
- 2017-07-11 13:24:21.162259 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:21.180233 I | exec: Running command: lsblk /dev/sdb1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.181724 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:21.197750 I | exec: Running command: lsblk /dev/sr0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.199119 I | cephosd: creating and starting the osds
- 2017-07-11 13:24:21.199133 I | exec: Running command: lsblk /dev/sda --bytes --pairs --output NAME,SIZE,TYPE,PKNAME
- 2017-07-11 13:24:21.200533 I | exec: Running command: blkid /dev/sda1 -s PARTLABEL -o value
- 2017-07-11 13:24:21.402682 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:21.404103 I | cephosd: skipping device sda that is in use (not by rook). fs: ext4, ownPartitions: false
- 2017-07-11 13:24:21.404161 I | exec: Running command: lsblk /dev/sdb --bytes --pairs --output NAME,SIZE,TYPE,PKNAME
- 2017-07-11 13:24:21.411385 I | exec: Running command: blkid /dev/sdb1 -s PARTLABEL -o value
- 2017-07-11 13:24:21.413073 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:21.414236 I | cephosd: skipping device sdb that is in use (not by rook). fs: , ownPartitions: false
- 2017-07-11 13:24:21.414297 I | cephosd: configuring osd devices: &{Entries:map[]}
- 2017-07-11 13:24:21.414356 I | cephosd: configuring osd dirs: map[/var/lib/rook:-1]
- 2017-07-11 13:24:21.414618 I | exec: Running command: ceph osd create 7fa3db3b-e42c-44ec-ac2c-d78a63760e1b --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/743596996
- 2017-07-11 13:24:22.355850 I | cephosd: successfully created OSD 7fa3db3b-e42c-44ec-ac2c-d78a63760e1b with ID 4
- 2017-07-11 13:24:22.356287 I | cephmon: writing config file /var/lib/rook/osd4/rook.config
- 2017-07-11 13:24:22.356590 I | exec: Running command: ceph mon getmap --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/243407955
- 2017-07-11 13:24:22.864386 I | exec: got monmap epoch 3
- 2017-07-11 13:24:22.864631 I | cephosd: Initializing OSD 4 file system at /var/lib/rook/osd4...
- 2017-07-11 13:24:22.870276 I | proc: Running process ceph-osd with args: [--mkfs --mkkey --id=4 --cluster=rook --conf=/var/lib/rook/osd4/rook.config --osd-data=/var/lib/rook/osd4 --osd-uuid=7fa3db3b-e42c-44ec-ac2c-d78a63760e1b --monmap=/var/lib/rook/osd4/tmp/activate.monmap --osd-journal=/var/lib/rook/osd4/journal --keyring=/var/lib/rook/osd4/keyring]
- 2017-07-11 13:24:22.870341 I | exec: Running command: ceph-osd --mkfs --mkkey --id=4 --cluster=rook --conf=/var/lib/rook/osd4/rook.config --osd-data=/var/lib/rook/osd4 --osd-uuid=7fa3db3b-e42c-44ec-ac2c-d78a63760e1b --monmap=/var/lib/rook/osd4/tmp/activate.monmap --osd-journal=/var/lib/rook/osd4/journal --keyring=/var/lib/rook/osd4/keyring
- 2017-07-11 13:24:22.928099 I | mkfs-osd4: 2017-07-11 13:24:22.920045 7f758bfbec80 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 86
- 2017-07-11 13:24:23.165807 I | mkfs-osd4: 2017-07-11 13:24:23.165238 7f758bfbec80 0 filestore(/var/lib/rook/osd4) backend generic (magic 0xef53)
- 2017-07-11 13:24:23.844081 I | mkfs-osd4: 2017-07-11 13:24:23.844022 7f758bfbec80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:23.945922 I | mkfs-osd4: 2017-07-11 13:24:23.945870 7f758bfbec80 0 filestore(/var/lib/rook/osd4) mkjournal(1061): created journal on /var/lib/rook/osd4/journal
- 2017-07-11 13:24:24.074195 I | mkfs-osd4: 2017-07-11 13:24:24.074127 7f758bfbec80 0 filestore(/var/lib/rook/osd4) backend generic (magic 0xef53)
- 2017-07-11 13:24:24.074609 I | mkfs-osd4: 2017-07-11 13:24:24.074584 7f758bfbec80 0 genericfilestorebackend(/var/lib/rook/osd4) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
- 2017-07-11 13:24:24.074673 I | mkfs-osd4: 2017-07-11 13:24:24.074651 7f758bfbec80 0 genericfilestorebackend(/var/lib/rook/osd4) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option
- 2017-07-11 13:24:24.074721 I | mkfs-osd4: 2017-07-11 13:24:24.074692 7f758bfbec80 0 genericfilestorebackend(/var/lib/rook/osd4) detect_features: splice() is disabled via 'filestore splice' config option
- 2017-07-11 13:24:24.462128 I | mkfs-osd4: 2017-07-11 13:24:24.462077 7f758bfbec80 0 genericfilestorebackend(/var/lib/rook/osd4) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
- 2017-07-11 13:24:24.929840 I | mkfs-osd4: 2017-07-11 13:24:24.929795 7f758bfbec80 0 filestore(/var/lib/rook/osd4) limited size xattrs
- 2017-07-11 13:24:24.930177 I | mkfs-osd4: 2017-07-11 13:24:24.930159 7f758bfbec80 0 filestore(/var/lib/rook/osd4) start omap initiation
- 2017-07-11 13:24:24.930386 I | mkfs-osd4: 2017-07-11 13:24:24.930348 7f758bfbec80 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:24:24.930417 I | mkfs-osd4:
- 2017-07-11 13:24:24.930488 I | mkfs-osd4: 2017-07-11 13:24:24.930431 7f758bfbec80 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:24:24.930546 I | mkfs-osd4: 2017-07-11 13:24:24.930519 7f758bfbec80 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:24:24.930579 I | mkfs-osd4: 2017-07-11 13:24:24.930565 7f758bfbec80 4 rocksdb: DB SUMMARY
- 2017-07-11 13:24:24.930594 I | mkfs-osd4:
- 2017-07-11 13:24:24.930671 I | mkfs-osd4: 2017-07-11 13:24:24.930654 7f758bfbec80 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:24:24.930694 I | mkfs-osd4:
- 2017-07-11 13:24:24.930733 I | mkfs-osd4: 2017-07-11 13:24:24.930720 7f758bfbec80 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:24:24.930746 I | mkfs-osd4:
- 2017-07-11 13:24:24.930817 I | mkfs-osd4: 2017-07-11 13:24:24.930764 7f758bfbec80 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes
- 2017-07-11 13:24:24.930895 I | mkfs-osd4:
- 2017-07-11 13:24:24.930931 I | mkfs-osd4: 2017-07-11 13:24:24.930916 7f758bfbec80 4 rocksdb: SST files in /var/lib/rook/osd4/current/omap dir, Total Num: 0, files:
- 2017-07-11 13:24:24.930945 I | mkfs-osd4:
- 2017-07-11 13:24:24.930999 I | mkfs-osd4: 2017-07-11 13:24:24.930972 7f758bfbec80 4 rocksdb: Write Ahead Log file in /var/lib/rook/osd4/current/omap: 000003.log size: 0 ;
- 2017-07-11 13:24:24.931030 I | mkfs-osd4:
- 2017-07-11 13:24:24.931071 I | mkfs-osd4: 2017-07-11 13:24:24.931058 7f758bfbec80 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:24:24.931098 I | mkfs-osd4: 2017-07-11 13:24:24.931087 7f758bfbec80 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:24:24.931138 I | mkfs-osd4: 2017-07-11 13:24:24.931112 7f758bfbec80 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:24:24.931165 I | mkfs-osd4: 2017-07-11 13:24:24.931154 7f758bfbec80 4 rocksdb: Options.env: 0x55dd761248e0
- 2017-07-11 13:24:24.931211 I | mkfs-osd4: 2017-07-11 13:24:24.931185 7f758bfbec80 4 rocksdb: Options.info_log: 0x55dd77b574a0
- 2017-07-11 13:24:24.931240 I | mkfs-osd4: 2017-07-11 13:24:24.931227 7f758bfbec80 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:24:24.931266 I | mkfs-osd4: 2017-07-11 13:24:24.931255 7f758bfbec80 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:24:24.931317 I | mkfs-osd4: 2017-07-11 13:24:24.931294 7f758bfbec80 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:24:24.931343 I | mkfs-osd4: 2017-07-11 13:24:24.931332 7f758bfbec80 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:24:24.931382 I | mkfs-osd4: 2017-07-11 13:24:24.931370 7f758bfbec80 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:24:24.931419 I | mkfs-osd4: 2017-07-11 13:24:24.931397 7f758bfbec80 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:24:24.931487 I | mkfs-osd4: 2017-07-11 13:24:24.931475 7f758bfbec80 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:24:24.931527 I | mkfs-osd4: 2017-07-11 13:24:24.931502 7f758bfbec80 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:24:24.931720 I | mkfs-osd4: 2017-07-11 13:24:24.931552 7f758bfbec80 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:24:24.931830 I | mkfs-osd4: 2017-07-11 13:24:24.931815 7f758bfbec80 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:24:24.931902 I | mkfs-osd4: 2017-07-11 13:24:24.931866 7f758bfbec80 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:24:24.932090 I | mkfs-osd4: 2017-07-11 13:24:24.932075 7f758bfbec80 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:24:24.932155 I | mkfs-osd4: 2017-07-11 13:24:24.932115 7f758bfbec80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:24:24.932184 I | mkfs-osd4: 2017-07-11 13:24:24.932173 7f758bfbec80 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:24:24.932232 I | mkfs-osd4: 2017-07-11 13:24:24.932221 7f758bfbec80 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:24:24.932257 I | mkfs-osd4: 2017-07-11 13:24:24.932246 7f758bfbec80 4 rocksdb: Options.wal_dir: /var/lib/rook/osd4/current/omap
- 2017-07-11 13:24:24.932293 I | mkfs-osd4: 2017-07-11 13:24:24.932271 7f758bfbec80 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:24:24.932320 I | mkfs-osd4: 2017-07-11 13:24:24.932309 7f758bfbec80 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:24:24.932343 I | mkfs-osd4: 2017-07-11 13:24:24.932334 7f758bfbec80 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:24:24.932379 I | mkfs-osd4: 2017-07-11 13:24:24.932356 7f758bfbec80 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:24:24.932404 I | mkfs-osd4: 2017-07-11 13:24:24.932394 7f758bfbec80 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:24:24.932426 I | mkfs-osd4: 2017-07-11 13:24:24.932417 7f758bfbec80 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:24:24.932462 I | mkfs-osd4: 2017-07-11 13:24:24.932451 7f758bfbec80 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:24:24.932487 I | mkfs-osd4: 2017-07-11 13:24:24.932476 7f758bfbec80 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:24:24.932511 I | mkfs-osd4: 2017-07-11 13:24:24.932501 7f758bfbec80 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:24:24.932549 I | mkfs-osd4: 2017-07-11 13:24:24.932538 7f758bfbec80 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:24:24.932571 I | mkfs-osd4: 2017-07-11 13:24:24.932562 7f758bfbec80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:24:24.932605 I | mkfs-osd4: 2017-07-11 13:24:24.932584 7f758bfbec80 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:24:24.932630 I | mkfs-osd4: 2017-07-11 13:24:24.932619 7f758bfbec80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:24:24.932652 I | mkfs-osd4: 2017-07-11 13:24:24.932642 7f758bfbec80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:24:24.932686 I | mkfs-osd4: 2017-07-11 13:24:24.932664 7f758bfbec80 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:24:24.932715 I | mkfs-osd4: 2017-07-11 13:24:24.932701 7f758bfbec80 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:24:24.932759 I | mkfs-osd4: 2017-07-11 13:24:24.932748 7f758bfbec80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:24:24.932784 I | mkfs-osd4: 2017-07-11 13:24:24.932774 7f758bfbec80 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:24:24.932805 I | mkfs-osd4: 2017-07-11 13:24:24.932796 7f758bfbec80 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:24:24.932842 I | mkfs-osd4: 2017-07-11 13:24:24.932831 7f758bfbec80 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:24:24.932868 I | mkfs-osd4: 2017-07-11 13:24:24.932858 7f758bfbec80 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:24:24.932904 I | mkfs-osd4: 2017-07-11 13:24:24.932881 7f758bfbec80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:24:24.932949 I | mkfs-osd4: 2017-07-11 13:24:24.932937 7f758bfbec80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:24:24.933013 I | mkfs-osd4: 2017-07-11 13:24:24.933000 7f758bfbec80 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:24:24.933039 I | mkfs-osd4: 2017-07-11 13:24:24.933028 7f758bfbec80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:24:24.933089 I | mkfs-osd4: 2017-07-11 13:24:24.933077 7f758bfbec80 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:24:24.933114 I | mkfs-osd4: 2017-07-11 13:24:24.933104 7f758bfbec80 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:24:24.933154 I | mkfs-osd4: 2017-07-11 13:24:24.933128 7f758bfbec80 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:24:24.933181 I | mkfs-osd4: 2017-07-11 13:24:24.933170 7f758bfbec80 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:24:24.933206 I | mkfs-osd4: 2017-07-11 13:24:24.933195 7f758bfbec80 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:24:24.933244 I | mkfs-osd4: 2017-07-11 13:24:24.933233 7f758bfbec80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:24:24.933281 I | mkfs-osd4: 2017-07-11 13:24:24.933259 7f758bfbec80 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:24:24.933332 I | mkfs-osd4: 2017-07-11 13:24:24.933320 7f758bfbec80 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:24:24.933360 I | mkfs-osd4: 2017-07-11 13:24:24.933347 7f758bfbec80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:24:24.933401 I | mkfs-osd4: 2017-07-11 13:24:24.933388 7f758bfbec80 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:24:24.933438 I | mkfs-osd4: 2017-07-11 13:24:24.933416 7f758bfbec80 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:24:24.933476 I | mkfs-osd4: 2017-07-11 13:24:24.933452 7f758bfbec80 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:24:24.933511 I | mkfs-osd4: 2017-07-11 13:24:24.933501 7f758bfbec80 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:24:24.933546 I | mkfs-osd4: 2017-07-11 13:24:24.933524 7f758bfbec80 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:24:24.933595 I | mkfs-osd4: 2017-07-11 13:24:24.933572 7f758bfbec80 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:24:24.933649 I | mkfs-osd4: 2017-07-11 13:24:24.933638 7f758bfbec80 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:24:24.933676 I | mkfs-osd4: 2017-07-11 13:24:24.933665 7f758bfbec80 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:24:24.935409 I | mkfs-osd4: 2017-07-11 13:24:24.935355 7f758bfbec80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001
- 2017-07-11 13:24:24.935495 I | mkfs-osd4:
- 2017-07-11 13:24:24.935763 I | mkfs-osd4: 2017-07-11 13:24:24.935743 7f758bfbec80 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:24:24.935794 I | mkfs-osd4:
- 2017-07-11 13:24:24.935836 I | mkfs-osd4: 2017-07-11 13:24:24.935820 7f758bfbec80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:24:24.935882 I | mkfs-osd4: 2017-07-11 13:24:24.935852 7f758bfbec80 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:24:24.935913 I | mkfs-osd4: 2017-07-11 13:24:24.935900 7f758bfbec80 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:24:24.935968 I | mkfs-osd4: 2017-07-11 13:24:24.935953 7f758bfbec80 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:24:24.936037 I | mkfs-osd4: 2017-07-11 13:24:24.935995 7f758bfbec80 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:24:24.936065 I | mkfs-osd4: 2017-07-11 13:24:24.936054 7f758bfbec80 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:24:24.936125 I | mkfs-osd4: 2017-07-11 13:24:24.936094 7f758bfbec80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55dd77986218)
- 2017-07-11 13:24:24.936141 I | mkfs-osd4: cache_index_and_filter_blocks: 0
- 2017-07-11 13:24:24.936152 I | mkfs-osd4: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:24:24.936162 I | mkfs-osd4: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:24:24.936172 I | mkfs-osd4: index_type: 0
- 2017-07-11 13:24:24.936196 I | mkfs-osd4: hash_index_allow_collision: 1
- 2017-07-11 13:24:24.936208 I | mkfs-osd4: checksum: 1
- 2017-07-11 13:24:24.936228 I | mkfs-osd4: no_block_cache: 0
- 2017-07-11 13:24:24.936238 I | mkfs-osd4: block_cache: 0x55dd779ac380
- 2017-07-11 13:24:24.936247 I | mkfs-osd4: block_cache_name: LRUCache
- 2017-07-11 13:24:24.936256 I | mkfs-osd4: block_cache_options:
- 2017-07-11 13:24:24.936280 I | mkfs-osd4: capacity : 107374182
- 2017-07-11 13:24:24.936290 I | mkfs-osd4: num_shard_bits : 4
- 2017-07-11 13:24:24.936299 I | mkfs-osd4: strict_capacity_limit : 0
- 2017-07-11 13:24:24.936309 I | mkfs-osd4: high_pri_pool_ratio: 0.000
- 2017-07-11 13:24:24.936319 I | mkfs-osd4: block_cache_compressed: (nil)
- 2017-07-11 13:24:24.936328 I | mkfs-osd4: persistent_cache: (nil)
- 2017-07-11 13:24:24.936347 I | mkfs-osd4: block_size: 4096
- 2017-07-11 13:24:24.936359 I | mkfs-osd4: block_size_deviation: 10
- 2017-07-11 13:24:24.936368 I | mkfs-osd4: block_restart_interval: 16
- 2017-07-11 13:24:24.936378 I | mkfs-osd4: index_block_restart_interval: 1
- 2017-07-11 13:24:24.936387 I | mkfs-osd4: filter_policy: nullptr
- 2017-07-11 13:24:24.936401 I | mkfs-osd4: whole_key_filtering: 1
- 2017-07-11 13:24:24.936410 I | mkfs-osd4: format_version: 2
- 2017-07-11 13:24:24.936433 I | mkfs-osd4:
- 2017-07-11 13:24:24.936458 I | mkfs-osd4: 2017-07-11 13:24:24.936445 7f758bfbec80 4 rocksdb: Options.write_buffer_size: 67108864
- 2017-07-11 13:24:24.936481 I | mkfs-osd4: 2017-07-11 13:24:24.936471 7f758bfbec80 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:24:24.936516 I | mkfs-osd4: 2017-07-11 13:24:24.936505 7f758bfbec80 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:24:24.936549 I | mkfs-osd4: 2017-07-11 13:24:24.936538 7f758bfbec80 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:24:24.936588 I | mkfs-osd4: 2017-07-11 13:24:24.936563 7f758bfbec80 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:24:24.936613 I | mkfs-osd4: 2017-07-11 13:24:24.936602 7f758bfbec80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:24:24.936635 I | mkfs-osd4: 2017-07-11 13:24:24.936626 7f758bfbec80 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:24:24.936673 I | mkfs-osd4: 2017-07-11 13:24:24.936661 7f758bfbec80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:24:24.936698 I | mkfs-osd4: 2017-07-11 13:24:24.936688 7f758bfbec80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:24:24.936739 I | mkfs-osd4: 2017-07-11 13:24:24.936717 7f758bfbec80 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:24:24.936765 I | mkfs-osd4: 2017-07-11 13:24:24.936754 7f758bfbec80 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:24:24.936788 I | mkfs-osd4: 2017-07-11 13:24:24.936778 7f758bfbec80 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:24:24.936825 I | mkfs-osd4: 2017-07-11 13:24:24.936800 7f758bfbec80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:24:24.936850 I | mkfs-osd4: 2017-07-11 13:24:24.936840 7f758bfbec80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:24:24.936872 I | mkfs-osd4: 2017-07-11 13:24:24.936863 7f758bfbec80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:24:24.936908 I | mkfs-osd4: 2017-07-11 13:24:24.936897 7f758bfbec80 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:24:24.936931 I | mkfs-osd4: 2017-07-11 13:24:24.936922 7f758bfbec80 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:24:24.936978 I | mkfs-osd4: 2017-07-11 13:24:24.936944 7f758bfbec80 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:24:24.937025 I | mkfs-osd4: 2017-07-11 13:24:24.936993 7f758bfbec80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:24:24.937077 I | mkfs-osd4: 2017-07-11 13:24:24.937064 7f758bfbec80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:24:24.937105 I | mkfs-osd4: 2017-07-11 13:24:24.937092 7f758bfbec80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:24:24.937146 I | mkfs-osd4: 2017-07-11 13:24:24.937120 7f758bfbec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:24:24.937174 I | mkfs-osd4: 2017-07-11 13:24:24.937163 7f758bfbec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:24:24.937200 I | mkfs-osd4: 2017-07-11 13:24:24.937189 7f758bfbec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:24:24.937241 I | mkfs-osd4: 2017-07-11 13:24:24.937227 7f758bfbec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:24:24.937267 I | mkfs-osd4: 2017-07-11 13:24:24.937256 7f758bfbec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:24:24.937308 I | mkfs-osd4: 2017-07-11 13:24:24.937282 7f758bfbec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:24:24.937336 I | mkfs-osd4: 2017-07-11 13:24:24.937324 7f758bfbec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:24:24.937361 I | mkfs-osd4: 2017-07-11 13:24:24.937350 7f758bfbec80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:24:24.937402 I | mkfs-osd4: 2017-07-11 13:24:24.937390 7f758bfbec80 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:24:24.937427 I | mkfs-osd4: 2017-07-11 13:24:24.937417 7f758bfbec80 4 rocksdb: Options.arena_block_size: 8388608
- 2017-07-11 13:24:24.937467 I | mkfs-osd4: 2017-07-11 13:24:24.937441 7f758bfbec80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:24:24.937505 I | mkfs-osd4: 2017-07-11 13:24:24.937483 7f758bfbec80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:24:24.937544 I | mkfs-osd4: 2017-07-11 13:24:24.937519 7f758bfbec80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:24:24.937584 I | mkfs-osd4: 2017-07-11 13:24:24.937572 7f758bfbec80 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:24:24.937625 I | mkfs-osd4: 2017-07-11 13:24:24.937598 7f758bfbec80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:24:24.937672 I | mkfs-osd4: 2017-07-11 13:24:24.937660 7f758bfbec80 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:24:24.937717 I | mkfs-osd4: 2017-07-11 13:24:24.937705 7f758bfbec80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:24:24.943712 I | mkfs-osd4: 2017-07-11 13:24:24.937732 7f758bfbec80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:24:24.944124 I | mkfs-osd4: 2017-07-11 13:24:24.943955 7f758bfbec80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:24:24.944281 I | mkfs-osd4: 2017-07-11 13:24:24.943960 7f758bfbec80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:24:24.944330 I | mkfs-osd4: 2017-07-11 13:24:24.943962 7f758bfbec80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:24:24.944355 I | mkfs-osd4: 2017-07-11 13:24:24.943963 7f758bfbec80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:24:24.944373 I | mkfs-osd4: 2017-07-11 13:24:24.943964 7f758bfbec80 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:24:24.944406 I | mkfs-osd4: 2017-07-11 13:24:24.943965 7f758bfbec80 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:24:24.944425 I | mkfs-osd4: 2017-07-11 13:24:24.943966 7f758bfbec80 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:24:24.944444 I | mkfs-osd4: 2017-07-11 13:24:24.943967 7f758bfbec80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:24:24.944461 I | mkfs-osd4: 2017-07-11 13:24:24.943969 7f758bfbec80 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:24:24.944496 I | mkfs-osd4: 2017-07-11 13:24:24.943970 7f758bfbec80 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:24:24.944513 I | mkfs-osd4: 2017-07-11 13:24:24.943971 7f758bfbec80 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:24:24.944530 I | mkfs-osd4: 2017-07-11 13:24:24.943971 7f758bfbec80 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:24:24.944561 I | mkfs-osd4: 2017-07-11 13:24:24.943972 7f758bfbec80 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:24:24.944588 I | mkfs-osd4: 2017-07-11 13:24:24.943972 7f758bfbec80 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:24:24.944952 I | mkfs-osd4: 2017-07-11 13:24:24.943973 7f758bfbec80 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:24:24.945399 I | mkfs-osd4: 2017-07-11 13:24:24.945162 7f758bfbec80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/osd4/current/omap/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:24:24.945435 I | mkfs-osd4:
- 2017-07-11 13:24:24.945459 I | mkfs-osd4: 2017-07-11 13:24:24.945169 7f758bfbec80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 0
- 2017-07-11 13:24:24.945471 I | mkfs-osd4:
- 2017-07-11 13:24:24.945481 I | mkfs-osd4: 2017-07-11 13:24:24.945211 7f758bfbec80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779464945203, "job": 1, "event": "recovery_started", "log_files": [3]}
- 2017-07-11 13:24:24.945506 I | mkfs-osd4: 2017-07-11 13:24:24.945214 7f758bfbec80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #3 mode 2
- 2017-07-11 13:24:24.945519 I | mkfs-osd4: 2017-07-11 13:24:24.945272 7f758bfbec80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 5
- 2017-07-11 13:24:24.945529 I | mkfs-osd4:
- 2017-07-11 13:24:25.160349 I | mkfs-osd4: 2017-07-11 13:24:25.160089 7f758bfbec80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779465160085, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:24:25.283887 I | mkfs-osd4: 2017-07-11 13:24:25.283615 7f758bfbec80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55dd77c3c000
- 2017-07-11 13:24:25.283976 I | mkfs-osd4: 2017-07-11 13:24:25.283716 7f758bfbec80 0 filestore(/var/lib/rook/osd4) mount(1717): enabling WRITEAHEAD journal mode: checkpoint is not enabled
- 2017-07-11 13:24:25.284017 I | mkfs-osd4: 2017-07-11 13:24:25.283807 7f758bfbec80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:25.284639 I | mkfs-osd4: 2017-07-11 13:24:25.284496 7f758bfbec80 -1 filestore(/var/lib/rook/osd4) could not find #-1:7b3f43c4:::osd_superblock:0# in index: (2) No such file or directory
- 2017-07-11 13:24:26.544364 I | mkfs-osd4: 2017-07-11 13:24:26.544116 7f758bfbec80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:217] Shutdown: canceling all background work
- 2017-07-11 13:24:26.544443 I | mkfs-osd4: 2017-07-11 13:24:26.544246 7f758bfbec80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:343] Shutdown complete
- 2017-07-11 13:24:26.545296 I | mkfs-osd4: 2017-07-11 13:24:26.544638 7f758bfbec80 -1 created object store /var/lib/rook/osd4 for osd.4 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:24:26.545345 I | mkfs-osd4: 2017-07-11 13:24:26.544699 7f758bfbec80 -1 auth: error reading file: /var/lib/rook/osd4/keyring: can't open /var/lib/rook/osd4/keyring: (2) No such file or directory
- 2017-07-11 13:24:26.545368 I | mkfs-osd4: 2017-07-11 13:24:26.544789 7f758bfbec80 -1 created new key in keyring /var/lib/rook/osd4/keyring
- 2017-07-11 13:24:26.546300 I | mkfs-osd4: 2017-07-11 13:24:23.844022 7f758bfbec80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:26.546340 I | mkfs-osd4: 2017-07-11 13:24:25.283807 7f758bfbec80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:26.546356 I | mkfs-osd4: 2017-07-11 13:24:25.284496 7f758bfbec80 -1 filestore(/var/lib/rook/osd4) could not find #-1:7b3f43c4:::osd_superblock:0# in index: (2) No such file or directory
- 2017-07-11 13:24:26.546369 I | mkfs-osd4: 2017-07-11 13:24:26.544638 7f758bfbec80 -1 created object store /var/lib/rook/osd4 for osd.4 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:24:26.546381 I | mkfs-osd4: 2017-07-11 13:24:26.544699 7f758bfbec80 -1 auth: error reading file: /var/lib/rook/osd4/keyring: can't open /var/lib/rook/osd4/keyring: (2) No such file or directory
- 2017-07-11 13:24:26.546394 I | mkfs-osd4: 2017-07-11 13:24:26.544789 7f758bfbec80 -1 created new key in keyring /var/lib/rook/osd4/keyring
- 2017-07-11 13:24:26.546688 I | exec: Running command: ceph auth add osd.4 -i /var/lib/rook/osd4/keyring osd allow * mon allow profile osd --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/490267030
- 2017-07-11 13:24:28.702392 I | exec: added key for osd.4
- 2017-07-11 13:24:28.702649 I | cephosd: adding osd.4 (/var/lib/rook/osd4), bytes: 104022159360, weight: 0.0946, to crush map at 'root=default'
- 2017-07-11 13:24:28.702812 I | exec: Running command: ceph osd crush create-or-move 4 0.0946 root=default --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/149939709
- 2017-07-11 13:24:30.346532 I | exec: create-or-move updating item name 'osd.4' weight 0.0946 at location {root=default} to crush map
- 2017-07-11 13:24:30.346809 I | cephosd: starting osd 4 at /var/lib/rook/osd4
- 2017-07-11 13:24:30.346892 I | cephosd: Config file /var/lib/rook/osd4/rook.config:
- [global]
- enable experimental unrecoverable data corrupting features =
- run dir = /var/lib/rook/osd4
- mon initial members = rook-ceph-mon1 rook-ceph-mon2 rook-ceph-mon0
- log file = /dev/stdout
- mon cluster log file = /dev/stdout
- mon keyvaluedb = rocksdb
- debug default = 0
- debug rados = 0
- debug mon = 0
- debug osd = 0
- debug bluestore = 0
- debug filestore = 0
- debug journal = 0
- debug leveldb = 0
- filestore_omap_backend = rocksdb
- osd pg bits = 11
- osd pgp bits = 11
- osd pool default size = 1
- osd pool default min size = 1
- osd pool default pg num = 100
- osd pool default pgp num = 100
- osd max object name len = 256
- osd max object namespace len = 64
- osd objectstore = filestore
- rbd_default_features = 3
- fatal signal handlers = false
- [osd.4]
- keyring = /var/lib/rook/osd4/keyring
- osd journal size = 1024
- [mon.rook-ceph-mon1]
- name = rook-ceph-mon1
- mon addr = 10.233.99.4:6790
- [mon.rook-ceph-mon2]
- name = rook-ceph-mon2
- mon addr = 10.233.124.3:6790
- [mon.rook-ceph-mon0]
- name = rook-ceph-mon0
- mon addr = 10.233.76.3:6790
- 2017-07-11 13:24:30.347548 I | proc: no existing process found for binary ceph-osd and pattern '--osd-uuid=7fa3db3b-e42c-44ec-ac2c-d78a63760e1b'
- 2017-07-11 13:24:30.347594 I | proc: Starting process osd4 with args: [--foreground --id=4 --cluster=rook --osd-data=/var/lib/rook/osd4 --conf=/var/lib/rook/osd4/rook.config --keyring=/var/lib/rook/osd4/keyring --osd-uuid=7fa3db3b-e42c-44ec-ac2c-d78a63760e1b --osd-journal=/var/lib/rook/osd4/journal]
- 2017-07-11 13:24:30.347617 I | exec: Running command: ceph-osd --foreground --id=4 --cluster=rook --osd-data=/var/lib/rook/osd4 --conf=/var/lib/rook/osd4/rook.config --keyring=/var/lib/rook/osd4/keyring --osd-uuid=7fa3db3b-e42c-44ec-ac2c-d78a63760e1b --osd-journal=/var/lib/rook/osd4/journal
- 2017-07-11 13:24:30.356740 I | cephosd: 1/1 osd dirs succeeded on this node
- 2017-07-11 13:24:30.356890 I | sleeping a while to let the osds run...
- 2017-07-11 13:24:30.393353 I | osd4: 2017-07-11 13:24:30.386298 7f30ed3aac80 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 178
- 2017-07-11 13:24:30.394014 I | osd4: starting osd.4 at - osd_data /var/lib/rook/osd4 /var/lib/rook/osd4/journal
- 2017-07-11 13:24:30.395160 I | osd4: 2017-07-11 13:24:30.394292 7f30ed3aac80 0 pidfile_write: ignore empty --pid-file
- 2017-07-11 13:24:30.407227 I | osd4: 2017-07-11 13:24:30.407203 7f30ed3aac80 0 load: jerasure load: lrc load: isa
- 2017-07-11 13:24:30.407581 I | osd4: 2017-07-11 13:24:30.407548 7f30ed3aac80 0 filestore(/var/lib/rook/osd4) backend generic (magic 0xef53)
- 2017-07-11 13:24:30.413757 I | osd4: 2017-07-11 13:24:30.413732 7f30ed3aac80 0 filestore(/var/lib/rook/osd4) backend generic (magic 0xef53)
- 2017-07-11 13:24:30.414105 I | osd4: 2017-07-11 13:24:30.414086 7f30ed3aac80 0 genericfilestorebackend(/var/lib/rook/osd4) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
- 2017-07-11 13:24:30.414157 I | osd4: 2017-07-11 13:24:30.414140 7f30ed3aac80 0 genericfilestorebackend(/var/lib/rook/osd4) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option
- 2017-07-11 13:24:30.414186 I | osd4: 2017-07-11 13:24:30.414174 7f30ed3aac80 0 genericfilestorebackend(/var/lib/rook/osd4) detect_features: splice() is disabled via 'filestore splice' config option
- 2017-07-11 13:24:30.632644 I | osd4: 2017-07-11 13:24:30.632589 7f30ed3aac80 0 genericfilestorebackend(/var/lib/rook/osd4) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
- 2017-07-11 13:24:31.003220 I | osd4: 2017-07-11 13:24:31.003155 7f30ed3aac80 0 filestore(/var/lib/rook/osd4) limited size xattrs
- 2017-07-11 13:24:31.019456 I | osd4: 2017-07-11 13:24:31.019415 7f30ed3aac80 0 filestore(/var/lib/rook/osd4) start omap initiation
- 2017-07-11 13:24:31.029521 I | osd4: 2017-07-11 13:24:31.029500 7f30ed3aac80 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:24:31.029559 I | osd4:
- 2017-07-11 13:24:31.029594 I | osd4: 2017-07-11 13:24:31.029576 7f30ed3aac80 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:24:31.029636 I | osd4: 2017-07-11 13:24:31.029610 7f30ed3aac80 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:24:31.031147 I | osd4: 2017-07-11 13:24:31.031128 7f30ed3aac80 4 rocksdb: DB SUMMARY
- 2017-07-11 13:24:31.039289 I | osd4:
- 2017-07-11 13:24:31.039520 I | osd4: 2017-07-11 13:24:31.039500 7f30ed3aac80 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:24:31.039559 I | osd4:
- 2017-07-11 13:24:31.043153 I | osd4: 2017-07-11 13:24:31.043136 7f30ed3aac80 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:24:31.043182 I | osd4:
- 2017-07-11 13:24:31.043246 I | osd4: 2017-07-11 13:24:31.043230 7f30ed3aac80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes
- 2017-07-11 13:24:31.049127 I | osd4:
- 2017-07-11 13:24:31.049195 I | osd4: 2017-07-11 13:24:31.049174 7f30ed3aac80 4 rocksdb: SST files in /var/lib/rook/osd4/current/omap dir, Total Num: 0, files:
- 2017-07-11 13:24:31.049214 I | osd4:
- 2017-07-11 13:24:31.049279 I | osd4: 2017-07-11 13:24:31.049264 7f30ed3aac80 4 rocksdb: Write Ahead Log file in /var/lib/rook/osd4/current/omap: 000006.log size: 98 ;
- 2017-07-11 13:24:31.051111 I | osd4:
- 2017-07-11 13:24:31.059264 I | osd4: 2017-07-11 13:24:31.059242 7f30ed3aac80 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:24:31.059327 I | osd4: 2017-07-11 13:24:31.059311 7f30ed3aac80 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:24:31.059361 I | osd4: 2017-07-11 13:24:31.059349 7f30ed3aac80 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:24:31.059406 I | osd4: 2017-07-11 13:24:31.059394 7f30ed3aac80 4 rocksdb: Options.env: 0x5634b5ec08e0
- 2017-07-11 13:24:31.059434 I | osd4: 2017-07-11 13:24:31.059423 7f30ed3aac80 4 rocksdb: Options.info_log: 0x5634b708a560
- 2017-07-11 13:24:31.059475 I | osd4: 2017-07-11 13:24:31.059463 7f30ed3aac80 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:24:31.063165 I | osd4: 2017-07-11 13:24:31.063148 7f30ed3aac80 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:24:31.069023 I | osd4: 2017-07-11 13:24:31.063197 7f30ed3aac80 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:24:31.069157 I | osd4: 2017-07-11 13:24:31.069078 7f30ed3aac80 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:24:31.069211 I | osd4: 2017-07-11 13:24:31.069180 7f30ed3aac80 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:24:31.069241 I | osd4: 2017-07-11 13:24:31.069229 7f30ed3aac80 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:24:31.071129 I | osd4: 2017-07-11 13:24:31.071110 7f30ed3aac80 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:24:31.079047 I | osd4: 2017-07-11 13:24:31.079027 7f30ed3aac80 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:24:31.079147 I | osd4: 2017-07-11 13:24:31.079111 7f30ed3aac80 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:24:31.079202 I | osd4: 2017-07-11 13:24:31.079183 7f30ed3aac80 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:24:31.079229 I | osd4: 2017-07-11 13:24:31.079218 7f30ed3aac80 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:24:31.088889 I | osd4: 2017-07-11 13:24:31.088869 7f30ed3aac80 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:24:31.088953 I | osd4: 2017-07-11 13:24:31.088924 7f30ed3aac80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:24:31.088983 I | osd4: 2017-07-11 13:24:31.088971 7f30ed3aac80 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:24:31.089022 I | osd4: 2017-07-11 13:24:31.089011 7f30ed3aac80 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:24:31.089054 I | osd4: 2017-07-11 13:24:31.089036 7f30ed3aac80 4 rocksdb: Options.wal_dir: /var/lib/rook/osd4/current/omap
- 2017-07-11 13:24:31.089095 I | osd4: 2017-07-11 13:24:31.089069 7f30ed3aac80 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:24:31.089119 I | osd4: 2017-07-11 13:24:31.089109 7f30ed3aac80 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:24:31.089143 I | osd4: 2017-07-11 13:24:31.089134 7f30ed3aac80 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:24:31.091120 I | osd4: 2017-07-11 13:24:31.089332 7f30ed3aac80 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:24:31.098864 I | osd4: 2017-07-11 13:24:31.098832 7f30ed3aac80 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:24:31.098926 I | osd4: 2017-07-11 13:24:31.098909 7f30ed3aac80 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:24:31.098957 I | osd4: 2017-07-11 13:24:31.098945 7f30ed3aac80 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:24:31.098999 I | osd4: 2017-07-11 13:24:31.098986 7f30ed3aac80 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:24:31.108924 I | osd4: 2017-07-11 13:24:31.099228 7f30ed3aac80 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:24:31.108953 I | osd4: 2017-07-11 13:24:31.108936 7f30ed3aac80 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:24:31.110211 I | osd4: 2017-07-11 13:24:31.110196 7f30ed3aac80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:24:31.110229 I | osd4: 2017-07-11 13:24:31.110219 7f30ed3aac80 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:24:31.110242 I | osd4: 2017-07-11 13:24:31.110234 7f30ed3aac80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:24:31.110276 I | osd4: 2017-07-11 13:24:31.110247 7f30ed3aac80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:24:31.110312 I | osd4: 2017-07-11 13:24:31.110283 7f30ed3aac80 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:24:31.110328 I | osd4: 2017-07-11 13:24:31.110318 7f30ed3aac80 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:24:31.110342 I | osd4: 2017-07-11 13:24:31.110333 7f30ed3aac80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:24:31.110369 I | osd4: 2017-07-11 13:24:31.110358 7f30ed3aac80 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:24:31.110384 I | osd4: 2017-07-11 13:24:31.110375 7f30ed3aac80 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:24:31.110399 I | osd4: 2017-07-11 13:24:31.110390 7f30ed3aac80 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:24:31.110415 I | osd4: 2017-07-11 13:24:31.110404 7f30ed3aac80 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:24:31.110450 I | osd4: 2017-07-11 13:24:31.110421 7f30ed3aac80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:24:31.110466 I | osd4: 2017-07-11 13:24:31.110456 7f30ed3aac80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:24:31.110481 I | osd4: 2017-07-11 13:24:31.110471 7f30ed3aac80 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:24:31.110505 I | osd4: 2017-07-11 13:24:31.110486 7f30ed3aac80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:24:31.110527 I | osd4: 2017-07-11 13:24:31.110516 7f30ed3aac80 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:24:31.110543 I | osd4: 2017-07-11 13:24:31.110533 7f30ed3aac80 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:24:31.110559 I | osd4: 2017-07-11 13:24:31.110549 7f30ed3aac80 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:24:31.110583 I | osd4: 2017-07-11 13:24:31.110564 7f30ed3aac80 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:24:31.110600 I | osd4: 2017-07-11 13:24:31.110590 7f30ed3aac80 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:24:31.110625 I | osd4: 2017-07-11 13:24:31.110616 7f30ed3aac80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:24:31.110641 I | osd4: 2017-07-11 13:24:31.110631 7f30ed3aac80 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:24:31.110663 I | osd4: 2017-07-11 13:24:31.110653 7f30ed3aac80 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:24:31.110694 I | osd4: 2017-07-11 13:24:31.110669 7f30ed3aac80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:24:31.110712 I | osd4: 2017-07-11 13:24:31.110702 7f30ed3aac80 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:24:31.110745 I | osd4: 2017-07-11 13:24:31.110717 7f30ed3aac80 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:24:31.110765 I | osd4: 2017-07-11 13:24:31.110751 7f30ed3aac80 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:24:31.110780 I | osd4: 2017-07-11 13:24:31.110771 7f30ed3aac80 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:24:31.110796 I | osd4: 2017-07-11 13:24:31.110786 7f30ed3aac80 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:24:31.110819 I | osd4: 2017-07-11 13:24:31.110801 7f30ed3aac80 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:24:31.110835 I | osd4: 2017-07-11 13:24:31.110825 7f30ed3aac80 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:24:31.110852 I | osd4: 2017-07-11 13:24:31.110842 7f30ed3aac80 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:24:31.111492 I | osd4: 2017-07-11 13:24:31.111464 7f30ed3aac80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000005
- 2017-07-11 13:24:31.111500 I | osd4:
- 2017-07-11 13:24:31.111632 I | osd4: 2017-07-11 13:24:31.111615 7f30ed3aac80 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:24:31.111639 I | osd4:
- 2017-07-11 13:24:31.111656 I | osd4: 2017-07-11 13:24:31.111644 7f30ed3aac80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:24:31.111704 I | osd4: 2017-07-11 13:24:31.111693 7f30ed3aac80 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:24:31.111729 I | osd4: 2017-07-11 13:24:31.111721 7f30ed3aac80 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:24:31.111743 I | osd4: 2017-07-11 13:24:31.111734 7f30ed3aac80 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:24:31.111764 I | osd4: 2017-07-11 13:24:31.111754 7f30ed3aac80 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:24:31.111778 I | osd4: 2017-07-11 13:24:31.111769 7f30ed3aac80 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:24:31.111811 I | osd4: 2017-07-11 13:24:31.111798 7f30ed3aac80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5634b6cfe1e0)
- 2017-07-11 13:24:31.111816 I | osd4: cache_index_and_filter_blocks: 0
- 2017-07-11 13:24:31.111819 I | osd4: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:24:31.111821 I | osd4: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:24:31.111827 I | osd4: index_type: 0
- 2017-07-11 13:24:31.111830 I | osd4: hash_index_allow_collision: 1
- 2017-07-11 13:24:31.111833 I | osd4: checksum: 1
- 2017-07-11 13:24:31.111835 I | osd4: no_block_cache: 0
- 2017-07-11 13:24:31.111838 I | osd4: block_cache: 0x5634b6d24620
- 2017-07-11 13:24:31.111840 I | osd4: block_cache_name: LRUCache
- 2017-07-11 13:24:31.111842 I | osd4: block_cache_options:
- 2017-07-11 13:24:31.111844 I | osd4: capacity : 107374182
- 2017-07-11 13:24:31.111846 I | osd4: num_shard_bits : 4
- 2017-07-11 13:24:31.111848 I | osd4: strict_capacity_limit : 0
- 2017-07-11 13:24:31.111849 I | osd4: high_pri_pool_ratio: 0.000
- 2017-07-11 13:24:31.111851 I | osd4: block_cache_compressed: (nil)
- 2017-07-11 13:24:31.111853 I | osd4: persistent_cache: (nil)
- 2017-07-11 13:24:31.111855 I | osd4: block_size: 4096
- 2017-07-11 13:24:31.111857 I | osd4: block_size_deviation: 10
- 2017-07-11 13:24:31.111859 I | osd4: block_restart_interval: 16
- 2017-07-11 13:24:31.111861 I | osd4: index_block_restart_interval: 1
- 2017-07-11 13:24:31.111863 I | osd4: filter_policy: nullptr
- 2017-07-11 13:24:31.111865 I | osd4: whole_key_filtering: 1
- 2017-07-11 13:24:31.111867 I | osd4: format_version: 2
- 2017-07-11 13:24:31.111869 I | osd4:
- 2017-07-11 13:24:31.111888 I | osd4: 2017-07-11 13:24:31.111877 7f30ed3aac80 4 rocksdb: Options.write_buffer_size: 67108864
- 2017-07-11 13:24:31.111901 I | osd4: 2017-07-11 13:24:31.111893 7f30ed3aac80 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:24:31.111918 I | osd4: 2017-07-11 13:24:31.111909 7f30ed3aac80 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:24:31.111931 I | osd4: 2017-07-11 13:24:31.111923 7f30ed3aac80 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:24:31.111948 I | osd4: 2017-07-11 13:24:31.111936 7f30ed3aac80 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:24:31.111967 I | osd4: 2017-07-11 13:24:31.111957 7f30ed3aac80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:24:31.111988 I | osd4: 2017-07-11 13:24:31.111978 7f30ed3aac80 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:24:31.112003 I | osd4: 2017-07-11 13:24:31.111995 7f30ed3aac80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:24:31.112017 I | osd4: 2017-07-11 13:24:31.112008 7f30ed3aac80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:24:31.112039 I | osd4: 2017-07-11 13:24:31.112022 7f30ed3aac80 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:24:31.112056 I | osd4: 2017-07-11 13:24:31.112047 7f30ed3aac80 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:24:31.112072 I | osd4: 2017-07-11 13:24:31.112063 7f30ed3aac80 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:24:31.112085 I | osd4: 2017-07-11 13:24:31.112076 7f30ed3aac80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:24:31.112097 I | osd4: 2017-07-11 13:24:31.112089 7f30ed3aac80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:24:31.112118 I | osd4: 2017-07-11 13:24:31.112109 7f30ed3aac80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:24:31.112132 I | osd4: 2017-07-11 13:24:31.112124 7f30ed3aac80 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:24:31.112145 I | osd4: 2017-07-11 13:24:31.112137 7f30ed3aac80 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:24:31.112158 I | osd4: 2017-07-11 13:24:31.112150 7f30ed3aac80 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:24:31.112172 I | osd4: 2017-07-11 13:24:31.112163 7f30ed3aac80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:24:31.112192 I | osd4: 2017-07-11 13:24:31.112176 7f30ed3aac80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:24:31.112210 I | osd4: 2017-07-11 13:24:31.112198 7f30ed3aac80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:24:31.112223 I | osd4: 2017-07-11 13:24:31.112215 7f30ed3aac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:24:31.112236 I | osd4: 2017-07-11 13:24:31.112228 7f30ed3aac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:24:31.112249 I | osd4: 2017-07-11 13:24:31.112241 7f30ed3aac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:24:31.112270 I | osd4: 2017-07-11 13:24:31.112261 7f30ed3aac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:24:31.112284 I | osd4: 2017-07-11 13:24:31.112276 7f30ed3aac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:24:31.112298 I | osd4: 2017-07-11 13:24:31.112289 7f30ed3aac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:24:31.112312 I | osd4: 2017-07-11 13:24:31.112302 7f30ed3aac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:24:31.112325 I | osd4: 2017-07-11 13:24:31.112317 7f30ed3aac80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:24:31.112346 I | osd4: 2017-07-11 13:24:31.112336 7f30ed3aac80 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:24:31.112359 I | osd4: 2017-07-11 13:24:31.112351 7f30ed3aac80 4 rocksdb: Options.arena_block_size: 8388608
- 2017-07-11 13:24:31.112372 I | osd4: 2017-07-11 13:24:31.112364 7f30ed3aac80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:24:31.112385 I | osd4: 2017-07-11 13:24:31.112377 7f30ed3aac80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:24:31.112413 I | osd4: 2017-07-11 13:24:31.112390 7f30ed3aac80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:24:31.112431 I | osd4: 2017-07-11 13:24:31.112421 7f30ed3aac80 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:24:31.112446 I | osd4: 2017-07-11 13:24:31.112437 7f30ed3aac80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:24:31.112461 I | osd4: 2017-07-11 13:24:31.112452 7f30ed3aac80 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:24:31.112477 I | osd4: 2017-07-11 13:24:31.112467 7f30ed3aac80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:24:31.112495 I | osd4: 2017-07-11 13:24:31.112482 7f30ed3aac80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:24:31.112514 I | osd4: 2017-07-11 13:24:31.112504 7f30ed3aac80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:24:31.112529 I | osd4: 2017-07-11 13:24:31.112520 7f30ed3aac80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:24:31.112543 I | osd4: 2017-07-11 13:24:31.112534 7f30ed3aac80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:24:31.112558 I | osd4: 2017-07-11 13:24:31.112548 7f30ed3aac80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:24:31.112576 I | osd4: 2017-07-11 13:24:31.112563 7f30ed3aac80 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:24:31.112595 I | osd4: 2017-07-11 13:24:31.112585 7f30ed3aac80 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:24:31.112609 I | osd4: 2017-07-11 13:24:31.112600 7f30ed3aac80 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:24:31.112626 I | osd4: 2017-07-11 13:24:31.112614 7f30ed3aac80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:24:31.112640 I | osd4: 2017-07-11 13:24:31.112631 7f30ed3aac80 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:24:31.112658 I | osd4: 2017-07-11 13:24:31.112645 7f30ed3aac80 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:24:31.112677 I | osd4: 2017-07-11 13:24:31.112667 7f30ed3aac80 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:24:31.112691 I | osd4: 2017-07-11 13:24:31.112682 7f30ed3aac80 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:24:31.112705 I | osd4: 2017-07-11 13:24:31.112697 7f30ed3aac80 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:24:31.112719 I | osd4: 2017-07-11 13:24:31.112710 7f30ed3aac80 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:24:31.112733 I | osd4: 2017-07-11 13:24:31.112724 7f30ed3aac80 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:24:31.121342 I | osd4: 2017-07-11 13:24:31.120954 7f30ed3aac80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/osd4/current/omap/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:24:31.121385 I | osd4:
- 2017-07-11 13:24:31.121399 I | osd4: 2017-07-11 13:24:31.120963 7f30ed3aac80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 4
- 2017-07-11 13:24:31.121410 I | osd4:
- 2017-07-11 13:24:31.121420 I | osd4: 2017-07-11 13:24:31.121005 7f30ed3aac80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779471121000, "job": 1, "event": "recovery_started", "log_files": [6]}
- 2017-07-11 13:24:31.121430 I | osd4: 2017-07-11 13:24:31.121008 7f30ed3aac80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #6 mode 2
- 2017-07-11 13:24:31.184764 I | osd4: 2017-07-11 13:24:31.184566 7f30ed3aac80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779471184557, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 882, "table_properties": {"data_size": 51, "index_size": 27, "filter_size": 0, "raw_key_size": 20, "raw_average_key_size": 20, "raw_value_size": 15, "raw_average_value_size": 15, "num_data_blocks": 1, "num_entries": 1, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:24:31.184816 I | osd4: 2017-07-11 13:24:31.184591 7f30ed3aac80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 8
- 2017-07-11 13:24:31.184831 I | osd4:
- 2017-07-11 13:24:31.280250 I | osd4: 2017-07-11 13:24:31.280201 7f30ed3aac80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779471280196, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:24:31.347031 I | osd4: 2017-07-11 13:24:31.347003 7f30ed3aac80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x5634b709e000
- 2017-07-11 13:24:31.347356 I | osd4: 2017-07-11 13:24:31.347278 7f30ed3aac80 0 filestore(/var/lib/rook/osd4) mount(1717): enabling WRITEAHEAD journal mode: checkpoint is not enabled
- 2017-07-11 13:24:31.347530 I | osd4: 2017-07-11 13:24:31.347506 7f30ed3aac80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:31.434175 I | osd4: 2017-07-11 13:24:31.434140 7f30ed3aac80 0 osd.4 0 crush map has features 288232575208783872, adjusting msgr requires for clients
- 2017-07-11 13:24:31.434253 I | osd4: 2017-07-11 13:24:31.434236 7f30ed3aac80 0 osd.4 0 crush map has features 288232575208783872 was 8705, adjusting msgr requires for mons
- 2017-07-11 13:24:31.434313 I | osd4: 2017-07-11 13:24:31.434295 7f30ed3aac80 0 osd.4 0 crush map has features 288232575208783872, adjusting msgr requires for osds
- 2017-07-11 13:24:31.434426 I | osd4: 2017-07-11 13:24:31.434407 7f30ed3aac80 0 osd.4 0 load_pgs
- 2017-07-11 13:24:31.434545 I | osd4: 2017-07-11 13:24:31.434505 7f30ed3aac80 0 osd.4 0 load_pgs opened 0 pgs
- 2017-07-11 13:24:31.434581 I | osd4: 2017-07-11 13:24:31.434567 7f30ed3aac80 0 osd.4 0 using 1 op queue with priority op cut off at 64.
- 2017-07-11 13:24:31.435297 I | osd4: 2017-07-11 13:24:31.435274 7f30ed3aac80 -1 osd.4 0 log_to_monitors {default=true}
- 2017-07-11 13:24:32.270563 I | osd4: 2017-07-11 13:24:32.270525 7f30ed3aac80 0 osd.4 0 done with init, starting boot process
- 2017-07-11 13:24:32.271954 I | osd4: 2017-07-11 13:24:32.271929 7f30d2b14700 -1 osd.4 0 waiting for initial osdmap
- 2017-07-11 13:24:32.311788 I | osd4: 2017-07-11 13:24:32.310643 7f30df32d700 0 osd.4 12 crush map has features 2200130813952, adjusting msgr requires for clients
- 2017-07-11 13:24:32.311857 I | osd4: 2017-07-11 13:24:32.310651 7f30df32d700 0 osd.4 12 crush map has features 2200130813952 was 288232575208792577, adjusting msgr requires for mons
- 2017-07-11 13:24:32.311875 I | osd4: 2017-07-11 13:24:32.310654 7f30df32d700 0 osd.4 12 crush map has features 720578140510109696, adjusting msgr requires for osds
- 2017-07-11 13:24:57.441109 I | osd4: 2017-07-11 13:24:57.440899 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:37.440883)
- 2017-07-11 13:24:57.441328 I | osd4: 2017-07-11 13:24:57.440926 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:37.440883)
- 2017-07-11 13:24:57.441359 I | osd4: 2017-07-11 13:24:57.440929 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:37.440883)
- 2017-07-11 13:24:58.445126 I | osd4: 2017-07-11 13:24:58.441023 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:38.441020)
- 2017-07-11 13:24:58.445194 I | osd4: 2017-07-11 13:24:58.441046 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:38.441020)
- 2017-07-11 13:24:58.445222 I | osd4: 2017-07-11 13:24:58.441050 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:38.441020)
- 2017-07-11 13:24:59.441271 I | osd4: 2017-07-11 13:24:59.441143 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:39.441141)
- 2017-07-11 13:24:59.441467 I | osd4: 2017-07-11 13:24:59.441172 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:39.441141)
- 2017-07-11 13:24:59.441612 I | osd4: 2017-07-11 13:24:59.441179 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:39.441141)
- 2017-07-11 13:25:00.441528 I | osd4: 2017-07-11 13:25:00.441402 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:40.441401)
- 2017-07-11 13:25:00.441621 I | osd4: 2017-07-11 13:25:00.441428 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:40.441401)
- 2017-07-11 13:25:00.441637 I | osd4: 2017-07-11 13:25:00.441442 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:40.441401)
- 2017-07-11 13:25:01.441614 I | osd4: 2017-07-11 13:25:01.441525 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:41.441524)
- 2017-07-11 13:25:01.441727 I | osd4: 2017-07-11 13:25:01.441539 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:41.441524)
- 2017-07-11 13:25:01.441743 I | osd4: 2017-07-11 13:25:01.441542 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:41.441524)
- 2017-07-11 13:25:02.441742 I | osd4: 2017-07-11 13:25:02.441642 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:42.441641)
- 2017-07-11 13:25:02.441839 I | osd4: 2017-07-11 13:25:02.441666 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:42.441641)
- 2017-07-11 13:25:02.441857 I | osd4: 2017-07-11 13:25:02.441671 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:42.441641)
- 2017-07-11 13:25:03.441922 I | osd4: 2017-07-11 13:25:03.441833 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:43.441831)
- 2017-07-11 13:25:03.441999 I | osd4: 2017-07-11 13:25:03.441858 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:43.441831)
- 2017-07-11 13:25:03.442016 I | osd4: 2017-07-11 13:25:03.441862 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:43.441831)
- 2017-07-11 13:25:04.442047 I | osd4: 2017-07-11 13:25:04.441951 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:44.441950)
- 2017-07-11 13:25:04.442122 I | osd4: 2017-07-11 13:25:04.441975 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:44.441950)
- 2017-07-11 13:25:04.442190 I | osd4: 2017-07-11 13:25:04.441979 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:44.441950)
- 2017-07-11 13:25:04.442401 I | osd4: 2017-07-11 13:25:04.442286 7f30e1b32700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.644850 secs
- 2017-07-11 13:25:04.442541 I | osd4: 2017-07-11 13:25:04.442329 7f30e1b32700 0 log_channel(cluster) log [WRN] : slow request 30.644850 seconds old, received at 2017-07-11 13:24:33.797300: osd_pg_create(e14 0.0:2 0.14:2 0.17:2 0.23:2 0.29:2 0.2d:2 0.37:2 0.39:2 0.3d:2 0.40:2 0.41:2 0.42:2 0.45:2 0.46:2 0.48:2 0.4a:2 0.55:2 0.5a:2 0.5c:2 0.62:2 0.65:2 0.66:2 0.68:2 0.6d:2 0.78:2 0.83:2 0.88:2 0.95:2 0.9c:2 0.a1:2 0.b0:2 0.b5:2 0.b8:2 0.bc:2 0.bd:2 0.c0:2 0.c1:2 0.c8:2 0.cb:2 0.e6:2 0.e7:2 0.f0:2 0.fe:2 0.100:2 0.101:2 0.10a:2 0.10d:2 0.10f:2 0.114:2 0.128:2 0.12a:2 0.12f:2 0.134:2 0.138:2 0.143:2 0.148:2 0.149:2 0.14c:2 0.14f:2 0.160:2 0.162:2 0.163:2 0.164:2 0.169:2 0.16b:2 0.17f:2 0.182:2 0.185:2 0.18f:2 0.190:2 0.19b:2 0.1a5:2 0.1b6:2 0.1bc:2 0.1c7:2 0.1d8:2 0.1d9:2 0.1db:2 0.1dd:2 0.1e4:2 0.1ee:2 0.1f0:2 0.1f6:2 0.1f7:2 0.204:2 0.208:2 0.210:2 0.217:2 0.219:2 0.21d:2 0.226:2 0.229:2 0.22a:2 0.22b:2 0.230:2 0.235:2 0.237:2 0.23a:2 0.23b:2 0.241:2 0.243:2 0.24d:2 0.25b:2 0.25e:2 0.261:2 0.265:2 0.267:2 0.26c:2 0.27b:2 0.27d:2 0.27f:2 0.283:2 0.284:2 0.288:2 0.28e:2 0.29e:2 0.2a6:2 0.2ae:2 0.2b1:2 0.2b4:2 0.2b6:2 0.2bb:2 0.2bf:2 0.2c0:2 0.2c3:2 0.2c5:2 0.2c6:2 0.2cd:2 0.2cf:2 0.2d5:2 0.2d8:2 0.2df:2 0.2e0:2 0.2e9:2 0.2ea:2 0.2f9:2 0.303:2 0.309:2 0.30a:2 0.30b:2 0.30d:2 0.312:2 0.325:2 0.32b:2 0.32c:2 0.32d:2 0.333:2 0.334:2 0.335:2 0.339:2 0.33a:2 0.342:2 0.359:2 0.362:2 0.368:2 0.36f:2 0.37a:2 0.384:2 0.38f:2 0.3a2:2 0.3a8:2 0.3a9:2 0.3b1:2 0.3b4:2 0.3b5:2 0.3be:2 0.3c5:2 0.3d1:2 0.3d5:2 0.3da:2 0.3e0:2 0.3e9:2 0.3eb:2 0.3ed:2 0.3ef:2 0.3f6:2 0.3f7:2 0.3f9:2 0.3fc:2) currently started
- 2017-07-11 13:25:05.442725 I | osd4: 2017-07-11 13:25:05.442593 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:45.442591)
- 2017-07-11 13:25:05.442807 I | osd4: 2017-07-11 13:25:05.442617 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:45.442591)
- 2017-07-11 13:25:05.442825 I | osd4: 2017-07-11 13:25:05.442620 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:45.442591)
- 2017-07-11 13:25:06.442862 I | osd4: 2017-07-11 13:25:06.442784 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:46.442783)
- 2017-07-11 13:25:06.442930 I | osd4: 2017-07-11 13:25:06.442800 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:46.442783)
- 2017-07-11 13:25:06.442958 I | osd4: 2017-07-11 13:25:06.442804 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:46.442783)
- 2017-07-11 13:25:07.443009 I | osd4: 2017-07-11 13:25:07.442914 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:47.442912)
- 2017-07-11 13:25:07.443034 I | osd4: 2017-07-11 13:25:07.442946 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:47.442912)
- 2017-07-11 13:25:07.443038 I | osd4: 2017-07-11 13:25:07.442950 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:47.442912)
- 2017-07-11 13:25:08.443376 I | osd4: 2017-07-11 13:25:08.443277 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:48.443276)
- 2017-07-11 13:25:08.443439 I | osd4: 2017-07-11 13:25:08.443292 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:48.443276)
- 2017-07-11 13:25:08.443466 I | osd4: 2017-07-11 13:25:08.443296 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:48.443276)
- 2017-07-11 13:25:09.443598 I | osd4: 2017-07-11 13:25:09.443462 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:49.443461)
- 2017-07-11 13:25:09.443672 I | osd4: 2017-07-11 13:25:09.443481 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:49.443461)
- 2017-07-11 13:25:09.443689 I | osd4: 2017-07-11 13:25:09.443485 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:49.443461)
- 2017-07-11 13:25:10.443857 I | osd4: 2017-07-11 13:25:10.443771 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:50.443769)
- 2017-07-11 13:25:10.443929 I | osd4: 2017-07-11 13:25:10.443787 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:50.443769)
- 2017-07-11 13:25:10.443946 I | osd4: 2017-07-11 13:25:10.443791 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:50.443769)
- 2017-07-11 13:25:11.444112 I | osd4: 2017-07-11 13:25:11.443952 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:51.443950)
- 2017-07-11 13:25:11.444296 I | osd4: 2017-07-11 13:25:11.443977 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:51.443950)
- 2017-07-11 13:25:11.444353 I | osd4: 2017-07-11 13:25:11.443984 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:51.443950)
- 2017-07-11 13:25:12.444241 I | osd4: 2017-07-11 13:25:12.444156 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:52.444155)
- 2017-07-11 13:25:12.444319 I | osd4: 2017-07-11 13:25:12.444175 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:52.444155)
- 2017-07-11 13:25:12.444336 I | osd4: 2017-07-11 13:25:12.444179 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:52.444155)
- 2017-07-11 13:25:13.444481 I | osd4: 2017-07-11 13:25:13.444333 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:53.444332)
- 2017-07-11 13:25:13.444559 I | osd4: 2017-07-11 13:25:13.444358 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:53.444332)
- 2017-07-11 13:25:13.444576 I | osd4: 2017-07-11 13:25:13.444374 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:53.444332)
- 2017-07-11 13:25:14.444737 I | osd4: 2017-07-11 13:25:14.444641 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:54.444639)
- 2017-07-11 13:25:14.444821 I | osd4: 2017-07-11 13:25:14.444668 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:54.444639)
- 2017-07-11 13:25:14.444837 I | osd4: 2017-07-11 13:25:14.444672 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:54.444639)
- 2017-07-11 13:25:15.444945 I | osd4: 2017-07-11 13:25:15.444827 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:55.444826)
- 2017-07-11 13:25:15.445033 I | osd4: 2017-07-11 13:25:15.444848 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:55.444826)
- 2017-07-11 13:25:15.445051 I | osd4: 2017-07-11 13:25:15.444852 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:55.444826)
- 2017-07-11 13:25:16.445239 I | osd4: 2017-07-11 13:25:16.445057 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:56.445055)
- 2017-07-11 13:25:16.445369 I | osd4: 2017-07-11 13:25:16.445090 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:56.445055)
- 2017-07-11 13:25:16.445531 I | osd4: 2017-07-11 13:25:16.445098 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:56.445055)
- 2017-07-11 13:25:17.445332 I | osd4: 2017-07-11 13:25:17.445234 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:57.445233)
- 2017-07-11 13:25:17.445416 I | osd4: 2017-07-11 13:25:17.445263 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:57.445233)
- 2017-07-11 13:25:17.445434 I | osd4: 2017-07-11 13:25:17.445267 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:57.445233)
- 2017-07-11 13:25:18.445478 I | osd4: 2017-07-11 13:25:18.445364 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:58.445362)
- 2017-07-11 13:25:18.445562 I | osd4: 2017-07-11 13:25:18.445389 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:58.445362)
- 2017-07-11 13:25:18.445577 I | osd4: 2017-07-11 13:25:18.445392 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:58.445362)
- 2017-07-11 13:25:19.445654 I | osd4: 2017-07-11 13:25:19.445564 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:59.445563)
- 2017-07-11 13:25:19.445745 I | osd4: 2017-07-11 13:25:19.445589 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:59.445563)
- 2017-07-11 13:25:19.445761 I | osd4: 2017-07-11 13:25:19.445592 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:24:59.445563)
- 2017-07-11 13:25:20.445853 I | osd4: 2017-07-11 13:25:20.445763 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:25:00.445761)
- 2017-07-11 13:25:20.445925 I | osd4: 2017-07-11 13:25:20.445787 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:25:00.445761)
- 2017-07-11 13:25:20.445945 I | osd4: 2017-07-11 13:25:20.445790 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:25:00.445761)
- 2017-07-11 13:25:21.446051 I | osd4: 2017-07-11 13:25:21.445961 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:25:01.445960)
- 2017-07-11 13:25:21.446133 I | osd4: 2017-07-11 13:25:21.445977 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:25:01.445960)
- 2017-07-11 13:25:21.446149 I | osd4: 2017-07-11 13:25:21.445981 7f30e1b32700 -1 osd.4 14 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:37.136893 (cutoff 2017-07-11 13:25:01.445960)
- 2017-07-11 13:25:21.991370 I | osd4: 2017-07-11 13:25:21.991257 7f30df32d700 -1 log_channel(cluster) log [ERR] : map e16 had wrong cluster addr (10.233.124.4:6801/178 != my 10.233.124.0:6801/178)
- 2017-07-11 13:25:22.446287 I | osd4: 2017-07-11 13:25:22.446162 7f30e1b32700 0 log_channel(cluster) log [WRN] : 2 slow requests, 2 included below; oldest blocked for > 45.667737 secs
- 2017-07-11 13:25:22.446367 I | osd4: 2017-07-11 13:25:22.446171 7f30e1b32700 0 log_channel(cluster) log [WRN] : slow request 45.667737 seconds old, received at 2017-07-11 13:24:36.778345: osd_pg_create(e15 0.10:2 0.13:2 0.1d:2 0.24:2 0.4d:2 0.5b:2 0.6c:2 0.77:2 0.7e:2 0.90:2 0.9e:2 0.ac:2 0.b7:2 0.cd:2 0.ce:2 0.d1:2 0.ed:2 0.f2:2 0.116:2 0.11b:2 0.129:2 0.12e:2 0.133:2 0.13d:2 0.13e:2 0.142:2 0.146:2 0.15e:2 0.176:2 0.187:2 0.1c4:2 0.1dc:2 0.1e8:2 0.203:2 0.23e:2 0.251:2 0.254:2 0.274:2 0.28b:2 0.2b0:2 0.2b3:2 0.2c8:2 0.2f4:2 0.311:2 0.326:2 0.33f:2 0.343:2 0.344:2 0.35e:2 0.36c:2 0.379:2 0.395:2 0.39c:2 0.3a7:2 0.3b0:2 0.3c3:2 0.3e3:2) currently wait for new map
- 2017-07-11 13:25:22.446389 I | osd4: 2017-07-11 13:25:22.446233 7f30e1b32700 0 log_channel(cluster) log [WRN] : slow request 40.751310 seconds old, received at 2017-07-11 13:24:41.694773: osd_pg_create(e17 0.10:2 0.14:2 0.17:2 0.1d:2 0.24:2 0.29:2 0.2d:2 0.37:2 0.3d:2 0.40:2 0.42:2 0.45:2 0.46:2 0.48:2 0.4a:2 0.55:2 0.5a:2 0.5c:2 0.62:2 0.65:2 0.68:2 0.6c:2 0.6d:2 0.78:2 0.83:2 0.90:2 0.95:2 0.9c:2 0.9e:2 0.b0:2 0.b5:2 0.b7:2 0.b8:2 0.bc:2 0.bd:2 0.c0:2 0.c8:2 0.cb:2 0.ce:2 0.d1:2 0.e6:2 0.e7:2 0.f2:2 0.fe:2 0.100:2 0.101:2 0.10a:2 0.10f:2 0.114:2 0.116:2 0.128:2 0.12a:2 0.12e:2 0.12f:2 0.13e:2 0.142:2 0.149:2 0.14c:2 0.14f:2 0.15e:2 0.160:2 0.162:2 0.163:2 0.164:2 0.169:2 0.16b:2 0.17f:2 0.182:2 0.185:2 0.18f:2 0.19b:2 0.1a5:2 0.1bc:2 0.1c7:2 0.1d9:2 0.1db:2 0.1dc:2 0.1dd:2 0.1e4:2 0.1e8:2 0.1ee:2 0.1f6:2 0.1f7:2 0.204:2 0.208:2 0.210:2 0.217:2 0.21d:2 0.226:2 0.229:2 0.22b:2 0.230:2 0.235:2 0.237:2 0.23a:2 0.23b:2 0.23e:2 0.241:2 0.243:2 0.24d:2 0.254:2 0.25b:2 0.25e:2 0.261:2 0.265:2 0.26c:2 0.27b:2 0.27d:2 0.27f:2 0.283:2 0.284:2 0.288:2 0.2ae:2 0.2b0:2 0.2b1:2 0.2b4:2 0.2bb:2 0.2bf:2 0.2c0:2 0.2c3:2 0.2c5:2 0.2cd:2 0.2cf:2 0.2df:2 0.2e9:2 0.2ea:2 0.2f9:2 0.303:2 0.309:2 0.30a:2 0.30b:2 0.30d:2 0.312:2 0.325:2 0.32b:2 0.32c:2 0.32d:2 0.333:2 0.334:2 0.339:2 0.33a:2 0.33f:2 0.342:2 0.344:2 0.359:2 0.362:2 0.368:2 0.36c:2 0.379:2 0.37a:2 0.38f:2 0.395:2 0.3a2:2 0.3a8:2 0.3a9:2 0.3b1:2 0.3b4:2 0.3b5:2 0.3be:2 0.3c3:2 0.3c5:2 0.3d1:2 0.3d5:2 0.3da:2 0.3e0:2 0.3e9:2 0.3eb:2 0.3ed:2 0.3ef:2 0.3f6:2 0.3f7:2 0.3f9:2) currently wait for new map
- 2017-07-11 13:25:37.449597 I | osd4: 2017-07-11 13:25:37.449542 7f30e1b32700 0 log_channel(cluster) log [WRN] : 2 slow requests, 1 included below; oldest blocked for > 60.671172 secs
- 2017-07-11 13:25:37.449679 I | osd4: 2017-07-11 13:25:37.449553 7f30e1b32700 0 log_channel(cluster) log [WRN] : slow request 60.671172 seconds old, received at 2017-07-11 13:24:36.778345: osd_pg_create(e15 0.10:2 0.13:2 0.1d:2 0.24:2 0.4d:2 0.5b:2 0.6c:2 0.77:2 0.7e:2 0.90:2 0.9e:2 0.ac:2 0.b7:2 0.cd:2 0.ce:2 0.d1:2 0.ed:2 0.f2:2 0.116:2 0.11b:2 0.129:2 0.12e:2 0.133:2 0.13d:2 0.13e:2 0.142:2 0.146:2 0.15e:2 0.176:2 0.187:2 0.1c4:2 0.1dc:2 0.1e8:2 0.203:2 0.23e:2 0.251:2 0.254:2 0.274:2 0.28b:2 0.2b0:2 0.2b3:2 0.2c8:2 0.2f4:2 0.311:2 0.326:2 0.33f:2 0.343:2 0.344:2 0.35e:2 0.36c:2 0.379:2 0.395:2 0.39c:2 0.3a7:2 0.3b0:2 0.3c3:2 0.3e3:2) currently wait for new map
- 2017-07-11 13:25:42.450519 I | osd4: 2017-07-11 13:25:42.450422 7f30e1b32700 0 log_channel(cluster) log [WRN] : 2 slow requests, 1 included below; oldest blocked for > 65.672029 secs
- 2017-07-11 13:25:42.450621 I | osd4: 2017-07-11 13:25:42.450443 7f30e1b32700 0 log_channel(cluster) log [WRN] : slow request 60.755602 seconds old, received at 2017-07-11 13:24:41.694773: osd_pg_create(e17 0.10:2 0.14:2 0.17:2 0.1d:2 0.24:2 0.29:2 0.2d:2 0.37:2 0.3d:2 0.40:2 0.42:2 0.45:2 0.46:2 0.48:2 0.4a:2 0.55:2 0.5a:2 0.5c:2 0.62:2 0.65:2 0.68:2 0.6c:2 0.6d:2 0.78:2 0.83:2 0.90:2 0.95:2 0.9c:2 0.9e:2 0.b0:2 0.b5:2 0.b7:2 0.b8:2 0.bc:2 0.bd:2 0.c0:2 0.c8:2 0.cb:2 0.ce:2 0.d1:2 0.e6:2 0.e7:2 0.f2:2 0.fe:2 0.100:2 0.101:2 0.10a:2 0.10f:2 0.114:2 0.116:2 0.128:2 0.12a:2 0.12e:2 0.12f:2 0.13e:2 0.142:2 0.149:2 0.14c:2 0.14f:2 0.15e:2 0.160:2 0.162:2 0.163:2 0.164:2 0.169:2 0.16b:2 0.17f:2 0.182:2 0.185:2 0.18f:2 0.19b:2 0.1a5:2 0.1bc:2 0.1c7:2 0.1d9:2 0.1db:2 0.1dc:2 0.1dd:2 0.1e4:2 0.1e8:2 0.1ee:2 0.1f6:2 0.1f7:2 0.204:2 0.208:2 0.210:2 0.217:2 0.21d:2 0.226:2 0.229:2 0.22b:2 0.230:2 0.235:2 0.237:2 0.23a:2 0.23b:2 0.23e:2 0.241:2 0.243:2 0.24d:2 0.254:2 0.25b:2 0.25e:2 0.261:2 0.265:2 0.26c:2 0.27b:2 0.27d:2 0.27f:2 0.283:2 0.284:2 0.288:2 0.2ae:2 0.2b0:2 0.2b1:2 0.2b4:2 0.2bb:2 0.2bf:2 0.2c0:2 0.2c3:2 0.2c5:2 0.2cd:2 0.2cf:2 0.2df:2 0.2e9:2 0.2ea:2 0.2f9:2 0.303:2 0.309:2 0.30a:2 0.30b:2 0.30d:2 0.312:2 0.325:2 0.32b:2 0.32c:2 0.32d:2 0.333:2 0.334:2 0.339:2 0.33a:2 0.33f:2 0.342:2 0.344:2 0.359:2 0.362:2 0.368:2 0.36c:2 0.379:2 0.37a:2 0.38f:2 0.395:2 0.3a2:2 0.3a8:2 0.3a9:2 0.3b1:2 0.3b4:2 0.3b5:2 0.3be:2 0.3c3:2 0.3c5:2 0.3d1:2 0.3d5:2 0.3da:2 0.3e0:2 0.3e9:2 0.3eb:2 0.3ed:2 0.3ef:2 0.3f6:2 0.3f7:2 0.3f9:2) currently wait for new map
- 2017-07-11 13:26:23.465345 I | osd4: 2017-07-11 13:26:23.465227 7f30e1b32700 -1 osd.4 42 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:03.465226)
- 2017-07-11 13:26:23.465431 I | osd4: 2017-07-11 13:26:23.465244 7f30e1b32700 -1 osd.4 42 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:03.465226)
- 2017-07-11 13:26:24.465549 I | osd4: 2017-07-11 13:26:24.465475 7f30e1b32700 -1 osd.4 42 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:04.465473)
- 2017-07-11 13:26:24.465633 I | osd4: 2017-07-11 13:26:24.465492 7f30e1b32700 -1 osd.4 42 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:04.465473)
- 2017-07-11 13:26:25.465715 I | osd4: 2017-07-11 13:26:25.465634 7f30e1b32700 -1 osd.4 42 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:05.465632)
- 2017-07-11 13:26:25.465789 I | osd4: 2017-07-11 13:26:25.465666 7f30e1b32700 -1 osd.4 42 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:05.465632)
- 2017-07-11 13:26:26.465995 I | osd4: 2017-07-11 13:26:26.465876 7f30e1b32700 -1 osd.4 42 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:06.465875)
- 2017-07-11 13:26:26.466118 I | osd4: 2017-07-11 13:26:26.465904 7f30e1b32700 -1 osd.4 42 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:06.465875)
- 2017-07-11 13:26:27.466094 I | osd4: 2017-07-11 13:26:27.466015 7f30e1b32700 -1 osd.4 42 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:07.466014)
- 2017-07-11 13:26:27.466171 I | osd4: 2017-07-11 13:26:27.466036 7f30e1b32700 -1 osd.4 42 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:07.466014)
- 2017-07-11 13:26:28.466413 I | osd4: 2017-07-11 13:26:28.466254 7f30e1b32700 -1 osd.4 42 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:08.466253)
- 2017-07-11 13:26:28.466862 I | osd4: 2017-07-11 13:26:28.466283 7f30e1b32700 -1 osd.4 42 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:08.466253)
- 2017-07-11 13:26:29.466518 I | osd4: 2017-07-11 13:26:29.466416 7f30e1b32700 -1 osd.4 42 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:09.466415)
- 2017-07-11 13:26:29.466610 I | osd4: 2017-07-11 13:26:29.466450 7f30e1b32700 -1 osd.4 42 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:09.466415)
- 2017-07-11 13:26:30.466888 I | osd4: 2017-07-11 13:26:30.466716 7f30e1b32700 -1 osd.4 50 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:10.466714)
- 2017-07-11 13:26:30.467018 I | osd4: 2017-07-11 13:26:30.466749 7f30e1b32700 -1 osd.4 50 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:10.466714)
- 2017-07-11 13:26:31.467005 I | osd4: 2017-07-11 13:26:31.466938 7f30e1b32700 -1 osd.4 50 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:11.466938)
- 2017-07-11 13:26:31.467086 I | osd4: 2017-07-11 13:26:31.466951 7f30e1b32700 -1 osd.4 50 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:11.466938)
- 2017-07-11 13:26:32.467151 I | osd4: 2017-07-11 13:26:32.467061 7f30e1b32700 -1 osd.4 50 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:12.467060)
- 2017-07-11 13:26:32.467243 I | osd4: 2017-07-11 13:26:32.467086 7f30e1b32700 -1 osd.4 50 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:12.467060)
- 2017-07-11 13:26:33.467449 I | osd4: 2017-07-11 13:26:33.467336 7f30e1b32700 -1 osd.4 50 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:13.467335)
- 2017-07-11 13:26:33.467535 I | osd4: 2017-07-11 13:26:33.467353 7f30e1b32700 -1 osd.4 50 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:13.467335)
- 2017-07-11 13:26:34.467735 I | osd4: 2017-07-11 13:26:34.467624 7f30e1b32700 -1 osd.4 59 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:14.467623)
- 2017-07-11 13:26:34.467814 I | osd4: 2017-07-11 13:26:34.467644 7f30e1b32700 -1 osd.4 59 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:14.467623)
- 2017-07-11 13:26:35.468045 I | osd4: 2017-07-11 13:26:35.467917 7f30e1b32700 -1 osd.4 59 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:15.467915)
- 2017-07-11 13:26:35.468169 I | osd4: 2017-07-11 13:26:35.467945 7f30e1b32700 -1 osd.4 59 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:15.467915)
- 2017-07-11 13:26:36.468790 I | osd4: 2017-07-11 13:26:36.468707 7f30e1b32700 -1 osd.4 61 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:16.468706)
- 2017-07-11 13:26:36.468868 I | osd4: 2017-07-11 13:26:36.468731 7f30e1b32700 -1 osd.4 61 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:16.468706)
- 2017-07-11 13:26:37.469059 I | osd4: 2017-07-11 13:26:37.468973 7f30e1b32700 -1 osd.4 61 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:17.468971)
- 2017-07-11 13:26:37.469237 I | osd4: 2017-07-11 13:26:37.468989 7f30e1b32700 -1 osd.4 61 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:17.468971)
- 2017-07-11 13:26:38.469300 I | osd4: 2017-07-11 13:26:38.469231 7f30e1b32700 -1 osd.4 61 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:18.469229)
- 2017-07-11 13:26:38.469365 I | osd4: 2017-07-11 13:26:38.469245 7f30e1b32700 -1 osd.4 61 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:18.469229)
- 2017-07-11 13:26:39.469625 I | osd4: 2017-07-11 13:26:39.469489 7f30e1b32700 -1 osd.4 61 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:19.469487)
- 2017-07-11 13:26:39.469711 I | osd4: 2017-07-11 13:26:39.469522 7f30e1b32700 -1 osd.4 61 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:19.469487)
- 2017-07-11 13:26:40.469907 I | osd4: 2017-07-11 13:26:40.469744 7f30e1b32700 -1 osd.4 61 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:20.469743)
- 2017-07-11 13:26:40.469988 I | osd4: 2017-07-11 13:26:40.469844 7f30e1b32700 -1 osd.4 61 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:20.469743)
- 2017-07-11 13:26:41.470220 I | osd4: 2017-07-11 13:26:41.470108 7f30e1b32700 -1 osd.4 65 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:21.470107)
- 2017-07-11 13:26:41.470302 I | osd4: 2017-07-11 13:26:41.470124 7f30e1b32700 -1 osd.4 65 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:21.470107)
- 2017-07-11 13:26:42.470421 I | osd4: 2017-07-11 13:26:42.470277 7f30e1b32700 -1 osd.4 65 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:22.470276)
- 2017-07-11 13:26:42.470489 I | osd4: 2017-07-11 13:26:42.470307 7f30e1b32700 -1 osd.4 65 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:22.470276)
- 2017-07-11 13:26:43.470654 I | osd4: 2017-07-11 13:26:43.470542 7f30e1b32700 -1 osd.4 65 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:23.470541)
- 2017-07-11 13:26:43.470761 I | osd4: 2017-07-11 13:26:43.470569 7f30e1b32700 -1 osd.4 65 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:23.470541)
- 2017-07-11 13:26:44.470938 I | osd4: 2017-07-11 13:26:44.470813 7f30e1b32700 -1 osd.4 67 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:24.470812)
- 2017-07-11 13:26:44.470960 I | osd4: 2017-07-11 13:26:44.470835 7f30e1b32700 -1 osd.4 67 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:24.470812)
- 2017-07-11 13:26:45.471243 I | osd4: 2017-07-11 13:26:45.471016 7f30e1b32700 -1 osd.4 68 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:25.471011)
- 2017-07-11 13:26:45.471354 I | osd4: 2017-07-11 13:26:45.471056 7f30e1b32700 -1 osd.4 68 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:25.471011)
- 2017-07-11 13:26:45.471417 I | osd4: 2017-07-11 13:26:45.471063 7f30e1b32700 -1 osd.4 68 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:02.550752 (cutoff 2017-07-11 13:26:25.471011)
- 2017-07-11 13:26:46.476680 I | osd4: 2017-07-11 13:26:46.476590 7f30e1b32700 -1 osd.4 70 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:26.476588)
- 2017-07-11 13:26:47.476768 I | osd4: 2017-07-11 13:26:47.476714 7f30e1b32700 -1 osd.4 70 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:27.476713)
- 2017-07-11 13:26:48.476913 I | osd4: 2017-07-11 13:26:48.476820 7f30e1b32700 -1 osd.4 70 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:28.476818)
- 2017-07-11 13:26:49.477217 I | osd4: 2017-07-11 13:26:49.477077 7f30e1b32700 -1 osd.4 72 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:29.477075)
- 2017-07-11 13:26:50.477375 I | osd4: 2017-07-11 13:26:50.477294 7f30e1b32700 -1 osd.4 72 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:30.477292)
- 2017-07-11 13:26:51.477625 I | osd4: 2017-07-11 13:26:51.477526 7f30e1b32700 -1 osd.4 72 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:31.477525)
- 2017-07-11 13:26:52.477844 I | osd4: 2017-07-11 13:26:52.477758 7f30e1b32700 -1 osd.4 74 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:32.477756)
- 2017-07-11 13:26:53.478182 I | osd4: 2017-07-11 13:26:53.478077 7f30e1b32700 -1 osd.4 75 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:33.478075)
- 2017-07-11 13:26:54.478412 I | osd4: 2017-07-11 13:26:54.478266 7f30e1b32700 -1 osd.4 76 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:34.478263)
- 2017-07-11 13:26:55.478579 I | osd4: 2017-07-11 13:26:55.478521 7f30e1b32700 -1 osd.4 77 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:35.478520)
- 2017-07-11 13:26:56.479224 I | osd4: 2017-07-11 13:26:56.479109 7f30e1b32700 -1 osd.4 77 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:36.479106)
- 2017-07-11 13:26:57.479336 I | osd4: 2017-07-11 13:26:57.479263 7f30e1b32700 -1 osd.4 77 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:37.479262)
- 2017-07-11 13:26:58.479612 I | osd4: 2017-07-11 13:26:58.479487 7f30e1b32700 -1 osd.4 77 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:38.479484)
- 2017-07-11 13:26:59.479741 I | osd4: 2017-07-11 13:26:59.479675 7f30e1b32700 -1 osd.4 77 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:39.479673)
- 2017-07-11 13:27:00.479958 I | osd4: 2017-07-11 13:27:00.479874 7f30e1b32700 -1 osd.4 77 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:40.479870)
- 2017-07-11 13:27:01.480264 I | osd4: 2017-07-11 13:27:01.480178 7f30e1b32700 -1 osd.4 77 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:41.480177)
- 2017-07-11 13:27:02.480555 I | osd4: 2017-07-11 13:27:02.480476 7f30e1b32700 -1 osd.4 79 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:42.480474)
- 2017-07-11 13:27:03.480888 I | osd4: 2017-07-11 13:27:03.480787 7f30e1b32700 -1 osd.4 79 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:43.480785)
- 2017-07-11 13:27:04.481312 I | osd4: 2017-07-11 13:27:04.481221 7f30e1b32700 -1 osd.4 79 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:44.481220)
- 2017-07-11 13:27:05.481503 I | osd4: 2017-07-11 13:27:05.481435 7f30e1b32700 -1 osd.4 80 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:45.481433)
- 2017-07-11 13:27:06.482071 I | osd4: 2017-07-11 13:27:06.481986 7f30e1b32700 -1 osd.4 80 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:46.481985)
- 2017-07-11 13:27:07.482315 I | osd4: 2017-07-11 13:27:07.482247 7f30e1b32700 -1 osd.4 80 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:47.482246)
- 2017-07-11 13:27:08.482616 I | osd4: 2017-07-11 13:27:08.482440 7f30e1b32700 -1 osd.4 80 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:48.482437)
- 2017-07-11 13:27:09.482766 I | osd4: 2017-07-11 13:27:09.482672 7f30e1b32700 -1 osd.4 80 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:49.482670)
- 2017-07-11 13:27:10.482993 I | osd4: 2017-07-11 13:27:10.482857 7f30e1b32700 -1 osd.4 80 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:50.482856)
- 2017-07-11 13:27:10.483085 I | osd4: 2017-07-11 13:27:10.482886 7f30e1b32700 -1 osd.4 80 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:50.482856)
- 2017-07-11 13:27:10.483102 I | osd4: 2017-07-11 13:27:10.482890 7f30e1b32700 -1 osd.4 80 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:50.482856)
- 2017-07-11 13:27:11.483123 I | osd4: 2017-07-11 13:27:11.483045 7f30e1b32700 -1 osd.4 84 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:51.483044)
- 2017-07-11 13:27:11.483199 I | osd4: 2017-07-11 13:27:11.483060 7f30e1b32700 -1 osd.4 84 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:51.483044)
- 2017-07-11 13:27:11.483214 I | osd4: 2017-07-11 13:27:11.483064 7f30e1b32700 -1 osd.4 84 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:51.483044)
- 2017-07-11 13:27:12.483317 I | osd4: 2017-07-11 13:27:12.483228 7f30e1b32700 -1 osd.4 84 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:52.483227)
- 2017-07-11 13:27:12.483408 I | osd4: 2017-07-11 13:27:12.483251 7f30e1b32700 -1 osd.4 84 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:52.483227)
- 2017-07-11 13:27:12.483424 I | osd4: 2017-07-11 13:27:12.483256 7f30e1b32700 -1 osd.4 84 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:52.483227)
- 2017-07-11 13:27:13.483660 I | osd4: 2017-07-11 13:27:13.483530 7f30e1b32700 -1 osd.4 84 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:53.483529)
- 2017-07-11 13:27:13.483733 I | osd4: 2017-07-11 13:27:13.483550 7f30e1b32700 -1 osd.4 84 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:53.483529)
- 2017-07-11 13:27:13.483750 I | osd4: 2017-07-11 13:27:13.483554 7f30e1b32700 -1 osd.4 84 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:53.483529)
- 2017-07-11 13:27:14.483846 I | osd4: 2017-07-11 13:27:14.483749 7f30e1b32700 -1 osd.4 84 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:54.483748)
- 2017-07-11 13:27:14.483919 I | osd4: 2017-07-11 13:27:14.483776 7f30e1b32700 -1 osd.4 84 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:54.483748)
- 2017-07-11 13:27:14.483935 I | osd4: 2017-07-11 13:27:14.483780 7f30e1b32700 -1 osd.4 84 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:54.483748)
- 2017-07-11 13:27:15.484068 I | osd4: 2017-07-11 13:27:15.483925 7f30e1b32700 -1 osd.4 85 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:55.483923)
- 2017-07-11 13:27:15.484147 I | osd4: 2017-07-11 13:27:15.483967 7f30e1b32700 -1 osd.4 85 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:24.753144 (cutoff 2017-07-11 13:26:55.483923)
- 2017-07-11 13:27:15.484165 I | osd4: 2017-07-11 13:27:15.483971 7f30e1b32700 -1 osd.4 85 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:55.483923)
- 2017-07-11 13:27:16.484415 I | osd4: 2017-07-11 13:27:16.484270 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:56.484269)
- 2017-07-11 13:27:16.484487 I | osd4: 2017-07-11 13:27:16.484309 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:56.484269)
- 2017-07-11 13:27:17.484825 I | osd4: 2017-07-11 13:27:17.484731 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:57.484730)
- 2017-07-11 13:27:17.484906 I | osd4: 2017-07-11 13:27:17.484761 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:57.484730)
- 2017-07-11 13:27:18.485043 I | osd4: 2017-07-11 13:27:18.484912 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:58.484909)
- 2017-07-11 13:27:18.485164 I | osd4: 2017-07-11 13:27:18.484949 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:58.484909)
- 2017-07-11 13:27:19.485252 I | osd4: 2017-07-11 13:27:19.485114 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:59.485112)
- 2017-07-11 13:27:19.485380 I | osd4: 2017-07-11 13:27:19.485148 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:26:59.485112)
- 2017-07-11 13:27:20.485430 I | osd4: 2017-07-11 13:27:20.485310 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:00.485306)
- 2017-07-11 13:27:20.485506 I | osd4: 2017-07-11 13:27:20.485343 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:00.485306)
- 2017-07-11 13:27:21.485591 I | osd4: 2017-07-11 13:27:21.485474 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:01.485473)
- 2017-07-11 13:27:21.485690 I | osd4: 2017-07-11 13:27:21.485492 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:01.485473)
- 2017-07-11 13:27:22.485831 I | osd4: 2017-07-11 13:27:22.485680 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:02.485678)
- 2017-07-11 13:27:22.485953 I | osd4: 2017-07-11 13:27:22.485714 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:02.485678)
- 2017-07-11 13:27:23.486151 I | osd4: 2017-07-11 13:27:23.486056 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:03.486055)
- 2017-07-11 13:27:23.486224 I | osd4: 2017-07-11 13:27:23.486069 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:03.486055)
- 2017-07-11 13:27:24.486614 I | osd4: 2017-07-11 13:27:24.486519 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:04.486505)
- 2017-07-11 13:27:24.486715 I | osd4: 2017-07-11 13:27:24.486550 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:04.486505)
- 2017-07-11 13:27:25.486966 I | osd4: 2017-07-11 13:27:25.486810 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:05.486808)
- 2017-07-11 13:27:25.487039 I | osd4: 2017-07-11 13:27:25.486835 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:05.486808)
- 2017-07-11 13:27:26.487363 I | osd4: 2017-07-11 13:27:26.487248 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:06.487247)
- 2017-07-11 13:27:26.487435 I | osd4: 2017-07-11 13:27:26.487295 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:06.487247)
- 2017-07-11 13:27:27.487685 I | osd4: 2017-07-11 13:27:27.487591 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:07.487589)
- 2017-07-11 13:27:27.487756 I | osd4: 2017-07-11 13:27:27.487614 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:07.487589)
- 2017-07-11 13:27:28.488768 I | osd4: 2017-07-11 13:27:28.488636 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:08.488634)
- 2017-07-11 13:27:28.488845 I | osd4: 2017-07-11 13:27:28.488673 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:08.488634)
- 2017-07-11 13:27:29.489104 I | osd4: 2017-07-11 13:27:29.488973 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:09.488971)
- 2017-07-11 13:27:29.489170 I | osd4: 2017-07-11 13:27:29.489000 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:09.488971)
- 2017-07-11 13:27:30.490010 I | osd4: 2017-07-11 13:27:30.489831 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:10.489828)
- 2017-07-11 13:27:30.490091 I | osd4: 2017-07-11 13:27:30.489871 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:10.489828)
- 2017-07-11 13:27:31.490304 I | osd4: 2017-07-11 13:27:31.490184 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:11.490183)
- 2017-07-11 13:27:31.490391 I | osd4: 2017-07-11 13:27:31.490201 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:11.490183)
- 2017-07-11 13:27:32.490546 I | osd4: 2017-07-11 13:27:32.490468 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:12.490466)
- 2017-07-11 13:27:32.490651 I | osd4: 2017-07-11 13:27:32.490481 7f30e1b32700 -1 osd.4 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:12.490466)
- 2017-07-11 13:27:33.490932 I | osd4: 2017-07-11 13:27:33.490812 7f30e1b32700 -1 osd.4 89 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:13.490811)
- 2017-07-11 13:27:33.491185 I | osd4: 2017-07-11 13:27:33.490840 7f30e1b32700 -1 osd.4 89 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:13.490811)
- 2017-07-11 13:27:34.491061 I | osd4: 2017-07-11 13:27:34.490972 7f30e1b32700 -1 osd.4 89 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:14.490970)
- 2017-07-11 13:27:34.491143 I | osd4: 2017-07-11 13:27:34.491000 7f30e1b32700 -1 osd.4 89 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:14.490970)
- 2017-07-11 13:27:35.491499 I | osd4: 2017-07-11 13:27:35.491368 7f30e1b32700 -1 osd.4 90 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:15.491367)
- 2017-07-11 13:27:35.491574 I | osd4: 2017-07-11 13:27:35.491398 7f30e1b32700 -1 osd.4 90 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:15.491367)
- 2017-07-11 13:27:36.491655 I | osd4: 2017-07-11 13:27:36.491576 7f30e1b32700 -1 osd.4 91 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:16.491575)
- 2017-07-11 13:27:37.491897 I | osd4: 2017-07-11 13:27:37.491808 7f30e1b32700 -1 osd.4 91 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:17.491807)
- 2017-07-11 13:27:38.492357 I | osd4: 2017-07-11 13:27:38.492191 7f30e1b32700 -1 osd.4 93 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:18.492190)
- 2017-07-11 13:27:39.492564 I | osd4: 2017-07-11 13:27:39.492495 7f30e1b32700 -1 osd.4 93 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:19.492494)
- 2017-07-11 13:27:40.493151 I | osd4: 2017-07-11 13:27:40.492973 7f30e1b32700 -1 osd.4 94 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:20.492971)
- 2017-07-11 13:27:41.493485 I | osd4: 2017-07-11 13:27:41.493375 7f30e1b32700 -1 osd.4 94 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:21.493373)
- 2017-07-11 13:27:42.493985 I | osd4: 2017-07-11 13:27:42.493827 7f30e1b32700 -1 osd.4 94 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:22.493825)
- 2017-07-11 13:27:43.494257 I | osd4: 2017-07-11 13:27:43.494170 7f30e1b32700 -1 osd.4 94 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:23.494169)
- 2017-07-11 13:27:44.494555 I | osd4: 2017-07-11 13:27:44.494463 7f30e1b32700 -1 osd.4 94 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:24.494461)
- 2017-07-11 13:27:45.494851 I | osd4: 2017-07-11 13:27:45.494732 7f30e1b32700 -1 osd.4 94 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:49.760177 (cutoff 2017-07-11 13:27:25.494728)
- 2017-07-11 13:27:53.502336 I | osd4: 2017-07-11 13:27:53.502117 7f30e1b32700 -1 osd.4 99 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:33.502115)
- 2017-07-11 13:27:54.502459 I | osd4: 2017-07-11 13:27:54.502361 7f30e1b32700 -1 osd.4 99 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:34.502359)
- 2017-07-11 13:27:55.502814 I | osd4: 2017-07-11 13:27:55.502747 7f30e1b32700 -1 osd.4 99 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:35.502745)
- 2017-07-11 13:27:56.502914 I | osd4: 2017-07-11 13:27:56.502849 7f30e1b32700 -1 osd.4 99 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:36.502846)
- 2017-07-11 13:27:57.503037 I | osd4: 2017-07-11 13:27:57.502967 7f30e1b32700 -1 osd.4 108 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:37.502965)
- 2017-07-11 13:27:58.503328 I | osd4: 2017-07-11 13:27:58.503264 7f30e1b32700 -1 osd.4 108 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:38.503262)
- 2017-07-11 13:27:59.504058 I | osd4: 2017-07-11 13:27:59.503411 7f30e1b32700 -1 osd.4 108 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:39.503409)
- 2017-07-11 13:28:00.510044 I | osd4: 2017-07-11 13:28:00.509960 7f30e1b32700 -1 osd.4 108 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:40.509959)
- 2017-07-11 13:28:01.510277 I | osd4: 2017-07-11 13:28:01.510190 7f30e1b32700 -1 osd.4 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:41.510189)
- 2017-07-11 13:28:02.510457 I | osd4: 2017-07-11 13:28:02.510371 7f30e1b32700 -1 osd.4 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:42.510370)
- 2017-07-11 13:28:03.510605 I | osd4: 2017-07-11 13:28:03.510540 7f30e1b32700 -1 osd.4 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:43.510539)
- 2017-07-11 13:28:04.510853 I | osd4: 2017-07-11 13:28:04.510779 7f30e1b32700 -1 osd.4 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:44.510777)
- 2017-07-11 13:28:05.511021 I | osd4: 2017-07-11 13:28:05.510959 7f30e1b32700 -1 osd.4 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:45.510958)
- 2017-07-11 13:28:06.511141 I | osd4: 2017-07-11 13:28:06.511075 7f30e1b32700 -1 osd.4 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:46.511074)
- 2017-07-11 13:28:07.511492 I | osd4: 2017-07-11 13:28:07.511295 7f30e1b32700 -1 osd.4 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:47.511293)
- 2017-07-11 13:28:07.511711 I | osd4: 2017-07-11 13:28:07.511318 7f30e1b32700 -1 osd.4 110 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:27:47.511293)
- 2017-07-11 13:28:08.511987 I | osd4: 2017-07-11 13:28:08.511850 7f30e1b32700 -1 osd.4 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:48.511848)
- 2017-07-11 13:28:08.512068 I | osd4: 2017-07-11 13:28:08.511872 7f30e1b32700 -1 osd.4 110 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:27:48.511848)
- 2017-07-11 13:28:09.512169 I | osd4: 2017-07-11 13:28:09.512086 7f30e1b32700 -1 osd.4 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:49.512084)
- 2017-07-11 13:28:09.512242 I | osd4: 2017-07-11 13:28:09.512106 7f30e1b32700 -1 osd.4 110 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:27:49.512084)
- 2017-07-11 13:28:10.512549 I | osd4: 2017-07-11 13:28:10.512355 7f30e1b32700 -1 osd.4 111 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:50.512353)
- 2017-07-11 13:28:10.512666 I | osd4: 2017-07-11 13:28:10.512385 7f30e1b32700 -1 osd.4 111 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:27:50.512353)
- 2017-07-11 13:28:11.512701 I | osd4: 2017-07-11 13:28:11.512599 7f30e1b32700 -1 osd.4 117 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:51.512598)
- 2017-07-11 13:28:11.512887 I | osd4: 2017-07-11 13:28:11.512618 7f30e1b32700 -1 osd.4 117 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:27:51.512598)
- 2017-07-11 13:28:12.513005 I | osd4: 2017-07-11 13:28:12.512918 7f30e1b32700 -1 osd.4 117 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:52.512917)
- 2017-07-11 13:28:12.513088 I | osd4: 2017-07-11 13:28:12.512945 7f30e1b32700 -1 osd.4 117 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:27:52.512917)
- 2017-07-11 13:28:13.513221 I | osd4: 2017-07-11 13:28:13.513145 7f30e1b32700 -1 osd.4 117 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:53.513141)
- 2017-07-11 13:28:13.513293 I | osd4: 2017-07-11 13:28:13.513166 7f30e1b32700 -1 osd.4 117 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:27:53.513141)
- 2017-07-11 13:28:14.513553 I | osd4: 2017-07-11 13:28:14.513439 7f30e1b32700 -1 osd.4 119 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:54.513437)
- 2017-07-11 13:28:14.513665 I | osd4: 2017-07-11 13:28:14.513473 7f30e1b32700 -1 osd.4 119 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:27:54.513437)
- 2017-07-11 13:28:15.513676 I | osd4: 2017-07-11 13:28:15.513585 7f30e1b32700 -1 osd.4 121 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:55.513584)
- 2017-07-11 13:28:15.513792 I | osd4: 2017-07-11 13:28:15.513598 7f30e1b32700 -1 osd.4 121 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:27:55.513584)
- 2017-07-11 13:28:16.513905 I | osd4: 2017-07-11 13:28:16.513822 7f30e1b32700 -1 osd.4 121 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:56.513820)
- 2017-07-11 13:28:16.513977 I | osd4: 2017-07-11 13:28:16.513845 7f30e1b32700 -1 osd.4 121 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:27:56.513820)
- 2017-07-11 13:28:17.514027 I | osd4: 2017-07-11 13:28:17.513928 7f30e1b32700 -1 osd.4 124 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:57.513926)
- 2017-07-11 13:28:17.514110 I | osd4: 2017-07-11 13:28:17.513943 7f30e1b32700 -1 osd.4 124 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:27:57.513926)
- 2017-07-11 13:28:18.514480 I | osd4: 2017-07-11 13:28:18.514350 7f30e1b32700 -1 osd.4 124 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:58.514349)
- 2017-07-11 13:28:18.514569 I | osd4: 2017-07-11 13:28:18.514376 7f30e1b32700 -1 osd.4 124 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:27:58.514349)
- 2017-07-11 13:28:19.514587 I | osd4: 2017-07-11 13:28:19.514506 7f30e1b32700 -1 osd.4 124 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:27:59.514504)
- 2017-07-11 13:28:19.514667 I | osd4: 2017-07-11 13:28:19.514529 7f30e1b32700 -1 osd.4 124 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:27:59.514504)
- 2017-07-11 13:28:20.526996 I | osd4: 2017-07-11 13:28:20.518330 7f30e1b32700 -1 osd.4 124 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:00.518329)
- 2017-07-11 13:28:20.530335 I | osd4: 2017-07-11 13:28:20.518358 7f30e1b32700 -1 osd.4 124 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:28:00.518329)
- 2017-07-11 13:28:20.530368 I | osd4: 2017-07-11 13:28:20.518361 7f30e1b32700 -1 osd.4 124 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:28:00.518329)
- 2017-07-11 13:28:21.518610 I | osd4: 2017-07-11 13:28:21.518474 7f30e1b32700 -1 osd.4 125 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:01.518473)
- 2017-07-11 13:28:21.518695 I | osd4: 2017-07-11 13:28:21.518504 7f30e1b32700 -1 osd.4 125 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:28:01.518473)
- 2017-07-11 13:28:21.518713 I | osd4: 2017-07-11 13:28:21.518508 7f30e1b32700 -1 osd.4 125 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:28:01.518473)
- 2017-07-11 13:28:22.519225 I | osd4: 2017-07-11 13:28:22.518625 7f30e1b32700 -1 osd.4 125 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:02.518624)
- 2017-07-11 13:28:22.519299 I | osd4: 2017-07-11 13:28:22.518654 7f30e1b32700 -1 osd.4 125 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:28:02.518624)
- 2017-07-11 13:28:22.519316 I | osd4: 2017-07-11 13:28:22.518658 7f30e1b32700 -1 osd.4 125 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:28:02.518624)
- 2017-07-11 13:28:23.518911 I | osd4: 2017-07-11 13:28:23.518807 7f30e1b32700 -1 osd.4 125 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:03.518805)
- 2017-07-11 13:28:23.519008 I | osd4: 2017-07-11 13:28:23.518832 7f30e1b32700 -1 osd.4 125 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:28:03.518805)
- 2017-07-11 13:28:23.519093 I | osd4: 2017-07-11 13:28:23.518836 7f30e1b32700 -1 osd.4 125 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:28:03.518805)
- 2017-07-11 13:28:24.519120 I | osd4: 2017-07-11 13:28:24.518986 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:04.518985)
- 2017-07-11 13:28:24.519210 I | osd4: 2017-07-11 13:28:24.519014 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:28:04.518985)
- 2017-07-11 13:28:24.519225 I | osd4: 2017-07-11 13:28:24.519018 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:28:04.518985)
- 2017-07-11 13:28:25.519330 I | osd4: 2017-07-11 13:28:25.519199 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:05.519197)
- 2017-07-11 13:28:25.519411 I | osd4: 2017-07-11 13:28:25.519227 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:28:05.519197)
- 2017-07-11 13:28:25.519433 I | osd4: 2017-07-11 13:28:25.519231 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:28:05.519197)
- 2017-07-11 13:28:26.519499 I | osd4: 2017-07-11 13:28:26.519357 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:06.519355)
- 2017-07-11 13:28:26.519593 I | osd4: 2017-07-11 13:28:26.519387 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:28:06.519355)
- 2017-07-11 13:28:26.519610 I | osd4: 2017-07-11 13:28:26.519391 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:28:06.519355)
- 2017-07-11 13:28:27.519665 I | osd4: 2017-07-11 13:28:27.519539 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:07.519537)
- 2017-07-11 13:28:27.519745 I | osd4: 2017-07-11 13:28:27.519586 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:28:07.519537)
- 2017-07-11 13:28:27.519762 I | osd4: 2017-07-11 13:28:27.519590 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:28:07.519537)
- 2017-07-11 13:28:28.520205 I | osd4: 2017-07-11 13:28:28.519793 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:08.519792)
- 2017-07-11 13:28:28.520406 I | osd4: 2017-07-11 13:28:28.519895 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:28:08.519792)
- 2017-07-11 13:28:28.520464 I | osd4: 2017-07-11 13:28:28.520305 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:28:08.519792)
- 2017-07-11 13:28:29.520543 I | osd4: 2017-07-11 13:28:29.520410 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:09.520409)
- 2017-07-11 13:28:29.520657 I | osd4: 2017-07-11 13:28:29.520443 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:28:09.520409)
- 2017-07-11 13:28:29.520695 I | osd4: 2017-07-11 13:28:29.520447 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:28:09.520409)
- 2017-07-11 13:28:30.529546 I | osd4: 2017-07-11 13:28:30.529449 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:10.529448)
- 2017-07-11 13:28:30.529631 I | osd4: 2017-07-11 13:28:30.529477 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:28:10.529448)
- 2017-07-11 13:28:30.529675 I | osd4: 2017-07-11 13:28:30.529481 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:28:10.529448)
- 2017-07-11 13:28:31.529821 I | osd4: 2017-07-11 13:28:31.529695 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:11.529694)
- 2017-07-11 13:28:31.529898 I | osd4: 2017-07-11 13:28:31.529729 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:28:11.529694)
- 2017-07-11 13:28:31.529914 I | osd4: 2017-07-11 13:28:31.529736 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:28:11.529694)
- 2017-07-11 13:28:32.529996 I | osd4: 2017-07-11 13:28:32.529905 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:12.529903)
- 2017-07-11 13:28:32.530064 I | osd4: 2017-07-11 13:28:32.529932 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:28:12.529903)
- 2017-07-11 13:28:32.530079 I | osd4: 2017-07-11 13:28:32.529936 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:28:12.529903)
- 2017-07-11 13:28:33.530394 I | osd4: 2017-07-11 13:28:33.530285 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:13.530283)
- 2017-07-11 13:28:33.530482 I | osd4: 2017-07-11 13:28:33.530327 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:33.365930 (cutoff 2017-07-11 13:28:13.530283)
- 2017-07-11 13:28:33.530505 I | osd4: 2017-07-11 13:28:33.530331 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:47.267935 (cutoff 2017-07-11 13:28:13.530283)
- 2017-07-11 13:28:34.530729 I | osd4: 2017-07-11 13:28:34.530615 7f30e1b32700 -1 osd.4 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:59.569228 (cutoff 2017-07-11 13:28:14.530613)
- END logs from pod: rook-ceph-osd-ckdpx
- BEGIN logs from pod: rook-ceph-osd-cn9hq
- 2017-07-11 13:24:21.605112 I | cephmon: parsing mon endpoints: rook-ceph-mon1=10.233.99.4:6790,rook-ceph-mon2=10.233.124.3:6790,rook-ceph-mon0=10.233.76.3:6790
- 2017-07-11 13:24:21.622629 I | cephmon: writing config file /var/lib/rook/rook/rook.config
- 2017-07-11 13:24:21.622796 I | cephmon: generated admin config in /var/lib/rook/rook
- 2017-07-11 13:24:21.622828 I | cephosd: discovering hardware
- 2017-07-11 13:24:21.622842 I | exec: Running command: lsblk --all --noheadings --list --output KNAME
- 2017-07-11 13:24:21.672639 I | exec: Running command: lsblk /dev/fd0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.680934 I | exec: Running command: sgdisk --print /dev/fd0
- 2017-07-11 13:24:21.761078 W | inventory: skipping device fd0 with an unknown uuid. Failed to complete get disk fd0 uuid: exit status 2
- 2017-07-11 13:24:21.763815 I | exec: Running command: lsblk /dev/loop0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.765261 I | exec: Running command: lsblk /dev/loop1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.777452 I | exec: Running command: lsblk /dev/loop2 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.804281 I | exec: Running command: lsblk /dev/loop3 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.814632 I | exec: Running command: lsblk /dev/loop4 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.815922 I | exec: Running command: lsblk /dev/loop5 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.817215 I | exec: Running command: lsblk /dev/loop6 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.837633 I | exec: Running command: lsblk /dev/loop7 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.845203 I | exec: Running command: lsblk /dev/sda --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.847206 I | exec: Running command: sgdisk --print /dev/sda
- 2017-07-11 13:24:21.885284 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:21.895264 I | exec: Running command: lsblk /dev/sda1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.906305 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:21.907366 I | exec: Running command: lsblk /dev/sdb --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.925492 I | exec: Running command: sgdisk --print /dev/sdb
- 2017-07-11 13:24:21.955985 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:21.956899 I | exec: Running command: lsblk /dev/sdb1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.985273 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:21.986777 I | exec: Running command: lsblk /dev/sr0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:21.988508 I | cephosd: creating and starting the osds
- 2017-07-11 13:24:21.994563 I | exec: Running command: lsblk /dev/sda --bytes --pairs --output NAME,SIZE,TYPE,PKNAME
- 2017-07-11 13:24:21.996083 I | exec: Running command: blkid /dev/sda1 -s PARTLABEL -o value
- 2017-07-11 13:24:22.054280 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:22.055450 I | cephosd: skipping device sda that is in use (not by rook). fs: ext4, ownPartitions: false
- 2017-07-11 13:24:22.055616 I | exec: Running command: lsblk /dev/sdb --bytes --pairs --output NAME,SIZE,TYPE,PKNAME
- 2017-07-11 13:24:22.057038 I | exec: Running command: blkid /dev/sdb1 -s PARTLABEL -o value
- 2017-07-11 13:24:22.074711 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:22.076062 I | cephosd: skipping device sdb that is in use (not by rook). fs: , ownPartitions: false
- 2017-07-11 13:24:22.076123 I | cephosd: configuring osd devices: &{Entries:map[]}
- 2017-07-11 13:24:22.076182 I | cephosd: configuring osd dirs: map[/var/lib/rook:-1]
- 2017-07-11 13:24:22.076394 I | exec: Running command: ceph osd create 9771b2a8-0591-4ce0-ba50-846d5c052724 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/855025240
- 2017-07-11 13:24:24.201638 I | cephosd: successfully created OSD 9771b2a8-0591-4ce0-ba50-846d5c052724 with ID 5
- 2017-07-11 13:24:24.202032 I | cephmon: writing config file /var/lib/rook/osd5/rook.config
- 2017-07-11 13:24:24.202298 I | exec: Running command: ceph mon getmap --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/682076119
- 2017-07-11 13:24:25.058447 I | exec: got monmap epoch 3
- 2017-07-11 13:24:25.058665 I | cephosd: Initializing OSD 5 file system at /var/lib/rook/osd5...
- 2017-07-11 13:24:25.058860 I | proc: Running process ceph-osd with args: [--mkfs --mkkey --id=5 --cluster=rook --conf=/var/lib/rook/osd5/rook.config --osd-data=/var/lib/rook/osd5 --osd-uuid=9771b2a8-0591-4ce0-ba50-846d5c052724 --monmap=/var/lib/rook/osd5/tmp/activate.monmap --osd-journal=/var/lib/rook/osd5/journal --keyring=/var/lib/rook/osd5/keyring]
- 2017-07-11 13:24:25.058900 I | exec: Running command: ceph-osd --mkfs --mkkey --id=5 --cluster=rook --conf=/var/lib/rook/osd5/rook.config --osd-data=/var/lib/rook/osd5 --osd-uuid=9771b2a8-0591-4ce0-ba50-846d5c052724 --monmap=/var/lib/rook/osd5/tmp/activate.monmap --osd-journal=/var/lib/rook/osd5/journal --keyring=/var/lib/rook/osd5/keyring
- 2017-07-11 13:24:25.604357 I | mkfs-osd5: 2017-07-11 13:24:25.604283 7fe6f250fc80 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 87
- 2017-07-11 13:24:26.003390 I | mkfs-osd5: 2017-07-11 13:24:26.003119 7fe6f250fc80 0 filestore(/var/lib/rook/osd5) backend generic (magic 0xef53)
- 2017-07-11 13:24:26.569893 I | mkfs-osd5: 2017-07-11 13:24:26.569837 7fe6f250fc80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:26.771989 I | mkfs-osd5: 2017-07-11 13:24:26.771949 7fe6f250fc80 0 filestore(/var/lib/rook/osd5) mkjournal(1061): created journal on /var/lib/rook/osd5/journal
- 2017-07-11 13:24:26.951587 I | mkfs-osd5: 2017-07-11 13:24:26.951551 7fe6f250fc80 0 filestore(/var/lib/rook/osd5) backend generic (magic 0xef53)
- 2017-07-11 13:24:26.951898 I | mkfs-osd5: 2017-07-11 13:24:26.951878 7fe6f250fc80 0 genericfilestorebackend(/var/lib/rook/osd5) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
- 2017-07-11 13:24:26.951946 I | mkfs-osd5: 2017-07-11 13:24:26.951931 7fe6f250fc80 0 genericfilestorebackend(/var/lib/rook/osd5) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option
- 2017-07-11 13:24:26.951971 I | mkfs-osd5: 2017-07-11 13:24:26.951961 7fe6f250fc80 0 genericfilestorebackend(/var/lib/rook/osd5) detect_features: splice() is disabled via 'filestore splice' config option
- 2017-07-11 13:24:28.677127 I | mkfs-osd5: 2017-07-11 13:24:28.677084 7fe6f250fc80 0 genericfilestorebackend(/var/lib/rook/osd5) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
- 2017-07-11 13:24:29.051351 I | mkfs-osd5: 2017-07-11 13:24:29.051313 7fe6f250fc80 0 filestore(/var/lib/rook/osd5) limited size xattrs
- 2017-07-11 13:24:29.051623 I | mkfs-osd5: 2017-07-11 13:24:29.051606 7fe6f250fc80 0 filestore(/var/lib/rook/osd5) start omap initiation
- 2017-07-11 13:24:29.051832 I | mkfs-osd5: 2017-07-11 13:24:29.051795 7fe6f250fc80 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:24:29.051857 I | mkfs-osd5:
- 2017-07-11 13:24:29.051900 I | mkfs-osd5: 2017-07-11 13:24:29.051871 7fe6f250fc80 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:24:29.051928 I | mkfs-osd5: 2017-07-11 13:24:29.051917 7fe6f250fc80 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:24:29.051954 I | mkfs-osd5: 2017-07-11 13:24:29.051942 7fe6f250fc80 4 rocksdb: DB SUMMARY
- 2017-07-11 13:24:29.051978 I | mkfs-osd5:
- 2017-07-11 13:24:29.052039 I | mkfs-osd5: 2017-07-11 13:24:29.052026 7fe6f250fc80 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:24:29.052068 I | mkfs-osd5:
- 2017-07-11 13:24:29.052091 I | mkfs-osd5: 2017-07-11 13:24:29.052080 7fe6f250fc80 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:24:29.052102 I | mkfs-osd5:
- 2017-07-11 13:24:29.052146 I | mkfs-osd5: 2017-07-11 13:24:29.052134 7fe6f250fc80 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes
- 2017-07-11 13:24:29.052160 I | mkfs-osd5:
- 2017-07-11 13:24:29.052184 I | mkfs-osd5: 2017-07-11 13:24:29.052173 7fe6f250fc80 4 rocksdb: SST files in /var/lib/rook/osd5/current/omap dir, Total Num: 0, files:
- 2017-07-11 13:24:29.052195 I | mkfs-osd5:
- 2017-07-11 13:24:29.052232 I | mkfs-osd5: 2017-07-11 13:24:29.052219 7fe6f250fc80 4 rocksdb: Write Ahead Log file in /var/lib/rook/osd5/current/omap: 000003.log size: 0 ;
- 2017-07-11 13:24:29.052244 I | mkfs-osd5:
- 2017-07-11 13:24:29.052265 I | mkfs-osd5: 2017-07-11 13:24:29.052255 7fe6f250fc80 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:24:29.052304 I | mkfs-osd5: 2017-07-11 13:24:29.052293 7fe6f250fc80 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:24:29.052326 I | mkfs-osd5: 2017-07-11 13:24:29.052317 7fe6f250fc80 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:24:29.052348 I | mkfs-osd5: 2017-07-11 13:24:29.052338 7fe6f250fc80 4 rocksdb: Options.env: 0x562c87e4d8e0
- 2017-07-11 13:24:29.052382 I | mkfs-osd5: 2017-07-11 13:24:29.052372 7fe6f250fc80 4 rocksdb: Options.info_log: 0x562c88c634a0
- 2017-07-11 13:24:29.052404 I | mkfs-osd5: 2017-07-11 13:24:29.052395 7fe6f250fc80 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:24:29.052427 I | mkfs-osd5: 2017-07-11 13:24:29.052418 7fe6f250fc80 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:24:29.052460 I | mkfs-osd5: 2017-07-11 13:24:29.052450 7fe6f250fc80 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:24:29.052482 I | mkfs-osd5: 2017-07-11 13:24:29.052473 7fe6f250fc80 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:24:29.052506 I | mkfs-osd5: 2017-07-11 13:24:29.052494 7fe6f250fc80 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:24:29.052541 I | mkfs-osd5: 2017-07-11 13:24:29.052530 7fe6f250fc80 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:24:29.052563 I | mkfs-osd5: 2017-07-11 13:24:29.052554 7fe6f250fc80 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:24:29.052584 I | mkfs-osd5: 2017-07-11 13:24:29.052575 7fe6f250fc80 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:24:29.052626 I | mkfs-osd5: 2017-07-11 13:24:29.052615 7fe6f250fc80 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:24:29.052648 I | mkfs-osd5: 2017-07-11 13:24:29.052639 7fe6f250fc80 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:24:29.052669 I | mkfs-osd5: 2017-07-11 13:24:29.052660 7fe6f250fc80 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:24:29.052706 I | mkfs-osd5: 2017-07-11 13:24:29.052696 7fe6f250fc80 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:24:29.052733 I | mkfs-osd5: 2017-07-11 13:24:29.052723 7fe6f250fc80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:24:29.052767 I | mkfs-osd5: 2017-07-11 13:24:29.052745 7fe6f250fc80 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:24:29.052790 I | mkfs-osd5: 2017-07-11 13:24:29.052781 7fe6f250fc80 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:24:29.052812 I | mkfs-osd5: 2017-07-11 13:24:29.052802 7fe6f250fc80 4 rocksdb: Options.wal_dir: /var/lib/rook/osd5/current/omap
- 2017-07-11 13:24:29.052847 I | mkfs-osd5: 2017-07-11 13:24:29.052837 7fe6f250fc80 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:24:29.052870 I | mkfs-osd5: 2017-07-11 13:24:29.052861 7fe6f250fc80 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:24:29.052890 I | mkfs-osd5: 2017-07-11 13:24:29.052881 7fe6f250fc80 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:24:29.052924 I | mkfs-osd5: 2017-07-11 13:24:29.052913 7fe6f250fc80 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:24:29.052946 I | mkfs-osd5: 2017-07-11 13:24:29.052937 7fe6f250fc80 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:24:29.052967 I | mkfs-osd5: 2017-07-11 13:24:29.052958 7fe6f250fc80 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:24:29.053000 I | mkfs-osd5: 2017-07-11 13:24:29.052990 7fe6f250fc80 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:24:29.053023 I | mkfs-osd5: 2017-07-11 13:24:29.053014 7fe6f250fc80 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:24:29.053047 I | mkfs-osd5: 2017-07-11 13:24:29.053038 7fe6f250fc80 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:24:29.053081 I | mkfs-osd5: 2017-07-11 13:24:29.053071 7fe6f250fc80 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:24:29.053103 I | mkfs-osd5: 2017-07-11 13:24:29.053094 7fe6f250fc80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:24:29.053123 I | mkfs-osd5: 2017-07-11 13:24:29.053115 7fe6f250fc80 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:24:29.053157 I | mkfs-osd5: 2017-07-11 13:24:29.053147 7fe6f250fc80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:24:29.053179 I | mkfs-osd5: 2017-07-11 13:24:29.053170 7fe6f250fc80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:24:29.053199 I | mkfs-osd5: 2017-07-11 13:24:29.053191 7fe6f250fc80 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:24:29.053234 I | mkfs-osd5: 2017-07-11 13:24:29.053223 7fe6f250fc80 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:24:29.053257 I | mkfs-osd5: 2017-07-11 13:24:29.053248 7fe6f250fc80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:24:29.053281 I | mkfs-osd5: 2017-07-11 13:24:29.053269 7fe6f250fc80 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:24:29.053315 I | mkfs-osd5: 2017-07-11 13:24:29.053305 7fe6f250fc80 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:24:29.053337 I | mkfs-osd5: 2017-07-11 13:24:29.053328 7fe6f250fc80 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:24:29.053358 I | mkfs-osd5: 2017-07-11 13:24:29.053349 7fe6f250fc80 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:24:29.053391 I | mkfs-osd5: 2017-07-11 13:24:29.053381 7fe6f250fc80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:24:29.053412 I | mkfs-osd5: 2017-07-11 13:24:29.053404 7fe6f250fc80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:24:29.053434 I | mkfs-osd5: 2017-07-11 13:24:29.053425 7fe6f250fc80 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:24:29.053474 I | mkfs-osd5: 2017-07-11 13:24:29.053463 7fe6f250fc80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:24:29.053499 I | mkfs-osd5: 2017-07-11 13:24:29.053490 7fe6f250fc80 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:24:29.053520 I | mkfs-osd5: 2017-07-11 13:24:29.053511 7fe6f250fc80 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:24:29.053554 I | mkfs-osd5: 2017-07-11 13:24:29.053544 7fe6f250fc80 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:24:29.053579 I | mkfs-osd5: 2017-07-11 13:24:29.053568 7fe6f250fc80 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:24:29.053601 I | mkfs-osd5: 2017-07-11 13:24:29.053592 7fe6f250fc80 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:24:29.053636 I | mkfs-osd5: 2017-07-11 13:24:29.053626 7fe6f250fc80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:24:29.053658 I | mkfs-osd5: 2017-07-11 13:24:29.053649 7fe6f250fc80 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:24:29.053678 I | mkfs-osd5: 2017-07-11 13:24:29.053669 7fe6f250fc80 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:24:29.053712 I | mkfs-osd5: 2017-07-11 13:24:29.053702 7fe6f250fc80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:24:29.053735 I | mkfs-osd5: 2017-07-11 13:24:29.053726 7fe6f250fc80 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:24:29.053756 I | mkfs-osd5: 2017-07-11 13:24:29.053747 7fe6f250fc80 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:24:29.053790 I | mkfs-osd5: 2017-07-11 13:24:29.053780 7fe6f250fc80 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:24:29.053811 I | mkfs-osd5: 2017-07-11 13:24:29.053802 7fe6f250fc80 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:24:29.053833 I | mkfs-osd5: 2017-07-11 13:24:29.053824 7fe6f250fc80 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:24:29.053866 I | mkfs-osd5: 2017-07-11 13:24:29.053856 7fe6f250fc80 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:24:29.053887 I | mkfs-osd5: 2017-07-11 13:24:29.053878 7fe6f250fc80 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:24:29.053910 I | mkfs-osd5: 2017-07-11 13:24:29.053901 7fe6f250fc80 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:24:29.061376 I | mkfs-osd5: 2017-07-11 13:24:29.061354 7fe6f250fc80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001
- 2017-07-11 13:24:29.061414 I | mkfs-osd5:
- 2017-07-11 13:24:29.061599 I | mkfs-osd5: 2017-07-11 13:24:29.061538 7fe6f250fc80 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:24:29.061618 I | mkfs-osd5:
- 2017-07-11 13:24:29.061658 I | mkfs-osd5: 2017-07-11 13:24:29.061645 7fe6f250fc80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:24:29.061686 I | mkfs-osd5: 2017-07-11 13:24:29.061673 7fe6f250fc80 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:24:29.061722 I | mkfs-osd5: 2017-07-11 13:24:29.061700 7fe6f250fc80 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:24:29.061747 I | mkfs-osd5: 2017-07-11 13:24:29.061737 7fe6f250fc80 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:24:29.061769 I | mkfs-osd5: 2017-07-11 13:24:29.061760 7fe6f250fc80 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:24:29.061805 I | mkfs-osd5: 2017-07-11 13:24:29.061782 7fe6f250fc80 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:24:29.061848 I | mkfs-osd5: 2017-07-11 13:24:29.061833 7fe6f250fc80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562c88a92218)
- 2017-07-11 13:24:29.061861 I | mkfs-osd5: cache_index_and_filter_blocks: 0
- 2017-07-11 13:24:29.061897 I | mkfs-osd5: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:24:29.061908 I | mkfs-osd5: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:24:29.061918 I | mkfs-osd5: index_type: 0
- 2017-07-11 13:24:29.061928 I | mkfs-osd5: hash_index_allow_collision: 1
- 2017-07-11 13:24:29.061938 I | mkfs-osd5: checksum: 1
- 2017-07-11 13:24:29.061948 I | mkfs-osd5: no_block_cache: 0
- 2017-07-11 13:24:29.061979 I | mkfs-osd5: block_cache: 0x562c88ab8380
- 2017-07-11 13:24:29.061989 I | mkfs-osd5: block_cache_name: LRUCache
- 2017-07-11 13:24:29.061999 I | mkfs-osd5: block_cache_options:
- 2017-07-11 13:24:29.062009 I | mkfs-osd5: capacity : 107374182
- 2017-07-11 13:24:29.062018 I | mkfs-osd5: num_shard_bits : 4
- 2017-07-11 13:24:29.062027 I | mkfs-osd5: strict_capacity_limit : 0
- 2017-07-11 13:24:29.062046 I | mkfs-osd5: high_pri_pool_ratio: 0.000
- 2017-07-11 13:24:29.062105 I | mkfs-osd5: block_cache_compressed: (nil)
- 2017-07-11 13:24:29.062131 I | mkfs-osd5: persistent_cache: (nil)
- 2017-07-11 13:24:29.062141 I | mkfs-osd5: block_size: 4096
- 2017-07-11 13:24:29.062150 I | mkfs-osd5: block_size_deviation: 10
- 2017-07-11 13:24:29.062160 I | mkfs-osd5: block_restart_interval: 16
- 2017-07-11 13:24:29.062169 I | mkfs-osd5: index_block_restart_interval: 1
- 2017-07-11 13:24:29.062178 I | mkfs-osd5: filter_policy: nullptr
- 2017-07-11 13:24:29.062200 I | mkfs-osd5: whole_key_filtering: 1
- 2017-07-11 13:24:29.062211 I | mkfs-osd5: format_version: 2
- 2017-07-11 13:24:29.062220 I | mkfs-osd5:
- 2017-07-11 13:24:29.062244 I | mkfs-osd5: 2017-07-11 13:24:29.062232 7fe6f250fc80 4 rocksdb: Options.write_buffer_size: 67108864
- 2017-07-11 13:24:29.062278 I | mkfs-osd5: 2017-07-11 13:24:29.062257 7fe6f250fc80 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:24:29.062302 I | mkfs-osd5: 2017-07-11 13:24:29.062293 7fe6f250fc80 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:24:29.062333 I | mkfs-osd5: 2017-07-11 13:24:29.062323 7fe6f250fc80 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:24:29.062371 I | mkfs-osd5: 2017-07-11 13:24:29.062360 7fe6f250fc80 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:24:29.062397 I | mkfs-osd5: 2017-07-11 13:24:29.062387 7fe6f250fc80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:24:29.062418 I | mkfs-osd5: 2017-07-11 13:24:29.062409 7fe6f250fc80 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:24:29.062455 I | mkfs-osd5: 2017-07-11 13:24:29.062444 7fe6f250fc80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:24:29.062478 I | mkfs-osd5: 2017-07-11 13:24:29.062469 7fe6f250fc80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:24:29.062523 I | mkfs-osd5: 2017-07-11 13:24:29.062512 7fe6f250fc80 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:24:29.062547 I | mkfs-osd5: 2017-07-11 13:24:29.062537 7fe6f250fc80 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:24:29.062568 I | mkfs-osd5: 2017-07-11 13:24:29.062559 7fe6f250fc80 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:24:29.062602 I | mkfs-osd5: 2017-07-11 13:24:29.062592 7fe6f250fc80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:24:29.062623 I | mkfs-osd5: 2017-07-11 13:24:29.062615 7fe6f250fc80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:24:29.062644 I | mkfs-osd5: 2017-07-11 13:24:29.062635 7fe6f250fc80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:24:29.062682 I | mkfs-osd5: 2017-07-11 13:24:29.062672 7fe6f250fc80 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:24:29.062704 I | mkfs-osd5: 2017-07-11 13:24:29.062695 7fe6f250fc80 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:24:29.062725 I | mkfs-osd5: 2017-07-11 13:24:29.062716 7fe6f250fc80 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:24:29.062759 I | mkfs-osd5: 2017-07-11 13:24:29.062749 7fe6f250fc80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:24:29.062781 I | mkfs-osd5: 2017-07-11 13:24:29.062772 7fe6f250fc80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:24:29.062804 I | mkfs-osd5: 2017-07-11 13:24:29.062793 7fe6f250fc80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:24:29.062839 I | mkfs-osd5: 2017-07-11 13:24:29.062829 7fe6f250fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:24:29.062862 I | mkfs-osd5: 2017-07-11 13:24:29.062853 7fe6f250fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:24:29.062883 I | mkfs-osd5: 2017-07-11 13:24:29.062874 7fe6f250fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:24:29.062916 I | mkfs-osd5: 2017-07-11 13:24:29.062906 7fe6f250fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:24:29.062939 I | mkfs-osd5: 2017-07-11 13:24:29.062929 7fe6f250fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:24:29.062962 I | mkfs-osd5: 2017-07-11 13:24:29.062953 7fe6f250fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:24:29.062995 I | mkfs-osd5: 2017-07-11 13:24:29.062985 7fe6f250fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:24:29.063017 I | mkfs-osd5: 2017-07-11 13:24:29.063008 7fe6f250fc80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:24:29.063038 I | mkfs-osd5: 2017-07-11 13:24:29.063029 7fe6f250fc80 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:24:29.063071 I | mkfs-osd5: 2017-07-11 13:24:29.063061 7fe6f250fc80 4 rocksdb: Options.arena_block_size: 8388608
- 2017-07-11 13:24:29.063093 I | mkfs-osd5: 2017-07-11 13:24:29.063084 7fe6f250fc80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:24:29.063113 I | mkfs-osd5: 2017-07-11 13:24:29.063104 7fe6f250fc80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:24:29.063148 I | mkfs-osd5: 2017-07-11 13:24:29.063137 7fe6f250fc80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:24:29.063170 I | mkfs-osd5: 2017-07-11 13:24:29.063161 7fe6f250fc80 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:24:29.063193 I | mkfs-osd5: 2017-07-11 13:24:29.063184 7fe6f250fc80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:24:29.063229 I | mkfs-osd5: 2017-07-11 13:24:29.063219 7fe6f250fc80 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:24:29.063251 I | mkfs-osd5: 2017-07-11 13:24:29.063242 7fe6f250fc80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:24:29.063276 I | mkfs-osd5: 2017-07-11 13:24:29.063267 7fe6f250fc80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:24:29.063311 I | mkfs-osd5: 2017-07-11 13:24:29.063301 7fe6f250fc80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:24:29.063333 I | mkfs-osd5: 2017-07-11 13:24:29.063324 7fe6f250fc80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:24:29.063354 I | mkfs-osd5: 2017-07-11 13:24:29.063345 7fe6f250fc80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:24:29.063388 I | mkfs-osd5: 2017-07-11 13:24:29.063378 7fe6f250fc80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:24:29.063411 I | mkfs-osd5: 2017-07-11 13:24:29.063402 7fe6f250fc80 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:24:29.063433 I | mkfs-osd5: 2017-07-11 13:24:29.063424 7fe6f250fc80 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:24:29.063466 I | mkfs-osd5: 2017-07-11 13:24:29.063456 7fe6f250fc80 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:24:29.063490 I | mkfs-osd5: 2017-07-11 13:24:29.063480 7fe6f250fc80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:24:29.063512 I | mkfs-osd5: 2017-07-11 13:24:29.063503 7fe6f250fc80 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:24:29.063545 I | mkfs-osd5: 2017-07-11 13:24:29.063535 7fe6f250fc80 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:24:29.063567 I | mkfs-osd5: 2017-07-11 13:24:29.063558 7fe6f250fc80 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:24:29.063588 I | mkfs-osd5: 2017-07-11 13:24:29.063579 7fe6f250fc80 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:24:29.063623 I | mkfs-osd5: 2017-07-11 13:24:29.063611 7fe6f250fc80 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:24:29.063647 I | mkfs-osd5: 2017-07-11 13:24:29.063638 7fe6f250fc80 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:24:29.063668 I | mkfs-osd5: 2017-07-11 13:24:29.063659 7fe6f250fc80 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:24:29.071960 I | mkfs-osd5: 2017-07-11 13:24:29.071930 7fe6f250fc80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/osd5/current/omap/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:24:29.072001 I | mkfs-osd5:
- 2017-07-11 13:24:29.072031 I | mkfs-osd5: 2017-07-11 13:24:29.072018 7fe6f250fc80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 0
- 2017-07-11 13:24:29.072044 I | mkfs-osd5:
- 2017-07-11 13:24:29.072125 I | mkfs-osd5: 2017-07-11 13:24:29.072110 7fe6f250fc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779469072107, "job": 1, "event": "recovery_started", "log_files": [3]}
- 2017-07-11 13:24:29.072206 I | mkfs-osd5: 2017-07-11 13:24:29.072193 7fe6f250fc80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #3 mode 2
- 2017-07-11 13:24:29.072346 I | mkfs-osd5: 2017-07-11 13:24:29.072331 7fe6f250fc80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 5
- 2017-07-11 13:24:29.072363 I | mkfs-osd5:
- 2017-07-11 13:24:29.162543 I | mkfs-osd5: 2017-07-11 13:24:29.162522 7fe6f250fc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779469162520, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:24:29.231867 I | mkfs-osd5: 2017-07-11 13:24:29.231822 7fe6f250fc80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x562c88d48000
- 2017-07-11 13:24:29.232050 I | mkfs-osd5: 2017-07-11 13:24:29.232032 7fe6f250fc80 0 filestore(/var/lib/rook/osd5) mount(1717): enabling WRITEAHEAD journal mode: checkpoint is not enabled
- 2017-07-11 13:24:29.232180 I | mkfs-osd5: 2017-07-11 13:24:29.232126 7fe6f250fc80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:29.234260 I | mkfs-osd5: 2017-07-11 13:24:29.234233 7fe6f250fc80 -1 filestore(/var/lib/rook/osd5) could not find #-1:7b3f43c4:::osd_superblock:0# in index: (2) No such file or directory
- 2017-07-11 13:24:30.210626 I | mkfs-osd5: 2017-07-11 13:24:30.210467 7fe6f250fc80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:217] Shutdown: canceling all background work
- 2017-07-11 13:24:30.213945 I | mkfs-osd5: 2017-07-11 13:24:30.210577 7fe6f250fc80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:343] Shutdown complete
- 2017-07-11 13:24:30.230098 I | mkfs-osd5: 2017-07-11 13:24:30.229843 7fe6f250fc80 -1 created object store /var/lib/rook/osd5 for osd.5 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:24:30.230133 I | mkfs-osd5: 2017-07-11 13:24:30.229888 7fe6f250fc80 -1 auth: error reading file: /var/lib/rook/osd5/keyring: can't open /var/lib/rook/osd5/keyring: (2) No such file or directory
- 2017-07-11 13:24:30.230149 I | mkfs-osd5: 2017-07-11 13:24:30.229981 7fe6f250fc80 -1 created new key in keyring /var/lib/rook/osd5/keyring
- 2017-07-11 13:24:30.241370 I | mkfs-osd5: 2017-07-11 13:24:26.569837 7fe6f250fc80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:30.241419 I | mkfs-osd5: 2017-07-11 13:24:29.232126 7fe6f250fc80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:30.241435 I | mkfs-osd5: 2017-07-11 13:24:29.234233 7fe6f250fc80 -1 filestore(/var/lib/rook/osd5) could not find #-1:7b3f43c4:::osd_superblock:0# in index: (2) No such file or directory
- 2017-07-11 13:24:30.241446 I | mkfs-osd5: 2017-07-11 13:24:30.229843 7fe6f250fc80 -1 created object store /var/lib/rook/osd5 for osd.5 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:24:30.241456 I | mkfs-osd5: 2017-07-11 13:24:30.229888 7fe6f250fc80 -1 auth: error reading file: /var/lib/rook/osd5/keyring: can't open /var/lib/rook/osd5/keyring: (2) No such file or directory
- 2017-07-11 13:24:30.241467 I | mkfs-osd5: 2017-07-11 13:24:30.229981 7fe6f250fc80 -1 created new key in keyring /var/lib/rook/osd5/keyring
- 2017-07-11 13:24:30.241597 I | exec: Running command: ceph auth add osd.5 -i /var/lib/rook/osd5/keyring osd allow * mon allow profile osd --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/484891978
- 2017-07-11 13:24:32.000969 I | exec: added key for osd.5
- 2017-07-11 13:24:32.001187 I | cephosd: adding osd.5 (/var/lib/rook/osd5), bytes: 104022159360, weight: 0.0946, to crush map at 'root=default'
- 2017-07-11 13:24:32.001359 I | exec: Running command: ceph osd crush create-or-move 5 0.0946 root=default --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/118853665
- 2017-07-11 13:24:33.885655 I | exec: create-or-move updating item name 'osd.5' weight 0.0946 at location {root=default} to crush map
- 2017-07-11 13:24:33.885815 I | cephosd: starting osd 5 at /var/lib/rook/osd5
- 2017-07-11 13:24:33.885888 I | cephosd: Config file /var/lib/rook/osd5/rook.config:
- [global]
- enable experimental unrecoverable data corrupting features =
- run dir = /var/lib/rook/osd5
- mon initial members = rook-ceph-mon1 rook-ceph-mon2 rook-ceph-mon0
- log file = /dev/stdout
- mon cluster log file = /dev/stdout
- mon keyvaluedb = rocksdb
- debug default = 0
- debug rados = 0
- debug mon = 0
- debug osd = 0
- debug bluestore = 0
- debug filestore = 0
- debug journal = 0
- debug leveldb = 0
- filestore_omap_backend = rocksdb
- osd pg bits = 11
- osd pgp bits = 11
- osd pool default size = 1
- osd pool default min size = 1
- osd pool default pg num = 100
- osd pool default pgp num = 100
- osd max object name len = 256
- osd max object namespace len = 64
- osd objectstore = filestore
- rbd_default_features = 3
- fatal signal handlers = false
- [osd.5]
- keyring = /var/lib/rook/osd5/keyring
- osd journal size = 1024
- [mon.rook-ceph-mon1]
- name = rook-ceph-mon1
- mon addr = 10.233.99.4:6790
- [mon.rook-ceph-mon2]
- name = rook-ceph-mon2
- mon addr = 10.233.124.3:6790
- [mon.rook-ceph-mon0]
- name = rook-ceph-mon0
- mon addr = 10.233.76.3:6790
- 2017-07-11 13:24:33.886431 I | proc: no existing process found for binary ceph-osd and pattern '--osd-uuid=9771b2a8-0591-4ce0-ba50-846d5c052724'
- 2017-07-11 13:24:33.886473 I | proc: Starting process osd5 with args: [--foreground --id=5 --cluster=rook --osd-data=/var/lib/rook/osd5 --conf=/var/lib/rook/osd5/rook.config --keyring=/var/lib/rook/osd5/keyring --osd-uuid=9771b2a8-0591-4ce0-ba50-846d5c052724 --osd-journal=/var/lib/rook/osd5/journal]
- 2017-07-11 13:24:33.886492 I | exec: Running command: ceph-osd --foreground --id=5 --cluster=rook --osd-data=/var/lib/rook/osd5 --conf=/var/lib/rook/osd5/rook.config --keyring=/var/lib/rook/osd5/keyring --osd-uuid=9771b2a8-0591-4ce0-ba50-846d5c052724 --osd-journal=/var/lib/rook/osd5/journal
- 2017-07-11 13:24:33.886951 I | cephosd: 1/1 osd dirs succeeded on this node
- 2017-07-11 13:24:33.887043 I | sleeping a while to let the osds run...
- 2017-07-11 13:24:33.944972 I | osd5: 2017-07-11 13:24:33.944917 7f408b507c80 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 179
- 2017-07-11 13:24:33.954199 I | osd5: starting osd.5 at - osd_data /var/lib/rook/osd5 /var/lib/rook/osd5/journal
- 2017-07-11 13:24:33.954489 I | osd5: 2017-07-11 13:24:33.954474 7f408b507c80 0 pidfile_write: ignore empty --pid-file
- 2017-07-11 13:24:34.246105 I | osd5: 2017-07-11 13:24:34.246058 7f408b507c80 0 load: jerasure load: lrc load: isa
- 2017-07-11 13:24:34.255006 I | osd5: 2017-07-11 13:24:34.254982 7f408b507c80 0 filestore(/var/lib/rook/osd5) backend generic (magic 0xef53)
- 2017-07-11 13:24:34.255617 I | osd5: 2017-07-11 13:24:34.255597 7f408b507c80 0 filestore(/var/lib/rook/osd5) backend generic (magic 0xef53)
- 2017-07-11 13:24:34.255925 I | osd5: 2017-07-11 13:24:34.255905 7f408b507c80 0 genericfilestorebackend(/var/lib/rook/osd5) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
- 2017-07-11 13:24:34.255977 I | osd5: 2017-07-11 13:24:34.255960 7f408b507c80 0 genericfilestorebackend(/var/lib/rook/osd5) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option
- 2017-07-11 13:24:34.256004 I | osd5: 2017-07-11 13:24:34.255993 7f408b507c80 0 genericfilestorebackend(/var/lib/rook/osd5) detect_features: splice() is disabled via 'filestore splice' config option
- 2017-07-11 13:24:34.441494 I | osd5: 2017-07-11 13:24:34.441426 7f408b507c80 0 genericfilestorebackend(/var/lib/rook/osd5) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
- 2017-07-11 13:24:34.631851 I | osd5: 2017-07-11 13:24:34.631828 7f408b507c80 0 filestore(/var/lib/rook/osd5) limited size xattrs
- 2017-07-11 13:24:34.632272 I | osd5: 2017-07-11 13:24:34.632232 7f408b507c80 0 filestore(/var/lib/rook/osd5) start omap initiation
- 2017-07-11 13:24:34.633843 I | osd5: 2017-07-11 13:24:34.633826 7f408b507c80 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:24:34.633872 I | osd5:
- 2017-07-11 13:24:34.633914 I | osd5: 2017-07-11 13:24:34.633896 7f408b507c80 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:24:34.633955 I | osd5: 2017-07-11 13:24:34.633930 7f408b507c80 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:24:34.633981 I | osd5: 2017-07-11 13:24:34.633970 7f408b507c80 4 rocksdb: DB SUMMARY
- 2017-07-11 13:24:34.633993 I | osd5:
- 2017-07-11 13:24:34.634079 I | osd5: 2017-07-11 13:24:34.634065 7f408b507c80 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:24:34.634109 I | osd5:
- 2017-07-11 13:24:34.634134 I | osd5: 2017-07-11 13:24:34.634123 7f408b507c80 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:24:34.634145 I | osd5:
- 2017-07-11 13:24:34.634191 I | osd5: 2017-07-11 13:24:34.634164 7f408b507c80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes
- 2017-07-11 13:24:34.634206 I | osd5:
- 2017-07-11 13:24:34.634230 I | osd5: 2017-07-11 13:24:34.634219 7f408b507c80 4 rocksdb: SST files in /var/lib/rook/osd5/current/omap dir, Total Num: 0, files:
- 2017-07-11 13:24:34.634247 I | osd5:
- 2017-07-11 13:24:34.634286 I | osd5: 2017-07-11 13:24:34.634273 7f408b507c80 4 rocksdb: Write Ahead Log file in /var/lib/rook/osd5/current/omap: 000006.log size: 98 ;
- 2017-07-11 13:24:34.634299 I | osd5:
- 2017-07-11 13:24:34.634321 I | osd5: 2017-07-11 13:24:34.634311 7f408b507c80 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:24:34.634357 I | osd5: 2017-07-11 13:24:34.634346 7f408b507c80 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:24:34.634380 I | osd5: 2017-07-11 13:24:34.634371 7f408b507c80 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:24:34.634401 I | osd5: 2017-07-11 13:24:34.634392 7f408b507c80 4 rocksdb: Options.env: 0x562f732b18e0
- 2017-07-11 13:24:34.634437 I | osd5: 2017-07-11 13:24:34.634427 7f408b507c80 4 rocksdb: Options.info_log: 0x562f746e8560
- 2017-07-11 13:24:34.634461 I | osd5: 2017-07-11 13:24:34.634451 7f408b507c80 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:24:34.634521 I | osd5: 2017-07-11 13:24:34.634510 7f408b507c80 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:24:34.634547 I | osd5: 2017-07-11 13:24:34.634537 7f408b507c80 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:24:34.634570 I | osd5: 2017-07-11 13:24:34.634561 7f408b507c80 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:24:34.634609 I | osd5: 2017-07-11 13:24:34.634597 7f408b507c80 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:24:34.634633 I | osd5: 2017-07-11 13:24:34.634623 7f408b507c80 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:24:34.634656 I | osd5: 2017-07-11 13:24:34.634646 7f408b507c80 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:24:34.634695 I | osd5: 2017-07-11 13:24:34.634684 7f408b507c80 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:24:34.634719 I | osd5: 2017-07-11 13:24:34.634709 7f408b507c80 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:24:34.634757 I | osd5: 2017-07-11 13:24:34.634732 7f408b507c80 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:24:34.634782 I | osd5: 2017-07-11 13:24:34.634772 7f408b507c80 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:24:34.634806 I | osd5: 2017-07-11 13:24:34.634796 7f408b507c80 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:24:34.634852 I | osd5: 2017-07-11 13:24:34.634842 7f408b507c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:24:34.634883 I | osd5: 2017-07-11 13:24:34.634873 7f408b507c80 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:24:34.634922 I | osd5: 2017-07-11 13:24:34.634897 7f408b507c80 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:24:34.634958 I | osd5: 2017-07-11 13:24:34.634936 7f408b507c80 4 rocksdb: Options.wal_dir: /var/lib/rook/osd5/current/omap
- 2017-07-11 13:24:34.635015 I | osd5: 2017-07-11 13:24:34.634974 7f408b507c80 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:24:34.635048 I | osd5: 2017-07-11 13:24:34.635035 7f408b507c80 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:24:34.635099 I | osd5: 2017-07-11 13:24:34.635088 7f408b507c80 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:24:34.635122 I | osd5: 2017-07-11 13:24:34.635113 7f408b507c80 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:24:34.635159 I | osd5: 2017-07-11 13:24:34.635134 7f408b507c80 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:24:34.635183 I | osd5: 2017-07-11 13:24:34.635173 7f408b507c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:24:34.635205 I | osd5: 2017-07-11 13:24:34.635195 7f408b507c80 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:24:34.635239 I | osd5: 2017-07-11 13:24:34.635229 7f408b507c80 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:24:34.651023 I | osd5: 2017-07-11 13:24:34.650999 7f408b507c80 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:24:34.651079 I | osd5: 2017-07-11 13:24:34.651058 7f408b507c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:24:34.651108 I | osd5: 2017-07-11 13:24:34.651097 7f408b507c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:24:34.651157 I | osd5: 2017-07-11 13:24:34.651134 7f408b507c80 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:24:34.651185 I | osd5: 2017-07-11 13:24:34.651172 7f408b507c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:24:34.651236 I | osd5: 2017-07-11 13:24:34.651224 7f408b507c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:24:34.651261 I | osd5: 2017-07-11 13:24:34.651251 7f408b507c80 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:24:34.651301 I | osd5: 2017-07-11 13:24:34.651275 7f408b507c80 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:24:34.651328 I | osd5: 2017-07-11 13:24:34.651317 7f408b507c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:24:34.651351 I | osd5: 2017-07-11 13:24:34.651341 7f408b507c80 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:24:34.651391 I | osd5: 2017-07-11 13:24:34.651379 7f408b507c80 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:24:34.651416 I | osd5: 2017-07-11 13:24:34.651405 7f408b507c80 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:24:34.651439 I | osd5: 2017-07-11 13:24:34.651429 7f408b507c80 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:24:34.651477 I | osd5: 2017-07-11 13:24:34.651466 7f408b507c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:24:34.651501 I | osd5: 2017-07-11 13:24:34.651491 7f408b507c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:24:34.651546 I | osd5: 2017-07-11 13:24:34.651536 7f408b507c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:24:34.651569 I | osd5: 2017-07-11 13:24:34.651560 7f408b507c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:24:34.651595 I | osd5: 2017-07-11 13:24:34.651586 7f408b507c80 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:24:34.651632 I | osd5: 2017-07-11 13:24:34.651621 7f408b507c80 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:24:34.651654 I | osd5: 2017-07-11 13:24:34.651645 7f408b507c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:24:34.651677 I | osd5: 2017-07-11 13:24:34.651668 7f408b507c80 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:24:34.651714 I | osd5: 2017-07-11 13:24:34.651704 7f408b507c80 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:24:34.651736 I | osd5: 2017-07-11 13:24:34.651727 7f408b507c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:24:34.651769 I | osd5: 2017-07-11 13:24:34.651748 7f408b507c80 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:24:34.651792 I | osd5: 2017-07-11 13:24:34.651782 7f408b507c80 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:24:34.651815 I | osd5: 2017-07-11 13:24:34.651804 7f408b507c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:24:34.651849 I | osd5: 2017-07-11 13:24:34.651827 7f408b507c80 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:24:34.651872 I | osd5: 2017-07-11 13:24:34.651862 7f408b507c80 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:24:34.651900 I | osd5: 2017-07-11 13:24:34.651884 7f408b507c80 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:24:34.651937 I | osd5: 2017-07-11 13:24:34.651927 7f408b507c80 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:24:34.651961 I | osd5: 2017-07-11 13:24:34.651951 7f408b507c80 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:24:34.651982 I | osd5: 2017-07-11 13:24:34.651973 7f408b507c80 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:24:34.652016 I | osd5: 2017-07-11 13:24:34.652006 7f408b507c80 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:24:34.652041 I | osd5: 2017-07-11 13:24:34.652031 7f408b507c80 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:24:34.652411 I | osd5: 2017-07-11 13:24:34.652391 7f408b507c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000005
- 2017-07-11 13:24:34.652443 I | osd5:
- 2017-07-11 13:24:34.652650 I | osd5: 2017-07-11 13:24:34.652580 7f408b507c80 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:24:34.652681 I | osd5:
- 2017-07-11 13:24:34.652709 I | osd5: 2017-07-11 13:24:34.652697 7f408b507c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:24:34.652732 I | osd5: 2017-07-11 13:24:34.652723 7f408b507c80 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:24:34.652773 I | osd5: 2017-07-11 13:24:34.652758 7f408b507c80 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:24:34.652811 I | osd5: 2017-07-11 13:24:34.652789 7f408b507c80 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:24:34.652848 I | osd5: 2017-07-11 13:24:34.652838 7f408b507c80 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:24:34.652872 I | osd5: 2017-07-11 13:24:34.652863 7f408b507c80 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:24:34.652935 I | osd5: 2017-07-11 13:24:34.652918 7f408b507c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562f7435c1e0)
- 2017-07-11 13:24:34.652950 I | osd5: cache_index_and_filter_blocks: 0
- 2017-07-11 13:24:34.652960 I | osd5: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:24:34.652971 I | osd5: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:24:34.652994 I | osd5: index_type: 0
- 2017-07-11 13:24:34.653006 I | osd5: hash_index_allow_collision: 1
- 2017-07-11 13:24:34.653016 I | osd5: checksum: 1
- 2017-07-11 13:24:34.653026 I | osd5: no_block_cache: 0
- 2017-07-11 13:24:34.653036 I | osd5: block_cache: 0x562f74382620
- 2017-07-11 13:24:34.653069 I | osd5: block_cache_name: LRUCache
- 2017-07-11 13:24:34.653081 I | osd5: block_cache_options:
- 2017-07-11 13:24:34.653092 I | osd5: capacity : 107374182
- 2017-07-11 13:24:34.653102 I | osd5: num_shard_bits : 4
- 2017-07-11 13:24:34.653123 I | osd5: strict_capacity_limit : 0
- 2017-07-11 13:24:34.653145 I | osd5: high_pri_pool_ratio: 0.000
- 2017-07-11 13:24:34.653157 I | osd5: block_cache_compressed: (nil)
- 2017-07-11 13:24:34.653167 I | osd5: persistent_cache: (nil)
- 2017-07-11 13:24:34.653177 I | osd5: block_size: 4096
- 2017-07-11 13:24:34.653187 I | osd5: block_size_deviation: 10
- 2017-07-11 13:24:34.653197 I | osd5: block_restart_interval: 16
- 2017-07-11 13:24:34.653209 I | osd5: index_block_restart_interval: 1
- 2017-07-11 13:24:34.653233 I | osd5: filter_policy: nullptr
- 2017-07-11 13:24:34.653244 I | osd5: whole_key_filtering: 1
- 2017-07-11 13:24:34.653254 I | osd5: format_version: 2
- 2017-07-11 13:24:34.653263 I | osd5:
- 2017-07-11 13:24:34.653301 I | osd5: 2017-07-11 13:24:34.653276 7f408b507c80 4 rocksdb: Options.write_buffer_size: 67108864
- 2017-07-11 13:24:34.653328 I | osd5: 2017-07-11 13:24:34.653318 7f408b507c80 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:24:34.653352 I | osd5: 2017-07-11 13:24:34.653343 7f408b507c80 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:24:34.653390 I | osd5: 2017-07-11 13:24:34.653379 7f408b507c80 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:24:34.653425 I | osd5: 2017-07-11 13:24:34.653404 7f408b507c80 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:24:34.653465 I | osd5: 2017-07-11 13:24:34.653439 7f408b507c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:24:34.653499 I | osd5: 2017-07-11 13:24:34.653487 7f408b507c80 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:24:34.653537 I | osd5: 2017-07-11 13:24:34.653513 7f408b507c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:24:34.653563 I | osd5: 2017-07-11 13:24:34.653552 7f408b507c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:24:34.653587 I | osd5: 2017-07-11 13:24:34.653577 7f408b507c80 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:24:34.653636 I | osd5: 2017-07-11 13:24:34.653614 7f408b507c80 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:24:34.653663 I | osd5: 2017-07-11 13:24:34.653653 7f408b507c80 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:24:34.653713 I | osd5: 2017-07-11 13:24:34.653690 7f408b507c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:24:34.653746 I | osd5: 2017-07-11 13:24:34.653737 7f408b507c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:24:34.653781 I | osd5: 2017-07-11 13:24:34.653771 7f408b507c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:24:34.653803 I | osd5: 2017-07-11 13:24:34.653794 7f408b507c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:24:34.653824 I | osd5: 2017-07-11 13:24:34.653815 7f408b507c80 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:24:34.653860 I | osd5: 2017-07-11 13:24:34.653848 7f408b507c80 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:24:34.653884 I | osd5: 2017-07-11 13:24:34.653875 7f408b507c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:24:34.653905 I | osd5: 2017-07-11 13:24:34.653896 7f408b507c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:24:34.653942 I | osd5: 2017-07-11 13:24:34.653930 7f408b507c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:24:34.653965 I | osd5: 2017-07-11 13:24:34.653956 7f408b507c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:24:34.653986 I | osd5: 2017-07-11 13:24:34.653977 7f408b507c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:24:34.654022 I | osd5: 2017-07-11 13:24:34.654012 7f408b507c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:24:34.654044 I | osd5: 2017-07-11 13:24:34.654035 7f408b507c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:24:34.654065 I | osd5: 2017-07-11 13:24:34.654056 7f408b507c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:24:34.654100 I | osd5: 2017-07-11 13:24:34.654090 7f408b507c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:24:34.654123 I | osd5: 2017-07-11 13:24:34.654113 7f408b507c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:24:34.654156 I | osd5: 2017-07-11 13:24:34.654135 7f408b507c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:24:34.654179 I | osd5: 2017-07-11 13:24:34.654169 7f408b507c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:24:34.654200 I | osd5: 2017-07-11 13:24:34.654191 7f408b507c80 4 rocksdb: Options.arena_block_size: 8388608
- 2017-07-11 13:24:34.654245 I | osd5: 2017-07-11 13:24:34.654213 7f408b507c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:24:34.654270 I | osd5: 2017-07-11 13:24:34.654260 7f408b507c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:24:34.654292 I | osd5: 2017-07-11 13:24:34.654282 7f408b507c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:24:34.654327 I | osd5: 2017-07-11 13:24:34.654317 7f408b507c80 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:24:34.654352 I | osd5: 2017-07-11 13:24:34.654342 7f408b507c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:24:34.654374 I | osd5: 2017-07-11 13:24:34.654365 7f408b507c80 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:24:34.654413 I | osd5: 2017-07-11 13:24:34.654402 7f408b507c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:24:34.654445 I | osd5: 2017-07-11 13:24:34.654434 7f408b507c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:24:34.654496 I | osd5: 2017-07-11 13:24:34.654485 7f408b507c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:24:34.654520 I | osd5: 2017-07-11 13:24:34.654510 7f408b507c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:24:34.654559 I | osd5: 2017-07-11 13:24:34.654534 7f408b507c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:24:34.654589 I | osd5: 2017-07-11 13:24:34.654576 7f408b507c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:24:34.654613 I | osd5: 2017-07-11 13:24:34.654602 7f408b507c80 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:24:34.654652 I | osd5: 2017-07-11 13:24:34.654641 7f408b507c80 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:24:34.654677 I | osd5: 2017-07-11 13:24:34.654666 7f408b507c80 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:24:34.654717 I | osd5: 2017-07-11 13:24:34.654691 7f408b507c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:24:34.654743 I | osd5: 2017-07-11 13:24:34.654732 7f408b507c80 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:24:34.654766 I | osd5: 2017-07-11 13:24:34.654756 7f408b507c80 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:24:34.654812 I | osd5: 2017-07-11 13:24:34.654791 7f408b507c80 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:24:34.654834 I | osd5: 2017-07-11 13:24:34.654825 7f408b507c80 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:24:34.654869 I | osd5: 2017-07-11 13:24:34.654847 7f408b507c80 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:24:34.654891 I | osd5: 2017-07-11 13:24:34.654882 7f408b507c80 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:24:34.654913 I | osd5: 2017-07-11 13:24:34.654904 7f408b507c80 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:24:34.661311 I | osd5: 2017-07-11 13:24:34.661283 7f408b507c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/osd5/current/omap/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:24:34.661320 I | osd5:
- 2017-07-11 13:24:34.661347 I | osd5: 2017-07-11 13:24:34.661333 7f408b507c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 4
- 2017-07-11 13:24:34.661352 I | osd5:
- 2017-07-11 13:24:34.661425 I | osd5: 2017-07-11 13:24:34.661398 7f408b507c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779474661394, "job": 1, "event": "recovery_started", "log_files": [6]}
- 2017-07-11 13:24:34.661446 I | osd5: 2017-07-11 13:24:34.661436 7f408b507c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #6 mode 2
- 2017-07-11 13:24:34.772253 I | osd5: 2017-07-11 13:24:34.772222 7f408b507c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779474772212, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 882, "table_properties": {"data_size": 51, "index_size": 27, "filter_size": 0, "raw_key_size": 20, "raw_average_key_size": 20, "raw_value_size": 15, "raw_average_value_size": 15, "num_data_blocks": 1, "num_entries": 1, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:24:34.773650 I | osd5: 2017-07-11 13:24:34.772504 7f408b507c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 8
- 2017-07-11 13:24:34.773682 I | osd5:
- 2017-07-11 13:24:34.847005 I | osd5: 2017-07-11 13:24:34.846895 7f408b507c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779474846892, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:24:34.949814 I | osd5: 2017-07-11 13:24:34.949787 7f408b507c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x562f746fc000
- 2017-07-11 13:24:34.957295 I | osd5: 2017-07-11 13:24:34.950122 7f408b507c80 0 filestore(/var/lib/rook/osd5) mount(1717): enabling WRITEAHEAD journal mode: checkpoint is not enabled
- 2017-07-11 13:24:34.957535 I | osd5: 2017-07-11 13:24:34.957470 7f408b507c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:35.281397 I | osd5: 2017-07-11 13:24:35.281372 7f408b507c80 0 osd.5 0 crush map has features 288232575208783872, adjusting msgr requires for clients
- 2017-07-11 13:24:35.281456 I | osd5: 2017-07-11 13:24:35.281441 7f408b507c80 0 osd.5 0 crush map has features 288232575208783872 was 8705, adjusting msgr requires for mons
- 2017-07-11 13:24:35.281487 I | osd5: 2017-07-11 13:24:35.281475 7f408b507c80 0 osd.5 0 crush map has features 288232575208783872, adjusting msgr requires for osds
- 2017-07-11 13:24:35.281602 I | osd5: 2017-07-11 13:24:35.281586 7f408b507c80 0 osd.5 0 load_pgs
- 2017-07-11 13:24:35.281676 I | osd5: 2017-07-11 13:24:35.281660 7f408b507c80 0 osd.5 0 load_pgs opened 0 pgs
- 2017-07-11 13:24:35.281720 I | osd5: 2017-07-11 13:24:35.281694 7f408b507c80 0 osd.5 0 using 1 op queue with priority op cut off at 64.
- 2017-07-11 13:24:35.282585 I | osd5: 2017-07-11 13:24:35.282562 7f408b507c80 -1 osd.5 0 log_to_monitors {default=true}
- 2017-07-11 13:24:36.670085 I | osd5: 2017-07-11 13:24:36.670004 7f408b507c80 0 osd.5 0 done with init, starting boot process
- 2017-07-11 13:24:36.678953 I | osd5: 2017-07-11 13:24:36.678908 7f4070c71700 -1 osd.5 0 waiting for initial osdmap
- 2017-07-11 13:24:36.809961 I | osd5: 2017-07-11 13:24:36.809550 7f407d48a700 0 osd.5 15 crush map has features 2200130813952, adjusting msgr requires for clients
- 2017-07-11 13:24:36.810004 I | osd5: 2017-07-11 13:24:36.809556 7f407d48a700 0 osd.5 15 crush map has features 2200130813952 was 288232575208792577, adjusting msgr requires for mons
- 2017-07-11 13:24:36.810020 I | osd5: 2017-07-11 13:24:36.809559 7f407d48a700 0 osd.5 15 crush map has features 720578140510109696, adjusting msgr requires for osds
- 2017-07-11 13:24:38.803340 I | osd5: 2017-07-11 13:24:38.803282 7f4083cc0700 0 -- 10.233.99.0:6801/179 >> 10.233.124.4:6801/178 conn(0x562f748f6000 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._process_connection connect claims to be 10.233.124.0:6801/178 not 10.233.124.4:6801/178 - wrong node!
- 2017-07-11 13:24:39.011306 I | osd5: 2017-07-11 13:24:39.011246 7f4083cc0700 0 -- 10.233.99.0:6801/179 >> 10.233.124.4:6801/178 conn(0x562f748f6000 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._process_connection connect claims to be 10.233.124.0:6801/178 not 10.233.124.4:6801/178 - wrong node!
- 2017-07-11 13:24:39.415322 I | osd5: 2017-07-11 13:24:39.415258 7f4083cc0700 0 -- 10.233.99.0:6801/179 >> 10.233.124.4:6801/178 conn(0x562f748f6000 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._process_connection connect claims to be 10.233.124.0:6801/178 not 10.233.124.4:6801/178 - wrong node!
- 2017-07-11 13:24:40.223319 I | osd5: 2017-07-11 13:24:40.223250 7f4083cc0700 0 -- 10.233.99.0:6801/179 >> 10.233.124.4:6801/178 conn(0x562f748f6000 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._process_connection connect claims to be 10.233.124.0:6801/178 not 10.233.124.4:6801/178 - wrong node!
- 2017-07-11 13:24:41.847237 I | osd5: 2017-07-11 13:24:41.831241 7f4083cc0700 0 -- 10.233.99.0:6801/179 >> 10.233.124.4:6801/178 conn(0x562f748f6000 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._process_connection connect claims to be 10.233.124.0:6801/178 not 10.233.124.4:6801/178 - wrong node!
- 2017-07-11 13:24:44.989960 I | osd5: 2017-07-11 13:24:44.989898 7f4083cc0700 0 -- 10.233.99.0:6801/179 >> 10.233.124.4:6801/178 conn(0x562f748f6000 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._process_connection connect claims to be 10.233.124.0:6801/178 not 10.233.124.4:6801/178 - wrong node!
- 2017-07-11 13:24:51.359544 I | osd5: 2017-07-11 13:24:51.359480 7f4083cc0700 0 -- 10.233.99.0:6801/179 >> 10.233.124.4:6801/178 conn(0x562f748f6000 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._process_connection connect claims to be 10.233.124.0:6801/178 not 10.233.124.4:6801/178 - wrong node!
- 2017-07-11 13:24:59.338787 I | osd5: 2017-07-11 13:24:59.338488 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:39.338486)
- 2017-07-11 13:24:59.348625 I | osd5: 2017-07-11 13:24:59.338527 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:39.338486)
- 2017-07-11 13:24:59.348885 I | osd5: 2017-07-11 13:24:59.338535 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:39.338486)
- 2017-07-11 13:25:00.343749 I | osd5: 2017-07-11 13:25:00.343659 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:40.343658)
- 2017-07-11 13:25:00.343809 I | osd5: 2017-07-11 13:25:00.343675 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:40.343658)
- 2017-07-11 13:25:00.343824 I | osd5: 2017-07-11 13:25:00.343678 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:40.343658)
- 2017-07-11 13:25:01.345825 I | osd5: 2017-07-11 13:25:01.345747 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:41.345744)
- 2017-07-11 13:25:01.345911 I | osd5: 2017-07-11 13:25:01.345769 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:41.345744)
- 2017-07-11 13:25:01.345933 I | osd5: 2017-07-11 13:25:01.345772 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:41.345744)
- 2017-07-11 13:25:02.347028 I | osd5: 2017-07-11 13:25:02.346937 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:42.346935)
- 2017-07-11 13:25:02.347113 I | osd5: 2017-07-11 13:25:02.346952 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:42.346935)
- 2017-07-11 13:25:02.347131 I | osd5: 2017-07-11 13:25:02.346956 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:42.346935)
- 2017-07-11 13:25:03.352819 I | osd5: 2017-07-11 13:25:03.352649 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:43.352648)
- 2017-07-11 13:25:03.352900 I | osd5: 2017-07-11 13:25:03.352672 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:43.352648)
- 2017-07-11 13:25:03.352917 I | osd5: 2017-07-11 13:25:03.352680 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:43.352648)
- 2017-07-11 13:25:03.991904 I | osd5: 2017-07-11 13:25:03.991751 7f4083cc0700 0 -- 10.233.99.0:6801/179 >> 10.233.124.4:6801/178 conn(0x562f748f6000 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._process_connection connect claims to be 10.233.124.0:6801/178 not 10.233.124.4:6801/178 - wrong node!
- 2017-07-11 13:25:04.352929 I | osd5: 2017-07-11 13:25:04.352845 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:44.352843)
- 2017-07-11 13:25:04.353025 I | osd5: 2017-07-11 13:25:04.352860 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:44.352843)
- 2017-07-11 13:25:04.353059 I | osd5: 2017-07-11 13:25:04.352863 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:44.352843)
- 2017-07-11 13:25:05.355005 I | osd5: 2017-07-11 13:25:05.354902 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:45.354900)
- 2017-07-11 13:25:05.355655 I | osd5: 2017-07-11 13:25:05.354954 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:45.354900)
- 2017-07-11 13:25:05.355685 I | osd5: 2017-07-11 13:25:05.354958 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:45.354900)
- 2017-07-11 13:25:06.357964 I | osd5: 2017-07-11 13:25:06.357888 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:46.357887)
- 2017-07-11 13:25:06.358170 I | osd5: 2017-07-11 13:25:06.357908 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:46.357887)
- 2017-07-11 13:25:06.358275 I | osd5: 2017-07-11 13:25:06.357911 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:46.357887)
- 2017-07-11 13:25:07.358171 I | osd5: 2017-07-11 13:25:07.358050 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:47.358049)
- 2017-07-11 13:25:07.359648 I | osd5: 2017-07-11 13:25:07.358077 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:47.358049)
- 2017-07-11 13:25:07.359676 I | osd5: 2017-07-11 13:25:07.358086 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:47.358049)
- 2017-07-11 13:25:08.359673 I | osd5: 2017-07-11 13:25:08.358707 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:48.358706)
- 2017-07-11 13:25:08.359760 I | osd5: 2017-07-11 13:25:08.358735 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:48.358706)
- 2017-07-11 13:25:08.359777 I | osd5: 2017-07-11 13:25:08.358742 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:48.358706)
- 2017-07-11 13:25:08.359925 I | osd5: 2017-07-11 13:25:08.359887 7f407fc8f700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.964326 secs
- 2017-07-11 13:25:08.360003 I | osd5: 2017-07-11 13:25:08.359900 7f407fc8f700 0 log_channel(cluster) log [WRN] : slow request 30.964326 seconds old, received at 2017-07-11 13:24:37.395485: osd_pg_create(e16 0.0:2 0.2:2 0.f:2 0.13:2 0.22:2 0.23:2 0.25:2 0.26:2 0.2a:2 0.39:2 0.41:2 0.4d:2 0.50:2 0.5b:2 0.60:2 0.66:2 0.70:2 0.72:2 0.76:2 0.77:2 0.7e:2 0.7f:2 0.88:2 0.89:2 0.8c:2 0.91:2 0.97:2 0.a1:2 0.a7:2 0.a8:2 0.ac:2 0.b9:2 0.c1:2 0.c3:2 0.c9:2 0.ca:2 0.cd:2 0.d2:2 0.d5:2 0.de:2 0.e1:2 0.e2:2 0.e8:2 0.ec:2 0.ed:2 0.f0:2 0.fc:2 0.103:2 0.10d:2 0.10e:2 0.115:2 0.11b:2 0.125:2 0.127:2 0.129:2 0.131:2 0.133:2 0.134:2 0.135:2 0.138:2 0.13d:2 0.143:2 0.146:2 0.148:2 0.14b:2 0.154:2 0.157:2 0.159:2 0.15a:2 0.16c:2 0.175:2 0.176:2 0.177:2 0.17b:2 0.184:2 0.187:2 0.18d:2 0.190:2 0.191:2 0.195:2 0.198:2 0.19a:2 0.1a0:2 0.1a7:2 0.1a8:2 0.1ab:2 0.1b5:2 0.1b6:2 0.1bf:2 0.1c4:2 0.1d2:2 0.1d7:2 0.1d8:2 0.1e3:2 0.1f0:2 0.1f8:2 0.1fd:2 0.1fe:2 0.202:2 0.203:2 0.20a:2 0.219:2 0.21f:2 0.228:2 0.22a:2 0.239:2 0.23d:2 0.24e:2 0.24f:2 0.251:2 0.267:2 0.26a:2 0.274:2 0.278:2 0.27a:2 0.28b:2 0.28e:2 0.294:2 0.298:2 0.29e:2 0.2a6:2 0.2b3:2 0.2b6:2 0.2ba:2 0.2c6:2 0.2c8:2 0.2ca:2 0.2d5:2 0.2d8:2 0.2dd:2 0.2e0:2 0.2ed:2 0.2f4:2 0.2f8:2 0.2ff:2 0.311:2 0.314:2 0.315:2 0.316:2 0.31f:2 0.322:2 0.326:2 0.32a:2 0.335:2 0.33c:2 0.343:2 0.34b:2 0.35a:2 0.35e:2 0.363:2 0.369:2 0.36f:2 0.37f:2 0.384:2 0.386:2 0.39a:2 0.39c:2 0.3a7:2 0.3ac:2 0.3ae:2 0.3b0:2 0.3ba:2 0.3d2:2 0.3d6:2 0.3dd:2 0.3e3:2 0.3ea:2 0.3f1:2 0.3f5:2 0.3fc:2 0.3fe:2) currently started
- 2017-07-11 13:25:09.365284 I | osd5: 2017-07-11 13:25:09.365201 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:49.365200)
- 2017-07-11 13:25:09.368970 I | osd5: 2017-07-11 13:25:09.365221 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:49.365200)
- 2017-07-11 13:25:09.369008 I | osd5: 2017-07-11 13:25:09.365225 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:49.365200)
- 2017-07-11 13:25:10.365460 I | osd5: 2017-07-11 13:25:10.365359 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:50.365358)
- 2017-07-11 13:25:10.368938 I | osd5: 2017-07-11 13:25:10.365376 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:50.365358)
- 2017-07-11 13:25:10.368972 I | osd5: 2017-07-11 13:25:10.365380 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:50.365358)
- 2017-07-11 13:25:11.369657 I | osd5: 2017-07-11 13:25:11.369546 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:51.369545)
- 2017-07-11 13:25:11.371345 I | osd5: 2017-07-11 13:25:11.369569 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:51.369545)
- 2017-07-11 13:25:11.371375 I | osd5: 2017-07-11 13:25:11.369573 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:51.369545)
- 2017-07-11 13:25:12.387173 I | osd5: 2017-07-11 13:25:12.371373 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:52.371371)
- 2017-07-11 13:25:12.387363 I | osd5: 2017-07-11 13:25:12.371392 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:52.371371)
- 2017-07-11 13:25:12.387402 I | osd5: 2017-07-11 13:25:12.371396 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:52.371371)
- 2017-07-11 13:25:13.392215 I | osd5: 2017-07-11 13:25:13.392102 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:53.392101)
- 2017-07-11 13:25:13.392910 I | osd5: 2017-07-11 13:25:13.392131 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:53.392101)
- 2017-07-11 13:25:13.392939 I | osd5: 2017-07-11 13:25:13.392134 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:53.392101)
- 2017-07-11 13:25:14.394542 I | osd5: 2017-07-11 13:25:14.394457 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:54.394456)
- 2017-07-11 13:25:14.394610 I | osd5: 2017-07-11 13:25:14.394480 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:54.394456)
- 2017-07-11 13:25:14.394628 I | osd5: 2017-07-11 13:25:14.394484 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:54.394456)
- 2017-07-11 13:25:15.397140 I | osd5: 2017-07-11 13:25:15.397059 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:55.397058)
- 2017-07-11 13:25:15.397157 I | osd5: 2017-07-11 13:25:15.397074 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:55.397058)
- 2017-07-11 13:25:15.397161 I | osd5: 2017-07-11 13:25:15.397077 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:55.397058)
- 2017-07-11 13:25:16.403551 I | osd5: 2017-07-11 13:25:16.403479 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:56.403478)
- 2017-07-11 13:25:16.403613 I | osd5: 2017-07-11 13:25:16.403492 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:56.403478)
- 2017-07-11 13:25:16.403629 I | osd5: 2017-07-11 13:25:16.403496 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:56.403478)
- 2017-07-11 13:25:17.406421 I | osd5: 2017-07-11 13:25:17.406294 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:57.406292)
- 2017-07-11 13:25:17.409223 I | osd5: 2017-07-11 13:25:17.406320 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:57.406292)
- 2017-07-11 13:25:17.409258 I | osd5: 2017-07-11 13:25:17.406328 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:57.406292)
- 2017-07-11 13:25:18.413850 I | osd5: 2017-07-11 13:25:18.410650 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:58.410649)
- 2017-07-11 13:25:18.420742 I | osd5: 2017-07-11 13:25:18.410663 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:58.410649)
- 2017-07-11 13:25:18.420767 I | osd5: 2017-07-11 13:25:18.410666 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:58.410649)
- 2017-07-11 13:25:18.835231 I | osd5: 2017-07-11 13:25:18.835171 7f4083cc0700 0 -- 10.233.99.0:6801/179 >> 10.233.124.4:6801/178 conn(0x562f748f6000 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._process_connection connect claims to be 10.233.124.0:6801/178 not 10.233.124.4:6801/178 - wrong node!
- 2017-07-11 13:25:19.411282 I | osd5: 2017-07-11 13:25:19.411210 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:59.411209)
- 2017-07-11 13:25:19.411337 I | osd5: 2017-07-11 13:25:19.411229 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:59.411209)
- 2017-07-11 13:25:19.411353 I | osd5: 2017-07-11 13:25:19.411232 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:24:59.411209)
- 2017-07-11 13:25:20.418773 I | osd5: 2017-07-11 13:25:20.418638 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:25:00.418636)
- 2017-07-11 13:25:20.418836 I | osd5: 2017-07-11 13:25:20.418670 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:25:00.418636)
- 2017-07-11 13:25:20.418852 I | osd5: 2017-07-11 13:25:20.418678 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:25:00.418636)
- 2017-07-11 13:25:21.422079 I | osd5: 2017-07-11 13:25:21.421416 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:25:01.421414)
- 2017-07-11 13:25:21.422155 I | osd5: 2017-07-11 13:25:21.421449 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:25:01.421414)
- 2017-07-11 13:25:21.422173 I | osd5: 2017-07-11 13:25:21.421457 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:25:01.421414)
- 2017-07-11 13:25:22.421981 I | osd5: 2017-07-11 13:25:22.421881 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:25:02.421880)
- 2017-07-11 13:25:22.422042 I | osd5: 2017-07-11 13:25:22.421894 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:25:02.421880)
- 2017-07-11 13:25:22.422058 I | osd5: 2017-07-11 13:25:22.421897 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:25:02.421880)
- 2017-07-11 13:25:23.422839 I | osd5: 2017-07-11 13:25:23.422743 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:25:03.422742)
- 2017-07-11 13:25:23.422903 I | osd5: 2017-07-11 13:25:23.422756 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:25:03.422742)
- 2017-07-11 13:25:23.422919 I | osd5: 2017-07-11 13:25:23.422760 7f407fc8f700 -1 osd.5 16 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:38.791230 (cutoff 2017-07-11 13:25:03.422742)
- 2017-07-11 13:25:24.354757 I | osd5: 2017-07-11 13:25:24.354682 7f407d48a700 -1 log_channel(cluster) log [ERR] : map e17 had wrong cluster addr (10.233.99.6:6801/179 != my 10.233.99.0:6801/179)
- 2017-07-11 13:26:15.639699 I | osd5: 2017-07-11 13:26:15.639620 7f407fc8f700 -1 osd.5 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:25:55.639619)
- 2017-07-11 13:26:15.639756 I | osd5: 2017-07-11 13:26:15.639632 7f407fc8f700 -1 osd.5 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:25:55.639619)
- 2017-07-11 13:26:16.644643 I | osd5: 2017-07-11 13:26:16.644564 7f407fc8f700 -1 osd.5 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:25:56.644562)
- 2017-07-11 13:26:16.644847 I | osd5: 2017-07-11 13:26:16.644575 7f407fc8f700 -1 osd.5 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:25:56.644562)
- 2017-07-11 13:26:17.647667 I | osd5: 2017-07-11 13:26:17.647605 7f407fc8f700 -1 osd.5 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:25:57.647604)
- 2017-07-11 13:26:17.647723 I | osd5: 2017-07-11 13:26:17.647618 7f407fc8f700 -1 osd.5 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:25:57.647604)
- 2017-07-11 13:26:18.650427 I | osd5: 2017-07-11 13:26:18.650363 7f407fc8f700 -1 osd.5 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:25:58.650362)
- 2017-07-11 13:26:18.650479 I | osd5: 2017-07-11 13:26:18.650383 7f407fc8f700 -1 osd.5 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:25:58.650362)
- 2017-07-11 13:26:19.656163 I | osd5: 2017-07-11 13:26:19.656057 7f407fc8f700 -1 osd.5 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:25:59.656055)
- 2017-07-11 13:26:19.657321 I | osd5: 2017-07-11 13:26:19.656082 7f407fc8f700 -1 osd.5 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:25:59.656055)
- 2017-07-11 13:26:20.661729 I | osd5: 2017-07-11 13:26:20.661671 7f407fc8f700 -1 osd.5 34 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:00.661670)
- 2017-07-11 13:26:20.661927 I | osd5: 2017-07-11 13:26:20.661685 7f407fc8f700 -1 osd.5 34 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:00.661670)
- 2017-07-11 13:26:21.662025 I | osd5: 2017-07-11 13:26:21.661868 7f407fc8f700 -1 osd.5 45 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:01.661866)
- 2017-07-11 13:26:21.665346 I | osd5: 2017-07-11 13:26:21.661893 7f407fc8f700 -1 osd.5 45 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:01.661866)
- 2017-07-11 13:26:22.664016 I | osd5: 2017-07-11 13:26:22.663903 7f407fc8f700 -1 osd.5 45 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:02.663902)
- 2017-07-11 13:26:22.664103 I | osd5: 2017-07-11 13:26:22.663919 7f407fc8f700 -1 osd.5 45 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:02.663902)
- 2017-07-11 13:26:23.669717 I | osd5: 2017-07-11 13:26:23.669531 7f407fc8f700 -1 osd.5 51 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:03.669530)
- 2017-07-11 13:26:23.669821 I | osd5: 2017-07-11 13:26:23.669549 7f407fc8f700 -1 osd.5 51 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:03.669530)
- 2017-07-11 13:26:24.672608 I | osd5: 2017-07-11 13:26:24.672496 7f407fc8f700 -1 osd.5 52 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:04.672495)
- 2017-07-11 13:26:24.673727 I | osd5: 2017-07-11 13:26:24.672522 7f407fc8f700 -1 osd.5 52 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:04.672495)
- 2017-07-11 13:26:25.678249 I | osd5: 2017-07-11 13:26:25.678171 7f407fc8f700 -1 osd.5 53 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:05.678170)
- 2017-07-11 13:26:25.678709 I | osd5: 2017-07-11 13:26:25.678183 7f407fc8f700 -1 osd.5 53 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:05.678170)
- 2017-07-11 13:26:26.682690 I | osd5: 2017-07-11 13:26:26.682571 7f407fc8f700 -1 osd.5 54 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:06.682568)
- 2017-07-11 13:26:26.682759 I | osd5: 2017-07-11 13:26:26.682593 7f407fc8f700 -1 osd.5 54 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:06.682568)
- 2017-07-11 13:26:27.683542 I | osd5: 2017-07-11 13:26:27.683452 7f407fc8f700 -1 osd.5 55 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:07.683451)
- 2017-07-11 13:26:27.683629 I | osd5: 2017-07-11 13:26:27.683468 7f407fc8f700 -1 osd.5 55 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:07.683451)
- 2017-07-11 13:26:28.689563 I | osd5: 2017-07-11 13:26:28.689475 7f407fc8f700 -1 osd.5 55 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:08.689473)
- 2017-07-11 13:26:28.689633 I | osd5: 2017-07-11 13:26:28.689500 7f407fc8f700 -1 osd.5 55 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:08.689473)
- 2017-07-11 13:26:29.693763 I | osd5: 2017-07-11 13:26:29.693656 7f407fc8f700 -1 osd.5 56 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:09.693655)
- 2017-07-11 13:26:29.693840 I | osd5: 2017-07-11 13:26:29.693673 7f407fc8f700 -1 osd.5 56 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:09.693655)
- 2017-07-11 13:26:30.700478 I | osd5: 2017-07-11 13:26:30.700423 7f407fc8f700 -1 osd.5 57 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:10.700422)
- 2017-07-11 13:26:30.700538 I | osd5: 2017-07-11 13:26:30.700435 7f407fc8f700 -1 osd.5 57 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:10.700422)
- 2017-07-11 13:26:31.702490 I | osd5: 2017-07-11 13:26:31.702437 7f407fc8f700 -1 osd.5 57 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:11.702436)
- 2017-07-11 13:26:31.702881 I | osd5: 2017-07-11 13:26:31.702449 7f407fc8f700 -1 osd.5 57 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:11.702436)
- 2017-07-11 13:26:32.702646 I | osd5: 2017-07-11 13:26:32.702536 7f407fc8f700 -1 osd.5 58 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:12.702534)
- 2017-07-11 13:26:32.702718 I | osd5: 2017-07-11 13:26:32.702551 7f407fc8f700 -1 osd.5 58 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:12.702534)
- 2017-07-11 13:26:33.714528 I | osd5: 2017-07-11 13:26:33.702689 7f407fc8f700 -1 osd.5 59 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:13.702687)
- 2017-07-11 13:26:33.714549 I | osd5: 2017-07-11 13:26:33.702716 7f407fc8f700 -1 osd.5 59 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:13.702687)
- 2017-07-11 13:26:33.714552 I | osd5: 2017-07-11 13:26:33.702725 7f407fc8f700 -1 osd.5 59 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:13.702687)
- 2017-07-11 13:26:34.708342 I | osd5: 2017-07-11 13:26:34.706875 7f407fc8f700 -1 osd.5 59 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:14.706873)
- 2017-07-11 13:26:34.708417 I | osd5: 2017-07-11 13:26:34.706899 7f407fc8f700 -1 osd.5 59 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:14.706873)
- 2017-07-11 13:26:34.708433 I | osd5: 2017-07-11 13:26:34.706906 7f407fc8f700 -1 osd.5 59 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:14.706873)
- 2017-07-11 13:26:35.713015 I | osd5: 2017-07-11 13:26:35.712896 7f407fc8f700 -1 osd.5 60 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:15.712894)
- 2017-07-11 13:26:35.713118 I | osd5: 2017-07-11 13:26:35.712927 7f407fc8f700 -1 osd.5 60 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:15.712894)
- 2017-07-11 13:26:35.713136 I | osd5: 2017-07-11 13:26:35.712930 7f407fc8f700 -1 osd.5 60 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:15.712894)
- 2017-07-11 13:26:36.718643 I | osd5: 2017-07-11 13:26:36.717816 7f407fc8f700 -1 osd.5 61 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:16.717815)
- 2017-07-11 13:26:36.718695 I | osd5: 2017-07-11 13:26:36.717827 7f407fc8f700 -1 osd.5 61 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:16.717815)
- 2017-07-11 13:26:36.718721 I | osd5: 2017-07-11 13:26:36.717830 7f407fc8f700 -1 osd.5 61 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:16.717815)
- 2017-07-11 13:26:37.720362 I | osd5: 2017-07-11 13:26:37.720281 7f407fc8f700 -1 osd.5 62 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:17.720280)
- 2017-07-11 13:26:37.720435 I | osd5: 2017-07-11 13:26:37.720292 7f407fc8f700 -1 osd.5 62 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:17.720280)
- 2017-07-11 13:26:37.720453 I | osd5: 2017-07-11 13:26:37.720295 7f407fc8f700 -1 osd.5 62 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:17.720280)
- 2017-07-11 13:26:38.721104 I | osd5: 2017-07-11 13:26:38.721018 7f407fc8f700 -1 osd.5 62 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:18.721017)
- 2017-07-11 13:26:38.721177 I | osd5: 2017-07-11 13:26:38.721039 7f407fc8f700 -1 osd.5 62 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:18.721017)
- 2017-07-11 13:26:38.721195 I | osd5: 2017-07-11 13:26:38.721043 7f407fc8f700 -1 osd.5 62 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:18.721017)
- 2017-07-11 13:26:39.722682 I | osd5: 2017-07-11 13:26:39.722577 7f407fc8f700 -1 osd.5 63 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:19.722575)
- 2017-07-11 13:26:39.722757 I | osd5: 2017-07-11 13:26:39.722609 7f407fc8f700 -1 osd.5 63 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:19.722575)
- 2017-07-11 13:26:39.722774 I | osd5: 2017-07-11 13:26:39.722612 7f407fc8f700 -1 osd.5 63 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:19.722575)
- 2017-07-11 13:26:40.725053 I | osd5: 2017-07-11 13:26:40.724985 7f407fc8f700 -1 osd.5 64 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:20.724984)
- 2017-07-11 13:26:40.728689 I | osd5: 2017-07-11 13:26:40.724997 7f407fc8f700 -1 osd.5 64 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:20.724984)
- 2017-07-11 13:26:40.728723 I | osd5: 2017-07-11 13:26:40.725000 7f407fc8f700 -1 osd.5 64 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:20.724984)
- 2017-07-11 13:26:41.744295 I | osd5: 2017-07-11 13:26:41.744238 7f407fc8f700 -1 osd.5 65 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:21.727586)
- 2017-07-11 13:26:41.744393 I | osd5: 2017-07-11 13:26:41.744365 7f407fc8f700 -1 osd.5 65 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:21.727586)
- 2017-07-11 13:26:41.744511 I | osd5: 2017-07-11 13:26:41.744478 7f407fc8f700 -1 osd.5 65 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:21.727586)
- 2017-07-11 13:26:42.748560 I | osd5: 2017-07-11 13:26:42.748473 7f407fc8f700 -1 osd.5 66 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:22.748472)
- 2017-07-11 13:26:42.748630 I | osd5: 2017-07-11 13:26:42.748499 7f407fc8f700 -1 osd.5 66 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:22.748472)
- 2017-07-11 13:26:42.748645 I | osd5: 2017-07-11 13:26:42.748502 7f407fc8f700 -1 osd.5 66 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:22.748472)
- 2017-07-11 13:26:43.749143 I | osd5: 2017-07-11 13:26:43.749073 7f407fc8f700 -1 osd.5 67 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:23.749071)
- 2017-07-11 13:26:43.749211 I | osd5: 2017-07-11 13:26:43.749086 7f407fc8f700 -1 osd.5 67 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:23.749071)
- 2017-07-11 13:26:43.749226 I | osd5: 2017-07-11 13:26:43.749089 7f407fc8f700 -1 osd.5 67 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:23.749071)
- 2017-07-11 13:26:44.749175 I | osd5: 2017-07-11 13:26:44.749118 7f407fc8f700 -1 osd.5 68 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:24.749117)
- 2017-07-11 13:26:44.749228 I | osd5: 2017-07-11 13:26:44.749128 7f407fc8f700 -1 osd.5 68 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:24.749117)
- 2017-07-11 13:26:44.749244 I | osd5: 2017-07-11 13:26:44.749132 7f407fc8f700 -1 osd.5 68 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:24.749117)
- 2017-07-11 13:26:45.758457 I | osd5: 2017-07-11 13:26:45.758389 7f407fc8f700 -1 osd.5 68 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:25.758388)
- 2017-07-11 13:26:45.760696 I | osd5: 2017-07-11 13:26:45.758403 7f407fc8f700 -1 osd.5 68 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:25.758388)
- 2017-07-11 13:26:45.760742 I | osd5: 2017-07-11 13:26:45.758406 7f407fc8f700 -1 osd.5 68 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:54.816597 (cutoff 2017-07-11 13:26:25.758388)
- 2017-07-11 13:26:46.764953 I | osd5: 2017-07-11 13:26:46.764890 7f407fc8f700 -1 osd.5 70 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:26.764888)
- 2017-07-11 13:26:47.768353 I | osd5: 2017-07-11 13:26:47.768281 7f407fc8f700 -1 osd.5 71 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:27.768280)
- 2017-07-11 13:26:48.774138 I | osd5: 2017-07-11 13:26:48.774068 7f407fc8f700 -1 osd.5 71 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:28.774067)
- 2017-07-11 13:26:49.780076 I | osd5: 2017-07-11 13:26:49.780028 7f407fc8f700 -1 osd.5 72 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:29.780026)
- 2017-07-11 13:26:50.782444 I | osd5: 2017-07-11 13:26:50.782373 7f407fc8f700 -1 osd.5 73 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:30.782372)
- 2017-07-11 13:26:51.787888 I | osd5: 2017-07-11 13:26:51.787833 7f407fc8f700 -1 osd.5 73 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:31.787832)
- 2017-07-11 13:26:52.788020 I | osd5: 2017-07-11 13:26:52.787934 7f407fc8f700 -1 osd.5 74 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:32.787932)
- 2017-07-11 13:26:53.793281 I | osd5: 2017-07-11 13:26:53.793115 7f407fc8f700 -1 osd.5 75 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:33.793114)
- 2017-07-11 13:26:54.799535 I | osd5: 2017-07-11 13:26:54.797218 7f407fc8f700 -1 osd.5 76 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:34.797216)
- 2017-07-11 13:26:55.802455 I | osd5: 2017-07-11 13:26:55.802381 7f407fc8f700 -1 osd.5 77 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:35.802379)
- 2017-07-11 13:26:56.805304 I | osd5: 2017-07-11 13:26:56.805236 7f407fc8f700 -1 osd.5 77 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:36.805235)
- 2017-07-11 13:26:57.807561 I | osd5: 2017-07-11 13:26:57.807466 7f407fc8f700 -1 osd.5 77 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:37.807464)
- 2017-07-11 13:26:58.814564 I | osd5: 2017-07-11 13:26:58.814476 7f407fc8f700 -1 osd.5 77 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:38.814474)
- 2017-07-11 13:26:59.823257 I | osd5: 2017-07-11 13:26:59.823095 7f407fc8f700 -1 osd.5 77 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:39.823093)
- 2017-07-11 13:27:00.830556 I | osd5: 2017-07-11 13:27:00.830505 7f407fc8f700 -1 osd.5 78 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:40.830504)
- 2017-07-11 13:27:01.831974 I | osd5: 2017-07-11 13:27:01.831917 7f407fc8f700 -1 osd.5 78 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:41.831916)
- 2017-07-11 13:27:02.832066 I | osd5: 2017-07-11 13:27:02.832010 7f407fc8f700 -1 osd.5 79 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:42.832009)
- 2017-07-11 13:27:03.832411 I | osd5: 2017-07-11 13:27:03.832350 7f407fc8f700 -1 osd.5 79 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:43.832346)
- 2017-07-11 13:27:04.855746 I | osd5: 2017-07-11 13:27:04.836388 7f407fc8f700 -1 osd.5 79 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:44.836387)
- 2017-07-11 13:27:05.840793 I | osd5: 2017-07-11 13:27:05.840697 7f407fc8f700 -1 osd.5 80 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:45.840695)
- 2017-07-11 13:27:06.844790 I | osd5: 2017-07-11 13:27:06.844615 7f407fc8f700 -1 osd.5 81 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:46.844613)
- 2017-07-11 13:27:07.850894 I | osd5: 2017-07-11 13:27:07.850782 7f407fc8f700 -1 osd.5 82 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:47.850779)
- 2017-07-11 13:27:08.853814 I | osd5: 2017-07-11 13:27:08.853730 7f407fc8f700 -1 osd.5 83 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:48.853728)
- 2017-07-11 13:27:08.853869 I | osd5: 2017-07-11 13:27:08.853744 7f407fc8f700 -1 osd.5 83 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:26:48.853728)
- 2017-07-11 13:27:09.865810 I | osd5: 2017-07-11 13:27:09.857776 7f407fc8f700 -1 osd.5 83 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:49.857774)
- 2017-07-11 13:27:09.866190 I | osd5: 2017-07-11 13:27:09.857795 7f407fc8f700 -1 osd.5 83 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:26:49.857774)
- 2017-07-11 13:27:10.865834 I | osd5: 2017-07-11 13:27:10.862309 7f407fc8f700 -1 osd.5 83 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:50.862308)
- 2017-07-11 13:27:10.865908 I | osd5: 2017-07-11 13:27:10.862327 7f407fc8f700 -1 osd.5 83 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:26:50.862308)
- 2017-07-11 13:27:11.864850 I | osd5: 2017-07-11 13:27:11.864774 7f407fc8f700 -1 osd.5 84 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:51.864773)
- 2017-07-11 13:27:11.864913 I | osd5: 2017-07-11 13:27:11.864786 7f407fc8f700 -1 osd.5 84 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:26:51.864773)
- 2017-07-11 13:27:12.868345 I | osd5: 2017-07-11 13:27:12.868263 7f407fc8f700 -1 osd.5 84 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:52.868261)
- 2017-07-11 13:27:12.868411 I | osd5: 2017-07-11 13:27:12.868289 7f407fc8f700 -1 osd.5 84 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:26:52.868261)
- 2017-07-11 13:27:13.871778 I | osd5: 2017-07-11 13:27:13.871625 7f407fc8f700 -1 osd.5 84 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:26:53.871624)
- 2017-07-11 13:27:13.872167 I | osd5: 2017-07-11 13:27:13.871638 7f407fc8f700 -1 osd.5 84 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:53.871624)
- 2017-07-11 13:27:13.872296 I | osd5: 2017-07-11 13:27:13.871641 7f407fc8f700 -1 osd.5 84 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:26:53.871624)
- 2017-07-11 13:27:14.877180 I | osd5: 2017-07-11 13:27:14.877108 7f407fc8f700 -1 osd.5 84 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:26:54.877107)
- 2017-07-11 13:27:14.877258 I | osd5: 2017-07-11 13:27:14.877121 7f407fc8f700 -1 osd.5 84 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:54.877107)
- 2017-07-11 13:27:14.877274 I | osd5: 2017-07-11 13:27:14.877124 7f407fc8f700 -1 osd.5 84 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:26:54.877107)
- 2017-07-11 13:27:15.877418 I | osd5: 2017-07-11 13:27:15.877298 7f407fc8f700 -1 osd.5 85 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:26:55.877297)
- 2017-07-11 13:27:15.877522 I | osd5: 2017-07-11 13:27:15.877325 7f407fc8f700 -1 osd.5 85 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:13.441411 (cutoff 2017-07-11 13:26:55.877297)
- 2017-07-11 13:27:15.877592 I | osd5: 2017-07-11 13:27:15.877332 7f407fc8f700 -1 osd.5 85 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:26:55.877297)
- 2017-07-11 13:27:16.879447 I | osd5: 2017-07-11 13:27:16.879346 7f407fc8f700 -1 osd.5 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:26:56.879345)
- 2017-07-11 13:27:16.879507 I | osd5: 2017-07-11 13:27:16.879358 7f407fc8f700 -1 osd.5 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:26:56.879345)
- 2017-07-11 13:27:17.884280 I | osd5: 2017-07-11 13:27:17.884098 7f407fc8f700 -1 osd.5 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:26:57.884096)
- 2017-07-11 13:27:17.884341 I | osd5: 2017-07-11 13:27:17.884126 7f407fc8f700 -1 osd.5 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:26:57.884096)
- 2017-07-11 13:27:18.892577 I | osd5: 2017-07-11 13:27:18.892508 7f407fc8f700 -1 osd.5 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:26:58.892507)
- 2017-07-11 13:27:18.892651 I | osd5: 2017-07-11 13:27:18.892525 7f407fc8f700 -1 osd.5 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:26:58.892507)
- 2017-07-11 13:27:19.898613 I | osd5: 2017-07-11 13:27:19.898460 7f407fc8f700 -1 osd.5 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:26:59.898459)
- 2017-07-11 13:27:19.899796 I | osd5: 2017-07-11 13:27:19.898487 7f407fc8f700 -1 osd.5 87 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:26:59.898459)
- 2017-07-11 13:27:20.905115 I | osd5: 2017-07-11 13:27:20.905027 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:00.905026)
- 2017-07-11 13:27:20.905287 I | osd5: 2017-07-11 13:27:20.905039 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:00.905026)
- 2017-07-11 13:27:21.907852 I | osd5: 2017-07-11 13:27:21.907794 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:01.907793)
- 2017-07-11 13:27:21.907914 I | osd5: 2017-07-11 13:27:21.907806 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:01.907793)
- 2017-07-11 13:27:22.908050 I | osd5: 2017-07-11 13:27:22.907898 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:02.907896)
- 2017-07-11 13:27:22.908100 I | osd5: 2017-07-11 13:27:22.907911 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:02.907896)
- 2017-07-11 13:27:23.912592 I | osd5: 2017-07-11 13:27:23.912482 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:03.912481)
- 2017-07-11 13:27:23.912657 I | osd5: 2017-07-11 13:27:23.912507 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:03.912481)
- 2017-07-11 13:27:24.919351 I | osd5: 2017-07-11 13:27:24.919245 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:04.919244)
- 2017-07-11 13:27:24.919450 I | osd5: 2017-07-11 13:27:24.919265 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:04.919244)
- 2017-07-11 13:27:25.924567 I | osd5: 2017-07-11 13:27:25.924416 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:05.924414)
- 2017-07-11 13:27:25.924646 I | osd5: 2017-07-11 13:27:25.924434 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:05.924414)
- 2017-07-11 13:27:26.931875 I | osd5: 2017-07-11 13:27:26.931789 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:06.931788)
- 2017-07-11 13:27:26.931936 I | osd5: 2017-07-11 13:27:26.931801 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:06.931788)
- 2017-07-11 13:27:27.932583 I | osd5: 2017-07-11 13:27:27.932485 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:07.932484)
- 2017-07-11 13:27:27.932649 I | osd5: 2017-07-11 13:27:27.932503 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:07.932484)
- 2017-07-11 13:27:28.934119 I | osd5: 2017-07-11 13:27:28.933754 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:08.933752)
- 2017-07-11 13:27:28.934198 I | osd5: 2017-07-11 13:27:28.933779 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:08.933752)
- 2017-07-11 13:27:29.937043 I | osd5: 2017-07-11 13:27:29.936965 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:09.936963)
- 2017-07-11 13:27:29.937139 I | osd5: 2017-07-11 13:27:29.937107 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:09.936963)
- 2017-07-11 13:27:30.938325 I | osd5: 2017-07-11 13:27:30.938214 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:10.938214)
- 2017-07-11 13:27:30.938398 I | osd5: 2017-07-11 13:27:30.938233 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:10.938214)
- 2017-07-11 13:27:31.940027 I | osd5: 2017-07-11 13:27:31.939974 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:11.939973)
- 2017-07-11 13:27:31.940079 I | osd5: 2017-07-11 13:27:31.939985 7f407fc8f700 -1 osd.5 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:11.939973)
- 2017-07-11 13:27:32.940160 I | osd5: 2017-07-11 13:27:32.940092 7f407fc8f700 -1 osd.5 89 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:12.940091)
- 2017-07-11 13:27:32.940228 I | osd5: 2017-07-11 13:27:32.940108 7f407fc8f700 -1 osd.5 89 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:12.940091)
- 2017-07-11 13:27:33.942926 I | osd5: 2017-07-11 13:27:33.942861 7f407fc8f700 -1 osd.5 89 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:13.942858)
- 2017-07-11 13:27:33.942985 I | osd5: 2017-07-11 13:27:33.942878 7f407fc8f700 -1 osd.5 89 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:13.942858)
- 2017-07-11 13:27:34.946952 I | osd5: 2017-07-11 13:27:34.946880 7f407fc8f700 -1 osd.5 89 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:14.946879)
- 2017-07-11 13:27:34.947022 I | osd5: 2017-07-11 13:27:34.946899 7f407fc8f700 -1 osd.5 89 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:14.946879)
- 2017-07-11 13:27:35.948683 I | osd5: 2017-07-11 13:27:35.948573 7f407fc8f700 -1 osd.5 90 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:15.948572)
- 2017-07-11 13:27:35.948793 I | osd5: 2017-07-11 13:27:35.948598 7f407fc8f700 -1 osd.5 90 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.199663 (cutoff 2017-07-11 13:27:15.948572)
- 2017-07-11 13:27:36.954256 I | osd5: 2017-07-11 13:27:36.954192 7f407fc8f700 -1 osd.5 91 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:16.954191)
- 2017-07-11 13:27:37.954921 I | osd5: 2017-07-11 13:27:37.954861 7f407fc8f700 -1 osd.5 92 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:17.954860)
- 2017-07-11 13:27:38.960748 I | osd5: 2017-07-11 13:27:38.960685 7f407fc8f700 -1 osd.5 93 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:18.960684)
- 2017-07-11 13:27:39.962408 I | osd5: 2017-07-11 13:27:39.962354 7f407fc8f700 -1 osd.5 94 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:19.962353)
- 2017-07-11 13:27:40.966517 I | osd5: 2017-07-11 13:27:40.966465 7f407fc8f700 -1 osd.5 94 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:20.966464)
- 2017-07-11 13:27:41.971851 I | osd5: 2017-07-11 13:27:41.971747 7f407fc8f700 -1 osd.5 95 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:21.971745)
- 2017-07-11 13:27:42.973425 I | osd5: 2017-07-11 13:27:42.973209 7f407fc8f700 -1 osd.5 96 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:22.973207)
- 2017-07-11 13:27:42.973592 I | osd5: 2017-07-11 13:27:42.973237 7f407fc8f700 -1 osd.5 96 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:22.973207)
- 2017-07-11 13:27:43.979516 I | osd5: 2017-07-11 13:27:43.979401 7f407fc8f700 -1 osd.5 97 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:23.979400)
- 2017-07-11 13:27:43.979530 I | osd5: 2017-07-11 13:27:43.979416 7f407fc8f700 -1 osd.5 97 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:23.979400)
- 2017-07-11 13:27:44.985472 I | osd5: 2017-07-11 13:27:44.985388 7f407fc8f700 -1 osd.5 97 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:24.985387)
- 2017-07-11 13:27:44.985530 I | osd5: 2017-07-11 13:27:44.985405 7f407fc8f700 -1 osd.5 97 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:24.985387)
- 2017-07-11 13:27:45.986220 I | osd5: 2017-07-11 13:27:45.986057 7f407fc8f700 -1 osd.5 98 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:53.500519 (cutoff 2017-07-11 13:27:25.986056)
- 2017-07-11 13:27:45.986305 I | osd5: 2017-07-11 13:27:45.986113 7f407fc8f700 -1 osd.5 98 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:25.986056)
- 2017-07-11 13:27:46.987833 I | osd5: 2017-07-11 13:27:46.987709 7f407fc8f700 -1 osd.5 99 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:26.987707)
- 2017-07-11 13:27:47.992908 I | osd5: 2017-07-11 13:27:47.992816 7f407fc8f700 -1 osd.5 100 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:27.992815)
- 2017-07-11 13:27:48.994036 I | osd5: 2017-07-11 13:27:48.993968 7f407fc8f700 -1 osd.5 100 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:28.993966)
- 2017-07-11 13:27:49.994610 I | osd5: 2017-07-11 13:27:49.994395 7f407fc8f700 -1 osd.5 101 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:29.994393)
- 2017-07-11 13:27:50.999667 I | osd5: 2017-07-11 13:27:50.999616 7f407fc8f700 -1 osd.5 101 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:30.999615)
- 2017-07-11 13:27:52.007049 I | osd5: 2017-07-11 13:27:52.006959 7f407fc8f700 -1 osd.5 103 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:32.006957)
- 2017-07-11 13:27:53.007150 I | osd5: 2017-07-11 13:27:53.007086 7f407fc8f700 -1 osd.5 104 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:33.007084)
- 2017-07-11 13:27:54.009256 I | osd5: 2017-07-11 13:27:54.007702 7f407fc8f700 -1 osd.5 105 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:34.007701)
- 2017-07-11 13:27:55.012380 I | osd5: 2017-07-11 13:27:55.012325 7f407fc8f700 -1 osd.5 105 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:35.012323)
- 2017-07-11 13:27:56.013895 I | osd5: 2017-07-11 13:27:56.013812 7f407fc8f700 -1 osd.5 106 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:36.013810)
- 2017-07-11 13:27:57.015482 I | osd5: 2017-07-11 13:27:57.015427 7f407fc8f700 -1 osd.5 107 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:37.015426)
- 2017-07-11 13:27:58.018229 I | osd5: 2017-07-11 13:27:58.017639 7f407fc8f700 -1 osd.5 108 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:38.017638)
- 2017-07-11 13:27:59.020112 I | osd5: 2017-07-11 13:27:59.020044 7f407fc8f700 -1 osd.5 109 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:39.020042)
- 2017-07-11 13:28:00.030063 I | osd5: 2017-07-11 13:28:00.027665 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:40.027663)
- 2017-07-11 13:28:01.030152 I | osd5: 2017-07-11 13:28:01.030068 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:41.030067)
- 2017-07-11 13:28:02.039337 I | osd5: 2017-07-11 13:28:02.030502 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:42.030500)
- 2017-07-11 13:28:03.042102 I | osd5: 2017-07-11 13:28:03.042038 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:43.042036)
- 2017-07-11 13:28:04.044400 I | osd5: 2017-07-11 13:28:04.044299 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:44.044297)
- 2017-07-11 13:28:05.045127 I | osd5: 2017-07-11 13:28:05.044726 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:45.044723)
- 2017-07-11 13:28:06.049979 I | osd5: 2017-07-11 13:28:06.049885 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:46.049884)
- 2017-07-11 13:28:06.050211 I | osd5: 2017-07-11 13:28:06.049899 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:27:46.049884)
- 2017-07-11 13:28:07.051812 I | osd5: 2017-07-11 13:28:07.051735 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:47.051734)
- 2017-07-11 13:28:07.051882 I | osd5: 2017-07-11 13:28:07.051748 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:27:47.051734)
- 2017-07-11 13:28:08.053477 I | osd5: 2017-07-11 13:28:08.053369 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:48.053368)
- 2017-07-11 13:28:08.053544 I | osd5: 2017-07-11 13:28:08.053383 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:27:48.053368)
- 2017-07-11 13:28:09.053687 I | osd5: 2017-07-11 13:28:09.053633 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:49.053632)
- 2017-07-11 13:28:09.053744 I | osd5: 2017-07-11 13:28:09.053639 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:27:49.053632)
- 2017-07-11 13:28:10.061585 I | osd5: 2017-07-11 13:28:10.060642 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:50.060640)
- 2017-07-11 13:28:10.062155 I | osd5: 2017-07-11 13:28:10.060657 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:27:50.060640)
- 2017-07-11 13:28:11.069593 I | osd5: 2017-07-11 13:28:11.069495 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:51.069494)
- 2017-07-11 13:28:11.069733 I | osd5: 2017-07-11 13:28:11.069506 7f407fc8f700 -1 osd.5 110 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:27:51.069494)
- 2017-07-11 13:28:12.069774 I | osd5: 2017-07-11 13:28:12.069687 7f407fc8f700 -1 osd.5 111 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:52.069685)
- 2017-07-11 13:28:12.076831 I | osd5: 2017-07-11 13:28:12.069703 7f407fc8f700 -1 osd.5 111 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:27:52.069685)
- 2017-07-11 13:28:13.071609 I | osd5: 2017-07-11 13:28:13.070831 7f407fc8f700 -1 osd.5 112 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:53.070829)
- 2017-07-11 13:28:13.071887 I | osd5: 2017-07-11 13:28:13.070841 7f407fc8f700 -1 osd.5 112 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:27:53.070829)
- 2017-07-11 13:28:14.075050 I | osd5: 2017-07-11 13:28:14.074976 7f407fc8f700 -1 osd.5 112 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:54.074975)
- 2017-07-11 13:28:14.075595 I | osd5: 2017-07-11 13:28:14.074994 7f407fc8f700 -1 osd.5 112 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:27:54.074975)
- 2017-07-11 13:28:15.075339 I | osd5: 2017-07-11 13:28:15.075082 7f407fc8f700 -1 osd.5 112 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:55.075081)
- 2017-07-11 13:28:15.075409 I | osd5: 2017-07-11 13:28:15.075258 7f407fc8f700 -1 osd.5 112 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:27:55.075081)
- 2017-07-11 13:28:16.075637 I | osd5: 2017-07-11 13:28:16.075543 7f407fc8f700 -1 osd.5 113 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:56.075541)
- 2017-07-11 13:28:16.075697 I | osd5: 2017-07-11 13:28:16.075554 7f407fc8f700 -1 osd.5 113 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:27:56.075541)
- 2017-07-11 13:28:17.082433 I | osd5: 2017-07-11 13:28:17.082327 7f407fc8f700 -1 osd.5 115 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:57.055424 (cutoff 2017-07-11 13:27:57.082326)
- 2017-07-11 13:28:17.082491 I | osd5: 2017-07-11 13:28:17.082339 7f407fc8f700 -1 osd.5 115 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:57.082326)
- 2017-07-11 13:28:17.082507 I | osd5: 2017-07-11 13:28:17.082342 7f407fc8f700 -1 osd.5 115 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:27:57.082326)
- 2017-07-11 13:28:18.083411 I | osd5: 2017-07-11 13:28:18.083307 7f407fc8f700 -1 osd.5 116 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:57.055424 (cutoff 2017-07-11 13:27:58.083307)
- 2017-07-11 13:28:18.083486 I | osd5: 2017-07-11 13:28:18.083330 7f407fc8f700 -1 osd.5 116 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:58.083307)
- 2017-07-11 13:28:18.083503 I | osd5: 2017-07-11 13:28:18.083333 7f407fc8f700 -1 osd.5 116 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:27:58.083307)
- 2017-07-11 13:28:19.092536 I | osd5: 2017-07-11 13:28:19.092424 7f407fc8f700 -1 osd.5 122 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:57.055424 (cutoff 2017-07-11 13:27:59.092423)
- 2017-07-11 13:28:19.092904 I | osd5: 2017-07-11 13:28:19.092435 7f407fc8f700 -1 osd.5 122 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:27:59.092423)
- 2017-07-11 13:28:19.093021 I | osd5: 2017-07-11 13:28:19.092438 7f407fc8f700 -1 osd.5 122 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:27:59.092423)
- 2017-07-11 13:28:20.094491 I | osd5: 2017-07-11 13:28:20.094398 7f407fc8f700 -1 osd.5 125 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:57.055424 (cutoff 2017-07-11 13:28:00.094396)
- 2017-07-11 13:28:20.094563 I | osd5: 2017-07-11 13:28:20.094420 7f407fc8f700 -1 osd.5 125 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.030393 (cutoff 2017-07-11 13:28:00.094396)
- 2017-07-11 13:28:20.094581 I | osd5: 2017-07-11 13:28:20.094424 7f407fc8f700 -1 osd.5 125 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:45.846791 (cutoff 2017-07-11 13:28:00.094396)
- END logs from pod: rook-ceph-osd-cn9hq
- BEGIN logs from pod: rook-ceph-osd-gt66q
- 2017-07-11 13:24:19.734485 I | cephmon: parsing mon endpoints: rook-ceph-mon1=10.233.99.4:6790,rook-ceph-mon2=10.233.124.3:6790,rook-ceph-mon0=10.233.76.3:6790
- 2017-07-11 13:24:19.734867 I | cephmon: writing config file /var/lib/rook/rook/rook.config
- 2017-07-11 13:24:19.735009 I | cephmon: generated admin config in /var/lib/rook/rook
- 2017-07-11 13:24:19.735029 I | cephosd: discovering hardware
- 2017-07-11 13:24:19.735042 I | exec: Running command: lsblk --all --noheadings --list --output KNAME
- 2017-07-11 13:24:19.743646 I | exec: Running command: lsblk /dev/fd0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.745071 I | exec: Running command: sgdisk --print /dev/fd0
- 2017-07-11 13:24:19.818187 W | inventory: skipping device fd0 with an unknown uuid. Failed to complete get disk fd0 uuid: exit status 2
- 2017-07-11 13:24:19.818281 I | exec: Running command: lsblk /dev/loop0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.819894 I | exec: Running command: lsblk /dev/loop1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.826947 I | exec: Running command: lsblk /dev/loop2 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.828184 I | exec: Running command: lsblk /dev/loop3 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.829319 I | exec: Running command: lsblk /dev/loop4 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.830513 I | exec: Running command: lsblk /dev/loop5 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.837562 I | exec: Running command: lsblk /dev/loop6 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.841277 I | exec: Running command: lsblk /dev/loop7 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.842425 I | exec: Running command: lsblk /dev/sda --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.851220 I | exec: Running command: sgdisk --print /dev/sda
- 2017-07-11 13:24:19.860732 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:19.861630 I | exec: Running command: lsblk /dev/sda1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.864990 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:19.866777 I | exec: Running command: lsblk /dev/sdb --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.868143 I | exec: Running command: sgdisk --print /dev/sdb
- 2017-07-11 13:24:19.878098 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:19.878944 I | exec: Running command: lsblk /dev/sdb1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.880080 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:19.888847 I | exec: Running command: lsblk /dev/sr0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.890216 I | cephosd: creating and starting the osds
- 2017-07-11 13:24:19.890229 I | exec: Running command: lsblk /dev/sda --bytes --pairs --output NAME,SIZE,TYPE,PKNAME
- 2017-07-11 13:24:19.898299 I | exec: Running command: blkid /dev/sda1 -s PARTLABEL -o value
- 2017-07-11 13:24:19.899904 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:19.900760 I | cephosd: skipping device sda that is in use (not by rook). fs: ext4, ownPartitions: false
- 2017-07-11 13:24:19.900770 I | exec: Running command: lsblk /dev/sdb --bytes --pairs --output NAME,SIZE,TYPE,PKNAME
- 2017-07-11 13:24:19.917880 I | exec: Running command: blkid /dev/sdb1 -s PARTLABEL -o value
- 2017-07-11 13:24:19.919950 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:19.920821 I | cephosd: skipping device sdb that is in use (not by rook). fs: , ownPartitions: false
- 2017-07-11 13:24:19.920841 I | cephosd: configuring osd devices: &{Entries:map[]}
- 2017-07-11 13:24:19.920864 I | cephosd: configuring osd dirs: map[/var/lib/rook:-1]
- 2017-07-11 13:24:19.920972 I | exec: Running command: ceph osd create 87446daf-adb9-4330-b384-dc39dca0e7d4 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/199476128
- 2017-07-11 13:24:20.998802 I | cephosd: successfully created OSD 87446daf-adb9-4330-b384-dc39dca0e7d4 with ID 0
- 2017-07-11 13:24:20.999155 I | cephmon: writing config file /var/lib/rook/osd0/rook.config
- 2017-07-11 13:24:20.999375 I | exec: Running command: ceph mon getmap --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/187646079
- 2017-07-11 13:24:21.428513 I | exec: got monmap epoch 3
- 2017-07-11 13:24:21.428719 I | cephosd: Initializing OSD 0 file system at /var/lib/rook/osd0...
- 2017-07-11 13:24:21.428955 I | proc: Running process ceph-osd with args: [--mkfs --mkkey --id=0 --cluster=rook --conf=/var/lib/rook/osd0/rook.config --osd-data=/var/lib/rook/osd0 --osd-uuid=87446daf-adb9-4330-b384-dc39dca0e7d4 --monmap=/var/lib/rook/osd0/tmp/activate.monmap --osd-journal=/var/lib/rook/osd0/journal --keyring=/var/lib/rook/osd0/keyring]
- 2017-07-11 13:24:21.428996 I | exec: Running command: ceph-osd --mkfs --mkkey --id=0 --cluster=rook --conf=/var/lib/rook/osd0/rook.config --osd-data=/var/lib/rook/osd0 --osd-uuid=87446daf-adb9-4330-b384-dc39dca0e7d4 --monmap=/var/lib/rook/osd0/tmp/activate.monmap --osd-journal=/var/lib/rook/osd0/journal --keyring=/var/lib/rook/osd0/keyring
- 2017-07-11 13:24:21.465423 I | mkfs-osd0: 2017-07-11 13:24:21.458829 7f08279c0c80 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 88
- 2017-07-11 13:24:21.666967 I | mkfs-osd0: 2017-07-11 13:24:21.666451 7f08279c0c80 0 filestore(/var/lib/rook/osd0) backend generic (magic 0xef53)
- 2017-07-11 13:24:21.920047 I | mkfs-osd0: 2017-07-11 13:24:21.919677 7f08279c0c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:21.998549 I | mkfs-osd0: 2017-07-11 13:24:21.998470 7f08279c0c80 0 filestore(/var/lib/rook/osd0) mkjournal(1061): created journal on /var/lib/rook/osd0/journal
- 2017-07-11 13:24:22.031448 I | mkfs-osd0: 2017-07-11 13:24:22.031385 7f08279c0c80 0 filestore(/var/lib/rook/osd0) backend generic (magic 0xef53)
- 2017-07-11 13:24:22.031745 I | mkfs-osd0: 2017-07-11 13:24:22.031724 7f08279c0c80 0 genericfilestorebackend(/var/lib/rook/osd0) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
- 2017-07-11 13:24:22.031793 I | mkfs-osd0: 2017-07-11 13:24:22.031778 7f08279c0c80 0 genericfilestorebackend(/var/lib/rook/osd0) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option
- 2017-07-11 13:24:22.031821 I | mkfs-osd0: 2017-07-11 13:24:22.031810 7f08279c0c80 0 genericfilestorebackend(/var/lib/rook/osd0) detect_features: splice() is disabled via 'filestore splice' config option
- 2017-07-11 13:24:22.149580 I | mkfs-osd0: 2017-07-11 13:24:22.149531 7f08279c0c80 0 genericfilestorebackend(/var/lib/rook/osd0) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
- 2017-07-11 13:24:22.217804 I | mkfs-osd0: 2017-07-11 13:24:22.217763 7f08279c0c80 0 filestore(/var/lib/rook/osd0) limited size xattrs
- 2017-07-11 13:24:22.218081 I | mkfs-osd0: 2017-07-11 13:24:22.218063 7f08279c0c80 0 filestore(/var/lib/rook/osd0) start omap initiation
- 2017-07-11 13:24:22.218292 I | mkfs-osd0: 2017-07-11 13:24:22.218254 7f08279c0c80 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:24:22.218319 I | mkfs-osd0:
- 2017-07-11 13:24:22.218363 I | mkfs-osd0: 2017-07-11 13:24:22.218333 7f08279c0c80 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:24:22.218393 I | mkfs-osd0: 2017-07-11 13:24:22.218381 7f08279c0c80 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:24:22.218420 I | mkfs-osd0: 2017-07-11 13:24:22.218408 7f08279c0c80 4 rocksdb: DB SUMMARY
- 2017-07-11 13:24:22.218445 I | mkfs-osd0:
- 2017-07-11 13:24:22.218503 I | mkfs-osd0: 2017-07-11 13:24:22.218489 7f08279c0c80 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:24:22.218531 I | mkfs-osd0:
- 2017-07-11 13:24:22.218557 I | mkfs-osd0: 2017-07-11 13:24:22.218545 7f08279c0c80 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:24:22.218569 I | mkfs-osd0:
- 2017-07-11 13:24:22.218610 I | mkfs-osd0: 2017-07-11 13:24:22.218585 7f08279c0c80 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes
- 2017-07-11 13:24:22.218625 I | mkfs-osd0:
- 2017-07-11 13:24:22.218692 I | mkfs-osd0: 2017-07-11 13:24:22.218649 7f08279c0c80 4 rocksdb: SST files in /var/lib/rook/osd0/current/omap dir, Total Num: 0, files:
- 2017-07-11 13:24:22.218707 I | mkfs-osd0:
- 2017-07-11 13:24:22.218746 I | mkfs-osd0: 2017-07-11 13:24:22.218731 7f08279c0c80 4 rocksdb: Write Ahead Log file in /var/lib/rook/osd0/current/omap: 000003.log size: 0 ;
- 2017-07-11 13:24:22.218773 I | mkfs-osd0:
- 2017-07-11 13:24:22.218801 I | mkfs-osd0: 2017-07-11 13:24:22.218788 7f08279c0c80 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:24:22.218832 I | mkfs-osd0: 2017-07-11 13:24:22.218821 7f08279c0c80 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:24:22.218875 I | mkfs-osd0: 2017-07-11 13:24:22.218863 7f08279c0c80 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:24:22.218901 I | mkfs-osd0: 2017-07-11 13:24:22.218890 7f08279c0c80 4 rocksdb: Options.env: 0x55c816ae38e0
- 2017-07-11 13:24:22.218954 I | mkfs-osd0: 2017-07-11 13:24:22.218931 7f08279c0c80 4 rocksdb: Options.info_log: 0x55c81772d4a0
- 2017-07-11 13:24:22.218984 I | mkfs-osd0: 2017-07-11 13:24:22.218972 7f08279c0c80 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:24:22.219023 I | mkfs-osd0: 2017-07-11 13:24:22.219011 7f08279c0c80 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:24:22.219049 I | mkfs-osd0: 2017-07-11 13:24:22.219039 7f08279c0c80 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:24:22.219099 I | mkfs-osd0: 2017-07-11 13:24:22.219088 7f08279c0c80 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:24:22.219124 I | mkfs-osd0: 2017-07-11 13:24:22.219114 7f08279c0c80 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:24:22.219171 I | mkfs-osd0: 2017-07-11 13:24:22.219148 7f08279c0c80 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:24:22.219196 I | mkfs-osd0: 2017-07-11 13:24:22.219186 7f08279c0c80 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:24:22.219218 I | mkfs-osd0: 2017-07-11 13:24:22.219209 7f08279c0c80 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:24:22.219272 I | mkfs-osd0: 2017-07-11 13:24:22.219248 7f08279c0c80 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:24:22.219298 I | mkfs-osd0: 2017-07-11 13:24:22.219287 7f08279c0c80 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:24:22.219335 I | mkfs-osd0: 2017-07-11 13:24:22.219323 7f08279c0c80 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:24:22.219361 I | mkfs-osd0: 2017-07-11 13:24:22.219351 7f08279c0c80 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:24:22.219399 I | mkfs-osd0: 2017-07-11 13:24:22.219376 7f08279c0c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:24:22.219425 I | mkfs-osd0: 2017-07-11 13:24:22.219414 7f08279c0c80 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:24:22.219449 I | mkfs-osd0: 2017-07-11 13:24:22.219439 7f08279c0c80 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:24:22.219488 I | mkfs-osd0: 2017-07-11 13:24:22.219475 7f08279c0c80 4 rocksdb: Options.wal_dir: /var/lib/rook/osd0/current/omap
- 2017-07-11 13:24:22.219514 I | mkfs-osd0: 2017-07-11 13:24:22.219504 7f08279c0c80 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:24:22.219538 I | mkfs-osd0: 2017-07-11 13:24:22.219528 7f08279c0c80 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:24:22.219587 I | mkfs-osd0: 2017-07-11 13:24:22.219566 7f08279c0c80 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:24:22.219610 I | mkfs-osd0: 2017-07-11 13:24:22.219600 7f08279c0c80 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:24:22.219645 I | mkfs-osd0: 2017-07-11 13:24:22.219634 7f08279c0c80 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:24:22.219670 I | mkfs-osd0: 2017-07-11 13:24:22.219659 7f08279c0c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:24:22.219692 I | mkfs-osd0: 2017-07-11 13:24:22.219682 7f08279c0c80 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:24:22.219727 I | mkfs-osd0: 2017-07-11 13:24:22.219716 7f08279c0c80 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:24:22.219755 I | mkfs-osd0: 2017-07-11 13:24:22.219744 7f08279c0c80 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:24:22.219777 I | mkfs-osd0: 2017-07-11 13:24:22.219768 7f08279c0c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:24:22.219815 I | mkfs-osd0: 2017-07-11 13:24:22.219804 7f08279c0c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:24:22.219838 I | mkfs-osd0: 2017-07-11 13:24:22.219828 7f08279c0c80 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:24:22.219877 I | mkfs-osd0: 2017-07-11 13:24:22.219854 7f08279c0c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:24:22.219902 I | mkfs-osd0: 2017-07-11 13:24:22.219892 7f08279c0c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:24:22.219924 I | mkfs-osd0: 2017-07-11 13:24:22.219915 7f08279c0c80 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:24:22.219961 I | mkfs-osd0: 2017-07-11 13:24:22.219950 7f08279c0c80 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:24:22.219986 I | mkfs-osd0: 2017-07-11 13:24:22.219976 7f08279c0c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:24:22.220009 I | mkfs-osd0: 2017-07-11 13:24:22.219999 7f08279c0c80 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:24:22.220045 I | mkfs-osd0: 2017-07-11 13:24:22.220034 7f08279c0c80 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:24:22.220068 I | mkfs-osd0: 2017-07-11 13:24:22.220059 7f08279c0c80 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:24:22.220102 I | mkfs-osd0: 2017-07-11 13:24:22.220081 7f08279c0c80 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:24:22.220127 I | mkfs-osd0: 2017-07-11 13:24:22.220117 7f08279c0c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:24:22.220149 I | mkfs-osd0: 2017-07-11 13:24:22.220140 7f08279c0c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:24:22.220185 I | mkfs-osd0: 2017-07-11 13:24:22.220162 7f08279c0c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:24:22.220210 I | mkfs-osd0: 2017-07-11 13:24:22.220200 7f08279c0c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:24:22.220233 I | mkfs-osd0: 2017-07-11 13:24:22.220223 7f08279c0c80 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:24:22.220269 I | mkfs-osd0: 2017-07-11 13:24:22.220258 7f08279c0c80 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:24:22.220293 I | mkfs-osd0: 2017-07-11 13:24:22.220283 7f08279c0c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:24:22.220318 I | mkfs-osd0: 2017-07-11 13:24:22.220306 7f08279c0c80 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:24:22.220357 I | mkfs-osd0: 2017-07-11 13:24:22.220346 7f08279c0c80 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:24:22.220379 I | mkfs-osd0: 2017-07-11 13:24:22.220370 7f08279c0c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:24:22.220416 I | mkfs-osd0: 2017-07-11 13:24:22.220393 7f08279c0c80 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:24:22.220441 I | mkfs-osd0: 2017-07-11 13:24:22.220431 7f08279c0c80 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:24:22.220465 I | mkfs-osd0: 2017-07-11 13:24:22.220455 7f08279c0c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:24:22.220503 I | mkfs-osd0: 2017-07-11 13:24:22.220492 7f08279c0c80 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:24:22.220528 I | mkfs-osd0: 2017-07-11 13:24:22.220517 7f08279c0c80 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:24:22.220550 I | mkfs-osd0: 2017-07-11 13:24:22.220541 7f08279c0c80 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:24:22.220587 I | mkfs-osd0: 2017-07-11 13:24:22.220577 7f08279c0c80 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:24:22.220612 I | mkfs-osd0: 2017-07-11 13:24:22.220601 7f08279c0c80 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:24:22.220648 I | mkfs-osd0: 2017-07-11 13:24:22.220625 7f08279c0c80 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:24:22.220672 I | mkfs-osd0: 2017-07-11 13:24:22.220662 7f08279c0c80 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:24:22.220697 I | mkfs-osd0: 2017-07-11 13:24:22.220687 7f08279c0c80 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:24:22.221142 I | mkfs-osd0: 2017-07-11 13:24:22.221124 7f08279c0c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001
- 2017-07-11 13:24:22.221192 I | mkfs-osd0:
- 2017-07-11 13:24:22.221308 I | mkfs-osd0: 2017-07-11 13:24:22.221291 7f08279c0c80 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:24:22.221325 I | mkfs-osd0:
- 2017-07-11 13:24:22.221366 I | mkfs-osd0: 2017-07-11 13:24:22.221353 7f08279c0c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:24:22.221400 I | mkfs-osd0: 2017-07-11 13:24:22.221384 7f08279c0c80 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:24:22.221441 I | mkfs-osd0: 2017-07-11 13:24:22.221429 7f08279c0c80 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:24:22.221478 I | mkfs-osd0: 2017-07-11 13:24:22.221457 7f08279c0c80 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:24:22.221516 I | mkfs-osd0: 2017-07-11 13:24:22.221505 7f08279c0c80 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:24:22.221541 I | mkfs-osd0: 2017-07-11 13:24:22.221531 7f08279c0c80 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:24:22.221608 I | mkfs-osd0: 2017-07-11 13:24:22.221567 7f08279c0c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c81755c218)
- 2017-07-11 13:24:22.221623 I | mkfs-osd0: cache_index_and_filter_blocks: 0
- 2017-07-11 13:24:22.221634 I | mkfs-osd0: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:24:22.221644 I | mkfs-osd0: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:24:22.221668 I | mkfs-osd0: index_type: 0
- 2017-07-11 13:24:22.221680 I | mkfs-osd0: hash_index_allow_collision: 1
- 2017-07-11 13:24:22.221690 I | mkfs-osd0: checksum: 1
- 2017-07-11 13:24:22.221700 I | mkfs-osd0: no_block_cache: 0
- 2017-07-11 13:24:22.221711 I | mkfs-osd0: block_cache: 0x55c817582380
- 2017-07-11 13:24:22.221721 I | mkfs-osd0: block_cache_name: LRUCache
- 2017-07-11 13:24:22.221758 I | mkfs-osd0: block_cache_options:
- 2017-07-11 13:24:22.221772 I | mkfs-osd0: capacity : 107374182
- 2017-07-11 13:24:22.221783 I | mkfs-osd0: num_shard_bits : 4
- 2017-07-11 13:24:22.221793 I | mkfs-osd0: strict_capacity_limit : 0
- 2017-07-11 13:24:22.221816 I | mkfs-osd0: high_pri_pool_ratio: 0.000
- 2017-07-11 13:24:22.221827 I | mkfs-osd0: block_cache_compressed: (nil)
- 2017-07-11 13:24:22.221837 I | mkfs-osd0: persistent_cache: (nil)
- 2017-07-11 13:24:22.221847 I | mkfs-osd0: block_size: 4096
- 2017-07-11 13:24:22.221858 I | mkfs-osd0: block_size_deviation: 10
- 2017-07-11 13:24:22.221868 I | mkfs-osd0: block_restart_interval: 16
- 2017-07-11 13:24:22.221898 I | mkfs-osd0: index_block_restart_interval: 1
- 2017-07-11 13:24:22.221910 I | mkfs-osd0: filter_policy: nullptr
- 2017-07-11 13:24:22.221919 I | mkfs-osd0: whole_key_filtering: 1
- 2017-07-11 13:24:22.221929 I | mkfs-osd0: format_version: 2
- 2017-07-11 13:24:22.221938 I | mkfs-osd0:
- 2017-07-11 13:24:22.221962 I | mkfs-osd0: 2017-07-11 13:24:22.221950 7f08279c0c80 4 rocksdb: Options.write_buffer_size: 67108864
- 2017-07-11 13:24:22.222001 I | mkfs-osd0: 2017-07-11 13:24:22.221990 7f08279c0c80 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:24:22.222025 I | mkfs-osd0: 2017-07-11 13:24:22.222015 7f08279c0c80 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:24:22.222072 I | mkfs-osd0: 2017-07-11 13:24:22.222059 7f08279c0c80 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:24:22.222096 I | mkfs-osd0: 2017-07-11 13:24:22.222086 7f08279c0c80 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:24:22.222124 I | mkfs-osd0: 2017-07-11 13:24:22.222109 7f08279c0c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:24:22.222158 I | mkfs-osd0: 2017-07-11 13:24:22.222147 7f08279c0c80 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:24:22.222183 I | mkfs-osd0: 2017-07-11 13:24:22.222172 7f08279c0c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:24:22.222222 I | mkfs-osd0: 2017-07-11 13:24:22.222210 7f08279c0c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:24:22.222253 I | mkfs-osd0: 2017-07-11 13:24:22.222242 7f08279c0c80 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:24:22.222294 I | mkfs-osd0: 2017-07-11 13:24:22.222270 7f08279c0c80 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:24:22.222319 I | mkfs-osd0: 2017-07-11 13:24:22.222309 7f08279c0c80 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:24:22.222342 I | mkfs-osd0: 2017-07-11 13:24:22.222332 7f08279c0c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:24:22.222378 I | mkfs-osd0: 2017-07-11 13:24:22.222367 7f08279c0c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:24:22.222401 I | mkfs-osd0: 2017-07-11 13:24:22.222391 7f08279c0c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:24:22.222426 I | mkfs-osd0: 2017-07-11 13:24:22.222416 7f08279c0c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:24:22.222463 I | mkfs-osd0: 2017-07-11 13:24:22.222452 7f08279c0c80 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:24:22.222487 I | mkfs-osd0: 2017-07-11 13:24:22.222477 7f08279c0c80 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:24:22.222523 I | mkfs-osd0: 2017-07-11 13:24:22.222500 7f08279c0c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:24:22.222547 I | mkfs-osd0: 2017-07-11 13:24:22.222537 7f08279c0c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:24:22.222574 I | mkfs-osd0: 2017-07-11 13:24:22.222562 7f08279c0c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:24:22.222610 I | mkfs-osd0: 2017-07-11 13:24:22.222599 7f08279c0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:24:22.222635 I | mkfs-osd0: 2017-07-11 13:24:22.222625 7f08279c0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:24:22.222658 I | mkfs-osd0: 2017-07-11 13:24:22.222648 7f08279c0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:24:22.222694 I | mkfs-osd0: 2017-07-11 13:24:22.222684 7f08279c0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:24:22.222718 I | mkfs-osd0: 2017-07-11 13:24:22.222708 7f08279c0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:24:22.222756 I | mkfs-osd0: 2017-07-11 13:24:22.222733 7f08279c0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:24:22.222780 I | mkfs-osd0: 2017-07-11 13:24:22.222770 7f08279c0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:24:22.222815 I | mkfs-osd0: 2017-07-11 13:24:22.222805 7f08279c0c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:24:22.222855 I | mkfs-osd0: 2017-07-11 13:24:22.222843 7f08279c0c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:24:22.222879 I | mkfs-osd0: 2017-07-11 13:24:22.222869 7f08279c0c80 4 rocksdb: Options.arena_block_size: 8388608
- 2017-07-11 13:24:22.222917 I | mkfs-osd0: 2017-07-11 13:24:22.222892 7f08279c0c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:24:22.222943 I | mkfs-osd0: 2017-07-11 13:24:22.222933 7f08279c0c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:24:22.222968 I | mkfs-osd0: 2017-07-11 13:24:22.222958 7f08279c0c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:24:22.223006 I | mkfs-osd0: 2017-07-11 13:24:22.222994 7f08279c0c80 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:24:22.223032 I | mkfs-osd0: 2017-07-11 13:24:22.223022 7f08279c0c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:24:22.223071 I | mkfs-osd0: 2017-07-11 13:24:22.223047 7f08279c0c80 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:24:22.223097 I | mkfs-osd0: 2017-07-11 13:24:22.223086 7f08279c0c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:24:22.223124 I | mkfs-osd0: 2017-07-11 13:24:22.223114 7f08279c0c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:24:22.223163 I | mkfs-osd0: 2017-07-11 13:24:22.223151 7f08279c0c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:24:22.223189 I | mkfs-osd0: 2017-07-11 13:24:22.223178 7f08279c0c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:24:22.223226 I | mkfs-osd0: 2017-07-11 13:24:22.223202 7f08279c0c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:24:22.223252 I | mkfs-osd0: 2017-07-11 13:24:22.223241 7f08279c0c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:24:22.223277 I | mkfs-osd0: 2017-07-11 13:24:22.223267 7f08279c0c80 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:24:22.223323 I | mkfs-osd0: 2017-07-11 13:24:22.223312 7f08279c0c80 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:24:22.223347 I | mkfs-osd0: 2017-07-11 13:24:22.223337 7f08279c0c80 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:24:22.223406 I | mkfs-osd0: 2017-07-11 13:24:22.223392 7f08279c0c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:24:22.223431 I | mkfs-osd0: 2017-07-11 13:24:22.223421 7f08279c0c80 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:24:22.223470 I | mkfs-osd0: 2017-07-11 13:24:22.223445 7f08279c0c80 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:24:22.223496 I | mkfs-osd0: 2017-07-11 13:24:22.223485 7f08279c0c80 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:24:22.223519 I | mkfs-osd0: 2017-07-11 13:24:22.223509 7f08279c0c80 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:24:22.223559 I | mkfs-osd0: 2017-07-11 13:24:22.223545 7f08279c0c80 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:24:22.223586 I | mkfs-osd0: 2017-07-11 13:24:22.223575 7f08279c0c80 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:24:22.223624 I | mkfs-osd0: 2017-07-11 13:24:22.223600 7f08279c0c80 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:24:22.224914 I | mkfs-osd0: 2017-07-11 13:24:22.224673 7f08279c0c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/osd0/current/omap/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:24:22.224953 I | mkfs-osd0:
- 2017-07-11 13:24:22.224967 I | mkfs-osd0: 2017-07-11 13:24:22.224681 7f08279c0c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 0
- 2017-07-11 13:24:22.224979 I | mkfs-osd0:
- 2017-07-11 13:24:22.224989 I | mkfs-osd0: 2017-07-11 13:24:22.224720 7f08279c0c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779462224715, "job": 1, "event": "recovery_started", "log_files": [3]}
- 2017-07-11 13:24:22.224999 I | mkfs-osd0: 2017-07-11 13:24:22.224723 7f08279c0c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #3 mode 2
- 2017-07-11 13:24:22.225028 I | mkfs-osd0: 2017-07-11 13:24:22.224779 7f08279c0c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 5
- 2017-07-11 13:24:22.225041 I | mkfs-osd0:
- 2017-07-11 13:24:22.284044 I | mkfs-osd0: 2017-07-11 13:24:22.283710 7f08279c0c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779462283704, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:24:22.315125 I | mkfs-osd0: 2017-07-11 13:24:22.315101 7f08279c0c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55c817812000
- 2017-07-11 13:24:22.315306 I | mkfs-osd0: 2017-07-11 13:24:22.315288 7f08279c0c80 0 filestore(/var/lib/rook/osd0) mount(1717): enabling WRITEAHEAD journal mode: checkpoint is not enabled
- 2017-07-11 13:24:22.315452 I | mkfs-osd0: 2017-07-11 13:24:22.315431 7f08279c0c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:22.315929 I | mkfs-osd0: 2017-07-11 13:24:22.315841 7f08279c0c80 -1 filestore(/var/lib/rook/osd0) could not find #-1:7b3f43c4:::osd_superblock:0# in index: (2) No such file or directory
- 2017-07-11 13:24:22.848571 I | mkfs-osd0: 2017-07-11 13:24:22.848365 7f08279c0c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:217] Shutdown: canceling all background work
- 2017-07-11 13:24:22.848637 I | mkfs-osd0: 2017-07-11 13:24:22.848490 7f08279c0c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:343] Shutdown complete
- 2017-07-11 13:24:22.848834 I | mkfs-osd0: 2017-07-11 13:24:22.848748 7f08279c0c80 -1 created object store /var/lib/rook/osd0 for osd.0 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:24:22.848982 I | mkfs-osd0: 2017-07-11 13:24:22.848888 7f08279c0c80 -1 auth: error reading file: /var/lib/rook/osd0/keyring: can't open /var/lib/rook/osd0/keyring: (2) No such file or directory
- 2017-07-11 13:24:22.849142 I | mkfs-osd0: 2017-07-11 13:24:22.849069 7f08279c0c80 -1 created new key in keyring /var/lib/rook/osd0/keyring
- 2017-07-11 13:24:22.850705 I | mkfs-osd0: 2017-07-11 13:24:21.919677 7f08279c0c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:22.850743 I | mkfs-osd0: 2017-07-11 13:24:22.315431 7f08279c0c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:22.850758 I | mkfs-osd0: 2017-07-11 13:24:22.315841 7f08279c0c80 -1 filestore(/var/lib/rook/osd0) could not find #-1:7b3f43c4:::osd_superblock:0# in index: (2) No such file or directory
- 2017-07-11 13:24:22.850769 I | mkfs-osd0: 2017-07-11 13:24:22.848748 7f08279c0c80 -1 created object store /var/lib/rook/osd0 for osd.0 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:24:22.850780 I | mkfs-osd0: 2017-07-11 13:24:22.848888 7f08279c0c80 -1 auth: error reading file: /var/lib/rook/osd0/keyring: can't open /var/lib/rook/osd0/keyring: (2) No such file or directory
- 2017-07-11 13:24:22.850791 I | mkfs-osd0: 2017-07-11 13:24:22.849069 7f08279c0c80 -1 created new key in keyring /var/lib/rook/osd0/keyring
- 2017-07-11 13:24:22.851017 I | exec: Running command: ceph auth add osd.0 -i /var/lib/rook/osd0/keyring osd allow * mon allow profile osd --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/739919826
- 2017-07-11 13:24:23.432671 I | exec: added key for osd.0
- 2017-07-11 13:24:23.432934 I | cephosd: adding osd.0 (/var/lib/rook/osd0), bytes: 104022159360, weight: 0.0946, to crush map at 'root=default'
- 2017-07-11 13:24:23.433088 I | exec: Running command: ceph osd crush create-or-move 0 0.0946 root=default --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/499411721
- 2017-07-11 13:24:25.439470 I | exec: create-or-move updating item name 'osd.0' weight 0.0946 at location {root=default} to crush map
- 2017-07-11 13:24:25.439661 I | cephosd: starting osd 0 at /var/lib/rook/osd0
- 2017-07-11 13:24:25.439735 I | cephosd: Config file /var/lib/rook/osd0/rook.config:
- [global]
- enable experimental unrecoverable data corrupting features =
- run dir = /var/lib/rook/osd0
- mon initial members = rook-ceph-mon1 rook-ceph-mon2 rook-ceph-mon0
- log file = /dev/stdout
- mon cluster log file = /dev/stdout
- mon keyvaluedb = rocksdb
- debug default = 0
- debug rados = 0
- debug mon = 0
- debug osd = 0
- debug bluestore = 0
- debug filestore = 0
- debug journal = 0
- debug leveldb = 0
- filestore_omap_backend = rocksdb
- osd pg bits = 11
- osd pgp bits = 11
- osd pool default size = 1
- osd pool default min size = 1
- osd pool default pg num = 100
- osd pool default pgp num = 100
- osd max object name len = 256
- osd max object namespace len = 64
- osd objectstore = filestore
- rbd_default_features = 3
- fatal signal handlers = false
- [osd.0]
- keyring = /var/lib/rook/osd0/keyring
- osd journal size = 1024
- [mon.rook-ceph-mon1]
- name = rook-ceph-mon1
- mon addr = 10.233.99.4:6790
- [mon.rook-ceph-mon2]
- name = rook-ceph-mon2
- mon addr = 10.233.124.3:6790
- [mon.rook-ceph-mon0]
- name = rook-ceph-mon0
- mon addr = 10.233.76.3:6790
- 2017-07-11 13:24:25.440221 I | proc: no existing process found for binary ceph-osd and pattern '--osd-uuid=87446daf-adb9-4330-b384-dc39dca0e7d4'
- 2017-07-11 13:24:25.440262 I | proc: Starting process osd0 with args: [--foreground --id=0 --cluster=rook --osd-data=/var/lib/rook/osd0 --conf=/var/lib/rook/osd0/rook.config --keyring=/var/lib/rook/osd0/keyring --osd-uuid=87446daf-adb9-4330-b384-dc39dca0e7d4 --osd-journal=/var/lib/rook/osd0/journal]
- 2017-07-11 13:24:25.440282 I | exec: Running command: ceph-osd --foreground --id=0 --cluster=rook --osd-data=/var/lib/rook/osd0 --conf=/var/lib/rook/osd0/rook.config --keyring=/var/lib/rook/osd0/keyring --osd-uuid=87446daf-adb9-4330-b384-dc39dca0e7d4 --osd-journal=/var/lib/rook/osd0/journal
- 2017-07-11 13:24:25.440697 I | cephosd: 1/1 osd dirs succeeded on this node
- 2017-07-11 13:24:25.440791 I | sleeping a while to let the osds run...
- 2017-07-11 13:24:25.468776 I | osd0: 2017-07-11 13:24:25.468732 7fd81bad4c80 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 180
- 2017-07-11 13:24:25.470155 I | osd0: starting osd.0 at - osd_data /var/lib/rook/osd0 /var/lib/rook/osd0/journal
- 2017-07-11 13:24:25.470435 I | osd0: 2017-07-11 13:24:25.470416 7fd81bad4c80 0 pidfile_write: ignore empty --pid-file
- 2017-07-11 13:24:25.487659 I | osd0: 2017-07-11 13:24:25.487627 7fd81bad4c80 0 load: jerasure load: lrc load: isa
- 2017-07-11 13:24:25.487907 I | osd0: 2017-07-11 13:24:25.487886 7fd81bad4c80 0 filestore(/var/lib/rook/osd0) backend generic (magic 0xef53)
- 2017-07-11 13:24:25.488387 I | osd0: 2017-07-11 13:24:25.488368 7fd81bad4c80 0 filestore(/var/lib/rook/osd0) backend generic (magic 0xef53)
- 2017-07-11 13:24:25.488667 I | osd0: 2017-07-11 13:24:25.488642 7fd81bad4c80 0 genericfilestorebackend(/var/lib/rook/osd0) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
- 2017-07-11 13:24:25.488717 I | osd0: 2017-07-11 13:24:25.488700 7fd81bad4c80 0 genericfilestorebackend(/var/lib/rook/osd0) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option
- 2017-07-11 13:24:25.488745 I | osd0: 2017-07-11 13:24:25.488734 7fd81bad4c80 0 genericfilestorebackend(/var/lib/rook/osd0) detect_features: splice() is disabled via 'filestore splice' config option
- 2017-07-11 13:24:25.550303 I | osd0: 2017-07-11 13:24:25.550256 7fd81bad4c80 0 genericfilestorebackend(/var/lib/rook/osd0) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
- 2017-07-11 13:24:25.614243 I | osd0: 2017-07-11 13:24:25.614219 7fd81bad4c80 0 filestore(/var/lib/rook/osd0) limited size xattrs
- 2017-07-11 13:24:25.614483 I | osd0: 2017-07-11 13:24:25.614466 7fd81bad4c80 0 filestore(/var/lib/rook/osd0) start omap initiation
- 2017-07-11 13:24:25.614733 I | osd0: 2017-07-11 13:24:25.614715 7fd81bad4c80 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:24:25.614765 I | osd0:
- 2017-07-11 13:24:25.614797 I | osd0: 2017-07-11 13:24:25.614781 7fd81bad4c80 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:24:25.614825 I | osd0: 2017-07-11 13:24:25.614814 7fd81bad4c80 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:24:25.614868 I | osd0: 2017-07-11 13:24:25.614856 7fd81bad4c80 4 rocksdb: DB SUMMARY
- 2017-07-11 13:24:25.614881 I | osd0:
- 2017-07-11 13:24:25.614972 I | osd0: 2017-07-11 13:24:25.614957 7fd81bad4c80 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:24:25.615345 I | osd0:
- 2017-07-11 13:24:25.615393 I | osd0: 2017-07-11 13:24:25.615378 7fd81bad4c80 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:24:25.615408 I | osd0:
- 2017-07-11 13:24:25.615457 I | osd0: 2017-07-11 13:24:25.615442 7fd81bad4c80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes
- 2017-07-11 13:24:25.615472 I | osd0:
- 2017-07-11 13:24:25.615512 I | osd0: 2017-07-11 13:24:25.615485 7fd81bad4c80 4 rocksdb: SST files in /var/lib/rook/osd0/current/omap dir, Total Num: 0, files:
- 2017-07-11 13:24:25.615526 I | osd0:
- 2017-07-11 13:24:25.615556 I | osd0: 2017-07-11 13:24:25.615539 7fd81bad4c80 4 rocksdb: Write Ahead Log file in /var/lib/rook/osd0/current/omap: 000006.log size: 98 ;
- 2017-07-11 13:24:25.615581 I | osd0:
- 2017-07-11 13:24:25.615608 I | osd0: 2017-07-11 13:24:25.615596 7fd81bad4c80 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:24:25.615631 I | osd0: 2017-07-11 13:24:25.615621 7fd81bad4c80 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:24:25.615669 I | osd0: 2017-07-11 13:24:25.615657 7fd81bad4c80 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:24:25.615693 I | osd0: 2017-07-11 13:24:25.615683 7fd81bad4c80 4 rocksdb: Options.env: 0x5567cbf398e0
- 2017-07-11 13:24:25.615714 I | osd0: 2017-07-11 13:24:25.615705 7fd81bad4c80 4 rocksdb: Options.info_log: 0x5567cd8a2560
- 2017-07-11 13:24:25.615750 I | osd0: 2017-07-11 13:24:25.615739 7fd81bad4c80 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:24:25.615774 I | osd0: 2017-07-11 13:24:25.615764 7fd81bad4c80 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:24:25.615797 I | osd0: 2017-07-11 13:24:25.615788 7fd81bad4c80 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:24:25.615833 I | osd0: 2017-07-11 13:24:25.615823 7fd81bad4c80 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:24:25.615857 I | osd0: 2017-07-11 13:24:25.615847 7fd81bad4c80 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:24:25.615880 I | osd0: 2017-07-11 13:24:25.615870 7fd81bad4c80 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:24:25.615915 I | osd0: 2017-07-11 13:24:25.615905 7fd81bad4c80 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:24:25.615938 I | osd0: 2017-07-11 13:24:25.615929 7fd81bad4c80 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:24:25.615960 I | osd0: 2017-07-11 13:24:25.615951 7fd81bad4c80 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:24:25.615995 I | osd0: 2017-07-11 13:24:25.615984 7fd81bad4c80 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:24:25.616018 I | osd0: 2017-07-11 13:24:25.616009 7fd81bad4c80 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:24:25.616040 I | osd0: 2017-07-11 13:24:25.616031 7fd81bad4c80 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:24:25.616081 I | osd0: 2017-07-11 13:24:25.616069 7fd81bad4c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:24:25.616105 I | osd0: 2017-07-11 13:24:25.616095 7fd81bad4c80 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:24:25.616139 I | osd0: 2017-07-11 13:24:25.616117 7fd81bad4c80 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:24:25.616176 I | osd0: 2017-07-11 13:24:25.616154 7fd81bad4c80 4 rocksdb: Options.wal_dir: /var/lib/rook/osd0/current/omap
- 2017-07-11 13:24:25.616202 I | osd0: 2017-07-11 13:24:25.616191 7fd81bad4c80 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:24:25.616244 I | osd0: 2017-07-11 13:24:25.616233 7fd81bad4c80 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:24:25.616268 I | osd0: 2017-07-11 13:24:25.616258 7fd81bad4c80 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:24:25.616303 I | osd0: 2017-07-11 13:24:25.616280 7fd81bad4c80 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:24:25.616327 I | osd0: 2017-07-11 13:24:25.616317 7fd81bad4c80 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:24:25.616349 I | osd0: 2017-07-11 13:24:25.616340 7fd81bad4c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:24:25.616384 I | osd0: 2017-07-11 13:24:25.616374 7fd81bad4c80 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:24:25.616408 I | osd0: 2017-07-11 13:24:25.616399 7fd81bad4c80 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:24:25.616431 I | osd0: 2017-07-11 13:24:25.616421 7fd81bad4c80 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:24:25.616465 I | osd0: 2017-07-11 13:24:25.616454 7fd81bad4c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:24:25.616671 I | osd0: 2017-07-11 13:24:25.616657 7fd81bad4c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:24:25.616711 I | osd0: 2017-07-11 13:24:25.616688 7fd81bad4c80 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:24:25.616739 I | osd0: 2017-07-11 13:24:25.616727 7fd81bad4c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:24:25.616763 I | osd0: 2017-07-11 13:24:25.616753 7fd81bad4c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:24:25.616801 I | osd0: 2017-07-11 13:24:25.616775 7fd81bad4c80 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:24:25.616825 I | osd0: 2017-07-11 13:24:25.616815 7fd81bad4c80 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:24:25.616848 I | osd0: 2017-07-11 13:24:25.616839 7fd81bad4c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:24:25.616884 I | osd0: 2017-07-11 13:24:25.616874 7fd81bad4c80 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:24:25.616908 I | osd0: 2017-07-11 13:24:25.616898 7fd81bad4c80 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:24:25.616930 I | osd0: 2017-07-11 13:24:25.616921 7fd81bad4c80 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:24:25.616965 I | osd0: 2017-07-11 13:24:25.616954 7fd81bad4c80 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:24:25.616989 I | osd0: 2017-07-11 13:24:25.616979 7fd81bad4c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:24:25.617011 I | osd0: 2017-07-11 13:24:25.617001 7fd81bad4c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:24:25.617046 I | osd0: 2017-07-11 13:24:25.617035 7fd81bad4c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:24:25.617071 I | osd0: 2017-07-11 13:24:25.617061 7fd81bad4c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:24:25.617110 I | osd0: 2017-07-11 13:24:25.617088 7fd81bad4c80 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:24:25.617137 I | osd0: 2017-07-11 13:24:25.617125 7fd81bad4c80 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:24:25.617160 I | osd0: 2017-07-11 13:24:25.617150 7fd81bad4c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:24:25.617195 I | osd0: 2017-07-11 13:24:25.617172 7fd81bad4c80 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:24:25.617219 I | osd0: 2017-07-11 13:24:25.617209 7fd81bad4c80 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:24:25.617241 I | osd0: 2017-07-11 13:24:25.617232 7fd81bad4c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:24:25.617276 I | osd0: 2017-07-11 13:24:25.617265 7fd81bad4c80 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:24:25.617299 I | osd0: 2017-07-11 13:24:25.617289 7fd81bad4c80 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:24:25.617325 I | osd0: 2017-07-11 13:24:25.617312 7fd81bad4c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:24:25.617363 I | osd0: 2017-07-11 13:24:25.617352 7fd81bad4c80 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:24:25.617385 I | osd0: 2017-07-11 13:24:25.617376 7fd81bad4c80 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:24:25.617421 I | osd0: 2017-07-11 13:24:25.617398 7fd81bad4c80 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:24:25.617452 I | osd0: 2017-07-11 13:24:25.617442 7fd81bad4c80 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:24:25.617475 I | osd0: 2017-07-11 13:24:25.617466 7fd81bad4c80 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:24:25.617514 I | osd0: 2017-07-11 13:24:25.617503 7fd81bad4c80 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:24:25.617537 I | osd0: 2017-07-11 13:24:25.617528 7fd81bad4c80 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:24:25.617575 I | osd0: 2017-07-11 13:24:25.617553 7fd81bad4c80 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:24:25.617864 I | osd0: 2017-07-11 13:24:25.617847 7fd81bad4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000005
- 2017-07-11 13:24:25.617890 I | osd0:
- 2017-07-11 13:24:25.618052 I | osd0: 2017-07-11 13:24:25.618036 7fd81bad4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:24:25.618085 I | osd0:
- 2017-07-11 13:24:25.618114 I | osd0: 2017-07-11 13:24:25.618101 7fd81bad4c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:24:25.618138 I | osd0: 2017-07-11 13:24:25.618128 7fd81bad4c80 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:24:25.618175 I | osd0: 2017-07-11 13:24:25.618164 7fd81bad4c80 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:24:25.618200 I | osd0: 2017-07-11 13:24:25.618190 7fd81bad4c80 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:24:25.618223 I | osd0: 2017-07-11 13:24:25.618213 7fd81bad4c80 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:24:25.618259 I | osd0: 2017-07-11 13:24:25.618248 7fd81bad4c80 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:24:25.618306 I | osd0: 2017-07-11 13:24:25.618291 7fd81bad4c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5567cd5161e0)
- 2017-07-11 13:24:25.618335 I | osd0: cache_index_and_filter_blocks: 0
- 2017-07-11 13:24:25.618346 I | osd0: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:24:25.618355 I | osd0: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:24:25.618365 I | osd0: index_type: 0
- 2017-07-11 13:24:25.618374 I | osd0: hash_index_allow_collision: 1
- 2017-07-11 13:24:25.618384 I | osd0: checksum: 1
- 2017-07-11 13:24:25.618406 I | osd0: no_block_cache: 0
- 2017-07-11 13:24:25.618416 I | osd0: block_cache: 0x5567cd53c620
- 2017-07-11 13:24:25.618425 I | osd0: block_cache_name: LRUCache
- 2017-07-11 13:24:25.618434 I | osd0: block_cache_options:
- 2017-07-11 13:24:25.618444 I | osd0: capacity : 107374182
- 2017-07-11 13:24:25.618453 I | osd0: num_shard_bits : 4
- 2017-07-11 13:24:25.618474 I | osd0: strict_capacity_limit : 0
- 2017-07-11 13:24:25.618484 I | osd0: high_pri_pool_ratio: 0.000
- 2017-07-11 13:24:25.618494 I | osd0: block_cache_compressed: (nil)
- 2017-07-11 13:24:25.618503 I | osd0: persistent_cache: (nil)
- 2017-07-11 13:24:25.618512 I | osd0: block_size: 4096
- 2017-07-11 13:24:25.618523 I | osd0: block_size_deviation: 10
- 2017-07-11 13:24:25.618532 I | osd0: block_restart_interval: 16
- 2017-07-11 13:24:25.618552 I | osd0: index_block_restart_interval: 1
- 2017-07-11 13:24:25.618563 I | osd0: filter_policy: nullptr
- 2017-07-11 13:24:25.618572 I | osd0: whole_key_filtering: 1
- 2017-07-11 13:24:25.618582 I | osd0: format_version: 2
- 2017-07-11 13:24:25.618590 I | osd0:
- 2017-07-11 13:24:25.618632 I | osd0: 2017-07-11 13:24:25.618603 7fd81bad4c80 4 rocksdb: Options.write_buffer_size: 67108864
- 2017-07-11 13:24:25.618658 I | osd0: 2017-07-11 13:24:25.618647 7fd81bad4c80 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:24:25.618682 I | osd0: 2017-07-11 13:24:25.618672 7fd81bad4c80 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:24:25.618719 I | osd0: 2017-07-11 13:24:25.618707 7fd81bad4c80 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:24:25.618743 I | osd0: 2017-07-11 13:24:25.618733 7fd81bad4c80 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:24:25.618764 I | osd0: 2017-07-11 13:24:25.618755 7fd81bad4c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:24:25.618806 I | osd0: 2017-07-11 13:24:25.618795 7fd81bad4c80 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:24:25.618830 I | osd0: 2017-07-11 13:24:25.618821 7fd81bad4c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:24:25.618864 I | osd0: 2017-07-11 13:24:25.618843 7fd81bad4c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:24:25.618889 I | osd0: 2017-07-11 13:24:25.618879 7fd81bad4c80 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:24:25.618912 I | osd0: 2017-07-11 13:24:25.618903 7fd81bad4c80 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:24:25.618947 I | osd0: 2017-07-11 13:24:25.618925 7fd81bad4c80 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:24:25.618971 I | osd0: 2017-07-11 13:24:25.618961 7fd81bad4c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:24:25.618993 I | osd0: 2017-07-11 13:24:25.618984 7fd81bad4c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:24:25.619028 I | osd0: 2017-07-11 13:24:25.619017 7fd81bad4c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:24:25.619052 I | osd0: 2017-07-11 13:24:25.619042 7fd81bad4c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:24:25.619073 I | osd0: 2017-07-11 13:24:25.619064 7fd81bad4c80 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:24:25.619111 I | osd0: 2017-07-11 13:24:25.619098 7fd81bad4c80 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:24:25.619135 I | osd0: 2017-07-11 13:24:25.619125 7fd81bad4c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:24:25.619156 I | osd0: 2017-07-11 13:24:25.619147 7fd81bad4c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:24:25.619194 I | osd0: 2017-07-11 13:24:25.619182 7fd81bad4c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:24:25.619217 I | osd0: 2017-07-11 13:24:25.619208 7fd81bad4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:24:25.619264 I | osd0: 2017-07-11 13:24:25.619232 7fd81bad4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:24:25.619315 I | osd0: 2017-07-11 13:24:25.619303 7fd81bad4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:24:25.619360 I | osd0: 2017-07-11 13:24:25.619349 7fd81bad4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:24:25.619383 I | osd0: 2017-07-11 13:24:25.619373 7fd81bad4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:24:25.619418 I | osd0: 2017-07-11 13:24:25.619407 7fd81bad4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:24:25.619446 I | osd0: 2017-07-11 13:24:25.619435 7fd81bad4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:24:25.619468 I | osd0: 2017-07-11 13:24:25.619459 7fd81bad4c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:24:25.619503 I | osd0: 2017-07-11 13:24:25.619492 7fd81bad4c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:24:25.619526 I | osd0: 2017-07-11 13:24:25.619516 7fd81bad4c80 4 rocksdb: Options.arena_block_size: 8388608
- 2017-07-11 13:24:25.619548 I | osd0: 2017-07-11 13:24:25.619538 7fd81bad4c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:24:25.619585 I | osd0: 2017-07-11 13:24:25.619574 7fd81bad4c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:24:25.619607 I | osd0: 2017-07-11 13:24:25.619597 7fd81bad4c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:24:25.619642 I | osd0: 2017-07-11 13:24:25.619619 7fd81bad4c80 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:24:25.619666 I | osd0: 2017-07-11 13:24:25.619656 7fd81bad4c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:24:25.619690 I | osd0: 2017-07-11 13:24:25.619680 7fd81bad4c80 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:24:25.619726 I | osd0: 2017-07-11 13:24:25.619715 7fd81bad4c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:24:25.619750 I | osd0: 2017-07-11 13:24:25.619740 7fd81bad4c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:24:25.619772 I | osd0: 2017-07-11 13:24:25.619763 7fd81bad4c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:24:25.619808 I | osd0: 2017-07-11 13:24:25.619797 7fd81bad4c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:24:25.619833 I | osd0: 2017-07-11 13:24:25.619822 7fd81bad4c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:24:25.619856 I | osd0: 2017-07-11 13:24:25.619846 7fd81bad4c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:24:25.619892 I | osd0: 2017-07-11 13:24:25.619881 7fd81bad4c80 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:24:25.619915 I | osd0: 2017-07-11 13:24:25.619906 7fd81bad4c80 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:24:25.619951 I | osd0: 2017-07-11 13:24:25.619928 7fd81bad4c80 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:24:25.619978 I | osd0: 2017-07-11 13:24:25.619966 7fd81bad4c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:24:25.620000 I | osd0: 2017-07-11 13:24:25.619990 7fd81bad4c80 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:24:25.620035 I | osd0: 2017-07-11 13:24:25.620012 7fd81bad4c80 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:24:25.620059 I | osd0: 2017-07-11 13:24:25.620049 7fd81bad4c80 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:24:25.620080 I | osd0: 2017-07-11 13:24:25.620071 7fd81bad4c80 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:24:25.620116 I | osd0: 2017-07-11 13:24:25.620105 7fd81bad4c80 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:24:25.620140 I | osd0: 2017-07-11 13:24:25.620130 7fd81bad4c80 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:24:25.620161 I | osd0: 2017-07-11 13:24:25.620152 7fd81bad4c80 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:24:25.621221 I | osd0: 2017-07-11 13:24:25.620830 7fd81bad4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/osd0/current/omap/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:24:25.621264 I | osd0:
- 2017-07-11 13:24:25.621282 I | osd0: 2017-07-11 13:24:25.620838 7fd81bad4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 4
- 2017-07-11 13:24:25.621294 I | osd0:
- 2017-07-11 13:24:25.621305 I | osd0: 2017-07-11 13:24:25.620872 7fd81bad4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779465620868, "job": 1, "event": "recovery_started", "log_files": [6]}
- 2017-07-11 13:24:25.621336 I | osd0: 2017-07-11 13:24:25.620875 7fd81bad4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #6 mode 2
- 2017-07-11 13:24:25.641721 I | osd0: 2017-07-11 13:24:25.641564 7fd81bad4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779465641557, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 882, "table_properties": {"data_size": 51, "index_size": 27, "filter_size": 0, "raw_key_size": 20, "raw_average_key_size": 20, "raw_value_size": 15, "raw_average_value_size": 15, "num_data_blocks": 1, "num_entries": 1, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:24:25.641763 I | osd0: 2017-07-11 13:24:25.641585 7fd81bad4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 8
- 2017-07-11 13:24:25.641777 I | osd0:
- 2017-07-11 13:24:25.736210 I | osd0: 2017-07-11 13:24:25.736171 7fd81bad4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779465736169, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:24:25.767780 I | osd0: 2017-07-11 13:24:25.767722 7fd81bad4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x5567cd8b6000
- 2017-07-11 13:24:25.768020 I | osd0: 2017-07-11 13:24:25.767999 7fd81bad4c80 0 filestore(/var/lib/rook/osd0) mount(1717): enabling WRITEAHEAD journal mode: checkpoint is not enabled
- 2017-07-11 13:24:25.768189 I | osd0: 2017-07-11 13:24:25.768165 7fd81bad4c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:25.803768 I | osd0: 2017-07-11 13:24:25.803745 7fd81bad4c80 0 osd.0 0 crush map has features 288232575208783872, adjusting msgr requires for clients
- 2017-07-11 13:24:25.803827 I | osd0: 2017-07-11 13:24:25.803812 7fd81bad4c80 0 osd.0 0 crush map has features 288232575208783872 was 8705, adjusting msgr requires for mons
- 2017-07-11 13:24:25.803862 I | osd0: 2017-07-11 13:24:25.803847 7fd81bad4c80 0 osd.0 0 crush map has features 288232575208783872, adjusting msgr requires for osds
- 2017-07-11 13:24:25.804003 I | osd0: 2017-07-11 13:24:25.803939 7fd81bad4c80 0 osd.0 0 load_pgs
- 2017-07-11 13:24:25.804070 I | osd0: 2017-07-11 13:24:25.804054 7fd81bad4c80 0 osd.0 0 load_pgs opened 0 pgs
- 2017-07-11 13:24:25.804101 I | osd0: 2017-07-11 13:24:25.804089 7fd81bad4c80 0 osd.0 0 using 1 op queue with priority op cut off at 64.
- 2017-07-11 13:24:25.811048 I | osd0: 2017-07-11 13:24:25.810643 7fd81bad4c80 -1 osd.0 0 log_to_monitors {default=true}
- 2017-07-11 13:24:26.627749 I | osd0: 2017-07-11 13:24:26.627519 7fd81bad4c80 0 osd.0 0 done with init, starting boot process
- 2017-07-11 13:24:26.629381 I | osd0: 2017-07-11 13:24:26.629356 7fd80123e700 -1 osd.0 0 waiting for initial osdmap
- 2017-07-11 13:24:26.654564 I | osd0: 2017-07-11 13:24:26.654153 7fd80da57700 0 osd.0 8 crush map has features 2200130813952, adjusting msgr requires for clients
- 2017-07-11 13:24:26.654603 I | osd0: 2017-07-11 13:24:26.654159 7fd80da57700 0 osd.0 8 crush map has features 2200130813952 was 288232575208792577, adjusting msgr requires for mons
- 2017-07-11 13:24:26.654636 I | osd0: 2017-07-11 13:24:26.654163 7fd80da57700 0 osd.0 8 crush map has features 720578140510109696, adjusting msgr requires for osds
- 2017-07-11 13:24:59.815640 I | osd0: 2017-07-11 13:24:59.815544 7fd81025c700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.826397 secs
- 2017-07-11 13:24:59.815729 I | osd0: 2017-07-11 13:24:59.815555 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 30.826397 seconds old, received at 2017-07-11 13:24:28.989049: osd_pg_create(e9 0.6:2 0.7:2 0.9:2 0.b:2 0.10:2 0.14:2 0.18:2 0.19:2 0.27:2 0.28:2 0.29:2 0.2c:2 0.31:2 0.3b:2 0.3d:2 0.42:2 0.44:2 0.46:2 0.49:2 0.50:2 0.53:2 0.55:2 0.59:2 0.5b:2 0.5d:2 0.5e:2 0.61:2 0.63:2 0.64:2 0.65:2 0.66:2 0.69:2 0.6b:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.82:2 0.83:2 0.90:2 0.9d:2 0.9f:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.a7:2 0.a8:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.ba:2 0.bb:2 0.bd:2 0.bf:2 0.c6:2 0.cd:2 0.d0:2 0.d3:2 0.d4:2 0.d6:2 0.d7:2 0.da:2 0.dd:2 0.e1:2 0.e3:2 0.e4:2 0.e5:2 0.e7:2 0.e8:2 0.e9:2 0.ed:2 0.ee:2 0.f4:2 0.f8:2 0.fc:2 0.fd:2 0.10c:2 0.10e:2 0.110:2 0.116:2 0.117:2 0.118:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.128:2 0.12a:2 0.12c:2 0.12f:2 0.132:2 0.135:2 0.140:2 0.141:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.160:2 0.163:2 0.166:2 0.16a:2 0.170:2 0.179:2 0.17b:2 0.17c:2 0.17e:2 0.17f:2 0.180:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.192:2 0.194:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b0:2 0.1b1:2 0.1b4:2 0.1b7:2 0.1b8:2 0.1b9:2 0.1ba:2 0.1be:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1ce:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1de:2 0.1e1:2 0.1e2:2 0.1e4:2 0.1e6:2 0.1eb:2 0.1ed:2 0.1f5:2 0.1f7:2 0.1f8:2 0.1fe:2 0.200:2 0.204:2 0.206:2 0.207:2 0.20a:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.214:2 0.216:2 0.21c:2 0.21e:2 0.227:2 0.228:2 0.22a:2 0.22b:2 0.22c:2 0.22d:2 0.231:2 0.23c:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.250:2 0.252:2 0.255:2 0.25b:2 0.25e:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26d:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.277:2 0.279:2 0.27f:2 0.282:2 0.286:2 0.28c:2 0.28f:2 0.292:2 0.294:2 0.295:2 0.296:2 0.298:2 0.299:2 0.29d:2 0.2a1:2 0.2a4:2 0.2ab:2 0.2ae:2 0.2b2:2 0.2b3:2 0.2b4:2 0.2b5:2 0.2bb:2 0.2bc:2 0.2be:2 0.2c1:2 0.2c4:2 0.2c5:2 0.2cb:2 0.2cd:2 0.2ce:2 0.2d2:2 0.2d3:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e7:2 0.2ee:2 0.2ef:2 0.2f0:2 0.2f6:2 0.2fa:2 0.2fb:2 0.304:2 0.306:2 0.309:2 0.30c:2 0.310:2 0.312:2 0.316:2 0.317:2 0.31a:2 0.31d:2 0.31e:2 0.31f:2 0.323:2 0.324:2 0.328:2 0.32b:2 0.32d:2 0.331:2 0.332:2 0.338:2 0.33b:2 0.33e:2 0.340:2 0.343:2 0.346:2 0.349:2 0.34d:2 0.351:2 0.352:2 0.355:2 0.356:2 0.358:2 0.35c:2 0.362:2 0.363:2 0.36b:2 0.372:2 0.373:2 0.374:2 0.377:2 0.378:2 0.37b:2 0.381:2 0.382:2 0.385:2 0.386:2 0.389:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.396:2 0.399:2 0.3a5:2 0.3a6:2 0.3a7:2 0.3a9:2 0.3ac:2 0.3af:2 0.3b6:2 0.3b7:2 0.3b8:2 0.3b9:2 0.3bc:2 0.3bd:2 0.3be:2 0.3c0:2 0.3c2:2 0.3c7:2 0.3ce:2 0.3cf:2 0.3d4:2 0.3d7:2 0.3d8:2 0.3de:2 0.3e6:2 0.3eb:2 0.3ed:2 0.3ee:2 0.3ef:2 0.3f3:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2) currently started
- 2017-07-11 13:25:29.821006 I | osd0: 2017-07-11 13:25:29.820915 7fd81025c700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 60.831826 secs
- 2017-07-11 13:25:29.821072 I | osd0: 2017-07-11 13:25:29.820934 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 60.831826 seconds old, received at 2017-07-11 13:24:28.989049: osd_pg_create(e9 0.6:2 0.7:2 0.9:2 0.b:2 0.10:2 0.14:2 0.18:2 0.19:2 0.27:2 0.28:2 0.29:2 0.2c:2 0.31:2 0.3b:2 0.3d:2 0.42:2 0.44:2 0.46:2 0.49:2 0.50:2 0.53:2 0.55:2 0.59:2 0.5b:2 0.5d:2 0.5e:2 0.61:2 0.63:2 0.64:2 0.65:2 0.66:2 0.69:2 0.6b:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.82:2 0.83:2 0.90:2 0.9d:2 0.9f:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.a7:2 0.a8:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.ba:2 0.bb:2 0.bd:2 0.bf:2 0.c6:2 0.cd:2 0.d0:2 0.d3:2 0.d4:2 0.d6:2 0.d7:2 0.da:2 0.dd:2 0.e1:2 0.e3:2 0.e4:2 0.e5:2 0.e7:2 0.e8:2 0.e9:2 0.ed:2 0.ee:2 0.f4:2 0.f8:2 0.fc:2 0.fd:2 0.10c:2 0.10e:2 0.110:2 0.116:2 0.117:2 0.118:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.128:2 0.12a:2 0.12c:2 0.12f:2 0.132:2 0.135:2 0.140:2 0.141:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.160:2 0.163:2 0.166:2 0.16a:2 0.170:2 0.179:2 0.17b:2 0.17c:2 0.17e:2 0.17f:2 0.180:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.192:2 0.194:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b0:2 0.1b1:2 0.1b4:2 0.1b7:2 0.1b8:2 0.1b9:2 0.1ba:2 0.1be:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1ce:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1de:2 0.1e1:2 0.1e2:2 0.1e4:2 0.1e6:2 0.1eb:2 0.1ed:2 0.1f5:2 0.1f7:2 0.1f8:2 0.1fe:2 0.200:2 0.204:2 0.206:2 0.207:2 0.20a:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.214:2 0.216:2 0.21c:2 0.21e:2 0.227:2 0.228:2 0.22a:2 0.22b:2 0.22c:2 0.22d:2 0.231:2 0.23c:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.250:2 0.252:2 0.255:2 0.25b:2 0.25e:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26d:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.277:2 0.279:2 0.27f:2 0.282:2 0.286:2 0.28c:2 0.28f:2 0.292:2 0.294:2 0.295:2 0.296:2 0.298:2 0.299:2 0.29d:2 0.2a1:2 0.2a4:2 0.2ab:2 0.2ae:2 0.2b2:2 0.2b3:2 0.2b4:2 0.2b5:2 0.2bb:2 0.2bc:2 0.2be:2 0.2c1:2 0.2c4:2 0.2c5:2 0.2cb:2 0.2cd:2 0.2ce:2 0.2d2:2 0.2d3:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e7:2 0.2ee:2 0.2ef:2 0.2f0:2 0.2f6:2 0.2fa:2 0.2fb:2 0.304:2 0.306:2 0.309:2 0.30c:2 0.310:2 0.312:2 0.316:2 0.317:2 0.31a:2 0.31d:2 0.31e:2 0.31f:2 0.323:2 0.324:2 0.328:2 0.32b:2 0.32d:2 0.331:2 0.332:2 0.338:2 0.33b:2 0.33e:2 0.340:2 0.343:2 0.346:2 0.349:2 0.34d:2 0.351:2 0.352:2 0.355:2 0.356:2 0.358:2 0.35c:2 0.362:2 0.363:2 0.36b:2 0.372:2 0.373:2 0.374:2 0.377:2 0.378:2 0.37b:2 0.381:2 0.382:2 0.385:2 0.386:2 0.389:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.396:2 0.399:2 0.3a5:2 0.3a6:2 0.3a7:2 0.3a9:2 0.3ac:2 0.3af:2 0.3b6:2 0.3b7:2 0.3b8:2 0.3b9:2 0.3bc:2 0.3bd:2 0.3be:2 0.3c0:2 0.3c2:2 0.3c7:2 0.3ce:2 0.3cf:2 0.3d4:2 0.3d7:2 0.3d8:2 0.3de:2 0.3e6:2 0.3eb:2 0.3ed:2 0.3ee:2 0.3ef:2 0.3f3:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2) currently started
- 2017-07-11 13:25:32.821717 I | osd0: 2017-07-11 13:25:32.821638 7fd81025c700 0 log_channel(cluster) log [WRN] : 8 slow requests, 5 included below; oldest blocked for > 62.492130 secs
- 2017-07-11 13:25:32.821795 I | osd0: 2017-07-11 13:25:32.821647 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 62.492130 seconds old, received at 2017-07-11 13:24:30.329295: osd_pg_create(e10 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:32.821824 I | osd0: 2017-07-11 13:25:32.821662 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 61.883204 seconds old, received at 2017-07-11 13:24:30.938221: osd_pg_create(e11 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:32.821865 I | osd0: 2017-07-11 13:25:32.821665 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 60.602348 seconds old, received at 2017-07-11 13:24:32.219078: osd_pg_create(e12 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:32.821889 I | osd0: 2017-07-11 13:25:32.821667 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 60.120760 seconds old, received at 2017-07-11 13:24:32.700666: osd_pg_create(e13 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:32.821925 I | osd0: 2017-07-11 13:25:32.821669 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 59.026349 seconds old, received at 2017-07-11 13:24:33.795077: osd_pg_create(e14 0.6:2 0.b:2 0.f:2 0.26:2 0.28:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f4:2 0.f8:2 0.112:2 0.117:2 0.119:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.154:2 0.16a:2 0.170:2 0.179:2 0.183:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f8:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24e:2 0.25f:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e5:2 0.2ee:2 0.2f3:2 0.2fa:2 0.304:2 0.316:2 0.317:2 0.31e:2 0.31f:2 0.320:2 0.324:2 0.328:2 0.332:2 0.343:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3e6:2 0.3f3:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:33.077130 I | osd0: 2017-07-11 13:25:33.077045 7fd80da57700 0 log_channel(cluster) log [WRN] : map e19 wrongly marked me down at e18
- 2017-07-11 13:25:33.821966 I | osd0: 2017-07-11 13:25:33.821843 7fd81025c700 0 log_channel(cluster) log [WRN] : 8 slow requests, 5 included below; oldest blocked for > 63.492492 secs
- 2017-07-11 13:25:33.822049 I | osd0: 2017-07-11 13:25:33.821863 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 63.492492 seconds old, received at 2017-07-11 13:24:30.329295: osd_pg_create(e10 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:33.822082 I | osd0: 2017-07-11 13:25:33.821869 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 62.883566 seconds old, received at 2017-07-11 13:24:30.938221: osd_pg_create(e11 0.5:2 0.f:2 0.14:2 0.17:2 0.19:2 0.21:2 0.26:2 0.28:2 0.29:2 0.3b:2 0.3f:2 0.44:2 0.47:2 0.49:2 0.55:2 0.5c:2 0.5d:2 0.64:2 0.69:2 0.73:2 0.78:2 0.7b:2 0.83:2 0.84:2 0.8b:2 0.8e:2 0.92:2 0.9d:2 0.a1:2 0.a2:2 0.a5:2 0.a6:2 0.ac:2 0.ad:2 0.b0:2 0.b4:2 0.b8:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.d8:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e7:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f9:2 0.fa:2 0.112:2 0.116:2 0.117:2 0.119:2 0.11b:2 0.11c:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12a:2 0.12c:2 0.12e:2 0.12f:2 0.134:2 0.147:2 0.149:2 0.14f:2 0.150:2 0.151:2 0.15e:2 0.160:2 0.169:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17a:2 0.182:2 0.183:2 0.186:2 0.189:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b7:2 0.1b9:2 0.1ba:2 0.1c0:2 0.1c7:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f6:2 0.1f8:2 0.200:2 0.206:2 0.207:2 0.20b:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.21f:2 0.227:2 0.228:2 0.22b:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23b:2 0.23c:2 0.23e:2 0.243:2 0.246:2 0.249:2 0.24c:2 0.24e:2 0.253:2 0.255:2 0.25b:2 0.25f:2 0.260:2 0.261:2 0.263:2 0.265:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.290:2 0.292:2 0.294:2 0.295:2 0.296:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b7:2 0.2b8:2 0.2b9:2 0.2bb:2 0.2be:2 0.2bf:2 0.2c0:2 0.2c4:2 0.2c5:2 0.2cd:2 0.2d0:2 0.2d3:2 0.2d7:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e0:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2e6:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.313:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.328:2 0.32d:2 0.332:2 0.338:2 0.343:2 0.34d:2 0.352:2 0.356:2 0.358:2 0.35c:2 0.360:2 0.366:2 0.36b:2 0.36d:2 0.372:2 0.373:2 0.377:2 0.37b:2 0.383:2 0.386:2 0.38d:2 0.391:2 0.3a3:2 0.3a5:2 0.3a6:2 0.3a9:2 0.3b3:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3ce:2 0.3d7:2 0.3d8:2 0.3e6:2 0.3e9:2 0.3ed:2 0.3ef:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f7:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:33.822112 I | osd0: 2017-07-11 13:25:33.821878 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 61.602710 seconds old, received at 2017-07-11 13:24:32.219078: osd_pg_create(e12 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:33.822134 I | osd0: 2017-07-11 13:25:33.821883 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 61.121121 seconds old, received at 2017-07-11 13:24:32.700666: osd_pg_create(e13 0.6:2 0.b:2 0.e:2 0.f:2 0.10:2 0.19:2 0.1d:2 0.26:2 0.28:2 0.2e:2 0.3b:2 0.40:2 0.44:2 0.49:2 0.4a:2 0.53:2 0.5c:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.6d:2 0.70:2 0.73:2 0.78:2 0.79:2 0.7b:2 0.8b:2 0.90:2 0.97:2 0.a1:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d1:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f2:2 0.f4:2 0.f8:2 0.101:2 0.111:2 0.112:2 0.114:2 0.117:2 0.119:2 0.11b:2 0.11d:2 0.120:2 0.122:2 0.129:2 0.12e:2 0.135:2 0.13e:2 0.147:2 0.149:2 0.150:2 0.151:2 0.154:2 0.157:2 0.163:2 0.164:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.182:2 0.183:2 0.186:2 0.18a:2 0.18d:2 0.18f:2 0.190:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1dc:2 0.1dd:2 0.1e6:2 0.1eb:2 0.1f0:2 0.1f5:2 0.1f8:2 0.204:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.227:2 0.22a:2 0.22c:2 0.22d:2 0.22f:2 0.230:2 0.231:2 0.23c:2 0.23e:2 0.246:2 0.249:2 0.24c:2 0.24d:2 0.24e:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.27d:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a6:2 0.2a9:2 0.2b2:2 0.2b4:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c0:2 0.2c4:2 0.2c6:2 0.2cd:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.303:2 0.304:2 0.30d:2 0.316:2 0.317:2 0.31a:2 0.31e:2 0.31f:2 0.320:2 0.323:2 0.324:2 0.326:2 0.328:2 0.332:2 0.333:2 0.338:2 0.343:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.362:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3ac:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c3:2 0.3c5:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3da:2 0.3e0:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3f5:2 0.3f6:2 0.3fb:2 0.3fc:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:33.822151 I | osd0: 2017-07-11 13:25:33.821889 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 60.026710 seconds old, received at 2017-07-11 13:24:33.795077: osd_pg_create(e14 0.6:2 0.b:2 0.f:2 0.26:2 0.28:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.a8:2 0.ac:2 0.ad:2 0.b4:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.dd:2 0.de:2 0.e3:2 0.e4:2 0.e8:2 0.ee:2 0.f4:2 0.f8:2 0.112:2 0.117:2 0.119:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.154:2 0.16a:2 0.170:2 0.179:2 0.183:2 0.18a:2 0.18d:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ab:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1bf:2 0.1c0:2 0.1cd:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.1f8:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24e:2 0.25f:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.294:2 0.295:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2dd:2 0.2de:2 0.2e1:2 0.2e5:2 0.2ee:2 0.2f3:2 0.2fa:2 0.304:2 0.316:2 0.317:2 0.31e:2 0.31f:2 0.320:2 0.324:2 0.328:2 0.332:2 0.343:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.386:2 0.38b:2 0.38d:2 0.391:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3e6:2 0.3f3:2 0.3fb:2 0.3fd:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:34.822208 I | osd0: 2017-07-11 13:25:34.822139 7fd81025c700 0 log_channel(cluster) log [WRN] : 8 slow requests, 3 included below; oldest blocked for > 64.492734 secs
- 2017-07-11 13:25:34.822281 I | osd0: 2017-07-11 13:25:34.822150 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 58.219143 seconds old, received at 2017-07-11 13:24:36.602887: osd_pg_create(e15 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.7f:2 0.8b:2 0.a1:2 0.a2:2 0.a6:2 0.a7:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.125:2 0.135:2 0.147:2 0.150:2 0.151:2 0.15a:2 0.16a:2 0.170:2 0.171:2 0.175:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.190:2 0.196:2 0.19c:2 0.1a0:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.21f:2 0.227:2 0.228:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.239:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.32a:2 0.332:2 0.338:2 0.346:2 0.34b:2 0.34d:2 0.35a:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39a:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:34.822362 I | osd0: 2017-07-11 13:25:34.822154 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 57.546311 seconds old, received at 2017-07-11 13:24:37.275719: osd_pg_create(e16 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:34.822389 I | osd0: 2017-07-11 13:25:34.822163 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 53.261450 seconds old, received at 2017-07-11 13:24:41.560579: osd_pg_create(e17 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:36.822565 I | osd0: 2017-07-11 13:25:36.822477 7fd81025c700 0 log_channel(cluster) log [WRN] : 8 slow requests, 1 included below; oldest blocked for > 66.493134 secs
- 2017-07-11 13:25:36.822685 I | osd0: 2017-07-11 13:25:36.822495 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 60.219543 seconds old, received at 2017-07-11 13:24:36.602887: osd_pg_create(e15 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.7f:2 0.8b:2 0.a1:2 0.a2:2 0.a6:2 0.a7:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d5:2 0.d7:2 0.dd:2 0.de:2 0.e1:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.125:2 0.135:2 0.147:2 0.150:2 0.151:2 0.15a:2 0.16a:2 0.170:2 0.171:2 0.175:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.190:2 0.196:2 0.19c:2 0.1a0:2 0.1a3:2 0.1a4:2 0.1a8:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.219:2 0.21f:2 0.227:2 0.228:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.239:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.27a:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b6:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d8:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.32a:2 0.332:2 0.338:2 0.346:2 0.34b:2 0.34d:2 0.35a:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.384:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39a:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:37.822760 I | osd0: 2017-07-11 13:25:37.822696 7fd81025c700 0 log_channel(cluster) log [WRN] : 8 slow requests, 1 included below; oldest blocked for > 67.493358 secs
- 2017-07-11 13:25:37.822824 I | osd0: 2017-07-11 13:25:37.822724 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 60.546935 seconds old, received at 2017-07-11 13:24:37.275719: osd_pg_create(e16 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:25:41.823524 I | osd0: 2017-07-11 13:25:41.823475 7fd81025c700 0 log_channel(cluster) log [WRN] : 8 slow requests, 1 included below; oldest blocked for > 71.494159 secs
- 2017-07-11 13:25:41.823549 I | osd0: 2017-07-11 13:25:41.823484 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 60.262875 seconds old, received at 2017-07-11 13:24:41.560579: osd_pg_create(e17 0.6:2 0.b:2 0.e:2 0.19:2 0.28:2 0.2e:2 0.3b:2 0.44:2 0.49:2 0.53:2 0.5d:2 0.5e:2 0.64:2 0.69:2 0.73:2 0.79:2 0.7b:2 0.8b:2 0.a2:2 0.a6:2 0.ad:2 0.b4:2 0.bb:2 0.c4:2 0.c6:2 0.cc:2 0.d0:2 0.d4:2 0.d7:2 0.dd:2 0.e3:2 0.e4:2 0.ee:2 0.f4:2 0.f8:2 0.111:2 0.112:2 0.117:2 0.119:2 0.11d:2 0.120:2 0.122:2 0.147:2 0.150:2 0.151:2 0.16a:2 0.170:2 0.171:2 0.179:2 0.17c:2 0.183:2 0.186:2 0.18a:2 0.196:2 0.19c:2 0.1a3:2 0.1a4:2 0.1ac:2 0.1ad:2 0.1b4:2 0.1b9:2 0.1c0:2 0.1cd:2 0.1cf:2 0.1d0:2 0.1d4:2 0.1e6:2 0.1eb:2 0.1f5:2 0.206:2 0.207:2 0.20b:2 0.20d:2 0.20e:2 0.20f:2 0.211:2 0.212:2 0.216:2 0.227:2 0.22c:2 0.22d:2 0.22f:2 0.231:2 0.23c:2 0.246:2 0.249:2 0.24c:2 0.255:2 0.25f:2 0.260:2 0.263:2 0.26e:2 0.270:2 0.271:2 0.272:2 0.273:2 0.277:2 0.282:2 0.28c:2 0.292:2 0.295:2 0.296:2 0.297:2 0.299:2 0.2a1:2 0.2a9:2 0.2b2:2 0.2b5:2 0.2b7:2 0.2bc:2 0.2be:2 0.2c4:2 0.2d0:2 0.2d2:2 0.2d9:2 0.2de:2 0.2e1:2 0.2e3:2 0.2e5:2 0.2eb:2 0.2ee:2 0.2f1:2 0.2f3:2 0.2fa:2 0.304:2 0.317:2 0.31a:2 0.31e:2 0.320:2 0.323:2 0.324:2 0.328:2 0.332:2 0.338:2 0.346:2 0.34d:2 0.35c:2 0.360:2 0.36d:2 0.372:2 0.373:2 0.374:2 0.377:2 0.37b:2 0.38b:2 0.38d:2 0.391:2 0.393:2 0.397:2 0.39e:2 0.3a5:2 0.3a6:2 0.3b6:2 0.3b8:2 0.3b9:2 0.3bd:2 0.3bf:2 0.3c0:2 0.3c7:2 0.3ce:2 0.3d7:2 0.3e6:2 0.3f2:2 0.3f3:2 0.3fb:2 0.3fd:2) currently wait for new map
- 2017-07-11 13:26:07.827426 I | osd0: 2017-07-11 13:26:07.827257 7fd81025c700 -1 osd.0 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:25:47.827254)
- 2017-07-11 13:26:08.827581 I | osd0: 2017-07-11 13:26:08.827476 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:25:48.827473)
- 2017-07-11 13:26:09.827760 I | osd0: 2017-07-11 13:26:09.827649 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:25:49.827647)
- 2017-07-11 13:26:10.827874 I | osd0: 2017-07-11 13:26:10.827800 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:25:50.827797)
- 2017-07-11 13:26:11.828189 I | osd0: 2017-07-11 13:26:11.827987 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:25:51.827984)
- 2017-07-11 13:26:12.828163 I | osd0: 2017-07-11 13:26:12.828079 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:25:52.828077)
- 2017-07-11 13:26:13.828302 I | osd0: 2017-07-11 13:26:13.828211 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:25:53.828198)
- 2017-07-11 13:26:14.828518 I | osd0: 2017-07-11 13:26:14.828409 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:25:54.828407)
- 2017-07-11 13:26:15.828699 I | osd0: 2017-07-11 13:26:15.828599 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:25:55.828597)
- 2017-07-11 13:26:16.828843 I | osd0: 2017-07-11 13:26:16.828747 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:25:56.828745)
- 2017-07-11 13:26:17.829046 I | osd0: 2017-07-11 13:26:17.828935 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:25:57.828930)
- 2017-07-11 13:26:18.829225 I | osd0: 2017-07-11 13:26:18.829050 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:25:58.829048)
- 2017-07-11 13:26:19.829242 I | osd0: 2017-07-11 13:26:19.829136 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:25:59.829134)
- 2017-07-11 13:26:20.829444 I | osd0: 2017-07-11 13:26:20.829300 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:00.829298)
- 2017-07-11 13:26:20.829529 I | osd0: 2017-07-11 13:26:20.829368 7fd81025c700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.071046 secs
- 2017-07-11 13:26:20.829619 I | osd0: 2017-07-11 13:26:20.829375 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 30.071046 seconds old, received at 2017-07-11 13:25:50.758281: osd_pg_create(e27 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27) currently started
- 2017-07-11 13:26:21.829548 I | osd0: 2017-07-11 13:26:21.829477 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:01.829476)
- 2017-07-11 13:26:22.829727 I | osd0: 2017-07-11 13:26:22.829573 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:02.829571)
- 2017-07-11 13:26:22.829807 I | osd0: 2017-07-11 13:26:22.829659 7fd81025c700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.543594 secs
- 2017-07-11 13:26:22.829829 I | osd0: 2017-07-11 13:26:22.829678 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 30.543594 seconds old, received at 2017-07-11 13:25:52.286024: osd_pg_create(e28 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28) currently started
- 2017-07-11 13:26:23.829853 I | osd0: 2017-07-11 13:26:23.829773 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:03.829771)
- 2017-07-11 13:26:24.830241 I | osd0: 2017-07-11 13:26:24.829976 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:04.829973)
- 2017-07-11 13:26:24.830353 I | osd0: 2017-07-11 13:26:24.830144 7fd81025c700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.142821 secs
- 2017-07-11 13:26:24.830396 I | osd0: 2017-07-11 13:26:24.830157 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 30.142821 seconds old, received at 2017-07-11 13:25:54.687199: osd_pg_create(e30 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30) currently started
- 2017-07-11 13:26:25.830396 I | osd0: 2017-07-11 13:26:25.830292 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:05.830290)
- 2017-07-11 13:26:26.830628 I | osd0: 2017-07-11 13:26:26.830469 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:06.830468)
- 2017-07-11 13:26:26.830700 I | osd0: 2017-07-11 13:26:26.830560 7fd81025c700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.597081 secs
- 2017-07-11 13:26:26.830723 I | osd0: 2017-07-11 13:26:26.830568 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 30.597081 seconds old, received at 2017-07-11 13:25:56.233433: osd_pg_create(e31 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31) currently started
- 2017-07-11 13:26:27.831062 I | osd0: 2017-07-11 13:26:27.830740 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:07.830738)
- 2017-07-11 13:26:27.831126 I | osd0: 2017-07-11 13:26:27.830890 7fd81025c700 0 log_channel(cluster) log [WRN] : 2 slow requests, 1 included below; oldest blocked for > 31.597350 secs
- 2017-07-11 13:26:27.831148 I | osd0: 2017-07-11 13:26:27.830901 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 30.309489 seconds old, received at 2017-07-11 13:25:57.521293: osd_pg_create(e32 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32) currently wait for new map
- 2017-07-11 13:26:28.773549 I | osd0: 2017-07-11 13:26:28.830936 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:08.830933)
- 2017-07-11 13:26:28.773620 I | osd0: 2017-07-11 13:26:28.831008 7fd81025c700 0 log_channel(cluster) log [WRN] : 3 slow requests, 1 included below; oldest blocked for > 32.597519 secs
- 2017-07-11 13:26:28.773646 I | osd0: 2017-07-11 13:26:28.831013 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 30.100007 seconds old, received at 2017-07-11 13:25:58.730944: osd_pg_create(e33 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33) currently wait for new map
- 2017-07-11 13:26:29.831251 I | osd0: 2017-07-11 13:26:29.831176 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:09.831174)
- 2017-07-11 13:26:30.831532 I | osd0: 2017-07-11 13:26:30.831370 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:10.831368)
- 2017-07-11 13:26:30.831631 I | osd0: 2017-07-11 13:26:30.831458 7fd81025c700 0 log_channel(cluster) log [WRN] : 4 slow requests, 1 included below; oldest blocked for > 34.597969 secs
- 2017-07-11 13:26:30.831668 I | osd0: 2017-07-11 13:26:30.831464 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 30.753834 seconds old, received at 2017-07-11 13:26:00.077568: osd_pg_create(e34 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:31.831920 I | osd0: 2017-07-11 13:26:31.831647 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:11.831644)
- 2017-07-11 13:26:31.831999 I | osd0: 2017-07-11 13:26:31.831820 7fd81025c700 0 log_channel(cluster) log [WRN] : 4 slow requests, 1 included below; oldest blocked for > 34.310429 secs
- 2017-07-11 13:26:31.832017 I | osd0: 2017-07-11 13:26:31.831831 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 30.375894 seconds old, received at 2017-07-11 13:26:01.455829: osd_pg_create(e35 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:32.832298 I | osd0: 2017-07-11 13:26:32.832060 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:12.832058)
- 2017-07-11 13:26:32.832405 I | osd0: 2017-07-11 13:26:32.832206 7fd81025c700 0 log_channel(cluster) log [WRN] : 4 slow requests, 1 included below; oldest blocked for > 34.101149 secs
- 2017-07-11 13:26:32.832486 I | osd0: 2017-07-11 13:26:32.832219 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 30.254009 seconds old, received at 2017-07-11 13:26:02.578084: osd_pg_create(e36 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:33.832505 I | osd0: 2017-07-11 13:26:33.832389 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:13.832387)
- 2017-07-11 13:26:33.832572 I | osd0: 2017-07-11 13:26:33.832453 7fd81025c700 0 log_channel(cluster) log [WRN] : 4 slow requests, 1 included below; oldest blocked for > 33.754838 secs
- 2017-07-11 13:26:33.832597 I | osd0: 2017-07-11 13:26:33.832459 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 30.052972 seconds old, received at 2017-07-11 13:26:03.779434: osd_pg_create(e37 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:34.832644 I | osd0: 2017-07-11 13:26:34.832573 7fd81025c700 -1 osd.0 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:14.832571)
- 2017-07-11 13:26:35.832834 I | osd0: 2017-07-11 13:26:35.832776 7fd81025c700 -1 osd.0 41 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:15.832774)
- 2017-07-11 13:26:36.834525 I | osd0: 2017-07-11 13:26:36.834449 7fd81025c700 -1 osd.0 41 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:16.834447)
- 2017-07-11 13:26:37.835074 I | osd0: 2017-07-11 13:26:37.834921 7fd81025c700 -1 osd.0 41 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:17.834919)
- 2017-07-11 13:26:38.835395 I | osd0: 2017-07-11 13:26:38.835117 7fd81025c700 -1 osd.0 41 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:18.835115)
- 2017-07-11 13:26:38.835502 I | osd0: 2017-07-11 13:26:38.835304 7fd81025c700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.076084 secs
- 2017-07-11 13:26:38.835519 I | osd0: 2017-07-11 13:26:38.835316 7fd81025c700 0 log_channel(cluster) log [WRN] : slow request 30.076084 seconds old, received at 2017-07-11 13:26:08.759104: osd_pg_create(e41 0.e:2 0.2e:2 0.8b:2 0.c4:2 0.cc:2 0.111:2 0.112:2 0.171:2 0.20e:2 0.22f:2 0.273:2 0.297:2 0.2a9:2 0.2b7:2 0.2d0:2 0.2eb:2 0.2f1:2 0.2f3:2 0.320:2 0.360:2 0.36d:2 0.397:2 0.39e:2 0.3bf:2 0.3f2:2 0.410:20 0.412:20 0.413:20 0.418:20 0.424:20 0.42a:20 0.42d:20 0.42e:20 0.42f:20 0.45d:20 0.45e:20 0.460:20 0.466:20 0.46c:20 0.46e:20 0.470:20 0.472:20 0.473:20 0.477:20 0.478:20 0.47a:20 0.48a:20 0.493:20 0.49c:20 0.4a2:20 0.4aa:20 0.4b1:23 0.4be:23 0.4c2:23 0.4c5:23 0.4c7:23 0.4ce:23 0.4d3:23 0.4d4:23 0.4da:23 0.4e2:23 0.4ee:23 0.4ef:23 0.4f2:23 0.4f3:23 0.501:23 0.507:23 0.50b:23 0.516:23 0.520:23 0.530:23 0.533:23 0.53f:23 0.549:23 0.54c:23 0.54d:23 0.550:24 0.555:24 0.561:24 0.565:24 0.56a:25 0.571:25 0.574:25 0.576:25 0.578:25 0.59a:25 0.59c:25 0.5a6:25 0.5a9:25 0.5b2:25 0.5b3:25 0.5b9:25 0.5bb:25 0.5bf:25 0.5c0:25 0.5c1:25 0.5c2:25 0.5c4:25 0.5cc:25 0.5cd:25 0.5da:25 0.5ef:25 0.5f5:25 0.5fb:25 0.5fc:25 0.5ff:25 0.603:25 0.607:25 0.611:25 0.618:25 0.625:26 0.637:26 0.63c:26 0.640:26 0.641:26 0.643:26 0.644:26 0.645:26 0.64b:27 0.64c:27 0.64d:27 0.652:27 0.654:27 0.65a:27 0.65b:27 0.65c:27 0.666:27 0.668:27 0.679:27 0.67a:27 0.67b:27 0.680:27 0.682:27 0.685:27 0.687:27 0.690:27 0.691:27 0.696:27 0.699:27 0.69a:27 0.69e:27 0.6a2:27 0.6b6:27 0.6b7:27 0.6b8:27 0.6c4:27 0.6c6:27 0.6ce:27 0.6da:28 0.6dd:28 0.6e0:28 0.6e2:28 0.6e5:29 0.6e8:30 0.6ea:30 0.6ee:30 0.6f0:30 0.6f6:31 0.6fc:31 0.70c:31 0.714:31 0.719:31 0.736:31 0.73b:31 0.748:31 0.74b:31 0.74f:31 0.758:31 0.75e:31 0.75f:31 0.760:31 0.763:31 0.766:31 0.76f:31 0.770:31 0.77c:31 0.782:31 0.783:31 0.787:31 0.78e:31 0.791:31 0.792:31 0.793:31 0.7a4:31 0.7ac:31 0.7ad:31 0.7b2:31 0.7b3:31 0.7c5:32 0.7c9:32 0.7cd:32 0.7d0:32 0.7d2:33 0.7d4:33 0.7d9:33 0.7dc:34 0.7dd:34 0.7f4:34 0.7fa:34) currently wait for new map
- 2017-07-11 13:26:39.835476 I | osd0: 2017-07-11 13:26:39.835416 7fd81025c700 -1 osd.0 60 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:19.835415)
- 2017-07-11 13:26:40.842998 I | osd0: 2017-07-11 13:26:40.842920 7fd81025c700 -1 osd.0 60 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:20.842918)
- 2017-07-11 13:26:41.846351 I | osd0: 2017-07-11 13:26:41.846247 7fd81025c700 -1 osd.0 60 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:21.846245)
- 2017-07-11 13:26:42.848611 I | osd0: 2017-07-11 13:26:42.848397 7fd81025c700 -1 osd.0 60 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:22.033161 (cutoff 2017-07-11 13:26:22.848396)
- 2017-07-11 13:26:42.848691 I | osd0: 2017-07-11 13:26:42.848413 7fd81025c700 -1 osd.0 60 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:22.848396)
- 2017-07-11 13:26:43.787857 I | osd0: 2017-07-11 13:26:43.848623 7fd81025c700 -1 osd.0 66 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:22.033161 (cutoff 2017-07-11 13:26:23.848604)
- 2017-07-11 13:26:43.787933 I | osd0: 2017-07-11 13:26:43.848651 7fd81025c700 -1 osd.0 66 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:23.848604)
- 2017-07-11 13:26:44.788292 I | osd0: 2017-07-11 13:26:44.788072 7fd81025c700 -1 osd.0 68 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:22.033161 (cutoff 2017-07-11 13:26:24.788069)
- 2017-07-11 13:26:44.788320 I | osd0: 2017-07-11 13:26:44.788104 7fd81025c700 -1 osd.0 68 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:24.788069)
- 2017-07-11 13:26:45.788305 I | osd0: 2017-07-11 13:26:45.788180 7fd81025c700 -1 osd.0 68 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:22.033161 (cutoff 2017-07-11 13:26:25.788178)
- 2017-07-11 13:26:45.788559 I | osd0: 2017-07-11 13:26:45.788399 7fd81025c700 -1 osd.0 68 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:47.620303 (cutoff 2017-07-11 13:26:25.788178)
- 2017-07-11 13:26:46.165058 I | osd0: 2017-07-11 13:26:46.164977 7fd80da57700 0 log_channel(cluster) log [WRN] : map e70 wrongly marked me down at e70
- 2017-07-11 13:27:06.791852 I | osd0: 2017-07-11 13:27:06.791788 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.771661 (cutoff 2017-07-11 13:26:46.791787)
- 2017-07-11 13:27:07.792111 I | osd0: 2017-07-11 13:27:07.791993 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.771661 (cutoff 2017-07-11 13:26:47.791991)
- 2017-07-11 13:27:08.792265 I | osd0: 2017-07-11 13:27:08.792188 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.771661 (cutoff 2017-07-11 13:26:48.792186)
- 2017-07-11 13:27:09.792633 I | osd0: 2017-07-11 13:27:09.792354 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.771661 (cutoff 2017-07-11 13:26:49.792351)
- 2017-07-11 13:27:09.792759 I | osd0: 2017-07-11 13:27:09.792394 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:26:49.792351)
- 2017-07-11 13:27:10.792872 I | osd0: 2017-07-11 13:27:10.792684 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.771661 (cutoff 2017-07-11 13:26:50.792682)
- 2017-07-11 13:27:10.792980 I | osd0: 2017-07-11 13:27:10.792723 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:26:50.792682)
- 2017-07-11 13:27:11.793080 I | osd0: 2017-07-11 13:27:11.792994 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.771661 (cutoff 2017-07-11 13:26:51.792984)
- 2017-07-11 13:27:11.793097 I | osd0: 2017-07-11 13:27:11.793008 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:26:51.792984)
- 2017-07-11 13:27:12.793276 I | osd0: 2017-07-11 13:27:12.793179 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.771661 (cutoff 2017-07-11 13:26:52.793177)
- 2017-07-11 13:27:12.793368 I | osd0: 2017-07-11 13:27:12.793207 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:26:52.793177)
- 2017-07-11 13:27:13.793504 I | osd0: 2017-07-11 13:27:13.793369 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.771661 (cutoff 2017-07-11 13:26:53.793366)
- 2017-07-11 13:27:13.793596 I | osd0: 2017-07-11 13:27:13.793409 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:26:53.793366)
- 2017-07-11 13:27:14.793893 I | osd0: 2017-07-11 13:27:14.793765 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.771661 (cutoff 2017-07-11 13:26:54.793762)
- 2017-07-11 13:27:14.793921 I | osd0: 2017-07-11 13:27:14.793803 7fd81025c700 -1 osd.0 81 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:26:54.793762)
- 2017-07-11 13:27:15.794019 I | osd0: 2017-07-11 13:27:15.793938 7fd81025c700 -1 osd.0 85 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.771661 (cutoff 2017-07-11 13:26:55.793936)
- 2017-07-11 13:27:15.794084 I | osd0: 2017-07-11 13:27:15.793964 7fd81025c700 -1 osd.0 85 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:26:55.793936)
- 2017-07-11 13:27:16.794283 I | osd0: 2017-07-11 13:27:16.794218 7fd81025c700 -1 osd.0 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:26:56.794216)
- 2017-07-11 13:27:17.794479 I | osd0: 2017-07-11 13:27:17.794406 7fd81025c700 -1 osd.0 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:26:57.794403)
- 2017-07-11 13:27:18.794617 I | osd0: 2017-07-11 13:27:18.794540 7fd81025c700 -1 osd.0 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:26:58.794539)
- 2017-07-11 13:27:19.794885 I | osd0: 2017-07-11 13:27:19.794817 7fd81025c700 -1 osd.0 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:26:59.794816)
- 2017-07-11 13:27:20.795108 I | osd0: 2017-07-11 13:27:20.795032 7fd81025c700 -1 osd.0 86 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:00.795030)
- 2017-07-11 13:27:21.795435 I | osd0: 2017-07-11 13:27:21.795308 7fd81025c700 -1 osd.0 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:01.795305)
- 2017-07-11 13:27:22.795636 I | osd0: 2017-07-11 13:27:22.795522 7fd81025c700 -1 osd.0 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:02.795520)
- 2017-07-11 13:27:23.795800 I | osd0: 2017-07-11 13:27:23.795719 7fd81025c700 -1 osd.0 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:03.795718)
- 2017-07-11 13:27:24.795996 I | osd0: 2017-07-11 13:27:24.795879 7fd81025c700 -1 osd.0 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:04.795876)
- 2017-07-11 13:27:25.796114 I | osd0: 2017-07-11 13:27:25.796036 7fd81025c700 -1 osd.0 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:05.796034)
- 2017-07-11 13:27:26.796373 I | osd0: 2017-07-11 13:27:26.796208 7fd81025c700 -1 osd.0 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:06.796205)
- 2017-07-11 13:27:27.796552 I | osd0: 2017-07-11 13:27:27.796410 7fd81025c700 -1 osd.0 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:07.796408)
- 2017-07-11 13:27:28.796639 I | osd0: 2017-07-11 13:27:28.796511 7fd81025c700 -1 osd.0 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:08.796510)
- 2017-07-11 13:27:29.797047 I | osd0: 2017-07-11 13:27:29.796881 7fd81025c700 -1 osd.0 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:09.796876)
- 2017-07-11 13:27:30.797254 I | osd0: 2017-07-11 13:27:30.797148 7fd81025c700 -1 osd.0 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:10.797145)
- 2017-07-11 13:27:31.797430 I | osd0: 2017-07-11 13:27:31.797368 7fd81025c700 -1 osd.0 88 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:11.797366)
- 2017-07-11 13:27:32.797577 I | osd0: 2017-07-11 13:27:32.797517 7fd81025c700 -1 osd.0 89 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:12.797516)
- 2017-07-11 13:27:33.797772 I | osd0: 2017-07-11 13:27:33.797685 7fd81025c700 -1 osd.0 89 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:13.797683)
- 2017-07-11 13:27:34.798070 I | osd0: 2017-07-11 13:27:34.797895 7fd81025c700 -1 osd.0 89 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:14.797892)
- 2017-07-11 13:27:35.798274 I | osd0: 2017-07-11 13:27:35.798155 7fd81025c700 -1 osd.0 89 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:49.578335 (cutoff 2017-07-11 13:27:15.798153)
- 2017-07-11 13:27:42.799370 I | osd0: 2017-07-11 13:27:42.799245 7fd81025c700 -1 osd.0 96 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.582768 (cutoff 2017-07-11 13:27:22.799243)
- 2017-07-11 13:27:43.799478 I | osd0: 2017-07-11 13:27:43.799374 7fd81025c700 -1 osd.0 96 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.582768 (cutoff 2017-07-11 13:27:23.799373)
- 2017-07-11 13:27:44.799771 I | osd0: 2017-07-11 13:27:44.799644 7fd81025c700 -1 osd.0 97 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.582768 (cutoff 2017-07-11 13:27:24.799641)
- 2017-07-11 13:27:45.800099 I | osd0: 2017-07-11 13:27:45.800020 7fd81025c700 -1 osd.0 97 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.582768 (cutoff 2017-07-11 13:27:25.800018)
- 2017-07-11 13:27:46.800313 I | osd0: 2017-07-11 13:27:46.800198 7fd81025c700 -1 osd.0 97 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.582768 (cutoff 2017-07-11 13:27:26.800194)
- 2017-07-11 13:27:47.800531 I | osd0: 2017-07-11 13:27:47.800380 7fd81025c700 -1 osd.0 97 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.582768 (cutoff 2017-07-11 13:27:27.800377)
- 2017-07-11 13:27:48.800734 I | osd0: 2017-07-11 13:27:48.800655 7fd81025c700 -1 osd.0 97 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.582768 (cutoff 2017-07-11 13:27:28.800653)
- 2017-07-11 13:27:49.800889 I | osd0: 2017-07-11 13:27:49.800809 7fd81025c700 -1 osd.0 97 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.582768 (cutoff 2017-07-11 13:27:29.800807)
- 2017-07-11 13:27:50.801074 I | osd0: 2017-07-11 13:27:50.800994 7fd81025c700 -1 osd.0 97 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.582768 (cutoff 2017-07-11 13:27:30.800993)
- 2017-07-11 13:27:51.801301 I | osd0: 2017-07-11 13:27:51.801167 7fd81025c700 -1 osd.0 97 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:22.582768 (cutoff 2017-07-11 13:27:31.801165)
- 2017-07-11 13:27:51.846609 I | osd0: 2017-07-11 13:27:51.845941 7fd80da57700 0 log_channel(cluster) log [WRN] : map e103 wrongly marked me down at e99
- 2017-07-11 13:28:12.805400 I | osd0: 2017-07-11 13:28:12.805271 7fd81025c700 -1 osd.0 119 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:52.805269)
- 2017-07-11 13:28:12.805466 I | osd0: 2017-07-11 13:28:12.805298 7fd81025c700 -1 osd.0 119 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:52.805269)
- 2017-07-11 13:28:13.805706 I | osd0: 2017-07-11 13:28:13.805599 7fd81025c700 -1 osd.0 119 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:53.805598)
- 2017-07-11 13:28:13.805775 I | osd0: 2017-07-11 13:28:13.805642 7fd81025c700 -1 osd.0 119 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:53.805598)
- 2017-07-11 13:28:14.806044 I | osd0: 2017-07-11 13:28:14.805960 7fd81025c700 -1 osd.0 119 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:54.805958)
- 2017-07-11 13:28:14.806062 I | osd0: 2017-07-11 13:28:14.805986 7fd81025c700 -1 osd.0 119 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:54.805958)
- 2017-07-11 13:28:15.806193 I | osd0: 2017-07-11 13:28:15.806108 7fd81025c700 -1 osd.0 122 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:55.806106)
- 2017-07-11 13:28:15.806271 I | osd0: 2017-07-11 13:28:15.806128 7fd81025c700 -1 osd.0 122 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:55.806106)
- 2017-07-11 13:28:16.806827 I | osd0: 2017-07-11 13:28:16.806767 7fd81025c700 -1 osd.0 122 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:56.806763)
- 2017-07-11 13:28:16.806881 I | osd0: 2017-07-11 13:28:16.806780 7fd81025c700 -1 osd.0 122 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:56.806763)
- 2017-07-11 13:28:17.807084 I | osd0: 2017-07-11 13:28:17.807014 7fd81025c700 -1 osd.0 124 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:57.807013)
- 2017-07-11 13:28:17.807149 I | osd0: 2017-07-11 13:28:17.807031 7fd81025c700 -1 osd.0 124 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:57.807013)
- 2017-07-11 13:28:18.807215 I | osd0: 2017-07-11 13:28:18.807108 7fd81025c700 -1 osd.0 124 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:58.807106)
- 2017-07-11 13:28:18.807232 I | osd0: 2017-07-11 13:28:18.807133 7fd81025c700 -1 osd.0 124 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:58.807106)
- 2017-07-11 13:28:19.807411 I | osd0: 2017-07-11 13:28:19.807315 7fd81025c700 -1 osd.0 124 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:59.807313)
- 2017-07-11 13:28:19.807481 I | osd0: 2017-07-11 13:28:19.807340 7fd81025c700 -1 osd.0 124 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:27:59.807313)
- 2017-07-11 13:28:20.807823 I | osd0: 2017-07-11 13:28:20.807688 7fd81025c700 -1 osd.0 124 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:00.807685)
- 2017-07-11 13:28:20.807878 I | osd0: 2017-07-11 13:28:20.807726 7fd81025c700 -1 osd.0 124 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:00.807685)
- 2017-07-11 13:28:21.808057 I | osd0: 2017-07-11 13:28:21.807880 7fd81025c700 -1 osd.0 124 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:01.807878)
- 2017-07-11 13:28:21.808173 I | osd0: 2017-07-11 13:28:21.807915 7fd81025c700 -1 osd.0 124 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:01.807878)
- 2017-07-11 13:28:22.808170 I | osd0: 2017-07-11 13:28:22.808053 7fd81025c700 -1 osd.0 124 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:02.808051)
- 2017-07-11 13:28:22.808233 I | osd0: 2017-07-11 13:28:22.808079 7fd81025c700 -1 osd.0 124 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:02.808051)
- 2017-07-11 13:28:23.808317 I | osd0: 2017-07-11 13:28:23.808221 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:03.808219)
- 2017-07-11 13:28:23.808385 I | osd0: 2017-07-11 13:28:23.808261 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:03.808219)
- 2017-07-11 13:28:24.808668 I | osd0: 2017-07-11 13:28:24.808495 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:04.808493)
- 2017-07-11 13:28:24.808780 I | osd0: 2017-07-11 13:28:24.808533 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:04.808493)
- 2017-07-11 13:28:25.808883 I | osd0: 2017-07-11 13:28:25.808802 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:05.808800)
- 2017-07-11 13:28:25.808956 I | osd0: 2017-07-11 13:28:25.808829 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:05.808800)
- 2017-07-11 13:28:26.809135 I | osd0: 2017-07-11 13:28:26.809038 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:06.809037)
- 2017-07-11 13:28:26.809195 I | osd0: 2017-07-11 13:28:26.809056 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:06.809037)
- 2017-07-11 13:28:27.809362 I | osd0: 2017-07-11 13:28:27.809281 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:07.809279)
- 2017-07-11 13:28:27.809422 I | osd0: 2017-07-11 13:28:27.809307 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:07.809279)
- 2017-07-11 13:28:28.809626 I | osd0: 2017-07-11 13:28:28.809448 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:08.809446)
- 2017-07-11 13:28:28.809713 I | osd0: 2017-07-11 13:28:28.809490 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:08.809446)
- 2017-07-11 13:28:29.809748 I | osd0: 2017-07-11 13:28:29.809688 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:09.809687)
- 2017-07-11 13:28:29.809812 I | osd0: 2017-07-11 13:28:29.809700 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:09.809687)
- 2017-07-11 13:28:30.809940 I | osd0: 2017-07-11 13:28:30.809855 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:10.809853)
- 2017-07-11 13:28:30.810003 I | osd0: 2017-07-11 13:28:30.809884 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:10.809853)
- 2017-07-11 13:28:31.810185 I | osd0: 2017-07-11 13:28:31.810069 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:11.810067)
- 2017-07-11 13:28:31.810208 I | osd0: 2017-07-11 13:28:31.810097 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:11.810067)
- 2017-07-11 13:28:32.810395 I | osd0: 2017-07-11 13:28:32.810319 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:12.810317)
- 2017-07-11 13:28:32.810465 I | osd0: 2017-07-11 13:28:32.810345 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:12.810317)
- 2017-07-11 13:28:33.810594 I | osd0: 2017-07-11 13:28:33.810510 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:13.810509)
- 2017-07-11 13:28:33.810675 I | osd0: 2017-07-11 13:28:33.810536 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:13.810509)
- 2017-07-11 13:28:34.810809 I | osd0: 2017-07-11 13:28:34.810724 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:14.810722)
- 2017-07-11 13:28:34.810827 I | osd0: 2017-07-11 13:28:34.810750 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:14.810722)
- 2017-07-11 13:28:35.811037 I | osd0: 2017-07-11 13:28:35.810906 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:15.810904)
- 2017-07-11 13:28:35.811135 I | osd0: 2017-07-11 13:28:35.810945 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:15.810904)
- 2017-07-11 13:28:36.811166 I | osd0: 2017-07-11 13:28:36.811090 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:16.811089)
- 2017-07-11 13:28:36.811237 I | osd0: 2017-07-11 13:28:36.811110 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:16.811089)
- 2017-07-11 13:28:37.811329 I | osd0: 2017-07-11 13:28:37.811243 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:17.811241)
- 2017-07-11 13:28:37.811398 I | osd0: 2017-07-11 13:28:37.811270 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:17.811241)
- 2017-07-11 13:28:38.811540 I | osd0: 2017-07-11 13:28:38.811413 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:18.811411)
- 2017-07-11 13:28:38.811558 I | osd0: 2017-07-11 13:28:38.811439 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:18.811411)
- 2017-07-11 13:28:39.811676 I | osd0: 2017-07-11 13:28:39.811590 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:19.811588)
- 2017-07-11 13:28:39.811748 I | osd0: 2017-07-11 13:28:39.811617 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:19.811588)
- 2017-07-11 13:28:40.812143 I | osd0: 2017-07-11 13:28:40.811931 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:20.811926)
- 2017-07-11 13:28:40.812255 I | osd0: 2017-07-11 13:28:40.811973 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:20.811926)
- 2017-07-11 13:28:41.812304 I | osd0: 2017-07-11 13:28:41.812133 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:21.812130)
- 2017-07-11 13:28:41.812423 I | osd0: 2017-07-11 13:28:41.812159 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:21.812130)
- 2017-07-11 13:28:42.812330 I | osd0: 2017-07-11 13:28:42.812247 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:22.812245)
- 2017-07-11 13:28:42.812402 I | osd0: 2017-07-11 13:28:42.812272 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:22.812245)
- 2017-07-11 13:28:43.812497 I | osd0: 2017-07-11 13:28:43.812368 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:23.812366)
- 2017-07-11 13:28:43.812617 I | osd0: 2017-07-11 13:28:43.812406 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:23.812366)
- 2017-07-11 13:28:44.812663 I | osd0: 2017-07-11 13:28:44.812574 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:24.812572)
- 2017-07-11 13:28:44.812730 I | osd0: 2017-07-11 13:28:44.812601 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:24.812572)
- 2017-07-11 13:28:45.812827 I | osd0: 2017-07-11 13:28:45.812741 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:25.812739)
- 2017-07-11 13:28:45.812890 I | osd0: 2017-07-11 13:28:45.812768 7fd81025c700 -1 osd.0 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:52.367470 (cutoff 2017-07-11 13:28:25.812739)
- 2017-07-11 13:28:46.711981 I | osd0: 2017-07-11 13:28:46.711675 7fd80da57700 0 log_channel(cluster) log [WRN] : map e127 wrongly marked me down at e127
- 2017-07-11 13:29:13.829245 I | osd0: 2017-07-11 13:29:13.829116 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:28:53.829113)
- 2017-07-11 13:29:13.829426 I | osd0: 2017-07-11 13:29:13.829142 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:28:53.829113)
- 2017-07-11 13:29:14.829429 I | osd0: 2017-07-11 13:29:14.829313 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:28:54.829311)
- 2017-07-11 13:29:14.829499 I | osd0: 2017-07-11 13:29:14.829340 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:28:54.829311)
- 2017-07-11 13:29:15.829624 I | osd0: 2017-07-11 13:29:15.829501 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:28:55.829499)
- 2017-07-11 13:29:15.829700 I | osd0: 2017-07-11 13:29:15.829543 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:28:55.829499)
- 2017-07-11 13:29:16.829784 I | osd0: 2017-07-11 13:29:16.829671 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:28:56.829667)
- 2017-07-11 13:29:16.829857 I | osd0: 2017-07-11 13:29:16.829685 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:28:56.829667)
- 2017-07-11 13:29:17.829958 I | osd0: 2017-07-11 13:29:17.829817 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:28:57.829814)
- 2017-07-11 13:29:17.830027 I | osd0: 2017-07-11 13:29:17.829864 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:28:57.829814)
- 2017-07-11 13:29:18.830064 I | osd0: 2017-07-11 13:29:18.829958 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:28:58.829956)
- 2017-07-11 13:29:18.830124 I | osd0: 2017-07-11 13:29:18.829983 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:28:58.829956)
- 2017-07-11 13:29:19.830284 I | osd0: 2017-07-11 13:29:19.830147 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:28:59.830144)
- 2017-07-11 13:29:19.830392 I | osd0: 2017-07-11 13:29:19.830186 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:28:59.830144)
- 2017-07-11 13:29:20.830441 I | osd0: 2017-07-11 13:29:20.830352 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:00.830350)
- 2017-07-11 13:29:20.830501 I | osd0: 2017-07-11 13:29:20.830377 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:00.830350)
- 2017-07-11 13:29:21.830568 I | osd0: 2017-07-11 13:29:21.830488 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:01.830486)
- 2017-07-11 13:29:21.830648 I | osd0: 2017-07-11 13:29:21.830511 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:01.830486)
- 2017-07-11 13:29:22.830719 I | osd0: 2017-07-11 13:29:22.830620 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:02.830618)
- 2017-07-11 13:29:22.830794 I | osd0: 2017-07-11 13:29:22.830646 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:02.830618)
- 2017-07-11 13:29:23.831030 I | osd0: 2017-07-11 13:29:23.830930 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:03.830917)
- 2017-07-11 13:29:23.831094 I | osd0: 2017-07-11 13:29:23.830959 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:03.830917)
- 2017-07-11 13:29:24.831165 I | osd0: 2017-07-11 13:29:24.831071 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:04.831070)
- 2017-07-11 13:29:24.831261 I | osd0: 2017-07-11 13:29:24.831085 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:04.831070)
- 2017-07-11 13:29:25.831292 I | osd0: 2017-07-11 13:29:25.831204 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:05.831203)
- 2017-07-11 13:29:25.831366 I | osd0: 2017-07-11 13:29:25.831222 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:05.831203)
- 2017-07-11 13:29:26.831453 I | osd0: 2017-07-11 13:29:26.831359 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:06.831358)
- 2017-07-11 13:29:26.831524 I | osd0: 2017-07-11 13:29:26.831374 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:06.831358)
- 2017-07-11 13:29:27.831587 I | osd0: 2017-07-11 13:29:27.831502 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:07.831500)
- 2017-07-11 13:29:27.831649 I | osd0: 2017-07-11 13:29:27.831514 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:07.831500)
- 2017-07-11 13:29:28.831743 I | osd0: 2017-07-11 13:29:28.831656 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:08.831654)
- 2017-07-11 13:29:28.831766 I | osd0: 2017-07-11 13:29:28.831683 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:08.831654)
- 2017-07-11 13:29:29.832065 I | osd0: 2017-07-11 13:29:29.831878 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:09.831876)
- 2017-07-11 13:29:29.832128 I | osd0: 2017-07-11 13:29:29.831905 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:09.831876)
- 2017-07-11 13:29:29.832144 I | osd0: 2017-07-11 13:29:29.831911 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:09.691782 front 2017-07-11 13:29:09.691782 (cutoff 2017-07-11 13:29:09.831876)
- 2017-07-11 13:29:30.832269 I | osd0: 2017-07-11 13:29:30.832086 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:10.832083)
- 2017-07-11 13:29:30.832361 I | osd0: 2017-07-11 13:29:30.832119 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:10.832083)
- 2017-07-11 13:29:30.832377 I | osd0: 2017-07-11 13:29:30.832127 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:09.691782 front 2017-07-11 13:29:09.691782 (cutoff 2017-07-11 13:29:10.832083)
- 2017-07-11 13:29:31.832400 I | osd0: 2017-07-11 13:29:31.832323 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:11.832322)
- 2017-07-11 13:29:31.832463 I | osd0: 2017-07-11 13:29:31.832338 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:11.832322)
- 2017-07-11 13:29:31.832479 I | osd0: 2017-07-11 13:29:31.832342 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:09.691782 front 2017-07-11 13:29:09.691782 (cutoff 2017-07-11 13:29:11.832322)
- 2017-07-11 13:29:32.832623 I | osd0: 2017-07-11 13:29:32.832474 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:12.832472)
- 2017-07-11 13:29:32.832705 I | osd0: 2017-07-11 13:29:32.832516 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:12.832472)
- 2017-07-11 13:29:32.832737 I | osd0: 2017-07-11 13:29:32.832520 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:09.691782 front 2017-07-11 13:29:09.691782 (cutoff 2017-07-11 13:29:12.832472)
- 2017-07-11 13:29:33.832798 I | osd0: 2017-07-11 13:29:33.832707 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:13.832705)
- 2017-07-11 13:29:33.832860 I | osd0: 2017-07-11 13:29:33.832729 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:13.832705)
- 2017-07-11 13:29:33.832878 I | osd0: 2017-07-11 13:29:33.832735 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:09.691782 front 2017-07-11 13:29:09.691782 (cutoff 2017-07-11 13:29:13.832705)
- 2017-07-11 13:29:34.832984 I | osd0: 2017-07-11 13:29:34.832893 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:14.832891)
- 2017-07-11 13:29:34.833056 I | osd0: 2017-07-11 13:29:34.832919 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:14.832891)
- 2017-07-11 13:29:34.833072 I | osd0: 2017-07-11 13:29:34.832923 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:09.691782 front 2017-07-11 13:29:09.691782 (cutoff 2017-07-11 13:29:14.832891)
- 2017-07-11 13:29:35.833163 I | osd0: 2017-07-11 13:29:35.833090 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:15.833089)
- 2017-07-11 13:29:35.833224 I | osd0: 2017-07-11 13:29:35.833106 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:15.833089)
- 2017-07-11 13:29:35.833240 I | osd0: 2017-07-11 13:29:35.833109 7fd81025c700 -1 osd.0 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:09.691782 front 2017-07-11 13:29:09.691782 (cutoff 2017-07-11 13:29:15.833089)
- 2017-07-11 13:29:36.833400 I | osd0: 2017-07-11 13:29:36.833314 7fd81025c700 -1 osd.0 132 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:16.833313)
- 2017-07-11 13:29:36.833481 I | osd0: 2017-07-11 13:29:36.833337 7fd81025c700 -1 osd.0 132 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:16.833313)
- 2017-07-11 13:29:37.833616 I | osd0: 2017-07-11 13:29:37.833483 7fd81025c700 -1 osd.0 132 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:17.833481)
- 2017-07-11 13:29:37.833726 I | osd0: 2017-07-11 13:29:37.833520 7fd81025c700 -1 osd.0 132 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:17.833481)
- 2017-07-11 13:29:38.833909 I | osd0: 2017-07-11 13:29:38.833738 7fd81025c700 -1 osd.0 132 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:18.833735)
- 2017-07-11 13:29:38.834023 I | osd0: 2017-07-11 13:29:38.833778 7fd81025c700 -1 osd.0 132 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:18.833735)
- 2017-07-11 13:29:39.834307 I | osd0: 2017-07-11 13:29:39.833981 7fd81025c700 -1 osd.0 132 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:19.833975)
- 2017-07-11 13:29:39.834386 I | osd0: 2017-07-11 13:29:39.834021 7fd81025c700 -1 osd.0 132 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:19.833975)
- 2017-07-11 13:29:39.834404 I | osd0: 2017-07-11 13:29:39.834029 7fd81025c700 -1 osd.0 132 heartbeat_check: no reply from 10.233.124.4:6805 osd.4 since back 2017-07-11 13:29:19.493296 front 2017-07-11 13:29:19.493296 (cutoff 2017-07-11 13:29:19.833975)
- 2017-07-11 13:29:40.834460 I | osd0: 2017-07-11 13:29:40.834313 7fd81025c700 -1 osd.0 132 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:20.834311)
- 2017-07-11 13:29:40.834546 I | osd0: 2017-07-11 13:29:40.834353 7fd81025c700 -1 osd.0 132 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:53.390054 (cutoff 2017-07-11 13:29:20.834311)
- 2017-07-11 13:29:40.834561 I | osd0: 2017-07-11 13:29:40.834361 7fd81025c700 -1 osd.0 132 heartbeat_check: no reply from 10.233.124.4:6805 osd.4 since back 2017-07-11 13:29:19.493296 front 2017-07-11 13:29:19.493296 (cutoff 2017-07-11 13:29:20.834311)
- 2017-07-11 13:29:41.780887 I | osd0: 2017-07-11 13:29:41.780814 7fd80da57700 0 log_channel(cluster) log [WRN] : map e133 wrongly marked me down at e133
- END logs from pod: rook-ceph-osd-gt66q
- BEGIN logs from pod: rook-ceph-osd-jjlkl
- 2017-07-11 13:24:19.757362 I | cephmon: parsing mon endpoints: rook-ceph-mon1=10.233.99.4:6790,rook-ceph-mon2=10.233.124.3:6790,rook-ceph-mon0=10.233.76.3:6790
- 2017-07-11 13:24:19.757920 I | cephmon: writing config file /var/lib/rook/rook/rook.config
- 2017-07-11 13:24:19.758078 I | cephmon: generated admin config in /var/lib/rook/rook
- 2017-07-11 13:24:19.758113 I | cephosd: discovering hardware
- 2017-07-11 13:24:19.758130 I | exec: Running command: lsblk --all --noheadings --list --output KNAME
- 2017-07-11 13:24:19.760390 I | exec: Running command: lsblk /dev/fd0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.767640 I | exec: Running command: sgdisk --print /dev/fd0
- 2017-07-11 13:24:19.818348 W | inventory: skipping device fd0 with an unknown uuid. Failed to complete get disk fd0 uuid: exit status 2
- 2017-07-11 13:24:19.818459 I | exec: Running command: lsblk /dev/loop0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.820118 I | exec: Running command: lsblk /dev/loop1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.821511 I | exec: Running command: lsblk /dev/loop2 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.822756 I | exec: Running command: lsblk /dev/loop3 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.824006 I | exec: Running command: lsblk /dev/loop4 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.830814 I | exec: Running command: lsblk /dev/loop5 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.832190 I | exec: Running command: lsblk /dev/loop6 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.833506 I | exec: Running command: lsblk /dev/loop7 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.840304 I | exec: Running command: lsblk /dev/sda --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.841744 I | exec: Running command: sgdisk --print /dev/sda
- 2017-07-11 13:24:19.850701 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:19.851720 I | exec: Running command: lsblk /dev/sda1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.853026 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:19.861333 I | exec: Running command: lsblk /dev/sdb --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.870573 I | exec: Running command: sgdisk --print /dev/sdb
- 2017-07-11 13:24:19.888813 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:19.890163 I | exec: Running command: lsblk /dev/sdb1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.891670 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:19.902737 I | exec: Running command: lsblk /dev/sr0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:19.904747 I | cephosd: creating and starting the osds
- 2017-07-11 13:24:19.904762 I | exec: Running command: lsblk /dev/sda --bytes --pairs --output NAME,SIZE,TYPE,PKNAME
- 2017-07-11 13:24:19.912398 I | exec: Running command: blkid /dev/sda1 -s PARTLABEL -o value
- 2017-07-11 13:24:19.914644 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:19.932493 I | cephosd: skipping device sda that is in use (not by rook). fs: ext4, ownPartitions: false
- 2017-07-11 13:24:19.932514 I | exec: Running command: lsblk /dev/sdb --bytes --pairs --output NAME,SIZE,TYPE,PKNAME
- 2017-07-11 13:24:19.948140 I | exec: Running command: blkid /dev/sdb1 -s PARTLABEL -o value
- 2017-07-11 13:24:19.949777 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:19.956848 I | cephosd: skipping device sdb that is in use (not by rook). fs: , ownPartitions: false
- 2017-07-11 13:24:19.956871 I | cephosd: configuring osd devices: &{Entries:map[]}
- 2017-07-11 13:24:19.956895 I | cephosd: configuring osd dirs: map[/var/lib/rook:-1]
- 2017-07-11 13:24:19.957011 I | exec: Running command: ceph osd create 73875ada-81e5-484d-a5cb-4fd39d3ea97f --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/898732313
- 2017-07-11 13:24:20.896611 I | cephosd: successfully created OSD 73875ada-81e5-484d-a5cb-4fd39d3ea97f with ID 1
- 2017-07-11 13:24:20.897035 I | cephmon: writing config file /var/lib/rook/osd1/rook.config
- 2017-07-11 13:24:20.897279 I | exec: Running command: ceph mon getmap --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/372700580
- 2017-07-11 13:24:21.401893 I | exec: got monmap epoch 3
- 2017-07-11 13:24:21.402129 I | cephosd: Initializing OSD 1 file system at /var/lib/rook/osd1...
- 2017-07-11 13:24:21.402345 I | proc: Running process ceph-osd with args: [--mkfs --mkkey --id=1 --cluster=rook --conf=/var/lib/rook/osd1/rook.config --osd-data=/var/lib/rook/osd1 --osd-uuid=73875ada-81e5-484d-a5cb-4fd39d3ea97f --monmap=/var/lib/rook/osd1/tmp/activate.monmap --osd-journal=/var/lib/rook/osd1/journal --keyring=/var/lib/rook/osd1/keyring]
- 2017-07-11 13:24:21.402384 I | exec: Running command: ceph-osd --mkfs --mkkey --id=1 --cluster=rook --conf=/var/lib/rook/osd1/rook.config --osd-data=/var/lib/rook/osd1 --osd-uuid=73875ada-81e5-484d-a5cb-4fd39d3ea97f --monmap=/var/lib/rook/osd1/tmp/activate.monmap --osd-journal=/var/lib/rook/osd1/journal --keyring=/var/lib/rook/osd1/keyring
- 2017-07-11 13:24:21.439826 I | mkfs-osd1: 2017-07-11 13:24:21.439768 7fccf0045c80 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 86
- 2017-07-11 13:24:21.573621 I | mkfs-osd1: 2017-07-11 13:24:21.573564 7fccf0045c80 0 filestore(/var/lib/rook/osd1) backend generic (magic 0xef53)
- 2017-07-11 13:24:21.699193 I | mkfs-osd1: 2017-07-11 13:24:21.699133 7fccf0045c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:21.848884 I | mkfs-osd1: 2017-07-11 13:24:21.848835 7fccf0045c80 0 filestore(/var/lib/rook/osd1) mkjournal(1061): created journal on /var/lib/rook/osd1/journal
- 2017-07-11 13:24:21.902549 I | mkfs-osd1: 2017-07-11 13:24:21.902505 7fccf0045c80 0 filestore(/var/lib/rook/osd1) backend generic (magic 0xef53)
- 2017-07-11 13:24:21.902947 I | mkfs-osd1: 2017-07-11 13:24:21.902923 7fccf0045c80 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
- 2017-07-11 13:24:21.903001 I | mkfs-osd1: 2017-07-11 13:24:21.902985 7fccf0045c80 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option
- 2017-07-11 13:24:21.903030 I | mkfs-osd1: 2017-07-11 13:24:21.903018 7fccf0045c80 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: splice() is disabled via 'filestore splice' config option
- 2017-07-11 13:24:21.998511 I | mkfs-osd1: 2017-07-11 13:24:21.998458 7fccf0045c80 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
- 2017-07-11 13:24:22.120296 I | mkfs-osd1: 2017-07-11 13:24:22.120238 7fccf0045c80 0 filestore(/var/lib/rook/osd1) limited size xattrs
- 2017-07-11 13:24:22.120643 I | mkfs-osd1: 2017-07-11 13:24:22.120623 7fccf0045c80 0 filestore(/var/lib/rook/osd1) start omap initiation
- 2017-07-11 13:24:22.120880 I | mkfs-osd1: 2017-07-11 13:24:22.120857 7fccf0045c80 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:24:22.120915 I | mkfs-osd1:
- 2017-07-11 13:24:22.120958 I | mkfs-osd1: 2017-07-11 13:24:22.120941 7fccf0045c80 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:24:22.121004 I | mkfs-osd1: 2017-07-11 13:24:22.120991 7fccf0045c80 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:24:22.121035 I | mkfs-osd1: 2017-07-11 13:24:22.121021 7fccf0045c80 4 rocksdb: DB SUMMARY
- 2017-07-11 13:24:22.121049 I | mkfs-osd1:
- 2017-07-11 13:24:22.121127 I | mkfs-osd1: 2017-07-11 13:24:22.121111 7fccf0045c80 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:24:22.121158 I | mkfs-osd1:
- 2017-07-11 13:24:22.121186 I | mkfs-osd1: 2017-07-11 13:24:22.121174 7fccf0045c80 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:24:22.121199 I | mkfs-osd1:
- 2017-07-11 13:24:22.121246 I | mkfs-osd1: 2017-07-11 13:24:22.121218 7fccf0045c80 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes
- 2017-07-11 13:24:22.121262 I | mkfs-osd1:
- 2017-07-11 13:24:22.121289 I | mkfs-osd1: 2017-07-11 13:24:22.121277 7fccf0045c80 4 rocksdb: SST files in /var/lib/rook/osd1/current/omap dir, Total Num: 0, files:
- 2017-07-11 13:24:22.121316 I | mkfs-osd1:
- 2017-07-11 13:24:22.121343 I | mkfs-osd1: 2017-07-11 13:24:22.121330 7fccf0045c80 4 rocksdb: Write Ahead Log file in /var/lib/rook/osd1/current/omap: 000003.log size: 0 ;
- 2017-07-11 13:24:22.121357 I | mkfs-osd1:
- 2017-07-11 13:24:22.121394 I | mkfs-osd1: 2017-07-11 13:24:22.121370 7fccf0045c80 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:24:22.121426 I | mkfs-osd1: 2017-07-11 13:24:22.121414 7fccf0045c80 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:24:22.121451 I | mkfs-osd1: 2017-07-11 13:24:22.121440 7fccf0045c80 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:24:22.121491 I | mkfs-osd1: 2017-07-11 13:24:22.121479 7fccf0045c80 4 rocksdb: Options.env: 0x564c8208e8e0
- 2017-07-11 13:24:22.121519 I | mkfs-osd1: 2017-07-11 13:24:22.121508 7fccf0045c80 4 rocksdb: Options.info_log: 0x564c831334a0
- 2017-07-11 13:24:22.121563 I | mkfs-osd1: 2017-07-11 13:24:22.121542 7fccf0045c80 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:24:22.121589 I | mkfs-osd1: 2017-07-11 13:24:22.121578 7fccf0045c80 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:24:22.121613 I | mkfs-osd1: 2017-07-11 13:24:22.121603 7fccf0045c80 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:24:22.121653 I | mkfs-osd1: 2017-07-11 13:24:22.121642 7fccf0045c80 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:24:22.121678 I | mkfs-osd1: 2017-07-11 13:24:22.121668 7fccf0045c80 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:24:22.121717 I | mkfs-osd1: 2017-07-11 13:24:22.121692 7fccf0045c80 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:24:22.121742 I | mkfs-osd1: 2017-07-11 13:24:22.121732 7fccf0045c80 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:24:22.121766 I | mkfs-osd1: 2017-07-11 13:24:22.121756 7fccf0045c80 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:24:22.121815 I | mkfs-osd1: 2017-07-11 13:24:22.121803 7fccf0045c80 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:24:22.121841 I | mkfs-osd1: 2017-07-11 13:24:22.121831 7fccf0045c80 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:24:22.121880 I | mkfs-osd1: 2017-07-11 13:24:22.121869 7fccf0045c80 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:24:22.121940 I | mkfs-osd1: 2017-07-11 13:24:22.121912 7fccf0045c80 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:24:22.122011 I | mkfs-osd1: 2017-07-11 13:24:22.121995 7fccf0045c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:24:22.122041 I | mkfs-osd1: 2017-07-11 13:24:22.122030 7fccf0045c80 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:24:22.122085 I | mkfs-osd1: 2017-07-11 13:24:22.122072 7fccf0045c80 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:24:22.122115 I | mkfs-osd1: 2017-07-11 13:24:22.122101 7fccf0045c80 4 rocksdb: Options.wal_dir: /var/lib/rook/osd1/current/omap
- 2017-07-11 13:24:22.122159 I | mkfs-osd1: 2017-07-11 13:24:22.122131 7fccf0045c80 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:24:22.122186 I | mkfs-osd1: 2017-07-11 13:24:22.122175 7fccf0045c80 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:24:22.122210 I | mkfs-osd1: 2017-07-11 13:24:22.122200 7fccf0045c80 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:24:22.122251 I | mkfs-osd1: 2017-07-11 13:24:22.122239 7fccf0045c80 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:24:22.122614 I | mkfs-osd1: 2017-07-11 13:24:22.122598 7fccf0045c80 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:24:22.122656 I | mkfs-osd1: 2017-07-11 13:24:22.122630 7fccf0045c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:24:22.122684 I | mkfs-osd1: 2017-07-11 13:24:22.122672 7fccf0045c80 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:24:22.122712 I | mkfs-osd1: 2017-07-11 13:24:22.122701 7fccf0045c80 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:24:22.122758 I | mkfs-osd1: 2017-07-11 13:24:22.122745 7fccf0045c80 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:24:22.122783 I | mkfs-osd1: 2017-07-11 13:24:22.122772 7fccf0045c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:24:22.122823 I | mkfs-osd1: 2017-07-11 13:24:22.122811 7fccf0045c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:24:22.122849 I | mkfs-osd1: 2017-07-11 13:24:22.122838 7fccf0045c80 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:24:22.122873 I | mkfs-osd1: 2017-07-11 13:24:22.122863 7fccf0045c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:24:22.122915 I | mkfs-osd1: 2017-07-11 13:24:22.122904 7fccf0045c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:24:22.122940 I | mkfs-osd1: 2017-07-11 13:24:22.122929 7fccf0045c80 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:24:22.122980 I | mkfs-osd1: 2017-07-11 13:24:22.122968 7fccf0045c80 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:24:22.123008 I | mkfs-osd1: 2017-07-11 13:24:22.122997 7fccf0045c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:24:22.123048 I | mkfs-osd1: 2017-07-11 13:24:22.123022 7fccf0045c80 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:24:22.123074 I | mkfs-osd1: 2017-07-11 13:24:22.123063 7fccf0045c80 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:24:22.123099 I | mkfs-osd1: 2017-07-11 13:24:22.123089 7fccf0045c80 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:24:22.123138 I | mkfs-osd1: 2017-07-11 13:24:22.123126 7fccf0045c80 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:24:22.123163 I | mkfs-osd1: 2017-07-11 13:24:22.123153 7fccf0045c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:24:22.123201 I | mkfs-osd1: 2017-07-11 13:24:22.123178 7fccf0045c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:24:22.123228 I | mkfs-osd1: 2017-07-11 13:24:22.123217 7fccf0045c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:24:22.123283 I | mkfs-osd1: 2017-07-11 13:24:22.123255 7fccf0045c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:24:22.123311 I | mkfs-osd1: 2017-07-11 13:24:22.123299 7fccf0045c80 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:24:22.123336 I | mkfs-osd1: 2017-07-11 13:24:22.123326 7fccf0045c80 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:24:22.123376 I | mkfs-osd1: 2017-07-11 13:24:22.123364 7fccf0045c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:24:22.123405 I | mkfs-osd1: 2017-07-11 13:24:22.123392 7fccf0045c80 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:24:22.123445 I | mkfs-osd1: 2017-07-11 13:24:22.123420 7fccf0045c80 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:24:22.123472 I | mkfs-osd1: 2017-07-11 13:24:22.123461 7fccf0045c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:24:22.123497 I | mkfs-osd1: 2017-07-11 13:24:22.123486 7fccf0045c80 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:24:22.123535 I | mkfs-osd1: 2017-07-11 13:24:22.123524 7fccf0045c80 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:24:22.123562 I | mkfs-osd1: 2017-07-11 13:24:22.123550 7fccf0045c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:24:22.123607 I | mkfs-osd1: 2017-07-11 13:24:22.123581 7fccf0045c80 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:24:22.123633 I | mkfs-osd1: 2017-07-11 13:24:22.123622 7fccf0045c80 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:24:22.123657 I | mkfs-osd1: 2017-07-11 13:24:22.123647 7fccf0045c80 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:24:22.123697 I | mkfs-osd1: 2017-07-11 13:24:22.123686 7fccf0045c80 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:24:22.123722 I | mkfs-osd1: 2017-07-11 13:24:22.123712 7fccf0045c80 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:24:22.123761 I | mkfs-osd1: 2017-07-11 13:24:22.123737 7fccf0045c80 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:24:22.123786 I | mkfs-osd1: 2017-07-11 13:24:22.123776 7fccf0045c80 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:24:22.123814 I | mkfs-osd1: 2017-07-11 13:24:22.123803 7fccf0045c80 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:24:22.124577 I | mkfs-osd1: 2017-07-11 13:24:22.124552 7fccf0045c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001
- 2017-07-11 13:24:22.124617 I | mkfs-osd1:
- 2017-07-11 13:24:22.124790 I | mkfs-osd1: 2017-07-11 13:24:22.124729 7fccf0045c80 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:24:22.124814 I | mkfs-osd1:
- 2017-07-11 13:24:22.124861 I | mkfs-osd1: 2017-07-11 13:24:22.124830 7fccf0045c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:24:22.124890 I | mkfs-osd1: 2017-07-11 13:24:22.124878 7fccf0045c80 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:24:22.124931 I | mkfs-osd1: 2017-07-11 13:24:22.124904 7fccf0045c80 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:24:22.124959 I | mkfs-osd1: 2017-07-11 13:24:22.124947 7fccf0045c80 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:24:22.124983 I | mkfs-osd1: 2017-07-11 13:24:22.124973 7fccf0045c80 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:24:22.125023 I | mkfs-osd1: 2017-07-11 13:24:22.125011 7fccf0045c80 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:24:22.125087 I | mkfs-osd1: 2017-07-11 13:24:22.125054 7fccf0045c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564c82f62218)
- 2017-07-11 13:24:22.125103 I | mkfs-osd1: cache_index_and_filter_blocks: 0
- 2017-07-11 13:24:22.125115 I | mkfs-osd1: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:24:22.125126 I | mkfs-osd1: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:24:22.125137 I | mkfs-osd1: index_type: 0
- 2017-07-11 13:24:22.125160 I | mkfs-osd1: hash_index_allow_collision: 1
- 2017-07-11 13:24:22.125174 I | mkfs-osd1: checksum: 1
- 2017-07-11 13:24:22.125185 I | mkfs-osd1: no_block_cache: 0
- 2017-07-11 13:24:22.125196 I | mkfs-osd1: block_cache: 0x564c82f88380
- 2017-07-11 13:24:22.125207 I | mkfs-osd1: block_cache_name: LRUCache
- 2017-07-11 13:24:22.125218 I | mkfs-osd1: block_cache_options:
- 2017-07-11 13:24:22.125241 I | mkfs-osd1: capacity : 107374182
- 2017-07-11 13:24:22.125253 I | mkfs-osd1: num_shard_bits : 4
- 2017-07-11 13:24:22.125264 I | mkfs-osd1: strict_capacity_limit : 0
- 2017-07-11 13:24:22.125275 I | mkfs-osd1: high_pri_pool_ratio: 0.000
- 2017-07-11 13:24:22.125288 I | mkfs-osd1: block_cache_compressed: (nil)
- 2017-07-11 13:24:22.125299 I | mkfs-osd1: persistent_cache: (nil)
- 2017-07-11 13:24:22.125323 I | mkfs-osd1: block_size: 4096
- 2017-07-11 13:24:22.125336 I | mkfs-osd1: block_size_deviation: 10
- 2017-07-11 13:24:22.125346 I | mkfs-osd1: block_restart_interval: 16
- 2017-07-11 13:24:22.125360 I | mkfs-osd1: index_block_restart_interval: 1
- 2017-07-11 13:24:22.125371 I | mkfs-osd1: filter_policy: nullptr
- 2017-07-11 13:24:22.125395 I | mkfs-osd1: whole_key_filtering: 1
- 2017-07-11 13:24:22.125408 I | mkfs-osd1: format_version: 2
- 2017-07-11 13:24:22.125419 I | mkfs-osd1:
- 2017-07-11 13:24:22.125446 I | mkfs-osd1: 2017-07-11 13:24:22.125432 7fccf0045c80 4 rocksdb: Options.write_buffer_size: 67108864
- 2017-07-11 13:24:22.125485 I | mkfs-osd1: 2017-07-11 13:24:22.125473 7fccf0045c80 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:24:22.125512 I | mkfs-osd1: 2017-07-11 13:24:22.125501 7fccf0045c80 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:24:22.125563 I | mkfs-osd1: 2017-07-11 13:24:22.125550 7fccf0045c80 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:24:22.125590 I | mkfs-osd1: 2017-07-11 13:24:22.125579 7fccf0045c80 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:24:22.125628 I | mkfs-osd1: 2017-07-11 13:24:22.125604 7fccf0045c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:24:22.125655 I | mkfs-osd1: 2017-07-11 13:24:22.125643 7fccf0045c80 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:24:22.125680 I | mkfs-osd1: 2017-07-11 13:24:22.125669 7fccf0045c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:24:22.125720 I | mkfs-osd1: 2017-07-11 13:24:22.125708 7fccf0045c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:24:22.125753 I | mkfs-osd1: 2017-07-11 13:24:22.125741 7fccf0045c80 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:24:22.125792 I | mkfs-osd1: 2017-07-11 13:24:22.125767 7fccf0045c80 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:24:22.125819 I | mkfs-osd1: 2017-07-11 13:24:22.125808 7fccf0045c80 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:24:22.125844 I | mkfs-osd1: 2017-07-11 13:24:22.125833 7fccf0045c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:24:22.125884 I | mkfs-osd1: 2017-07-11 13:24:22.125872 7fccf0045c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:24:22.125909 I | mkfs-osd1: 2017-07-11 13:24:22.125898 7fccf0045c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:24:22.125950 I | mkfs-osd1: 2017-07-11 13:24:22.125938 7fccf0045c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:24:22.125976 I | mkfs-osd1: 2017-07-11 13:24:22.125966 7fccf0045c80 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:24:22.126000 I | mkfs-osd1: 2017-07-11 13:24:22.125990 7fccf0045c80 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:24:22.126041 I | mkfs-osd1: 2017-07-11 13:24:22.126030 7fccf0045c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:24:22.126066 I | mkfs-osd1: 2017-07-11 13:24:22.126055 7fccf0045c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:24:22.126231 I | mkfs-osd1: 2017-07-11 13:24:22.126212 7fccf0045c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:24:22.126322 I | mkfs-osd1: 2017-07-11 13:24:22.126301 7fccf0045c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:24:22.126376 I | mkfs-osd1: 2017-07-11 13:24:22.126346 7fccf0045c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:24:22.126404 I | mkfs-osd1: 2017-07-11 13:24:22.126393 7fccf0045c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:24:22.126429 I | mkfs-osd1: 2017-07-11 13:24:22.126418 7fccf0045c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:24:22.126474 I | mkfs-osd1: 2017-07-11 13:24:22.126462 7fccf0045c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:24:22.126501 I | mkfs-osd1: 2017-07-11 13:24:22.126490 7fccf0045c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:24:22.126541 I | mkfs-osd1: 2017-07-11 13:24:22.126529 7fccf0045c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:24:22.126566 I | mkfs-osd1: 2017-07-11 13:24:22.126556 7fccf0045c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:24:22.126604 I | mkfs-osd1: 2017-07-11 13:24:22.126580 7fccf0045c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:24:22.126631 I | mkfs-osd1: 2017-07-11 13:24:22.126619 7fccf0045c80 4 rocksdb: Options.arena_block_size: 8388608
- 2017-07-11 13:24:22.126656 I | mkfs-osd1: 2017-07-11 13:24:22.126645 7fccf0045c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:24:22.126694 I | mkfs-osd1: 2017-07-11 13:24:22.126682 7fccf0045c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:24:22.126720 I | mkfs-osd1: 2017-07-11 13:24:22.126710 7fccf0045c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:24:22.126758 I | mkfs-osd1: 2017-07-11 13:24:22.126735 7fccf0045c80 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:24:22.126786 I | mkfs-osd1: 2017-07-11 13:24:22.126774 7fccf0045c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:24:22.126813 I | mkfs-osd1: 2017-07-11 13:24:22.126802 7fccf0045c80 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:24:22.126851 I | mkfs-osd1: 2017-07-11 13:24:22.126840 7fccf0045c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:24:22.126880 I | mkfs-osd1: 2017-07-11 13:24:22.126869 7fccf0045c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:24:22.126919 I | mkfs-osd1: 2017-07-11 13:24:22.126894 7fccf0045c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:24:22.126946 I | mkfs-osd1: 2017-07-11 13:24:22.126934 7fccf0045c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:24:22.126970 I | mkfs-osd1: 2017-07-11 13:24:22.126959 7fccf0045c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:24:22.127010 I | mkfs-osd1: 2017-07-11 13:24:22.126999 7fccf0045c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:24:22.127035 I | mkfs-osd1: 2017-07-11 13:24:22.127025 7fccf0045c80 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:24:22.127073 I | mkfs-osd1: 2017-07-11 13:24:22.127049 7fccf0045c80 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:24:22.127099 I | mkfs-osd1: 2017-07-11 13:24:22.127088 7fccf0045c80 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:24:22.127127 I | mkfs-osd1: 2017-07-11 13:24:22.127115 7fccf0045c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:24:22.127166 I | mkfs-osd1: 2017-07-11 13:24:22.127154 7fccf0045c80 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:24:22.127191 I | mkfs-osd1: 2017-07-11 13:24:22.127180 7fccf0045c80 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:24:22.127215 I | mkfs-osd1: 2017-07-11 13:24:22.127205 7fccf0045c80 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:24:22.127254 I | mkfs-osd1: 2017-07-11 13:24:22.127243 7fccf0045c80 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:24:22.127282 I | mkfs-osd1: 2017-07-11 13:24:22.127268 7fccf0045c80 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:24:22.127322 I | mkfs-osd1: 2017-07-11 13:24:22.127310 7fccf0045c80 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:24:22.127348 I | mkfs-osd1: 2017-07-11 13:24:22.127337 7fccf0045c80 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:24:22.128147 I | mkfs-osd1: 2017-07-11 13:24:22.128079 7fccf0045c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/osd1/current/omap/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:24:22.128188 I | mkfs-osd1:
- 2017-07-11 13:24:22.128204 I | mkfs-osd1: 2017-07-11 13:24:22.128087 7fccf0045c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 0
- 2017-07-11 13:24:22.128216 I | mkfs-osd1:
- 2017-07-11 13:24:22.128386 I | mkfs-osd1: 2017-07-11 13:24:22.128267 7fccf0045c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779462128260, "job": 1, "event": "recovery_started", "log_files": [3]}
- 2017-07-11 13:24:22.128423 I | mkfs-osd1: 2017-07-11 13:24:22.128273 7fccf0045c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #3 mode 2
- 2017-07-11 13:24:22.128511 I | mkfs-osd1: 2017-07-11 13:24:22.128470 7fccf0045c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 5
- 2017-07-11 13:24:22.128530 I | mkfs-osd1:
- 2017-07-11 13:24:22.249940 I | mkfs-osd1: 2017-07-11 13:24:22.249700 7fccf0045c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779462249695, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:24:22.328165 I | mkfs-osd1: 2017-07-11 13:24:22.328103 7fccf0045c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x564c83218000
- 2017-07-11 13:24:22.328455 I | mkfs-osd1: 2017-07-11 13:24:22.328427 7fccf0045c80 0 filestore(/var/lib/rook/osd1) mount(1717): enabling WRITEAHEAD journal mode: checkpoint is not enabled
- 2017-07-11 13:24:22.328646 I | mkfs-osd1: 2017-07-11 13:24:22.328622 7fccf0045c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:22.329093 I | mkfs-osd1: 2017-07-11 13:24:22.329002 7fccf0045c80 -1 filestore(/var/lib/rook/osd1) could not find #-1:7b3f43c4:::osd_superblock:0# in index: (2) No such file or directory
- 2017-07-11 13:24:23.020875 I | mkfs-osd1: 2017-07-11 13:24:23.020567 7fccf0045c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:217] Shutdown: canceling all background work
- 2017-07-11 13:24:23.020896 I | mkfs-osd1: 2017-07-11 13:24:23.020699 7fccf0045c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:343] Shutdown complete
- 2017-07-11 13:24:23.022025 I | mkfs-osd1: 2017-07-11 13:24:23.021097 7fccf0045c80 -1 created object store /var/lib/rook/osd1 for osd.1 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:24:23.022054 I | mkfs-osd1: 2017-07-11 13:24:23.021136 7fccf0045c80 -1 auth: error reading file: /var/lib/rook/osd1/keyring: can't open /var/lib/rook/osd1/keyring: (2) No such file or directory
- 2017-07-11 13:24:23.022066 I | mkfs-osd1: 2017-07-11 13:24:23.021229 7fccf0045c80 -1 created new key in keyring /var/lib/rook/osd1/keyring
- 2017-07-11 13:24:23.023256 I | mkfs-osd1: 2017-07-11 13:24:21.699133 7fccf0045c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:23.023411 I | mkfs-osd1: 2017-07-11 13:24:22.328622 7fccf0045c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:23.023434 I | mkfs-osd1: 2017-07-11 13:24:22.329002 7fccf0045c80 -1 filestore(/var/lib/rook/osd1) could not find #-1:7b3f43c4:::osd_superblock:0# in index: (2) No such file or directory
- 2017-07-11 13:24:23.023463 I | mkfs-osd1: 2017-07-11 13:24:23.021097 7fccf0045c80 -1 created object store /var/lib/rook/osd1 for osd.1 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:24:23.023488 I | mkfs-osd1: 2017-07-11 13:24:23.021136 7fccf0045c80 -1 auth: error reading file: /var/lib/rook/osd1/keyring: can't open /var/lib/rook/osd1/keyring: (2) No such file or directory
- 2017-07-11 13:24:23.023501 I | mkfs-osd1: 2017-07-11 13:24:23.021229 7fccf0045c80 -1 created new key in keyring /var/lib/rook/osd1/keyring
- 2017-07-11 13:24:23.023825 I | exec: Running command: ceph auth add osd.1 -i /var/lib/rook/osd1/keyring osd allow * mon allow profile osd --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/449661107
- 2017-07-11 13:24:23.832396 I | exec: added key for osd.1
- 2017-07-11 13:24:23.832641 I | cephosd: adding osd.1 (/var/lib/rook/osd1), bytes: 104022159360, weight: 0.0946, to crush map at 'root=default'
- 2017-07-11 13:24:23.832799 I | exec: Running command: ceph osd crush create-or-move 1 0.0946 root=default --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/102261366
- 2017-07-11 13:24:25.479199 I | exec: create-or-move updating item name 'osd.1' weight 0.0946 at location {root=default} to crush map
- 2017-07-11 13:24:25.479581 I | cephosd: starting osd 1 at /var/lib/rook/osd1
- 2017-07-11 13:24:25.480039 I | cephosd: Config file /var/lib/rook/osd1/rook.config:
- [global]
- enable experimental unrecoverable data corrupting features =
- run dir = /var/lib/rook/osd1
- mon initial members = rook-ceph-mon2 rook-ceph-mon0 rook-ceph-mon1
- log file = /dev/stdout
- mon cluster log file = /dev/stdout
- mon keyvaluedb = rocksdb
- debug default = 0
- debug rados = 0
- debug mon = 0
- debug osd = 0
- debug bluestore = 0
- debug filestore = 0
- debug journal = 0
- debug leveldb = 0
- filestore_omap_backend = rocksdb
- osd pg bits = 11
- osd pgp bits = 11
- osd pool default size = 1
- osd pool default min size = 1
- osd pool default pg num = 100
- osd pool default pgp num = 100
- osd max object name len = 256
- osd max object namespace len = 64
- osd objectstore = filestore
- rbd_default_features = 3
- fatal signal handlers = false
- [osd.1]
- keyring = /var/lib/rook/osd1/keyring
- osd journal size = 1024
- [mon.rook-ceph-mon1]
- name = rook-ceph-mon1
- mon addr = 10.233.99.4:6790
- [mon.rook-ceph-mon2]
- name = rook-ceph-mon2
- mon addr = 10.233.124.3:6790
- [mon.rook-ceph-mon0]
- name = rook-ceph-mon0
- mon addr = 10.233.76.3:6790
- 2017-07-11 13:24:25.480700 I | proc: no existing process found for binary ceph-osd and pattern '--osd-uuid=73875ada-81e5-484d-a5cb-4fd39d3ea97f'
- 2017-07-11 13:24:25.480937 I | proc: Starting process osd1 with args: [--foreground --id=1 --cluster=rook --osd-data=/var/lib/rook/osd1 --conf=/var/lib/rook/osd1/rook.config --keyring=/var/lib/rook/osd1/keyring --osd-uuid=73875ada-81e5-484d-a5cb-4fd39d3ea97f --osd-journal=/var/lib/rook/osd1/journal]
- 2017-07-11 13:24:25.480975 I | exec: Running command: ceph-osd --foreground --id=1 --cluster=rook --osd-data=/var/lib/rook/osd1 --conf=/var/lib/rook/osd1/rook.config --keyring=/var/lib/rook/osd1/keyring --osd-uuid=73875ada-81e5-484d-a5cb-4fd39d3ea97f --osd-journal=/var/lib/rook/osd1/journal
- 2017-07-11 13:24:25.487108 I | cephosd: 1/1 osd dirs succeeded on this node
- 2017-07-11 13:24:25.487261 I | sleeping a while to let the osds run...
- 2017-07-11 13:24:25.515583 I | osd1: 2017-07-11 13:24:25.515530 7f28e9cc8c80 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 178
- 2017-07-11 13:24:25.516807 I | osd1: starting osd.1 at - osd_data /var/lib/rook/osd1 /var/lib/rook/osd1/journal
- 2017-07-11 13:24:25.523142 I | osd1: 2017-07-11 13:24:25.517083 7f28e9cc8c80 0 pidfile_write: ignore empty --pid-file
- 2017-07-11 13:24:25.534408 I | osd1: 2017-07-11 13:24:25.534378 7f28e9cc8c80 0 load: jerasure load: lrc load: isa
- 2017-07-11 13:24:25.534729 I | osd1: 2017-07-11 13:24:25.534694 7f28e9cc8c80 0 filestore(/var/lib/rook/osd1) backend generic (magic 0xef53)
- 2017-07-11 13:24:25.535307 I | osd1: 2017-07-11 13:24:25.535286 7f28e9cc8c80 0 filestore(/var/lib/rook/osd1) backend generic (magic 0xef53)
- 2017-07-11 13:24:25.535660 I | osd1: 2017-07-11 13:24:25.535630 7f28e9cc8c80 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
- 2017-07-11 13:24:25.535713 I | osd1: 2017-07-11 13:24:25.535697 7f28e9cc8c80 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option
- 2017-07-11 13:24:25.535742 I | osd1: 2017-07-11 13:24:25.535730 7f28e9cc8c80 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: splice() is disabled via 'filestore splice' config option
- 2017-07-11 13:24:25.736549 I | osd1: 2017-07-11 13:24:25.736488 7f28e9cc8c80 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
- 2017-07-11 13:24:25.813915 I | osd1: 2017-07-11 13:24:25.811025 7f28e9cc8c80 0 filestore(/var/lib/rook/osd1) limited size xattrs
- 2017-07-11 13:24:25.842728 I | osd1: 2017-07-11 13:24:25.822674 7f28e9cc8c80 0 filestore(/var/lib/rook/osd1) start omap initiation
- 2017-07-11 13:24:25.843475 I | osd1: 2017-07-11 13:24:25.843421 7f28e9cc8c80 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:24:25.843514 I | osd1:
- 2017-07-11 13:24:25.843551 I | osd1: 2017-07-11 13:24:25.843532 7f28e9cc8c80 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:24:25.843599 I | osd1: 2017-07-11 13:24:25.843569 7f28e9cc8c80 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:24:25.843629 I | osd1: 2017-07-11 13:24:25.843616 7f28e9cc8c80 4 rocksdb: DB SUMMARY
- 2017-07-11 13:24:25.843643 I | osd1:
- 2017-07-11 13:24:25.843728 I | osd1: 2017-07-11 13:24:25.843712 7f28e9cc8c80 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:24:25.843804 I | osd1:
- 2017-07-11 13:24:25.843849 I | osd1: 2017-07-11 13:24:25.843834 7f28e9cc8c80 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:24:25.843864 I | osd1:
- 2017-07-11 13:24:25.843911 I | osd1: 2017-07-11 13:24:25.843883 7f28e9cc8c80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes
- 2017-07-11 13:24:25.843926 I | osd1:
- 2017-07-11 13:24:25.843956 I | osd1: 2017-07-11 13:24:25.843943 7f28e9cc8c80 4 rocksdb: SST files in /var/lib/rook/osd1/current/omap dir, Total Num: 0, files:
- 2017-07-11 13:24:25.843970 I | osd1:
- 2017-07-11 13:24:25.844011 I | osd1: 2017-07-11 13:24:25.843997 7f28e9cc8c80 4 rocksdb: Write Ahead Log file in /var/lib/rook/osd1/current/omap: 000006.log size: 98 ;
- 2017-07-11 13:24:25.844025 I | osd1:
- 2017-07-11 13:24:25.844063 I | osd1: 2017-07-11 13:24:25.844039 7f28e9cc8c80 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:24:25.844093 I | osd1: 2017-07-11 13:24:25.844081 7f28e9cc8c80 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:24:25.844166 I | osd1: 2017-07-11 13:24:25.844108 7f28e9cc8c80 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:24:25.844196 I | osd1: 2017-07-11 13:24:25.844184 7f28e9cc8c80 4 rocksdb: Options.env: 0x56068ebcf8e0
- 2017-07-11 13:24:25.844239 I | osd1: 2017-07-11 13:24:25.844227 7f28e9cc8c80 4 rocksdb: Options.info_log: 0x560690af8560
- 2017-07-11 13:24:25.844265 I | osd1: 2017-07-11 13:24:25.844254 7f28e9cc8c80 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:24:25.844304 I | osd1: 2017-07-11 13:24:25.844292 7f28e9cc8c80 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:24:25.844330 I | osd1: 2017-07-11 13:24:25.844319 7f28e9cc8c80 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:24:25.844372 I | osd1: 2017-07-11 13:24:25.844346 7f28e9cc8c80 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:24:25.844400 I | osd1: 2017-07-11 13:24:25.844387 7f28e9cc8c80 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:24:25.844425 I | osd1: 2017-07-11 13:24:25.844414 7f28e9cc8c80 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:24:25.844465 I | osd1: 2017-07-11 13:24:25.844453 7f28e9cc8c80 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:24:25.844492 I | osd1: 2017-07-11 13:24:25.844481 7f28e9cc8c80 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:24:25.844530 I | osd1: 2017-07-11 13:24:25.844506 7f28e9cc8c80 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:24:25.844558 I | osd1: 2017-07-11 13:24:25.844546 7f28e9cc8c80 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:24:25.844582 I | osd1: 2017-07-11 13:24:25.844571 7f28e9cc8c80 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:24:25.844624 I | osd1: 2017-07-11 13:24:25.844609 7f28e9cc8c80 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:24:25.844652 I | osd1: 2017-07-11 13:24:25.844640 7f28e9cc8c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:24:25.844692 I | osd1: 2017-07-11 13:24:25.844666 7f28e9cc8c80 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:24:25.844719 I | osd1: 2017-07-11 13:24:25.844707 7f28e9cc8c80 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:24:25.844745 I | osd1: 2017-07-11 13:24:25.844733 7f28e9cc8c80 4 rocksdb: Options.wal_dir: /var/lib/rook/osd1/current/omap
- 2017-07-11 13:24:25.844788 I | osd1: 2017-07-11 13:24:25.844776 7f28e9cc8c80 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:24:25.844815 I | osd1: 2017-07-11 13:24:25.844804 7f28e9cc8c80 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:24:25.844854 I | osd1: 2017-07-11 13:24:25.844842 7f28e9cc8c80 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:24:25.844880 I | osd1: 2017-07-11 13:24:25.844869 7f28e9cc8c80 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:24:25.844918 I | osd1: 2017-07-11 13:24:25.844894 7f28e9cc8c80 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:24:25.844963 I | osd1: 2017-07-11 13:24:25.844949 7f28e9cc8c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:24:25.845039 I | osd1: 2017-07-11 13:24:25.844980 7f28e9cc8c80 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:24:25.849749 I | osd1: 2017-07-11 13:24:25.849727 7f28e9cc8c80 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:24:25.849795 I | osd1: 2017-07-11 13:24:25.849760 7f28e9cc8c80 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:24:25.849823 I | osd1: 2017-07-11 13:24:25.849809 7f28e9cc8c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:24:25.849839 I | osd1: 2017-07-11 13:24:25.849829 7f28e9cc8c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:24:25.849854 I | osd1: 2017-07-11 13:24:25.849844 7f28e9cc8c80 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:24:25.849887 I | osd1: 2017-07-11 13:24:25.849870 7f28e9cc8c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:24:25.849904 I | osd1: 2017-07-11 13:24:25.849894 7f28e9cc8c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:24:25.849920 I | osd1: 2017-07-11 13:24:25.849910 7f28e9cc8c80 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:24:25.849935 I | osd1: 2017-07-11 13:24:25.849925 7f28e9cc8c80 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:24:25.849950 I | osd1: 2017-07-11 13:24:25.849940 7f28e9cc8c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:24:25.849975 I | osd1: 2017-07-11 13:24:25.849962 7f28e9cc8c80 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:24:25.849991 I | osd1: 2017-07-11 13:24:25.849982 7f28e9cc8c80 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:24:25.850006 I | osd1: 2017-07-11 13:24:25.849997 7f28e9cc8c80 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:24:25.850021 I | osd1: 2017-07-11 13:24:25.850012 7f28e9cc8c80 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:24:25.850044 I | osd1: 2017-07-11 13:24:25.850026 7f28e9cc8c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:24:25.850060 I | osd1: 2017-07-11 13:24:25.850050 7f28e9cc8c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:24:25.850075 I | osd1: 2017-07-11 13:24:25.850065 7f28e9cc8c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:24:25.850089 I | osd1: 2017-07-11 13:24:25.850080 7f28e9cc8c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:24:25.850105 I | osd1: 2017-07-11 13:24:25.850095 7f28e9cc8c80 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:24:25.850129 I | osd1: 2017-07-11 13:24:25.850117 7f28e9cc8c80 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:24:25.850145 I | osd1: 2017-07-11 13:24:25.850136 7f28e9cc8c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:24:25.850160 I | osd1: 2017-07-11 13:24:25.850151 7f28e9cc8c80 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:24:25.850200 I | osd1: 2017-07-11 13:24:25.850176 7f28e9cc8c80 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:24:25.850219 I | osd1: 2017-07-11 13:24:25.850209 7f28e9cc8c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:24:25.850233 I | osd1: 2017-07-11 13:24:25.850224 7f28e9cc8c80 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:24:25.850247 I | osd1: 2017-07-11 13:24:25.850238 7f28e9cc8c80 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:24:25.850262 I | osd1: 2017-07-11 13:24:25.850252 7f28e9cc8c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:24:25.850276 I | osd1: 2017-07-11 13:24:25.850267 7f28e9cc8c80 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:24:25.850297 I | osd1: 2017-07-11 13:24:25.850287 7f28e9cc8c80 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:24:25.850311 I | osd1: 2017-07-11 13:24:25.850302 7f28e9cc8c80 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:24:25.850326 I | osd1: 2017-07-11 13:24:25.850317 7f28e9cc8c80 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:24:25.850339 I | osd1: 2017-07-11 13:24:25.850331 7f28e9cc8c80 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:24:25.850352 I | osd1: 2017-07-11 13:24:25.850344 7f28e9cc8c80 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:24:25.850373 I | osd1: 2017-07-11 13:24:25.850363 7f28e9cc8c80 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:24:25.850390 I | osd1: 2017-07-11 13:24:25.850379 7f28e9cc8c80 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:24:25.850587 I | osd1: 2017-07-11 13:24:25.850542 7f28e9cc8c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000005
- 2017-07-11 13:24:25.850597 I | osd1:
- 2017-07-11 13:24:25.850730 I | osd1: 2017-07-11 13:24:25.850712 7f28e9cc8c80 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:24:25.850735 I | osd1:
- 2017-07-11 13:24:25.850752 I | osd1: 2017-07-11 13:24:25.850741 7f28e9cc8c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:24:25.850777 I | osd1: 2017-07-11 13:24:25.850766 7f28e9cc8c80 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:24:25.850792 I | osd1: 2017-07-11 13:24:25.850783 7f28e9cc8c80 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:24:25.850808 I | osd1: 2017-07-11 13:24:25.850798 7f28e9cc8c80 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:24:25.850822 I | osd1: 2017-07-11 13:24:25.850813 7f28e9cc8c80 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:24:25.850852 I | osd1: 2017-07-11 13:24:25.850832 7f28e9cc8c80 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:24:25.850889 I | osd1: 2017-07-11 13:24:25.850873 7f28e9cc8c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56069076c1e0)
- 2017-07-11 13:24:25.850893 I | osd1: cache_index_and_filter_blocks: 0
- 2017-07-11 13:24:25.850896 I | osd1: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:24:25.850898 I | osd1: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:24:25.850901 I | osd1: index_type: 0
- 2017-07-11 13:24:25.850903 I | osd1: hash_index_allow_collision: 1
- 2017-07-11 13:24:25.850906 I | osd1: checksum: 1
- 2017-07-11 13:24:25.850908 I | osd1: no_block_cache: 0
- 2017-07-11 13:24:25.850915 I | osd1: block_cache: 0x560690792620
- 2017-07-11 13:24:25.850917 I | osd1: block_cache_name: LRUCache
- 2017-07-11 13:24:25.850920 I | osd1: block_cache_options:
- 2017-07-11 13:24:25.850922 I | osd1: capacity : 107374182
- 2017-07-11 13:24:25.850924 I | osd1: num_shard_bits : 4
- 2017-07-11 13:24:25.850927 I | osd1: strict_capacity_limit : 0
- 2017-07-11 13:24:25.850929 I | osd1: high_pri_pool_ratio: 0.000
- 2017-07-11 13:24:25.850931 I | osd1: block_cache_compressed: (nil)
- 2017-07-11 13:24:25.850934 I | osd1: persistent_cache: (nil)
- 2017-07-11 13:24:25.850936 I | osd1: block_size: 4096
- 2017-07-11 13:24:25.850938 I | osd1: block_size_deviation: 10
- 2017-07-11 13:24:25.850940 I | osd1: block_restart_interval: 16
- 2017-07-11 13:24:25.850943 I | osd1: index_block_restart_interval: 1
- 2017-07-11 13:24:25.850945 I | osd1: filter_policy: nullptr
- 2017-07-11 13:24:25.850947 I | osd1: whole_key_filtering: 1
- 2017-07-11 13:24:25.850952 I | osd1: format_version: 2
- 2017-07-11 13:24:25.850954 I | osd1:
- 2017-07-11 13:24:25.850976 I | osd1: 2017-07-11 13:24:25.850964 7f28e9cc8c80 4 rocksdb: Options.write_buffer_size: 67108864
- 2017-07-11 13:24:25.850992 I | osd1: 2017-07-11 13:24:25.850982 7f28e9cc8c80 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:24:25.851025 I | osd1: 2017-07-11 13:24:25.850999 7f28e9cc8c80 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:24:25.851053 I | osd1: 2017-07-11 13:24:25.851041 7f28e9cc8c80 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:24:25.851069 I | osd1: 2017-07-11 13:24:25.851059 7f28e9cc8c80 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:24:25.851084 I | osd1: 2017-07-11 13:24:25.851075 7f28e9cc8c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:24:25.851105 I | osd1: 2017-07-11 13:24:25.851095 7f28e9cc8c80 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:24:25.851129 I | osd1: 2017-07-11 13:24:25.851118 7f28e9cc8c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:24:25.851145 I | osd1: 2017-07-11 13:24:25.851135 7f28e9cc8c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:24:25.851160 I | osd1: 2017-07-11 13:24:25.851150 7f28e9cc8c80 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:24:25.851174 I | osd1: 2017-07-11 13:24:25.851165 7f28e9cc8c80 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:24:25.851197 I | osd1: 2017-07-11 13:24:25.851180 7f28e9cc8c80 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:24:25.851214 I | osd1: 2017-07-11 13:24:25.851204 7f28e9cc8c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:24:25.851229 I | osd1: 2017-07-11 13:24:25.851220 7f28e9cc8c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:24:25.851244 I | osd1: 2017-07-11 13:24:25.851235 7f28e9cc8c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:24:25.851259 I | osd1: 2017-07-11 13:24:25.851250 7f28e9cc8c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:24:25.851283 I | osd1: 2017-07-11 13:24:25.851272 7f28e9cc8c80 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:24:25.851299 I | osd1: 2017-07-11 13:24:25.851289 7f28e9cc8c80 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:24:25.851315 I | osd1: 2017-07-11 13:24:25.851304 7f28e9cc8c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:24:25.851330 I | osd1: 2017-07-11 13:24:25.851320 7f28e9cc8c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:24:25.851356 I | osd1: 2017-07-11 13:24:25.851335 7f28e9cc8c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:24:25.851373 I | osd1: 2017-07-11 13:24:25.851362 7f28e9cc8c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:24:25.851387 I | osd1: 2017-07-11 13:24:25.851378 7f28e9cc8c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:24:25.851402 I | osd1: 2017-07-11 13:24:25.851392 7f28e9cc8c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:24:25.851420 I | osd1: 2017-07-11 13:24:25.851407 7f28e9cc8c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:24:25.851439 I | osd1: 2017-07-11 13:24:25.851429 7f28e9cc8c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:24:25.851454 I | osd1: 2017-07-11 13:24:25.851444 7f28e9cc8c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:24:25.851468 I | osd1: 2017-07-11 13:24:25.851459 7f28e9cc8c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:24:25.851484 I | osd1: 2017-07-11 13:24:25.851474 7f28e9cc8c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:24:25.851503 I | osd1: 2017-07-11 13:24:25.851489 7f28e9cc8c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:24:25.851522 I | osd1: 2017-07-11 13:24:25.851511 7f28e9cc8c80 4 rocksdb: Options.arena_block_size: 8388608
- 2017-07-11 13:24:25.851537 I | osd1: 2017-07-11 13:24:25.851527 7f28e9cc8c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:24:25.851554 I | osd1: 2017-07-11 13:24:25.851544 7f28e9cc8c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:24:25.851569 I | osd1: 2017-07-11 13:24:25.851559 7f28e9cc8c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:24:25.851591 I | osd1: 2017-07-11 13:24:25.851574 7f28e9cc8c80 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:24:25.851607 I | osd1: 2017-07-11 13:24:25.851597 7f28e9cc8c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:24:25.851623 I | osd1: 2017-07-11 13:24:25.851613 7f28e9cc8c80 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:24:25.851675 I | osd1: 2017-07-11 13:24:25.851629 7f28e9cc8c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:24:25.851705 I | osd1: 2017-07-11 13:24:25.851691 7f28e9cc8c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:24:25.851722 I | osd1: 2017-07-11 13:24:25.851711 7f28e9cc8c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:24:25.851737 I | osd1: 2017-07-11 13:24:25.851728 7f28e9cc8c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:24:25.851753 I | osd1: 2017-07-11 13:24:25.851743 7f28e9cc8c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:24:25.851777 I | osd1: 2017-07-11 13:24:25.851767 7f28e9cc8c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:24:25.851793 I | osd1: 2017-07-11 13:24:25.851783 7f28e9cc8c80 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:24:25.851809 I | osd1: 2017-07-11 13:24:25.851799 7f28e9cc8c80 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:24:25.851824 I | osd1: 2017-07-11 13:24:25.851814 7f28e9cc8c80 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:24:25.851849 I | osd1: 2017-07-11 13:24:25.851829 7f28e9cc8c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:24:25.851865 I | osd1: 2017-07-11 13:24:25.851855 7f28e9cc8c80 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:24:25.851880 I | osd1: 2017-07-11 13:24:25.851870 7f28e9cc8c80 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:24:25.851894 I | osd1: 2017-07-11 13:24:25.851885 7f28e9cc8c80 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:24:25.851909 I | osd1: 2017-07-11 13:24:25.851900 7f28e9cc8c80 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:24:25.851933 I | osd1: 2017-07-11 13:24:25.851922 7f28e9cc8c80 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:24:25.851949 I | osd1: 2017-07-11 13:24:25.851939 7f28e9cc8c80 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:24:25.851963 I | osd1: 2017-07-11 13:24:25.851954 7f28e9cc8c80 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:24:25.857404 I | osd1: 2017-07-11 13:24:25.857376 7f28e9cc8c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/osd1/current/omap/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:24:25.857413 I | osd1:
- 2017-07-11 13:24:25.857439 I | osd1: 2017-07-11 13:24:25.857425 7f28e9cc8c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 4
- 2017-07-11 13:24:25.857443 I | osd1:
- 2017-07-11 13:24:25.857542 I | osd1: 2017-07-11 13:24:25.857526 7f28e9cc8c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779465857521, "job": 1, "event": "recovery_started", "log_files": [6]}
- 2017-07-11 13:24:25.857565 I | osd1: 2017-07-11 13:24:25.857553 7f28e9cc8c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #6 mode 2
- 2017-07-11 13:24:25.878264 I | osd1: 2017-07-11 13:24:25.878225 7f28e9cc8c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779465878171, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 882, "table_properties": {"data_size": 51, "index_size": 27, "filter_size": 0, "raw_key_size": 20, "raw_average_key_size": 20, "raw_value_size": 15, "raw_average_value_size": 15, "num_data_blocks": 1, "num_entries": 1, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:24:25.878427 I | osd1: 2017-07-11 13:24:25.878410 7f28e9cc8c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 8
- 2017-07-11 13:24:25.878446 I | osd1:
- 2017-07-11 13:24:26.033019 I | osd1: 2017-07-11 13:24:26.032973 7f28e9cc8c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779466032967, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:24:26.077828 I | osd1: 2017-07-11 13:24:26.077785 7f28e9cc8c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x560690b0c000
- 2017-07-11 13:24:26.078172 I | osd1: 2017-07-11 13:24:26.078150 7f28e9cc8c80 0 filestore(/var/lib/rook/osd1) mount(1717): enabling WRITEAHEAD journal mode: checkpoint is not enabled
- 2017-07-11 13:24:26.078422 I | osd1: 2017-07-11 13:24:26.078353 7f28e9cc8c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:26.119114 I | osd1: 2017-07-11 13:24:26.119074 7f28e9cc8c80 0 osd.1 0 crush map has features 288232575208783872, adjusting msgr requires for clients
- 2017-07-11 13:24:26.119214 I | osd1: 2017-07-11 13:24:26.119198 7f28e9cc8c80 0 osd.1 0 crush map has features 288232575208783872 was 8705, adjusting msgr requires for mons
- 2017-07-11 13:24:26.119268 I | osd1: 2017-07-11 13:24:26.119253 7f28e9cc8c80 0 osd.1 0 crush map has features 288232575208783872, adjusting msgr requires for osds
- 2017-07-11 13:24:26.119374 I | osd1: 2017-07-11 13:24:26.119354 7f28e9cc8c80 0 osd.1 0 load_pgs
- 2017-07-11 13:24:26.119506 I | osd1: 2017-07-11 13:24:26.119463 7f28e9cc8c80 0 osd.1 0 load_pgs opened 0 pgs
- 2017-07-11 13:24:26.119569 I | osd1: 2017-07-11 13:24:26.119538 7f28e9cc8c80 0 osd.1 0 using 1 op queue with priority op cut off at 64.
- 2017-07-11 13:24:26.125730 I | osd1: 2017-07-11 13:24:26.125708 7f28e9cc8c80 -1 osd.1 0 log_to_monitors {default=true}
- 2017-07-11 13:24:26.626508 I | osd1: 2017-07-11 13:24:26.626481 7f28e9cc8c80 0 osd.1 0 done with init, starting boot process
- 2017-07-11 13:24:26.628044 I | osd1: 2017-07-11 13:24:26.628000 7f28cf432700 -1 osd.1 0 waiting for initial osdmap
- 2017-07-11 13:24:26.653333 I | osd1: 2017-07-11 13:24:26.652178 7f28dbc4b700 0 osd.1 8 crush map has features 2200130813952, adjusting msgr requires for clients
- 2017-07-11 13:24:26.653420 I | osd1: 2017-07-11 13:24:26.652185 7f28dbc4b700 0 osd.1 8 crush map has features 2200130813952 was 288232575208792577, adjusting msgr requires for mons
- 2017-07-11 13:24:26.653439 I | osd1: 2017-07-11 13:24:26.652188 7f28dbc4b700 0 osd.1 8 crush map has features 720578140510109696, adjusting msgr requires for osds
- 2017-07-11 13:24:30.365072 I | osd1: 2017-07-11 13:24:30.365002 7f28e2481700 0 -- 10.233.76.4:6801/178 >> 10.233.72.0:6801/180 conn(0x560690c87000 :6801 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 0 vs existing csq=0 existing_state=STATE_CONNECTING_RE
- 2017-07-11 13:24:45.185301 I | osd1: 2017-07-11 13:24:45.185206 7f28e1c80700 0 -- 10.233.76.4:6801/178 >> 10.233.72.0:6801/180 conn(0x560691877000 :6801 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 0 vs existing csq=0 existing_state=STATE_CONNECTING_RE
- 2017-07-11 13:24:51.131473 I | osd1: 2017-07-11 13:24:51.131273 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:31.131271)
- 2017-07-11 13:24:52.131708 I | osd1: 2017-07-11 13:24:52.131578 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:32.131575)
- 2017-07-11 13:24:53.131881 I | osd1: 2017-07-11 13:24:53.131789 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:33.131786)
- 2017-07-11 13:24:54.132002 I | osd1: 2017-07-11 13:24:54.131892 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:34.131890)
- 2017-07-11 13:24:55.132154 I | osd1: 2017-07-11 13:24:55.132031 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:35.132028)
- 2017-07-11 13:24:56.140778 I | osd1: 2017-07-11 13:24:56.140680 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:36.140679)
- 2017-07-11 13:24:57.140932 I | osd1: 2017-07-11 13:24:57.140856 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:37.140855)
- 2017-07-11 13:24:58.141169 I | osd1: 2017-07-11 13:24:58.141096 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:38.141093)
- 2017-07-11 13:24:59.141718 I | osd1: 2017-07-11 13:24:59.141509 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:39.141508)
- 2017-07-11 13:24:59.141817 I | osd1: 2017-07-11 13:24:59.141621 7f28de450700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.086934 secs
- 2017-07-11 13:24:59.141856 I | osd1: 2017-07-11 13:24:59.141647 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.086934 seconds old, received at 2017-07-11 13:24:29.054610: osd_pg_create(e9 0.1:2 0.4:2 0.8:2 0.c:2 0.11:2 0.12:2 0.13:2 0.16:2 0.1a:2 0.1b:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.2b:2 0.33:2 0.34:2 0.36:2 0.37:2 0.38:2 0.39:2 0.3c:2 0.40:2 0.41:2 0.43:2 0.4b:2 0.4d:2 0.4e:2 0.52:2 0.57:2 0.5a:2 0.5f:2 0.62:2 0.67:2 0.6d:2 0.74:2 0.75:2 0.80:2 0.81:2 0.84:2 0.86:2 0.87:2 0.8c:2 0.8d:2 0.8f:2 0.92:2 0.93:2 0.96:2 0.99:2 0.9a:2 0.9b:2 0.9c:2 0.a4:2 0.a9:2 0.aa:2 0.ae:2 0.af:2 0.b1:2 0.b2:2 0.b7:2 0.b9:2 0.be:2 0.c1:2 0.c7:2 0.c9:2 0.cf:2 0.db:2 0.df:2 0.e6:2 0.f0:2 0.f1:2 0.f2:2 0.f3:2 0.f5:2 0.f6:2 0.fa:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.106:2 0.109:2 0.10b:2 0.10d:2 0.113:2 0.114:2 0.115:2 0.11a:2 0.121:2 0.124:2 0.125:2 0.12b:2 0.130:2 0.136:2 0.137:2 0.139:2 0.13a:2 0.13b:2 0.13c:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14b:2 0.14d:2 0.155:2 0.156:2 0.158:2 0.159:2 0.15b:2 0.15d:2 0.161:2 0.164:2 0.165:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.178:2 0.17d:2 0.184:2 0.187:2 0.18c:2 0.18e:2 0.18f:2 0.190:2 0.191:2 0.193:2 0.197:2 0.199:2 0.19a:2 0.19b:2 0.19d:2 0.1a1:2 0.1a2:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b2:2 0.1b3:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1c9:2 0.1d1:2 0.1d3:2 0.1d9:2 0.1da:2 0.1dd:2 0.1e0:2 0.1e3:2 0.1e5:2 0.1e7:2 0.1e8:2 0.1ea:2 0.1ee:2 0.1f1:2 0.1f2:2 0.1f3:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fb:2 0.1fc:2 0.1fd:2 0.1ff:2 0.202:2 0.208:2 0.209:2 0.20c:2 0.210:2 0.213:2 0.215:2 0.219:2 0.21b:2 0.220:2 0.221:2 0.225:2 0.229:2 0.22e:2 0.230:2 0.233:2 0.234:2 0.236:2 0.238:2 0.240:2 0.241:2 0.244:2 0.245:2 0.24b:2 0.24f:2 0.256:2 0.257:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.268:2 0.26c:2 0.26f:2 0.274:2 0.275:2 0.278:2 0.27b:2 0.27c:2 0.27d:2 0.27e:2 0.281:2 0.284:2 0.287:2 0.288:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.293:2 0.29b:2 0.29c:2 0.29f:2 0.2a2:2 0.2a3:2 0.2a5:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ad:2 0.2b0:2 0.2b6:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2bd:2 0.2c0:2 0.2c3:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2cf:2 0.2d4:2 0.2d6:2 0.2d8:2 0.2da:2 0.2dc:2 0.2e6:2 0.2e8:2 0.2f2:2 0.2f4:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2fd:2 0.2ff:2 0.301:2 0.302:2 0.303:2 0.305:2 0.307:2 0.30b:2 0.30d:2 0.30f:2 0.311:2 0.314:2 0.315:2 0.318:2 0.319:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.336:2 0.339:2 0.33a:2 0.33d:2 0.347:2 0.348:2 0.34a:2 0.34e:2 0.34f:2 0.350:2 0.353:2 0.357:2 0.35b:2 0.35d:2 0.35e:2 0.35f:2 0.361:2 0.366:2 0.368:2 0.369:2 0.36f:2 0.370:2 0.371:2 0.375:2 0.376:2 0.37c:2 0.37e:2 0.380:2 0.384:2 0.387:2 0.38a:2 0.38e:2 0.390:2 0.392:2 0.395:2 0.39a:2 0.39b:2 0.39c:2 0.39d:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b3:2 0.3b4:2 0.3b5:2 0.3ba:2 0.3c1:2 0.3c3:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cc:2 0.3cd:2 0.3d1:2 0.3d2:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3da:2 0.3db:2 0.3dc:2 0.3dd:2 0.3df:2 0.3e0:2 0.3e2:2 0.3e3:2 0.3e5:2 0.3e7:2 0.3ea:2 0.3ec:2 0.3f0:2 0.3f1:2 0.3f4:2 0.3f8:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:00.038862 I | osd1: 2017-07-11 13:25:00.030769 7f28e1c80700 0 -- 10.233.76.4:6801/178 >> 10.233.72.0:6801/180 conn(0x560691878800 :6801 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 0 vs existing csq=0 existing_state=STATE_CONNECTING_RE
- 2017-07-11 13:25:00.141875 I | osd1: 2017-07-11 13:25:00.141780 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:40.141779)
- 2017-07-11 13:25:01.142021 I | osd1: 2017-07-11 13:25:01.141941 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:41.141939)
- 2017-07-11 13:25:02.142198 I | osd1: 2017-07-11 13:25:02.142105 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:42.142104)
- 2017-07-11 13:25:03.142367 I | osd1: 2017-07-11 13:25:03.142267 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:43.142266)
- 2017-07-11 13:25:04.142691 I | osd1: 2017-07-11 13:25:04.142601 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:44.142600)
- 2017-07-11 13:25:05.142915 I | osd1: 2017-07-11 13:25:05.142795 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:45.142794)
- 2017-07-11 13:25:06.143031 I | osd1: 2017-07-11 13:25:06.142965 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:46.142963)
- 2017-07-11 13:25:07.143172 I | osd1: 2017-07-11 13:25:07.143098 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:47.143095)
- 2017-07-11 13:25:08.143309 I | osd1: 2017-07-11 13:25:08.143230 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:48.143229)
- 2017-07-11 13:25:09.143435 I | osd1: 2017-07-11 13:25:09.143332 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:49.143331)
- 2017-07-11 13:25:10.143537 I | osd1: 2017-07-11 13:25:10.143469 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:50.143468)
- 2017-07-11 13:25:11.143713 I | osd1: 2017-07-11 13:25:11.143582 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:51.143580)
- 2017-07-11 13:25:12.143873 I | osd1: 2017-07-11 13:25:12.143800 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:52.143799)
- 2017-07-11 13:25:13.144138 I | osd1: 2017-07-11 13:25:13.144040 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:53.144037)
- 2017-07-11 13:25:14.144277 I | osd1: 2017-07-11 13:25:14.144200 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:54.144198)
- 2017-07-11 13:25:14.858059 I | osd1: 2017-07-11 13:25:14.857992 7f28e1c80700 0 -- 10.233.76.4:6801/178 >> 10.233.72.0:6801/180 conn(0x560691c1e000 :6801 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 0 vs existing csq=0 existing_state=STATE_CONNECTING_RE
- 2017-07-11 13:25:15.144451 I | osd1: 2017-07-11 13:25:15.144371 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:55.144370)
- 2017-07-11 13:25:16.144695 I | osd1: 2017-07-11 13:25:16.144582 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:56.144580)
- 2017-07-11 13:25:17.144870 I | osd1: 2017-07-11 13:25:17.144756 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:57.144755)
- 2017-07-11 13:25:18.145002 I | osd1: 2017-07-11 13:25:18.144922 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:58.144906)
- 2017-07-11 13:25:19.145214 I | osd1: 2017-07-11 13:25:19.145105 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:24:59.145104)
- 2017-07-11 13:25:20.145391 I | osd1: 2017-07-11 13:25:20.145277 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:00.145275)
- 2017-07-11 13:25:21.145564 I | osd1: 2017-07-11 13:25:21.145433 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:01.145431)
- 2017-07-11 13:25:22.145814 I | osd1: 2017-07-11 13:25:22.145726 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:02.145725)
- 2017-07-11 13:25:23.145967 I | osd1: 2017-07-11 13:25:23.145883 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:03.145881)
- 2017-07-11 13:25:24.146143 I | osd1: 2017-07-11 13:25:24.146052 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:04.146050)
- 2017-07-11 13:25:25.146411 I | osd1: 2017-07-11 13:25:25.146275 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:05.146274)
- 2017-07-11 13:25:26.146574 I | osd1: 2017-07-11 13:25:26.146478 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:06.146464)
- 2017-07-11 13:25:27.146829 I | osd1: 2017-07-11 13:25:27.146702 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:07.146701)
- 2017-07-11 13:25:28.147050 I | osd1: 2017-07-11 13:25:28.146906 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:08.146905)
- 2017-07-11 13:25:29.147267 I | osd1: 2017-07-11 13:25:29.147108 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:09.147107)
- 2017-07-11 13:25:29.147351 I | osd1: 2017-07-11 13:25:29.147190 7f28de450700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 60.092556 secs
- 2017-07-11 13:25:29.147396 I | osd1: 2017-07-11 13:25:29.147196 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.092556 seconds old, received at 2017-07-11 13:24:29.054610: osd_pg_create(e9 0.1:2 0.4:2 0.8:2 0.c:2 0.11:2 0.12:2 0.13:2 0.16:2 0.1a:2 0.1b:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.2b:2 0.33:2 0.34:2 0.36:2 0.37:2 0.38:2 0.39:2 0.3c:2 0.40:2 0.41:2 0.43:2 0.4b:2 0.4d:2 0.4e:2 0.52:2 0.57:2 0.5a:2 0.5f:2 0.62:2 0.67:2 0.6d:2 0.74:2 0.75:2 0.80:2 0.81:2 0.84:2 0.86:2 0.87:2 0.8c:2 0.8d:2 0.8f:2 0.92:2 0.93:2 0.96:2 0.99:2 0.9a:2 0.9b:2 0.9c:2 0.a4:2 0.a9:2 0.aa:2 0.ae:2 0.af:2 0.b1:2 0.b2:2 0.b7:2 0.b9:2 0.be:2 0.c1:2 0.c7:2 0.c9:2 0.cf:2 0.db:2 0.df:2 0.e6:2 0.f0:2 0.f1:2 0.f2:2 0.f3:2 0.f5:2 0.f6:2 0.fa:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.106:2 0.109:2 0.10b:2 0.10d:2 0.113:2 0.114:2 0.115:2 0.11a:2 0.121:2 0.124:2 0.125:2 0.12b:2 0.130:2 0.136:2 0.137:2 0.139:2 0.13a:2 0.13b:2 0.13c:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14b:2 0.14d:2 0.155:2 0.156:2 0.158:2 0.159:2 0.15b:2 0.15d:2 0.161:2 0.164:2 0.165:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.178:2 0.17d:2 0.184:2 0.187:2 0.18c:2 0.18e:2 0.18f:2 0.190:2 0.191:2 0.193:2 0.197:2 0.199:2 0.19a:2 0.19b:2 0.19d:2 0.1a1:2 0.1a2:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b2:2 0.1b3:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1c9:2 0.1d1:2 0.1d3:2 0.1d9:2 0.1da:2 0.1dd:2 0.1e0:2 0.1e3:2 0.1e5:2 0.1e7:2 0.1e8:2 0.1ea:2 0.1ee:2 0.1f1:2 0.1f2:2 0.1f3:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fb:2 0.1fc:2 0.1fd:2 0.1ff:2 0.202:2 0.208:2 0.209:2 0.20c:2 0.210:2 0.213:2 0.215:2 0.219:2 0.21b:2 0.220:2 0.221:2 0.225:2 0.229:2 0.22e:2 0.230:2 0.233:2 0.234:2 0.236:2 0.238:2 0.240:2 0.241:2 0.244:2 0.245:2 0.24b:2 0.24f:2 0.256:2 0.257:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.268:2 0.26c:2 0.26f:2 0.274:2 0.275:2 0.278:2 0.27b:2 0.27c:2 0.27d:2 0.27e:2 0.281:2 0.284:2 0.287:2 0.288:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.293:2 0.29b:2 0.29c:2 0.29f:2 0.2a2:2 0.2a3:2 0.2a5:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ad:2 0.2b0:2 0.2b6:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2bd:2 0.2c0:2 0.2c3:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2cf:2 0.2d4:2 0.2d6:2 0.2d8:2 0.2da:2 0.2dc:2 0.2e6:2 0.2e8:2 0.2f2:2 0.2f4:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2fd:2 0.2ff:2 0.301:2 0.302:2 0.303:2 0.305:2 0.307:2 0.30b:2 0.30d:2 0.30f:2 0.311:2 0.314:2 0.315:2 0.318:2 0.319:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.336:2 0.339:2 0.33a:2 0.33d:2 0.347:2 0.348:2 0.34a:2 0.34e:2 0.34f:2 0.350:2 0.353:2 0.357:2 0.35b:2 0.35d:2 0.35e:2 0.35f:2 0.361:2 0.366:2 0.368:2 0.369:2 0.36f:2 0.370:2 0.371:2 0.375:2 0.376:2 0.37c:2 0.37e:2 0.380:2 0.384:2 0.387:2 0.38a:2 0.38e:2 0.390:2 0.392:2 0.395:2 0.39a:2 0.39b:2 0.39c:2 0.39d:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b3:2 0.3b4:2 0.3b5:2 0.3ba:2 0.3c1:2 0.3c3:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cc:2 0.3cd:2 0.3d1:2 0.3d2:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3da:2 0.3db:2 0.3dc:2 0.3dd:2 0.3df:2 0.3e0:2 0.3e2:2 0.3e3:2 0.3e5:2 0.3e7:2 0.3ea:2 0.3ec:2 0.3f0:2 0.3f1:2 0.3f4:2 0.3f8:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:29.680006 I | osd1: 2017-07-11 13:25:29.679925 7f28e2c82700 0 -- 10.233.76.4:6801/178 >> 10.233.72.0:6801/180 conn(0x560691d3d800 :6801 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 0 vs existing csq=0 existing_state=STATE_CONNECTING_RE
- 2017-07-11 13:25:30.147437 I | osd1: 2017-07-11 13:25:30.147340 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:10.147339)
- 2017-07-11 13:25:31.147545 I | osd1: 2017-07-11 13:25:31.147469 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:11.147467)
- 2017-07-11 13:25:32.147686 I | osd1: 2017-07-11 13:25:32.147614 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:12.147612)
- 2017-07-11 13:25:33.147820 I | osd1: 2017-07-11 13:25:33.147746 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:13.147744)
- 2017-07-11 13:25:34.147958 I | osd1: 2017-07-11 13:25:34.147893 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:14.147892)
- 2017-07-11 13:25:35.148138 I | osd1: 2017-07-11 13:25:35.148046 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:15.148028)
- 2017-07-11 13:25:36.148319 I | osd1: 2017-07-11 13:25:36.148207 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:16.148205)
- 2017-07-11 13:25:37.148576 I | osd1: 2017-07-11 13:25:37.148452 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:17.148450)
- 2017-07-11 13:25:38.148760 I | osd1: 2017-07-11 13:25:38.148656 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:18.148655)
- 2017-07-11 13:25:39.148892 I | osd1: 2017-07-11 13:25:39.148797 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:19.148796)
- 2017-07-11 13:25:40.149066 I | osd1: 2017-07-11 13:25:40.148965 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:20.148964)
- 2017-07-11 13:25:41.149266 I | osd1: 2017-07-11 13:25:41.149169 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:21.149167)
- 2017-07-11 13:25:42.149428 I | osd1: 2017-07-11 13:25:42.149348 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:22.149346)
- 2017-07-11 13:25:43.151749 I | osd1: 2017-07-11 13:25:43.149489 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:23.149487)
- 2017-07-11 13:25:44.152221 I | osd1: 2017-07-11 13:25:44.152075 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:24.152074)
- 2017-07-11 13:25:44.152305 I | osd1: 2017-07-11 13:25:44.152153 7f28de450700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 73.772555 secs
- 2017-07-11 13:25:44.152327 I | osd1: 2017-07-11 13:25:44.152167 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 73.772555 seconds old, received at 2017-07-11 13:24:30.379551: osd_pg_create(e10 0.3:2 0.9:2 0.2a:2 0.2d:2 0.35:2 0.60:2 0.63:2 0.6e:2 0.76:2 0.7a:2 0.7d:2 0.8a:2 0.ab:2 0.b6:2 0.bc:2 0.ca:2 0.ce:2 0.d2:2 0.eb:2 0.11f:2 0.133:2 0.13e:2 0.141:2 0.148:2 0.14c:2 0.14e:2 0.166:2 0.167:2 0.180:2 0.198:2 0.19e:2 0.1a5:2 0.1a6:2 0.1b6:2 0.1bc:2 0.1d8:2 0.1ef:2 0.21a:2 0.222:2 0.223:2 0.226:2 0.24a:2 0.25c:2 0.25d:2 0.29a:2 0.2a0:2 0.2a6:2 0.2af:2 0.2b1:2 0.2b3:2 0.2c6:2 0.2f6:2 0.300:2 0.325:2 0.32c:2 0.330:2 0.33c:2 0.342:2 0.34b:2 0.363:2 0.36c:2 0.378:2 0.379:2 0.37f:2 0.388:2 0.396:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3e8:2 0.3eb:2) currently wait for new map
- 2017-07-11 13:25:45.152694 I | osd1: 2017-07-11 13:25:45.152280 7f28de450700 -1 osd.1 9 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:25.152277)
- 2017-07-11 13:25:45.152789 I | osd1: 2017-07-11 13:25:45.152385 7f28de450700 0 log_channel(cluster) log [WRN] : 2 slow requests, 2 included below; oldest blocked for > 74.772758 secs
- 2017-07-11 13:25:45.152824 I | osd1: 2017-07-11 13:25:45.152392 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 74.772758 seconds old, received at 2017-07-11 13:24:30.379551: osd_pg_create(e10 0.3:2 0.9:2 0.2a:2 0.2d:2 0.35:2 0.60:2 0.63:2 0.6e:2 0.76:2 0.7a:2 0.7d:2 0.8a:2 0.ab:2 0.b6:2 0.bc:2 0.ca:2 0.ce:2 0.d2:2 0.eb:2 0.11f:2 0.133:2 0.13e:2 0.141:2 0.148:2 0.14c:2 0.14e:2 0.166:2 0.167:2 0.180:2 0.198:2 0.19e:2 0.1a5:2 0.1a6:2 0.1b6:2 0.1bc:2 0.1d8:2 0.1ef:2 0.21a:2 0.222:2 0.223:2 0.226:2 0.24a:2 0.25c:2 0.25d:2 0.29a:2 0.2a0:2 0.2a6:2 0.2af:2 0.2b1:2 0.2b3:2 0.2c6:2 0.2f6:2 0.300:2 0.325:2 0.32c:2 0.330:2 0.33c:2 0.342:2 0.34b:2 0.363:2 0.36c:2 0.378:2 0.379:2 0.37f:2 0.388:2 0.396:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3e8:2 0.3eb:2) currently wait for new map
- 2017-07-11 13:25:45.152851 I | osd1: 2017-07-11 13:25:45.152637 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 74.168544 seconds old, received at 2017-07-11 13:24:30.983765: osd_pg_create(e11 0.1:2 0.3:2 0.4:2 0.8:2 0.9:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2a:2 0.2b:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.39:2 0.3c:2 0.40:2 0.41:2 0.43:2 0.4b:2 0.4d:2 0.4e:2 0.52:2 0.5a:2 0.5f:2 0.60:2 0.62:2 0.63:2 0.6d:2 0.6e:2 0.75:2 0.76:2 0.7a:2 0.7d:2 0.80:2 0.81:2 0.87:2 0.8a:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.9a:2 0.9b:2 0.9c:2 0.a9:2 0.ab:2 0.b1:2 0.b2:2 0.b6:2 0.bc:2 0.be:2 0.c9:2 0.ca:2 0.ce:2 0.cf:2 0.d2:2 0.db:2 0.df:2 0.e6:2 0.eb:2 0.f1:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.133:2 0.139:2 0.13b:2 0.13e:2 0.141:2 0.144:2 0.145:2 0.148:2 0.14a:2 0.14b:2 0.14c:2 0.14d:2 0.14e:2 0.155:2 0.158:2 0.159:2 0.15d:2 0.164:2 0.165:2 0.166:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.180:2 0.18e:2 0.18f:2 0.193:2 0.198:2 0.199:2 0.19a:2 0.19b:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d3:2 0.1d8:2 0.1d9:2 0.1dd:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f9:2 0.1fa:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21a:2 0.21b:2 0.220:2 0.222:2 0.223:2 0.225:2 0.226:2 0.230:2 0.233:2 0.234:2 0.236:2 0.240:2 0.241:2 0.244:2 0.24a:2 0.24f:2 0.258:2 0.25a:2 0.25c:2 0.25d:2 0.262:2 0.266:2 0.26c:2 0.274:2 0.275:2 0.27d:2 0.281:2 0.288:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.2a0:2 0.2a3:2 0.2a5:2 0.2a6:2 0.2ad:2 0.2af:2 0.2b1:2 0.2b3:2 0.2ba:2 0.2bd:2 0.2c3:2 0.2c6:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cf:2 0.2d8:2 0.2f6:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.303:2 0.307:2 0.30d:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.325:2 0.32a:2 0.32c:2 0.32e:2 0.330:2 0.336:2 0.339:2 0.33c:2 0.33d:2 0.342:2 0.347:2 0.34b:2 0.34e:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.363:2 0.36c:2 0.370:2 0.375:2 0.376:2 0.378:2 0.379:2 0.37c:2 0.37f:2 0.380:2 0.384:2 0.387:2 0.388:2 0.38a:2 0.38e:2 0.392:2 0.396:2 0.39b:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c3:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cc:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3e0:2 0.3e3:2 0.3e8:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f4:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:25:46.152949 I | osd1: 2017-07-11 13:25:46.152784 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:26.152782)
- 2017-07-11 13:25:46.153037 I | osd1: 2017-07-11 13:25:46.152880 7f28de450700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 73.939919 secs
- 2017-07-11 13:25:46.153079 I | osd1: 2017-07-11 13:25:46.152888 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 73.939919 seconds old, received at 2017-07-11 13:24:32.212896: osd_pg_create(e12 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:47.153226 I | osd1: 2017-07-11 13:25:47.153066 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:27.153064)
- 2017-07-11 13:25:47.153311 I | osd1: 2017-07-11 13:25:47.153162 7f28de450700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 74.940232 secs
- 2017-07-11 13:25:47.153356 I | osd1: 2017-07-11 13:25:47.153169 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 74.940232 seconds old, received at 2017-07-11 13:24:32.212896: osd_pg_create(e12 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently started
- 2017-07-11 13:25:48.153402 I | osd1: 2017-07-11 13:25:48.153314 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:28.153313)
- 2017-07-11 13:25:49.153577 I | osd1: 2017-07-11 13:25:49.153480 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:29.153479)
- 2017-07-11 13:25:50.153854 I | osd1: 2017-07-11 13:25:50.153709 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:30.153707)
- 2017-07-11 13:25:51.154023 I | osd1: 2017-07-11 13:25:51.153899 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:31.153897)
- 2017-07-11 13:25:52.154215 I | osd1: 2017-07-11 13:25:52.154126 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:32.154124)
- 2017-07-11 13:25:53.154327 I | osd1: 2017-07-11 13:25:53.154256 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:33.154255)
- 2017-07-11 13:25:54.154526 I | osd1: 2017-07-11 13:25:54.154404 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:34.154402)
- 2017-07-11 13:25:55.155651 I | osd1: 2017-07-11 13:25:55.155510 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:35.155508)
- 2017-07-11 13:25:56.155791 I | osd1: 2017-07-11 13:25:56.155714 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:36.155712)
- 2017-07-11 13:25:57.156098 I | osd1: 2017-07-11 13:25:57.156008 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:37.156006)
- 2017-07-11 13:25:58.156515 I | osd1: 2017-07-11 13:25:58.156400 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:38.156398)
- 2017-07-11 13:25:59.156774 I | osd1: 2017-07-11 13:25:59.156670 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:39.156668)
- 2017-07-11 13:26:00.156821 I | osd1: 2017-07-11 13:26:00.156753 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:40.156751)
- 2017-07-11 13:26:01.157972 I | osd1: 2017-07-11 13:26:01.157890 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:41.157888)
- 2017-07-11 13:26:02.158201 I | osd1: 2017-07-11 13:26:02.158064 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:42.158062)
- 2017-07-11 13:26:03.158362 I | osd1: 2017-07-11 13:26:03.158244 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:43.158241)
- 2017-07-11 13:26:03.158448 I | osd1: 2017-07-11 13:26:03.158301 7f28de450700 0 log_channel(cluster) log [WRN] : 3 slow requests, 2 included below; oldest blocked for > 90.945374 secs
- 2017-07-11 13:26:03.158466 I | osd1: 2017-07-11 13:26:03.158308 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.315376 seconds old, received at 2017-07-11 13:25:32.842895: pg_notify((query:13 sent:13 0.10a( empty local-lis/les=0/0 n=0 ec=2/2 lis/c 0/0 les/c/f 0/0/0 12/12/12))=([2,11] intervals=) epoch 13) currently wait for new map
- 2017-07-11 13:26:03.158495 I | osd1: 2017-07-11 13:26:03.158310 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.095310 seconds old, received at 2017-07-11 13:25:33.062960: pg_notify((query:13 sent:13 0.187( empty local-lis/les=0/0 n=0 ec=2/2 lis/c 0/0 les/c/f 0/0/0 12/12/12))=([2,11] intervals=) epoch 15) currently wait for new map
- 2017-07-11 13:26:04.158481 I | osd1: 2017-07-11 13:26:04.158404 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:44.158402)
- 2017-07-11 13:26:05.158747 I | osd1: 2017-07-11 13:26:05.158616 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:45.158614)
- 2017-07-11 13:26:06.158929 I | osd1: 2017-07-11 13:26:06.158820 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:46.158819)
- 2017-07-11 13:26:07.159390 I | osd1: 2017-07-11 13:26:07.159043 7f28de450700 -1 osd.1 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:47.159042)
- 2017-07-11 13:26:07.159498 I | osd1: 2017-07-11 13:26:07.159296 7f28de450700 0 log_channel(cluster) log [WRN] : 9 slow requests, 5 included below; oldest blocked for > 94.465619 secs
- 2017-07-11 13:26:07.159523 I | osd1: 2017-07-11 13:26:07.159316 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 94.465619 seconds old, received at 2017-07-11 13:24:32.693479: osd_pg_create(e13 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:07.159552 I | osd1: 2017-07-11 13:26:07.159320 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 93.307052 seconds old, received at 2017-07-11 13:24:33.852047: osd_pg_create(e14 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.35:2 0.36:2 0.38:2 0.4d:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.76:2 0.80:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a9:2 0.b1:2 0.b2:2 0.b9:2 0.be:2 0.c9:2 0.ca:2 0.cf:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.209:2 0.215:2 0.21b:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.274:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2ed:2 0.2f7:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cd:2 0.3d3:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:07.159595 I | osd1: 2017-07-11 13:26:07.159323 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 90.557336 seconds old, received at 2017-07-11 13:24:36.601763: osd_pg_create(e15 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.26:2 0.2a:2 0.35:2 0.36:2 0.38:2 0.41:2 0.4e:2 0.4f:2 0.50:2 0.52:2 0.60:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.c3:2 0.ca:2 0.cf:2 0.d2:2 0.db:2 0.df:2 0.e8:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.115:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.157:2 0.158:2 0.159:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.177:2 0.17d:2 0.18d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ab:2 0.1ae:2 0.1af:2 0.1b6:2 0.1bb:2 0.1bd:2 0.1bf:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.23d:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28e:2 0.291:2 0.294:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2a6:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2dd:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.363:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ac:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ea:2 0.3ec:2 0.3f5:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:07.159615 I | osd1: 2017-07-11 13:26:07.159326 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 89.889977 seconds old, received at 2017-07-11 13:24:37.269122: osd_pg_create(e16 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:07.159634 I | osd1: 2017-07-11 13:26:07.159329 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 85.594176 seconds old, received at 2017-07-11 13:24:41.564923: osd_pg_create(e17 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:08.159781 I | osd1: 2017-07-11 13:26:08.159526 7f28de450700 -1 osd.1 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:30.588651 (cutoff 2017-07-11 13:25:48.159525)
- 2017-07-11 13:26:08.159864 I | osd1: 2017-07-11 13:26:08.159687 7f28de450700 0 log_channel(cluster) log [WRN] : 9 slow requests, 5 included below; oldest blocked for > 95.466107 secs
- 2017-07-11 13:26:08.159903 I | osd1: 2017-07-11 13:26:08.159694 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 95.466107 seconds old, received at 2017-07-11 13:24:32.693479: osd_pg_create(e13 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.2d:2 0.35:2 0.36:2 0.37:2 0.38:2 0.41:2 0.46:2 0.4d:2 0.4e:2 0.4f:2 0.52:2 0.5a:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.83:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.b5:2 0.b7:2 0.b9:2 0.bc:2 0.be:2 0.c8:2 0.c9:2 0.ca:2 0.cf:2 0.db:2 0.df:2 0.e7:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10a:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.125:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.146:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.175:2 0.17d:2 0.184:2 0.187:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a5:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1b5:2 0.1b6:2 0.1bb:2 0.1bc:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1d9:2 0.1e0:2 0.1e5:2 0.1e8:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.208:2 0.209:2 0.210:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.226:2 0.234:2 0.236:2 0.240:2 0.243:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.25e:2 0.261:2 0.262:2 0.266:2 0.26f:2 0.274:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.28e:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2b0:2 0.2b1:2 0.2ba:2 0.2bb:2 0.2bd:2 0.2c5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2e9:2 0.2ed:2 0.2f7:2 0.2f8:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.311:2 0.315:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32c:2 0.32e:2 0.339:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.368:2 0.36c:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.379:2 0.37a:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.395:2 0.39b:2 0.39d:2 0.3a1:2 0.3a2:2 0.3a4:2 0.3a8:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3b1:2 0.3b4:2 0.3ba:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d1:2 0.3d3:2 0.3d5:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3e9:2 0.3ea:2 0.3eb:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3f9:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:08.159948 I | osd1: 2017-07-11 13:26:08.159699 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 94.307540 seconds old, received at 2017-07-11 13:24:33.852047: osd_pg_create(e14 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.25:2 0.35:2 0.36:2 0.38:2 0.4d:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.76:2 0.80:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a9:2 0.b1:2 0.b2:2 0.b9:2 0.be:2 0.c9:2 0.ca:2 0.cf:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.139:2 0.13b:2 0.13d:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16c:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19a:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ae:2 0.1af:2 0.1bd:2 0.1c1:2 0.1c4:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.1fd:2 0.202:2 0.209:2 0.215:2 0.21b:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.24f:2 0.258:2 0.259:2 0.25a:2 0.262:2 0.266:2 0.274:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28b:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2ed:2 0.2f7:2 0.2fc:2 0.2ff:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32a:2 0.32e:2 0.33c:2 0.33d:2 0.347:2 0.34b:2 0.34f:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cd:2 0.3d3:2 0.3d6:2 0.3d9:2 0.3dc:2 0.3dd:2 0.3e3:2 0.3ec:2 0.3f1:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:08.159990 I | osd1: 2017-07-11 13:26:08.159702 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 91.557823 seconds old, received at 2017-07-11 13:24:36.601763: osd_pg_create(e15 0.1:2 0.2:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.22:2 0.25:2 0.26:2 0.2a:2 0.35:2 0.36:2 0.38:2 0.41:2 0.4e:2 0.4f:2 0.50:2 0.52:2 0.60:2 0.74:2 0.75:2 0.76:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8c:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.c3:2 0.ca:2 0.cf:2 0.d2:2 0.db:2 0.df:2 0.e8:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.103:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.115:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.157:2 0.158:2 0.159:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.177:2 0.17d:2 0.18d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1a7:2 0.1ab:2 0.1ae:2 0.1af:2 0.1b6:2 0.1bb:2 0.1bd:2 0.1bf:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.23d:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.28e:2 0.291:2 0.294:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2a6:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2ca:2 0.2cc:2 0.2dd:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.363:2 0.36f:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.37f:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ac:2 0.3ad:2 0.3ae:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ea:2 0.3ec:2 0.3f5:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:08.160009 I | osd1: 2017-07-11 13:26:08.159712 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 90.890464 seconds old, received at 2017-07-11 13:24:37.269122: osd_pg_create(e16 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:08.160026 I | osd1: 2017-07-11 13:26:08.159722 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 86.594663 seconds old, received at 2017-07-11 13:24:41.564923: osd_pg_create(e17 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2) currently wait for new map
- 2017-07-11 13:26:12.160515 I | osd1: 2017-07-11 13:26:12.160442 7f28de450700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.466879 secs
- 2017-07-11 13:26:12.160599 I | osd1: 2017-07-11 13:26:12.160454 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.466879 seconds old, received at 2017-07-11 13:25:41.693498: osd_pg_create(e20 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20) currently started
- 2017-07-11 13:26:14.161636 I | osd1: 2017-07-11 13:26:14.161564 7f28de450700 0 log_channel(cluster) log [WRN] : 2 slow requests, 1 included below; oldest blocked for > 32.468001 secs
- 2017-07-11 13:26:14.161722 I | osd1: 2017-07-11 13:26:14.161590 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.543300 seconds old, received at 2017-07-11 13:25:43.618199: osd_pg_create(e22 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22) currently wait for new map
- 2017-07-11 13:26:15.161869 I | osd1: 2017-07-11 13:26:15.161805 7f28de450700 0 log_channel(cluster) log [WRN] : 3 slow requests, 1 included below; oldest blocked for > 33.468212 secs
- 2017-07-11 13:26:15.161954 I | osd1: 2017-07-11 13:26:15.161818 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.327390 seconds old, received at 2017-07-11 13:25:44.834321: osd_pg_create(e23 0.1:2 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23) currently wait for new map
- 2017-07-11 13:26:17.162285 I | osd1: 2017-07-11 13:26:17.162218 7f28de450700 0 log_channel(cluster) log [WRN] : 4 slow requests, 1 included below; oldest blocked for > 35.468642 secs
- 2017-07-11 13:26:17.162386 I | osd1: 2017-07-11 13:26:17.162229 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.848726 seconds old, received at 2017-07-11 13:25:46.313414: osd_pg_create(e24 0.3:2 0.4:2 0.8:2 0.c:2 0.11:2 0.1a:2 0.1c:2 0.1e:2 0.20:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24) currently wait for new map
- 2017-07-11 13:26:43.166812 I | osd1: 2017-07-11 13:26:43.166742 7f28de450700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 55.346405 secs
- 2017-07-11 13:26:43.166915 I | osd1: 2017-07-11 13:26:43.166754 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 55.346405 seconds old, received at 2017-07-11 13:25:47.820229: osd_pg_create(e25 0.3:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25) currently started
- 2017-07-11 13:26:47.169843 I | osd1: 2017-07-11 13:26:47.169750 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:27.169748)
- 2017-07-11 13:26:48.170211 I | osd1: 2017-07-11 13:26:48.170065 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:28.170063)
- 2017-07-11 13:26:48.170230 I | osd1: 2017-07-11 13:26:48.170148 7f28de450700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 60.349894 secs
- 2017-07-11 13:26:48.170243 I | osd1: 2017-07-11 13:26:48.170156 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.349894 seconds old, received at 2017-07-11 13:25:47.820229: osd_pg_create(e25 0.3:2 0.35:2 0.36:2 0.38:2 0.4e:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25) currently started
- 2017-07-11 13:26:49.170372 I | osd1: 2017-07-11 13:26:49.170267 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:29.170265)
- 2017-07-11 13:26:50.170627 I | osd1: 2017-07-11 13:26:50.170506 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:30.170504)
- 2017-07-11 13:26:51.171010 I | osd1: 2017-07-11 13:26:51.170867 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:31.170865)
- 2017-07-11 13:26:51.171027 I | osd1: 2017-07-11 13:26:51.170942 7f28de450700 0 log_channel(cluster) log [WRN] : 8 slow requests, 5 included below; oldest blocked for > 63.350666 secs
- 2017-07-11 13:26:51.171033 I | osd1: 2017-07-11 13:26:51.170946 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.189307 seconds old, received at 2017-07-11 13:26:20.981588: pg_notify((query:21 sent:36 0.4a4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:51.171036 I | osd1: 2017-07-11 13:26:51.170950 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.189245 seconds old, received at 2017-07-11 13:26:20.981650: pg_notify((query:21 sent:36 0.4a6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:51.171039 I | osd1: 2017-07-11 13:26:51.170953 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.189811 seconds old, received at 2017-07-11 13:26:20.981085: pg_notify((query:21 sent:36 0.427( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:51.171041 I | osd1: 2017-07-11 13:26:51.170955 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.189572 seconds old, received at 2017-07-11 13:26:20.981323: pg_notify((query:21 sent:36 0.434( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:51.171047 I | osd1: 2017-07-11 13:26:51.170957 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.189524 seconds old, received at 2017-07-11 13:26:20.981372: pg_notify((query:21 sent:36 0.437( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:52.171204 I | osd1: 2017-07-11 13:26:52.171081 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:32.171080)
- 2017-07-11 13:26:52.171290 I | osd1: 2017-07-11 13:26:52.171146 7f28de450700 0 log_channel(cluster) log [WRN] : 8 slow requests, 2 included below; oldest blocked for > 64.350875 secs
- 2017-07-11 13:26:52.171308 I | osd1: 2017-07-11 13:26:52.171151 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 31.189582 seconds old, received at 2017-07-11 13:26:20.981522: pg_notify((query:21 sent:36 0.46a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:52.171339 I | osd1: 2017-07-11 13:26:52.171153 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 31.189544 seconds old, received at 2017-07-11 13:26:20.981560: pg_notify((query:21 sent:36 0.474( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:26:53.171485 I | osd1: 2017-07-11 13:26:53.171302 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:33.171300)
- 2017-07-11 13:26:54.176288 I | osd1: 2017-07-11 13:26:54.176210 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:34.176209)
- 2017-07-11 13:26:55.189240 I | osd1: 2017-07-11 13:26:55.179648 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:35.179645)
- 2017-07-11 13:26:55.189483 I | osd1: 2017-07-11 13:26:55.179723 7f28de450700 0 log_channel(cluster) log [WRN] : 9 slow requests, 1 included below; oldest blocked for > 67.359467 secs
- 2017-07-11 13:26:55.189523 I | osd1: 2017-07-11 13:26:55.179745 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.092543 seconds old, received at 2017-07-11 13:26:25.087153: pg_notify((query:25 sent:53 0.4b2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:26:56.179928 I | osd1: 2017-07-11 13:26:56.179853 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:36.179851)
- 2017-07-11 13:26:57.180384 I | osd1: 2017-07-11 13:26:57.180255 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:37.180253)
- 2017-07-11 13:26:57.180480 I | osd1: 2017-07-11 13:26:57.180312 7f28de450700 0 log_channel(cluster) log [WRN] : 11 slow requests, 2 included below; oldest blocked for > 69.360050 secs
- 2017-07-11 13:26:57.180516 I | osd1: 2017-07-11 13:26:57.180318 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.599795 seconds old, received at 2017-07-11 13:26:26.580485: pg_notify((query:25 sent:53 0.4d9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:26:57.180534 I | osd1: 2017-07-11 13:26:57.180321 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.045284 seconds old, received at 2017-07-11 13:26:27.134996: pg_notify((query:25 sent:54 0.4dd( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 54) currently wait for new map
- 2017-07-11 13:26:58.180594 I | osd1: 2017-07-11 13:26:58.180469 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:38.180468)
- 2017-07-11 13:26:58.180695 I | osd1: 2017-07-11 13:26:58.180538 7f28de450700 0 log_channel(cluster) log [WRN] : 13 slow requests, 2 included below; oldest blocked for > 70.360263 secs
- 2017-07-11 13:26:58.180726 I | osd1: 2017-07-11 13:26:58.180542 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.704741 seconds old, received at 2017-07-11 13:26:27.475751: pg_notify((query:25 sent:53 0.4e3( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:26:58.180756 I | osd1: 2017-07-11 13:26:58.180545 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.305323 seconds old, received at 2017-07-11 13:26:27.875170: pg_notify((query:25 sent:55 0.4e6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:26:59.195847 I | osd1: 2017-07-11 13:26:59.186692 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:39.186669)
- 2017-07-11 13:26:59.199432 I | osd1: 2017-07-11 13:26:59.186773 7f28de450700 0 log_channel(cluster) log [WRN] : 14 slow requests, 1 included below; oldest blocked for > 71.366516 secs
- 2017-07-11 13:26:59.207256 I | osd1: 2017-07-11 13:26:59.186778 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.888978 seconds old, received at 2017-07-11 13:26:28.297767: pg_notify((query:25 sent:55 0.4ec( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:00.187136 I | osd1: 2017-07-11 13:27:00.186918 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:40.186915)
- 2017-07-11 13:27:00.187245 I | osd1: 2017-07-11 13:27:00.187022 7f28de450700 0 log_channel(cluster) log [WRN] : 23 slow requests, 5 included below; oldest blocked for > 72.366735 secs
- 2017-07-11 13:27:00.187285 I | osd1: 2017-07-11 13:27:00.187027 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.168011 seconds old, received at 2017-07-11 13:26:30.018953: pg_notify((query:21 sent:42 0.486( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:00.187301 I | osd1: 2017-07-11 13:27:00.187044 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.167945 seconds old, received at 2017-07-11 13:26:30.019019: pg_notify((query:21 sent:42 0.49d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:00.187331 I | osd1: 2017-07-11 13:27:00.187053 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.167925 seconds old, received at 2017-07-11 13:26:30.019039: pg_notify((query:21 sent:42 0.4a5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:00.187345 I | osd1: 2017-07-11 13:27:00.187055 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.874083 seconds old, received at 2017-07-11 13:26:29.312882: pg_notify((query:25 sent:56 0.4f7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:00.187357 I | osd1: 2017-07-11 13:27:00.187056 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.485377 seconds old, received at 2017-07-11 13:26:29.701587: pg_notify((query:25 sent:56 0.4fb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:01.187423 I | osd1: 2017-07-11 13:27:01.187157 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:41.187155)
- 2017-07-11 13:27:01.187442 I | osd1: 2017-07-11 13:27:01.187326 7f28de450700 0 log_channel(cluster) log [WRN] : 25 slow requests, 5 included below; oldest blocked for > 40.206130 secs
- 2017-07-11 13:27:01.187475 I | osd1: 2017-07-11 13:27:01.187334 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 71.768138 seconds old, received at 2017-07-11 13:25:49.419076: osd_pg_create(e26 0.3:2 0.35:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26) currently started
- 2017-07-11 13:27:01.187482 I | osd1: 2017-07-11 13:27:01.187361 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 31.168161 seconds old, received at 2017-07-11 13:26:30.019054: pg_notify((query:25 sent:42 0.4b0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:01.187490 I | osd1: 2017-07-11 13:27:01.187364 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.388593 seconds old, received at 2017-07-11 13:26:30.798622: pg_notify((query:25 sent:57 0.503( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 57) currently wait for new map
- 2017-07-11 13:27:01.187492 I | osd1: 2017-07-11 13:27:01.187365 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.412681 seconds old, received at 2017-07-11 13:26:30.774533: pg_notify((query:25 sent:56 0.502( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:01.187495 I | osd1: 2017-07-11 13:27:01.187367 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 31.168146 seconds old, received at 2017-07-11 13:26:30.019069: pg_notify((query:25 sent:42 0.4bb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:02.187708 I | osd1: 2017-07-11 13:27:02.187499 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:42.187497)
- 2017-07-11 13:27:02.187794 I | osd1: 2017-07-11 13:27:02.187615 7f28de450700 0 log_channel(cluster) log [WRN] : 26 slow requests, 4 included below; oldest blocked for > 41.206484 secs
- 2017-07-11 13:27:02.187838 I | osd1: 2017-07-11 13:27:02.187638 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 72.768492 seconds old, received at 2017-07-11 13:25:49.419076: osd_pg_create(e26 0.3:2 0.35:2 0.4f:2 0.52:2 0.74:2 0.75:2 0.80:2 0.81:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.35f:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26) currently started
- 2017-07-11 13:27:02.187863 I | osd1: 2017-07-11 13:27:02.187645 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.529653 seconds old, received at 2017-07-11 13:26:31.657915: pg_notify((query:25 sent:56 0.509( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:02.187878 I | osd1: 2017-07-11 13:27:02.187647 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 32.168482 seconds old, received at 2017-07-11 13:26:30.019086: pg_notify((query:25 sent:42 0.4e0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:02.187890 I | osd1: 2017-07-11 13:27:02.187649 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 32.168466 seconds old, received at 2017-07-11 13:26:30.019102: pg_notify((query:25 sent:42 0.4f5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:03.187984 I | osd1: 2017-07-11 13:27:03.187822 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:43.187821)
- 2017-07-11 13:27:03.188055 I | osd1: 2017-07-11 13:27:03.187911 7f28de450700 0 log_channel(cluster) log [WRN] : 28 slow requests, 2 included below; oldest blocked for > 42.206789 secs
- 2017-07-11 13:27:03.188073 I | osd1: 2017-07-11 13:27:03.187915 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.530131 seconds old, received at 2017-07-11 13:26:32.657742: pg_notify((query:25 sent:58 0.514( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 58) currently wait for new map
- 2017-07-11 13:27:03.188090 I | osd1: 2017-07-11 13:27:03.187932 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.689602 seconds old, received at 2017-07-11 13:26:32.498272: pg_notify((query:25 sent:56 0.513( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:04.188170 I | osd1: 2017-07-11 13:27:04.188047 7f28de450700 -1 osd.1 26 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:44.188045)
- 2017-07-11 13:27:04.188241 I | osd1: 2017-07-11 13:27:04.188109 7f28de450700 0 log_channel(cluster) log [WRN] : 30 slow requests, 2 included below; oldest blocked for > 43.206991 secs
- 2017-07-11 13:27:04.188258 I | osd1: 2017-07-11 13:27:04.188114 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.485611 seconds old, received at 2017-07-11 13:26:33.702464: pg_notify((query:25 sent:56 0.51c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:04.188279 I | osd1: 2017-07-11 13:27:04.188118 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.210146 seconds old, received at 2017-07-11 13:26:33.977929: pg_notify((query:25 sent:56 0.51e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:05.188573 I | osd1: 2017-07-11 13:27:05.188414 7f28de450700 -1 osd.1 31 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:45.188412)
- 2017-07-11 13:27:05.189387 I | osd1: 2017-07-11 13:27:05.189243 7f28de450700 0 log_channel(cluster) log [WRN] : 46 slow requests, 5 included below; oldest blocked for > 44.207349 secs
- 2017-07-11 13:27:05.189452 I | osd1: 2017-07-11 13:27:05.189253 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 74.382946 seconds old, received at 2017-07-11 13:25:50.805488: osd_pg_create(e27 0.3:2 0.35:2 0.4f:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27) currently wait for new map
- 2017-07-11 13:27:05.189502 I | osd1: 2017-07-11 13:27:05.189272 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 72.908815 seconds old, received at 2017-07-11 13:25:52.279618: osd_pg_create(e28 0.3:2 0.35:2 0.4f:2 0.a0:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:05.189528 I | osd1: 2017-07-11 13:27:05.189276 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 71.700793 seconds old, received at 2017-07-11 13:25:53.487640: osd_pg_create(e29 0.3:2 0.35:2 0.4f:2 0.a0:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:05.189549 I | osd1: 2017-07-11 13:27:05.189281 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 70.447050 seconds old, received at 2017-07-11 13:25:54.741384: osd_pg_create(e30 0.3:2 0.35:2 0.4f:2 0.a0:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30) currently wait for new map
- 2017-07-11 13:27:05.189589 I | osd1: 2017-07-11 13:27:05.189292 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 68.952185 seconds old, received at 2017-07-11 13:25:56.236248: osd_pg_create(e31 0.3:2 0.35:2 0.4f:2 0.a0:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31) currently wait for new map
- 2017-07-11 13:27:06.189636 I | osd1: 2017-07-11 13:27:06.189417 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:26:46.189415)
- 2017-07-11 13:27:06.189739 I | osd1: 2017-07-11 13:27:06.189431 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:46.189415)
- 2017-07-11 13:27:06.189753 I | osd1: 2017-07-11 13:27:06.189525 7f28de450700 0 log_channel(cluster) log [WRN] : 47 slow requests, 5 included below; oldest blocked for > 45.208403 secs
- 2017-07-11 13:27:06.189765 I | osd1: 2017-07-11 13:27:06.189531 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 75.384000 seconds old, received at 2017-07-11 13:25:50.805488: osd_pg_create(e27 0.3:2 0.35:2 0.4f:2 0.86:2 0.87:2 0.8f:2 0.93:2 0.96:2 0.99:2 0.9b:2 0.a0:2 0.a9:2 0.ae:2 0.b1:2 0.b2:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.34f:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27) currently wait for new map
- 2017-07-11 13:27:06.189786 I | osd1: 2017-07-11 13:27:06.189547 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 73.909869 seconds old, received at 2017-07-11 13:25:52.279618: osd_pg_create(e28 0.3:2 0.35:2 0.4f:2 0.a0:2 0.be:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:06.189799 I | osd1: 2017-07-11 13:27:06.189551 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 72.701847 seconds old, received at 2017-07-11 13:25:53.487640: osd_pg_create(e29 0.3:2 0.35:2 0.4f:2 0.a0:2 0.cf:2 0.db:2 0.df:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28) currently wait for new map
- 2017-07-11 13:27:06.189810 I | osd1: 2017-07-11 13:27:06.189554 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 71.448104 seconds old, received at 2017-07-11 13:25:54.741384: osd_pg_create(e30 0.3:2 0.35:2 0.4f:2 0.a0:2 0.f1:2 0.f3:2 0.f5:2 0.f6:2 0.fb:2 0.102:2 0.104:2 0.105:2 0.109:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30) currently wait for new map
- 2017-07-11 13:27:06.189824 I | osd1: 2017-07-11 13:27:06.189567 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 69.953239 seconds old, received at 2017-07-11 13:25:56.236248: osd_pg_create(e31 0.3:2 0.35:2 0.4f:2 0.a0:2 0.10b:2 0.113:2 0.11f:2 0.124:2 0.12b:2 0.137:2 0.139:2 0.13b:2 0.144:2 0.145:2 0.14a:2 0.14e:2 0.155:2 0.158:2 0.15d:2 0.165:2 0.167:2 0.168:2 0.16d:2 0.16e:2 0.172:2 0.174:2 0.17d:2 0.18e:2 0.193:2 0.19e:2 0.1a1:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.39d:2 0.3a1:2 0.3a4:2 0.3aa:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31) currently wait for new map
- 2017-07-11 13:27:07.190483 I | osd1: 2017-07-11 13:27:07.189645 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:26:47.189644)
- 2017-07-11 13:27:07.190573 I | osd1: 2017-07-11 13:27:07.189656 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:47.189644)
- 2017-07-11 13:27:07.190591 I | osd1: 2017-07-11 13:27:07.190166 7f28de450700 0 log_channel(cluster) log [WRN] : 49 slow requests, 5 included below; oldest blocked for > 46.208604 secs
- 2017-07-11 13:27:07.190624 I | osd1: 2017-07-11 13:27:07.190185 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 69.675377 seconds old, received at 2017-07-11 13:25:57.514311: osd_pg_create(e32 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32) currently wait for new map
- 2017-07-11 13:27:07.190671 I | osd1: 2017-07-11 13:27:07.190209 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 68.464259 seconds old, received at 2017-07-11 13:25:58.725429: osd_pg_create(e33 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33) currently wait for new map
- 2017-07-11 13:27:07.190719 I | osd1: 2017-07-11 13:27:07.190213 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 67.060533 seconds old, received at 2017-07-11 13:26:00.129155: osd_pg_create(e34 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:07.190753 I | osd1: 2017-07-11 13:27:07.190217 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 65.733720 seconds old, received at 2017-07-11 13:26:01.455968: osd_pg_create(e35 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:07.190795 I | osd1: 2017-07-11 13:27:07.190228 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 64.613660 seconds old, received at 2017-07-11 13:26:02.576028: osd_pg_create(e36 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:08.190582 I | osd1: 2017-07-11 13:27:08.190365 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:26:48.190360)
- 2017-07-11 13:27:08.190614 I | osd1: 2017-07-11 13:27:08.190392 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:48.190360)
- 2017-07-11 13:27:08.190618 I | osd1: 2017-07-11 13:27:08.190463 7f28de450700 0 log_channel(cluster) log [WRN] : 49 slow requests, 5 included below; oldest blocked for > 47.209318 secs
- 2017-07-11 13:27:08.190626 I | osd1: 2017-07-11 13:27:08.190470 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 70.676092 seconds old, received at 2017-07-11 13:25:57.514311: osd_pg_create(e32 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1ae:2 0.1af:2 0.1bb:2 0.1bd:2 0.1c1:2 0.1c5:2 0.1c8:2 0.1d1:2 0.1d3:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32) currently wait for new map
- 2017-07-11 13:27:08.190646 I | osd1: 2017-07-11 13:27:08.190487 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 69.464974 seconds old, received at 2017-07-11 13:25:58.725429: osd_pg_create(e33 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1e0:2 0.1e5:2 0.1ea:2 0.1ef:2 0.1f1:2 0.1f4:2 0.1f9:2 0.1fa:2 0.1fc:2 0.209:2 0.215:2 0.21b:2 0.220:2 0.222:2 0.225:2 0.234:2 0.236:2 0.240:2 0.244:2 0.258:2 0.259:2 0.25a:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2cc:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33) currently wait for new map
- 2017-07-11 13:27:08.190655 I | osd1: 2017-07-11 13:27:08.190500 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 68.061248 seconds old, received at 2017-07-11 13:26:00.129155: osd_pg_create(e34 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.262:2 0.266:2 0.26f:2 0.275:2 0.281:2 0.285:2 0.289:2 0.28a:2 0.291:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:08.190674 I | osd1: 2017-07-11 13:27:08.190504 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 66.734434 seconds old, received at 2017-07-11 13:26:01.455968: osd_pg_create(e35 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.29f:2 0.2a3:2 0.2a5:2 0.2bd:2 0.2c7:2 0.2c9:2 0.2f7:2 0.2fc:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:08.190682 I | osd1: 2017-07-11 13:27:08.190513 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 65.614374 seconds old, received at 2017-07-11 13:26:02.576028: osd_pg_create(e36 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.301:2 0.302:2 0.307:2 0.30f:2 0.318:2 0.31c:2 0.321:2 0.32e:2 0.33d:2 0.347:2 0.353:2 0.35b:2 0.35d:2 0.361:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:09.191155 I | osd1: 2017-07-11 13:27:09.190635 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:26:49.190633)
- 2017-07-11 13:27:09.191240 I | osd1: 2017-07-11 13:27:09.190660 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:49.190633)
- 2017-07-11 13:27:09.191260 I | osd1: 2017-07-11 13:27:09.191042 7f28de450700 0 log_channel(cluster) log [WRN] : 50 slow requests, 5 included below; oldest blocked for > 48.209584 secs
- 2017-07-11 13:27:09.191277 I | osd1: 2017-07-11 13:27:09.191051 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 65.354982 seconds old, received at 2017-07-11 13:26:03.835686: osd_pg_create(e37 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:09.191334 I | osd1: 2017-07-11 13:27:09.191058 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 64.220425 seconds old, received at 2017-07-11 13:26:04.970243: osd_pg_create(e38 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:09.191372 I | osd1: 2017-07-11 13:27:09.191062 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 62.891164 seconds old, received at 2017-07-11 13:26:06.299505: osd_pg_create(e39 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:09.191399 I | osd1: 2017-07-11 13:27:09.191072 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 61.603405 seconds old, received at 2017-07-11 13:26:07.587264: osd_pg_create(e40 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:09.191422 I | osd1: 2017-07-11 13:27:09.191075 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.374950 seconds old, received at 2017-07-11 13:26:08.815718: osd_pg_create(e41 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:10.191453 I | osd1: 2017-07-11 13:27:10.191284 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:26:50.191283)
- 2017-07-11 13:27:10.191530 I | osd1: 2017-07-11 13:27:10.191298 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:50.191283)
- 2017-07-11 13:27:10.191550 I | osd1: 2017-07-11 13:27:10.191361 7f28de450700 0 log_channel(cluster) log [WRN] : 52 slow requests, 5 included below; oldest blocked for > 49.210222 secs
- 2017-07-11 13:27:10.191585 I | osd1: 2017-07-11 13:27:10.191370 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.880335 seconds old, received at 2017-07-11 13:26:39.310971: pg_notify((query:25 sent:63 0.557( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 63) currently wait for new map
- 2017-07-11 13:27:10.191617 I | osd1: 2017-07-11 13:27:10.191374 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 66.355620 seconds old, received at 2017-07-11 13:26:03.835686: osd_pg_create(e37 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.370:2 0.375:2 0.376:2 0.37c:2 0.380:2 0.38a:2 0.38e:2 0.392:2 0.39b:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:10.191837 I | osd1: 2017-07-11 13:27:10.191378 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 65.221063 seconds old, received at 2017-07-11 13:26:04.970243: osd_pg_create(e38 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.3ab:2 0.3ad:2 0.3c1:2 0.3c4:2 0.3c9:2 0.3ca:2 0.3cb:2 0.3cd:2 0.3d3:2 0.3d9:2 0.3dc:2 0.3ec:2 0.3f8:2 0.3fa:2 0.3ff:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:10.191877 I | osd1: 2017-07-11 13:27:10.191389 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 63.891801 seconds old, received at 2017-07-11 13:26:06.299505: osd_pg_create(e39 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:10.191915 I | osd1: 2017-07-11 13:27:10.191393 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 62.604043 seconds old, received at 2017-07-11 13:26:07.587264: osd_pg_create(e40 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:11.191833 I | osd1: 2017-07-11 13:27:11.191520 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:26:51.191519)
- 2017-07-11 13:27:11.191850 I | osd1: 2017-07-11 13:27:11.191536 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:51.191519)
- 2017-07-11 13:27:11.191853 I | osd1: 2017-07-11 13:27:11.191740 7f28de450700 0 log_channel(cluster) log [WRN] : 54 slow requests, 5 included below; oldest blocked for > 50.210483 secs
- 2017-07-11 13:27:11.191857 I | osd1: 2017-07-11 13:27:11.191744 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.132634 seconds old, received at 2017-07-11 13:26:41.058933: pg_notify((query:25 sent:61 0.560( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:11.191860 I | osd1: 2017-07-11 13:27:11.191747 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.185198 seconds old, received at 2017-07-11 13:26:41.006369: pg_notify((query:25 sent:61 0.55c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:11.191874 I | osd1: 2017-07-11 13:27:11.191751 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 62.375849 seconds old, received at 2017-07-11 13:26:08.815718: osd_pg_create(e41 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:11.191883 I | osd1: 2017-07-11 13:27:11.191756 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 61.048090 seconds old, received at 2017-07-11 13:26:10.143477: osd_pg_create(e42 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:11.191891 I | osd1: 2017-07-11 13:27:11.191775 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 59.606180 seconds old, received at 2017-07-11 13:26:11.585387: osd_pg_create(e43 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:12.192113 I | osd1: 2017-07-11 13:27:12.191899 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:26:52.191898)
- 2017-07-11 13:27:12.192198 I | osd1: 2017-07-11 13:27:12.191926 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:52.191898)
- 2017-07-11 13:27:12.192218 I | osd1: 2017-07-11 13:27:12.192022 7f28de450700 0 log_channel(cluster) log [WRN] : 55 slow requests, 5 included below; oldest blocked for > 51.210888 secs
- 2017-07-11 13:27:12.192247 I | osd1: 2017-07-11 13:27:12.192027 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.737071 seconds old, received at 2017-07-11 13:26:41.454902: pg_notify((query:25 sent:61 0.568( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:12.192276 I | osd1: 2017-07-11 13:27:12.192034 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 62.048496 seconds old, received at 2017-07-11 13:26:10.143477: osd_pg_create(e42 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:12.192302 I | osd1: 2017-07-11 13:27:12.192039 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.606586 seconds old, received at 2017-07-11 13:26:11.585387: osd_pg_create(e43 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:12.192340 I | osd1: 2017-07-11 13:27:12.192050 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 36.833041 seconds old, received at 2017-07-11 13:26:35.358932: pg_notify((query:25 sent:60 0.52b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:12.192354 I | osd1: 2017-07-11 13:27:12.192051 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 35.974373 seconds old, received at 2017-07-11 13:26:36.217600: pg_notify((query:25 sent:60 0.539( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:13.192322 I | osd1: 2017-07-11 13:27:13.192163 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:26:53.192162)
- 2017-07-11 13:27:13.192403 I | osd1: 2017-07-11 13:27:13.192187 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:53.192162)
- 2017-07-11 13:27:13.192420 I | osd1: 2017-07-11 13:27:13.192250 7f28de450700 0 log_channel(cluster) log [WRN] : 55 slow requests, 3 included below; oldest blocked for > 52.211112 secs
- 2017-07-11 13:27:13.192459 I | osd1: 2017-07-11 13:27:13.192254 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 36.549638 seconds old, received at 2017-07-11 13:26:36.642558: pg_notify((query:25 sent:61 0.53d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:13.192481 I | osd1: 2017-07-11 13:27:13.192257 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 34.772839 seconds old, received at 2017-07-11 13:26:38.419357: pg_notify((query:25 sent:62 0.551( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 62) currently wait for new map
- 2017-07-11 13:27:13.192494 I | osd1: 2017-07-11 13:27:13.192258 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 33.301633 seconds old, received at 2017-07-11 13:26:39.890564: pg_notify((query:25 sent:61 0.558( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:14.197674 I | osd1: 2017-07-11 13:27:14.197170 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:26:54.197168)
- 2017-07-11 13:27:14.197765 I | osd1: 2017-07-11 13:27:14.197195 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:54.197168)
- 2017-07-11 13:27:15.197504 I | osd1: 2017-07-11 13:27:15.197372 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:26:55.197370)
- 2017-07-11 13:27:15.197640 I | osd1: 2017-07-11 13:27:15.197402 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:55.197370)
- 2017-07-11 13:27:16.197707 I | osd1: 2017-07-11 13:27:16.197564 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:26:56.197560)
- 2017-07-11 13:27:16.197816 I | osd1: 2017-07-11 13:27:16.197591 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:56.197560)
- 2017-07-11 13:27:17.197854 I | osd1: 2017-07-11 13:27:17.197778 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:26:57.197777)
- 2017-07-11 13:27:17.197932 I | osd1: 2017-07-11 13:27:17.197792 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:57.197777)
- 2017-07-11 13:27:18.198009 I | osd1: 2017-07-11 13:27:18.197922 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:26:58.197921)
- 2017-07-11 13:27:18.198028 I | osd1: 2017-07-11 13:27:18.197942 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:58.197921)
- 2017-07-11 13:27:19.198129 I | osd1: 2017-07-11 13:27:19.198056 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:26:59.198054)
- 2017-07-11 13:27:19.198223 I | osd1: 2017-07-11 13:27:19.198070 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:26:59.198054)
- 2017-07-11 13:27:20.198312 I | osd1: 2017-07-11 13:27:20.198213 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:00.198212)
- 2017-07-11 13:27:20.198411 I | osd1: 2017-07-11 13:27:20.198248 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:00.198212)
- 2017-07-11 13:27:21.198557 I | osd1: 2017-07-11 13:27:21.198361 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:01.198359)
- 2017-07-11 13:27:21.198651 I | osd1: 2017-07-11 13:27:21.198389 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:01.198359)
- 2017-07-11 13:27:21.198668 I | osd1: 2017-07-11 13:27:21.198478 7f28de450700 0 log_channel(cluster) log [WRN] : 51 slow requests, 5 included below; oldest blocked for > 60.217363 secs
- 2017-07-11 13:27:21.198696 I | osd1: 2017-07-11 13:27:21.198485 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.216860 seconds old, received at 2017-07-11 13:26:20.981588: pg_notify((query:21 sent:36 0.4a4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:21.198712 I | osd1: 2017-07-11 13:27:21.198490 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.216797 seconds old, received at 2017-07-11 13:26:20.981650: pg_notify((query:21 sent:36 0.4a6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:21.199268 I | osd1: 2017-07-11 13:27:21.198492 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.217363 seconds old, received at 2017-07-11 13:26:20.981085: pg_notify((query:21 sent:36 0.427( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:21.199285 I | osd1: 2017-07-11 13:27:21.198494 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.217124 seconds old, received at 2017-07-11 13:26:20.981323: pg_notify((query:21 sent:36 0.434( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:21.199299 I | osd1: 2017-07-11 13:27:21.198496 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.217076 seconds old, received at 2017-07-11 13:26:20.981372: pg_notify((query:21 sent:36 0.437( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:22.198759 I | osd1: 2017-07-11 13:27:22.198621 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:02.198619)
- 2017-07-11 13:27:22.198836 I | osd1: 2017-07-11 13:27:22.198646 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:02.198619)
- 2017-07-11 13:27:22.198854 I | osd1: 2017-07-11 13:27:22.198682 7f28de450700 0 log_channel(cluster) log [WRN] : 51 slow requests, 2 included below; oldest blocked for > 61.217571 secs
- 2017-07-11 13:27:22.198866 I | osd1: 2017-07-11 13:27:22.198687 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 61.217133 seconds old, received at 2017-07-11 13:26:20.981522: pg_notify((query:21 sent:36 0.46a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:22.198906 I | osd1: 2017-07-11 13:27:22.198703 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 61.217096 seconds old, received at 2017-07-11 13:26:20.981560: pg_notify((query:21 sent:36 0.474( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 36) currently wait for new map
- 2017-07-11 13:27:23.198891 I | osd1: 2017-07-11 13:27:23.198797 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:03.198796)
- 2017-07-11 13:27:23.198955 I | osd1: 2017-07-11 13:27:23.198822 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:03.198796)
- 2017-07-11 13:27:24.199053 I | osd1: 2017-07-11 13:27:24.198957 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:04.198955)
- 2017-07-11 13:27:24.199149 I | osd1: 2017-07-11 13:27:24.198984 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:04.198955)
- 2017-07-11 13:27:25.199198 I | osd1: 2017-07-11 13:27:25.199096 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:05.199094)
- 2017-07-11 13:27:25.199317 I | osd1: 2017-07-11 13:27:25.199116 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:05.199094)
- 2017-07-11 13:27:25.199422 I | osd1: 2017-07-11 13:27:25.199146 7f28de450700 0 log_channel(cluster) log [WRN] : 51 slow requests, 1 included below; oldest blocked for > 64.218040 secs
- 2017-07-11 13:27:25.199445 I | osd1: 2017-07-11 13:27:25.199151 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.111971 seconds old, received at 2017-07-11 13:26:25.087153: pg_notify((query:25 sent:53 0.4b2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:26.199472 I | osd1: 2017-07-11 13:27:26.199267 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:06.199265)
- 2017-07-11 13:27:26.199952 I | osd1: 2017-07-11 13:27:26.199301 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:06.199265)
- 2017-07-11 13:27:26.200008 I | osd1: 2017-07-11 13:27:26.199304 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:06.199265)
- 2017-07-11 13:27:27.199610 I | osd1: 2017-07-11 13:27:27.199479 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:07.199478)
- 2017-07-11 13:27:27.199698 I | osd1: 2017-07-11 13:27:27.199502 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:07.199478)
- 2017-07-11 13:27:27.199714 I | osd1: 2017-07-11 13:27:27.199505 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:07.199478)
- 2017-07-11 13:27:27.199725 I | osd1: 2017-07-11 13:27:27.199538 7f28de450700 0 log_channel(cluster) log [WRN] : 51 slow requests, 2 included below; oldest blocked for > 66.218430 secs
- 2017-07-11 13:27:27.199751 I | osd1: 2017-07-11 13:27:27.199555 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.619029 seconds old, received at 2017-07-11 13:26:26.580485: pg_notify((query:25 sent:53 0.4d9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:27.199764 I | osd1: 2017-07-11 13:27:27.199558 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.064519 seconds old, received at 2017-07-11 13:26:27.134996: pg_notify((query:25 sent:54 0.4dd( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 54) currently wait for new map
- 2017-07-11 13:27:28.216480 I | osd1: 2017-07-11 13:27:28.200120 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:08.200118)
- 2017-07-11 13:27:28.216550 I | osd1: 2017-07-11 13:27:28.200146 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:08.200118)
- 2017-07-11 13:27:28.216569 I | osd1: 2017-07-11 13:27:28.200149 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:08.200118)
- 2017-07-11 13:27:28.216582 I | osd1: 2017-07-11 13:27:28.200193 7f28de450700 0 log_channel(cluster) log [WRN] : 51 slow requests, 2 included below; oldest blocked for > 67.219084 secs
- 2017-07-11 13:27:28.216610 I | osd1: 2017-07-11 13:27:28.200211 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.724418 seconds old, received at 2017-07-11 13:26:27.475751: pg_notify((query:25 sent:53 0.4e3( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 53) currently wait for new map
- 2017-07-11 13:27:28.216625 I | osd1: 2017-07-11 13:27:28.200215 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.324999 seconds old, received at 2017-07-11 13:26:27.875170: pg_notify((query:25 sent:55 0.4e6( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:29.200432 I | osd1: 2017-07-11 13:27:29.200316 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:09.200314)
- 2017-07-11 13:27:29.200510 I | osd1: 2017-07-11 13:27:29.200335 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:09.200314)
- 2017-07-11 13:27:29.200538 I | osd1: 2017-07-11 13:27:29.200339 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:09.200314)
- 2017-07-11 13:27:29.200578 I | osd1: 2017-07-11 13:27:29.200368 7f28de450700 0 log_channel(cluster) log [WRN] : 51 slow requests, 1 included below; oldest blocked for > 68.219263 secs
- 2017-07-11 13:27:29.200590 I | osd1: 2017-07-11 13:27:29.200373 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.902580 seconds old, received at 2017-07-11 13:26:28.297767: pg_notify((query:25 sent:55 0.4ec( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 55) currently wait for new map
- 2017-07-11 13:27:30.209993 I | osd1: 2017-07-11 13:27:30.204451 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:10.204450)
- 2017-07-11 13:27:30.215891 I | osd1: 2017-07-11 13:27:30.204471 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:10.204450)
- 2017-07-11 13:27:30.215933 I | osd1: 2017-07-11 13:27:30.204475 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:10.204450)
- 2017-07-11 13:27:30.215949 I | osd1: 2017-07-11 13:27:30.204514 7f28de450700 0 log_channel(cluster) log [WRN] : 51 slow requests, 5 included below; oldest blocked for > 69.223400 secs
- 2017-07-11 13:27:30.215980 I | osd1: 2017-07-11 13:27:30.204519 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.185531 seconds old, received at 2017-07-11 13:26:30.018953: pg_notify((query:21 sent:42 0.486( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:30.215994 I | osd1: 2017-07-11 13:27:30.204522 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.185465 seconds old, received at 2017-07-11 13:26:30.019019: pg_notify((query:21 sent:42 0.49d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:30.222053 I | osd1: 2017-07-11 13:27:30.204524 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.185445 seconds old, received at 2017-07-11 13:26:30.019039: pg_notify((query:21 sent:42 0.4a5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:30.222091 I | osd1: 2017-07-11 13:27:30.204527 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.891603 seconds old, received at 2017-07-11 13:26:29.312882: pg_notify((query:25 sent:56 0.4f7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:30.222108 I | osd1: 2017-07-11 13:27:30.204529 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.502898 seconds old, received at 2017-07-11 13:26:29.701587: pg_notify((query:25 sent:56 0.4fb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:31.204884 I | osd1: 2017-07-11 13:27:31.204728 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:11.204712)
- 2017-07-11 13:27:31.204962 I | osd1: 2017-07-11 13:27:31.204754 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:11.204712)
- 2017-07-11 13:27:31.204979 I | osd1: 2017-07-11 13:27:31.204757 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:11.204712)
- 2017-07-11 13:27:31.204992 I | osd1: 2017-07-11 13:27:31.204807 7f28de450700 0 log_channel(cluster) log [WRN] : 51 slow requests, 5 included below; oldest blocked for > 70.223681 secs
- 2017-07-11 13:27:31.205021 I | osd1: 2017-07-11 13:27:31.204813 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 61.185711 seconds old, received at 2017-07-11 13:26:30.019054: pg_notify((query:25 sent:42 0.4b0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:31.205036 I | osd1: 2017-07-11 13:27:31.204815 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.406144 seconds old, received at 2017-07-11 13:26:30.798622: pg_notify((query:25 sent:57 0.503( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 57) currently wait for new map
- 2017-07-11 13:27:31.205051 I | osd1: 2017-07-11 13:27:31.204818 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.430232 seconds old, received at 2017-07-11 13:26:30.774533: pg_notify((query:25 sent:56 0.502( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:31.205063 I | osd1: 2017-07-11 13:27:31.204821 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 61.185696 seconds old, received at 2017-07-11 13:26:30.019069: pg_notify((query:25 sent:42 0.4bb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:31.205088 I | osd1: 2017-07-11 13:27:31.204823 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 61.185679 seconds old, received at 2017-07-11 13:26:30.019086: pg_notify((query:25 sent:42 0.4e0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:32.207704 I | osd1: 2017-07-11 13:27:32.205602 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:12.205601)
- 2017-07-11 13:27:32.207906 I | osd1: 2017-07-11 13:27:32.205641 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:12.205601)
- 2017-07-11 13:27:32.207952 I | osd1: 2017-07-11 13:27:32.207809 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:12.205601)
- 2017-07-11 13:27:32.208053 I | osd1: 2017-07-11 13:27:32.208020 7f28de450700 0 log_channel(cluster) log [WRN] : 50 slow requests, 2 included below; oldest blocked for > 71.226891 secs
- 2017-07-11 13:27:32.208106 I | osd1: 2017-07-11 13:27:32.208027 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.550061 seconds old, received at 2017-07-11 13:26:31.657915: pg_notify((query:25 sent:56 0.509( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:32.208134 I | osd1: 2017-07-11 13:27:32.208031 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 62.188873 seconds old, received at 2017-07-11 13:26:30.019102: pg_notify((query:25 sent:42 0.4f5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 42) currently wait for new map
- 2017-07-11 13:27:33.211724 I | osd1: 2017-07-11 13:27:33.209563 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:13.209561)
- 2017-07-11 13:27:33.211798 I | osd1: 2017-07-11 13:27:33.209592 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:13.209561)
- 2017-07-11 13:27:33.211816 I | osd1: 2017-07-11 13:27:33.209596 7f28de450700 -1 osd.1 33 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:13.209561)
- 2017-07-11 13:27:33.211837 I | osd1: 2017-07-11 13:27:33.209657 7f28de450700 0 log_channel(cluster) log [WRN] : 50 slow requests, 2 included below; oldest blocked for > 72.228549 secs
- 2017-07-11 13:27:33.211868 I | osd1: 2017-07-11 13:27:33.209662 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.551891 seconds old, received at 2017-07-11 13:26:32.657742: pg_notify((query:25 sent:58 0.514( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 58) currently wait for new map
- 2017-07-11 13:27:33.211892 I | osd1: 2017-07-11 13:27:33.209665 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.711361 seconds old, received at 2017-07-11 13:26:32.498272: pg_notify((query:25 sent:56 0.513( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:34.211544 I | osd1: 2017-07-11 13:27:34.211321 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:14.211320)
- 2017-07-11 13:27:34.211639 I | osd1: 2017-07-11 13:27:34.211333 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:14.211320)
- 2017-07-11 13:27:34.211657 I | osd1: 2017-07-11 13:27:34.211337 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:14.211320)
- 2017-07-11 13:27:34.211685 I | osd1: 2017-07-11 13:27:34.211394 7f28de450700 0 log_channel(cluster) log [WRN] : 65 slow requests, 5 included below; oldest blocked for > 69.124192 secs
- 2017-07-11 13:27:34.211700 I | osd1: 2017-07-11 13:27:34.211400 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 43.169587 seconds old, received at 2017-07-11 13:26:51.041759: pg_notify((query:26 sent:72 0.5bc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 72) currently wait for new map
- 2017-07-11 13:27:34.211714 I | osd1: 2017-07-11 13:27:34.211402 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 50.483405 seconds old, received at 2017-07-11 13:26:43.727940: pg_notify((query:26 sent:67 0.580( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:34.211726 I | osd1: 2017-07-11 13:27:34.211405 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 39.432352 seconds old, received at 2017-07-11 13:26:54.778993: pg_notify((query:26 sent:76 0.5eb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:34.211738 I | osd1: 2017-07-11 13:27:34.211407 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 50.472048 seconds old, received at 2017-07-11 13:26:43.739297: pg_notify((query:26 sent:67 0.581( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:34.211767 I | osd1: 2017-07-11 13:27:34.211410 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 38.991231 seconds old, received at 2017-07-11 13:26:55.220115: pg_notify((query:26 sent:76 0.5f2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:35.211688 I | osd1: 2017-07-11 13:27:35.211513 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:15.211511)
- 2017-07-11 13:27:35.211772 I | osd1: 2017-07-11 13:27:35.211528 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:15.211511)
- 2017-07-11 13:27:35.211789 I | osd1: 2017-07-11 13:27:35.211532 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:15.211511)
- 2017-07-11 13:27:35.211818 I | osd1: 2017-07-11 13:27:35.211613 7f28de450700 0 log_channel(cluster) log [WRN] : 66 slow requests, 5 included below; oldest blocked for > 70.124410 secs
- 2017-07-11 13:27:35.211832 I | osd1: 2017-07-11 13:27:35.211618 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 50.962313 seconds old, received at 2017-07-11 13:26:44.249250: pg_notify((query:26 sent:67 0.584( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:35.211868 I | osd1: 2017-07-11 13:27:35.211620 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 36.391198 seconds old, received at 2017-07-11 13:26:58.820365: pg_notify((query:26 sent:77 0.60e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:35.211893 I | osd1: 2017-07-11 13:27:35.211623 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 49.607724 seconds old, received at 2017-07-11 13:26:45.603838: pg_notify((query:26 sent:68 0.595( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:35.211907 I | osd1: 2017-07-11 13:27:35.211625 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 35.996271 seconds old, received at 2017-07-11 13:26:59.215292: pg_notify((query:26 sent:77 0.610( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:35.211919 I | osd1: 2017-07-11 13:27:35.211627 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 43.225311 seconds old, received at 2017-07-11 13:26:51.986252: pg_notify((query:26 sent:73 0.5cb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 73) currently wait for new map
- 2017-07-11 13:27:36.211900 I | osd1: 2017-07-11 13:27:36.211737 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:16.211736)
- 2017-07-11 13:27:36.211964 I | osd1: 2017-07-11 13:27:36.211755 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:16.211736)
- 2017-07-11 13:27:36.211980 I | osd1: 2017-07-11 13:27:36.211758 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:16.211736)
- 2017-07-11 13:27:36.211991 I | osd1: 2017-07-11 13:27:36.211826 7f28de450700 0 log_channel(cluster) log [WRN] : 71 slow requests, 5 included below; oldest blocked for > 71.124614 secs
- 2017-07-11 13:27:36.212027 I | osd1: 2017-07-11 13:27:36.211832 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.721337 seconds old, received at 2017-07-11 13:27:05.490431: pg_notify((query:30 sent:78 0.5e2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.5f4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:36.212044 I | osd1: 2017-07-11 13:27:36.211836 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 35.307991 seconds old, received at 2017-07-11 13:27:00.903776: pg_notify((query:26 sent:78 0.61e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:36.212056 I | osd1: 2017-07-11 13:27:36.211838 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.644354 seconds old, received at 2017-07-11 13:27:05.567414: pg_notify((query:31 sent:78 0.430( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:36.212068 I | osd1: 2017-07-11 13:27:36.211840 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.027417 seconds old, received at 2017-07-11 13:27:06.184351: pg_notify((query:31 sent:78 0.45f( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.46d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:36.212081 I | osd1: 2017-07-11 13:27:36.211843 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.011214 seconds old, received at 2017-07-11 13:27:06.200553: pg_notify((query:31 sent:78 0.41d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.421( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.422( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:37.212118 I | osd1: 2017-07-11 13:27:37.211919 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:17.211918)
- 2017-07-11 13:27:37.212198 I | osd1: 2017-07-11 13:27:37.211942 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:17.211918)
- 2017-07-11 13:27:37.212214 I | osd1: 2017-07-11 13:27:37.211946 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:17.211918)
- 2017-07-11 13:27:37.212225 I | osd1: 2017-07-11 13:27:37.212018 7f28de450700 0 log_channel(cluster) log [WRN] : 73 slow requests, 5 included below; oldest blocked for > 72.124801 secs
- 2017-07-11 13:27:37.212255 I | osd1: 2017-07-11 13:27:37.212023 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.831535 seconds old, received at 2017-07-11 13:27:06.380420: pg_notify((query:33 sent:81 0.489( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.49b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.4ad( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 81) currently wait for new map
- 2017-07-11 13:27:37.212274 I | osd1: 2017-07-11 13:27:37.212026 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.022916 seconds old, received at 2017-07-11 13:27:07.189039: pg_notify((query:33 sent:81 0.4bc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.4c0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:81 0.4c1( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 81) currently wait for new map
- 2017-07-11 13:27:37.212286 I | osd1: 2017-07-11 13:27:37.212029 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 33.423069 seconds old, received at 2017-07-11 13:27:03.788885: pg_notify((query:26 sent:79 0.63e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 79) currently wait for new map
- 2017-07-11 13:27:37.212304 I | osd1: 2017-07-11 13:27:37.212031 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 43.439708 seconds old, received at 2017-07-11 13:26:53.772246: pg_notify((query:26 sent:75 0.5df( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 75) currently wait for new map
- 2017-07-11 13:27:37.212315 I | osd1: 2017-07-11 13:27:37.212045 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 42.610629 seconds old, received at 2017-07-11 13:26:54.601325: pg_notify((query:26 sent:76 0.5e8( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:38.221255 I | osd1: 2017-07-11 13:27:38.212664 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:18.212663)
- 2017-07-11 13:27:38.229206 I | osd1: 2017-07-11 13:27:38.212686 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:18.212663)
- 2017-07-11 13:27:38.229245 I | osd1: 2017-07-11 13:27:38.212689 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:18.212663)
- 2017-07-11 13:27:38.230501 I | osd1: 2017-07-11 13:27:38.212809 7f28de450700 0 log_channel(cluster) log [WRN] : 76 slow requests, 5 included below; oldest blocked for > 73.125544 secs
- 2017-07-11 13:27:38.233240 I | osd1: 2017-07-11 13:27:38.229298 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.467090 seconds old, received at 2017-07-11 13:27:07.745608: pg_notify((query:33 sent:82 0.4e4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.4e7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.4fe( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.506( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:38.239040 I | osd1: 2017-07-11 13:27:38.229303 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.466970 seconds old, received at 2017-07-11 13:27:07.745728: pg_notify((query:33 sent:82 0.592( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:38.239083 I | osd1: 2017-07-11 13:27:38.229306 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 62.853766 seconds old, received at 2017-07-11 13:26:35.358932: pg_notify((query:25 sent:60 0.52b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:38.239130 I | osd1: 2017-07-11 13:27:38.229311 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 85.373497 seconds old, received at 2017-07-11 13:26:12.839201: osd_pg_create(e44 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:38.239154 I | osd1: 2017-07-11 13:27:38.229322 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 42.086802 seconds old, received at 2017-07-11 13:26:56.125895: pg_notify((query:26 sent:77 0.5fa( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:39.229656 I | osd1: 2017-07-11 13:27:39.229459 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:19.229458)
- 2017-07-11 13:27:39.229742 I | osd1: 2017-07-11 13:27:39.229482 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:19.229458)
- 2017-07-11 13:27:39.229759 I | osd1: 2017-07-11 13:27:39.229485 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:19.229458)
- 2017-07-11 13:27:39.229786 I | osd1: 2017-07-11 13:27:39.229557 7f28de450700 0 log_channel(cluster) log [WRN] : 86 slow requests, 5 included below; oldest blocked for > 74.142341 secs
- 2017-07-11 13:27:39.229806 I | osd1: 2017-07-11 13:27:39.229563 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.990371 seconds old, received at 2017-07-11 13:27:08.239123: pg_notify((query:33 sent:82 0.599( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.59d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5a2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5b1( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5b7( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.5b8( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:39.229823 I | osd1: 2017-07-11 13:27:39.229568 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.916765 seconds old, received at 2017-07-11 13:27:08.312729: pg_notify((query:33 sent:82 0.658( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:39.229836 I | osd1: 2017-07-11 13:27:39.229572 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.951168 seconds old, received at 2017-07-11 13:27:08.278327: pg_notify((query:33 sent:82 0.646( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:39.229847 I | osd1: 2017-07-11 13:27:39.229589 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.905708 seconds old, received at 2017-07-11 13:27:08.323786: pg_notify((query:33 sent:82 0.660( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:39.229880 I | osd1: 2017-07-11 13:27:39.229592 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.903106 seconds old, received at 2017-07-11 13:27:08.326388: pg_notify((query:33 sent:82 0.663( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:40.229887 I | osd1: 2017-07-11 13:27:40.229689 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:20.229688)
- 2017-07-11 13:27:40.229971 I | osd1: 2017-07-11 13:27:40.229707 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:20.229688)
- 2017-07-11 13:27:40.229988 I | osd1: 2017-07-11 13:27:40.229711 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:20.229688)
- 2017-07-11 13:27:40.230017 I | osd1: 2017-07-11 13:27:40.229797 7f28de450700 0 log_channel(cluster) log [WRN] : 86 slow requests, 5 included below; oldest blocked for > 75.142592 secs
- 2017-07-11 13:27:40.230031 I | osd1: 2017-07-11 13:27:40.229802 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.918775 seconds old, received at 2017-07-11 13:26:39.310971: pg_notify((query:25 sent:63 0.557( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 63) currently wait for new map
- 2017-07-11 13:27:40.230045 I | osd1: 2017-07-11 13:27:40.229804 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 31.923477 seconds old, received at 2017-07-11 13:27:08.306268: pg_notify((query:33 sent:80 0.659( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 80) currently wait for new map
- 2017-07-11 13:27:40.230057 I | osd1: 2017-07-11 13:27:40.229807 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 31.894077 seconds old, received at 2017-07-11 13:27:08.335668: pg_notify((query:33 sent:80 0.66d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 80) currently wait for new map
- 2017-07-11 13:27:40.230099 I | osd1: 2017-07-11 13:27:40.229813 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 87.390545 seconds old, received at 2017-07-11 13:26:12.839201: osd_pg_create(e44 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:40.230122 I | osd1: 2017-07-11 13:27:40.229825 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 56.953126 seconds old, received at 2017-07-11 13:26:43.276620: pg_notify((query:26 sent:61 0.572( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:41.230261 I | osd1: 2017-07-11 13:27:41.229957 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:21.229955)
- 2017-07-11 13:27:41.230319 I | osd1: 2017-07-11 13:27:41.229987 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:21.229955)
- 2017-07-11 13:27:41.230335 I | osd1: 2017-07-11 13:27:41.229995 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:21.229955)
- 2017-07-11 13:27:41.230347 I | osd1: 2017-07-11 13:27:41.230167 7f28de450700 0 log_channel(cluster) log [WRN] : 88 slow requests, 5 included below; oldest blocked for > 76.142899 secs
- 2017-07-11 13:27:41.230360 I | osd1: 2017-07-11 13:27:41.230172 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.171119 seconds old, received at 2017-07-11 13:26:41.058933: pg_notify((query:25 sent:61 0.560( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:41.230390 I | osd1: 2017-07-11 13:27:41.230175 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.223683 seconds old, received at 2017-07-11 13:26:41.006369: pg_notify((query:25 sent:61 0.55c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:41.230402 I | osd1: 2017-07-11 13:27:41.230179 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.592509 seconds old, received at 2017-07-11 13:27:10.637543: pg_notify((query:33 sent:83 0.69b( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:41.230431 I | osd1: 2017-07-11 13:27:41.230191 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 33.468466 seconds old, received at 2017-07-11 13:27:07.761587: pg_notify((query:33 sent:82 0.546( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.55a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:33 sent:82 0.569( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:41.230477 I | osd1: 2017-07-11 13:27:41.230194 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 56.124997 seconds old, received at 2017-07-11 13:26:45.105055: pg_notify((query:26 sent:68 0.58a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:42.230581 I | osd1: 2017-07-11 13:27:42.230385 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:22.230384)
- 2017-07-11 13:27:42.230671 I | osd1: 2017-07-11 13:27:42.230412 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:22.230384)
- 2017-07-11 13:27:42.230689 I | osd1: 2017-07-11 13:27:42.230417 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:22.230384)
- 2017-07-11 13:27:42.230718 I | osd1: 2017-07-11 13:27:42.230490 7f28de450700 0 log_channel(cluster) log [WRN] : 92 slow requests, 5 included below; oldest blocked for > 77.143283 secs
- 2017-07-11 13:27:42.230733 I | osd1: 2017-07-11 13:27:42.230495 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.775534 seconds old, received at 2017-07-11 13:26:41.454902: pg_notify((query:25 sent:61 0.568( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:42.230747 I | osd1: 2017-07-11 13:27:42.230499 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.955004 seconds old, received at 2017-07-11 13:27:11.275432: pg_notify((query:33 sent:84 0.6a9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:42.230759 I | osd1: 2017-07-11 13:27:42.230502 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.597711 seconds old, received at 2017-07-11 13:27:11.632725: pg_notify((query:33 sent:84 0.6af( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:42.230771 I | osd1: 2017-07-11 13:27:42.230504 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.588758 seconds old, received at 2017-07-11 13:27:11.641678: pg_notify((query:33 sent:84 0.6b0( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:42.230802 I | osd1: 2017-07-11 13:27:42.230507 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.092767 seconds old, received at 2017-07-11 13:27:12.137669: pg_notify((query:33 sent:84 0.6b2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:43.230868 I | osd1: 2017-07-11 13:27:43.230686 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:23.230684)
- 2017-07-11 13:27:43.230951 I | osd1: 2017-07-11 13:27:43.230714 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:23.230684)
- 2017-07-11 13:27:43.230968 I | osd1: 2017-07-11 13:27:43.230717 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:23.230684)
- 2017-07-11 13:27:43.230996 I | osd1: 2017-07-11 13:27:43.230778 7f28de450700 0 log_channel(cluster) log [WRN] : 93 slow requests, 5 included below; oldest blocked for > 78.143573 secs
- 2017-07-11 13:27:43.231010 I | osd1: 2017-07-11 13:27:43.230783 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.365027 seconds old, received at 2017-07-11 13:27:12.865700: pg_notify((query:33 sent:84 0.6c5( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:43.231024 I | osd1: 2017-07-11 13:27:43.230786 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 34.456532 seconds old, received at 2017-07-11 13:27:08.774195: pg_notify((query:33 sent:80 0.67d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 80) currently wait for new map
- 2017-07-11 13:27:43.231037 I | osd1: 2017-07-11 13:27:43.230788 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 67.013127 seconds old, received at 2017-07-11 13:26:36.217600: pg_notify((query:25 sent:60 0.539( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 60) currently wait for new map
- 2017-07-11 13:27:43.231074 I | osd1: 2017-07-11 13:27:43.230799 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 59.951200 seconds old, received at 2017-07-11 13:26:43.279526: pg_notify((query:26 sent:66 0.577( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 66) currently wait for new map
- 2017-07-11 13:27:43.231088 I | osd1: 2017-07-11 13:27:43.230801 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 46.111899 seconds old, received at 2017-07-11 13:26:57.118827: pg_notify((query:26 sent:77 0.601( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:44.231056 I | osd1: 2017-07-11 13:27:44.230903 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:24.230885)
- 2017-07-11 13:27:44.231152 I | osd1: 2017-07-11 13:27:44.230931 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:24.230885)
- 2017-07-11 13:27:44.231195 I | osd1: 2017-07-11 13:27:44.230935 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:24.230885)
- 2017-07-11 13:27:44.231216 I | osd1: 2017-07-11 13:27:44.230991 7f28de450700 0 log_channel(cluster) log [WRN] : 96 slow requests, 5 included below; oldest blocked for > 79.143791 secs
- 2017-07-11 13:27:44.231235 I | osd1: 2017-07-11 13:27:44.230996 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.503004 seconds old, received at 2017-07-11 13:26:43.727940: pg_notify((query:26 sent:67 0.580( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:44.231276 I | osd1: 2017-07-11 13:27:44.230999 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.193221 seconds old, received at 2017-07-11 13:27:14.037724: pg_notify((query:33 sent:84 0.6e4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:44.231297 I | osd1: 2017-07-11 13:27:44.231003 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.491647 seconds old, received at 2017-07-11 13:26:43.739297: pg_notify((query:26 sent:67 0.581( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:44.231315 I | osd1: 2017-07-11 13:27:44.231006 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.184016 seconds old, received at 2017-07-11 13:27:14.046928: pg_notify((query:33 sent:84 0.6dc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:44.231347 I | osd1: 2017-07-11 13:27:44.231008 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.954325 seconds old, received at 2017-07-11 13:26:43.276620: pg_notify((query:26 sent:61 0.572( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:45.231239 I | osd1: 2017-07-11 13:27:45.231082 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:25.231080)
- 2017-07-11 13:27:45.231334 I | osd1: 2017-07-11 13:27:45.231108 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:25.231080)
- 2017-07-11 13:27:45.231377 I | osd1: 2017-07-11 13:27:45.231112 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:25.231080)
- 2017-07-11 13:27:45.231397 I | osd1: 2017-07-11 13:27:45.231173 7f28de450700 0 log_channel(cluster) log [WRN] : 102 slow requests, 5 included below; oldest blocked for > 80.143968 secs
- 2017-07-11 13:27:45.231417 I | osd1: 2017-07-11 13:27:45.231178 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.669061 seconds old, received at 2017-07-11 13:27:14.562060: pg_notify((query:33 sent:84 0.6eb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:45.231460 I | osd1: 2017-07-11 13:27:45.231183 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.981872 seconds old, received at 2017-07-11 13:26:44.249250: pg_notify((query:26 sent:67 0.584( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:45.231480 I | osd1: 2017-07-11 13:27:45.231185 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.579540 seconds old, received at 2017-07-11 13:27:14.651582: pg_notify((query:33 sent:84 0.6f4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:45.231498 I | osd1: 2017-07-11 13:27:45.231187 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.579626 seconds old, received at 2017-07-11 13:27:14.651495: pg_notify((query:33 sent:83 0.6fb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:45.231530 I | osd1: 2017-07-11 13:27:45.231189 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.150142 seconds old, received at 2017-07-11 13:27:15.080979: pg_notify((query:33 sent:83 0.704( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:46.231442 I | osd1: 2017-07-11 13:27:46.231282 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:26.231281)
- 2017-07-11 13:27:46.231505 I | osd1: 2017-07-11 13:27:46.231294 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:26.231281)
- 2017-07-11 13:27:46.231521 I | osd1: 2017-07-11 13:27:46.231297 7f28de450700 -1 osd.1 40 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:26.231281)
- 2017-07-11 13:27:46.231532 I | osd1: 2017-07-11 13:27:46.231374 7f28de450700 0 log_channel(cluster) log [WRN] : 105 slow requests, 5 included below; oldest blocked for > 81.144176 secs
- 2017-07-11 13:27:46.231543 I | osd1: 2017-07-11 13:27:46.231379 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.627491 seconds old, received at 2017-07-11 13:26:45.603838: pg_notify((query:26 sent:68 0.595( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:46.231569 I | osd1: 2017-07-11 13:27:46.231383 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.655197 seconds old, received at 2017-07-11 13:27:15.576133: pg_notify((query:33 sent:85 0.710( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 85) currently wait for new map
- 2017-07-11 13:27:46.231582 I | osd1: 2017-07-11 13:27:46.231385 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.282693 seconds old, received at 2017-07-11 13:27:15.948637: pg_notify((query:33 sent:85 0.718( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 85) currently wait for new map
- 2017-07-11 13:27:46.231593 I | osd1: 2017-07-11 13:27:46.231388 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 31.116766 seconds old, received at 2017-07-11 13:27:15.114563: pg_notify((query:33 sent:83 0.707( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 83) currently wait for new map
- 2017-07-11 13:27:46.231607 I | osd1: 2017-07-11 13:27:46.231390 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 31.665693 seconds old, received at 2017-07-11 13:27:14.565637: pg_notify((query:33 sent:84 0.6ec( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:47.231683 I | osd1: 2017-07-11 13:27:47.231520 7f28de450700 -1 osd.1 42 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:27.231519)
- 2017-07-11 13:27:47.231777 I | osd1: 2017-07-11 13:27:47.231538 7f28de450700 -1 osd.1 42 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:27.231519)
- 2017-07-11 13:27:47.231850 I | osd1: 2017-07-11 13:27:47.231541 7f28de450700 -1 osd.1 42 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:27.231519)
- 2017-07-11 13:27:47.231872 I | osd1: 2017-07-11 13:27:47.231621 7f28de450700 0 log_channel(cluster) log [WRN] : 98 slow requests, 5 included below; oldest blocked for > 82.144421 secs
- 2017-07-11 13:27:47.231905 I | osd1: 2017-07-11 13:27:47.231626 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 62.126519 seconds old, received at 2017-07-11 13:26:45.105055: pg_notify((query:26 sent:68 0.58a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 68) currently wait for new map
- 2017-07-11 13:27:47.231926 I | osd1: 2017-07-11 13:27:47.231629 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 63.952048 seconds old, received at 2017-07-11 13:26:43.279526: pg_notify((query:26 sent:66 0.577( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 66) currently wait for new map
- 2017-07-11 13:27:47.231944 I | osd1: 2017-07-11 13:27:47.231631 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 31.698025 seconds old, received at 2017-07-11 13:27:15.533549: pg_notify((query:33 sent:85 0.70d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 85) currently wait for new map
- 2017-07-11 13:27:47.231962 I | osd1: 2017-07-11 13:27:47.231635 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 73.529111 seconds old, received at 2017-07-11 13:26:33.702464: pg_notify((query:25 sent:56 0.51c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:47.231992 I | osd1: 2017-07-11 13:27:47.231637 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 62.639275 seconds old, received at 2017-07-11 13:26:44.592300: pg_notify((query:26 sent:67 0.585( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:48.240376 I | osd1: 2017-07-11 13:27:48.232786 7f28de450700 -1 osd.1 42 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:28.232784)
- 2017-07-11 13:27:48.249700 I | osd1: 2017-07-11 13:27:48.232811 7f28de450700 -1 osd.1 42 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:28.232784)
- 2017-07-11 13:27:48.249763 I | osd1: 2017-07-11 13:27:48.232815 7f28de450700 -1 osd.1 42 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:28.232784)
- 2017-07-11 13:27:48.249787 I | osd1: 2017-07-11 13:27:48.232896 7f28de450700 0 log_channel(cluster) log [WRN] : 91 slow requests, 5 included below; oldest blocked for > 96.647456 secs
- 2017-07-11 13:27:48.249824 I | osd1: 2017-07-11 13:27:48.232903 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 63.640544 seconds old, received at 2017-07-11 13:26:44.592300: pg_notify((query:26 sent:67 0.585( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 67) currently wait for new map
- 2017-07-11 13:27:48.249846 I | osd1: 2017-07-11 13:27:48.232906 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 40.013111 seconds old, received at 2017-07-11 13:27:08.219733: pg_notify((query:33 sent:82 0.5d4( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:48.249865 I | osd1: 2017-07-11 13:27:48.232908 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 71.590286 seconds old, received at 2017-07-11 13:26:36.642558: pg_notify((query:25 sent:61 0.53d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:48.249911 I | osd1: 2017-07-11 13:27:48.232910 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 43.246956 seconds old, received at 2017-07-11 13:27:04.985887: pg_notify((query:30 sent:78 0.5f9( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:30 sent:78 0.608( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) (query:31 sent:78 0.60a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 78) currently wait for new map
- 2017-07-11 13:27:48.250117 I | osd1: 2017-07-11 13:27:48.232913 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 37.072739 seconds old, received at 2017-07-11 13:27:11.160105: pg_notify((query:33 sent:84 0.69c( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:49.233207 I | osd1: 2017-07-11 13:27:49.233037 7f28de450700 -1 osd.1 42 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:29.233035)
- 2017-07-11 13:27:49.233271 I | osd1: 2017-07-11 13:27:49.233062 7f28de450700 -1 osd.1 42 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:29.233035)
- 2017-07-11 13:27:49.233288 I | osd1: 2017-07-11 13:27:49.233066 7f28de450700 -1 osd.1 42 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:29.233035)
- 2017-07-11 13:27:49.233301 I | osd1: 2017-07-11 13:27:49.233128 7f28de450700 0 log_channel(cluster) log [WRN] : 92 slow requests, 5 included below; oldest blocked for > 97.647688 secs
- 2017-07-11 13:27:49.233329 I | osd1: 2017-07-11 13:27:49.233134 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.033977 seconds old, received at 2017-07-11 13:27:19.199097: pg_notify((query:33 sent:86 0.735( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:49.233345 I | osd1: 2017-07-11 13:27:49.233136 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 70.813718 seconds old, received at 2017-07-11 13:26:38.419357: pg_notify((query:25 sent:62 0.551( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 62) currently wait for new map
- 2017-07-11 13:27:49.233358 I | osd1: 2017-07-11 13:27:49.233138 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.350007 seconds old, received at 2017-07-11 13:26:48.883068: pg_notify((query:26 sent:70 0.5ab( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 70) currently wait for new map
- 2017-07-11 13:27:49.233373 I | osd1: 2017-07-11 13:27:49.233141 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 51.699534 seconds old, received at 2017-07-11 13:26:57.533540: pg_notify((query:26 sent:77 0.605( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 77) currently wait for new map
- 2017-07-11 13:27:49.233384 I | osd1: 2017-07-11 13:27:49.233145 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 75.255146 seconds old, received at 2017-07-11 13:26:33.977929: pg_notify((query:25 sent:56 0.51e( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 56) currently wait for new map
- 2017-07-11 13:27:50.233471 I | osd1: 2017-07-11 13:27:50.233257 7f28de450700 -1 osd.1 42 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:30.233256)
- 2017-07-11 13:27:50.233571 I | osd1: 2017-07-11 13:27:50.233281 7f28de450700 -1 osd.1 42 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:30.233256)
- 2017-07-11 13:27:50.233588 I | osd1: 2017-07-11 13:27:50.233285 7f28de450700 -1 osd.1 42 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:30.233256)
- 2017-07-11 13:27:50.233623 I | osd1: 2017-07-11 13:27:50.233369 7f28de450700 0 log_channel(cluster) log [WRN] : 93 slow requests, 5 included below; oldest blocked for > 98.647930 secs
- 2017-07-11 13:27:50.233639 I | osd1: 2017-07-11 13:27:50.233376 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.401485 seconds old, received at 2017-07-11 13:27:19.831832: pg_notify((query:33 sent:86 0.73a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:50.233653 I | osd1: 2017-07-11 13:27:50.233379 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 61.350249 seconds old, received at 2017-07-11 13:26:48.883068: pg_notify((query:26 sent:70 0.5ab( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 70) currently wait for new map
- 2017-07-11 13:27:50.233669 I | osd1: 2017-07-11 13:27:50.233381 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 66.953742 seconds old, received at 2017-07-11 13:26:43.279575: pg_notify((query:26 sent:66 0.57a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 66) currently wait for new map
- 2017-07-11 13:27:50.233696 I | osd1: 2017-07-11 13:27:50.233384 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 42.012912 seconds old, received at 2017-07-11 13:27:08.220405: pg_notify((query:33 sent:82 0.634( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 82) currently wait for new map
- 2017-07-11 13:27:50.233710 I | osd1: 2017-07-11 13:27:50.233386 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 70.342753 seconds old, received at 2017-07-11 13:26:39.890564: pg_notify((query:25 sent:61 0.558( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 61) currently wait for new map
- 2017-07-11 13:27:51.242443 I | osd1: 2017-07-11 13:27:51.241903 7f28de450700 -1 osd.1 44 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:31.241899)
- 2017-07-11 13:27:51.242532 I | osd1: 2017-07-11 13:27:51.241918 7f28de450700 -1 osd.1 44 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:31.241899)
- 2017-07-11 13:27:51.242550 I | osd1: 2017-07-11 13:27:51.241922 7f28de450700 -1 osd.1 44 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:31.241899)
- 2017-07-11 13:27:51.242577 I | osd1: 2017-07-11 13:27:51.242251 7f28de450700 0 log_channel(cluster) log [WRN] : 104 slow requests, 5 included below; oldest blocked for > 99.656573 secs
- 2017-07-11 13:27:51.242592 I | osd1: 2017-07-11 13:27:51.242256 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.200202 seconds old, received at 2017-07-11 13:26:51.041759: pg_notify((query:26 sent:72 0.5bc( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 72) currently wait for new map
- 2017-07-11 13:27:51.242618 I | osd1: 2017-07-11 13:27:51.242262 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 96.978876 seconds old, received at 2017-07-11 13:26:14.263085: osd_pg_create(e45 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:51.242912 I | osd1: 2017-07-11 13:27:51.242270 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 95.369145 seconds old, received at 2017-07-11 13:26:15.872816: osd_pg_create(e46 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:51.243019 I | osd1: 2017-07-11 13:27:51.242276 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 94.044219 seconds old, received at 2017-07-11 13:26:17.197741: osd_pg_create(e47 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:51.243260 I | osd1: 2017-07-11 13:27:51.242281 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 92.879030 seconds old, received at 2017-07-11 13:26:18.362931: osd_pg_create(e48 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:52.242753 I | osd1: 2017-07-11 13:27:52.242379 7f28de450700 -1 osd.1 60 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:32.242378)
- 2017-07-11 13:27:52.242823 I | osd1: 2017-07-11 13:27:52.242392 7f28de450700 -1 osd.1 60 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:32.242378)
- 2017-07-11 13:27:52.242840 I | osd1: 2017-07-11 13:27:52.242396 7f28de450700 -1 osd.1 60 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:32.242378)
- 2017-07-11 13:27:52.242853 I | osd1: 2017-07-11 13:27:52.242643 7f28de450700 0 log_channel(cluster) log [WRN] : 87 slow requests, 5 included below; oldest blocked for > 75.599868 secs
- 2017-07-11 13:27:52.242894 I | osd1: 2017-07-11 13:27:52.242652 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 95.044685 seconds old, received at 2017-07-11 13:26:17.197741: osd_pg_create(e47 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently started
- 2017-07-11 13:27:52.242921 I | osd1: 2017-07-11 13:27:52.242660 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 93.879496 seconds old, received at 2017-07-11 13:26:18.362931: osd_pg_create(e48 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:52.242973 I | osd1: 2017-07-11 13:27:52.242666 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 92.142505 seconds old, received at 2017-07-11 13:26:20.099922: osd_pg_create(e49 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:52.243015 I | osd1: 2017-07-11 13:27:52.242670 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 90.643368 seconds old, received at 2017-07-11 13:26:21.599058: osd_pg_create(e50 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:52.243055 I | osd1: 2017-07-11 13:27:52.242674 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 89.306341 seconds old, received at 2017-07-11 13:26:22.936086: osd_pg_create(e51 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:53.243061 I | osd1: 2017-07-11 13:27:53.242762 7f28de450700 -1 osd.1 60 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:33.242761)
- 2017-07-11 13:27:53.243142 I | osd1: 2017-07-11 13:27:53.242780 7f28de450700 -1 osd.1 60 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:33.242761)
- 2017-07-11 13:27:53.243160 I | osd1: 2017-07-11 13:27:53.242784 7f28de450700 -1 osd.1 60 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:33.242761)
- 2017-07-11 13:27:53.243187 I | osd1: 2017-07-11 13:27:53.242969 7f28de450700 0 log_channel(cluster) log [WRN] : 85 slow requests, 5 included below; oldest blocked for > 76.600234 secs
- 2017-07-11 13:27:53.243203 I | osd1: 2017-07-11 13:27:53.242974 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.644460 seconds old, received at 2017-07-11 13:27:22.598333: pg_notify((query:33 sent:88 0.754( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 88) currently wait for new map
- 2017-07-11 13:27:53.243219 I | osd1: 2017-07-11 13:27:53.242977 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 89.851805 seconds old, received at 2017-07-11 13:26:23.390988: osd pg remove(epoch 50; pg0.4d; ) currently wait for new map
- 2017-07-11 13:27:53.243251 I | osd1: 2017-07-11 13:27:53.242981 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 90.306707 seconds old, received at 2017-07-11 13:26:22.936086: osd_pg_create(e51 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently started
- 2017-07-11 13:27:53.243312 I | osd1: 2017-07-11 13:27:53.242985 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 88.629480 seconds old, received at 2017-07-11 13:26:24.613312: osd_pg_create(e52 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.400:20 0.408:20 0.40a:20 0.40c:20 0.40d:20 0.40e:20 0.411:20 0.41d:20 0.420:20 0.421:20 0.422:20 0.427:20 0.429:20 0.42b:20 0.42c:20 0.430:20 0.432:20 0.433:20 0.434:20 0.437:20 0.438:20 0.43a:20 0.440:20 0.442:20 0.443:20 0.446:20 0.449:20 0.44a:20 0.44b:20 0.44e:20 0.44f:20 0.451:20 0.452:20 0.457:20 0.458:20 0.45c:20 0.45f:20 0.461:20 0.469:20 0.46a:20 0.46d:20 0.46f:20 0.471:20 0.474:20 0.47e:20 0.47f:20 0.482:20 0.484:20 0.485:20 0.486:20 0.489:20 0.48b:20 0.48c:20 0.48d:20 0.48f:20 0.497:20 0.499:20 0.49b:20 0.49d:20 0.4a0:20 0.4a4:20 0.4a5:20 0.4a6:20 0.4a8:20 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:53.243337 I | osd1: 2017-07-11 13:27:53.242989 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 88.254915 seconds old, received at 2017-07-11 13:26:24.987877: osd_pg_create(e53 0.3:2 0.35:2 0.4f:2 0.a0:2 0.11f:2 0.14e:2 0.167:2 0.19e:2 0.1a6:2 0.1d5:2 0.1ef:2 0.222:2 0.25d:2 0.285:2 0.29a:2 0.300:2 0.3a1:2 0.3a4:2 0.4ad:22 0.4b0:23 0.4b2:23 0.4b4:23 0.4b5:23 0.4b7:23 0.4b8:23 0.4bb:23 0.4bc:23 0.4bd:23 0.4c0:23 0.4c1:23 0.4c4:23 0.4c6:23 0.4c9:23 0.4cd:23 0.4d9:23 0.4db:23 0.4dd:23 0.4de:23 0.4df:23 0.4e0:23 0.4e1:23 0.4e3:23 0.4e4:23 0.4e6:23 0.4e7:23 0.4ec:23 0.4f0:23 0.4f5:23 0.4f7:23 0.4f9:23 0.4fa:23 0.4fb:23 0.4fe:23 0.500:23 0.502:23 0.503:23 0.504:23 0.505:23 0.506:23 0.509:23 0.50d:23 0.511:23 0.513:23 0.514:23 0.515:23 0.518:23 0.51a:23 0.51b:23 0.51c:23 0.51e:23 0.524:23 0.525:23 0.527:23 0.529:23 0.52a:23 0.52b:23 0.52e:23 0.538:23 0.539:23 0.53a:23 0.53c:23 0.53d:23 0.53e:23 0.542:23 0.546:23 0.548:23 0.551:24 0.552:24 0.556:24 0.557:24 0.558:24 0.559:24 0.55a:24 0.55c:24 0.560:24 0.564:24 0.568:24 0.569:25 0.56b:25 0.56e:25 0.570:25 0.572:25 0.573:25 0.577:25 0.57a:25 0.580:25 0.581:25 0.582:25 0.584:25 0.585:25 0.586:25 0.588:25 0.58a:25 0.58b:25 0.58c:25 0.58e:25 0.592:25 0.593:25 0.594:25 0.595:25 0.598:25 0.599:25 0.59b:25 0.59d:25 0.59e:25 0.5a1:25 0.5a2:25 0.5a3:25 0.5a4:25 0.5a7:25 0.5a8:25 0.5ab:25 0.5ad:25 0.5ae:25 0.5b1:25 0.5b4:25 0.5b5:25 0.5b7:25 0.5b8:25 0.5bc:25 0.5c6:25 0.5c7:25 0.5ca:25 0.5cb:25 0.5ce:25 0.5d2:25 0.5d4:25 0.5dd:25 0.5de:25 0.5df:25 0.5e2:25 0.5e4:25 0.5e5:25 0.5e8:25 0.5ea:25 0.5eb:25 0.5f1:25 0.5f2:25 0.5f4:25 0.5f7:25 0.5f9:25 0.5fa:25 0.5fe:25 0.600:25 0.601:25 0.604:25 0.605:25 0.608:25 0.609:25 0.60a:25 0.60b:25 0.60e:25 0.60f:25 0.610:25 0.613:25 0.616:25 0.617:25 0.61b:26 0.61e:26 0.622:26 0.62f:26 0.630:26 0.632:26 0.634:26 0.636:26 0.63a:26 0.63d:26 0.63e:26 0.642:26 0.646:27 0.64a:27 0.651:27 0.658:27 0.659:27 0.65f:27 0.660:27 0.661:27 0.663:27 0.667:27 0.669:27 0.66d:27 0.671:27 0.673:27 0.674:27 0.675:27 0.676:27 0.677:27 0.67d:27 0.67f:27 0.68c:27 0.68d:27 0.692:27 0.693:27 0.694:27 0.697:27 0.69b:27 0.69c:27 0.6a5:27 0.6a6:27 0.6a7:27 0.6a8:27 0.6a9:27 0.6aa:27 0.6ac:27 0.6ad:27 0.6ae:27 0.6af:27 0.6b0:27 0.6b1:27 0.6b2:27 0.6b3:27 0.6b5:27 0.6bc:27 0.6be:27 0.6c1:27 0.6c5:27 0.6c8:27 0.6c9:27 0.6ca:27 0.6cc:27 0.6cd:27 0.6d0:27 0.6d1:27 0.6d3:27 0.6d4:27 0.6d7:27 0.6dc:28 0.6de:28 0.6df:28 0.6e4:28 0.6e6:30 0.6eb:30 0.6ec:30 0.6f3:30 0.6f4:31 0.6f7:31 0.6fb:31 0.6ff:31 0.703:31 0.704:31 0.706:31 0.707:31 0.70a:31 0.70d:31 0.70f:31 0.710:31 0.712:31 0.718:31 0.71a:31 0.71c:31 0.721:31 0.723:31 0.72d:31 0.72e:31 0.72f:31 0.730:31 0.731:31 0.732:31 0.734:31 0.735:31 0.737:31 0.738:31 0.73a:31 0.73c:31 0.740:31 0.741:31 0.743:31 0.745:31 0.74a:31 0.74e:31 0.750:31 0.751:31 0.753:31 0.754:31 0.755:31 0.756:31 0.757:31 0.759:31 0.75c:31 0.761:31 0.768:31 0.769:31 0.76b:31 0.76c:31 0.76d:31 0.774:31 0.775:31 0.77b:31 0.77d:31 0.785:31 0.788:31 0.789:31 0.78b:31 0.78c:31 0.794:31 0.798:31 0.799:31 0.79a:31 0.79e:31 0.7a0:31 0.7aa:31 0.7b1:31 0.7b5:31 0.7b8:32 0.7ba:32 0.7bb:32 0.7bc:32 0.7bd:32 0.7c8:32 0.7cb:32 0.7cc:32 0.7ce:32 0.7d6:33 0.7db:34 0.7de:34 0.7e3:34 0.7e4:34 0.7e5:34 0.7e6:34 0.7e7:34 0.7eb:34 0.7ed:34 0.7ef:34 0.7f0:34 0.7f1:34 0.7f2:34 0.7f3:34 0.7f6:34 0.7f7:34 0.7f8:34 0.7f9:34) currently wait for new map
- 2017-07-11 13:27:54.248338 I | osd1: 2017-07-11 13:27:54.248196 7f28de450700 -1 osd.1 60 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:46.111405 (cutoff 2017-07-11 13:27:34.248194)
- 2017-07-11 13:27:54.248427 I | osd1: 2017-07-11 13:27:54.248208 7f28de450700 -1 osd.1 60 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:34.248194)
- 2017-07-11 13:27:54.248444 I | osd1: 2017-07-11 13:27:54.248212 7f28de450700 -1 osd.1 60 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:26.309502 (cutoff 2017-07-11 13:27:34.248194)
- 2017-07-11 13:27:54.248473 I | osd1: 2017-07-11 13:27:54.248263 7f28de450700 0 log_channel(cluster) log [WRN] : 77 slow requests, 5 included below; oldest blocked for > 77.605662 secs
- 2017-07-11 13:27:54.248488 I | osd1: 2017-07-11 13:27:54.248268 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 62.261968 seconds old, received at 2017-07-11 13:26:51.986252: pg_notify((query:26 sent:73 0.5cb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 73) currently wait for new map
- 2017-07-11 13:27:54.248501 I | osd1: 2017-07-11 13:27:54.248272 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.475974 seconds old, received at 2017-07-11 13:26:53.772246: pg_notify((query:26 sent:75 0.5df( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 75) currently wait for new map
- 2017-07-11 13:27:54.248514 I | osd1: 2017-07-11 13:27:54.248276 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 33.326644 seconds old, received at 2017-07-11 13:27:20.921576: pg_notify((query:33 sent:86 0.743( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:54.248551 I | osd1: 2017-07-11 13:27:54.248278 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 32.118362 seconds old, received at 2017-07-11 13:27:22.129859: pg_notify((query:33 sent:86 0.751( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:54.248565 I | osd1: 2017-07-11 13:27:54.248281 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 33.820998 seconds old, received at 2017-07-11 13:27:20.427222: pg_notify((query:33 sent:87 0.741( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 87) currently wait for new map
- 2017-07-11 13:27:55.248512 I | osd1: 2017-07-11 13:27:55.248358 7f28de450700 -1 osd.1 71 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:35.248357)
- 2017-07-11 13:27:55.248599 I | osd1: 2017-07-11 13:27:55.248440 7f28de450700 0 log_channel(cluster) log [WRN] : 59 slow requests, 5 included below; oldest blocked for > 64.206642 secs
- 2017-07-11 13:27:55.248617 I | osd1: 2017-07-11 13:27:55.248446 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.469408 seconds old, received at 2017-07-11 13:26:54.778993: pg_notify((query:26 sent:76 0.5eb( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:55.248647 I | osd1: 2017-07-11 13:27:55.248448 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.028286 seconds old, received at 2017-07-11 13:26:55.220115: pg_notify((query:26 sent:76 0.5f2( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:55.248662 I | osd1: 2017-07-11 13:27:55.248453 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 60.647076 seconds old, received at 2017-07-11 13:26:54.601325: pg_notify((query:26 sent:76 0.5e8( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 76) currently wait for new map
- 2017-07-11 13:27:55.248675 I | osd1: 2017-07-11 13:27:55.248456 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 33.915342 seconds old, received at 2017-07-11 13:27:21.333059: pg_notify((query:33 sent:88 0.74a( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 88) currently wait for new map
- 2017-07-11 13:27:55.248687 I | osd1: 2017-07-11 13:27:55.248458 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 41.837203 seconds old, received at 2017-07-11 13:27:13.411198: pg_notify((query:33 sent:84 0.6cd( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 84) currently wait for new map
- 2017-07-11 13:27:56.248859 I | osd1: 2017-07-11 13:27:56.248679 7f28de450700 -1 osd.1 81 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:36.248678)
- 2017-07-11 13:27:56.249042 I | osd1: 2017-07-11 13:27:56.248962 7f28de450700 0 log_channel(cluster) log [WRN] : 51 slow requests, 5 included below; oldest blocked for > 48.503111 secs
- 2017-07-11 13:27:56.249079 I | osd1: 2017-07-11 13:27:56.248969 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 48.009182 seconds old, received at 2017-07-11 13:27:08.239537: osd pg remove(epoch 82; pg0.336; ) currently wait for new map
- 2017-07-11 13:27:56.249095 I | osd1: 2017-07-11 13:27:56.248972 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 47.970436 seconds old, received at 2017-07-11 13:27:08.278283: osd pg remove(epoch 82; pg0.2e6; ) currently wait for new map
- 2017-07-11 13:27:56.249108 I | osd1: 2017-07-11 13:27:56.248974 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 48.009160 seconds old, received at 2017-07-11 13:27:08.239559: osd pg remove(epoch 82; pg0.199; ) currently wait for new map
- 2017-07-11 13:27:56.249120 I | osd1: 2017-07-11 13:27:56.248977 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 47.970427 seconds old, received at 2017-07-11 13:27:08.278291: osd pg remove(epoch 82; pg0.3b3; ) currently wait for new map
- 2017-07-11 13:27:56.249133 I | osd1: 2017-07-11 13:27:56.248979 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 48.009044 seconds old, received at 2017-07-11 13:27:08.239674: osd pg remove(epoch 82; pg0.197; ) currently wait for new map
- 2017-07-11 13:27:57.249583 I | osd1: 2017-07-11 13:27:57.249419 7f28de450700 -1 osd.1 84 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:05.813927 (cutoff 2017-07-11 13:27:37.249417)
- 2017-07-11 13:27:57.249602 I | osd1: 2017-07-11 13:27:57.249518 7f28de450700 0 log_channel(cluster) log [WRN] : 28 slow requests, 2 included below; oldest blocked for > 46.611937 secs
- 2017-07-11 13:27:57.249607 I | osd1: 2017-07-11 13:27:57.249524 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.617720 seconds old, received at 2017-07-11 13:27:26.631760: pg_notify((query:33 sent:86 0.775( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:27:57.249610 I | osd1: 2017-07-11 13:27:57.249527 7f28de450700 0 log_channel(cluster) log [WRN] : slow request 30.041037 seconds old, received at 2017-07-11 13:27:27.208443: pg_notify((query:33 sent:86 0.77d( DNE empty local-lis/les=0/0 n=0 ec=0/0 lis/c 0/0 les/c/f 0/0/0 0/0/0))=([0,0] intervals=) epoch 86) currently wait for new map
- 2017-07-11 13:28:20.258448 I | osd1: 2017-07-11 13:28:20.258266 7f28de450700 -1 osd.1 125 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:00.258265)
- 2017-07-11 13:28:20.258544 I | osd1: 2017-07-11 13:28:20.258295 7f28de450700 -1 osd.1 125 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:00.258265)
- 2017-07-11 13:28:20.258564 I | osd1: 2017-07-11 13:28:20.258299 7f28de450700 -1 osd.1 125 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:00.258265)
- 2017-07-11 13:28:21.258628 I | osd1: 2017-07-11 13:28:21.258493 7f28de450700 -1 osd.1 125 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:01.258491)
- 2017-07-11 13:28:21.258713 I | osd1: 2017-07-11 13:28:21.258521 7f28de450700 -1 osd.1 125 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:01.258491)
- 2017-07-11 13:28:21.258731 I | osd1: 2017-07-11 13:28:21.258524 7f28de450700 -1 osd.1 125 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:01.258491)
- 2017-07-11 13:28:22.259155 I | osd1: 2017-07-11 13:28:22.259058 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:02.259057)
- 2017-07-11 13:28:22.259258 I | osd1: 2017-07-11 13:28:22.259085 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:02.259057)
- 2017-07-11 13:28:22.259276 I | osd1: 2017-07-11 13:28:22.259089 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:02.259057)
- 2017-07-11 13:28:23.259549 I | osd1: 2017-07-11 13:28:23.259402 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:03.259401)
- 2017-07-11 13:28:23.259645 I | osd1: 2017-07-11 13:28:23.259430 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:03.259401)
- 2017-07-11 13:28:23.259672 I | osd1: 2017-07-11 13:28:23.259435 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:03.259401)
- 2017-07-11 13:28:24.259761 I | osd1: 2017-07-11 13:28:24.259629 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:04.259627)
- 2017-07-11 13:28:24.259856 I | osd1: 2017-07-11 13:28:24.259658 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:04.259627)
- 2017-07-11 13:28:24.259872 I | osd1: 2017-07-11 13:28:24.259662 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:04.259627)
- 2017-07-11 13:28:25.259973 I | osd1: 2017-07-11 13:28:25.259875 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:05.259873)
- 2017-07-11 13:28:25.260041 I | osd1: 2017-07-11 13:28:25.259903 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:05.259873)
- 2017-07-11 13:28:25.260058 I | osd1: 2017-07-11 13:28:25.259907 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:05.259873)
- 2017-07-11 13:28:26.260427 I | osd1: 2017-07-11 13:28:26.260036 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:06.260034)
- 2017-07-11 13:28:26.260513 I | osd1: 2017-07-11 13:28:26.260060 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:06.260034)
- 2017-07-11 13:28:26.260531 I | osd1: 2017-07-11 13:28:26.260064 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:06.260034)
- 2017-07-11 13:28:27.260323 I | osd1: 2017-07-11 13:28:27.260225 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:07.260223)
- 2017-07-11 13:28:27.260411 I | osd1: 2017-07-11 13:28:27.260253 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:07.260223)
- 2017-07-11 13:28:27.260429 I | osd1: 2017-07-11 13:28:27.260257 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:07.260223)
- 2017-07-11 13:28:28.260574 I | osd1: 2017-07-11 13:28:28.260354 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:08.260352)
- 2017-07-11 13:28:28.260672 I | osd1: 2017-07-11 13:28:28.260382 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:08.260352)
- 2017-07-11 13:28:28.260690 I | osd1: 2017-07-11 13:28:28.260389 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:08.260352)
- 2017-07-11 13:28:29.260689 I | osd1: 2017-07-11 13:28:29.260590 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:09.260589)
- 2017-07-11 13:28:29.260772 I | osd1: 2017-07-11 13:28:29.260618 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:09.260589)
- 2017-07-11 13:28:29.260794 I | osd1: 2017-07-11 13:28:29.260622 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:09.260589)
- 2017-07-11 13:28:30.260896 I | osd1: 2017-07-11 13:28:30.260728 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:10.260722)
- 2017-07-11 13:28:30.260977 I | osd1: 2017-07-11 13:28:30.260756 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:10.260722)
- 2017-07-11 13:28:30.260992 I | osd1: 2017-07-11 13:28:30.260760 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:10.260722)
- 2017-07-11 13:28:31.261045 I | osd1: 2017-07-11 13:28:31.260944 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:11.260943)
- 2017-07-11 13:28:31.261131 I | osd1: 2017-07-11 13:28:31.260971 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:11.260943)
- 2017-07-11 13:28:31.261148 I | osd1: 2017-07-11 13:28:31.260975 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:11.260943)
- 2017-07-11 13:28:32.261292 I | osd1: 2017-07-11 13:28:32.261153 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:12.261151)
- 2017-07-11 13:28:32.261414 I | osd1: 2017-07-11 13:28:32.261183 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:12.261151)
- 2017-07-11 13:28:32.261442 I | osd1: 2017-07-11 13:28:32.261187 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:12.261151)
- 2017-07-11 13:28:33.261464 I | osd1: 2017-07-11 13:28:33.261363 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:13.261361)
- 2017-07-11 13:28:33.261550 I | osd1: 2017-07-11 13:28:33.261392 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:13.261361)
- 2017-07-11 13:28:33.261573 I | osd1: 2017-07-11 13:28:33.261396 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:13.261361)
- 2017-07-11 13:28:34.261965 I | osd1: 2017-07-11 13:28:34.261824 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:14.261822)
- 2017-07-11 13:28:34.262051 I | osd1: 2017-07-11 13:28:34.261852 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:14.261822)
- 2017-07-11 13:28:34.262068 I | osd1: 2017-07-11 13:28:34.261856 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:14.261822)
- 2017-07-11 13:28:35.262182 I | osd1: 2017-07-11 13:28:35.262074 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:15.262073)
- 2017-07-11 13:28:35.262267 I | osd1: 2017-07-11 13:28:35.262102 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:15.262073)
- 2017-07-11 13:28:35.262284 I | osd1: 2017-07-11 13:28:35.262105 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:15.262073)
- 2017-07-11 13:28:36.262408 I | osd1: 2017-07-11 13:28:36.262288 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:16.262287)
- 2017-07-11 13:28:36.262487 I | osd1: 2017-07-11 13:28:36.262307 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:16.262287)
- 2017-07-11 13:28:36.262504 I | osd1: 2017-07-11 13:28:36.262311 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:16.262287)
- 2017-07-11 13:28:37.262670 I | osd1: 2017-07-11 13:28:37.262568 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:17.262566)
- 2017-07-11 13:28:37.262754 I | osd1: 2017-07-11 13:28:37.262597 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:17.262566)
- 2017-07-11 13:28:37.262776 I | osd1: 2017-07-11 13:28:37.262601 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:17.262566)
- 2017-07-11 13:28:38.263079 I | osd1: 2017-07-11 13:28:38.262973 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:18.262968)
- 2017-07-11 13:28:38.263170 I | osd1: 2017-07-11 13:28:38.263004 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:18.262968)
- 2017-07-11 13:28:38.263188 I | osd1: 2017-07-11 13:28:38.263008 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:18.262968)
- 2017-07-11 13:28:39.263420 I | osd1: 2017-07-11 13:28:39.263303 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:19.263302)
- 2017-07-11 13:28:39.263439 I | osd1: 2017-07-11 13:28:39.263331 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:19.263302)
- 2017-07-11 13:28:39.263443 I | osd1: 2017-07-11 13:28:39.263335 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:19.263302)
- 2017-07-11 13:28:40.263655 I | osd1: 2017-07-11 13:28:40.263550 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:20.263548)
- 2017-07-11 13:28:40.263741 I | osd1: 2017-07-11 13:28:40.263580 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:20.263548)
- 2017-07-11 13:28:40.263758 I | osd1: 2017-07-11 13:28:40.263584 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:20.263548)
- 2017-07-11 13:28:41.263793 I | osd1: 2017-07-11 13:28:41.263694 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:21.263693)
- 2017-07-11 13:28:41.263878 I | osd1: 2017-07-11 13:28:41.263723 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:21.263693)
- 2017-07-11 13:28:41.263902 I | osd1: 2017-07-11 13:28:41.263727 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:21.263693)
- 2017-07-11 13:28:42.263979 I | osd1: 2017-07-11 13:28:42.263857 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:22.263856)
- 2017-07-11 13:28:42.264050 I | osd1: 2017-07-11 13:28:42.263886 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:22.263856)
- 2017-07-11 13:28:42.264067 I | osd1: 2017-07-11 13:28:42.263890 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:22.263856)
- 2017-07-11 13:28:43.264192 I | osd1: 2017-07-11 13:28:43.264018 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:23.264016)
- 2017-07-11 13:28:43.264280 I | osd1: 2017-07-11 13:28:43.264043 7f28de450700 -1 osd.1 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:00.218475 (cutoff 2017-07-11 13:28:23.264016)
- END logs from pod: rook-ceph-osd-jjlkl
- BEGIN logs from pod: rook-ceph-osd-jl0pk
- 2017-07-11 13:24:20.703165 I | cephmon: parsing mon endpoints: rook-ceph-mon1=10.233.99.4:6790,rook-ceph-mon2=10.233.124.3:6790,rook-ceph-mon0=10.233.76.3:6790
- 2017-07-11 13:24:20.703593 I | cephmon: writing config file /var/lib/rook/rook/rook.config
- 2017-07-11 13:24:20.703734 I | cephmon: generated admin config in /var/lib/rook/rook
- 2017-07-11 13:24:20.703754 I | cephosd: discovering hardware
- 2017-07-11 13:24:20.703767 I | exec: Running command: lsblk --all --noheadings --list --output KNAME
- 2017-07-11 13:24:20.712048 I | exec: Running command: lsblk /dev/fd0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.713327 I | exec: Running command: sgdisk --print /dev/fd0
- 2017-07-11 13:24:20.767869 W | inventory: skipping device fd0 with an unknown uuid. Failed to complete get disk fd0 uuid: exit status 2
- 2017-07-11 13:24:20.767924 I | exec: Running command: lsblk /dev/loop0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.769306 I | exec: Running command: lsblk /dev/loop1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.770448 I | exec: Running command: lsblk /dev/loop2 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.777604 I | exec: Running command: lsblk /dev/loop3 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.778751 I | exec: Running command: lsblk /dev/loop4 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.780151 I | exec: Running command: lsblk /dev/loop5 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.781472 I | exec: Running command: lsblk /dev/loop6 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.789163 I | exec: Running command: lsblk /dev/loop7 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.790462 I | exec: Running command: lsblk /dev/sda --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.797754 I | exec: Running command: sgdisk --print /dev/sda
- 2017-07-11 13:24:20.808010 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:20.818185 I | exec: Running command: lsblk /dev/sda1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.819943 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:20.820868 I | exec: Running command: lsblk /dev/sdb --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.832504 I | exec: Running command: sgdisk --print /dev/sdb
- 2017-07-11 13:24:20.849477 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:20.860474 I | exec: Running command: lsblk /dev/sdb1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.861968 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:20.862871 I | exec: Running command: lsblk /dev/sr0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.872774 I | cephosd: creating and starting the osds
- 2017-07-11 13:24:20.872820 I | exec: Running command: lsblk /dev/sda --bytes --pairs --output NAME,SIZE,TYPE,PKNAME
- 2017-07-11 13:24:20.880079 I | exec: Running command: blkid /dev/sda1 -s PARTLABEL -o value
- 2017-07-11 13:24:20.881843 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:20.882932 I | cephosd: skipping device sda that is in use (not by rook). fs: ext4, ownPartitions: false
- 2017-07-11 13:24:20.882976 I | exec: Running command: lsblk /dev/sdb --bytes --pairs --output NAME,SIZE,TYPE,PKNAME
- 2017-07-11 13:24:20.890300 I | exec: Running command: blkid /dev/sdb1 -s PARTLABEL -o value
- 2017-07-11 13:24:20.892220 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:20.893131 I | cephosd: skipping device sdb that is in use (not by rook). fs: , ownPartitions: false
- 2017-07-11 13:24:20.893180 I | cephosd: configuring osd devices: &{Entries:map[]}
- 2017-07-11 13:24:20.893215 I | cephosd: configuring osd dirs: map[/var/lib/rook:-1]
- 2017-07-11 13:24:20.900191 I | exec: Running command: ceph osd create cd112926-e214-4caa-9506-6797fb79af42 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/463166591
- 2017-07-11 13:24:22.277553 I | cephosd: successfully created OSD cd112926-e214-4caa-9506-6797fb79af42 with ID 3
- 2017-07-11 13:24:22.277947 I | cephmon: writing config file /var/lib/rook/osd3/rook.config
- 2017-07-11 13:24:22.278164 I | exec: Running command: ceph mon getmap --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/667723730
- 2017-07-11 13:24:22.769320 I | exec: got monmap epoch 3
- 2017-07-11 13:24:22.769575 I | cephosd: Initializing OSD 3 file system at /var/lib/rook/osd3...
- 2017-07-11 13:24:22.769800 I | proc: Running process ceph-osd with args: [--mkfs --mkkey --id=3 --cluster=rook --conf=/var/lib/rook/osd3/rook.config --osd-data=/var/lib/rook/osd3 --osd-uuid=cd112926-e214-4caa-9506-6797fb79af42 --monmap=/var/lib/rook/osd3/tmp/activate.monmap --osd-journal=/var/lib/rook/osd3/journal --keyring=/var/lib/rook/osd3/keyring]
- 2017-07-11 13:24:22.769836 I | exec: Running command: ceph-osd --mkfs --mkkey --id=3 --cluster=rook --conf=/var/lib/rook/osd3/rook.config --osd-data=/var/lib/rook/osd3 --osd-uuid=cd112926-e214-4caa-9506-6797fb79af42 --monmap=/var/lib/rook/osd3/tmp/activate.monmap --osd-journal=/var/lib/rook/osd3/journal --keyring=/var/lib/rook/osd3/keyring
- 2017-07-11 13:24:22.800597 I | mkfs-osd3: 2017-07-11 13:24:22.800549 7fda28fe4c80 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 86
- 2017-07-11 13:24:22.969842 I | mkfs-osd3: 2017-07-11 13:24:22.969376 7fda28fe4c80 0 filestore(/var/lib/rook/osd3) backend generic (magic 0xef53)
- 2017-07-11 13:24:23.252295 I | mkfs-osd3: 2017-07-11 13:24:23.252237 7fda28fe4c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:23.349199 I | mkfs-osd3: 2017-07-11 13:24:23.349109 7fda28fe4c80 0 filestore(/var/lib/rook/osd3) mkjournal(1061): created journal on /var/lib/rook/osd3/journal
- 2017-07-11 13:24:23.394697 I | mkfs-osd3: 2017-07-11 13:24:23.394667 7fda28fe4c80 0 filestore(/var/lib/rook/osd3) backend generic (magic 0xef53)
- 2017-07-11 13:24:23.395098 I | mkfs-osd3: 2017-07-11 13:24:23.395076 7fda28fe4c80 0 genericfilestorebackend(/var/lib/rook/osd3) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
- 2017-07-11 13:24:23.395164 I | mkfs-osd3: 2017-07-11 13:24:23.395148 7fda28fe4c80 0 genericfilestorebackend(/var/lib/rook/osd3) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option
- 2017-07-11 13:24:23.395192 I | mkfs-osd3: 2017-07-11 13:24:23.395181 7fda28fe4c80 0 genericfilestorebackend(/var/lib/rook/osd3) detect_features: splice() is disabled via 'filestore splice' config option
- 2017-07-11 13:24:23.462483 I | mkfs-osd3: 2017-07-11 13:24:23.462434 7fda28fe4c80 0 genericfilestorebackend(/var/lib/rook/osd3) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
- 2017-07-11 13:24:23.531646 I | mkfs-osd3: 2017-07-11 13:24:23.531612 7fda28fe4c80 0 filestore(/var/lib/rook/osd3) limited size xattrs
- 2017-07-11 13:24:23.531936 I | mkfs-osd3: 2017-07-11 13:24:23.531912 7fda28fe4c80 0 filestore(/var/lib/rook/osd3) start omap initiation
- 2017-07-11 13:24:23.532154 I | mkfs-osd3: 2017-07-11 13:24:23.532134 7fda28fe4c80 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:24:23.532183 I | mkfs-osd3:
- 2017-07-11 13:24:23.532231 I | mkfs-osd3: 2017-07-11 13:24:23.532199 7fda28fe4c80 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:24:23.532268 I | mkfs-osd3: 2017-07-11 13:24:23.532249 7fda28fe4c80 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:24:23.532313 I | mkfs-osd3: 2017-07-11 13:24:23.532299 7fda28fe4c80 4 rocksdb: DB SUMMARY
- 2017-07-11 13:24:23.532329 I | mkfs-osd3:
- 2017-07-11 13:24:23.532406 I | mkfs-osd3: 2017-07-11 13:24:23.532391 7fda28fe4c80 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:24:23.532423 I | mkfs-osd3:
- 2017-07-11 13:24:23.532463 I | mkfs-osd3: 2017-07-11 13:24:23.532436 7fda28fe4c80 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:24:23.532478 I | mkfs-osd3:
- 2017-07-11 13:24:23.532510 I | mkfs-osd3: 2017-07-11 13:24:23.532496 7fda28fe4c80 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes
- 2017-07-11 13:24:23.532541 I | mkfs-osd3:
- 2017-07-11 13:24:23.532570 I | mkfs-osd3: 2017-07-11 13:24:23.532557 7fda28fe4c80 4 rocksdb: SST files in /var/lib/rook/osd3/current/omap dir, Total Num: 0, files:
- 2017-07-11 13:24:23.532586 I | mkfs-osd3:
- 2017-07-11 13:24:23.532627 I | mkfs-osd3: 2017-07-11 13:24:23.532612 7fda28fe4c80 4 rocksdb: Write Ahead Log file in /var/lib/rook/osd3/current/omap: 000003.log size: 0 ;
- 2017-07-11 13:24:23.532641 I | mkfs-osd3:
- 2017-07-11 13:24:23.532666 I | mkfs-osd3: 2017-07-11 13:24:23.532654 7fda28fe4c80 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:24:23.533046 I | mkfs-osd3: 2017-07-11 13:24:23.533028 7fda28fe4c80 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:24:23.533146 I | mkfs-osd3: 2017-07-11 13:24:23.533130 7fda28fe4c80 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:24:23.533227 I | mkfs-osd3: 2017-07-11 13:24:23.533212 7fda28fe4c80 4 rocksdb: Options.env: 0x5584335a88e0
- 2017-07-11 13:24:23.533275 I | mkfs-osd3: 2017-07-11 13:24:23.533261 7fda28fe4c80 4 rocksdb: Options.info_log: 0x558434dd94a0
- 2017-07-11 13:24:23.533302 I | mkfs-osd3: 2017-07-11 13:24:23.533290 7fda28fe4c80 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:24:23.533342 I | mkfs-osd3: 2017-07-11 13:24:23.533330 7fda28fe4c80 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:24:23.533369 I | mkfs-osd3: 2017-07-11 13:24:23.533357 7fda28fe4c80 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:24:23.533409 I | mkfs-osd3: 2017-07-11 13:24:23.533383 7fda28fe4c80 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:24:23.533437 I | mkfs-osd3: 2017-07-11 13:24:23.533426 7fda28fe4c80 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:24:23.533482 I | mkfs-osd3: 2017-07-11 13:24:23.533457 7fda28fe4c80 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:24:23.533510 I | mkfs-osd3: 2017-07-11 13:24:23.533498 7fda28fe4c80 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:24:23.533535 I | mkfs-osd3: 2017-07-11 13:24:23.533524 7fda28fe4c80 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:24:23.533581 I | mkfs-osd3: 2017-07-11 13:24:23.533568 7fda28fe4c80 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:24:23.533611 I | mkfs-osd3: 2017-07-11 13:24:23.533600 7fda28fe4c80 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:24:23.533652 I | mkfs-osd3: 2017-07-11 13:24:23.533640 7fda28fe4c80 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:24:23.533685 I | mkfs-osd3: 2017-07-11 13:24:23.533673 7fda28fe4c80 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:24:23.533726 I | mkfs-osd3: 2017-07-11 13:24:23.533699 7fda28fe4c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:24:23.533758 I | mkfs-osd3: 2017-07-11 13:24:23.533746 7fda28fe4c80 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:24:23.533799 I | mkfs-osd3: 2017-07-11 13:24:23.533773 7fda28fe4c80 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:24:23.533827 I | mkfs-osd3: 2017-07-11 13:24:23.533814 7fda28fe4c80 4 rocksdb: Options.wal_dir: /var/lib/rook/osd3/current/omap
- 2017-07-11 13:24:23.533853 I | mkfs-osd3: 2017-07-11 13:24:23.533842 7fda28fe4c80 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:24:23.533916 I | mkfs-osd3: 2017-07-11 13:24:23.533904 7fda28fe4c80 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:24:23.533942 I | mkfs-osd3: 2017-07-11 13:24:23.533930 7fda28fe4c80 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:24:23.533980 I | mkfs-osd3: 2017-07-11 13:24:23.533969 7fda28fe4c80 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:24:23.534005 I | mkfs-osd3: 2017-07-11 13:24:23.533994 7fda28fe4c80 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:24:23.534041 I | mkfs-osd3: 2017-07-11 13:24:23.534018 7fda28fe4c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:24:23.534102 I | mkfs-osd3: 2017-07-11 13:24:23.534089 7fda28fe4c80 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:24:23.534145 I | mkfs-osd3: 2017-07-11 13:24:23.534133 7fda28fe4c80 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:24:23.534171 I | mkfs-osd3: 2017-07-11 13:24:23.534160 7fda28fe4c80 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:24:23.534222 I | mkfs-osd3: 2017-07-11 13:24:23.534209 7fda28fe4c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:24:23.534249 I | mkfs-osd3: 2017-07-11 13:24:23.534238 7fda28fe4c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:24:23.534289 I | mkfs-osd3: 2017-07-11 13:24:23.534263 7fda28fe4c80 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:24:23.534316 I | mkfs-osd3: 2017-07-11 13:24:23.534304 7fda28fe4c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:24:23.534342 I | mkfs-osd3: 2017-07-11 13:24:23.534330 7fda28fe4c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:24:23.534381 I | mkfs-osd3: 2017-07-11 13:24:23.534369 7fda28fe4c80 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:24:23.534453 I | mkfs-osd3: 2017-07-11 13:24:23.534408 7fda28fe4c80 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:24:23.534477 I | mkfs-osd3: 2017-07-11 13:24:23.534467 7fda28fe4c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:24:23.534501 I | mkfs-osd3: 2017-07-11 13:24:23.534490 7fda28fe4c80 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:24:23.534536 I | mkfs-osd3: 2017-07-11 13:24:23.534525 7fda28fe4c80 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:24:23.534559 I | mkfs-osd3: 2017-07-11 13:24:23.534549 7fda28fe4c80 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:24:23.534581 I | mkfs-osd3: 2017-07-11 13:24:23.534571 7fda28fe4c80 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:24:23.534616 I | mkfs-osd3: 2017-07-11 13:24:23.534605 7fda28fe4c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:24:23.534639 I | mkfs-osd3: 2017-07-11 13:24:23.534629 7fda28fe4c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:24:23.534687 I | mkfs-osd3: 2017-07-11 13:24:23.534651 7fda28fe4c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:24:23.534731 I | mkfs-osd3: 2017-07-11 13:24:23.534719 7fda28fe4c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:24:23.534772 I | mkfs-osd3: 2017-07-11 13:24:23.534746 7fda28fe4c80 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:24:23.534798 I | mkfs-osd3: 2017-07-11 13:24:23.534787 7fda28fe4c80 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:24:23.534823 I | mkfs-osd3: 2017-07-11 13:24:23.534812 7fda28fe4c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:24:23.534862 I | mkfs-osd3: 2017-07-11 13:24:23.534850 7fda28fe4c80 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:24:23.534888 I | mkfs-osd3: 2017-07-11 13:24:23.534877 7fda28fe4c80 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:24:23.534927 I | mkfs-osd3: 2017-07-11 13:24:23.534902 7fda28fe4c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:24:23.534954 I | mkfs-osd3: 2017-07-11 13:24:23.534942 7fda28fe4c80 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:24:23.534979 I | mkfs-osd3: 2017-07-11 13:24:23.534968 7fda28fe4c80 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:24:23.535018 I | mkfs-osd3: 2017-07-11 13:24:23.535005 7fda28fe4c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:24:23.535044 I | mkfs-osd3: 2017-07-11 13:24:23.535033 7fda28fe4c80 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:24:23.535094 I | mkfs-osd3: 2017-07-11 13:24:23.535058 7fda28fe4c80 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:24:23.535133 I | mkfs-osd3: 2017-07-11 13:24:23.535111 7fda28fe4c80 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:24:23.535179 I | mkfs-osd3: 2017-07-11 13:24:23.535167 7fda28fe4c80 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:24:23.535225 I | mkfs-osd3: 2017-07-11 13:24:23.535204 7fda28fe4c80 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:24:23.535263 I | mkfs-osd3: 2017-07-11 13:24:23.535251 7fda28fe4c80 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:24:23.535299 I | mkfs-osd3: 2017-07-11 13:24:23.535288 7fda28fe4c80 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:24:23.535339 I | mkfs-osd3: 2017-07-11 13:24:23.535327 7fda28fe4c80 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:24:23.535966 I | mkfs-osd3: 2017-07-11 13:24:23.535932 7fda28fe4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001
- 2017-07-11 13:24:23.536021 I | mkfs-osd3:
- 2017-07-11 13:24:23.536131 I | mkfs-osd3: 2017-07-11 13:24:23.536114 7fda28fe4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:24:23.536160 I | mkfs-osd3:
- 2017-07-11 13:24:23.536188 I | mkfs-osd3: 2017-07-11 13:24:23.536174 7fda28fe4c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:24:23.536215 I | mkfs-osd3: 2017-07-11 13:24:23.536202 7fda28fe4c80 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:24:23.536251 I | mkfs-osd3: 2017-07-11 13:24:23.536240 7fda28fe4c80 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:24:23.536276 I | mkfs-osd3: 2017-07-11 13:24:23.536266 7fda28fe4c80 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:24:23.536300 I | mkfs-osd3: 2017-07-11 13:24:23.536290 7fda28fe4c80 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:24:23.536336 I | mkfs-osd3: 2017-07-11 13:24:23.536325 7fda28fe4c80 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:24:23.536376 I | mkfs-osd3: 2017-07-11 13:24:23.536361 7fda28fe4c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558434c08218)
- 2017-07-11 13:24:23.536402 I | mkfs-osd3: cache_index_and_filter_blocks: 0
- 2017-07-11 13:24:23.536413 I | mkfs-osd3: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:24:23.536423 I | mkfs-osd3: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:24:23.536433 I | mkfs-osd3: index_type: 0
- 2017-07-11 13:24:23.536443 I | mkfs-osd3: hash_index_allow_collision: 1
- 2017-07-11 13:24:23.536453 I | mkfs-osd3: checksum: 1
- 2017-07-11 13:24:23.536473 I | mkfs-osd3: no_block_cache: 0
- 2017-07-11 13:24:23.536485 I | mkfs-osd3: block_cache: 0x558434c2e380
- 2017-07-11 13:24:23.536494 I | mkfs-osd3: block_cache_name: LRUCache
- 2017-07-11 13:24:23.536504 I | mkfs-osd3: block_cache_options:
- 2017-07-11 13:24:23.536514 I | mkfs-osd3: capacity : 107374182
- 2017-07-11 13:24:23.536524 I | mkfs-osd3: num_shard_bits : 4
- 2017-07-11 13:24:23.536534 I | mkfs-osd3: strict_capacity_limit : 0
- 2017-07-11 13:24:23.536555 I | mkfs-osd3: high_pri_pool_ratio: 0.000
- 2017-07-11 13:24:23.536565 I | mkfs-osd3: block_cache_compressed: (nil)
- 2017-07-11 13:24:23.536575 I | mkfs-osd3: persistent_cache: (nil)
- 2017-07-11 13:24:23.536588 I | mkfs-osd3: block_size: 4096
- 2017-07-11 13:24:23.536598 I | mkfs-osd3: block_size_deviation: 10
- 2017-07-11 13:24:23.536607 I | mkfs-osd3: block_restart_interval: 16
- 2017-07-11 13:24:23.536628 I | mkfs-osd3: index_block_restart_interval: 1
- 2017-07-11 13:24:23.536638 I | mkfs-osd3: filter_policy: nullptr
- 2017-07-11 13:24:23.536648 I | mkfs-osd3: whole_key_filtering: 1
- 2017-07-11 13:24:23.536657 I | mkfs-osd3: format_version: 2
- 2017-07-11 13:24:23.536667 I | mkfs-osd3:
- 2017-07-11 13:24:23.536691 I | mkfs-osd3: 2017-07-11 13:24:23.536679 7fda28fe4c80 4 rocksdb: Options.write_buffer_size: 67108864
- 2017-07-11 13:24:23.536727 I | mkfs-osd3: 2017-07-11 13:24:23.536717 7fda28fe4c80 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:24:23.536750 I | mkfs-osd3: 2017-07-11 13:24:23.536741 7fda28fe4c80 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:24:23.536807 I | mkfs-osd3: 2017-07-11 13:24:23.536795 7fda28fe4c80 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:24:23.536832 I | mkfs-osd3: 2017-07-11 13:24:23.536822 7fda28fe4c80 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:24:23.536870 I | mkfs-osd3: 2017-07-11 13:24:23.536846 7fda28fe4c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:24:23.536895 I | mkfs-osd3: 2017-07-11 13:24:23.536884 7fda28fe4c80 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:24:23.536919 I | mkfs-osd3: 2017-07-11 13:24:23.536909 7fda28fe4c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:24:23.536956 I | mkfs-osd3: 2017-07-11 13:24:23.536945 7fda28fe4c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:24:23.536986 I | mkfs-osd3: 2017-07-11 13:24:23.536976 7fda28fe4c80 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:24:23.537027 I | mkfs-osd3: 2017-07-11 13:24:23.537002 7fda28fe4c80 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:24:23.537053 I | mkfs-osd3: 2017-07-11 13:24:23.537041 7fda28fe4c80 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:24:23.537076 I | mkfs-osd3: 2017-07-11 13:24:23.537066 7fda28fe4c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:24:23.537112 I | mkfs-osd3: 2017-07-11 13:24:23.537101 7fda28fe4c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:24:23.537147 I | mkfs-osd3: 2017-07-11 13:24:23.537137 7fda28fe4c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:24:23.537195 I | mkfs-osd3: 2017-07-11 13:24:23.537184 7fda28fe4c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:24:23.537219 I | mkfs-osd3: 2017-07-11 13:24:23.537209 7fda28fe4c80 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:24:23.537242 I | mkfs-osd3: 2017-07-11 13:24:23.537232 7fda28fe4c80 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:24:23.537288 I | mkfs-osd3: 2017-07-11 13:24:23.537271 7fda28fe4c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:24:23.537312 I | mkfs-osd3: 2017-07-11 13:24:23.537301 7fda28fe4c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:24:23.537350 I | mkfs-osd3: 2017-07-11 13:24:23.537337 7fda28fe4c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:24:23.537378 I | mkfs-osd3: 2017-07-11 13:24:23.537367 7fda28fe4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:24:23.537414 I | mkfs-osd3: 2017-07-11 13:24:23.537392 7fda28fe4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:24:23.537440 I | mkfs-osd3: 2017-07-11 13:24:23.537429 7fda28fe4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:24:23.537463 I | mkfs-osd3: 2017-07-11 13:24:23.537453 7fda28fe4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:24:23.537500 I | mkfs-osd3: 2017-07-11 13:24:23.537476 7fda28fe4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:24:23.537525 I | mkfs-osd3: 2017-07-11 13:24:23.537515 7fda28fe4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:24:23.537549 I | mkfs-osd3: 2017-07-11 13:24:23.537539 7fda28fe4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:24:23.537585 I | mkfs-osd3: 2017-07-11 13:24:23.537574 7fda28fe4c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:24:23.537609 I | mkfs-osd3: 2017-07-11 13:24:23.537599 7fda28fe4c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:24:23.537646 I | mkfs-osd3: 2017-07-11 13:24:23.537622 7fda28fe4c80 4 rocksdb: Options.arena_block_size: 8388608
- 2017-07-11 13:24:23.537672 I | mkfs-osd3: 2017-07-11 13:24:23.537661 7fda28fe4c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:24:23.537696 I | mkfs-osd3: 2017-07-11 13:24:23.537686 7fda28fe4c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:24:23.537733 I | mkfs-osd3: 2017-07-11 13:24:23.537709 7fda28fe4c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:24:23.537758 I | mkfs-osd3: 2017-07-11 13:24:23.537747 7fda28fe4c80 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:24:23.537783 I | mkfs-osd3: 2017-07-11 13:24:23.537772 7fda28fe4c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:24:23.537821 I | mkfs-osd3: 2017-07-11 13:24:23.537809 7fda28fe4c80 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:24:23.537845 I | mkfs-osd3: 2017-07-11 13:24:23.537834 7fda28fe4c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:24:23.537867 I | mkfs-osd3: 2017-07-11 13:24:23.537858 7fda28fe4c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:24:23.537908 I | mkfs-osd3: 2017-07-11 13:24:23.537896 7fda28fe4c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:24:23.537932 I | mkfs-osd3: 2017-07-11 13:24:23.537921 7fda28fe4c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:24:23.537969 I | mkfs-osd3: 2017-07-11 13:24:23.537957 7fda28fe4c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:24:23.537994 I | mkfs-osd3: 2017-07-11 13:24:23.537984 7fda28fe4c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:24:23.538017 I | mkfs-osd3: 2017-07-11 13:24:23.538007 7fda28fe4c80 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:24:23.538053 I | mkfs-osd3: 2017-07-11 13:24:23.538042 7fda28fe4c80 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:24:23.538078 I | mkfs-osd3: 2017-07-11 13:24:23.538067 7fda28fe4c80 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:24:23.538114 I | mkfs-osd3: 2017-07-11 13:24:23.538091 7fda28fe4c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:24:23.538140 I | mkfs-osd3: 2017-07-11 13:24:23.538129 7fda28fe4c80 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:24:23.538164 I | mkfs-osd3: 2017-07-11 13:24:23.538153 7fda28fe4c80 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:24:23.538201 I | mkfs-osd3: 2017-07-11 13:24:23.538178 7fda28fe4c80 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:24:23.538225 I | mkfs-osd3: 2017-07-11 13:24:23.538215 7fda28fe4c80 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:24:23.538249 I | mkfs-osd3: 2017-07-11 13:24:23.538238 7fda28fe4c80 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:24:23.538287 I | mkfs-osd3: 2017-07-11 13:24:23.538275 7fda28fe4c80 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:24:23.538311 I | mkfs-osd3: 2017-07-11 13:24:23.538301 7fda28fe4c80 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:24:23.545229 I | mkfs-osd3: 2017-07-11 13:24:23.544990 7fda28fe4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/osd3/current/omap/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:24:23.545269 I | mkfs-osd3:
- 2017-07-11 13:24:23.545284 I | mkfs-osd3: 2017-07-11 13:24:23.544998 7fda28fe4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 0
- 2017-07-11 13:24:23.545295 I | mkfs-osd3:
- 2017-07-11 13:24:23.545305 I | mkfs-osd3: 2017-07-11 13:24:23.545037 7fda28fe4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779463545033, "job": 1, "event": "recovery_started", "log_files": [3]}
- 2017-07-11 13:24:23.545315 I | mkfs-osd3: 2017-07-11 13:24:23.545040 7fda28fe4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #3 mode 2
- 2017-07-11 13:24:23.545344 I | mkfs-osd3: 2017-07-11 13:24:23.545097 7fda28fe4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 5
- 2017-07-11 13:24:23.545355 I | mkfs-osd3:
- 2017-07-11 13:24:23.618094 I | mkfs-osd3: 2017-07-11 13:24:23.617881 7fda28fe4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779463617875, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:24:23.649374 I | mkfs-osd3: 2017-07-11 13:24:23.649341 7fda28fe4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x558434ebe000
- 2017-07-11 13:24:23.649622 I | mkfs-osd3: 2017-07-11 13:24:23.649585 7fda28fe4c80 0 filestore(/var/lib/rook/osd3) mount(1717): enabling WRITEAHEAD journal mode: checkpoint is not enabled
- 2017-07-11 13:24:23.649781 I | mkfs-osd3: 2017-07-11 13:24:23.649757 7fda28fe4c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:23.650780 I | mkfs-osd3: 2017-07-11 13:24:23.650698 7fda28fe4c80 -1 filestore(/var/lib/rook/osd3) could not find #-1:7b3f43c4:::osd_superblock:0# in index: (2) No such file or directory
- 2017-07-11 13:24:24.011252 I | mkfs-osd3: 2017-07-11 13:24:24.010982 7fda28fe4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:217] Shutdown: canceling all background work
- 2017-07-11 13:24:24.011373 I | mkfs-osd3: 2017-07-11 13:24:24.011152 7fda28fe4c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:343] Shutdown complete
- 2017-07-11 13:24:24.012402 I | mkfs-osd3: 2017-07-11 13:24:24.011729 7fda28fe4c80 -1 created object store /var/lib/rook/osd3 for osd.3 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:24:24.012457 I | mkfs-osd3: 2017-07-11 13:24:24.011776 7fda28fe4c80 -1 auth: error reading file: /var/lib/rook/osd3/keyring: can't open /var/lib/rook/osd3/keyring: (2) No such file or directory
- 2017-07-11 13:24:24.012480 I | mkfs-osd3: 2017-07-11 13:24:24.011861 7fda28fe4c80 -1 created new key in keyring /var/lib/rook/osd3/keyring
- 2017-07-11 13:24:24.013336 I | mkfs-osd3: 2017-07-11 13:24:23.252237 7fda28fe4c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:24.013372 I | mkfs-osd3: 2017-07-11 13:24:23.649757 7fda28fe4c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:24.013388 I | mkfs-osd3: 2017-07-11 13:24:23.650698 7fda28fe4c80 -1 filestore(/var/lib/rook/osd3) could not find #-1:7b3f43c4:::osd_superblock:0# in index: (2) No such file or directory
- 2017-07-11 13:24:24.013400 I | mkfs-osd3: 2017-07-11 13:24:24.011729 7fda28fe4c80 -1 created object store /var/lib/rook/osd3 for osd.3 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:24:24.013410 I | mkfs-osd3: 2017-07-11 13:24:24.011776 7fda28fe4c80 -1 auth: error reading file: /var/lib/rook/osd3/keyring: can't open /var/lib/rook/osd3/keyring: (2) No such file or directory
- 2017-07-11 13:24:24.013422 I | mkfs-osd3: 2017-07-11 13:24:24.011861 7fda28fe4c80 -1 created new key in keyring /var/lib/rook/osd3/keyring
- 2017-07-11 13:24:24.013644 I | exec: Running command: ceph auth add osd.3 -i /var/lib/rook/osd3/keyring osd allow * mon allow profile osd --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/017192713
- 2017-07-11 13:24:25.194155 I | exec: added key for osd.3
- 2017-07-11 13:24:25.194411 I | cephosd: adding osd.3 (/var/lib/rook/osd3), bytes: 104022159360, weight: 0.0946, to crush map at 'root=default'
- 2017-07-11 13:24:25.194578 I | exec: Running command: ceph osd crush create-or-move 3 0.0946 root=default --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/721451220
- 2017-07-11 13:24:26.716671 I | exec: create-or-move updating item name 'osd.3' weight 0.0946 at location {root=default} to crush map
- 2017-07-11 13:24:26.716897 I | cephosd: starting osd 3 at /var/lib/rook/osd3
- 2017-07-11 13:24:26.717000 I | cephosd: Config file /var/lib/rook/osd3/rook.config:
- [global]
- enable experimental unrecoverable data corrupting features =
- run dir = /var/lib/rook/osd3
- mon initial members = rook-ceph-mon1 rook-ceph-mon2 rook-ceph-mon0
- log file = /dev/stdout
- mon cluster log file = /dev/stdout
- mon keyvaluedb = rocksdb
- debug default = 0
- debug rados = 0
- debug mon = 0
- debug osd = 0
- debug bluestore = 0
- debug filestore = 0
- debug journal = 0
- debug leveldb = 0
- filestore_omap_backend = rocksdb
- osd pg bits = 11
- osd pgp bits = 11
- osd pool default size = 1
- osd pool default min size = 1
- osd pool default pg num = 100
- osd pool default pgp num = 100
- osd max object name len = 256
- osd max object namespace len = 64
- osd objectstore = filestore
- rbd_default_features = 3
- fatal signal handlers = false
- [osd.3]
- keyring = /var/lib/rook/osd3/keyring
- osd journal size = 1024
- [mon.rook-ceph-mon1]
- name = rook-ceph-mon1
- mon addr = 10.233.99.4:6790
- [mon.rook-ceph-mon2]
- name = rook-ceph-mon2
- mon addr = 10.233.124.3:6790
- [mon.rook-ceph-mon0]
- name = rook-ceph-mon0
- mon addr = 10.233.76.3:6790
- 2017-07-11 13:24:26.717584 I | proc: no existing process found for binary ceph-osd and pattern '--osd-uuid=cd112926-e214-4caa-9506-6797fb79af42'
- 2017-07-11 13:24:26.717634 I | proc: Starting process osd3 with args: [--foreground --id=3 --cluster=rook --osd-data=/var/lib/rook/osd3 --conf=/var/lib/rook/osd3/rook.config --keyring=/var/lib/rook/osd3/keyring --osd-uuid=cd112926-e214-4caa-9506-6797fb79af42 --osd-journal=/var/lib/rook/osd3/journal]
- 2017-07-11 13:24:26.717656 I | exec: Running command: ceph-osd --foreground --id=3 --cluster=rook --osd-data=/var/lib/rook/osd3 --conf=/var/lib/rook/osd3/rook.config --keyring=/var/lib/rook/osd3/keyring --osd-uuid=cd112926-e214-4caa-9506-6797fb79af42 --osd-journal=/var/lib/rook/osd3/journal
- 2017-07-11 13:24:26.718141 I | cephosd: 1/1 osd dirs succeeded on this node
- 2017-07-11 13:24:26.718280 I | sleeping a while to let the osds run...
- 2017-07-11 13:24:26.740725 I | osd3: 2017-07-11 13:24:26.740112 7f83d6cdfc80 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 178
- 2017-07-11 13:24:26.747167 I | osd3: starting osd.3 at - osd_data /var/lib/rook/osd3 /var/lib/rook/osd3/journal
- 2017-07-11 13:24:26.748625 I | osd3: 2017-07-11 13:24:26.747367 7f83d6cdfc80 0 pidfile_write: ignore empty --pid-file
- 2017-07-11 13:24:26.759409 I | osd3: 2017-07-11 13:24:26.759383 7f83d6cdfc80 0 load: jerasure load: lrc load: isa
- 2017-07-11 13:24:26.759704 I | osd3: 2017-07-11 13:24:26.759670 7f83d6cdfc80 0 filestore(/var/lib/rook/osd3) backend generic (magic 0xef53)
- 2017-07-11 13:24:26.760249 I | osd3: 2017-07-11 13:24:26.760229 7f83d6cdfc80 0 filestore(/var/lib/rook/osd3) backend generic (magic 0xef53)
- 2017-07-11 13:24:26.760590 I | osd3: 2017-07-11 13:24:26.760549 7f83d6cdfc80 0 genericfilestorebackend(/var/lib/rook/osd3) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
- 2017-07-11 13:24:26.760647 I | osd3: 2017-07-11 13:24:26.760628 7f83d6cdfc80 0 genericfilestorebackend(/var/lib/rook/osd3) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option
- 2017-07-11 13:24:26.760692 I | osd3: 2017-07-11 13:24:26.760679 7f83d6cdfc80 0 genericfilestorebackend(/var/lib/rook/osd3) detect_features: splice() is disabled via 'filestore splice' config option
- 2017-07-11 13:24:26.811582 I | osd3: 2017-07-11 13:24:26.811523 7f83d6cdfc80 0 genericfilestorebackend(/var/lib/rook/osd3) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
- 2017-07-11 13:24:26.882036 I | osd3: 2017-07-11 13:24:26.881972 7f83d6cdfc80 0 filestore(/var/lib/rook/osd3) limited size xattrs
- 2017-07-11 13:24:26.882359 I | osd3: 2017-07-11 13:24:26.882341 7f83d6cdfc80 0 filestore(/var/lib/rook/osd3) start omap initiation
- 2017-07-11 13:24:26.882624 I | osd3: 2017-07-11 13:24:26.882599 7f83d6cdfc80 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:24:26.882659 I | osd3:
- 2017-07-11 13:24:26.882690 I | osd3: 2017-07-11 13:24:26.882674 7f83d6cdfc80 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:24:26.882732 I | osd3: 2017-07-11 13:24:26.882706 7f83d6cdfc80 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:24:26.882761 I | osd3: 2017-07-11 13:24:26.882750 7f83d6cdfc80 4 rocksdb: DB SUMMARY
- 2017-07-11 13:24:26.882774 I | osd3:
- 2017-07-11 13:24:26.882855 I | osd3: 2017-07-11 13:24:26.882840 7f83d6cdfc80 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:24:26.882884 I | osd3:
- 2017-07-11 13:24:26.882909 I | osd3: 2017-07-11 13:24:26.882898 7f83d6cdfc80 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:24:26.882933 I | osd3:
- 2017-07-11 13:24:26.882977 I | osd3: 2017-07-11 13:24:26.882964 7f83d6cdfc80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes
- 2017-07-11 13:24:26.882994 I | osd3:
- 2017-07-11 13:24:26.883020 I | osd3: 2017-07-11 13:24:26.883007 7f83d6cdfc80 4 rocksdb: SST files in /var/lib/rook/osd3/current/omap dir, Total Num: 0, files:
- 2017-07-11 13:24:26.883045 I | osd3:
- 2017-07-11 13:24:26.883072 I | osd3: 2017-07-11 13:24:26.883059 7f83d6cdfc80 4 rocksdb: Write Ahead Log file in /var/lib/rook/osd3/current/omap: 000006.log size: 98 ;
- 2017-07-11 13:24:26.883091 I | osd3:
- 2017-07-11 13:24:26.883130 I | osd3: 2017-07-11 13:24:26.883103 7f83d6cdfc80 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:24:26.883160 I | osd3: 2017-07-11 13:24:26.883149 7f83d6cdfc80 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:24:26.883183 I | osd3: 2017-07-11 13:24:26.883173 7f83d6cdfc80 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:24:26.883225 I | osd3: 2017-07-11 13:24:26.883213 7f83d6cdfc80 4 rocksdb: Options.env: 0x55f8540e68e0
- 2017-07-11 13:24:26.883285 I | osd3: 2017-07-11 13:24:26.883249 7f83d6cdfc80 4 rocksdb: Options.info_log: 0x55f8552c0560
- 2017-07-11 13:24:26.883353 I | osd3: 2017-07-11 13:24:26.883300 7f83d6cdfc80 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:24:26.883381 I | osd3: 2017-07-11 13:24:26.883370 7f83d6cdfc80 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:24:26.883404 I | osd3: 2017-07-11 13:24:26.883395 7f83d6cdfc80 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:24:26.883441 I | osd3: 2017-07-11 13:24:26.883430 7f83d6cdfc80 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:24:26.883465 I | osd3: 2017-07-11 13:24:26.883455 7f83d6cdfc80 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:24:26.883487 I | osd3: 2017-07-11 13:24:26.883477 7f83d6cdfc80 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:24:26.883523 I | osd3: 2017-07-11 13:24:26.883512 7f83d6cdfc80 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:24:26.883548 I | osd3: 2017-07-11 13:24:26.883538 7f83d6cdfc80 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:24:26.883570 I | osd3: 2017-07-11 13:24:26.883560 7f83d6cdfc80 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:24:26.883607 I | osd3: 2017-07-11 13:24:26.883596 7f83d6cdfc80 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:24:26.883629 I | osd3: 2017-07-11 13:24:26.883619 7f83d6cdfc80 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:24:26.883666 I | osd3: 2017-07-11 13:24:26.883643 7f83d6cdfc80 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:24:26.883690 I | osd3: 2017-07-11 13:24:26.883679 7f83d6cdfc80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:24:26.883713 I | osd3: 2017-07-11 13:24:26.883704 7f83d6cdfc80 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:24:26.883750 I | osd3: 2017-07-11 13:24:26.883726 7f83d6cdfc80 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:24:26.883785 I | osd3: 2017-07-11 13:24:26.883764 7f83d6cdfc80 4 rocksdb: Options.wal_dir: /var/lib/rook/osd3/current/omap
- 2017-07-11 13:24:26.883826 I | osd3: 2017-07-11 13:24:26.883802 7f83d6cdfc80 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:24:26.883849 I | osd3: 2017-07-11 13:24:26.883839 7f83d6cdfc80 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:24:26.883872 I | osd3: 2017-07-11 13:24:26.883862 7f83d6cdfc80 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:24:26.883914 I | osd3: 2017-07-11 13:24:26.883903 7f83d6cdfc80 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:24:26.884220 I | osd3: 2017-07-11 13:24:26.884038 7f83d6cdfc80 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:24:26.884303 I | osd3: 2017-07-11 13:24:26.884251 7f83d6cdfc80 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:24:26.884335 I | osd3: 2017-07-11 13:24:26.884322 7f83d6cdfc80 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:24:26.884377 I | osd3: 2017-07-11 13:24:26.884365 7f83d6cdfc80 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:24:26.884486 I | osd3: 2017-07-11 13:24:26.884394 7f83d6cdfc80 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:24:26.884515 I | osd3: 2017-07-11 13:24:26.884503 7f83d6cdfc80 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:24:26.884556 I | osd3: 2017-07-11 13:24:26.884530 7f83d6cdfc80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:24:26.884657 I | osd3: 2017-07-11 13:24:26.884642 7f83d6cdfc80 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:24:26.884688 I | osd3: 2017-07-11 13:24:26.884676 7f83d6cdfc80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:24:26.884730 I | osd3: 2017-07-11 13:24:26.884718 7f83d6cdfc80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:24:26.884758 I | osd3: 2017-07-11 13:24:26.884746 7f83d6cdfc80 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:24:26.884799 I | osd3: 2017-07-11 13:24:26.884772 7f83d6cdfc80 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:24:26.884839 I | osd3: 2017-07-11 13:24:26.884828 7f83d6cdfc80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:24:26.884878 I | osd3: 2017-07-11 13:24:26.884854 7f83d6cdfc80 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:24:26.884903 I | osd3: 2017-07-11 13:24:26.884893 7f83d6cdfc80 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:24:26.884927 I | osd3: 2017-07-11 13:24:26.884917 7f83d6cdfc80 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:24:26.884974 I | osd3: 2017-07-11 13:24:26.884963 7f83d6cdfc80 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:24:26.884998 I | osd3: 2017-07-11 13:24:26.884988 7f83d6cdfc80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:24:26.885066 I | osd3: 2017-07-11 13:24:26.885054 7f83d6cdfc80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:24:26.885106 I | osd3: 2017-07-11 13:24:26.885081 7f83d6cdfc80 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:24:26.885133 I | osd3: 2017-07-11 13:24:26.885122 7f83d6cdfc80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:24:26.885160 I | osd3: 2017-07-11 13:24:26.885149 7f83d6cdfc80 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:24:26.885204 I | osd3: 2017-07-11 13:24:26.885189 7f83d6cdfc80 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:24:26.885231 I | osd3: 2017-07-11 13:24:26.885220 7f83d6cdfc80 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:24:26.885272 I | osd3: 2017-07-11 13:24:26.885246 7f83d6cdfc80 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:24:26.885299 I | osd3: 2017-07-11 13:24:26.885288 7f83d6cdfc80 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:24:26.885325 I | osd3: 2017-07-11 13:24:26.885314 7f83d6cdfc80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:24:26.885366 I | osd3: 2017-07-11 13:24:26.885354 7f83d6cdfc80 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:24:26.885391 I | osd3: 2017-07-11 13:24:26.885380 7f83d6cdfc80 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:24:26.885441 I | osd3: 2017-07-11 13:24:26.885427 7f83d6cdfc80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:24:26.885469 I | osd3: 2017-07-11 13:24:26.885458 7f83d6cdfc80 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:24:26.885510 I | osd3: 2017-07-11 13:24:26.885484 7f83d6cdfc80 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:24:26.885536 I | osd3: 2017-07-11 13:24:26.885525 7f83d6cdfc80 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:24:26.885581 I | osd3: 2017-07-11 13:24:26.885550 7f83d6cdfc80 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:24:26.885610 I | osd3: 2017-07-11 13:24:26.885598 7f83d6cdfc80 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:24:26.885635 I | osd3: 2017-07-11 13:24:26.885624 7f83d6cdfc80 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:24:26.885676 I | osd3: 2017-07-11 13:24:26.885664 7f83d6cdfc80 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:24:26.885705 I | osd3: 2017-07-11 13:24:26.885694 7f83d6cdfc80 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:24:26.886050 I | osd3: 2017-07-11 13:24:26.886022 7f83d6cdfc80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000005
- 2017-07-11 13:24:26.886084 I | osd3:
- 2017-07-11 13:24:26.886206 I | osd3: 2017-07-11 13:24:26.886189 7f83d6cdfc80 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:24:26.886255 I | osd3:
- 2017-07-11 13:24:26.886285 I | osd3: 2017-07-11 13:24:26.886272 7f83d6cdfc80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:24:26.886323 I | osd3: 2017-07-11 13:24:26.886312 7f83d6cdfc80 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:24:26.886353 I | osd3: 2017-07-11 13:24:26.886342 7f83d6cdfc80 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:24:26.886389 I | osd3: 2017-07-11 13:24:26.886366 7f83d6cdfc80 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:24:26.886414 I | osd3: 2017-07-11 13:24:26.886403 7f83d6cdfc80 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:24:26.886437 I | osd3: 2017-07-11 13:24:26.886427 7f83d6cdfc80 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:24:26.886495 I | osd3: 2017-07-11 13:24:26.886480 7f83d6cdfc80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f854f341e0)
- 2017-07-11 13:24:26.886510 I | osd3: cache_index_and_filter_blocks: 0
- 2017-07-11 13:24:26.886520 I | osd3: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:24:26.886529 I | osd3: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:24:26.886554 I | osd3: index_type: 0
- 2017-07-11 13:24:26.886564 I | osd3: hash_index_allow_collision: 1
- 2017-07-11 13:24:26.886573 I | osd3: checksum: 1
- 2017-07-11 13:24:26.886582 I | osd3: no_block_cache: 0
- 2017-07-11 13:24:26.886591 I | osd3: block_cache: 0x55f854f5a620
- 2017-07-11 13:24:26.886601 I | osd3: block_cache_name: LRUCache
- 2017-07-11 13:24:26.886622 I | osd3: block_cache_options:
- 2017-07-11 13:24:26.886632 I | osd3: capacity : 107374182
- 2017-07-11 13:24:26.886642 I | osd3: num_shard_bits : 4
- 2017-07-11 13:24:26.886652 I | osd3: strict_capacity_limit : 0
- 2017-07-11 13:24:26.886662 I | osd3: high_pri_pool_ratio: 0.000
- 2017-07-11 13:24:26.886671 I | osd3: block_cache_compressed: (nil)
- 2017-07-11 13:24:26.886680 I | osd3: persistent_cache: (nil)
- 2017-07-11 13:24:26.886704 I | osd3: block_size: 4096
- 2017-07-11 13:24:26.886714 I | osd3: block_size_deviation: 10
- 2017-07-11 13:24:26.886724 I | osd3: block_restart_interval: 16
- 2017-07-11 13:24:26.886733 I | osd3: index_block_restart_interval: 1
- 2017-07-11 13:24:26.886743 I | osd3: filter_policy: nullptr
- 2017-07-11 13:24:26.886752 I | osd3: whole_key_filtering: 1
- 2017-07-11 13:24:26.886761 I | osd3: format_version: 2
- 2017-07-11 13:24:26.886783 I | osd3:
- 2017-07-11 13:24:26.886807 I | osd3: 2017-07-11 13:24:26.886796 7f83d6cdfc80 4 rocksdb: Options.write_buffer_size: 67108864
- 2017-07-11 13:24:26.886830 I | osd3: 2017-07-11 13:24:26.886820 7f83d6cdfc80 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:24:26.886866 I | osd3: 2017-07-11 13:24:26.886855 7f83d6cdfc80 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:24:26.886902 I | osd3: 2017-07-11 13:24:26.886891 7f83d6cdfc80 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:24:26.886940 I | osd3: 2017-07-11 13:24:26.886915 7f83d6cdfc80 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:24:26.886965 I | osd3: 2017-07-11 13:24:26.886954 7f83d6cdfc80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:24:26.887011 I | osd3: 2017-07-11 13:24:26.886987 7f83d6cdfc80 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:24:26.887037 I | osd3: 2017-07-11 13:24:26.887026 7f83d6cdfc80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:24:26.887061 I | osd3: 2017-07-11 13:24:26.887051 7f83d6cdfc80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:24:26.887099 I | osd3: 2017-07-11 13:24:26.887087 7f83d6cdfc80 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:24:26.887124 I | osd3: 2017-07-11 13:24:26.887114 7f83d6cdfc80 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:24:26.887148 I | osd3: 2017-07-11 13:24:26.887138 7f83d6cdfc80 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:24:26.887196 I | osd3: 2017-07-11 13:24:26.887174 7f83d6cdfc80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:24:26.887219 I | osd3: 2017-07-11 13:24:26.887209 7f83d6cdfc80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:24:26.887254 I | osd3: 2017-07-11 13:24:26.887244 7f83d6cdfc80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:24:26.887278 I | osd3: 2017-07-11 13:24:26.887268 7f83d6cdfc80 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:24:26.887327 I | osd3: 2017-07-11 13:24:26.887303 7f83d6cdfc80 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:24:26.887355 I | osd3: 2017-07-11 13:24:26.887342 7f83d6cdfc80 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:24:26.887380 I | osd3: 2017-07-11 13:24:26.887370 7f83d6cdfc80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:24:26.887417 I | osd3: 2017-07-11 13:24:26.887406 7f83d6cdfc80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:24:26.887456 I | osd3: 2017-07-11 13:24:26.887432 7f83d6cdfc80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:24:26.887496 I | osd3: 2017-07-11 13:24:26.887484 7f83d6cdfc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:24:26.887542 I | osd3: 2017-07-11 13:24:26.887531 7f83d6cdfc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:24:26.887583 I | osd3: 2017-07-11 13:24:26.887572 7f83d6cdfc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:24:26.887609 I | osd3: 2017-07-11 13:24:26.887598 7f83d6cdfc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:24:26.887648 I | osd3: 2017-07-11 13:24:26.887636 7f83d6cdfc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:24:26.887674 I | osd3: 2017-07-11 13:24:26.887663 7f83d6cdfc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:24:26.887699 I | osd3: 2017-07-11 13:24:26.887688 7f83d6cdfc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:24:26.887741 I | osd3: 2017-07-11 13:24:26.887728 7f83d6cdfc80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:24:26.893659 I | osd3: 2017-07-11 13:24:26.893619 7f83d6cdfc80 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:24:26.893694 I | osd3: 2017-07-11 13:24:26.893671 7f83d6cdfc80 4 rocksdb: Options.arena_block_size: 8388608
- 2017-07-11 13:24:26.893717 I | osd3: 2017-07-11 13:24:26.893705 7f83d6cdfc80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:24:26.893733 I | osd3: 2017-07-11 13:24:26.893723 7f83d6cdfc80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:24:26.893748 I | osd3: 2017-07-11 13:24:26.893739 7f83d6cdfc80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:24:26.893776 I | osd3: 2017-07-11 13:24:26.893757 7f83d6cdfc80 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:24:26.893793 I | osd3: 2017-07-11 13:24:26.893783 7f83d6cdfc80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:24:26.893809 I | osd3: 2017-07-11 13:24:26.893799 7f83d6cdfc80 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:24:26.893837 I | osd3: 2017-07-11 13:24:26.893828 7f83d6cdfc80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:24:26.893859 I | osd3: 2017-07-11 13:24:26.893849 7f83d6cdfc80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:24:26.893873 I | osd3: 2017-07-11 13:24:26.893864 7f83d6cdfc80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:24:26.893887 I | osd3: 2017-07-11 13:24:26.893878 7f83d6cdfc80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:24:26.893901 I | osd3: 2017-07-11 13:24:26.893892 7f83d6cdfc80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:24:26.893914 I | osd3: 2017-07-11 13:24:26.893905 7f83d6cdfc80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:24:26.893936 I | osd3: 2017-07-11 13:24:26.893926 7f83d6cdfc80 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:24:26.893951 I | osd3: 2017-07-11 13:24:26.893942 7f83d6cdfc80 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:24:26.893964 I | osd3: 2017-07-11 13:24:26.893956 7f83d6cdfc80 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:24:26.893980 I | osd3: 2017-07-11 13:24:26.893969 7f83d6cdfc80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:24:26.893998 I | osd3: 2017-07-11 13:24:26.893986 7f83d6cdfc80 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:24:26.894018 I | osd3: 2017-07-11 13:24:26.894006 7f83d6cdfc80 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:24:26.894032 I | osd3: 2017-07-11 13:24:26.894023 7f83d6cdfc80 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:24:26.894046 I | osd3: 2017-07-11 13:24:26.894037 7f83d6cdfc80 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:24:26.894060 I | osd3: 2017-07-11 13:24:26.894051 7f83d6cdfc80 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:24:26.894073 I | osd3: 2017-07-11 13:24:26.894064 7f83d6cdfc80 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:24:26.894093 I | osd3: 2017-07-11 13:24:26.894084 7f83d6cdfc80 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:24:26.894521 I | osd3: 2017-07-11 13:24:26.894499 7f83d6cdfc80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/osd3/current/omap/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:24:26.894527 I | osd3:
- 2017-07-11 13:24:26.894550 I | osd3: 2017-07-11 13:24:26.894538 7f83d6cdfc80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 4
- 2017-07-11 13:24:26.894554 I | osd3:
- 2017-07-11 13:24:26.894618 I | osd3: 2017-07-11 13:24:26.894595 7f83d6cdfc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779466894591, "job": 1, "event": "recovery_started", "log_files": [6]}
- 2017-07-11 13:24:26.894638 I | osd3: 2017-07-11 13:24:26.894628 7f83d6cdfc80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #6 mode 2
- 2017-07-11 13:24:26.937116 I | osd3: 2017-07-11 13:24:26.937086 7f83d6cdfc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779466937078, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 882, "table_properties": {"data_size": 51, "index_size": 27, "filter_size": 0, "raw_key_size": 20, "raw_average_key_size": 20, "raw_value_size": 15, "raw_average_value_size": 15, "num_data_blocks": 1, "num_entries": 1, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:24:26.937182 I | osd3: 2017-07-11 13:24:26.937170 7f83d6cdfc80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 8
- 2017-07-11 13:24:26.937188 I | osd3:
- 2017-07-11 13:24:27.006471 I | osd3: 2017-07-11 13:24:27.006444 7f83d6cdfc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779467006440, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:24:27.047295 I | osd3: 2017-07-11 13:24:27.047269 7f83d6cdfc80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55f8552d4000
- 2017-07-11 13:24:27.047556 I | osd3: 2017-07-11 13:24:27.047534 7f83d6cdfc80 0 filestore(/var/lib/rook/osd3) mount(1717): enabling WRITEAHEAD journal mode: checkpoint is not enabled
- 2017-07-11 13:24:27.047771 I | osd3: 2017-07-11 13:24:27.047708 7f83d6cdfc80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:27.090107 I | osd3: 2017-07-11 13:24:27.090075 7f83d6cdfc80 0 osd.3 0 crush map has features 288232575208783872, adjusting msgr requires for clients
- 2017-07-11 13:24:27.090184 I | osd3: 2017-07-11 13:24:27.090167 7f83d6cdfc80 0 osd.3 0 crush map has features 288232575208783872 was 8705, adjusting msgr requires for mons
- 2017-07-11 13:24:27.090238 I | osd3: 2017-07-11 13:24:27.090223 7f83d6cdfc80 0 osd.3 0 crush map has features 288232575208783872, adjusting msgr requires for osds
- 2017-07-11 13:24:27.090354 I | osd3: 2017-07-11 13:24:27.090324 7f83d6cdfc80 0 osd.3 0 load_pgs
- 2017-07-11 13:24:27.090482 I | osd3: 2017-07-11 13:24:27.090451 7f83d6cdfc80 0 osd.3 0 load_pgs opened 0 pgs
- 2017-07-11 13:24:27.090515 I | osd3: 2017-07-11 13:24:27.090503 7f83d6cdfc80 0 osd.3 0 using 1 op queue with priority op cut off at 64.
- 2017-07-11 13:24:27.091123 I | osd3: 2017-07-11 13:24:27.091103 7f83d6cdfc80 -1 osd.3 0 log_to_monitors {default=true}
- 2017-07-11 13:24:29.008564 I | osd3: 2017-07-11 13:24:29.008340 7f83d6cdfc80 0 osd.3 0 done with init, starting boot process
- 2017-07-11 13:24:29.019073 I | osd3: 2017-07-11 13:24:29.019036 7f83bc449700 -1 osd.3 0 waiting for initial osdmap
- 2017-07-11 13:24:29.035536 I | osd3: 2017-07-11 13:24:29.035471 7f83c8c62700 0 osd.3 9 crush map has features 2200130813952, adjusting msgr requires for clients
- 2017-07-11 13:24:29.035578 I | osd3: 2017-07-11 13:24:29.035489 7f83c8c62700 0 osd.3 9 crush map has features 2200130813952 was 288232575208792577, adjusting msgr requires for mons
- 2017-07-11 13:24:29.035598 I | osd3: 2017-07-11 13:24:29.035492 7f83c8c62700 0 osd.3 9 crush map has features 720578140510109696, adjusting msgr requires for osds
- 2017-07-11 13:24:54.101915 I | osd3: 2017-07-11 13:24:54.101545 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:34.101544)
- 2017-07-11 13:24:55.101824 I | osd3: 2017-07-11 13:24:55.101747 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:35.101744)
- 2017-07-11 13:24:56.102043 I | osd3: 2017-07-11 13:24:56.101967 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:36.101966)
- 2017-07-11 13:24:57.102163 I | osd3: 2017-07-11 13:24:57.102075 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:37.102074)
- 2017-07-11 13:24:58.102364 I | osd3: 2017-07-11 13:24:58.102263 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:38.102262)
- 2017-07-11 13:24:59.102540 I | osd3: 2017-07-11 13:24:59.102463 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:39.102462)
- 2017-07-11 13:25:00.102735 I | osd3: 2017-07-11 13:25:00.102674 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:40.102673)
- 2017-07-11 13:25:01.102985 I | osd3: 2017-07-11 13:25:01.102809 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:41.102808)
- 2017-07-11 13:25:01.103067 I | osd3: 2017-07-11 13:25:01.102918 7f83cb467700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.754338 secs
- 2017-07-11 13:25:01.103091 I | osd3: 2017-07-11 13:25:01.102930 7f83cb467700 0 log_channel(cluster) log [WRN] : slow request 30.754338 seconds old, received at 2017-07-11 13:24:30.348500: osd_pg_create(e10 0.7:2 0.a:2 0.12:2 0.13:2 0.15:2 0.18:2 0.1b:2 0.1f:2 0.22:2 0.23:2 0.24:2 0.2c:2 0.30:2 0.33:2 0.34:2 0.3d:2 0.3e:2 0.42:2 0.45:2 0.4a:2 0.4c:2 0.50:2 0.51:2 0.54:2 0.57:2 0.58:2 0.59:2 0.66:2 0.67:2 0.68:2 0.6a:2 0.6b:2 0.6c:2 0.6f:2 0.71:2 0.7c:2 0.82:2 0.85:2 0.89:2 0.90:2 0.95:2 0.9e:2 0.9f:2 0.a3:2 0.aa:2 0.af:2 0.b3:2 0.b7:2 0.ba:2 0.bd:2 0.c0:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e0:2 0.e2:2 0.e5:2 0.e9:2 0.ea:2 0.ed:2 0.ef:2 0.f7:2 0.fc:2 0.fd:2 0.fe:2 0.ff:2 0.106:2 0.107:2 0.108:2 0.10a:2 0.10c:2 0.10d:2 0.10e:2 0.10f:2 0.110:2 0.11a:2 0.123:2 0.127:2 0.128:2 0.130:2 0.132:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.143:2 0.152:2 0.153:2 0.156:2 0.15c:2 0.15f:2 0.162:2 0.163:2 0.16f:2 0.173:2 0.176:2 0.177:2 0.17e:2 0.181:2 0.187:2 0.188:2 0.18b:2 0.18c:2 0.191:2 0.192:2 0.194:2 0.195:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b0:2 0.1b1:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c2:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1dc:2 0.1de:2 0.1df:2 0.1e2:2 0.1e3:2 0.1ec:2 0.1f3:2 0.1fb:2 0.1fe:2 0.201:2 0.204:2 0.205:2 0.20a:2 0.213:2 0.21c:2 0.21e:2 0.221:2 0.224:2 0.229:2 0.232:2 0.235:2 0.237:2 0.238:2 0.23a:2 0.23f:2 0.242:2 0.245:2 0.24b:2 0.250:2 0.256:2 0.257:2 0.25e:2 0.264:2 0.267:2 0.268:2 0.26a:2 0.278:2 0.27e:2 0.280:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.29e:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ae:2 0.2b0:2 0.2c1:2 0.2c8:2 0.2cb:2 0.2d5:2 0.2d6:2 0.2da:2 0.2db:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ea:2 0.2ec:2 0.2ef:2 0.2f0:2 0.2f2:2 0.2f4:2 0.2f9:2 0.2fb:2 0.305:2 0.306:2 0.308:2 0.309:2 0.30a:2 0.30c:2 0.310:2 0.314:2 0.319:2 0.31d:2 0.322:2 0.327:2 0.329:2 0.331:2 0.334:2 0.335:2 0.337:2 0.33e:2 0.340:2 0.344:2 0.348:2 0.349:2 0.34a:2 0.34c:2 0.350:2 0.354:2 0.355:2 0.357:2 0.359:2 0.35a:2 0.35e:2 0.365:2 0.367:2 0.369:2 0.36a:2 0.36e:2 0.37d:2 0.382:2 0.389:2 0.38c:2 0.38f:2 0.390:2 0.394:2 0.398:2 0.399:2 0.39a:2 0.3a0:2 0.3a7:2 0.3af:2 0.3b0:2 0.3b7:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c5:2 0.3c6:2 0.3cf:2 0.3d2:2 0.3d4:2 0.3d5:2 0.3db:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3e5:2 0.3e7:2 0.3f0:2 0.3f6:2 0.3f9:2) currently started
- 2017-07-11 13:25:02.103139 I | osd3: 2017-07-11 13:25:02.103063 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:42.103062)
- 2017-07-11 13:25:03.103402 I | osd3: 2017-07-11 13:25:03.103273 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:43.103271)
- 2017-07-11 13:25:04.103533 I | osd3: 2017-07-11 13:25:04.103446 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:44.103443)
- 2017-07-11 13:25:05.103700 I | osd3: 2017-07-11 13:25:05.103617 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:45.103604)
- 2017-07-11 13:25:06.104080 I | osd3: 2017-07-11 13:25:06.103965 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:46.103963)
- 2017-07-11 13:25:07.104190 I | osd3: 2017-07-11 13:25:07.104120 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:47.104118)
- 2017-07-11 13:25:08.104343 I | osd3: 2017-07-11 13:25:08.104267 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:48.104266)
- 2017-07-11 13:25:09.104490 I | osd3: 2017-07-11 13:25:09.104410 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:49.104408)
- 2017-07-11 13:25:10.104629 I | osd3: 2017-07-11 13:25:10.104551 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:50.104550)
- 2017-07-11 13:25:11.104824 I | osd3: 2017-07-11 13:25:11.104722 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:51.104721)
- 2017-07-11 13:25:12.105037 I | osd3: 2017-07-11 13:25:12.104923 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:52.104921)
- 2017-07-11 13:25:13.105243 I | osd3: 2017-07-11 13:25:13.105134 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:53.105121)
- 2017-07-11 13:25:14.105468 I | osd3: 2017-07-11 13:25:14.105396 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:54.105394)
- 2017-07-11 13:25:15.105610 I | osd3: 2017-07-11 13:25:15.105521 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:55.105519)
- 2017-07-11 13:25:16.105806 I | osd3: 2017-07-11 13:25:16.105718 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:56.105717)
- 2017-07-11 13:25:17.106025 I | osd3: 2017-07-11 13:25:17.105932 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:57.105931)
- 2017-07-11 13:25:18.106198 I | osd3: 2017-07-11 13:25:18.106117 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:58.106115)
- 2017-07-11 13:25:19.106370 I | osd3: 2017-07-11 13:25:19.106287 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:24:59.106285)
- 2017-07-11 13:25:20.106477 I | osd3: 2017-07-11 13:25:20.106376 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:00.106373)
- 2017-07-11 13:25:21.106658 I | osd3: 2017-07-11 13:25:21.106553 7f83cb467700 -1 osd.3 10 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:01.106551)
- 2017-07-11 13:25:22.106876 I | osd3: 2017-07-11 13:25:22.106690 7f83cb467700 -1 osd.3 13 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:02.106689)
- 2017-07-11 13:25:23.106922 I | osd3: 2017-07-11 13:25:23.106851 7f83cb467700 -1 osd.3 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:03.106850)
- 2017-07-11 13:25:24.107042 I | osd3: 2017-07-11 13:25:24.106978 7f83cb467700 -1 osd.3 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:04.106976)
- 2017-07-11 13:25:25.107220 I | osd3: 2017-07-11 13:25:25.107097 7f83cb467700 -1 osd.3 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:05.107095)
- 2017-07-11 13:25:26.107448 I | osd3: 2017-07-11 13:25:26.107217 7f83cb467700 -1 osd.3 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:06.107216)
- 2017-07-11 13:25:27.107455 I | osd3: 2017-07-11 13:25:27.107376 7f83cb467700 -1 osd.3 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:07.107375)
- 2017-07-11 13:25:28.107760 I | osd3: 2017-07-11 13:25:28.107606 7f83cb467700 -1 osd.3 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:08.107604)
- 2017-07-11 13:25:29.107934 I | osd3: 2017-07-11 13:25:29.107861 7f83cb467700 -1 osd.3 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:09.107859)
- 2017-07-11 13:25:30.108054 I | osd3: 2017-07-11 13:25:30.107979 7f83cb467700 -1 osd.3 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:10.107978)
- 2017-07-11 13:25:31.108209 I | osd3: 2017-07-11 13:25:31.108136 7f83cb467700 -1 osd.3 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:11.108135)
- 2017-07-11 13:25:32.108311 I | osd3: 2017-07-11 13:25:32.108238 7f83cb467700 -1 osd.3 14 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:12.108237)
- 2017-07-11 13:25:33.108549 I | osd3: 2017-07-11 13:25:33.108300 7f83cb467700 -1 osd.3 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:13.108298)
- 2017-07-11 13:25:33.108613 I | osd3: 2017-07-11 13:25:33.108429 7f83cb467700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 56.563008 secs
- 2017-07-11 13:25:33.108637 I | osd3: 2017-07-11 13:25:33.108434 7f83cb467700 0 log_channel(cluster) log [WRN] : slow request 56.563008 seconds old, received at 2017-07-11 13:24:36.545354: osd_pg_create(e15 0.a:2 0.d:2 0.18:2 0.1f:2 0.23:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.72:2 0.7c:2 0.88:2 0.89:2 0.8d:2 0.91:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.b9:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e2:2 0.e9:2 0.ea:2 0.ef:2 0.fc:2 0.ff:2 0.108:2 0.10e:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.127:2 0.12d:2 0.130:2 0.131:2 0.132:2 0.136:2 0.138:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.154:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.184:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.195:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1d7:2 0.1de:2 0.1df:2 0.1e2:2 0.1e3:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1f8:2 0.1fb:2 0.202:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.24e:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.278:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.298:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2ed:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.2ff:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.314:2 0.316:2 0.319:2 0.31d:2 0.31f:2 0.329:2 0.331:2 0.335:2 0.337:2 0.33b:2 0.33c:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.369:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3ba:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3d2:2 0.3d6:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2 0.3f1:2) currently started
- 2017-07-11 13:25:34.108603 I | osd3: 2017-07-11 13:25:34.108513 7f83cb467700 -1 osd.3 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:14.108512)
- 2017-07-11 13:25:35.108777 I | osd3: 2017-07-11 13:25:35.108677 7f83cb467700 -1 osd.3 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:15.108676)
- 2017-07-11 13:25:36.108923 I | osd3: 2017-07-11 13:25:36.108810 7f83cb467700 -1 osd.3 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:16.108809)
- 2017-07-11 13:25:37.109127 I | osd3: 2017-07-11 13:25:37.108931 7f83cb467700 -1 osd.3 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:17.108929)
- 2017-07-11 13:25:37.109204 I | osd3: 2017-07-11 13:25:37.109009 7f83cb467700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 60.563637 secs
- 2017-07-11 13:25:37.109223 I | osd3: 2017-07-11 13:25:37.109015 7f83cb467700 0 log_channel(cluster) log [WRN] : slow request 60.563637 seconds old, received at 2017-07-11 13:24:36.545354: osd_pg_create(e15 0.a:2 0.d:2 0.18:2 0.1f:2 0.23:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.72:2 0.7c:2 0.88:2 0.89:2 0.8d:2 0.91:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.b9:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e2:2 0.e9:2 0.ea:2 0.ef:2 0.fc:2 0.ff:2 0.108:2 0.10e:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.127:2 0.12d:2 0.130:2 0.131:2 0.132:2 0.136:2 0.138:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.154:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.184:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.195:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1d7:2 0.1de:2 0.1df:2 0.1e2:2 0.1e3:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1f8:2 0.1fb:2 0.202:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.24e:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.278:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.298:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2ed:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.2ff:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.314:2 0.316:2 0.319:2 0.31d:2 0.31f:2 0.329:2 0.331:2 0.335:2 0.337:2 0.33b:2 0.33c:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.369:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3ba:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3d2:2 0.3d6:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2 0.3f1:2) currently started
- 2017-07-11 13:25:38.109173 I | osd3: 2017-07-11 13:25:38.109086 7f83cb467700 -1 osd.3 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:18.109085)
- 2017-07-11 13:25:39.115321 I | osd3: 2017-07-11 13:25:39.115227 7f83cb467700 -1 osd.3 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:19.115226)
- 2017-07-11 13:25:40.115534 I | osd3: 2017-07-11 13:25:40.115439 7f83cb467700 -1 osd.3 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:20.115438)
- 2017-07-11 13:25:41.115687 I | osd3: 2017-07-11 13:25:41.115580 7f83cb467700 -1 osd.3 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:21.115578)
- 2017-07-11 13:25:42.116099 I | osd3: 2017-07-11 13:25:42.115770 7f83cb467700 -1 osd.3 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:22.115768)
- 2017-07-11 13:25:42.116116 I | osd3: 2017-07-11 13:25:42.116008 7f83cb467700 0 log_channel(cluster) log [WRN] : 2 slow requests, 2 included below; oldest blocked for > 64.892901 secs
- 2017-07-11 13:25:42.116125 I | osd3: 2017-07-11 13:25:42.116019 7f83cb467700 0 log_channel(cluster) log [WRN] : slow request 64.892901 seconds old, received at 2017-07-11 13:24:37.222959: osd_pg_create(e16 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:42.116141 I | osd3: 2017-07-11 13:25:42.116029 7f83cb467700 0 log_channel(cluster) log [WRN] : slow request 60.607081 seconds old, received at 2017-07-11 13:24:41.508779: osd_pg_create(e17 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:43.116434 I | osd3: 2017-07-11 13:25:43.116282 7f83cb467700 -1 osd.3 16 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:23.116275)
- 2017-07-11 13:25:43.116516 I | osd3: 2017-07-11 13:25:43.116352 7f83cb467700 0 log_channel(cluster) log [WRN] : 2 slow requests, 2 included below; oldest blocked for > 65.893370 secs
- 2017-07-11 13:25:43.116533 I | osd3: 2017-07-11 13:25:43.116358 7f83cb467700 0 log_channel(cluster) log [WRN] : slow request 65.893370 seconds old, received at 2017-07-11 13:24:37.222959: osd_pg_create(e16 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:43.116574 I | osd3: 2017-07-11 13:25:43.116362 7f83cb467700 0 log_channel(cluster) log [WRN] : slow request 61.607550 seconds old, received at 2017-07-11 13:24:41.508779: osd_pg_create(e17 0.a:2 0.d:2 0.18:2 0.1f:2 0.2c:2 0.2f:2 0.30:2 0.3e:2 0.4c:2 0.51:2 0.54:2 0.59:2 0.61:2 0.67:2 0.6a:2 0.6b:2 0.6f:2 0.71:2 0.7c:2 0.8d:2 0.9f:2 0.a3:2 0.a4:2 0.aa:2 0.bf:2 0.c7:2 0.d3:2 0.d6:2 0.d9:2 0.da:2 0.e9:2 0.ea:2 0.ef:2 0.ff:2 0.108:2 0.110:2 0.118:2 0.11a:2 0.123:2 0.12d:2 0.130:2 0.132:2 0.136:2 0.13a:2 0.13c:2 0.13f:2 0.140:2 0.152:2 0.153:2 0.156:2 0.15b:2 0.15f:2 0.173:2 0.17e:2 0.181:2 0.188:2 0.18b:2 0.192:2 0.194:2 0.19f:2 0.1a2:2 0.1a9:2 0.1aa:2 0.1b2:2 0.1b3:2 0.1be:2 0.1c3:2 0.1c6:2 0.1ca:2 0.1cc:2 0.1d6:2 0.1de:2 0.1df:2 0.1e2:2 0.1e7:2 0.1ec:2 0.1ed:2 0.1fb:2 0.205:2 0.20c:2 0.214:2 0.21c:2 0.21e:2 0.221:2 0.232:2 0.238:2 0.23f:2 0.242:2 0.245:2 0.247:2 0.250:2 0.256:2 0.257:2 0.264:2 0.268:2 0.27c:2 0.27e:2 0.287:2 0.28d:2 0.28f:2 0.293:2 0.29b:2 0.29c:2 0.29d:2 0.2a4:2 0.2a7:2 0.2a8:2 0.2aa:2 0.2ab:2 0.2ac:2 0.2c1:2 0.2c2:2 0.2d4:2 0.2d6:2 0.2dc:2 0.2e4:2 0.2e7:2 0.2e8:2 0.2ec:2 0.2f0:2 0.2f2:2 0.2fb:2 0.2fe:2 0.305:2 0.308:2 0.30c:2 0.310:2 0.319:2 0.31d:2 0.329:2 0.331:2 0.337:2 0.33b:2 0.33e:2 0.340:2 0.341:2 0.345:2 0.348:2 0.34a:2 0.350:2 0.354:2 0.355:2 0.357:2 0.365:2 0.367:2 0.36a:2 0.36e:2 0.371:2 0.37d:2 0.37e:2 0.382:2 0.385:2 0.38c:2 0.390:2 0.398:2 0.399:2 0.3af:2 0.3bb:2 0.3bc:2 0.3c2:2 0.3c6:2 0.3c8:2 0.3cf:2 0.3d0:2 0.3de:2 0.3df:2 0.3e1:2 0.3e4:2 0.3ee:2 0.3f0:2) currently wait for new map
- 2017-07-11 13:25:44.116721 I | osd3: 2017-07-11 13:25:44.116628 7f83cb467700 -1 osd.3 17 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:33.398234 (cutoff 2017-07-11 13:25:24.116627)
- 2017-07-11 13:25:44.491940 I | osd3: 2017-07-11 13:25:44.491845 7f83c8c62700 0 log_channel(cluster) log [WRN] : map e18 wrongly marked me down at e18
- 2017-07-11 13:26:20.145479 I | osd3: 2017-07-11 13:26:20.145219 7f83cb467700 -1 osd.3 47 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:00.145217)
- 2017-07-11 13:26:21.145706 I | osd3: 2017-07-11 13:26:21.145568 7f83cb467700 -1 osd.3 47 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:01.145566)
- 2017-07-11 13:26:22.145886 I | osd3: 2017-07-11 13:26:22.145778 7f83cb467700 -1 osd.3 50 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:02.145777)
- 2017-07-11 13:26:23.146064 I | osd3: 2017-07-11 13:26:23.145983 7f83cb467700 -1 osd.3 50 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:03.145982)
- 2017-07-11 13:26:24.146235 I | osd3: 2017-07-11 13:26:24.146091 7f83cb467700 -1 osd.3 50 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:04.146090)
- 2017-07-11 13:26:24.146313 I | osd3: 2017-07-11 13:26:24.146110 7f83cb467700 -1 osd.3 50 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:04.146090)
- 2017-07-11 13:26:25.146334 I | osd3: 2017-07-11 13:26:25.146246 7f83cb467700 -1 osd.3 53 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:05.146245)
- 2017-07-11 13:26:25.146352 I | osd3: 2017-07-11 13:26:25.146274 7f83cb467700 -1 osd.3 53 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:05.146245)
- 2017-07-11 13:26:26.146603 I | osd3: 2017-07-11 13:26:26.146447 7f83cb467700 -1 osd.3 53 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:06.146444)
- 2017-07-11 13:26:26.146705 I | osd3: 2017-07-11 13:26:26.146489 7f83cb467700 -1 osd.3 53 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:06.146444)
- 2017-07-11 13:26:27.146848 I | osd3: 2017-07-11 13:26:27.146676 7f83cb467700 -1 osd.3 53 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:07.146674)
- 2017-07-11 13:26:27.146975 I | osd3: 2017-07-11 13:26:27.146702 7f83cb467700 -1 osd.3 53 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:07.146674)
- 2017-07-11 13:26:28.146835 I | osd3: 2017-07-11 13:26:28.146761 7f83cb467700 -1 osd.3 55 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:08.146759)
- 2017-07-11 13:26:28.146916 I | osd3: 2017-07-11 13:26:28.146775 7f83cb467700 -1 osd.3 55 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:08.146759)
- 2017-07-11 13:26:29.146975 I | osd3: 2017-07-11 13:26:29.146869 7f83cb467700 -1 osd.3 56 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:09.146867)
- 2017-07-11 13:26:29.146994 I | osd3: 2017-07-11 13:26:29.146891 7f83cb467700 -1 osd.3 56 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:09.146867)
- 2017-07-11 13:26:30.147195 I | osd3: 2017-07-11 13:26:30.147059 7f83cb467700 -1 osd.3 56 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:10.147056)
- 2017-07-11 13:26:30.147327 I | osd3: 2017-07-11 13:26:30.147099 7f83cb467700 -1 osd.3 56 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:10.147056)
- 2017-07-11 13:26:31.147442 I | osd3: 2017-07-11 13:26:31.147344 7f83cb467700 -1 osd.3 56 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:11.147342)
- 2017-07-11 13:26:31.147511 I | osd3: 2017-07-11 13:26:31.147372 7f83cb467700 -1 osd.3 56 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:11.147342)
- 2017-07-11 13:26:32.147690 I | osd3: 2017-07-11 13:26:32.147597 7f83cb467700 -1 osd.3 56 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:12.147596)
- 2017-07-11 13:26:32.147710 I | osd3: 2017-07-11 13:26:32.147627 7f83cb467700 -1 osd.3 56 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:12.147596)
- 2017-07-11 13:26:33.147922 I | osd3: 2017-07-11 13:26:33.147818 7f83cb467700 -1 osd.3 56 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:13.147817)
- 2017-07-11 13:26:33.148004 I | osd3: 2017-07-11 13:26:33.147850 7f83cb467700 -1 osd.3 56 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:13.147817)
- 2017-07-11 13:26:34.148169 I | osd3: 2017-07-11 13:26:34.148028 7f83cb467700 -1 osd.3 56 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:14.148025)
- 2017-07-11 13:26:34.148254 I | osd3: 2017-07-11 13:26:34.148068 7f83cb467700 -1 osd.3 56 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:14.148025)
- 2017-07-11 13:26:35.148350 I | osd3: 2017-07-11 13:26:35.148268 7f83cb467700 -1 osd.3 60 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:15.148267)
- 2017-07-11 13:26:35.148368 I | osd3: 2017-07-11 13:26:35.148291 7f83cb467700 -1 osd.3 60 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:15.148267)
- 2017-07-11 13:26:36.148545 I | osd3: 2017-07-11 13:26:36.148454 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:16.148453)
- 2017-07-11 13:26:36.148633 I | osd3: 2017-07-11 13:26:36.148481 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:16.148453)
- 2017-07-11 13:26:37.148954 I | osd3: 2017-07-11 13:26:37.148768 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:17.148766)
- 2017-07-11 13:26:37.149224 I | osd3: 2017-07-11 13:26:37.148807 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:17.148766)
- 2017-07-11 13:26:38.149088 I | osd3: 2017-07-11 13:26:38.149002 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:18.149001)
- 2017-07-11 13:26:38.149169 I | osd3: 2017-07-11 13:26:38.149029 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:18.149001)
- 2017-07-11 13:26:39.149322 I | osd3: 2017-07-11 13:26:39.149233 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:19.149230)
- 2017-07-11 13:26:39.149343 I | osd3: 2017-07-11 13:26:39.149262 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:19.149230)
- 2017-07-11 13:26:40.149641 I | osd3: 2017-07-11 13:26:40.149482 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:20.149480)
- 2017-07-11 13:26:40.149720 I | osd3: 2017-07-11 13:26:40.149525 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:20.149480)
- 2017-07-11 13:26:41.150029 I | osd3: 2017-07-11 13:26:41.149894 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:21.149892)
- 2017-07-11 13:26:41.150070 I | osd3: 2017-07-11 13:26:41.149933 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:21.149892)
- 2017-07-11 13:26:42.150348 I | osd3: 2017-07-11 13:26:42.150164 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:22.150161)
- 2017-07-11 13:26:42.150380 I | osd3: 2017-07-11 13:26:42.150204 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:22.150161)
- 2017-07-11 13:26:43.150574 I | osd3: 2017-07-11 13:26:43.150480 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:23.150478)
- 2017-07-11 13:26:43.150663 I | osd3: 2017-07-11 13:26:43.150509 7f83cb467700 -1 osd.3 61 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:23.150478)
- 2017-07-11 13:26:44.150834 I | osd3: 2017-07-11 13:26:44.150754 7f83cb467700 -1 osd.3 67 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:24.150752)
- 2017-07-11 13:26:44.150927 I | osd3: 2017-07-11 13:26:44.150773 7f83cb467700 -1 osd.3 67 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:24.150752)
- 2017-07-11 13:26:45.151061 I | osd3: 2017-07-11 13:26:45.150985 7f83cb467700 -1 osd.3 67 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:59.489899 (cutoff 2017-07-11 13:26:25.150984)
- 2017-07-11 13:26:45.151078 I | osd3: 2017-07-11 13:26:45.151005 7f83cb467700 -1 osd.3 67 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:03.590241 (cutoff 2017-07-11 13:26:25.150984)
- 2017-07-11 13:26:46.043464 I | osd3: 2017-07-11 13:26:46.043418 7f83c8c62700 0 log_channel(cluster) log [WRN] : map e70 wrongly marked me down at e70
- 2017-07-11 13:27:07.155104 I | osd3: 2017-07-11 13:27:07.155003 7f83cb467700 -1 osd.3 80 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.734915 (cutoff 2017-07-11 13:26:47.154991)
- 2017-07-11 13:27:08.155259 I | osd3: 2017-07-11 13:27:08.155143 7f83cb467700 -1 osd.3 82 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.734915 (cutoff 2017-07-11 13:26:48.155141)
- 2017-07-11 13:27:09.155410 I | osd3: 2017-07-11 13:27:09.155289 7f83cb467700 -1 osd.3 83 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.734915 (cutoff 2017-07-11 13:26:49.155287)
- 2017-07-11 13:27:10.155482 I | osd3: 2017-07-11 13:27:10.155405 7f83cb467700 -1 osd.3 83 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.734915 (cutoff 2017-07-11 13:26:50.155404)
- 2017-07-11 13:27:11.155779 I | osd3: 2017-07-11 13:27:11.155677 7f83cb467700 -1 osd.3 84 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.734915 (cutoff 2017-07-11 13:26:51.155647)
- 2017-07-11 13:27:12.155985 I | osd3: 2017-07-11 13:27:12.155874 7f83cb467700 -1 osd.3 84 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:26:52.155872)
- 2017-07-11 13:27:12.156002 I | osd3: 2017-07-11 13:27:12.155901 7f83cb467700 -1 osd.3 84 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.734915 (cutoff 2017-07-11 13:26:52.155872)
- 2017-07-11 13:27:13.156445 I | osd3: 2017-07-11 13:27:13.156308 7f83cb467700 -1 osd.3 84 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:26:53.156306)
- 2017-07-11 13:27:13.156573 I | osd3: 2017-07-11 13:27:13.156348 7f83cb467700 -1 osd.3 84 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.734915 (cutoff 2017-07-11 13:26:53.156306)
- 2017-07-11 13:27:14.156539 I | osd3: 2017-07-11 13:27:14.156445 7f83cb467700 -1 osd.3 84 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:26:54.156444)
- 2017-07-11 13:27:14.156618 I | osd3: 2017-07-11 13:27:14.156468 7f83cb467700 -1 osd.3 84 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.734915 (cutoff 2017-07-11 13:26:54.156444)
- 2017-07-11 13:27:15.156687 I | osd3: 2017-07-11 13:27:15.156590 7f83cb467700 -1 osd.3 84 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:26:55.156589)
- 2017-07-11 13:27:15.156711 I | osd3: 2017-07-11 13:27:15.156618 7f83cb467700 -1 osd.3 84 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:26:46.734915 (cutoff 2017-07-11 13:26:55.156589)
- 2017-07-11 13:27:16.156796 I | osd3: 2017-07-11 13:27:16.156709 7f83cb467700 -1 osd.3 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:26:56.156708)
- 2017-07-11 13:27:17.157012 I | osd3: 2017-07-11 13:27:17.156887 7f83cb467700 -1 osd.3 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:26:57.156885)
- 2017-07-11 13:27:18.157167 I | osd3: 2017-07-11 13:27:18.157043 7f83cb467700 -1 osd.3 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:26:58.157042)
- 2017-07-11 13:27:19.157298 I | osd3: 2017-07-11 13:27:19.157192 7f83cb467700 -1 osd.3 86 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:26:59.157190)
- 2017-07-11 13:27:20.157402 I | osd3: 2017-07-11 13:27:20.157317 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:00.157315)
- 2017-07-11 13:27:21.157652 I | osd3: 2017-07-11 13:27:21.157558 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:01.157557)
- 2017-07-11 13:27:22.157818 I | osd3: 2017-07-11 13:27:22.157727 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:02.157726)
- 2017-07-11 13:27:23.165732 I | osd3: 2017-07-11 13:27:23.159266 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:03.159263)
- 2017-07-11 13:27:24.159441 I | osd3: 2017-07-11 13:27:24.159375 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:04.159374)
- 2017-07-11 13:27:25.159622 I | osd3: 2017-07-11 13:27:25.159538 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:05.159535)
- 2017-07-11 13:27:26.159772 I | osd3: 2017-07-11 13:27:26.159692 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:06.159690)
- 2017-07-11 13:27:27.160037 I | osd3: 2017-07-11 13:27:27.159862 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:07.159860)
- 2017-07-11 13:27:28.160145 I | osd3: 2017-07-11 13:27:28.160042 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:08.160041)
- 2017-07-11 13:27:29.160282 I | osd3: 2017-07-11 13:27:29.160197 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:09.160195)
- 2017-07-11 13:27:30.160457 I | osd3: 2017-07-11 13:27:30.160317 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:10.160315)
- 2017-07-11 13:27:31.160768 I | osd3: 2017-07-11 13:27:31.160691 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:11.160690)
- 2017-07-11 13:27:32.161022 I | osd3: 2017-07-11 13:27:32.160905 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:12.160903)
- 2017-07-11 13:27:33.172617 I | osd3: 2017-07-11 13:27:33.162534 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:13.162533)
- 2017-07-11 13:27:34.163011 I | osd3: 2017-07-11 13:27:34.162900 7f83cb467700 -1 osd.3 87 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:14.162899)
- 2017-07-11 13:27:35.163135 I | osd3: 2017-07-11 13:27:35.163072 7f83cb467700 -1 osd.3 90 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:15.163070)
- 2017-07-11 13:27:36.164751 I | osd3: 2017-07-11 13:27:36.163404 7f83cb467700 -1 osd.3 90 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:16.163402)
- 2017-07-11 13:27:37.168093 I | osd3: 2017-07-11 13:27:37.166709 7f83cb467700 -1 osd.3 90 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:52.035138 (cutoff 2017-07-11 13:27:17.166708)
- 2017-07-11 13:27:37.574055 I | osd3: 2017-07-11 13:27:37.573525 7f83c8c62700 0 log_channel(cluster) log [WRN] : map e92 wrongly marked me down at e91
- 2017-07-11 13:27:59.181061 I | osd3: 2017-07-11 13:27:59.180988 7f83cb467700 -1 osd.3 108 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:39.180987)
- 2017-07-11 13:28:00.181274 I | osd3: 2017-07-11 13:28:00.181191 7f83cb467700 -1 osd.3 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:40.181188)
- 2017-07-11 13:28:01.181331 I | osd3: 2017-07-11 13:28:01.181261 7f83cb467700 -1 osd.3 110 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:41.181258)
- 2017-07-11 13:28:02.181480 I | osd3: 2017-07-11 13:28:02.181407 7f83cb467700 -1 osd.3 111 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:42.181406)
- 2017-07-11 13:28:03.181622 I | osd3: 2017-07-11 13:28:03.181510 7f83cb467700 -1 osd.3 111 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:43.181508)
- 2017-07-11 13:28:04.181749 I | osd3: 2017-07-11 13:28:04.181675 7f83cb467700 -1 osd.3 111 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:44.181673)
- 2017-07-11 13:28:05.181876 I | osd3: 2017-07-11 13:28:05.181803 7f83cb467700 -1 osd.3 111 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:45.181801)
- 2017-07-11 13:28:06.182155 I | osd3: 2017-07-11 13:28:06.182036 7f83cb467700 -1 osd.3 111 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:46.182033)
- 2017-07-11 13:28:07.182360 I | osd3: 2017-07-11 13:28:07.182263 7f83cb467700 -1 osd.3 111 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:47.182261)
- 2017-07-11 13:28:08.182557 I | osd3: 2017-07-11 13:28:08.182479 7f83cb467700 -1 osd.3 111 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:48.182478)
- 2017-07-11 13:28:09.182719 I | osd3: 2017-07-11 13:28:09.182608 7f83cb467700 -1 osd.3 111 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:49.182586)
- 2017-07-11 13:28:10.182960 I | osd3: 2017-07-11 13:28:10.182865 7f83cb467700 -1 osd.3 111 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:50.182863)
- 2017-07-11 13:28:11.183185 I | osd3: 2017-07-11 13:28:11.183107 7f83cb467700 -1 osd.3 112 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:51.183105)
- 2017-07-11 13:28:12.183413 I | osd3: 2017-07-11 13:28:12.183297 7f83cb467700 -1 osd.3 119 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:52.183295)
- 2017-07-11 13:28:13.183589 I | osd3: 2017-07-11 13:28:13.183500 7f83cb467700 -1 osd.3 119 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:53.183498)
- 2017-07-11 13:28:14.183800 I | osd3: 2017-07-11 13:28:14.183732 7f83cb467700 -1 osd.3 119 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:54.183731)
- 2017-07-11 13:28:15.186446 I | osd3: 2017-07-11 13:28:15.186355 7f83cb467700 -1 osd.3 121 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:55.186354)
- 2017-07-11 13:28:16.186598 I | osd3: 2017-07-11 13:28:16.186468 7f83cb467700 -1 osd.3 121 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:27:56.186466)
- 2017-07-11 13:28:16.186727 I | osd3: 2017-07-11 13:28:16.186500 7f83cb467700 -1 osd.3 121 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:56.186466)
- 2017-07-11 13:28:17.186774 I | osd3: 2017-07-11 13:28:17.186668 7f83cb467700 -1 osd.3 123 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:27:57.186667)
- 2017-07-11 13:28:17.186857 I | osd3: 2017-07-11 13:28:17.186691 7f83cb467700 -1 osd.3 123 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:57.186667)
- 2017-07-11 13:28:18.186875 I | osd3: 2017-07-11 13:28:18.186782 7f83cb467700 -1 osd.3 123 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:27:58.186780)
- 2017-07-11 13:28:18.186967 I | osd3: 2017-07-11 13:28:18.186808 7f83cb467700 -1 osd.3 123 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:58.186780)
- 2017-07-11 13:28:19.187068 I | osd3: 2017-07-11 13:28:19.186963 7f83cb467700 -1 osd.3 123 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:27:59.186961)
- 2017-07-11 13:28:19.187131 I | osd3: 2017-07-11 13:28:19.186989 7f83cb467700 -1 osd.3 123 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:27:59.186961)
- 2017-07-11 13:28:20.187240 I | osd3: 2017-07-11 13:28:20.187138 7f83cb467700 -1 osd.3 125 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:00.187137)
- 2017-07-11 13:28:20.187325 I | osd3: 2017-07-11 13:28:20.187168 7f83cb467700 -1 osd.3 125 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:00.187137)
- 2017-07-11 13:28:21.187448 I | osd3: 2017-07-11 13:28:21.187319 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:01.187317)
- 2017-07-11 13:28:21.187546 I | osd3: 2017-07-11 13:28:21.187378 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:01.187317)
- 2017-07-11 13:28:22.187599 I | osd3: 2017-07-11 13:28:22.187520 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:02.187517)
- 2017-07-11 13:28:22.187671 I | osd3: 2017-07-11 13:28:22.187541 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:02.187517)
- 2017-07-11 13:28:23.187769 I | osd3: 2017-07-11 13:28:23.187681 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:03.187679)
- 2017-07-11 13:28:23.187855 I | osd3: 2017-07-11 13:28:23.187709 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:03.187679)
- 2017-07-11 13:28:24.187933 I | osd3: 2017-07-11 13:28:24.187845 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:04.187844)
- 2017-07-11 13:28:24.188016 I | osd3: 2017-07-11 13:28:24.187870 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:04.187844)
- 2017-07-11 13:28:25.188227 I | osd3: 2017-07-11 13:28:25.188033 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:05.188028)
- 2017-07-11 13:28:25.188312 I | osd3: 2017-07-11 13:28:25.188072 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:05.188028)
- 2017-07-11 13:28:26.188425 I | osd3: 2017-07-11 13:28:26.188291 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:06.188289)
- 2017-07-11 13:28:26.188502 I | osd3: 2017-07-11 13:28:26.188330 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:06.188289)
- 2017-07-11 13:28:27.188582 I | osd3: 2017-07-11 13:28:27.188452 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:07.188451)
- 2017-07-11 13:28:27.188663 I | osd3: 2017-07-11 13:28:27.188481 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:07.188451)
- 2017-07-11 13:28:28.188801 I | osd3: 2017-07-11 13:28:28.188659 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:08.188658)
- 2017-07-11 13:28:28.188896 I | osd3: 2017-07-11 13:28:28.188691 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:08.188658)
- 2017-07-11 13:28:29.188962 I | osd3: 2017-07-11 13:28:29.188874 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:09.188872)
- 2017-07-11 13:28:29.189038 I | osd3: 2017-07-11 13:28:29.188901 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:09.188872)
- 2017-07-11 13:28:30.189159 I | osd3: 2017-07-11 13:28:30.189038 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:10.189036)
- 2017-07-11 13:28:30.189234 I | osd3: 2017-07-11 13:28:30.189065 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:10.189036)
- 2017-07-11 13:28:31.189461 I | osd3: 2017-07-11 13:28:31.189309 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:11.189307)
- 2017-07-11 13:28:31.189552 I | osd3: 2017-07-11 13:28:31.189346 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:11.189307)
- 2017-07-11 13:28:32.189657 I | osd3: 2017-07-11 13:28:32.189513 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:12.189512)
- 2017-07-11 13:28:32.189739 I | osd3: 2017-07-11 13:28:32.189540 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:12.189512)
- 2017-07-11 13:28:33.190157 I | osd3: 2017-07-11 13:28:33.190035 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:13.190033)
- 2017-07-11 13:28:33.190246 I | osd3: 2017-07-11 13:28:33.190062 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:13.190033)
- 2017-07-11 13:28:34.190269 I | osd3: 2017-07-11 13:28:34.190181 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:14.190180)
- 2017-07-11 13:28:34.190353 I | osd3: 2017-07-11 13:28:34.190209 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:14.190180)
- 2017-07-11 13:28:35.190410 I | osd3: 2017-07-11 13:28:35.190299 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:15.190298)
- 2017-07-11 13:28:35.190474 I | osd3: 2017-07-11 13:28:35.190327 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:15.190298)
- 2017-07-11 13:28:36.190725 I | osd3: 2017-07-11 13:28:36.190589 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:16.190586)
- 2017-07-11 13:28:36.190841 I | osd3: 2017-07-11 13:28:36.190628 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:16.190586)
- 2017-07-11 13:28:37.190867 I | osd3: 2017-07-11 13:28:37.190770 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:17.190768)
- 2017-07-11 13:28:37.190930 I | osd3: 2017-07-11 13:28:37.190796 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:17.190768)
- 2017-07-11 13:28:38.191084 I | osd3: 2017-07-11 13:28:38.190982 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:18.190981)
- 2017-07-11 13:28:38.191176 I | osd3: 2017-07-11 13:28:38.191010 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:18.190981)
- 2017-07-11 13:28:39.191367 I | osd3: 2017-07-11 13:28:39.191277 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:19.191263)
- 2017-07-11 13:28:39.191431 I | osd3: 2017-07-11 13:28:39.191300 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:19.191263)
- 2017-07-11 13:28:40.191644 I | osd3: 2017-07-11 13:28:40.191555 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:20.191554)
- 2017-07-11 13:28:40.191714 I | osd3: 2017-07-11 13:28:40.191581 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:20.191554)
- 2017-07-11 13:28:41.236681 I | osd3: 2017-07-11 13:28:41.192536 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:21.192535)
- 2017-07-11 13:28:41.244681 I | osd3: 2017-07-11 13:28:41.192563 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:21.192535)
- 2017-07-11 13:28:42.192791 I | osd3: 2017-07-11 13:28:42.192657 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:22.192655)
- 2017-07-11 13:28:42.192911 I | osd3: 2017-07-11 13:28:42.192701 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:22.192655)
- 2017-07-11 13:28:43.192882 I | osd3: 2017-07-11 13:28:43.192793 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:23.192792)
- 2017-07-11 13:28:43.192962 I | osd3: 2017-07-11 13:28:43.192820 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:23.192792)
- 2017-07-11 13:28:44.193122 I | osd3: 2017-07-11 13:28:44.193022 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:24.193020)
- 2017-07-11 13:28:44.193198 I | osd3: 2017-07-11 13:28:44.193038 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:24.193020)
- 2017-07-11 13:28:45.193240 I | osd3: 2017-07-11 13:28:45.193141 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:25.193139)
- 2017-07-11 13:28:45.193259 I | osd3: 2017-07-11 13:28:45.193169 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:25.193139)
- 2017-07-11 13:28:46.193418 I | osd3: 2017-07-11 13:28:46.193287 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.912729 (cutoff 2017-07-11 13:28:26.193286)
- 2017-07-11 13:28:46.193480 I | osd3: 2017-07-11 13:28:46.193314 7f83cb467700 -1 osd.3 126 heartbeat_check: no reply from 10.233.69.0:6803 osd.2 ever on either front or back, first ping sent 2017-07-11 13:27:38.308140 (cutoff 2017-07-11 13:28:26.193286)
- 2017-07-11 13:28:46.811796 I | osd3: 2017-07-11 13:28:46.811740 7f83c8c62700 0 log_channel(cluster) log [WRN] : map e127 wrongly marked me down at e127
- 2017-07-11 13:29:13.197891 I | osd3: 2017-07-11 13:29:13.197737 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:28:53.197736)
- 2017-07-11 13:29:13.197968 I | osd3: 2017-07-11 13:29:13.197765 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:28:53.197736)
- 2017-07-11 13:29:14.198190 I | osd3: 2017-07-11 13:29:14.198098 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:28:54.198096)
- 2017-07-11 13:29:14.198271 I | osd3: 2017-07-11 13:29:14.198125 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:28:54.198096)
- 2017-07-11 13:29:15.198352 I | osd3: 2017-07-11 13:29:15.198249 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:28:55.198247)
- 2017-07-11 13:29:15.198429 I | osd3: 2017-07-11 13:29:15.198276 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:28:55.198247)
- 2017-07-11 13:29:16.198457 I | osd3: 2017-07-11 13:29:16.198363 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:28:56.198361)
- 2017-07-11 13:29:16.198547 I | osd3: 2017-07-11 13:29:16.198394 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:28:56.198361)
- 2017-07-11 13:29:17.198567 I | osd3: 2017-07-11 13:29:17.198478 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:28:57.198476)
- 2017-07-11 13:29:17.198650 I | osd3: 2017-07-11 13:29:17.198505 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:28:57.198476)
- 2017-07-11 13:29:18.198772 I | osd3: 2017-07-11 13:29:18.198672 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:28:58.198670)
- 2017-07-11 13:29:18.198860 I | osd3: 2017-07-11 13:29:18.198701 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:28:58.198670)
- 2017-07-11 13:29:19.198980 I | osd3: 2017-07-11 13:29:19.198845 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:28:59.198843)
- 2017-07-11 13:29:19.199057 I | osd3: 2017-07-11 13:29:19.198883 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:28:59.198843)
- 2017-07-11 13:29:20.199107 I | osd3: 2017-07-11 13:29:20.199016 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:00.199015)
- 2017-07-11 13:29:20.199189 I | osd3: 2017-07-11 13:29:20.199044 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:00.199015)
- 2017-07-11 13:29:21.199284 I | osd3: 2017-07-11 13:29:21.199163 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:01.199162)
- 2017-07-11 13:29:21.199352 I | osd3: 2017-07-11 13:29:21.199190 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:01.199162)
- 2017-07-11 13:29:22.199534 I | osd3: 2017-07-11 13:29:22.199395 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:02.199394)
- 2017-07-11 13:29:22.199639 I | osd3: 2017-07-11 13:29:22.199423 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:02.199394)
- 2017-07-11 13:29:23.199702 I | osd3: 2017-07-11 13:29:23.199605 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:03.199603)
- 2017-07-11 13:29:23.199783 I | osd3: 2017-07-11 13:29:23.199631 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:03.199603)
- 2017-07-11 13:29:24.199890 I | osd3: 2017-07-11 13:29:24.199793 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:04.199791)
- 2017-07-11 13:29:24.199976 I | osd3: 2017-07-11 13:29:24.199822 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:04.199791)
- 2017-07-11 13:29:25.200109 I | osd3: 2017-07-11 13:29:25.199971 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:05.199969)
- 2017-07-11 13:29:25.200236 I | osd3: 2017-07-11 13:29:25.200012 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:05.199969)
- 2017-07-11 13:29:26.200263 I | osd3: 2017-07-11 13:29:26.200129 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:06.200126)
- 2017-07-11 13:29:26.200371 I | osd3: 2017-07-11 13:29:26.200168 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:06.200126)
- 2017-07-11 13:29:27.200376 I | osd3: 2017-07-11 13:29:27.200291 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:07.200290)
- 2017-07-11 13:29:27.200461 I | osd3: 2017-07-11 13:29:27.200316 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:07.200290)
- 2017-07-11 13:29:28.200748 I | osd3: 2017-07-11 13:29:28.200610 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:08.200608)
- 2017-07-11 13:29:28.200836 I | osd3: 2017-07-11 13:29:28.200642 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:08.200608)
- 2017-07-11 13:29:29.200930 I | osd3: 2017-07-11 13:29:29.200840 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:09.200839)
- 2017-07-11 13:29:29.201015 I | osd3: 2017-07-11 13:29:29.200866 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:09.200839)
- 2017-07-11 13:29:30.201217 I | osd3: 2017-07-11 13:29:30.201000 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:10.200998)
- 2017-07-11 13:29:30.201300 I | osd3: 2017-07-11 13:29:30.201028 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:10.200998)
- 2017-07-11 13:29:30.201316 I | osd3: 2017-07-11 13:29:30.201031 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:09.344990 front 2017-07-11 13:29:09.344990 (cutoff 2017-07-11 13:29:10.200998)
- 2017-07-11 13:29:31.201398 I | osd3: 2017-07-11 13:29:31.201243 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:11.201242)
- 2017-07-11 13:29:31.201509 I | osd3: 2017-07-11 13:29:31.201271 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:11.201242)
- 2017-07-11 13:29:31.201536 I | osd3: 2017-07-11 13:29:31.201275 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:09.344990 front 2017-07-11 13:29:09.344990 (cutoff 2017-07-11 13:29:11.201242)
- 2017-07-11 13:29:32.201701 I | osd3: 2017-07-11 13:29:32.201497 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:12.201495)
- 2017-07-11 13:29:32.201825 I | osd3: 2017-07-11 13:29:32.201537 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:12.201495)
- 2017-07-11 13:29:32.201984 I | osd3: 2017-07-11 13:29:32.201545 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:09.344990 front 2017-07-11 13:29:09.344990 (cutoff 2017-07-11 13:29:12.201495)
- 2017-07-11 13:29:33.201837 I | osd3: 2017-07-11 13:29:33.201739 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:13.201738)
- 2017-07-11 13:29:33.201920 I | osd3: 2017-07-11 13:29:33.201765 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:13.201738)
- 2017-07-11 13:29:33.201937 I | osd3: 2017-07-11 13:29:33.201769 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:09.344990 front 2017-07-11 13:29:09.344990 (cutoff 2017-07-11 13:29:13.201738)
- 2017-07-11 13:29:34.202133 I | osd3: 2017-07-11 13:29:34.201925 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:14.201923)
- 2017-07-11 13:29:34.202215 I | osd3: 2017-07-11 13:29:34.201966 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:14.201923)
- 2017-07-11 13:29:34.202233 I | osd3: 2017-07-11 13:29:34.201973 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:09.344990 front 2017-07-11 13:29:09.344990 (cutoff 2017-07-11 13:29:14.201923)
- 2017-07-11 13:29:35.202285 I | osd3: 2017-07-11 13:29:35.202158 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:15.202156)
- 2017-07-11 13:29:35.202353 I | osd3: 2017-07-11 13:29:35.202185 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:15.202156)
- 2017-07-11 13:29:35.202368 I | osd3: 2017-07-11 13:29:35.202189 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:09.344990 front 2017-07-11 13:29:09.344990 (cutoff 2017-07-11 13:29:15.202156)
- 2017-07-11 13:29:36.202876 I | osd3: 2017-07-11 13:29:36.202704 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:16.202702)
- 2017-07-11 13:29:36.202963 I | osd3: 2017-07-11 13:29:36.202733 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:16.202702)
- 2017-07-11 13:29:36.202980 I | osd3: 2017-07-11 13:29:36.202738 7f83cb467700 -1 osd.3 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:09.344990 front 2017-07-11 13:29:09.344990 (cutoff 2017-07-11 13:29:16.202702)
- 2017-07-11 13:29:37.203103 I | osd3: 2017-07-11 13:29:37.202992 7f83cb467700 -1 osd.3 132 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:17.202991)
- 2017-07-11 13:29:37.203193 I | osd3: 2017-07-11 13:29:37.203032 7f83cb467700 -1 osd.3 132 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:17.202991)
- 2017-07-11 13:29:38.203291 I | osd3: 2017-07-11 13:29:38.203202 7f83cb467700 -1 osd.3 132 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:18.203198)
- 2017-07-11 13:29:38.203360 I | osd3: 2017-07-11 13:29:38.203229 7f83cb467700 -1 osd.3 132 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:18.203198)
- 2017-07-11 13:29:39.203543 I | osd3: 2017-07-11 13:29:39.203398 7f83cb467700 -1 osd.3 132 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:19.203396)
- 2017-07-11 13:29:39.203620 I | osd3: 2017-07-11 13:29:39.203420 7f83cb467700 -1 osd.3 132 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:19.203396)
- 2017-07-11 13:29:39.203636 I | osd3: 2017-07-11 13:29:39.203423 7f83cb467700 -1 osd.3 132 heartbeat_check: no reply from 10.233.124.4:6805 osd.4 since back 2017-07-11 13:29:18.645974 front 2017-07-11 13:29:18.645974 (cutoff 2017-07-11 13:29:19.203396)
- 2017-07-11 13:29:40.212347 I | osd3: 2017-07-11 13:29:40.208656 7f83cb467700 -1 osd.3 132 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:20.208655)
- 2017-07-11 13:29:40.228028 I | osd3: 2017-07-11 13:29:40.208683 7f83cb467700 -1 osd.3 132 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:20.208655)
- 2017-07-11 13:29:40.228051 I | osd3: 2017-07-11 13:29:40.208686 7f83cb467700 -1 osd.3 132 heartbeat_check: no reply from 10.233.124.4:6805 osd.4 since back 2017-07-11 13:29:18.645974 front 2017-07-11 13:29:18.645974 (cutoff 2017-07-11 13:29:20.208655)
- 2017-07-11 13:29:41.209181 I | osd3: 2017-07-11 13:29:41.209030 7f83cb467700 -1 osd.3 132 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:21.209028)
- 2017-07-11 13:29:41.209292 I | osd3: 2017-07-11 13:29:41.209069 7f83cb467700 -1 osd.3 132 heartbeat_check: no reply from 10.233.69.0:6806 osd.2 ever on either front or back, first ping sent 2017-07-11 13:28:52.943391 (cutoff 2017-07-11 13:29:21.209028)
- 2017-07-11 13:29:41.209316 I | osd3: 2017-07-11 13:29:41.209077 7f83cb467700 -1 osd.3 132 heartbeat_check: no reply from 10.233.124.4:6805 osd.4 since back 2017-07-11 13:29:18.645974 front 2017-07-11 13:29:18.645974 (cutoff 2017-07-11 13:29:21.209028)
- 2017-07-11 13:29:41.699638 I | osd3: 2017-07-11 13:29:41.699495 7f83c8c62700 0 log_channel(cluster) log [WRN] : map e133 wrongly marked me down at e133
- END logs from pod: rook-ceph-osd-jl0pk
- BEGIN logs from pod: rook-ceph-osd-zzkmt
- 2017-07-11 13:24:20.317870 I | cephmon: parsing mon endpoints: rook-ceph-mon1=10.233.99.4:6790,rook-ceph-mon2=10.233.124.3:6790,rook-ceph-mon0=10.233.76.3:6790
- 2017-07-11 13:24:20.318285 I | cephmon: writing config file /var/lib/rook/rook/rook.config
- 2017-07-11 13:24:20.318457 I | cephmon: generated admin config in /var/lib/rook/rook
- 2017-07-11 13:24:20.318492 I | cephosd: discovering hardware
- 2017-07-11 13:24:20.318518 I | exec: Running command: lsblk --all --noheadings --list --output KNAME
- 2017-07-11 13:24:20.326241 I | exec: Running command: lsblk /dev/fd0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.327361 I | exec: Running command: sgdisk --print /dev/fd0
- 2017-07-11 13:24:20.383743 W | inventory: skipping device fd0 with an unknown uuid. Failed to complete get disk fd0 uuid: exit status 2
- 2017-07-11 13:24:20.383801 I | exec: Running command: lsblk /dev/loop0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.385578 I | exec: Running command: lsblk /dev/loop1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.401792 I | exec: Running command: lsblk /dev/loop2 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.402981 I | exec: Running command: lsblk /dev/loop3 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.404187 I | exec: Running command: lsblk /dev/loop4 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.420534 I | exec: Running command: lsblk /dev/loop5 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.421812 I | exec: Running command: lsblk /dev/loop6 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.423073 I | exec: Running command: lsblk /dev/loop7 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.430167 I | exec: Running command: lsblk /dev/sda --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.431583 I | exec: Running command: sgdisk --print /dev/sda
- 2017-07-11 13:24:20.442330 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:20.449175 I | exec: Running command: lsblk /dev/sda1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.450633 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:20.451589 I | exec: Running command: lsblk /dev/sdb --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.469024 I | exec: Running command: sgdisk --print /dev/sdb
- 2017-07-11 13:24:20.471738 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:20.489191 I | exec: Running command: lsblk /dev/sdb1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.490682 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:20.491704 I | exec: Running command: lsblk /dev/sr0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
- 2017-07-11 13:24:20.500254 I | cephosd: creating and starting the osds
- 2017-07-11 13:24:20.500269 I | exec: Running command: lsblk /dev/sda --bytes --pairs --output NAME,SIZE,TYPE,PKNAME
- 2017-07-11 13:24:20.501826 I | exec: Running command: blkid /dev/sda1 -s PARTLABEL -o value
- 2017-07-11 13:24:20.513239 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:20.532228 I | cephosd: skipping device sda that is in use (not by rook). fs: ext4, ownPartitions: false
- 2017-07-11 13:24:20.532254 I | exec: Running command: lsblk /dev/sdb --bytes --pairs --output NAME,SIZE,TYPE,PKNAME
- 2017-07-11 13:24:20.549860 I | exec: Running command: blkid /dev/sdb1 -s PARTLABEL -o value
- 2017-07-11 13:24:20.551895 I | exec: Running command: df --output=source,fstype
- 2017-07-11 13:24:20.568528 I | cephosd: skipping device sdb that is in use (not by rook). fs: , ownPartitions: false
- 2017-07-11 13:24:20.568597 I | cephosd: configuring osd devices: &{Entries:map[]}
- 2017-07-11 13:24:20.568672 I | cephosd: configuring osd dirs: map[/var/lib/rook:-1]
- 2017-07-11 13:24:20.568868 I | exec: Running command: ceph osd create 0623e5ff-56df-42b2-b682-76e1b77cba81 --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/355764192
- 2017-07-11 13:24:22.397775 I | cephosd: successfully created OSD 0623e5ff-56df-42b2-b682-76e1b77cba81 with ID 2
- 2017-07-11 13:24:22.403987 I | cephmon: writing config file /var/lib/rook/osd2/rook.config
- 2017-07-11 13:24:22.404220 I | exec: Running command: ceph mon getmap --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/408256959
- 2017-07-11 13:24:22.858210 I | exec: got monmap epoch 3
- 2017-07-11 13:24:22.858398 I | cephosd: Initializing OSD 2 file system at /var/lib/rook/osd2...
- 2017-07-11 13:24:22.858606 I | proc: Running process ceph-osd with args: [--mkfs --mkkey --id=2 --cluster=rook --conf=/var/lib/rook/osd2/rook.config --osd-data=/var/lib/rook/osd2 --osd-uuid=0623e5ff-56df-42b2-b682-76e1b77cba81 --monmap=/var/lib/rook/osd2/tmp/activate.monmap --osd-journal=/var/lib/rook/osd2/journal --keyring=/var/lib/rook/osd2/keyring]
- 2017-07-11 13:24:22.858654 I | exec: Running command: ceph-osd --mkfs --mkkey --id=2 --cluster=rook --conf=/var/lib/rook/osd2/rook.config --osd-data=/var/lib/rook/osd2 --osd-uuid=0623e5ff-56df-42b2-b682-76e1b77cba81 --monmap=/var/lib/rook/osd2/tmp/activate.monmap --osd-journal=/var/lib/rook/osd2/journal --keyring=/var/lib/rook/osd2/keyring
- 2017-07-11 13:24:22.887577 I | mkfs-osd2: 2017-07-11 13:24:22.887526 7f6ec6a65c80 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 86
- 2017-07-11 13:24:23.231087 I | mkfs-osd2: 2017-07-11 13:24:23.231030 7f6ec6a65c80 0 filestore(/var/lib/rook/osd2) backend generic (magic 0xef53)
- 2017-07-11 13:24:23.373044 I | mkfs-osd2: 2017-07-11 13:24:23.373008 7f6ec6a65c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:23.498800 I | mkfs-osd2: 2017-07-11 13:24:23.498748 7f6ec6a65c80 0 filestore(/var/lib/rook/osd2) mkjournal(1061): created journal on /var/lib/rook/osd2/journal
- 2017-07-11 13:24:23.533309 I | mkfs-osd2: 2017-07-11 13:24:23.533285 7f6ec6a65c80 0 filestore(/var/lib/rook/osd2) backend generic (magic 0xef53)
- 2017-07-11 13:24:23.533622 I | mkfs-osd2: 2017-07-11 13:24:23.533600 7f6ec6a65c80 0 genericfilestorebackend(/var/lib/rook/osd2) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
- 2017-07-11 13:24:23.533672 I | mkfs-osd2: 2017-07-11 13:24:23.533657 7f6ec6a65c80 0 genericfilestorebackend(/var/lib/rook/osd2) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option
- 2017-07-11 13:24:23.533699 I | mkfs-osd2: 2017-07-11 13:24:23.533688 7f6ec6a65c80 0 genericfilestorebackend(/var/lib/rook/osd2) detect_features: splice() is disabled via 'filestore splice' config option
- 2017-07-11 13:24:23.572786 I | mkfs-osd2: 2017-07-11 13:24:23.572743 7f6ec6a65c80 0 genericfilestorebackend(/var/lib/rook/osd2) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
- 2017-07-11 13:24:23.819107 I | mkfs-osd2: 2017-07-11 13:24:23.819078 7f6ec6a65c80 0 filestore(/var/lib/rook/osd2) limited size xattrs
- 2017-07-11 13:24:23.819364 I | mkfs-osd2: 2017-07-11 13:24:23.819339 7f6ec6a65c80 0 filestore(/var/lib/rook/osd2) start omap initiation
- 2017-07-11 13:24:23.819595 I | mkfs-osd2: 2017-07-11 13:24:23.819558 7f6ec6a65c80 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:24:23.819624 I | mkfs-osd2:
- 2017-07-11 13:24:23.819667 I | mkfs-osd2: 2017-07-11 13:24:23.819638 7f6ec6a65c80 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:24:23.819699 I | mkfs-osd2: 2017-07-11 13:24:23.819684 7f6ec6a65c80 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:24:23.819726 I | mkfs-osd2: 2017-07-11 13:24:23.819714 7f6ec6a65c80 4 rocksdb: DB SUMMARY
- 2017-07-11 13:24:23.819753 I | mkfs-osd2:
- 2017-07-11 13:24:23.819826 I | mkfs-osd2: 2017-07-11 13:24:23.819797 7f6ec6a65c80 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:24:23.819840 I | mkfs-osd2:
- 2017-07-11 13:24:23.819863 I | mkfs-osd2: 2017-07-11 13:24:23.819852 7f6ec6a65c80 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:24:23.819875 I | mkfs-osd2:
- 2017-07-11 13:24:23.819917 I | mkfs-osd2: 2017-07-11 13:24:23.819903 7f6ec6a65c80 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes
- 2017-07-11 13:24:23.819932 I | mkfs-osd2:
- 2017-07-11 13:24:23.819956 I | mkfs-osd2: 2017-07-11 13:24:23.819945 7f6ec6a65c80 4 rocksdb: SST files in /var/lib/rook/osd2/current/omap dir, Total Num: 0, files:
- 2017-07-11 13:24:23.819981 I | mkfs-osd2:
- 2017-07-11 13:24:23.820023 I | mkfs-osd2: 2017-07-11 13:24:23.820010 7f6ec6a65c80 4 rocksdb: Write Ahead Log file in /var/lib/rook/osd2/current/omap: 000003.log size: 0 ;
- 2017-07-11 13:24:23.820036 I | mkfs-osd2:
- 2017-07-11 13:24:23.820074 I | mkfs-osd2: 2017-07-11 13:24:23.820062 7f6ec6a65c80 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:24:23.820102 I | mkfs-osd2: 2017-07-11 13:24:23.820091 7f6ec6a65c80 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:24:23.820140 I | mkfs-osd2: 2017-07-11 13:24:23.820115 7f6ec6a65c80 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:24:23.820188 I | mkfs-osd2: 2017-07-11 13:24:23.820165 7f6ec6a65c80 4 rocksdb: Options.env: 0x55cd84d538e0
- 2017-07-11 13:24:23.820233 I | mkfs-osd2: 2017-07-11 13:24:23.820220 7f6ec6a65c80 4 rocksdb: Options.info_log: 0x55cd8667f4a0
- 2017-07-11 13:24:23.820260 I | mkfs-osd2: 2017-07-11 13:24:23.820249 7f6ec6a65c80 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:24:23.820300 I | mkfs-osd2: 2017-07-11 13:24:23.820274 7f6ec6a65c80 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:24:23.820327 I | mkfs-osd2: 2017-07-11 13:24:23.820316 7f6ec6a65c80 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:24:23.820352 I | mkfs-osd2: 2017-07-11 13:24:23.820341 7f6ec6a65c80 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:24:23.820391 I | mkfs-osd2: 2017-07-11 13:24:23.820379 7f6ec6a65c80 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:24:23.820417 I | mkfs-osd2: 2017-07-11 13:24:23.820406 7f6ec6a65c80 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:24:23.820456 I | mkfs-osd2: 2017-07-11 13:24:23.820431 7f6ec6a65c80 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:24:23.820494 I | mkfs-osd2: 2017-07-11 13:24:23.820471 7f6ec6a65c80 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:24:23.820548 I | mkfs-osd2: 2017-07-11 13:24:23.820536 7f6ec6a65c80 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:24:23.820571 I | mkfs-osd2: 2017-07-11 13:24:23.820562 7f6ec6a65c80 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:24:23.820605 I | mkfs-osd2: 2017-07-11 13:24:23.820583 7f6ec6a65c80 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:24:23.820630 I | mkfs-osd2: 2017-07-11 13:24:23.820620 7f6ec6a65c80 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:24:23.820658 I | mkfs-osd2: 2017-07-11 13:24:23.820648 7f6ec6a65c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:24:23.820695 I | mkfs-osd2: 2017-07-11 13:24:23.820684 7f6ec6a65c80 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:24:23.820718 I | mkfs-osd2: 2017-07-11 13:24:23.820708 7f6ec6a65c80 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:24:23.820740 I | mkfs-osd2: 2017-07-11 13:24:23.820730 7f6ec6a65c80 4 rocksdb: Options.wal_dir: /var/lib/rook/osd2/current/omap
- 2017-07-11 13:24:23.820776 I | mkfs-osd2: 2017-07-11 13:24:23.820766 7f6ec6a65c80 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:24:23.820799 I | mkfs-osd2: 2017-07-11 13:24:23.820790 7f6ec6a65c80 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:24:23.820821 I | mkfs-osd2: 2017-07-11 13:24:23.820812 7f6ec6a65c80 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:24:23.820859 I | mkfs-osd2: 2017-07-11 13:24:23.820848 7f6ec6a65c80 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:24:23.820881 I | mkfs-osd2: 2017-07-11 13:24:23.820872 7f6ec6a65c80 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:24:23.820915 I | mkfs-osd2: 2017-07-11 13:24:23.820893 7f6ec6a65c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:24:23.820939 I | mkfs-osd2: 2017-07-11 13:24:23.820928 7f6ec6a65c80 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:24:23.820961 I | mkfs-osd2: 2017-07-11 13:24:23.820952 7f6ec6a65c80 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:24:23.821000 I | mkfs-osd2: 2017-07-11 13:24:23.820976 7f6ec6a65c80 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:24:23.821023 I | mkfs-osd2: 2017-07-11 13:24:23.821013 7f6ec6a65c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:24:23.821045 I | mkfs-osd2: 2017-07-11 13:24:23.821035 7f6ec6a65c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:24:23.821079 I | mkfs-osd2: 2017-07-11 13:24:23.821069 7f6ec6a65c80 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:24:23.821117 I | mkfs-osd2: 2017-07-11 13:24:23.821093 7f6ec6a65c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:24:23.821154 I | mkfs-osd2: 2017-07-11 13:24:23.821130 7f6ec6a65c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:24:23.821178 I | mkfs-osd2: 2017-07-11 13:24:23.821168 7f6ec6a65c80 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:24:23.821202 I | mkfs-osd2: 2017-07-11 13:24:23.821192 7f6ec6a65c80 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:24:23.821241 I | mkfs-osd2: 2017-07-11 13:24:23.821230 7f6ec6a65c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:24:23.821277 I | mkfs-osd2: 2017-07-11 13:24:23.821255 7f6ec6a65c80 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:24:23.821329 I | mkfs-osd2: 2017-07-11 13:24:23.821317 7f6ec6a65c80 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:24:23.821353 I | mkfs-osd2: 2017-07-11 13:24:23.821343 7f6ec6a65c80 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:24:23.821392 I | mkfs-osd2: 2017-07-11 13:24:23.821380 7f6ec6a65c80 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:24:23.821418 I | mkfs-osd2: 2017-07-11 13:24:23.821408 7f6ec6a65c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:24:23.821442 I | mkfs-osd2: 2017-07-11 13:24:23.821432 7f6ec6a65c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:24:23.821483 I | mkfs-osd2: 2017-07-11 13:24:23.821471 7f6ec6a65c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:24:23.821515 I | mkfs-osd2: 2017-07-11 13:24:23.821504 7f6ec6a65c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:24:23.821556 I | mkfs-osd2: 2017-07-11 13:24:23.821544 7f6ec6a65c80 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:24:23.821582 I | mkfs-osd2: 2017-07-11 13:24:23.821571 7f6ec6a65c80 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:24:23.821642 I | mkfs-osd2: 2017-07-11 13:24:23.821631 7f6ec6a65c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:24:23.821668 I | mkfs-osd2: 2017-07-11 13:24:23.821656 7f6ec6a65c80 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:24:23.821703 I | mkfs-osd2: 2017-07-11 13:24:23.821680 7f6ec6a65c80 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:24:23.821727 I | mkfs-osd2: 2017-07-11 13:24:23.821717 7f6ec6a65c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:24:23.821749 I | mkfs-osd2: 2017-07-11 13:24:23.821739 7f6ec6a65c80 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:24:23.821783 I | mkfs-osd2: 2017-07-11 13:24:23.821773 7f6ec6a65c80 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:24:23.821807 I | mkfs-osd2: 2017-07-11 13:24:23.821797 7f6ec6a65c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:24:23.821831 I | mkfs-osd2: 2017-07-11 13:24:23.821822 7f6ec6a65c80 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:24:23.821868 I | mkfs-osd2: 2017-07-11 13:24:23.821857 7f6ec6a65c80 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:24:23.821893 I | mkfs-osd2: 2017-07-11 13:24:23.821881 7f6ec6a65c80 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:24:23.821928 I | mkfs-osd2: 2017-07-11 13:24:23.821906 7f6ec6a65c80 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:24:23.821953 I | mkfs-osd2: 2017-07-11 13:24:23.821942 7f6ec6a65c80 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:24:23.821975 I | mkfs-osd2: 2017-07-11 13:24:23.821965 7f6ec6a65c80 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:24:23.822019 I | mkfs-osd2: 2017-07-11 13:24:23.821988 7f6ec6a65c80 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:24:23.822047 I | mkfs-osd2: 2017-07-11 13:24:23.822037 7f6ec6a65c80 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:24:23.822583 I | mkfs-osd2: 2017-07-11 13:24:23.822563 7f6ec6a65c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001
- 2017-07-11 13:24:23.822618 I | mkfs-osd2:
- 2017-07-11 13:24:23.822800 I | mkfs-osd2: 2017-07-11 13:24:23.822744 7f6ec6a65c80 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:24:23.822818 I | mkfs-osd2:
- 2017-07-11 13:24:23.822859 I | mkfs-osd2: 2017-07-11 13:24:23.822845 7f6ec6a65c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:24:23.822884 I | mkfs-osd2: 2017-07-11 13:24:23.822874 7f6ec6a65c80 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:24:23.822907 I | mkfs-osd2: 2017-07-11 13:24:23.822898 7f6ec6a65c80 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:24:23.822946 I | mkfs-osd2: 2017-07-11 13:24:23.822935 7f6ec6a65c80 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:24:23.822968 I | mkfs-osd2: 2017-07-11 13:24:23.822959 7f6ec6a65c80 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:24:23.823004 I | mkfs-osd2: 2017-07-11 13:24:23.822981 7f6ec6a65c80 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:24:23.823048 I | mkfs-osd2: 2017-07-11 13:24:23.823032 7f6ec6a65c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cd864ae218)
- 2017-07-11 13:24:23.823061 I | mkfs-osd2: cache_index_and_filter_blocks: 0
- 2017-07-11 13:24:23.823086 I | mkfs-osd2: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:24:23.823098 I | mkfs-osd2: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:24:23.823108 I | mkfs-osd2: index_type: 0
- 2017-07-11 13:24:23.823118 I | mkfs-osd2: hash_index_allow_collision: 1
- 2017-07-11 13:24:23.823129 I | mkfs-osd2: checksum: 1
- 2017-07-11 13:24:23.823138 I | mkfs-osd2: no_block_cache: 0
- 2017-07-11 13:24:23.823161 I | mkfs-osd2: block_cache: 0x55cd864d4380
- 2017-07-11 13:24:23.823171 I | mkfs-osd2: block_cache_name: LRUCache
- 2017-07-11 13:24:23.823180 I | mkfs-osd2: block_cache_options:
- 2017-07-11 13:24:23.823192 I | mkfs-osd2: capacity : 107374182
- 2017-07-11 13:24:23.823202 I | mkfs-osd2: num_shard_bits : 4
- 2017-07-11 13:24:23.823211 I | mkfs-osd2: strict_capacity_limit : 0
- 2017-07-11 13:24:23.823232 I | mkfs-osd2: high_pri_pool_ratio: 0.000
- 2017-07-11 13:24:23.823243 I | mkfs-osd2: block_cache_compressed: (nil)
- 2017-07-11 13:24:23.823252 I | mkfs-osd2: persistent_cache: (nil)
- 2017-07-11 13:24:23.823262 I | mkfs-osd2: block_size: 4096
- 2017-07-11 13:24:23.823271 I | mkfs-osd2: block_size_deviation: 10
- 2017-07-11 13:24:23.823281 I | mkfs-osd2: block_restart_interval: 16
- 2017-07-11 13:24:23.823291 I | mkfs-osd2: index_block_restart_interval: 1
- 2017-07-11 13:24:23.823335 I | mkfs-osd2: filter_policy: nullptr
- 2017-07-11 13:24:23.823346 I | mkfs-osd2: whole_key_filtering: 1
- 2017-07-11 13:24:23.823357 I | mkfs-osd2: format_version: 2
- 2017-07-11 13:24:23.823367 I | mkfs-osd2:
- 2017-07-11 13:24:23.823406 I | mkfs-osd2: 2017-07-11 13:24:23.823380 7f6ec6a65c80 4 rocksdb: Options.write_buffer_size: 67108864
- 2017-07-11 13:24:23.823432 I | mkfs-osd2: 2017-07-11 13:24:23.823422 7f6ec6a65c80 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:24:23.823493 I | mkfs-osd2: 2017-07-11 13:24:23.823446 7f6ec6a65c80 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:24:23.823554 I | mkfs-osd2: 2017-07-11 13:24:23.823527 7f6ec6a65c80 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:24:23.823582 I | mkfs-osd2: 2017-07-11 13:24:23.823570 7f6ec6a65c80 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:24:23.823607 I | mkfs-osd2: 2017-07-11 13:24:23.823596 7f6ec6a65c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:24:23.823646 I | mkfs-osd2: 2017-07-11 13:24:23.823634 7f6ec6a65c80 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:24:23.823671 I | mkfs-osd2: 2017-07-11 13:24:23.823661 7f6ec6a65c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:24:23.823713 I | mkfs-osd2: 2017-07-11 13:24:23.823688 7f6ec6a65c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:24:23.823746 I | mkfs-osd2: 2017-07-11 13:24:23.823734 7f6ec6a65c80 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:24:23.829764 I | mkfs-osd2: 2017-07-11 13:24:23.823761 7f6ec6a65c80 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:24:23.829832 I | mkfs-osd2: 2017-07-11 13:24:23.829814 7f6ec6a65c80 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:24:23.829863 I | mkfs-osd2: 2017-07-11 13:24:23.829851 7f6ec6a65c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:24:23.829902 I | mkfs-osd2: 2017-07-11 13:24:23.829890 7f6ec6a65c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:24:23.829927 I | mkfs-osd2: 2017-07-11 13:24:23.829917 7f6ec6a65c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:24:23.829963 I | mkfs-osd2: 2017-07-11 13:24:23.829941 7f6ec6a65c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:24:23.829989 I | mkfs-osd2: 2017-07-11 13:24:23.829978 7f6ec6a65c80 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:24:23.830038 I | mkfs-osd2: 2017-07-11 13:24:23.830023 7f6ec6a65c80 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:24:23.830066 I | mkfs-osd2: 2017-07-11 13:24:23.830055 7f6ec6a65c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:24:23.830103 I | mkfs-osd2: 2017-07-11 13:24:23.830090 7f6ec6a65c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:24:23.830129 I | mkfs-osd2: 2017-07-11 13:24:23.830117 7f6ec6a65c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:24:23.830168 I | mkfs-osd2: 2017-07-11 13:24:23.830146 7f6ec6a65c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:24:23.830209 I | mkfs-osd2: 2017-07-11 13:24:23.830184 7f6ec6a65c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:24:23.830247 I | mkfs-osd2: 2017-07-11 13:24:23.830224 7f6ec6a65c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:24:23.830275 I | mkfs-osd2: 2017-07-11 13:24:23.830263 7f6ec6a65c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:24:23.830300 I | mkfs-osd2: 2017-07-11 13:24:23.830289 7f6ec6a65c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:24:23.830341 I | mkfs-osd2: 2017-07-11 13:24:23.830328 7f6ec6a65c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:24:23.830367 I | mkfs-osd2: 2017-07-11 13:24:23.830357 7f6ec6a65c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:24:23.830403 I | mkfs-osd2: 2017-07-11 13:24:23.830381 7f6ec6a65c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:24:23.830430 I | mkfs-osd2: 2017-07-11 13:24:23.830418 7f6ec6a65c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:24:23.830455 I | mkfs-osd2: 2017-07-11 13:24:23.830445 7f6ec6a65c80 4 rocksdb: Options.arena_block_size: 8388608
- 2017-07-11 13:24:23.830493 I | mkfs-osd2: 2017-07-11 13:24:23.830480 7f6ec6a65c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:24:23.830529 I | mkfs-osd2: 2017-07-11 13:24:23.830519 7f6ec6a65c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:24:23.830562 I | mkfs-osd2: 2017-07-11 13:24:23.830541 7f6ec6a65c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:24:23.830586 I | mkfs-osd2: 2017-07-11 13:24:23.830576 7f6ec6a65c80 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:24:23.830610 I | mkfs-osd2: 2017-07-11 13:24:23.830600 7f6ec6a65c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:24:23.830644 I | mkfs-osd2: 2017-07-11 13:24:23.830633 7f6ec6a65c80 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:24:23.830667 I | mkfs-osd2: 2017-07-11 13:24:23.830658 7f6ec6a65c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:24:23.830690 I | mkfs-osd2: 2017-07-11 13:24:23.830680 7f6ec6a65c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:24:23.830724 I | mkfs-osd2: 2017-07-11 13:24:23.830713 7f6ec6a65c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:24:23.830750 I | mkfs-osd2: 2017-07-11 13:24:23.830740 7f6ec6a65c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:24:23.830772 I | mkfs-osd2: 2017-07-11 13:24:23.830762 7f6ec6a65c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:24:23.830807 I | mkfs-osd2: 2017-07-11 13:24:23.830795 7f6ec6a65c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:24:23.830830 I | mkfs-osd2: 2017-07-11 13:24:23.830820 7f6ec6a65c80 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:24:23.830852 I | mkfs-osd2: 2017-07-11 13:24:23.830843 7f6ec6a65c80 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:24:23.830887 I | mkfs-osd2: 2017-07-11 13:24:23.830876 7f6ec6a65c80 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:24:23.830911 I | mkfs-osd2: 2017-07-11 13:24:23.830900 7f6ec6a65c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:24:23.830944 I | mkfs-osd2: 2017-07-11 13:24:23.830923 7f6ec6a65c80 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:24:23.830970 I | mkfs-osd2: 2017-07-11 13:24:23.830959 7f6ec6a65c80 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:24:23.830992 I | mkfs-osd2: 2017-07-11 13:24:23.830982 7f6ec6a65c80 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:24:23.831024 I | mkfs-osd2: 2017-07-11 13:24:23.831004 7f6ec6a65c80 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:24:23.831050 I | mkfs-osd2: 2017-07-11 13:24:23.831038 7f6ec6a65c80 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:24:23.831073 I | mkfs-osd2: 2017-07-11 13:24:23.831064 7f6ec6a65c80 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:24:23.831106 I | mkfs-osd2: 2017-07-11 13:24:23.831085 7f6ec6a65c80 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:24:23.831981 I | mkfs-osd2: 2017-07-11 13:24:23.831753 7f6ec6a65c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/osd2/current/omap/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:24:23.832016 I | mkfs-osd2:
- 2017-07-11 13:24:23.832030 I | mkfs-osd2: 2017-07-11 13:24:23.831760 7f6ec6a65c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 0
- 2017-07-11 13:24:23.832041 I | mkfs-osd2:
- 2017-07-11 13:24:23.832051 I | mkfs-osd2: 2017-07-11 13:24:23.831797 7f6ec6a65c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779463831793, "job": 1, "event": "recovery_started", "log_files": [3]}
- 2017-07-11 13:24:23.832062 I | mkfs-osd2: 2017-07-11 13:24:23.831801 7f6ec6a65c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #3 mode 2
- 2017-07-11 13:24:23.832085 I | mkfs-osd2: 2017-07-11 13:24:23.831856 7f6ec6a65c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 5
- 2017-07-11 13:24:23.832096 I | mkfs-osd2:
- 2017-07-11 13:24:23.956868 I | mkfs-osd2: 2017-07-11 13:24:23.956643 7f6ec6a65c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779463956639, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:24:24.005943 I | mkfs-osd2: 2017-07-11 13:24:24.005893 7f6ec6a65c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55cd86764000
- 2017-07-11 13:24:24.006171 I | mkfs-osd2: 2017-07-11 13:24:24.006142 7f6ec6a65c80 0 filestore(/var/lib/rook/osd2) mount(1717): enabling WRITEAHEAD journal mode: checkpoint is not enabled
- 2017-07-11 13:24:24.006348 I | mkfs-osd2: 2017-07-11 13:24:24.006325 7f6ec6a65c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:24.006880 I | mkfs-osd2: 2017-07-11 13:24:24.006735 7f6ec6a65c80 -1 filestore(/var/lib/rook/osd2) could not find #-1:7b3f43c4:::osd_superblock:0# in index: (2) No such file or directory
- 2017-07-11 13:24:25.518960 I | mkfs-osd2: 2017-07-11 13:24:25.518664 7f6ec6a65c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:217] Shutdown: canceling all background work
- 2017-07-11 13:24:25.519068 I | mkfs-osd2: 2017-07-11 13:24:25.518865 7f6ec6a65c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:343] Shutdown complete
- 2017-07-11 13:24:25.520143 I | mkfs-osd2: 2017-07-11 13:24:25.519374 7f6ec6a65c80 -1 created object store /var/lib/rook/osd2 for osd.2 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:24:25.520216 I | mkfs-osd2: 2017-07-11 13:24:25.519411 7f6ec6a65c80 -1 auth: error reading file: /var/lib/rook/osd2/keyring: can't open /var/lib/rook/osd2/keyring: (2) No such file or directory
- 2017-07-11 13:24:25.520243 I | mkfs-osd2: 2017-07-11 13:24:25.519541 7f6ec6a65c80 -1 created new key in keyring /var/lib/rook/osd2/keyring
- 2017-07-11 13:24:25.521234 I | mkfs-osd2: 2017-07-11 13:24:23.373008 7f6ec6a65c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:25.521283 I | mkfs-osd2: 2017-07-11 13:24:24.006325 7f6ec6a65c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:25.521300 I | mkfs-osd2: 2017-07-11 13:24:24.006735 7f6ec6a65c80 -1 filestore(/var/lib/rook/osd2) could not find #-1:7b3f43c4:::osd_superblock:0# in index: (2) No such file or directory
- 2017-07-11 13:24:25.521313 I | mkfs-osd2: 2017-07-11 13:24:25.519374 7f6ec6a65c80 -1 created object store /var/lib/rook/osd2 for osd.2 fsid 14d33745-7e28-4202-a25a-906da8bffbcf
- 2017-07-11 13:24:25.521325 I | mkfs-osd2: 2017-07-11 13:24:25.519411 7f6ec6a65c80 -1 auth: error reading file: /var/lib/rook/osd2/keyring: can't open /var/lib/rook/osd2/keyring: (2) No such file or directory
- 2017-07-11 13:24:25.521338 I | mkfs-osd2: 2017-07-11 13:24:25.519541 7f6ec6a65c80 -1 created new key in keyring /var/lib/rook/osd2/keyring
- 2017-07-11 13:24:25.521611 I | exec: Running command: ceph auth add osd.2 -i /var/lib/rook/osd2/keyring osd allow * mon allow profile osd --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/116577810
- 2017-07-11 13:24:26.418742 I | exec: added key for osd.2
- 2017-07-11 13:24:26.418934 I | cephosd: adding osd.2 (/var/lib/rook/osd2), bytes: 104022159360, weight: 0.0946, to crush map at 'root=default'
- 2017-07-11 13:24:26.419078 I | exec: Running command: ceph osd crush create-or-move 2 0.0946 root=default --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/444695113
- 2017-07-11 13:24:29.081663 I | exec: create-or-move updating item name 'osd.2' weight 0.0946 at location {root=default} to crush map
- 2017-07-11 13:24:29.081879 I | cephosd: starting osd 2 at /var/lib/rook/osd2
- 2017-07-11 13:24:29.081967 I | cephosd: Config file /var/lib/rook/osd2/rook.config:
- [global]
- enable experimental unrecoverable data corrupting features =
- run dir = /var/lib/rook/osd2
- mon initial members = rook-ceph-mon0 rook-ceph-mon1 rook-ceph-mon2
- log file = /dev/stdout
- mon cluster log file = /dev/stdout
- mon keyvaluedb = rocksdb
- debug default = 0
- debug rados = 0
- debug mon = 0
- debug osd = 0
- debug bluestore = 0
- debug filestore = 0
- debug journal = 0
- debug leveldb = 0
- filestore_omap_backend = rocksdb
- osd pg bits = 11
- osd pgp bits = 11
- osd pool default size = 1
- osd pool default min size = 1
- osd pool default pg num = 100
- osd pool default pgp num = 100
- osd max object name len = 256
- osd max object namespace len = 64
- osd objectstore = filestore
- rbd_default_features = 3
- fatal signal handlers = false
- [osd.2]
- keyring = /var/lib/rook/osd2/keyring
- osd journal size = 1024
- [mon.rook-ceph-mon1]
- name = rook-ceph-mon1
- mon addr = 10.233.99.4:6790
- [mon.rook-ceph-mon2]
- name = rook-ceph-mon2
- mon addr = 10.233.124.3:6790
- [mon.rook-ceph-mon0]
- name = rook-ceph-mon0
- mon addr = 10.233.76.3:6790
- 2017-07-11 13:24:29.082577 I | proc: no existing process found for binary ceph-osd and pattern '--osd-uuid=0623e5ff-56df-42b2-b682-76e1b77cba81'
- 2017-07-11 13:24:29.088498 I | proc: Starting process osd2 with args: [--foreground --id=2 --cluster=rook --osd-data=/var/lib/rook/osd2 --conf=/var/lib/rook/osd2/rook.config --keyring=/var/lib/rook/osd2/keyring --osd-uuid=0623e5ff-56df-42b2-b682-76e1b77cba81 --osd-journal=/var/lib/rook/osd2/journal]
- 2017-07-11 13:24:29.088550 I | exec: Running command: ceph-osd --foreground --id=2 --cluster=rook --osd-data=/var/lib/rook/osd2 --conf=/var/lib/rook/osd2/rook.config --keyring=/var/lib/rook/osd2/keyring --osd-uuid=0623e5ff-56df-42b2-b682-76e1b77cba81 --osd-journal=/var/lib/rook/osd2/journal
- 2017-07-11 13:24:29.088975 I | cephosd: 1/1 osd dirs succeeded on this node
- 2017-07-11 13:24:29.089078 I | sleeping a while to let the osds run...
- 2017-07-11 13:24:29.110609 I | osd2: 2017-07-11 13:24:29.110543 7f3d25d97c80 0 ceph version 322840bc7 (b322840bc716d86b322b7f78c31cc7f9ae42c1a4) luminous (dev), process (unknown), pid 178
- 2017-07-11 13:24:29.111508 I | osd2: starting osd.2 at - osd_data /var/lib/rook/osd2 /var/lib/rook/osd2/journal
- 2017-07-11 13:24:29.118598 I | osd2: 2017-07-11 13:24:29.111800 7f3d25d97c80 0 pidfile_write: ignore empty --pid-file
- 2017-07-11 13:24:29.129505 I | osd2: 2017-07-11 13:24:29.129482 7f3d25d97c80 0 load: jerasure load: lrc load: isa
- 2017-07-11 13:24:29.129782 I | osd2: 2017-07-11 13:24:29.129760 7f3d25d97c80 0 filestore(/var/lib/rook/osd2) backend generic (magic 0xef53)
- 2017-07-11 13:24:29.130284 I | osd2: 2017-07-11 13:24:29.130265 7f3d25d97c80 0 filestore(/var/lib/rook/osd2) backend generic (magic 0xef53)
- 2017-07-11 13:24:29.130547 I | osd2: 2017-07-11 13:24:29.130528 7f3d25d97c80 0 genericfilestorebackend(/var/lib/rook/osd2) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
- 2017-07-11 13:24:29.130602 I | osd2: 2017-07-11 13:24:29.130585 7f3d25d97c80 0 genericfilestorebackend(/var/lib/rook/osd2) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option
- 2017-07-11 13:24:29.130661 I | osd2: 2017-07-11 13:24:29.130630 7f3d25d97c80 0 genericfilestorebackend(/var/lib/rook/osd2) detect_features: splice() is disabled via 'filestore splice' config option
- 2017-07-11 13:24:29.177596 I | osd2: 2017-07-11 13:24:29.177549 7f3d25d97c80 0 genericfilestorebackend(/var/lib/rook/osd2) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
- 2017-07-11 13:24:29.301993 I | osd2: 2017-07-11 13:24:29.301932 7f3d25d97c80 0 filestore(/var/lib/rook/osd2) limited size xattrs
- 2017-07-11 13:24:29.302289 I | osd2: 2017-07-11 13:24:29.302271 7f3d25d97c80 0 filestore(/var/lib/rook/osd2) start omap initiation
- 2017-07-11 13:24:29.302586 I | osd2: 2017-07-11 13:24:29.302554 7f3d25d97c80 4 rocksdb: RocksDB version: 5.4.0
- 2017-07-11 13:24:29.302614 I | osd2:
- 2017-07-11 13:24:29.302646 I | osd2: 2017-07-11 13:24:29.302630 7f3d25d97c80 4 rocksdb: Git sha rocksdb_build_git_sha:@e15382c09c87a65eaeca9bda233bab503f1e5772@
- 2017-07-11 13:24:29.302689 I | osd2: 2017-07-11 13:24:29.302676 7f3d25d97c80 4 rocksdb: Compile date Jul 3 2017
- 2017-07-11 13:24:29.302714 I | osd2: 2017-07-11 13:24:29.302703 7f3d25d97c80 4 rocksdb: DB SUMMARY
- 2017-07-11 13:24:29.302726 I | osd2:
- 2017-07-11 13:24:29.302807 I | osd2: 2017-07-11 13:24:29.302792 7f3d25d97c80 4 rocksdb: CURRENT file: CURRENT
- 2017-07-11 13:24:29.302836 I | osd2:
- 2017-07-11 13:24:29.302973 I | osd2: 2017-07-11 13:24:29.302855 7f3d25d97c80 4 rocksdb: IDENTITY file: IDENTITY
- 2017-07-11 13:24:29.303005 I | osd2:
- 2017-07-11 13:24:29.303043 I | osd2: 2017-07-11 13:24:29.303028 7f3d25d97c80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes
- 2017-07-11 13:24:29.303060 I | osd2:
- 2017-07-11 13:24:29.303103 I | osd2: 2017-07-11 13:24:29.303090 7f3d25d97c80 4 rocksdb: SST files in /var/lib/rook/osd2/current/omap dir, Total Num: 0, files:
- 2017-07-11 13:24:29.303118 I | osd2:
- 2017-07-11 13:24:29.303143 I | osd2: 2017-07-11 13:24:29.303130 7f3d25d97c80 4 rocksdb: Write Ahead Log file in /var/lib/rook/osd2/current/omap: 000006.log size: 98 ;
- 2017-07-11 13:24:29.303171 I | osd2:
- 2017-07-11 13:24:29.303200 I | osd2: 2017-07-11 13:24:29.303187 7f3d25d97c80 4 rocksdb: Options.error_if_exists: 0
- 2017-07-11 13:24:29.303226 I | osd2: 2017-07-11 13:24:29.303215 7f3d25d97c80 4 rocksdb: Options.create_if_missing: 1
- 2017-07-11 13:24:29.303286 I | osd2: 2017-07-11 13:24:29.303265 7f3d25d97c80 4 rocksdb: Options.paranoid_checks: 1
- 2017-07-11 13:24:29.303310 I | osd2: 2017-07-11 13:24:29.303300 7f3d25d97c80 4 rocksdb: Options.env: 0x55a66cdff8e0
- 2017-07-11 13:24:29.303348 I | osd2: 2017-07-11 13:24:29.303336 7f3d25d97c80 4 rocksdb: Options.info_log: 0x55a66dc4a560
- 2017-07-11 13:24:29.303372 I | osd2: 2017-07-11 13:24:29.303362 7f3d25d97c80 4 rocksdb: Options.max_open_files: -1
- 2017-07-11 13:24:29.303394 I | osd2: 2017-07-11 13:24:29.303384 7f3d25d97c80 4 rocksdb: Options.max_file_opening_threads: 16
- 2017-07-11 13:24:29.303432 I | osd2: 2017-07-11 13:24:29.303421 7f3d25d97c80 4 rocksdb: Options.use_fsync: 0
- 2017-07-11 13:24:29.303455 I | osd2: 2017-07-11 13:24:29.303446 7f3d25d97c80 4 rocksdb: Options.max_log_file_size: 0
- 2017-07-11 13:24:29.303491 I | osd2: 2017-07-11 13:24:29.303468 7f3d25d97c80 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2017-07-11 13:24:29.303515 I | osd2: 2017-07-11 13:24:29.303505 7f3d25d97c80 4 rocksdb: Options.log_file_time_to_roll: 0
- 2017-07-11 13:24:29.303537 I | osd2: 2017-07-11 13:24:29.303528 7f3d25d97c80 4 rocksdb: Options.keep_log_file_num: 1000
- 2017-07-11 13:24:29.303575 I | osd2: 2017-07-11 13:24:29.303551 7f3d25d97c80 4 rocksdb: Options.recycle_log_file_num: 0
- 2017-07-11 13:24:29.303598 I | osd2: 2017-07-11 13:24:29.303589 7f3d25d97c80 4 rocksdb: Options.allow_fallocate: 1
- 2017-07-11 13:24:29.303620 I | osd2: 2017-07-11 13:24:29.303611 7f3d25d97c80 4 rocksdb: Options.allow_mmap_reads: 0
- 2017-07-11 13:24:29.303656 I | osd2: 2017-07-11 13:24:29.303645 7f3d25d97c80 4 rocksdb: Options.allow_mmap_writes: 0
- 2017-07-11 13:24:29.303679 I | osd2: 2017-07-11 13:24:29.303669 7f3d25d97c80 4 rocksdb: Options.use_direct_reads: 0
- 2017-07-11 13:24:29.303701 I | osd2: 2017-07-11 13:24:29.303692 7f3d25d97c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2017-07-11 13:24:29.303738 I | osd2: 2017-07-11 13:24:29.303727 7f3d25d97c80 4 rocksdb: Options.create_missing_column_families: 0
- 2017-07-11 13:24:29.303761 I | osd2: 2017-07-11 13:24:29.303751 7f3d25d97c80 4 rocksdb: Options.db_log_dir:
- 2017-07-11 13:24:29.303809 I | osd2: 2017-07-11 13:24:29.303774 7f3d25d97c80 4 rocksdb: Options.wal_dir: /var/lib/rook/osd2/current/omap
- 2017-07-11 13:24:29.303837 I | osd2: 2017-07-11 13:24:29.303826 7f3d25d97c80 4 rocksdb: Options.table_cache_numshardbits: 6
- 2017-07-11 13:24:29.303863 I | osd2: 2017-07-11 13:24:29.303853 7f3d25d97c80 4 rocksdb: Options.max_subcompactions: 1
- 2017-07-11 13:24:29.303902 I | osd2: 2017-07-11 13:24:29.303891 7f3d25d97c80 4 rocksdb: Options.max_background_flushes: 1
- 2017-07-11 13:24:29.303924 I | osd2: 2017-07-11 13:24:29.303915 7f3d25d97c80 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2017-07-11 13:24:29.304022 I | osd2: 2017-07-11 13:24:29.304007 7f3d25d97c80 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2017-07-11 13:24:29.304063 I | osd2: 2017-07-11 13:24:29.304051 7f3d25d97c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2017-07-11 13:24:29.304585 I | osd2: 2017-07-11 13:24:29.304568 7f3d25d97c80 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2017-07-11 13:24:29.304619 I | osd2: 2017-07-11 13:24:29.304607 7f3d25d97c80 4 rocksdb: Options.advise_random_on_open: 1
- 2017-07-11 13:24:29.304663 I | osd2: 2017-07-11 13:24:29.304650 7f3d25d97c80 4 rocksdb: Options.db_write_buffer_size: 0
- 2017-07-11 13:24:29.304691 I | osd2: 2017-07-11 13:24:29.304680 7f3d25d97c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2017-07-11 13:24:29.304732 I | osd2: 2017-07-11 13:24:29.304707 7f3d25d97c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2017-07-11 13:24:29.304760 I | osd2: 2017-07-11 13:24:29.304749 7f3d25d97c80 4 rocksdb: Options.compaction_readahead_size: 0
- 2017-07-11 13:24:29.304803 I | osd2: 2017-07-11 13:24:29.304777 7f3d25d97c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2017-07-11 13:24:29.304833 I | osd2: 2017-07-11 13:24:29.304820 7f3d25d97c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2017-07-11 13:24:29.304859 I | osd2: 2017-07-11 13:24:29.304849 7f3d25d97c80 4 rocksdb: Options.use_adaptive_mutex: 0
- 2017-07-11 13:24:29.304901 I | osd2: 2017-07-11 13:24:29.304888 7f3d25d97c80 4 rocksdb: Options.rate_limiter: (nil)
- 2017-07-11 13:24:29.304929 I | osd2: 2017-07-11 13:24:29.304918 7f3d25d97c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2017-07-11 13:24:29.304969 I | osd2: 2017-07-11 13:24:29.304956 7f3d25d97c80 4 rocksdb: Options.bytes_per_sync: 0
- 2017-07-11 13:24:29.304997 I | osd2: 2017-07-11 13:24:29.304986 7f3d25d97c80 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2017-07-11 13:24:29.305039 I | osd2: 2017-07-11 13:24:29.305014 7f3d25d97c80 4 rocksdb: Options.wal_recovery_mode: 2
- 2017-07-11 13:24:29.305068 I | osd2: 2017-07-11 13:24:29.305057 7f3d25d97c80 4 rocksdb: Options.enable_thread_tracking: 0
- 2017-07-11 13:24:29.305095 I | osd2: 2017-07-11 13:24:29.305083 7f3d25d97c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2017-07-11 13:24:29.305161 I | osd2: 2017-07-11 13:24:29.305136 7f3d25d97c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2017-07-11 13:24:29.305208 I | osd2: 2017-07-11 13:24:29.305194 7f3d25d97c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2017-07-11 13:24:29.305242 I | osd2: 2017-07-11 13:24:29.305227 7f3d25d97c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2017-07-11 13:24:29.305300 I | osd2: 2017-07-11 13:24:29.305285 7f3d25d97c80 4 rocksdb: Options.row_cache: 26843546
- 2017-07-11 13:24:29.305333 I | osd2: 2017-07-11 13:24:29.305320 7f3d25d97c80 4 rocksdb: Options.wal_filter: None
- 2017-07-11 13:24:29.305379 I | osd2: 2017-07-11 13:24:29.305365 7f3d25d97c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2017-07-11 13:24:29.305410 I | osd2: 2017-07-11 13:24:29.305397 7f3d25d97c80 4 rocksdb: Options.base_background_compactions: 1
- 2017-07-11 13:24:29.305474 I | osd2: 2017-07-11 13:24:29.305462 7f3d25d97c80 4 rocksdb: Options.max_background_compactions: 1
- 2017-07-11 13:24:29.305502 I | osd2: 2017-07-11 13:24:29.305491 7f3d25d97c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2017-07-11 13:24:29.305541 I | osd2: 2017-07-11 13:24:29.305529 7f3d25d97c80 4 rocksdb: Options.delayed_write_rate : 16777216
- 2017-07-11 13:24:29.305568 I | osd2: 2017-07-11 13:24:29.305557 7f3d25d97c80 4 rocksdb: Options.max_total_wal_size: 0
- 2017-07-11 13:24:29.305612 I | osd2: 2017-07-11 13:24:29.305584 7f3d25d97c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2017-07-11 13:24:29.305642 I | osd2: 2017-07-11 13:24:29.305630 7f3d25d97c80 4 rocksdb: Options.stats_dump_period_sec: 600
- 2017-07-11 13:24:29.305681 I | osd2: 2017-07-11 13:24:29.305657 7f3d25d97c80 4 rocksdb: Compression algorithms supported:
- 2017-07-11 13:24:29.305710 I | osd2: 2017-07-11 13:24:29.305698 7f3d25d97c80 4 rocksdb: Snappy supported: 0
- 2017-07-11 13:24:29.305772 I | osd2: 2017-07-11 13:24:29.305726 7f3d25d97c80 4 rocksdb: Zlib supported: 0
- 2017-07-11 13:24:29.305804 I | osd2: 2017-07-11 13:24:29.305791 7f3d25d97c80 4 rocksdb: Bzip supported: 0
- 2017-07-11 13:24:29.305872 I | osd2: 2017-07-11 13:24:29.305858 7f3d25d97c80 4 rocksdb: LZ4 supported: 0
- 2017-07-11 13:24:29.305917 I | osd2: 2017-07-11 13:24:29.305890 7f3d25d97c80 4 rocksdb: ZSTD supported: 0
- 2017-07-11 13:24:29.305952 I | osd2: 2017-07-11 13:24:29.305940 7f3d25d97c80 4 rocksdb: Fast CRC32 supported: 1
- 2017-07-11 13:24:29.308601 I | osd2: 2017-07-11 13:24:29.308574 7f3d25d97c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000005
- 2017-07-11 13:24:29.308641 I | osd2:
- 2017-07-11 13:24:29.308846 I | osd2: 2017-07-11 13:24:29.308775 7f3d25d97c80 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2017-07-11 13:24:29.308866 I | osd2:
- 2017-07-11 13:24:29.308910 I | osd2: 2017-07-11 13:24:29.308894 7f3d25d97c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2017-07-11 13:24:29.308939 I | osd2: 2017-07-11 13:24:29.308926 7f3d25d97c80 4 rocksdb: Options.merge_operator:
- 2017-07-11 13:24:29.308979 I | osd2: 2017-07-11 13:24:29.308953 7f3d25d97c80 4 rocksdb: Options.compaction_filter: None
- 2017-07-11 13:24:29.309004 I | osd2: 2017-07-11 13:24:29.308994 7f3d25d97c80 4 rocksdb: Options.compaction_filter_factory: None
- 2017-07-11 13:24:29.309027 I | osd2: 2017-07-11 13:24:29.309017 7f3d25d97c80 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2017-07-11 13:24:29.309063 I | osd2: 2017-07-11 13:24:29.309052 7f3d25d97c80 4 rocksdb: Options.table_factory: BlockBasedTable
- 2017-07-11 13:24:29.309125 I | osd2: 2017-07-11 13:24:29.309094 7f3d25d97c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a66d8be1e0)
- 2017-07-11 13:24:29.309141 I | osd2: cache_index_and_filter_blocks: 0
- 2017-07-11 13:24:29.309154 I | osd2: cache_index_and_filter_blocks_with_high_priority: 0
- 2017-07-11 13:24:29.309164 I | osd2: pin_l0_filter_and_index_blocks_in_cache: 0
- 2017-07-11 13:24:29.309174 I | osd2: index_type: 0
- 2017-07-11 13:24:29.309183 I | osd2: hash_index_allow_collision: 1
- 2017-07-11 13:24:29.309204 I | osd2: checksum: 1
- 2017-07-11 13:24:29.309215 I | osd2: no_block_cache: 0
- 2017-07-11 13:24:29.309225 I | osd2: block_cache: 0x55a66d8e4620
- 2017-07-11 13:24:29.309234 I | osd2: block_cache_name: LRUCache
- 2017-07-11 13:24:29.309244 I | osd2: block_cache_options:
- 2017-07-11 13:24:29.309253 I | osd2: capacity : 107374182
- 2017-07-11 13:24:29.309282 I | osd2: num_shard_bits : 4
- 2017-07-11 13:24:29.309296 I | osd2: strict_capacity_limit : 0
- 2017-07-11 13:24:29.309306 I | osd2: high_pri_pool_ratio: 0.000
- 2017-07-11 13:24:29.309316 I | osd2: block_cache_compressed: (nil)
- 2017-07-11 13:24:29.309325 I | osd2: persistent_cache: (nil)
- 2017-07-11 13:24:29.309334 I | osd2: block_size: 4096
- 2017-07-11 13:24:29.317650 I | osd2: block_size_deviation: 10
- 2017-07-11 13:24:29.317684 I | osd2: block_restart_interval: 16
- 2017-07-11 13:24:29.317700 I | osd2: index_block_restart_interval: 1
- 2017-07-11 13:24:29.317740 I | osd2: filter_policy: nullptr
- 2017-07-11 13:24:29.317753 I | osd2: whole_key_filtering: 1
- 2017-07-11 13:24:29.317762 I | osd2: format_version: 2
- 2017-07-11 13:24:29.317773 I | osd2:
- 2017-07-11 13:24:29.317785 I | osd2: 2017-07-11 13:24:29.315231 7f3d25d97c80 4 rocksdb: Options.write_buffer_size: 67108864
- 2017-07-11 13:24:29.317802 I | osd2: 2017-07-11 13:24:29.315248 7f3d25d97c80 4 rocksdb: Options.max_write_buffer_number: 2
- 2017-07-11 13:24:29.317828 I | osd2: 2017-07-11 13:24:29.315255 7f3d25d97c80 4 rocksdb: Options.compression: NoCompression
- 2017-07-11 13:24:29.317839 I | osd2: 2017-07-11 13:24:29.315262 7f3d25d97c80 4 rocksdb: Options.bottommost_compression: Disabled
- 2017-07-11 13:24:29.317849 I | osd2: 2017-07-11 13:24:29.315267 7f3d25d97c80 4 rocksdb: Options.prefix_extractor: nullptr
- 2017-07-11 13:24:29.317862 I | osd2: 2017-07-11 13:24:29.315273 7f3d25d97c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2017-07-11 13:24:29.317872 I | osd2: 2017-07-11 13:24:29.315410 7f3d25d97c80 4 rocksdb: Options.num_levels: 7
- 2017-07-11 13:24:29.317893 I | osd2: 2017-07-11 13:24:29.315421 7f3d25d97c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2017-07-11 13:24:29.317906 I | osd2: 2017-07-11 13:24:29.315426 7f3d25d97c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2017-07-11 13:24:29.317949 I | osd2: 2017-07-11 13:24:29.315431 7f3d25d97c80 4 rocksdb: Options.compression_opts.window_bits: -14
- 2017-07-11 13:24:29.317980 I | osd2: 2017-07-11 13:24:29.315437 7f3d25d97c80 4 rocksdb: Options.compression_opts.level: -1
- 2017-07-11 13:24:29.317992 I | osd2: 2017-07-11 13:24:29.315442 7f3d25d97c80 4 rocksdb: Options.compression_opts.strategy: 0
- 2017-07-11 13:24:29.318005 I | osd2: 2017-07-11 13:24:29.315447 7f3d25d97c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2017-07-11 13:24:29.318016 I | osd2: 2017-07-11 13:24:29.315451 7f3d25d97c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2017-07-11 13:24:29.318026 I | osd2: 2017-07-11 13:24:29.315456 7f3d25d97c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2017-07-11 13:24:29.318035 I | osd2: 2017-07-11 13:24:29.315461 7f3d25d97c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2017-07-11 13:24:29.318056 I | osd2: 2017-07-11 13:24:29.315466 7f3d25d97c80 4 rocksdb: Options.target_file_size_base: 67108864
- 2017-07-11 13:24:29.318068 I | osd2: 2017-07-11 13:24:29.315471 7f3d25d97c80 4 rocksdb: Options.target_file_size_multiplier: 1
- 2017-07-11 13:24:29.318078 I | osd2: 2017-07-11 13:24:29.315483 7f3d25d97c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2017-07-11 13:24:29.318088 I | osd2: 2017-07-11 13:24:29.315489 7f3d25d97c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2017-07-11 13:24:29.318098 I | osd2: 2017-07-11 13:24:29.315494 7f3d25d97c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2017-07-11 13:24:29.318109 I | osd2: 2017-07-11 13:24:29.315501 7f3d25d97c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2017-07-11 13:24:29.318118 I | osd2: 2017-07-11 13:24:29.315506 7f3d25d97c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2017-07-11 13:24:29.318141 I | osd2: 2017-07-11 13:24:29.315510 7f3d25d97c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2017-07-11 13:24:29.318152 I | osd2: 2017-07-11 13:24:29.315515 7f3d25d97c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2017-07-11 13:24:29.318161 I | osd2: 2017-07-11 13:24:29.315520 7f3d25d97c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2017-07-11 13:24:29.318172 I | osd2: 2017-07-11 13:24:29.315524 7f3d25d97c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2017-07-11 13:24:29.318182 I | osd2: 2017-07-11 13:24:29.315529 7f3d25d97c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2017-07-11 13:24:29.318192 I | osd2: 2017-07-11 13:24:29.315534 7f3d25d97c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2017-07-11 13:24:29.318213 I | osd2: 2017-07-11 13:24:29.315538 7f3d25d97c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2017-07-11 13:24:29.318245 I | osd2: 2017-07-11 13:24:29.315543 7f3d25d97c80 4 rocksdb: Options.arena_block_size: 8388608
- 2017-07-11 13:24:29.318256 I | osd2: 2017-07-11 13:24:29.315548 7f3d25d97c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2017-07-11 13:24:29.318266 I | osd2: 2017-07-11 13:24:29.315552 7f3d25d97c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2017-07-11 13:24:29.318288 I | osd2: 2017-07-11 13:24:29.315557 7f3d25d97c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2017-07-11 13:24:29.318299 I | osd2: 2017-07-11 13:24:29.315561 7f3d25d97c80 4 rocksdb: Options.disable_auto_compactions: 0
- 2017-07-11 13:24:29.318309 I | osd2: 2017-07-11 13:24:29.315567 7f3d25d97c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2017-07-11 13:24:29.318319 I | osd2: 2017-07-11 13:24:29.315572 7f3d25d97c80 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2017-07-11 13:24:29.318330 I | osd2: 2017-07-11 13:24:29.315577 7f3d25d97c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2017-07-11 13:24:29.318363 I | osd2: 2017-07-11 13:24:29.315582 7f3d25d97c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2017-07-11 13:24:29.318377 I | osd2: 2017-07-11 13:24:29.315591 7f3d25d97c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2017-07-11 13:24:29.318389 I | osd2: 2017-07-11 13:24:29.315597 7f3d25d97c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2017-07-11 13:24:29.318409 I | osd2: 2017-07-11 13:24:29.315902 7f3d25d97c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2017-07-11 13:24:29.318422 I | osd2: 2017-07-11 13:24:29.315916 7f3d25d97c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2017-07-11 13:24:29.318447 I | osd2: 2017-07-11 13:24:29.315921 7f3d25d97c80 4 rocksdb: Options.table_properties_collectors:
- 2017-07-11 13:24:29.318459 I | osd2: 2017-07-11 13:24:29.315928 7f3d25d97c80 4 rocksdb: Options.inplace_update_support: 0
- 2017-07-11 13:24:29.318470 I | osd2: 2017-07-11 13:24:29.315933 7f3d25d97c80 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2017-07-11 13:24:29.318483 I | osd2: 2017-07-11 13:24:29.315938 7f3d25d97c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2017-07-11 13:24:29.318505 I | osd2: 2017-07-11 13:24:29.315944 7f3d25d97c80 4 rocksdb: Options.memtable_huge_page_size: 0
- 2017-07-11 13:24:29.318544 I | osd2: 2017-07-11 13:24:29.315950 7f3d25d97c80 4 rocksdb: Options.bloom_locality: 0
- 2017-07-11 13:24:29.318556 I | osd2: 2017-07-11 13:24:29.315960 7f3d25d97c80 4 rocksdb: Options.max_successive_merges: 0
- 2017-07-11 13:24:29.318568 I | osd2: 2017-07-11 13:24:29.315966 7f3d25d97c80 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2017-07-11 13:24:29.318579 I | osd2: 2017-07-11 13:24:29.315979 7f3d25d97c80 4 rocksdb: Options.paranoid_file_checks: 0
- 2017-07-11 13:24:29.318602 I | osd2: 2017-07-11 13:24:29.315985 7f3d25d97c80 4 rocksdb: Options.force_consistency_checks: 0
- 2017-07-11 13:24:29.318615 I | osd2: 2017-07-11 13:24:29.315990 7f3d25d97c80 4 rocksdb: Options.report_bg_io_stats: 0
- 2017-07-11 13:24:29.318632 I | osd2: 2017-07-11 13:24:29.316466 7f3d25d97c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/osd2/current/omap/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2017-07-11 13:24:29.318646 I | osd2:
- 2017-07-11 13:24:29.318657 I | osd2: 2017-07-11 13:24:29.316483 7f3d25d97c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 4
- 2017-07-11 13:24:29.318693 I | osd2:
- 2017-07-11 13:24:29.318706 I | osd2: 2017-07-11 13:24:29.316526 7f3d25d97c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779469316522, "job": 1, "event": "recovery_started", "log_files": [6]}
- 2017-07-11 13:24:29.318718 I | osd2: 2017-07-11 13:24:29.316549 7f3d25d97c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #6 mode 2
- 2017-07-11 13:24:29.333792 I | osd2: 2017-07-11 13:24:29.333574 7f3d25d97c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779469333557, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 882, "table_properties": {"data_size": 51, "index_size": 27, "filter_size": 0, "raw_key_size": 20, "raw_average_key_size": 20, "raw_value_size": 15, "raw_average_value_size": 15, "num_data_blocks": 1, "num_entries": 1, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2017-07-11 13:24:29.333827 I | osd2: 2017-07-11 13:24:29.333613 7f3d25d97c80 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 8
- 2017-07-11 13:24:29.333841 I | osd2:
- 2017-07-11 13:24:29.459858 I | osd2: 2017-07-11 13:24:29.459633 7f3d25d97c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1499779469459628, "job": 1, "event": "recovery_finished"}
- 2017-07-11 13:24:29.518874 I | osd2: 2017-07-11 13:24:29.518633 7f3d25d97c80 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55a66dc5e000
- 2017-07-11 13:24:29.518922 I | osd2: 2017-07-11 13:24:29.518747 7f3d25d97c80 0 filestore(/var/lib/rook/osd2) mount(1717): enabling WRITEAHEAD journal mode: checkpoint is not enabled
- 2017-07-11 13:24:29.518998 I | osd2: 2017-07-11 13:24:29.518824 7f3d25d97c80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
- 2017-07-11 13:24:29.567597 I | osd2: 2017-07-11 13:24:29.567557 7f3d25d97c80 0 osd.2 0 crush map has features 288232575208783872, adjusting msgr requires for clients
- 2017-07-11 13:24:29.567668 I | osd2: 2017-07-11 13:24:29.567652 7f3d25d97c80 0 osd.2 0 crush map has features 288232575208783872 was 8705, adjusting msgr requires for mons
- 2017-07-11 13:24:29.567723 I | osd2: 2017-07-11 13:24:29.567690 7f3d25d97c80 0 osd.2 0 crush map has features 288232575208783872, adjusting msgr requires for osds
- 2017-07-11 13:24:29.567845 I | osd2: 2017-07-11 13:24:29.567827 7f3d25d97c80 0 osd.2 0 load_pgs
- 2017-07-11 13:24:29.567913 I | osd2: 2017-07-11 13:24:29.567893 7f3d25d97c80 0 osd.2 0 load_pgs opened 0 pgs
- 2017-07-11 13:24:29.567964 I | osd2: 2017-07-11 13:24:29.567933 7f3d25d97c80 0 osd.2 0 using 1 op queue with priority op cut off at 64.
- 2017-07-11 13:24:29.574669 I | osd2: 2017-07-11 13:24:29.574647 7f3d25d97c80 -1 osd.2 0 log_to_monitors {default=true}
- 2017-07-11 13:24:30.386490 I | osd2: 2017-07-11 13:24:30.386458 7f3d25d97c80 0 osd.2 0 done with init, starting boot process
- 2017-07-11 13:24:30.393426 I | osd2: 2017-07-11 13:24:30.393356 7f3d0b501700 -1 osd.2 0 waiting for initial osdmap
- 2017-07-11 13:24:30.414126 I | osd2: 2017-07-11 13:24:30.413401 7f3d17d1a700 0 osd.2 10 crush map has features 2200130813952, adjusting msgr requires for clients
- 2017-07-11 13:24:30.414180 I | osd2: 2017-07-11 13:24:30.413407 7f3d17d1a700 0 osd.2 10 crush map has features 2200130813952 was 288232575208792577, adjusting msgr requires for mons
- 2017-07-11 13:24:30.414223 I | osd2: 2017-07-11 13:24:30.414029 7f3d17d1a700 0 osd.2 10 crush map has features 720578140510109696, adjusting msgr requires for osds
- 2017-07-11 13:24:56.578011 I | osd2: 2017-07-11 13:24:56.577683 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:36.577681)
- 2017-07-11 13:24:56.578076 I | osd2: 2017-07-11 13:24:56.577722 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:36.577681)
- 2017-07-11 13:24:57.578099 I | osd2: 2017-07-11 13:24:57.577969 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:37.577967)
- 2017-07-11 13:24:57.578219 I | osd2: 2017-07-11 13:24:57.578006 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:37.577967)
- 2017-07-11 13:24:58.578358 I | osd2: 2017-07-11 13:24:58.578171 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:38.578167)
- 2017-07-11 13:24:58.578478 I | osd2: 2017-07-11 13:24:58.578211 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:38.578167)
- 2017-07-11 13:24:59.578474 I | osd2: 2017-07-11 13:24:59.578392 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:39.578391)
- 2017-07-11 13:24:59.578535 I | osd2: 2017-07-11 13:24:59.578417 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:39.578391)
- 2017-07-11 13:25:00.578638 I | osd2: 2017-07-11 13:25:00.578543 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:40.578542)
- 2017-07-11 13:25:00.578724 I | osd2: 2017-07-11 13:25:00.578571 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:40.578542)
- 2017-07-11 13:25:01.580854 I | osd2: 2017-07-11 13:25:01.578914 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:41.578900)
- 2017-07-11 13:25:01.580941 I | osd2: 2017-07-11 13:25:01.578936 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:41.578900)
- 2017-07-11 13:25:02.581470 I | osd2: 2017-07-11 13:25:02.581148 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:42.581146)
- 2017-07-11 13:25:02.581539 I | osd2: 2017-07-11 13:25:02.581187 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:42.581146)
- 2017-07-11 13:25:02.581554 I | osd2: 2017-07-11 13:25:02.581393 7f3d1a51f700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.293208 secs
- 2017-07-11 13:25:02.581575 I | osd2: 2017-07-11 13:25:02.581404 7f3d1a51f700 0 log_channel(cluster) log [WRN] : slow request 30.293208 seconds old, received at 2017-07-11 13:24:32.288034: osd_pg_create(e12 0.5:2 0.7:2 0.9:2 0.12:2 0.13:2 0.14:2 0.15:2 0.16:2 0.17:2 0.1b:2 0.21:2 0.27:2 0.29:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.39:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5b:2 0.5f:2 0.60:2 0.63:2 0.6e:2 0.72:2 0.7a:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.95:2 0.98:2 0.9a:2 0.9d:2 0.9e:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.b8:2 0.ba:2 0.c0:2 0.c2:2 0.c5:2 0.cb:2 0.ce:2 0.d2:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.fe:2 0.100:2 0.106:2 0.107:2 0.10c:2 0.10d:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.127:2 0.128:2 0.12c:2 0.12f:2 0.131:2 0.133:2 0.134:2 0.141:2 0.142:2 0.14b:2 0.14d:2 0.159:2 0.15a:2 0.15c:2 0.160:2 0.161:2 0.166:2 0.169:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.17f:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1db:2 0.1e1:2 0.1e4:2 0.1e9:2 0.1ee:2 0.1f2:2 0.1f3:2 0.1f6:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.21d:2 0.21f:2 0.223:2 0.224:2 0.228:2 0.229:2 0.22b:2 0.22e:2 0.233:2 0.235:2 0.237:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.251:2 0.252:2 0.253:2 0.254:2 0.25c:2 0.265:2 0.267:2 0.269:2 0.26b:2 0.26c:2 0.26d:2 0.276:2 0.278:2 0.279:2 0.27b:2 0.27f:2 0.280:2 0.284:2 0.286:2 0.288:2 0.290:2 0.298:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b3:2 0.2b8:2 0.2b9:2 0.2bf:2 0.2c8:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2df:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ea:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30b:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32d:2 0.32f:2 0.330:2 0.334:2 0.336:2 0.33a:2 0.344:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.359:2 0.363:2 0.364:2 0.366:2 0.369:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b0:2 0.3b2:2 0.3b3:2 0.3b5:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3ed:2 0.3f4:2) currently started
- 2017-07-11 13:25:03.581739 I | osd2: 2017-07-11 13:25:03.581555 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:43.581553)
- 2017-07-11 13:25:03.581769 I | osd2: 2017-07-11 13:25:03.581584 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:43.581553)
- 2017-07-11 13:25:04.581842 I | osd2: 2017-07-11 13:25:04.581767 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:44.581766)
- 2017-07-11 13:25:04.581907 I | osd2: 2017-07-11 13:25:04.581784 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:44.581766)
- 2017-07-11 13:25:05.582052 I | osd2: 2017-07-11 13:25:05.581919 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:45.581918)
- 2017-07-11 13:25:05.582141 I | osd2: 2017-07-11 13:25:05.581947 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:45.581918)
- 2017-07-11 13:25:06.582371 I | osd2: 2017-07-11 13:25:06.582228 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:46.582226)
- 2017-07-11 13:25:06.582432 I | osd2: 2017-07-11 13:25:06.582262 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:46.582226)
- 2017-07-11 13:25:07.589717 I | osd2: 2017-07-11 13:25:07.586074 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:47.586071)
- 2017-07-11 13:25:07.589807 I | osd2: 2017-07-11 13:25:07.586111 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:47.586071)
- 2017-07-11 13:25:08.586395 I | osd2: 2017-07-11 13:25:08.586276 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:48.586274)
- 2017-07-11 13:25:08.586595 I | osd2: 2017-07-11 13:25:08.586303 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:48.586274)
- 2017-07-11 13:25:09.586548 I | osd2: 2017-07-11 13:25:09.586463 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:49.586462)
- 2017-07-11 13:25:09.586610 I | osd2: 2017-07-11 13:25:09.586488 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:49.586462)
- 2017-07-11 13:25:10.586921 I | osd2: 2017-07-11 13:25:10.586763 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:50.586761)
- 2017-07-11 13:25:10.587031 I | osd2: 2017-07-11 13:25:10.586791 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:50.586761)
- 2017-07-11 13:25:11.587071 I | osd2: 2017-07-11 13:25:11.587003 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:51.587002)
- 2017-07-11 13:25:11.587131 I | osd2: 2017-07-11 13:25:11.587018 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:51.587002)
- 2017-07-11 13:25:12.587402 I | osd2: 2017-07-11 13:25:12.587289 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:52.587288)
- 2017-07-11 13:25:12.587512 I | osd2: 2017-07-11 13:25:12.587478 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:52.587288)
- 2017-07-11 13:25:13.587711 I | osd2: 2017-07-11 13:25:13.587577 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:53.587575)
- 2017-07-11 13:25:13.587803 I | osd2: 2017-07-11 13:25:13.587615 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:53.587575)
- 2017-07-11 13:25:14.587785 I | osd2: 2017-07-11 13:25:14.587712 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:54.587711)
- 2017-07-11 13:25:14.587851 I | osd2: 2017-07-11 13:25:14.587729 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:54.587711)
- 2017-07-11 13:25:15.588007 I | osd2: 2017-07-11 13:25:15.587853 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:55.587852)
- 2017-07-11 13:25:15.588125 I | osd2: 2017-07-11 13:25:15.587879 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:55.587852)
- 2017-07-11 13:25:16.588307 I | osd2: 2017-07-11 13:25:16.588091 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:56.588090)
- 2017-07-11 13:25:16.588431 I | osd2: 2017-07-11 13:25:16.588123 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:56.588090)
- 2017-07-11 13:25:17.588514 I | osd2: 2017-07-11 13:25:17.588371 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:57.588368)
- 2017-07-11 13:25:17.588620 I | osd2: 2017-07-11 13:25:17.588405 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:57.588368)
- 2017-07-11 13:25:18.588708 I | osd2: 2017-07-11 13:25:18.588582 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:58.588581)
- 2017-07-11 13:25:18.588822 I | osd2: 2017-07-11 13:25:18.588613 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:58.588581)
- 2017-07-11 13:25:19.588901 I | osd2: 2017-07-11 13:25:19.588802 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:59.588801)
- 2017-07-11 13:25:19.588989 I | osd2: 2017-07-11 13:25:19.588817 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:24:59.588801)
- 2017-07-11 13:25:20.589040 I | osd2: 2017-07-11 13:25:20.588935 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:00.588933)
- 2017-07-11 13:25:20.589108 I | osd2: 2017-07-11 13:25:20.588949 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:00.588933)
- 2017-07-11 13:25:21.589212 I | osd2: 2017-07-11 13:25:21.589126 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:01.589125)
- 2017-07-11 13:25:21.589275 I | osd2: 2017-07-11 13:25:21.589140 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:01.589125)
- 2017-07-11 13:25:22.589461 I | osd2: 2017-07-11 13:25:22.589293 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:02.589290)
- 2017-07-11 13:25:22.589569 I | osd2: 2017-07-11 13:25:22.589324 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:02.589290)
- 2017-07-11 13:25:23.589605 I | osd2: 2017-07-11 13:25:23.589535 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:03.589534)
- 2017-07-11 13:25:23.589662 I | osd2: 2017-07-11 13:25:23.589553 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:03.589534)
- 2017-07-11 13:25:24.589855 I | osd2: 2017-07-11 13:25:24.589709 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:04.589707)
- 2017-07-11 13:25:24.589935 I | osd2: 2017-07-11 13:25:24.589741 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:04.589707)
- 2017-07-11 13:25:25.589999 I | osd2: 2017-07-11 13:25:25.589920 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:05.589919)
- 2017-07-11 13:25:25.590024 I | osd2: 2017-07-11 13:25:25.589943 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:05.589919)
- 2017-07-11 13:25:26.590112 I | osd2: 2017-07-11 13:25:26.590006 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:06.590005)
- 2017-07-11 13:25:26.590174 I | osd2: 2017-07-11 13:25:26.590022 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:06.590005)
- 2017-07-11 13:25:27.590320 I | osd2: 2017-07-11 13:25:27.590181 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:07.590180)
- 2017-07-11 13:25:27.590417 I | osd2: 2017-07-11 13:25:27.590205 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:07.590180)
- 2017-07-11 13:25:28.590561 I | osd2: 2017-07-11 13:25:28.590411 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:08.590410)
- 2017-07-11 13:25:28.590641 I | osd2: 2017-07-11 13:25:28.590479 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:08.590410)
- 2017-07-11 13:25:29.590659 I | osd2: 2017-07-11 13:25:29.590578 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:09.590577)
- 2017-07-11 13:25:29.590733 I | osd2: 2017-07-11 13:25:29.590591 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:09.590577)
- 2017-07-11 13:25:30.590796 I | osd2: 2017-07-11 13:25:30.590717 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:10.590716)
- 2017-07-11 13:25:30.590857 I | osd2: 2017-07-11 13:25:30.590736 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:10.590716)
- 2017-07-11 13:25:31.591018 I | osd2: 2017-07-11 13:25:31.590893 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:11.590890)
- 2017-07-11 13:25:31.591144 I | osd2: 2017-07-11 13:25:31.590924 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:11.590890)
- 2017-07-11 13:25:32.591202 I | osd2: 2017-07-11 13:25:32.591093 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:12.591092)
- 2017-07-11 13:25:32.591272 I | osd2: 2017-07-11 13:25:32.591110 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:12.591092)
- 2017-07-11 13:25:32.591289 I | osd2: 2017-07-11 13:25:32.591134 7f3d1a51f700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 60.303083 secs
- 2017-07-11 13:25:32.591309 I | osd2: 2017-07-11 13:25:32.591149 7f3d1a51f700 0 log_channel(cluster) log [WRN] : slow request 60.303083 seconds old, received at 2017-07-11 13:24:32.288034: osd_pg_create(e12 0.5:2 0.7:2 0.9:2 0.12:2 0.13:2 0.14:2 0.15:2 0.16:2 0.17:2 0.1b:2 0.21:2 0.27:2 0.29:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.39:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5b:2 0.5f:2 0.60:2 0.63:2 0.6e:2 0.72:2 0.7a:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.95:2 0.98:2 0.9a:2 0.9d:2 0.9e:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.b8:2 0.ba:2 0.c0:2 0.c2:2 0.c5:2 0.cb:2 0.ce:2 0.d2:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.fe:2 0.100:2 0.106:2 0.107:2 0.10c:2 0.10d:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.127:2 0.128:2 0.12c:2 0.12f:2 0.131:2 0.133:2 0.134:2 0.141:2 0.142:2 0.14b:2 0.14d:2 0.159:2 0.15a:2 0.15c:2 0.160:2 0.161:2 0.166:2 0.169:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.17f:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1db:2 0.1e1:2 0.1e4:2 0.1e9:2 0.1ee:2 0.1f2:2 0.1f3:2 0.1f6:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.21d:2 0.21f:2 0.223:2 0.224:2 0.228:2 0.229:2 0.22b:2 0.22e:2 0.233:2 0.235:2 0.237:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.251:2 0.252:2 0.253:2 0.254:2 0.25c:2 0.265:2 0.267:2 0.269:2 0.26b:2 0.26c:2 0.26d:2 0.276:2 0.278:2 0.279:2 0.27b:2 0.27f:2 0.280:2 0.284:2 0.286:2 0.288:2 0.290:2 0.298:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b3:2 0.2b8:2 0.2b9:2 0.2bf:2 0.2c8:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2df:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ea:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30b:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32d:2 0.32f:2 0.330:2 0.334:2 0.336:2 0.33a:2 0.344:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.359:2 0.363:2 0.364:2 0.366:2 0.369:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b0:2 0.3b2:2 0.3b3:2 0.3b5:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3ed:2 0.3f4:2) currently started
- 2017-07-11 13:25:33.591387 I | osd2: 2017-07-11 13:25:33.591275 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:13.591274)
- 2017-07-11 13:25:33.591465 I | osd2: 2017-07-11 13:25:33.591294 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:13.591274)
- 2017-07-11 13:25:34.591532 I | osd2: 2017-07-11 13:25:34.591438 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:14.591437)
- 2017-07-11 13:25:34.591594 I | osd2: 2017-07-11 13:25:34.591455 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:14.591437)
- 2017-07-11 13:25:35.595121 I | osd2: 2017-07-11 13:25:35.595014 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:15.595012)
- 2017-07-11 13:25:35.605004 I | osd2: 2017-07-11 13:25:35.595040 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:15.595012)
- 2017-07-11 13:25:36.595302 I | osd2: 2017-07-11 13:25:36.595228 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:16.595227)
- 2017-07-11 13:25:36.595366 I | osd2: 2017-07-11 13:25:36.595244 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:16.595227)
- 2017-07-11 13:25:37.595434 I | osd2: 2017-07-11 13:25:37.595361 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:17.595360)
- 2017-07-11 13:25:37.595510 I | osd2: 2017-07-11 13:25:37.595377 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:17.595360)
- 2017-07-11 13:25:38.595788 I | osd2: 2017-07-11 13:25:38.595508 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:18.595507)
- 2017-07-11 13:25:38.595851 I | osd2: 2017-07-11 13:25:38.595551 7f3d1a51f700 -1 osd.2 12 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:18.595507)
- 2017-07-11 13:25:38.595868 I | osd2: 2017-07-11 13:25:38.595702 7f3d1a51f700 0 log_channel(cluster) log [WRN] : 2 slow requests, 2 included below; oldest blocked for > 65.997406 secs
- 2017-07-11 13:25:38.595920 I | osd2: 2017-07-11 13:25:38.595708 7f3d1a51f700 0 log_channel(cluster) log [WRN] : slow request 65.997406 seconds old, received at 2017-07-11 13:24:32.598200: osd_pg_create(e13 0.5:2 0.7:2 0.9:2 0.12:2 0.13:2 0.14:2 0.15:2 0.16:2 0.17:2 0.1b:2 0.21:2 0.27:2 0.29:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.39:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5b:2 0.5f:2 0.60:2 0.63:2 0.6e:2 0.72:2 0.7a:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.95:2 0.98:2 0.9a:2 0.9d:2 0.9e:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.b8:2 0.ba:2 0.c0:2 0.c2:2 0.c5:2 0.cb:2 0.ce:2 0.d2:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.fe:2 0.100:2 0.106:2 0.107:2 0.10c:2 0.10d:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.127:2 0.128:2 0.12c:2 0.12f:2 0.131:2 0.133:2 0.134:2 0.141:2 0.142:2 0.14b:2 0.14d:2 0.159:2 0.15a:2 0.15c:2 0.160:2 0.161:2 0.166:2 0.169:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.17f:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1db:2 0.1e1:2 0.1e4:2 0.1e9:2 0.1ee:2 0.1f2:2 0.1f3:2 0.1f6:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.21d:2 0.21f:2 0.223:2 0.224:2 0.228:2 0.229:2 0.22b:2 0.22e:2 0.233:2 0.235:2 0.237:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.251:2 0.252:2 0.253:2 0.254:2 0.25c:2 0.265:2 0.267:2 0.269:2 0.26b:2 0.26c:2 0.26d:2 0.276:2 0.278:2 0.279:2 0.27b:2 0.27f:2 0.280:2 0.284:2 0.286:2 0.288:2 0.290:2 0.298:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b3:2 0.2b8:2 0.2b9:2 0.2bf:2 0.2c8:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2df:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ea:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30b:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32d:2 0.32f:2 0.330:2 0.334:2 0.336:2 0.33a:2 0.344:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.359:2 0.363:2 0.364:2 0.366:2 0.369:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b0:2 0.3b2:2 0.3b3:2 0.3b5:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3ed:2 0.3f4:2) currently wait for new map
- 2017-07-11 13:25:38.595954 I | osd2: 2017-07-11 13:25:38.595722 7f3d1a51f700 0 log_channel(cluster) log [WRN] : slow request 64.714804 seconds old, received at 2017-07-11 13:24:33.880802: osd_pg_create(e14 0.5:2 0.7:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2a:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.50:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.72:2 0.7d:2 0.7f:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.91:2 0.92:2 0.94:2 0.9a:2 0.9d:2 0.a5:2 0.a7:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.c2:2 0.c5:2 0.d8:2 0.e0:2 0.e5:2 0.eb:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.127:2 0.12c:2 0.131:2 0.133:2 0.141:2 0.14d:2 0.159:2 0.15c:2 0.161:2 0.166:2 0.16f:2 0.17a:2 0.17b:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.198:2 0.199:2 0.1b7:2 0.1c2:2 0.1c9:2 0.1ce:2 0.1d2:2 0.1da:2 0.1e1:2 0.1f2:2 0.1f3:2 0.1ff:2 0.200:2 0.201:2 0.203:2 0.213:2 0.218:2 0.21a:2 0.21f:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.23d:2 0.248:2 0.24a:2 0.24b:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26b:2 0.26d:2 0.278:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2cb:2 0.2ce:2 0.2d3:2 0.2d7:2 0.2da:2 0.2db:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f6:2 0.2fd:2 0.306:2 0.30e:2 0.31b:2 0.32f:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.356:2 0.363:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d2:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2) currently wait for new map
- 2017-07-11 13:25:39.596130 I | osd2: 2017-07-11 13:25:39.595839 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:19.595837)
- 2017-07-11 13:25:39.596196 I | osd2: 2017-07-11 13:25:39.595867 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:19.595837)
- 2017-07-11 13:25:39.596213 I | osd2: 2017-07-11 13:25:39.596036 7f3d1a51f700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 62.798606 secs
- 2017-07-11 13:25:39.596231 I | osd2: 2017-07-11 13:25:39.596069 7f3d1a51f700 0 log_channel(cluster) log [WRN] : slow request 62.798606 seconds old, received at 2017-07-11 13:24:36.797317: osd_pg_create(e15 0.5:2 0.7:2 0.9:2 0.f:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.70:2 0.7a:2 0.7d:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.92:2 0.94:2 0.97:2 0.98:2 0.9a:2 0.9d:2 0.a5:2 0.a8:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.ba:2 0.c2:2 0.c5:2 0.c9:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.12c:2 0.134:2 0.141:2 0.143:2 0.14b:2 0.14d:2 0.15c:2 0.161:2 0.166:2 0.16c:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19a:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b5:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1e1:2 0.1e9:2 0.1f2:2 0.1f3:2 0.1fd:2 0.1fe:2 0.1ff:2 0.200:2 0.201:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.248:2 0.24a:2 0.24b:2 0.24f:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26a:2 0.26b:2 0.26d:2 0.276:2 0.279:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2f8:2 0.2fd:2 0.306:2 0.30e:2 0.313:2 0.315:2 0.31b:2 0.322:2 0.327:2 0.32f:2 0.330:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.386:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d4:2 0.3d8:2 0.3db:2 0.3dd:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:40.596267 I | osd2: 2017-07-11 13:25:40.596171 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:20.596169)
- 2017-07-11 13:25:40.596328 I | osd2: 2017-07-11 13:25:40.596186 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:20.596169)
- 2017-07-11 13:25:40.596343 I | osd2: 2017-07-11 13:25:40.596213 7f3d1a51f700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 63.798877 secs
- 2017-07-11 13:25:40.596361 I | osd2: 2017-07-11 13:25:40.596219 7f3d1a51f700 0 log_channel(cluster) log [WRN] : slow request 63.798877 seconds old, received at 2017-07-11 13:24:36.797317: osd_pg_create(e15 0.5:2 0.7:2 0.9:2 0.f:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.70:2 0.7a:2 0.7d:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.92:2 0.94:2 0.97:2 0.98:2 0.9a:2 0.9d:2 0.a5:2 0.a8:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.ba:2 0.c2:2 0.c5:2 0.c9:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.ec:2 0.f0:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.12c:2 0.134:2 0.141:2 0.143:2 0.14b:2 0.14d:2 0.15c:2 0.161:2 0.166:2 0.16c:2 0.16f:2 0.178:2 0.17a:2 0.17b:2 0.180:2 0.189:2 0.18c:2 0.191:2 0.197:2 0.198:2 0.199:2 0.19a:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b5:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1d2:2 0.1d8:2 0.1da:2 0.1e1:2 0.1e9:2 0.1f2:2 0.1f3:2 0.1fd:2 0.1fe:2 0.1ff:2 0.200:2 0.201:2 0.20a:2 0.213:2 0.218:2 0.21a:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.248:2 0.24a:2 0.24b:2 0.24f:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26a:2 0.26b:2 0.26d:2 0.276:2 0.279:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b8:2 0.2b9:2 0.2ba:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d5:2 0.2d7:2 0.2da:2 0.2db:2 0.2e0:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2f8:2 0.2fd:2 0.306:2 0.30e:2 0.313:2 0.315:2 0.31b:2 0.322:2 0.327:2 0.32f:2 0.330:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.386:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d4:2 0.3d8:2 0.3db:2 0.3dd:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2 0.3fe:2) currently wait for new map
- 2017-07-11 13:25:41.596408 I | osd2: 2017-07-11 13:25:41.596322 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:21.596321)
- 2017-07-11 13:25:41.596470 I | osd2: 2017-07-11 13:25:41.596338 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:21.596321)
- 2017-07-11 13:25:42.596563 I | osd2: 2017-07-11 13:25:42.596459 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:22.596457)
- 2017-07-11 13:25:42.596653 I | osd2: 2017-07-11 13:25:42.596479 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:22.596457)
- 2017-07-11 13:25:43.596747 I | osd2: 2017-07-11 13:25:43.596635 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:23.596634)
- 2017-07-11 13:25:43.596824 I | osd2: 2017-07-11 13:25:43.596654 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:23.596634)
- 2017-07-11 13:25:44.596905 I | osd2: 2017-07-11 13:25:44.596821 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:24.596820)
- 2017-07-11 13:25:44.596968 I | osd2: 2017-07-11 13:25:44.596847 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:24.596820)
- 2017-07-11 13:25:45.602822 I | osd2: 2017-07-11 13:25:45.602742 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:25.602741)
- 2017-07-11 13:25:45.602959 I | osd2: 2017-07-11 13:25:45.602764 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:25.602741)
- 2017-07-11 13:25:46.602992 I | osd2: 2017-07-11 13:25:46.602920 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:26.602919)
- 2017-07-11 13:25:46.603091 I | osd2: 2017-07-11 13:25:46.602936 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:26.602919)
- 2017-07-11 13:25:47.603119 I | osd2: 2017-07-11 13:25:47.603030 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:27.603029)
- 2017-07-11 13:25:47.603186 I | osd2: 2017-07-11 13:25:47.603061 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:27.603029)
- 2017-07-11 13:25:48.603454 I | osd2: 2017-07-11 13:25:48.603266 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:28.603264)
- 2017-07-11 13:25:48.603564 I | osd2: 2017-07-11 13:25:48.603317 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:28.603264)
- 2017-07-11 13:25:49.603556 I | osd2: 2017-07-11 13:25:49.603474 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:29.603473)
- 2017-07-11 13:25:49.603622 I | osd2: 2017-07-11 13:25:49.603487 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:29.603473)
- 2017-07-11 13:25:50.604176 I | osd2: 2017-07-11 13:25:50.604102 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:30.604101)
- 2017-07-11 13:25:50.604244 I | osd2: 2017-07-11 13:25:50.604115 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:30.604101)
- 2017-07-11 13:25:51.604294 I | osd2: 2017-07-11 13:25:51.604180 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:31.604179)
- 2017-07-11 13:25:51.604386 I | osd2: 2017-07-11 13:25:51.604195 7f3d1a51f700 -1 osd.2 15 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:24:35.975630 (cutoff 2017-07-11 13:25:31.604179)
- 2017-07-11 13:25:52.187351 I | osd2: 2017-07-11 13:25:52.187080 7f3d17d1a700 0 log_channel(cluster) log [WRN] : map e18 wrongly marked me down at e18
- 2017-07-11 13:25:52.604449 I | osd2: 2017-07-11 13:25:52.604400 7f3d1a51f700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 70.890580 secs
- 2017-07-11 13:25:52.604517 I | osd2: 2017-07-11 13:25:52.604410 7f3d1a51f700 0 log_channel(cluster) log [WRN] : slow request 70.890580 seconds old, received at 2017-07-11 13:24:41.713752: osd_pg_create(e17 0.5:2 0.7:2 0.9:2 0.12:2 0.15:2 0.16:2 0.1b:2 0.21:2 0.27:2 0.2b:2 0.31:2 0.32:2 0.33:2 0.34:2 0.3a:2 0.3c:2 0.3f:2 0.43:2 0.47:2 0.4b:2 0.56:2 0.57:2 0.58:2 0.5f:2 0.63:2 0.6e:2 0.7a:2 0.7d:2 0.82:2 0.84:2 0.85:2 0.8a:2 0.8e:2 0.92:2 0.94:2 0.98:2 0.9a:2 0.9d:2 0.a5:2 0.ab:2 0.af:2 0.b3:2 0.b6:2 0.ba:2 0.c2:2 0.c5:2 0.d8:2 0.dc:2 0.e0:2 0.e5:2 0.eb:2 0.f7:2 0.f9:2 0.fa:2 0.fd:2 0.106:2 0.107:2 0.10c:2 0.11c:2 0.11e:2 0.121:2 0.126:2 0.12c:2 0.141:2 0.14d:2 0.15c:2 0.161:2 0.166:2 0.16f:2 0.178:2 0.17a:2 0.180:2 0.189:2 0.18c:2 0.197:2 0.199:2 0.19d:2 0.1b0:2 0.1b1:2 0.1b7:2 0.1b8:2 0.1ba:2 0.1c2:2 0.1c9:2 0.1cb:2 0.1ce:2 0.1da:2 0.1e1:2 0.1e9:2 0.1f2:2 0.1f3:2 0.1ff:2 0.200:2 0.201:2 0.213:2 0.218:2 0.21a:2 0.223:2 0.224:2 0.22e:2 0.233:2 0.248:2 0.24a:2 0.24b:2 0.252:2 0.253:2 0.25c:2 0.269:2 0.26b:2 0.26d:2 0.276:2 0.279:2 0.280:2 0.286:2 0.290:2 0.2a0:2 0.2a2:2 0.2ad:2 0.2af:2 0.2b8:2 0.2b9:2 0.2cb:2 0.2ce:2 0.2d1:2 0.2d3:2 0.2d7:2 0.2da:2 0.2db:2 0.2e2:2 0.2e6:2 0.2ef:2 0.2f5:2 0.2f6:2 0.2fd:2 0.306:2 0.30e:2 0.313:2 0.31b:2 0.327:2 0.32f:2 0.330:2 0.336:2 0.349:2 0.34c:2 0.34e:2 0.351:2 0.352:2 0.356:2 0.358:2 0.364:2 0.366:2 0.36b:2 0.378:2 0.381:2 0.383:2 0.387:2 0.388:2 0.389:2 0.394:2 0.396:2 0.39f:2 0.3a0:2 0.3a3:2 0.3b2:2 0.3b3:2 0.3b7:2 0.3cc:2 0.3d4:2 0.3d8:2 0.3db:2 0.3e2:2 0.3e5:2 0.3e7:2 0.3e8:2 0.3f4:2) currently wait for new map
- 2017-07-11 13:26:18.608315 I | osd2: 2017-07-11 13:26:18.608159 7f3d1a51f700 -1 osd.2 36 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:25:58.608157)
- 2017-07-11 13:26:18.608374 I | osd2: 2017-07-11 13:26:18.608187 7f3d1a51f700 -1 osd.2 36 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:25:58.608157)
- 2017-07-11 13:26:19.608535 I | osd2: 2017-07-11 13:26:19.608415 7f3d1a51f700 -1 osd.2 36 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:25:59.608413)
- 2017-07-11 13:26:19.608632 I | osd2: 2017-07-11 13:26:19.608444 7f3d1a51f700 -1 osd.2 36 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:25:59.608413)
- 2017-07-11 13:26:20.608663 I | osd2: 2017-07-11 13:26:20.608584 7f3d1a51f700 -1 osd.2 36 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:00.608583)
- 2017-07-11 13:26:20.608732 I | osd2: 2017-07-11 13:26:20.608606 7f3d1a51f700 -1 osd.2 36 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:00.608583)
- 2017-07-11 13:26:21.608829 I | osd2: 2017-07-11 13:26:21.608765 7f3d1a51f700 -1 osd.2 36 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:01.608764)
- 2017-07-11 13:26:21.608925 I | osd2: 2017-07-11 13:26:21.608780 7f3d1a51f700 -1 osd.2 36 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:01.608764)
- 2017-07-11 13:26:22.609073 I | osd2: 2017-07-11 13:26:22.608911 7f3d1a51f700 -1 osd.2 36 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:02.608909)
- 2017-07-11 13:26:22.609199 I | osd2: 2017-07-11 13:26:22.608945 7f3d1a51f700 -1 osd.2 36 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:02.608909)
- 2017-07-11 13:26:23.609278 I | osd2: 2017-07-11 13:26:23.609135 7f3d1a51f700 -1 osd.2 36 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:03.609133)
- 2017-07-11 13:26:23.609336 I | osd2: 2017-07-11 13:26:23.609165 7f3d1a51f700 -1 osd.2 36 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:03.609133)
- 2017-07-11 13:26:24.609435 I | osd2: 2017-07-11 13:26:24.609344 7f3d1a51f700 -1 osd.2 51 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:04.609343)
- 2017-07-11 13:26:24.609498 I | osd2: 2017-07-11 13:26:24.609359 7f3d1a51f700 -1 osd.2 51 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:04.609343)
- 2017-07-11 13:26:25.609621 I | osd2: 2017-07-11 13:26:25.609506 7f3d1a51f700 -1 osd.2 51 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:05.609504)
- 2017-07-11 13:26:25.609727 I | osd2: 2017-07-11 13:26:25.609534 7f3d1a51f700 -1 osd.2 51 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:05.609504)
- 2017-07-11 13:26:26.609836 I | osd2: 2017-07-11 13:26:26.609721 7f3d1a51f700 -1 osd.2 54 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:06.609719)
- 2017-07-11 13:26:26.609925 I | osd2: 2017-07-11 13:26:26.609749 7f3d1a51f700 -1 osd.2 54 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:06.609719)
- 2017-07-11 13:26:27.610078 I | osd2: 2017-07-11 13:26:27.609922 7f3d1a51f700 -1 osd.2 54 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:07.609919)
- 2017-07-11 13:26:27.610153 I | osd2: 2017-07-11 13:26:27.609951 7f3d1a51f700 -1 osd.2 54 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:07.609919)
- 2017-07-11 13:26:28.610338 I | osd2: 2017-07-11 13:26:28.610159 7f3d1a51f700 -1 osd.2 55 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:08.610157)
- 2017-07-11 13:26:28.610452 I | osd2: 2017-07-11 13:26:28.610200 7f3d1a51f700 -1 osd.2 55 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:08.610157)
- 2017-07-11 13:26:29.610466 I | osd2: 2017-07-11 13:26:29.610392 7f3d1a51f700 -1 osd.2 56 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:09.610391)
- 2017-07-11 13:26:29.610541 I | osd2: 2017-07-11 13:26:29.610409 7f3d1a51f700 -1 osd.2 56 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:09.610391)
- 2017-07-11 13:26:30.610681 I | osd2: 2017-07-11 13:26:30.610543 7f3d1a51f700 -1 osd.2 56 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:10.610541)
- 2017-07-11 13:26:30.610749 I | osd2: 2017-07-11 13:26:30.610560 7f3d1a51f700 -1 osd.2 56 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:10.610541)
- 2017-07-11 13:26:31.610964 I | osd2: 2017-07-11 13:26:31.610829 7f3d1a51f700 -1 osd.2 57 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:11.610815)
- 2017-07-11 13:26:31.611026 I | osd2: 2017-07-11 13:26:31.610896 7f3d1a51f700 -1 osd.2 57 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:11.610815)
- 2017-07-11 13:26:32.611168 I | osd2: 2017-07-11 13:26:32.611081 7f3d1a51f700 -1 osd.2 57 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:12.611079)
- 2017-07-11 13:26:32.611245 I | osd2: 2017-07-11 13:26:32.611109 7f3d1a51f700 -1 osd.2 57 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:12.611079)
- 2017-07-11 13:26:33.611363 I | osd2: 2017-07-11 13:26:33.611279 7f3d1a51f700 -1 osd.2 57 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:13.611277)
- 2017-07-11 13:26:33.611423 I | osd2: 2017-07-11 13:26:33.611308 7f3d1a51f700 -1 osd.2 57 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:13.611277)
- 2017-07-11 13:26:34.611590 I | osd2: 2017-07-11 13:26:34.611454 7f3d1a51f700 -1 osd.2 57 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:14.611451)
- 2017-07-11 13:26:34.611845 I | osd2: 2017-07-11 13:26:34.611496 7f3d1a51f700 -1 osd.2 57 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:14.611451)
- 2017-07-11 13:26:35.611747 I | osd2: 2017-07-11 13:26:35.611631 7f3d1a51f700 -1 osd.2 60 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:15.611630)
- 2017-07-11 13:26:35.611855 I | osd2: 2017-07-11 13:26:35.611661 7f3d1a51f700 -1 osd.2 60 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:15.611630)
- 2017-07-11 13:26:36.611932 I | osd2: 2017-07-11 13:26:36.611796 7f3d1a51f700 -1 osd.2 60 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:16.611793)
- 2017-07-11 13:26:36.612007 I | osd2: 2017-07-11 13:26:36.611853 7f3d1a51f700 -1 osd.2 60 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:16.611793)
- 2017-07-11 13:26:37.612099 I | osd2: 2017-07-11 13:26:37.611990 7f3d1a51f700 -1 osd.2 60 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:17.611989)
- 2017-07-11 13:26:37.612169 I | osd2: 2017-07-11 13:26:37.612042 7f3d1a51f700 -1 osd.2 60 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:17.611989)
- 2017-07-11 13:26:38.612495 I | osd2: 2017-07-11 13:26:38.612200 7f3d1a51f700 -1 osd.2 62 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:18.612198)
- 2017-07-11 13:26:38.612608 I | osd2: 2017-07-11 13:26:38.612390 7f3d1a51f700 -1 osd.2 62 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:18.612198)
- 2017-07-11 13:26:39.612905 I | osd2: 2017-07-11 13:26:39.612803 7f3d1a51f700 -1 osd.2 63 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:19.612802)
- 2017-07-11 13:26:39.612964 I | osd2: 2017-07-11 13:26:39.612818 7f3d1a51f700 -1 osd.2 63 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:19.612802)
- 2017-07-11 13:26:40.613030 I | osd2: 2017-07-11 13:26:40.612940 7f3d1a51f700 -1 osd.2 64 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:20.612939)
- 2017-07-11 13:26:40.613126 I | osd2: 2017-07-11 13:26:40.612955 7f3d1a51f700 -1 osd.2 64 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:20.612939)
- 2017-07-11 13:26:41.613154 I | osd2: 2017-07-11 13:26:41.613058 7f3d1a51f700 -1 osd.2 64 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:21.613046)
- 2017-07-11 13:26:41.613211 I | osd2: 2017-07-11 13:26:41.613081 7f3d1a51f700 -1 osd.2 64 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:21.613046)
- 2017-07-11 13:26:42.613247 I | osd2: 2017-07-11 13:26:42.613180 7f3d1a51f700 -1 osd.2 66 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:22.613179)
- 2017-07-11 13:26:42.613310 I | osd2: 2017-07-11 13:26:42.613197 7f3d1a51f700 -1 osd.2 66 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:22.613179)
- 2017-07-11 13:26:43.613435 I | osd2: 2017-07-11 13:26:43.613309 7f3d1a51f700 -1 osd.2 66 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:23.613307)
- 2017-07-11 13:26:43.613514 I | osd2: 2017-07-11 13:26:43.613371 7f3d1a51f700 -1 osd.2 66 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:23.613307)
- 2017-07-11 13:26:44.613610 I | osd2: 2017-07-11 13:26:44.613468 7f3d1a51f700 -1 osd.2 66 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:24.613466)
- 2017-07-11 13:26:44.613853 I | osd2: 2017-07-11 13:26:44.613507 7f3d1a51f700 -1 osd.2 66 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:24.613466)
- 2017-07-11 13:26:45.613764 I | osd2: 2017-07-11 13:26:45.613643 7f3d1a51f700 -1 osd.2 66 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:25.613641)
- 2017-07-11 13:26:45.613869 I | osd2: 2017-07-11 13:26:45.613673 7f3d1a51f700 -1 osd.2 66 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:25:57.796772 (cutoff 2017-07-11 13:26:25.613641)
- 2017-07-11 13:27:09.617280 I | osd2: 2017-07-11 13:27:09.617197 7f3d1a51f700 -1 osd.2 83 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.703138 (cutoff 2017-07-11 13:26:49.617196)
- 2017-07-11 13:27:10.617465 I | osd2: 2017-07-11 13:27:10.617358 7f3d1a51f700 -1 osd.2 83 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.703138 (cutoff 2017-07-11 13:26:50.617356)
- 2017-07-11 13:27:11.617670 I | osd2: 2017-07-11 13:27:11.617593 7f3d1a51f700 -1 osd.2 83 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.703138 (cutoff 2017-07-11 13:26:51.617590)
- 2017-07-11 13:27:12.617954 I | osd2: 2017-07-11 13:27:12.617816 7f3d1a51f700 -1 osd.2 83 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.703138 (cutoff 2017-07-11 13:26:52.617814)
- 2017-07-11 13:27:13.618139 I | osd2: 2017-07-11 13:27:13.618013 7f3d1a51f700 -1 osd.2 83 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.703138 (cutoff 2017-07-11 13:26:53.618010)
- 2017-07-11 13:27:14.618353 I | osd2: 2017-07-11 13:27:14.618269 7f3d1a51f700 -1 osd.2 83 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.703138 (cutoff 2017-07-11 13:26:54.618265)
- 2017-07-11 13:27:15.618485 I | osd2: 2017-07-11 13:27:15.618422 7f3d1a51f700 -1 osd.2 83 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.703138 (cutoff 2017-07-11 13:26:55.618421)
- 2017-07-11 13:27:16.618692 I | osd2: 2017-07-11 13:27:16.618585 7f3d1a51f700 -1 osd.2 83 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:26:56.204018 (cutoff 2017-07-11 13:26:56.618583)
- 2017-07-11 13:27:16.618755 I | osd2: 2017-07-11 13:27:16.618613 7f3d1a51f700 -1 osd.2 83 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:26:48.703138 (cutoff 2017-07-11 13:26:56.618583)
- 2017-07-11 13:27:16.663737 I | osd2: 2017-07-11 13:27:16.663301 7f3d17d1a700 0 log_channel(cluster) log [WRN] : map e86 wrongly marked me down at e86
- 2017-07-11 13:27:37.625129 I | osd2: 2017-07-11 13:27:37.625021 7f3d1a51f700 -1 osd.2 92 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:17.092488 (cutoff 2017-07-11 13:27:17.625020)
- 2017-07-11 13:27:38.625316 I | osd2: 2017-07-11 13:27:38.625196 7f3d1a51f700 -1 osd.2 92 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:17.092488 (cutoff 2017-07-11 13:27:18.625194)
- 2017-07-11 13:27:39.625540 I | osd2: 2017-07-11 13:27:39.625314 7f3d1a51f700 -1 osd.2 92 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:17.092488 (cutoff 2017-07-11 13:27:19.625313)
- 2017-07-11 13:27:40.625534 I | osd2: 2017-07-11 13:27:40.625462 7f3d1a51f700 -1 osd.2 92 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:17.092488 (cutoff 2017-07-11 13:27:20.625461)
- 2017-07-11 13:27:41.625702 I | osd2: 2017-07-11 13:27:41.625626 7f3d1a51f700 -1 osd.2 92 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:17.092488 (cutoff 2017-07-11 13:27:21.625625)
- 2017-07-11 13:27:42.625886 I | osd2: 2017-07-11 13:27:42.625781 7f3d1a51f700 -1 osd.2 95 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:17.092488 (cutoff 2017-07-11 13:27:22.625778)
- 2017-07-11 13:27:43.626023 I | osd2: 2017-07-11 13:27:43.625941 7f3d1a51f700 -1 osd.2 96 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:17.092488 (cutoff 2017-07-11 13:27:23.625939)
- 2017-07-11 13:27:44.626243 I | osd2: 2017-07-11 13:27:44.626102 7f3d1a51f700 -1 osd.2 97 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:17.092488 (cutoff 2017-07-11 13:27:24.626101)
- 2017-07-11 13:27:45.626390 I | osd2: 2017-07-11 13:27:45.626299 7f3d1a51f700 -1 osd.2 98 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:17.092488 (cutoff 2017-07-11 13:27:25.626297)
- 2017-07-11 13:28:04.631045 I | osd2: 2017-07-11 13:28:04.630955 7f3d1a51f700 -1 osd.2 111 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:44.630954)
- 2017-07-11 13:28:05.631217 I | osd2: 2017-07-11 13:28:05.631083 7f3d1a51f700 -1 osd.2 111 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:45.631081)
- 2017-07-11 13:28:06.631403 I | osd2: 2017-07-11 13:28:06.631293 7f3d1a51f700 -1 osd.2 111 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:46.631274)
- 2017-07-11 13:28:07.631529 I | osd2: 2017-07-11 13:28:07.631437 7f3d1a51f700 -1 osd.2 111 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:47.631435)
- 2017-07-11 13:28:08.634720 I | osd2: 2017-07-11 13:28:08.634550 7f3d1a51f700 -1 osd.2 111 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:48.634548)
- 2017-07-11 13:28:09.635302 I | osd2: 2017-07-11 13:28:09.634719 7f3d1a51f700 -1 osd.2 111 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:49.634717)
- 2017-07-11 13:28:10.635558 I | osd2: 2017-07-11 13:28:10.635500 7f3d1a51f700 -1 osd.2 111 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:50.635499)
- 2017-07-11 13:28:11.635780 I | osd2: 2017-07-11 13:28:11.635698 7f3d1a51f700 -1 osd.2 111 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:51.635696)
- 2017-07-11 13:28:12.635953 I | osd2: 2017-07-11 13:28:12.635842 7f3d1a51f700 -1 osd.2 117 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:52.635839)
- 2017-07-11 13:28:13.636208 I | osd2: 2017-07-11 13:28:13.636058 7f3d1a51f700 -1 osd.2 120 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:53.636054)
- 2017-07-11 13:28:14.636308 I | osd2: 2017-07-11 13:28:14.636253 7f3d1a51f700 -1 osd.2 121 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:54.636251)
- 2017-07-11 13:28:15.636617 I | osd2: 2017-07-11 13:28:15.636412 7f3d1a51f700 -1 osd.2 121 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:27:55.636410)
- 2017-07-11 13:28:15.636688 I | osd2: 2017-07-11 13:28:15.636433 7f3d1a51f700 -1 osd.2 121 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:55.636410)
- 2017-07-11 13:28:16.636689 I | osd2: 2017-07-11 13:28:16.636615 7f3d1a51f700 -1 osd.2 122 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:27:56.636614)
- 2017-07-11 13:28:16.636746 I | osd2: 2017-07-11 13:28:16.636640 7f3d1a51f700 -1 osd.2 122 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:56.636614)
- 2017-07-11 13:28:17.636974 I | osd2: 2017-07-11 13:28:17.636845 7f3d1a51f700 -1 osd.2 123 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:27:57.636844)
- 2017-07-11 13:28:17.637039 I | osd2: 2017-07-11 13:28:17.636865 7f3d1a51f700 -1 osd.2 123 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:57.636844)
- 2017-07-11 13:28:18.637245 I | osd2: 2017-07-11 13:28:18.637096 7f3d1a51f700 -1 osd.2 124 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:27:58.637093)
- 2017-07-11 13:28:18.637319 I | osd2: 2017-07-11 13:28:18.637123 7f3d1a51f700 -1 osd.2 124 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:58.637093)
- 2017-07-11 13:28:19.637432 I | osd2: 2017-07-11 13:28:19.637326 7f3d1a51f700 -1 osd.2 124 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:27:59.637325)
- 2017-07-11 13:28:19.637491 I | osd2: 2017-07-11 13:28:19.637352 7f3d1a51f700 -1 osd.2 124 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:27:59.637325)
- 2017-07-11 13:28:20.637600 I | osd2: 2017-07-11 13:28:20.637503 7f3d1a51f700 -1 osd.2 125 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:00.637502)
- 2017-07-11 13:28:20.637657 I | osd2: 2017-07-11 13:28:20.637519 7f3d1a51f700 -1 osd.2 125 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:00.637502)
- 2017-07-11 13:28:21.637758 I | osd2: 2017-07-11 13:28:21.637672 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:01.637671)
- 2017-07-11 13:28:21.637818 I | osd2: 2017-07-11 13:28:21.637688 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:01.637671)
- 2017-07-11 13:28:22.638209 I | osd2: 2017-07-11 13:28:22.638076 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:02.638075)
- 2017-07-11 13:28:22.638315 I | osd2: 2017-07-11 13:28:22.638117 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:02.638075)
- 2017-07-11 13:28:23.638475 I | osd2: 2017-07-11 13:28:23.638396 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:03.638395)
- 2017-07-11 13:28:23.638540 I | osd2: 2017-07-11 13:28:23.638421 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:03.638395)
- 2017-07-11 13:28:24.638766 I | osd2: 2017-07-11 13:28:24.638604 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:04.638602)
- 2017-07-11 13:28:24.638834 I | osd2: 2017-07-11 13:28:24.638642 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:04.638602)
- 2017-07-11 13:28:25.638879 I | osd2: 2017-07-11 13:28:25.638798 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:05.638797)
- 2017-07-11 13:28:25.638935 I | osd2: 2017-07-11 13:28:25.638814 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:05.638797)
- 2017-07-11 13:28:26.639225 I | osd2: 2017-07-11 13:28:26.639087 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:06.639084)
- 2017-07-11 13:28:26.639282 I | osd2: 2017-07-11 13:28:26.639127 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:06.639084)
- 2017-07-11 13:28:27.639435 I | osd2: 2017-07-11 13:28:27.639307 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:07.639306)
- 2017-07-11 13:28:27.639494 I | osd2: 2017-07-11 13:28:27.639358 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:07.639306)
- 2017-07-11 13:28:28.639660 I | osd2: 2017-07-11 13:28:28.639546 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:08.639545)
- 2017-07-11 13:28:28.639775 I | osd2: 2017-07-11 13:28:28.639574 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:08.639545)
- 2017-07-11 13:28:29.639865 I | osd2: 2017-07-11 13:28:29.639730 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:09.639729)
- 2017-07-11 13:28:29.639931 I | osd2: 2017-07-11 13:28:29.639746 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:09.639729)
- 2017-07-11 13:28:30.640032 I | osd2: 2017-07-11 13:28:30.639914 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:10.639913)
- 2017-07-11 13:28:30.640128 I | osd2: 2017-07-11 13:28:30.639943 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:10.639913)
- 2017-07-11 13:28:31.640695 I | osd2: 2017-07-11 13:28:31.640579 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:11.640578)
- 2017-07-11 13:28:31.640760 I | osd2: 2017-07-11 13:28:31.640606 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:11.640578)
- 2017-07-11 13:28:32.640817 I | osd2: 2017-07-11 13:28:32.640710 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:12.640701)
- 2017-07-11 13:28:32.640872 I | osd2: 2017-07-11 13:28:32.640724 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:12.640701)
- 2017-07-11 13:28:33.640935 I | osd2: 2017-07-11 13:28:33.640845 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:13.640843)
- 2017-07-11 13:28:33.641004 I | osd2: 2017-07-11 13:28:33.640873 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:13.640843)
- 2017-07-11 13:28:34.641079 I | osd2: 2017-07-11 13:28:34.640980 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:14.640979)
- 2017-07-11 13:28:34.641145 I | osd2: 2017-07-11 13:28:34.641005 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:14.640979)
- 2017-07-11 13:28:35.641210 I | osd2: 2017-07-11 13:28:35.641146 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:15.641145)
- 2017-07-11 13:28:35.641269 I | osd2: 2017-07-11 13:28:35.641161 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:15.641145)
- 2017-07-11 13:28:36.641560 I | osd2: 2017-07-11 13:28:36.641428 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:16.641426)
- 2017-07-11 13:28:36.641664 I | osd2: 2017-07-11 13:28:36.641468 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:16.641426)
- 2017-07-11 13:28:37.641835 I | osd2: 2017-07-11 13:28:37.641704 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:17.641702)
- 2017-07-11 13:28:37.641941 I | osd2: 2017-07-11 13:28:37.641743 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:17.641702)
- 2017-07-11 13:28:38.642039 I | osd2: 2017-07-11 13:28:38.641967 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:18.641964)
- 2017-07-11 13:28:38.642095 I | osd2: 2017-07-11 13:28:38.641989 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:18.641964)
- 2017-07-11 13:28:39.642187 I | osd2: 2017-07-11 13:28:39.642118 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:19.642117)
- 2017-07-11 13:28:39.642252 I | osd2: 2017-07-11 13:28:39.642133 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:19.642117)
- 2017-07-11 13:28:40.642322 I | osd2: 2017-07-11 13:28:40.642242 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:20.642241)
- 2017-07-11 13:28:40.642387 I | osd2: 2017-07-11 13:28:40.642256 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:20.642241)
- 2017-07-11 13:28:41.642653 I | osd2: 2017-07-11 13:28:41.642482 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:21.642480)
- 2017-07-11 13:28:41.642762 I | osd2: 2017-07-11 13:28:41.642521 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:21.642480)
- 2017-07-11 13:28:42.642935 I | osd2: 2017-07-11 13:28:42.642804 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:22.642802)
- 2017-07-11 13:28:42.643043 I | osd2: 2017-07-11 13:28:42.642843 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:22.642802)
- 2017-07-11 13:28:43.643121 I | osd2: 2017-07-11 13:28:43.643008 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:23.643006)
- 2017-07-11 13:28:43.643216 I | osd2: 2017-07-11 13:28:43.643035 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:23.643006)
- 2017-07-11 13:28:44.643297 I | osd2: 2017-07-11 13:28:44.643212 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:24.643210)
- 2017-07-11 13:28:44.643356 I | osd2: 2017-07-11 13:28:44.643241 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:24.643210)
- 2017-07-11 13:28:45.643430 I | osd2: 2017-07-11 13:28:45.643364 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:25.643363)
- 2017-07-11 13:28:45.643488 I | osd2: 2017-07-11 13:28:45.643379 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:25.643363)
- 2017-07-11 13:28:46.643598 I | osd2: 2017-07-11 13:28:46.643512 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.72.0:6806 osd.0 ever on either front or back, first ping sent 2017-07-11 13:27:55.599162 (cutoff 2017-07-11 13:28:26.643511)
- 2017-07-11 13:28:46.643671 I | osd2: 2017-07-11 13:28:46.643539 7f3d1a51f700 -1 osd.2 126 heartbeat_check: no reply from 10.233.86.0:6806 osd.3 ever on either front or back, first ping sent 2017-07-11 13:27:44.596766 (cutoff 2017-07-11 13:28:26.643511)
- 2017-07-11 13:28:46.720678 I | osd2: 2017-07-11 13:28:46.720298 7f3d17d1a700 0 log_channel(cluster) log [WRN] : map e127 wrongly marked me down at e127
- 2017-07-11 13:29:17.647753 I | osd2: 2017-07-11 13:29:17.647614 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:28:57.647613)
- 2017-07-11 13:29:17.647818 I | osd2: 2017-07-11 13:29:17.647641 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:28:57.647613)
- 2017-07-11 13:29:18.647940 I | osd2: 2017-07-11 13:29:18.647816 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:28:58.647814)
- 2017-07-11 13:29:18.648007 I | osd2: 2017-07-11 13:29:18.647843 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:28:58.647814)
- 2017-07-11 13:29:19.648086 I | osd2: 2017-07-11 13:29:19.648015 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:28:59.648014)
- 2017-07-11 13:29:19.648158 I | osd2: 2017-07-11 13:29:19.648031 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:28:59.648014)
- 2017-07-11 13:29:20.648251 I | osd2: 2017-07-11 13:29:20.648159 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:00.648158)
- 2017-07-11 13:29:20.648313 I | osd2: 2017-07-11 13:29:20.648173 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:00.648158)
- 2017-07-11 13:29:21.648573 I | osd2: 2017-07-11 13:29:21.648457 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:01.648456)
- 2017-07-11 13:29:21.648637 I | osd2: 2017-07-11 13:29:21.648501 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:01.648456)
- 2017-07-11 13:29:22.648926 I | osd2: 2017-07-11 13:29:22.648802 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:02.648801)
- 2017-07-11 13:29:22.648988 I | osd2: 2017-07-11 13:29:22.648827 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:02.648801)
- 2017-07-11 13:29:23.649240 I | osd2: 2017-07-11 13:29:23.649104 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:03.649102)
- 2017-07-11 13:29:23.649346 I | osd2: 2017-07-11 13:29:23.649144 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:03.649102)
- 2017-07-11 13:29:24.649472 I | osd2: 2017-07-11 13:29:24.649384 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:04.649383)
- 2017-07-11 13:29:24.649553 I | osd2: 2017-07-11 13:29:24.649412 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:04.649383)
- 2017-07-11 13:29:25.649636 I | osd2: 2017-07-11 13:29:25.649557 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:05.649544)
- 2017-07-11 13:29:25.649696 I | osd2: 2017-07-11 13:29:25.649572 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:05.649544)
- 2017-07-11 13:29:26.659098 I | osd2: 2017-07-11 13:29:26.650616 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:06.650615)
- 2017-07-11 13:29:26.659183 I | osd2: 2017-07-11 13:29:26.650640 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:06.650615)
- 2017-07-11 13:29:27.650998 I | osd2: 2017-07-11 13:29:27.650870 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:07.650868)
- 2017-07-11 13:29:27.651061 I | osd2: 2017-07-11 13:29:27.650911 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:07.650868)
- 2017-07-11 13:29:28.651273 I | osd2: 2017-07-11 13:29:28.651140 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:08.651138)
- 2017-07-11 13:29:28.651388 I | osd2: 2017-07-11 13:29:28.651167 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:08.651138)
- 2017-07-11 13:29:29.651543 I | osd2: 2017-07-11 13:29:29.651385 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:09.651383)
- 2017-07-11 13:29:29.651607 I | osd2: 2017-07-11 13:29:29.651403 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:09.651383)
- 2017-07-11 13:29:29.651623 I | osd2: 2017-07-11 13:29:29.651419 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:08.705932 front 2017-07-11 13:29:08.705932 (cutoff 2017-07-11 13:29:09.651383)
- 2017-07-11 13:29:30.651620 I | osd2: 2017-07-11 13:29:30.651551 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:10.651550)
- 2017-07-11 13:29:30.651681 I | osd2: 2017-07-11 13:29:30.651563 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:10.651550)
- 2017-07-11 13:29:30.651696 I | osd2: 2017-07-11 13:29:30.651566 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:08.705932 front 2017-07-11 13:29:08.705932 (cutoff 2017-07-11 13:29:10.651550)
- 2017-07-11 13:29:31.651769 I | osd2: 2017-07-11 13:29:31.651679 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:11.651678)
- 2017-07-11 13:29:31.651846 I | osd2: 2017-07-11 13:29:31.651705 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:11.651678)
- 2017-07-11 13:29:31.651863 I | osd2: 2017-07-11 13:29:31.651709 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:08.705932 front 2017-07-11 13:29:08.705932 (cutoff 2017-07-11 13:29:11.651678)
- 2017-07-11 13:29:32.651971 I | osd2: 2017-07-11 13:29:32.651866 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.72.0:6803 osd.0 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:12.651865)
- 2017-07-11 13:29:32.652027 I | osd2: 2017-07-11 13:29:32.651889 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.86.0:6803 osd.3 ever on either front or back, first ping sent 2017-07-11 13:28:57.005054 (cutoff 2017-07-11 13:29:12.651865)
- 2017-07-11 13:29:32.652048 I | osd2: 2017-07-11 13:29:32.651893 7f3d1a51f700 -1 osd.2 131 heartbeat_check: no reply from 10.233.99.6:6805 osd.5 since back 2017-07-11 13:29:08.705932 front 2017-07-11 13:29:08.705932 (cutoff 2017-07-11 13:29:12.651865)
- END logs from pod: rook-ceph-osd-zzkmt
- BEGIN logs from pod: rook-tools
- END logs from pod: rook-tools
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement